CN117615197A

CN117615197A - Multi-window display method and display device

Info

Publication number: CN117615197A
Application number: CN202310490743.0A
Authority: CN
Inventors: 周小萌; 刘兆磊; 杨鲁明; 李金昆
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2023-04-28
Filing date: 2023-04-28
Publication date: 2024-02-27

Abstract

The embodiment of the application discloses a multi-window display method and display equipment, which relate to the technical field of display, and can reduce the operation of a user when multi-window display is needed, so that the experience of the user is improved. The specific scheme is as follows: responding to a received multi-window display instruction input by a user, and determining a current use scene, wherein the current use scene comprises an HDMI scene, a DLNA scene or a full scene; determining at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates based on the current use scene, and displaying the at least one multi-window display template; the plurality of multi-window display templates includes a first multi-window display template; and responding to the received selection operation of the user on the first multi-window display template, and performing multi-window display based on the first multi-window display template.

Description

Multi-window display method and display device

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to a multi-window display method and a display device.

Background

With the development of large screen displays, more and more display devices may include large screen displays. When the electronic device includes a large screen display (e.g., a television), the electronic device may support the functionality of a multi-window display. The multi-window display refers to an interface that can simultaneously display a plurality of application programs on a display interface of one electronic device.

For example, when the display device includes a large screen display, the user may select a multi-window display function on the electronic device, so that the user may throw a screen on the display of the electronic device to display an interface of other electronic devices, while the user may watch television on the display of the electronic device.

However, when the user needs the display device to perform multi-window display, the user needs to perform operations such as selecting a display area position, which results in complicated operations for the user when the electronic device performs multi-window display.

Disclosure of Invention

The embodiment of the application provides a multi-window display method and display equipment, which are used for solving the problem that the operation of a user is complex when the display equipment performs multi-window display.

In order to achieve the above purpose, the embodiments of the present application adopt the following technical solutions: in a first aspect, embodiments of the present application provide

A display device, the display device comprising: a display; a memory storing a plurality of multi-window display templates; a communicator configured to receive an operation of a user; a controller coupled with the display, the memory, and the communicator and configured to: responding to a multi-window display instruction received by a communicator and input by a user, and determining a current use scene of the display equipment, wherein the current use scene comprises an HDMI scene, a DLNA scene or a full scene; determining at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates based on the current use scene, and controlling a display to display the at least one multi-window display template; the plurality of multi-window display templates includes a first multi-window display template; and responding to a selection operation instruction of a user on the first multi-window display template received by the communicator, and controlling the display to display multiple windows based on the first multi-window display template.

With reference to the first aspect, in another optional manner, the current usage scenario is an HDMI scenario, and the first multi-window display template includes a first display area and at least one second display area, and the controller is configured to: controlling a display to display data corresponding to the HDMI in a first display area; and controlling the display to display the screen throwing data corresponding to the first electronic equipment in the second display area, or displaying the data corresponding to the local display equipment in the second display area.

With reference to the first aspect, in another optional manner, the current usage scenario is a DLNA scenario, and the first multi-window display template includes a third display area and a fourth display area, and the controller is configured to: controlling a display to display screen throwing data corresponding to the second electronic equipment in a third display area; controlling a display to display screen throwing data corresponding to the third electronic equipment in a fourth display area; the screen projection data corresponding to the second electronic device are different from the screen projection data corresponding to the third electronic device.

With reference to the first aspect, in another optional manner, the current usage scenario is a full scenario, and the first multi-window display template includes a fifth display area and a sixth display area, and the controller is configured to: controlling a display to display data locally corresponding to the display device in a fifth display area; the display is controlled, data corresponding to the local display equipment are displayed in a sixth display area, or screen projection data corresponding to fourth electronic equipment are displayed in the sixth display area, or data corresponding to HDMI is displayed in the sixth display area; wherein the data locally corresponding to the display device displayed in the fifth display area is different from the data locally corresponding to the display device displayed in the sixth display area.

With reference to the first aspect, in another optional manner, the current usage scenario is a full scenario, and the first multi-window display template includes a plurality of seventh display areas, and the controller is configured to: controlling a display to display screen throwing data corresponding to a plurality of fifth electronic devices in a plurality of seventh display areas respectively; the screen projection data corresponding to the fifth electronic devices are different.

With reference to the first aspect, in another alternative manner, the controller is further configured to: responsive to the communicator receiving a user modification operation of at least one multi-window display template corresponding to a current usage scenario, modifying the at least one multi-window display template; the modification operation comprises a new addition operation, a deletion operation or a position adjustment operation; the control memory stores the modified at least one multi-window display template.

With reference to the first aspect, in another alternative manner, the controller is further configured to: under the condition that the display performs multi-window display based on the first multi-window display template, responding to the communicator to receive the binding operation of a user on the preset key, and binding the preset key with the first multi-window display template; and responding to the trigger operation of the user on the preset key received by the communicator, and controlling the display to display multiple windows based on the first multi-window display template.

With reference to the first aspect, in another alternative manner, the controller is further configured to: and under the condition that the display performs multi-window display based on the first multi-window display template, controlling the display not to display a second multi-window display template, wherein the second multi-window display template is a multi-window display template except the first multi-window display template in the plurality of multi-window display templates.

In a second aspect, the present application further provides a multi-window display method, where the multi-window display method includes: responding to a received multi-window display instruction input by a user, and determining a current use scene; the current use scene comprises an HDMI scene, a DLNA scene or a full scene; determining at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates based on the current use scene, and displaying the at least one multi-window display template; the plurality of multi-window display templates includes a first multi-window display template; responding to a received selection operation instruction of a user on the first multi-window display template, and performing multi-window display based on the first multi-window display template.

In a third aspect, the present application also provides a multi-window display device, including: a receiving module, a determining module, a display module and the like.

The receiving module can be used for receiving a multi-window display instruction input by a user.

The determining module may be configured to determine, in response to a received multi-window display instruction input by a user, a current usage scenario, where the current usage scenario includes an HDMI scenario, a DLNA scenario, or a full scenario.

The determining module is further configured to determine at least one multi-window display template corresponding to the current usage scenario among the multiple multi-window display templates based on the current usage scenario.

The display module is also used for displaying at least one multi-window display template corresponding to the determined current use scene.

The receiving module is further configured to receive a selection operation of the user on the first multi-window display template.

The display module is further used for responding to the received selection operation of the user on the first multi-window display template and performing multi-window display based on the first multi-window display template.

In a fourth aspect, there is provided a display device including: a processor; the processor is configured to couple to the memory and execute the multi-window display method according to the second aspect according to the instruction after reading the instruction in the memory.

In a fifth aspect, there is provided a computer readable storage medium having instructions stored therein which, when run on a computer, cause the computer to perform the multi-window display method of the second aspect described above.

In a sixth aspect, there is provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the multi-window display method of the second aspect described above.

According to the scheme provided by the application, firstly, a multi-window display instruction input by a user is received, and the current use scene is determined; the current use scene comprises an HDMI scene, a DLNA scene or a full scene; then, based on the current use scene, determining at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates, and displaying the multi-window display templates; and finally, after receiving the selection operation of the user on the multi-window display template, displaying the multi-window based on the multi-window display template.

According to the scheme, under an actual use scene, a user selects a needed multi-window display template from a plurality of multi-window display templates according to the current use scene. That is, the scheme of the application can customize the multi-window display template according to the actual use scene of the user, unify multi-window display operation, simplify the multi-window display operation flow, expand the use range of the multi-window, thereby improving the user interaction experience and optimizing the multi-window display effect.

According to the scheme, under the current use scene, a user can select a needed multi-window display template through a plurality of multi-window display templates corresponding to the current use scene, so that the multi-window display template displays multi-window data. That is, according to the scheme provided by the application, a user does not need to perform operations such as a display area and the like under an actual use scene, and only needs to select the multi-window display template to display multi-window data, so that the operation of the user can be reduced, and the experience of the user is improved.

Drawings

Fig. 1 is a schematic diagram of a multi-window display method according to an embodiment of the present application.

Fig. 2 is a schematic flow chart of a multi-window display method according to an embodiment of the present application.

Fig. 3 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment of the present application;

fig. 4 is a schematic hardware structure of a control device 100 according to an embodiment of the present application;

fig. 5 is a schematic hardware structure diagram of a display device 200 according to an embodiment of the present application;

fig. 6 is one of software configuration diagrams of a display device 200 according to an embodiment of the present application;

fig. 7 is a second schematic software structure of a display device 200 according to the embodiment of the present application;

Fig. 8 is a timing diagram of a multi-window display method according to an embodiment of the present application;

FIG. 9 is a third schematic diagram of a system design of a display device according to an embodiment of the present disclosure;

FIG. 10 is a second flowchart of a multi-window display method according to an embodiment of the present disclosure;

FIG. 11 is a schematic diagram of a display interface of a multi-window display method according to an embodiment of the present application;

FIG. 12 is a second diagram of a display interface of a multi-window display method according to an embodiment of the present disclosure;

FIG. 13 is a third schematic diagram of a display interface of a multi-window display method according to an embodiment of the present disclosure;

FIG. 14 is a diagram illustrating a display interface of a multi-window display method according to an embodiment of the present disclosure;

FIG. 15 is a schematic diagram of a display interface of a plurality of multi-window display templates according to an embodiment of the present application;

FIG. 16 is a diagram of a display interface of a multi-window display method according to an embodiment of the present disclosure;

fig. 17 is a schematic diagram of a display interface for selecting a conference template according to an embodiment of the present application;

FIG. 18 is a third diagram illustrating a multi-window display method according to an embodiment of the present disclosure;

FIG. 19 is a schematic diagram of a display interface for modifying a multi-window display template according to an embodiment of the present application;

FIG. 20 is a diagram illustrating a second intention of a display interface for modifying a multi-window display template according to an embodiment of the present application;

FIG. 21 is a schematic diagram of a display interface for storing a multi-window display template according to an embodiment of the present application;

fig. 22 is a schematic structural diagram of a multi-window display device according to an embodiment of the present application.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "and/or" in this application is merely an association relation describing an associated object, and indicates that three relations may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the front and rear association objects are an or relationship.

With the development of large screen displays, more and more display devices may include large screen displays. Where the display device includes a large screen display (e.g., a television), the display device may support the functionality of a multi-window display. The multi-window display refers to an interface that can simultaneously display a plurality of application programs on a display interface of one display device. When the multi-window display is performed, the screen (i.e., the display) of the display device may include a plurality of windows, that is, the screen may be divided into two display areas, or may be divided into three display areas, or may be divided into a plurality of display areas, and the displayed multi-windows may be superimposed to form a picture-in-picture style, so that each window may display a different interface.

For example, where the display device includes a large screen display, the user may select a multi-window display function on the display device. Then, the screen of the display device may include two windows, and the user may display one interface by means of screen projection or the like, and display the other interface by means of watching television live broadcast or the like, so that the user may watch television live broadcast on the display of the display device while displaying the interfaces of other electronic devices on the display of the display device by means of screen projection or the like.

The screen projection can comprise a mirror image screen projection and a digital living network alliance ((digital living network alllance, DLNA) screen projection, wherein the DLNA screen projection refers to an interconnection function existing on electronic equipment, wireless connection can be established between other electronic equipment and display equipment, then screen projection data to be projected on the other electronic equipment are sent to the display equipment through the established wireless connection, and finally the display equipment receives the screen projection data to display in real time.

The mirror image screen projection refers to that the mobile terminal is connected to the display device in a wired or wireless mode, so that the screen projection of an interface displayed in the mobile terminal is performed on the display device, and the display device displays the content corresponding to the screen projection data sent by the mobile terminal in real time. When a user performs mirror image screen projection on a mobile terminal and a display device, the mobile terminal and the display device are usually required to be connected in a local area network formed by the same router in advance. In the mirror image screen-throwing process, the mobile terminal records the screen of the content displayed by the mobile terminal in real time, and sends the screen-recording data to the display equipment through the router, and the display equipment decodes and displays in real time after receiving the screen-recording data.

For example, the display device may define a multi-window display function as a function in which a home page in a screen-cast scene appears simultaneously with a screen-cast multi-window. The multi-window display scene can be limited under the mirror image scene of the mobile phone, the homepage and the mirror image can be displayed in multiple windows, the sound is respectively output, and the dynamic adjustment of the window according to the mirror image size is supported. The multi-window display function mainly meets the requirements of multi-window film watching, side watching training, multi-window screen throwing of a conference and the like.

For another example, the display device may first provide a multi-window display function. After the user selects the multi-window display function, the display device may display a plurality of windows, each window may display a multi-window product capable of being supported (i.e., a manner in which multi-window display is possible), and the multi-window product capable of being supported currently may be a camera, a mobile phone mirror image, a wired signal input, or the like. The user can then customize the usage scenario of the multi-window display, i.e. different interfaces can be displayed in different windows by means of different multi-window displays.

Currently, when the display device performs multi-window display, each window can display an interface corresponding to a physical signal source, an interface corresponding to mirror image screen projection of electronic equipment such as a mobile phone or an interface corresponding to DLNA screen projection.

The physical signal sources of the display device may include: high definition multimedia interface (high definition multimedia interface, HDMI), digital television (digital television, DTV), analog television (analog television, ATV), and the like. That is, when the display device performs content display, the display device may acquire data to be displayed through different channels of HDMI, DTV, or ATV, etc., to be displayed in one window of the display device.

The mirror image screen projection of the electronic equipment such as the mobile phone can be realized by Miracast screen projection mirror image or AirPlay screen projection mirror image.

Miracast mirror projection is a wireless display standard based on WI-FI direct connection. The 3C device supporting the standard can share video pictures in a wireless manner, and electronic devices such as mobile phones can directly play videos or photos on televisions or other display devices through Miracast without any connecting wire or wireless hot spot.

The AriLay mirror image screen projection is a display device such as a television, a player or a smart television which can share video, photos, music and other contents on one electronic device through an AirPlay protocol.

In summary, although the multi-window display function can be displayed in the prior art, there is no unified requirement for the multi-window display function. For example, it is not clear whether to first determine the multi-window display function or to first define the usage scenario. Therefore, when the user holds different display devices, the operation of multi-window display is different, so that the operation steps of the user are different, the flow is complex, and the display effect of the multi-window is affected.

In addition, when the user needs to perform multi-window display on the display device in an actual scene, the size, position, display mode, and the like of the display area of the display device need to be operated so that the display area is reasonably and aesthetically arranged on the screen of the display device, thereby performing multi-window display. Therefore, the display area is operated to perform multi-window display on the screen of the display device, and the operation is complex, so that the user experience is reduced.

In view of the above problems, the embodiments of the present application provide a multi-window display method, which may be applied to a display device, and first receives a multi-window display instruction input by a user, and determines a current usage scenario; the current use scene comprises an HDMI scene, a DLNA scene or a full scene; then, based on the current use scene, determining at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates, and displaying the multi-window display templates; and finally, after receiving the selection operation of the user on the multi-window display template, displaying the multi-window based on the multi-window display template.

According to the scheme, under the current use scene, a user can select a needed multi-window display template through a plurality of multi-window display templates corresponding to the current use scene so as to display data corresponding to the multi-window. That is, according to the scheme, a user does not need to perform operations such as a display area and the like under an actual use scene, and only needs to select a needed multi-window display template to display multi-window data, so that the operations of the user can be reduced, and the experience of the user is improved.

The principle of the multi-window display method provided in the embodiment of the present application is schematically described below with reference to fig. 1.

The currently used scene may include an HDMI scene, a full scene, or a DLNA scene. When the current use scene is an HDMI scene, at least one multi-window display template corresponding to the HDMI scene can be displayed, and the at least one multi-window display template can comprise a first viewing template, a viewing template and a conference template.

The first film watching template can simultaneously display an interface corresponding to the HDMI and an interface corresponding to the DLNA projection screen. After receiving the selection operation of the user on the first film watching template, the first film watching template can simultaneously display an interface corresponding to HDMI and an interface corresponding to DLNA projection screen based on the first film watching template.

The viewing template can simultaneously display an interface corresponding to the HDMI and an interface corresponding to the local video event of the television. After receiving the selection operation of the user on the viewing template, the viewing template can simultaneously display an interface corresponding to the HDMI and an interface corresponding to the local video event of the television based on the viewing template.

The conference template can simultaneously display an interface corresponding to the HDMI, one-way mirror image projection of other electronic equipment and two-way mirror image projection of other electronic equipment. After receiving the selection operation of the user on the conference template, the conference template can simultaneously display an interface corresponding to HDMI and interfaces corresponding to one-way mirror image and two-way mirror image projection based on the conference template.

When the current usage scene is a full scene, at least one multi-window display template corresponding to the full scene can be displayed, and the at least one multi-window display template can comprise a viewing fitness template, a fitness mirror template, a game template, a second viewing template or a third viewing template.

The film watching body building template can simultaneously display an interface corresponding to the local video playing of the television and an interface corresponding to the local body building of the television. After receiving the selection operation of the user on the film watching body building template, based on the film watching body building template, the film watching body building template can simultaneously display the interface corresponding to the local video playing of the television and the interface corresponding to the local body building of the television.

The body-building mirror template can simultaneously display interfaces corresponding to local body-building videos of the television and interfaces corresponding to mirror image body-building videos of other electronic equipment. After receiving the selection operation of the user on the exercise mirror template, the interface corresponding to the local exercise video of the television and the interface corresponding to the mirror image exercise video of other electronic equipment can be displayed simultaneously based on the exercise mirror template.

The game template can display one path, two paths, three paths and four paths of interfaces corresponding to the game mirror image projection screen at the same time. After receiving the selection operation of the user on the game template, the game template can simultaneously display interfaces corresponding to one-way, two-way, three-way and four-way game mirror image projection screens based on the game template.

The second film watching template can simultaneously display an interface corresponding to the local video of the television and an interface corresponding to the screen-throwing video. The screen-throwing video can comprise DLNA screen throwing and can also comprise mirror image screen throwing of electronic equipment such as a mobile phone and the like. After receiving the selection operation of the user on the second film watching template, the second film watching template can simultaneously display an interface corresponding to the local video of the television and an interface corresponding to the screen projection video based on the second film watching template.

And the third film watching template can simultaneously display an interface corresponding to the local video of the television and an interface corresponding to the HDMI. After receiving the selection operation of the user on the third film watching template, the third film watching template can simultaneously display an interface corresponding to the local video of the television and an interface corresponding to the HDMI based on the third film watching template.

When the current use scene is a DLNA scene, a multi-window display template corresponding to the full scene can be displayed, and the multi-window display template can comprise a fourth viewing template. The fourth film watching template can simultaneously display interfaces corresponding to the screen projection videos of other electronic equipment and interfaces corresponding to the screen projection videos different from the screen projection videos of the other electronic equipment. After receiving the selection operation of the user on the fourth film watching template, based on the fourth film watching template, the fourth film watching template can simultaneously display interfaces corresponding to the screen projection videos of other electronic equipment and interfaces corresponding to the screen projection videos different from the screen projection videos of the other electronic equipment.

As shown in fig. 2 for the following fig. 1, the multi-window display method provided in the embodiment of the present application may include the following procedures:

the user can play data by using the display device, the current use scene of the display device can be an HDMI scene, and the current use scene is determined when the user presses a signal source key (namely a multi-window display instruction) for a long time. And when the current field use scene is HDMI, displaying a first film watching template, a viewing template and a conference template corresponding to the HDMI scene. After the user selects the conference template, the screen of the display device displays the conference template, and the HDMI screen, the AirPlay screen and the Miracast screen are displayed through the conference template. That is, the conference template may obtain displayed conference data through HDMI, airPlay and Miracast drops.

And when the current use scene is DLNA, displaying a fourth viewing template corresponding to the DLNA scene. The user can select the fourth viewing template, and after receiving the selected fourth viewing template, the display device displays the fourth viewing template on a screen of the display device.

When the current use scene is a full scene, displaying a viewing fitness template, a fitness mirror template, a game template, a second viewing template and a third viewing template corresponding to the full scene. The user can select one of the templates, and the display device displays the template on the screen of the display device after receiving the selection of one of the templates.

The following describes a multi-window display method provided in an embodiment of the present application.

The display device provided in the embodiment of the application may have various implementation forms, for example, may be a display device with a dialogue system, such as a television, a smart television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. The embodiment of the present application does not limit the specific form of the display device herein. In the embodiment of the application, a display device is taken as a television set as an example for schematic description. Fig. 3 and 4 are specific embodiments of a display device of the present application.

Fig. 3 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 3, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is programmed using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 4 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 4, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and may function as an interaction medium between the user and the display device 200.

By way of example, taking a display device as a television, fig. 5 shows a schematic structural diagram of a display device according to an embodiment of the present application.

As shown in fig. 5, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a power supply 280, a memory 290, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation Interface, and a user manipulation User Interface (UI).

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

External device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory 290. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (central processing unit, CPU), video processor, audio processor, graphics processor (graphics processing unit, GPU), RAM (random access memory, RAM), ROM (read-only memory), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (graphic user interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as a graphic, window, control, etc., displayed in a display screen of the display device, where the control may include visual interface elements such as graphic, button, menu, tab, text box, dialog box, status bar, navigation bar, widget, etc.

It will be appreciated that in general, implementation of display device functions requires software in addition to the hardware support described above.

Fig. 6 is a software structure block diagram of a display device provided in an embodiment of the present application.

In some embodiments, as shown in fig. 6, the system of the display device is divided into four layers, namely, an application (applications) layer (abbreviated as "application layer"), an application framework (application framework) layer (abbreviated as "framework layer"), a An Zhuoyun-line (android run) layer and a system library layer (abbreviated as "system runtime layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a window (window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution. In some examples, the dialog system included with the display device may be located in a framework layer of the system of the display device.

As shown in fig. 6, the application framework layer in the embodiment of the present application includes a manager (manager), a content provider (content provider), and the like, where the manager includes at least one of the following modules: an activity manager (activity manager) is used to interact with all activities running in the system; a location manager (location manager) is used to provide system services or applications with access to system location services; a package manager (package manager) for retrieving various information about an application package currently installed on the device; a notification manager (Notification manager) for controlling the display and clearing of notification messages; a window manager (window manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 6, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

The methods in the following embodiments may be implemented in a display device having the above-described hardware structure or software structure.

In some embodiments, as shown in fig. 7, in order to implement the multi-window display method provided in the embodiments of the present application, the software structure of the multi-window display method may further include a multi-window display service (such as a service corresponding to a signal source key) located in a framework layer, a multi-window display template, a dependency module, and an interactive application located in an application layer.

The multi-window display service is used for opening a multi-window display template, for example, a service corresponding to a signal source key.

The multi-window display template is used for managing different template selection inlets, template selection floating windows and other popup window management displayed in different scenes. The multi-window display template may include a template list service, a template list floating window manager, a template list floating window, and a template list broadcast. The template list service is used for displaying a plurality of multi-window display templates in a list form, the template list floating window manager is used for controlling classes displayed by the template list floating window, the template list floating window is used for displaying a template list in a floating window form, and the template list broadcasting is used for setting mutex of the multi-windows.

The dependency module may include a signal source channel for obtaining a current channel of the display device to determine a current usage scenario. The interactive application may include a multi-window user interface receiver for receiving a multi-window display template corresponding to the determined current usage scenario.

When the display equipment needs multi-window display, the display equipment can receive a multi-window display instruction of a user and then send the multi-window display instruction to the multi-window display template, the multi-window module is combined with the dependency module to judge and select the multi-window display template under the current use scene of the user, and the selected multi-window display template under the current use scene is subjected to multi-window display through interactive application.

With specific reference to fig. 7, as shown in fig. 8, the method for displaying a multi-window display template may include the following S801 to S814.

S801, a template list service of the display device receives a multi-window display instruction.

When the user needs to perform multi-window display through the display device, the user can trigger the operation of multi-window display through the control device corresponding to the display device, for example, the user can press a signal source key on the control device for a long time, so that the display device is triggered to perform multi-window display.

After the user triggers the operation of multi-window display through the control device corresponding to the display device, the multi-window display service of the display device can receive the triggering operation of multi-window display. After the multi-window display service of the display device receives the triggering operation of the multi-window display, the multi-window display service of the display device may send a multi-window display instruction to the template list service of the display device, so that the template list service of the display device may receive the multi-window display instruction.

S802, the template list service of the display device sends a scene determination request to the signal source channel.

The request to confirm the current usage scenario of the display device may be a resource manager request (sourcemanager). That is, the template list service of the display device may, upon receiving the multi-window display instruction, then send a request to the signal channel confirming the current usage scenario.

S803, the signal source channel of the display device receives the scene determination request and determines the current use scene.

The current usage scene may be an HDMI scene, a DLNA scene, or a full scene.

After the signal source channel of the display device receives the scene determination request, the signal source channel may determine the current usage scene according to the signal source on the display device. For example, if the signal source on the display device is HDMI-inputted data, it is determined that the current usage scene is an HDMI scene.

S804, the signal source channel of the display device sends the current use scene to the template list service.

And after the signal source channel of the display device determines the current use scene, the signal source channel sends the current use scene to the template list service.

S805, the template list service of the display device sends the current use scene to the floating window manager from the template list.

S806, the template list floating window manager of the display device determines whether a template list floating window corresponding to the current use scene is displayed.

And the floating window manager of the display device determines whether the template list floating window displays the template list floating window corresponding to the current use scene according to the current use scene, wherein the template list in the template list floating window at least comprises a multi-window display template.

In the case where it is determined that the display device is not displaying the template list floating window in the current use scenario, the following step S807 is performed; in the case where it is determined to display the template list floating window in the current use scenario, the following step S809 is performed.

S807, the template list floating window manager of the display device sends a creation request to the template list floating window.

And when the template list floating window manager of the display device determines that the template list floating window does not display the floating window corresponding to the current use scene, sending a creation request to the template list floating window.

S808, receiving a creation request by a template list floating window of the display device, and creating a floating window corresponding to the current use scene.

And after the template list floating window of the display device receives the floating window creation request, creating a floating window corresponding to the current use scene. The floating window is used for selecting at least one multi-window display template corresponding to the current use scene from a plurality of multi-window display templates for display.

S809, the template list floating window of the display device sends a floating window corresponding to the current use scene to the multi-window user interface receiver.

The template list floating window of the display device sends the floating window corresponding to the current use scene to the multi-window user interface receiver so that the multi-window list template corresponding to the current use scene is displayed on the user interface through the multi-window user interface receiver, and the multi-window list comprises at least one multi-window display template.

S810, a multi-window user interface receiver of the display device receives a floating window corresponding to the current use scene and displays the template list floating window.

The multi-window user interface receiver of the display device receives the floating window corresponding to the current use scene and displays the template list floating window corresponding to the current use scene.

S811, the template list service of the display device creates a template list broadcast.

The template list service of the display device may create a template list broadcast to manage the displayed multi-window list templates. For example, the template list service of the display device may manage all template list floating windows corresponding to the usage scenarios through the white list, and register the IDs of all template list floating windows corresponding to the usage scenarios into the white list. And monitoring broadcasting by using the template list corresponding to all the use scenes in the white list. And the template lists corresponding to all the use scenes in the white list are mutually exclusive.

And S812, the template list service of the display device sends the Panel broadcast to the multi-window user interface receiver.

And S813, after the multi-window user interface receiver of the display equipment receives the Panel broadcast, sending a template list floating window corresponding to the current use scene to the template list service.

After the multi-window user interface receiver of the display device displays the template list floating window corresponding to the current use scene, the template list floating window corresponding to the current use scene is displayed for the template list service.

S814, the template list service of the display device receives the template list floating window corresponding to the current use scene and hides the template list floating windows corresponding to other use scenes.

After the template list service of the display device receives the Panel broadcast, the Panel broadcast is sent to the template lists corresponding to other use scenes, and after the template lists corresponding to other use scenes receive the Panel broadcast, the corresponding template lists are hidden and not displayed.

In this way, the display device can be ensured to display the template list floating window corresponding to the current use scene, namely, the display device can be ensured to display at least one multi-window display template corresponding to the current use scene.

In some embodiments, as illustrated in connection with fig. 9, taking the display device as a television set as an example, a television application programming interface (application programming interface, API) system design may include a television manager. The television manager is used for acquiring and managing channels of data to be displayed. The television manager may include an ATV manager (ATV manager), a DTV manager (DTV manager), an audio manager (audio manager), a picture manager (picture manager), and a source code manager (source manager).

The television API comprises a plurality of services with Android standards, completes different TV functions, is packaged in TVServices. Apk, and operates as an application program. The TV API completes interaction with TV Services through an Android binder mechanism, wherein the binder is a set of inter-process communication frames provided by Android and is used for sending messages among multiple processes, synchronizing and sharing a memory. Some of the functions in Services call the interface of the TIL layer, i.e. from Java layer to C layer, through Java local interface writer (Java Native Interface, JNI).

The following describes in detail a multi-window display method according to an embodiment of the present application with reference to fig. 10. As shown in fig. 10, taking a display device as a television set as an example, the multi-window display method provided in the present application may include S1001 to S1005.

S801, receiving a multi-window display instruction input by a user.

When the user needs to perform multi-window display through the television, the user can input multi-window display operation through the control device. For example, the multi-window display operation may be a user's pressing operation of at least one key in the remote controller. The control device receives and responds to the multi-window display operation, generates a multi-window display instruction and sends the multi-window display instruction to the television. The television can receive a multi-window display instruction input by a user in a starting-up state, so that the current use scene can be determined.

In some embodiments, the multi-window display operation may be a long press of a signal source key on the remote control. When the user needs to display multiple windows through the television, the user can press a signal source key in a remote controller corresponding to the television for a long time, generate a multiple window display instruction, and send the multiple window display instruction to the television. And the television receives a multi-window display instruction input by a user.

In this embodiment of the present application, a specific implementation of receiving a multi-window display instruction input by a user may refer to the implementation in S801 described above. The embodiments of the present application are not described herein.

S1002, responding to a received multi-window display instruction input by a user, and determining a current use scene, wherein the current use scene comprises an HDMI scene, a DLNA scene or a full scene.

And the television responds to the received multi-window display instruction input by the user, and determines the current use scene of the television.

The currently used scene may include an HDMI scene, a DLNA scene, or a full scene.

The HDMI scene refers to a scene in which other electronic devices are connected to a display device through an HDMI interface, and then the content of the other electronic devices is displayed on the display device.

The DLNA scene is to wirelessly connect other electronic devices with an interconnection function with a display device, and then screen data on the other electronic devices onto the display device, so that the display device displays the screen data of the other electronic devices. The other electronic devices may be mobile phones, tablet computers, notebook computers, and other devices.

The full scene refers to scenes other than the HDMI scene and the DLNA scene. For example, the full scene may be a scene in which the display device displays local data through a channel such as local media or network media; for another example, the full scene may be a scene that data on the mobile terminal is shared to the display device through mirror image screen projection, and then the display device receives the screen projection data to display the data on the mobile terminal.

In some embodiments, the television may acquire the current channel in response to the received multi-window display instruction input by the user, and determine the current usage scenario of the television.

In the embodiment of the present application, for a specific implementation of receiving a multi-window display instruction input by a user, reference may be made to the implementation in S802-S803. The embodiments of the present application are not described herein.

S1003, determining at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates based on the current use scene, and displaying the at least one multi-window display template; the plurality of multi-window display templates includes a first multi-window display template.

The television determines at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates based on the determined current use scene, and displays the at least one multi-window display template. The currently used scene may be an HDMI scene, a DLNA scene, or a full scene. Therefore, when the current use scene of the television is different, the displayed multi-window display templates are also different, that is, the television needs to provide different multi-window display templates in combination with the actual use scene of the user.

And under the condition that the current use scene is determined to be the HDMI scene, determining at least one multi-window display template corresponding to the HDMI scene in the multiple multi-window display templates, and displaying the at least one multi-window display template corresponding to the HDMI scene. The plurality of multi-window display templates includes a first multi-window display template. The plurality of multi-window display templates may also include other multi-window display templates.

The first multi-window display template may include a first display region and at least one second display region; displaying data corresponding to the HDMI in a first display region; and displaying the screen throwing data corresponding to the first electronic equipment in the second display area, or displaying the data corresponding to the local television in the second display area.

The positions of the first display area and the at least one second display area in the screen are preset positions. For example, in the case where the second display area is one, the first display area may be a left half display area corresponding to the screen, the second display area may be a right half display area corresponding to the screen, and for example, the first display area may be an upper half display area corresponding to the screen, and the second display area may be a lower half display area corresponding to the screen.

For example, as shown in fig. 11 (a), when the current scene is an HDMI scene, a multi-window display instruction is received, and the tv displays a plurality of multi-window display templates corresponding to the current scene. As shown in (b) of fig. 11, the corresponding plurality of multi-window display templates when the current usage scene is HDMI may include a first viewing template, a viewing template, and a conference template. The plurality of multi-window display templates may include a first multi-window display template, that is, the first multi-window display template may be a first viewing template, may be a viewing template, and may also be a conference template.

When the first multi-window display template is a first viewing template, the first viewing template may include two display regions, namely a first display region and a second display region. The first display area may be a left half display area corresponding to the screen, and the second display area may be a right half display area corresponding to the screen. When the screen of the television displays the first video viewing template, the first display area can display data corresponding to HDMI, and the second display area can display data corresponding to DLNA projection screen. Thus, the user can watch the projection screen data while watching the video.

When the first multi-window display template is a viewing template, the viewing template may include a first display region and a second display region. The first display area may display data corresponding to HDMI; the second display area can display data corresponding to a local channel of the television.

For example, as shown in fig. 11 (a) and 11 (b), when the current usage scene is an HDMI scene, the television receives a multi-window display instruction and displays a plurality of multi-window display templates corresponding to the current usage scene. When the first multi-window display template is a viewing template, the first viewing template may include two display regions, namely a first display region and a second display region. The first display area may be a left half display area corresponding to the screen, and the second display area may be a right half display area corresponding to the screen. When the display screen of the television displays the first video viewing template, the first display area can display data corresponding to the HDMI, and the second display area can display video event data corresponding to the local channel of the television.

When the first multi-window display template is a conference template, the conference template may include a first display region, a second display region one, and a second display region two. The first display area may display data corresponding to HDMI; the first display area can display data corresponding to the first path of mirror image projection; and the second display area II can display data corresponding to the second path of mirror image projection screen.

When the first multi-window display template is a conference template, the conference template may include three display regions, i.e., a first display region and two second display regions. The positions of the three display areas of the conference template in the screen are preset positions. For example, the first display area may be a left third of the display areas corresponding to the screen, the second display area may be a middle third of the display areas corresponding to the screen, and the third display area may be a right third of the display areas corresponding to the screen. For another example, the first display area may be an upper third of the display areas corresponding to the screen, the second display area may be a middle third of the display areas corresponding to the screen, and the second display area may be a lower third of the display areas corresponding to the screen.

For example, as shown in fig. 11 (a) and 11 (b), when the current usage scene is an HDMI scene, the television receives a multi-window display instruction and displays a plurality of multi-window display templates corresponding to the current usage scene. When the first multi-window display template is a conference template, the conference template may include three display regions, i.e., a first display region and two second display regions. The first display area may be a left third of the display area corresponding to the screen, the second display area may be a middle third of the display area corresponding to the screen, and the third display area may be a right third of the display area corresponding to the screen. And displaying the conference template on a display screen of the television, wherein the first display area can display data corresponding to HDMI, the second display area can display data corresponding to one-path mirror image projection, and the second display area can display data corresponding to two-path mirror image projection.

Under the condition that the current use scene is determined to be the DLNA scene, a multi-window display template corresponding to the DLNA scene is determined in a plurality of multi-window display templates, and the multi-window display template corresponding to the DLNA scene is displayed. The multi-window display template may include a first multi-window display template. The first multi-window display template may include a third display region and a fourth display region; displaying data corresponding to the second electronic equipment in a third display area; and displaying the screen throwing data corresponding to the third electronic equipment in the fourth display area.

The positions of the third display area and the fourth display area in the screen are preset positions. For example, the third display area may be a left half display area corresponding to the screen, the fourth display area may be a right half display area corresponding to the screen, and for another example, the third display area may be an upper half display area corresponding to the screen, and the fourth display area may be a lower half display area corresponding to the screen.

And under the condition that the current use scene is determined to be the DLNA scene, receiving a multi-window display instruction, and displaying a fourth film watching template of the current use scene Jing Duiying by the display equipment. The fourth viewing template may include two display regions, namely a third display region and a fourth display region. The third display area may be a left half area of the screen and the fourth display area may be a right half area of the screen.

For example, as shown in fig. 13 (a), when the current usage scene is a DLNA scene, the television receives a multi-window display instruction to display the first multi-window display template of the current usage field Jing Duiying. As shown in (b) of fig. 13, the corresponding first multi-window display template when the current usage scene is a DLNA scene may include a fourth viewing template.

The fourth viewing template may include two display regions, namely a third display region and a fourth display region. The third display area may be a left half display area corresponding to the screen, and the fourth display area may be a right half display area corresponding to the screen. When the screen of the television displays the fourth viewing template, the third display area can display data corresponding to the second electronic device, and the fourth display area can display data corresponding to the third electronic device.

In some embodiments, the second electronic device may be different from the third electronic device or may be the same electronic device. The second electronic device and the third electronic device are not limited by the embodiments of the present application.

In some embodiments, the screen projection data corresponding to the second electronic device and the screen projection data corresponding to the third electronic device may be different or the same. The embodiment of the application does not limit the screen projection data corresponding to the second electronic device and the data corresponding to the third electronic device.

In the case that the current usage scenario is determined to be a full scenario, at least one multi-window display template corresponding to the full scenario is determined in a plurality of multi-window display templates, and the plurality of multi-window display templates may include a first multi-window display template. The plurality of multi-window display templates may also include other multi-window display templates.

The first multi-window display template may include a fifth display region and a sixth display region; displaying data corresponding to the local television in a fifth display area; displaying screen throwing data corresponding to the fourth electronic equipment in a sixth display area, or displaying data corresponding to the HDMI in the sixth display area; the data locally corresponding to the television set displayed in the fifth display area is different from the data locally corresponding to the television set displayed in the sixth display area.

The positions of the fifth display area and the sixth display area in the screen are preset positions. For example, the fifth display area may be a left half display area corresponding to the screen, the sixth display area may be a right half display area corresponding to the screen, and for another example, the fifth display area may be an upper half display area corresponding to the screen, and the sixth display area may be a lower half display area corresponding to the screen.

For example, as shown in fig. 14 (a), when the current scene is the full scene, a multi-window display instruction is received, and the tv displays a plurality of multi-window display templates corresponding to the current scene. As shown in (b) of fig. 14, when the current usage scenario is a full scenario, the corresponding plurality of multi-window display templates may include a viewing fitness template, a fitness mirror template, a game template, a second viewing template, and a third viewing template. The plurality of multi-window display templates may include a first multi-window display template, i.e., the first multi-window display template may be a viewing fitness template, may be a fitness mirror template, may be a game template, may be a second viewing template, and may be a third viewing template.

When the first multi-window display template is a film viewing and fitness template, the film viewing and fitness template may include a fifth display region and a sixth display region. That is, the fifth display area may be a left half display area corresponding to the screen, and the sixth display area may be a right half display area corresponding to the screen. The data locally corresponding to the television set displayed in the fifth display area is different from the data locally corresponding to the television set displayed in the sixth display area. When the display screen of the television displays the film watching body building template, the fifth display area can display video data corresponding to the local position of the television, and the sixth display area can display video event data corresponding to the local position of the television.

When the first multi-window display template is determined to be the gymnastic mirror template, the television displays data corresponding to the local television in a fifth display area in the first multi-window display template, and displays mirror image screen projection data corresponding to the fourth electronic device in a sixth display area in the first multi-window display template.

When the first multi-window display template determines the second film watching template, the display device displays data corresponding to the local television in a fifth display area in the first multi-window display template, and displays DLNA screen throwing data corresponding to the fourth electronic device in a sixth display area in the first multi-window display template.

When the first multi-window display template is determined to be the third film watching template, the display device displays data corresponding to the local television in a fifth display area in the first multi-window display template and displays data corresponding to the HDMI in a sixth display area in the first multi-window display template.

When the first multi-window display template is the exercise mirror template, the second film viewing template or the third film viewing template, the preset position of the display area of the first multi-window display template can be referred to the preset position of the display area of the film viewing exercise template, which is not described herein in detail.

In the case that the current usage scenario is determined to be a full scenario, at least one multi-window display template corresponding to the full scenario is determined in a plurality of multi-window display templates, and the plurality of multi-window display templates may include a first multi-window display template. The first multi-window display area may include a plurality of seventh display areas, where the seventh display areas respectively display screen projection data corresponding to the fifth electronic devices; and the screen projection data corresponding to the plurality of fifth electronic devices are different.

When the first multi-window display template is determined to be a game template, the first multi-window display template of the television set may include four seventh display regions. And displaying the screen projection data corresponding to the four fifth electronic devices in the four seventh display areas respectively, wherein the screen projection data corresponding to the four fifth electronic devices are different. That is, the fourth seventh display area may include a seventh display area one, a seventh display area two, a seventh display area three, and a seventh display area four.

The positions of the four seventh display areas in the screen are preset positions. For example, the seventh display area one may be an upper left quarter display area corresponding to the screen, the seventh display area two may be an upper right quarter display area corresponding to the screen, the seventh display area three may be a lower left quarter display area corresponding to the screen, and the seventh display area four may be a lower right quarter display area corresponding to the screen.

When the first multi-window display template is a game template, the conference template may include four seventh display regions, that is, the four seventh display regions may include a seventh display region one, a seventh display region two, a seventh display region three, and a seventh display region four. The seventh display area I displays the screen throwing data of the fifth electronic equipment I obtained through one-way mirror image, the seventh display area II displays the screen throwing data of the fifth electronic equipment II obtained through two-way mirror image, the seventh display area III displays the screen throwing data of the fifth electronic equipment III obtained through three-way mirror image, and the seventh display area IV displays the screen throwing data of the fifth electronic equipment obtained through four-way mirror image.

Therefore, a plurality of multi-window display templates are stored on the television, so that a user can select a needed multi-window display template in the current use scene under the actual use scene, and personalized service is provided for the user.

For example, as shown in fig. 15, the screen of the television displays an arbitrary window corresponding to the full scene, the user may input a multi-window display instruction through a signal source key on the remote controller, and the television may display a viewing fitness template, a fitness mirror template, a game template, a second viewing template, and a third viewing template on the screen in response to the multi-window display instruction.

In this embodiment of the present application, for a specific implementation of receiving a multi-window display instruction input by a user, reference may be made to the implementation in S804-S814. The embodiments of the present application are not described herein.

S1004, receiving a selection operation of a user on the first multi-window display template.

In the case of displaying the first multi-window display template, the user may trigger the control device to perform a selection operation on the first multi-window display template. The control device receives the selection operation of the user on the first multi-window display template, generates a selection operation instruction and sends the selection operation instruction to the television. And the television receives a selection operation instruction of the user for the first multi-window display template so as to perform multi-window display based on the first multi-window display template.

In some embodiments, the user may trigger a selection operation of the first multi-window display template of the television display via the remote control. The remote controller receives the selection operation of the user on the first multi-window display template, generates a selection operation instruction and sends the selection operation instruction to the television. And the television receives the selection operation instruction, so that multi-window display is performed based on the first multi-window display template.

S1005, responding to the received selection operation of the user on the first multi-window display template, and performing multi-window display based on the first multi-window display template.

And the television receives the selection operation of the user on the first multi-window display template, and displays multi-window data based on the first multi-window display template.

In the HDMI scene, a user can select a first film watching template, a film watching template and a conference template, and the television responds to receiving a selection operation instruction of the user and performs multi-window display based on a corresponding multi-window display template.

When the television receives the selection operation of the first film watching template from the user, the television can display the data obtained by HDMI in a first display area in the multi-window display template, and display the data obtained by DLNA in a second display area in the multi-window display template.

For example, continuing to combine with the operation (b) in fig. 11, receiving the selection operation of the user on the first multi-window display template, as shown in (c) in fig. 11, the first multi-window display template is a first film viewing template, and the first film viewing template includes two display areas, that is, the first display area is an interface corresponding to HDMI, and the second display area is an interface corresponding to DLNA projection. As shown in (d) of fig. 11, after receiving the data of the first viewing template, multi-window display is performed based on the first multi-window display template, that is, the data corresponding to HDMI is displayed in the left half display area corresponding to the screen, and the data corresponding to DLNA projection is displayed in the right half display area corresponding to the screen.

In this way, when the first viewing template is displayed on the screen of the television, the user does not need to adjust the first display area and the second display area any more, but the preset first display area and the preset second display area are directly displayed on the display area of the screen, the data corresponding to the HDMI is displayed on the first display area, and the data corresponding to the DLNA is displayed on the second display area. Therefore, the user can watch the data corresponding to the HDMI through the first display area of the screen, and watch the DLNA screen-throwing data through the second display area of the screen.

When the television displays the viewing template in response to receiving a selection operation of the viewing template by a user, the television can display the data obtained by HDMI in a first display area in the multi-window display template, and display the data obtained by the local channel of the television in a second display area in the multi-window display template.

For example, continuing to combine with the operation (b) in fig. 11, receiving the selection operation of the user on the first multi-window display template, referring to the operation (c) in fig. 11, the first multi-window display template is a viewing template, and the viewing template includes two display areas, that is, the first display area is an interface corresponding to HDMI, and the second display area is an interface corresponding to the local television. Referring to fig. 11 (d), after receiving the data of the viewing template, multi-window display is performed based on the first multi-window display template, that is, the data corresponding to HDMI is displayed in the left half of the display area corresponding to the screen, and the video event data corresponding to the local television is displayed in the right half of the display area corresponding to the screen. Thus, the user can realize that two games can be watched simultaneously through the viewing template.

When the conference template is displayed by the television in response to receiving the selection operation of the user on the conference template, the television can display the data obtained through HDMI in a first display area in the multi-window display template, display the data obtained through one-way screen projection in a second display area I, and display the data obtained through two-way screen projection in a second display area II. The multi-window display area in the display can display conference data obtained by different channels, namely, conference data obtained by HDMI channels can be displayed in a first display area, conference data obtained by one-way mirror image screen projection can be displayed in a first display area, and conference data obtained by two-way mirror image screen projection can be displayed in a second display area, so that a multi-person conference can be realized.

For example, continuing to combine with (b) in fig. 11, displaying a plurality of multi-window display templates on the display screen of the television, and receiving a selection operation of the first multi-window display template by the user. As shown in fig. 12 (a), when the first multi-window display template is a conference template, the conference template includes three display areas, i.e., a first display area is an interface corresponding to HDMI, a second display area is an interface corresponding to one-way mirror projection, and a second display area is an interface corresponding to two-way mirror projection. As shown in fig. 12 (b), after receiving the data of the conference template, multi-window display is performed based on the first multi-window display template, that is, the data corresponding to HDMI is displayed in the left third of the display areas corresponding to the screen, the screen-casting data corresponding to one-way mirror image screen-casting is displayed in the middle third of the display areas corresponding to the screen, and the screen-casting data corresponding to two-way mirror image screen-casting is displayed in the right third of the display areas corresponding to the screen. So that a multi-person conference can be realized on television.

For example, when a plurality of multi-window display templates are displayed on the screen of the television set as shown in (a) of fig. 17, that is, the plurality of multi-window display templates may be a first viewing template, a viewing template, and a conference template. The user may perform a select conference template operation (e.g., an OK button in a remote control) via the control device. As shown in fig. 17 (b), after receiving the operation of selecting the conference template, the screen of the television may display channels corresponding to the conference template, that is, HDMI, one-way mirror projection, and two-way mirror projection. Then, multi-window display is performed based on the first multi-window display template.

In the DLNA scene, a user can perform selection operation on the first multi-window display template, and the television responds to receiving a selection operation instruction of the user and performs multi-window display based on the corresponding multi-window display template.

For example, continuing to combine with the illustration (b) in fig. 13, when the first multi-window display template is displayed on the screen of the television, receiving the selection operation of the user on the first multi-window display template, as illustrated in fig. 13 (c), the first multi-window display template is a fourth viewing template, and the fourth viewing template includes two display areas, that is, the third display area is an interface corresponding to the second electronic device DLNA, and the fourth display area is an interface corresponding to the third electronic device DLNA. As shown in (d) of fig. 13, after receiving the data of the fourth film viewing template, performing multi-window display based on the first multi-window display template, that is, displaying the screen-casting data corresponding to the screen casting of the second electronic device DLNA in the left half display area corresponding to the screen, and displaying the screen-casting data corresponding to the screen casting of the third electronic device DLNA in the right half display area corresponding to the screen.

Therefore, in a DLNA scene, a user can simultaneously screen different electronic devices or data of the same electronic device when watching the video, and then screen-casting data corresponding to different electronic devices are displayed in different display areas of the screen, so that the user can have different video watching experiences.

Under the full scene, the user can select the film watching body building template, the body building mirror template, the game template, the second film watching template and the third film watching template, and the television responds to receiving a selection operation instruction of the user and displays multiple windows based on the corresponding multiple window display template.

When the television displays the viewing fitness template in response to receiving a user selection operation of the viewing fitness template, the fifth display area in the television display displays corresponding data obtained locally from the television, and the sixth display area displays corresponding data obtained locally from the television. The fifth display area display obtains corresponding data from the local television set differently from the sixth display area display obtains corresponding data from the local television set.

For example, continuing to combine with the operation (b) in fig. 14, receiving the selection operation of the user on the first multi-window display template, as shown in (c) in fig. 14, the first multi-window display template is a viewing and body-building template, and the viewing and body-building template includes two display areas, namely, a fifth display area is an interface corresponding to the local television, and a sixth display area is an interface corresponding to the local television. As shown in fig. 14 (d), after receiving the data of the film-viewing fitness template, the data is displayed based on the first multi-window display template. The corresponding exercise video is locally obtained by displaying the television in the left half display area corresponding to the screen, and the corresponding exercise mirror is locally obtained by displaying the television in the right half area corresponding to the screen, so that a user can watch the exercise motion of the user through the exercise mirror while watching the exercise video.

When the television displays the gym mirror template in response to receiving a user selection operation of the gym mirror template, displaying data corresponding to the local television in a fifth display area in the television display, and displaying data corresponding to the mirror image screen projection of the fourth electronic device in a sixth display area.

For example, continuing to combine with the operation (b) in fig. 14, receiving the selection operation of the user on the first multi-window display template, referring to the operation (c) in fig. 14, the first multi-window display template is a gym mirror template, and the gym mirror template includes two display areas, namely, a fifth display area is an interface corresponding to the local television, and a sixth display area is an interface corresponding to the mirror image projection of the fourth electronic device. Referring to fig. 14 (d), after receiving the data of the gym-mirror template, the display is performed based on the first multi-window display template. The exercise mirror corresponding to the local television is displayed in the left half display area corresponding to the screen, and the data corresponding to the mirror image screen throwing of the fourth electronic equipment is displayed in the right half display area corresponding to the screen. Therefore, when a user selects the exercise mirror template, the user can mirror the exercise video such as the screen key through the mobile phone and can check whether the exercise action of the user corresponds to the standard through the exercise mirror.

When the television receives the selection operation of the second viewing template from the user, the data corresponding to the local television is displayed in a fifth display area in the display, the data corresponding to the DLNA projection screen is displayed in a sixth display area, or the data corresponding to the fourth electronic device is displayed in the sixth display area.

For example, continuing to refer to (b) in fig. 14, a user selection operation of the first multi-window display template is received. Referring to fig. 14 (c), the first multi-window display template is a second viewing template, where the second viewing template includes two display areas, i.e., a fifth display area is an interface corresponding to a local television, and a sixth display area is an interface corresponding to a screen corresponding to a fourth electronic device. The screen projection corresponding to the fourth electronic device may be a screen projection of the fourth electronic device DLNA, or may be a screen projection of the fourth electronic device mirror image. Referring to fig. 14 (d), after receiving the data of the second viewing template, the data is displayed based on the first multi-window display template. The exercise mirror corresponding to the local television is displayed in the left half display area corresponding to the screen, and the data corresponding to the DLNA projection screen or the data corresponding to the mirror image projection screen of the fourth electronic equipment is displayed in the right half display area corresponding to the screen. Therefore, the user can watch the DLNA screen-throwing data through the DLNA screen-throwing, or watch the fourth electronic equipment mirror image screen-throwing data through the mirror image screen-throwing, and meanwhile, the user can watch the video corresponding to the local television.

In response to receiving a user selection operation of the third viewing template, the television displays the third viewing template, displays data corresponding to the television locally in a fifth display area in the display, and displays data corresponding to the HDMI in a sixth display area.

For example, continuing to combine with the operation (b) in fig. 14, receiving the selection operation of the user on the first multi-window display template, referring to the operation (c) in fig. 14, the first multi-window display template is a third viewing template, where the third viewing template includes two display areas, that is, a fifth display area is an interface corresponding to the local television, and a sixth display area is an interface corresponding to the HDMI. Referring to fig. 14 (d), after receiving the data of the third viewing template, the data is displayed based on the first multi-window display template. That is, data corresponding to the local television is displayed in the left half of the display area corresponding to the screen, and data corresponding to the HDMI is displayed in the right half of the display area corresponding to the screen. Therefore, when the user selects the third viewing template, different video data can be obtained by displaying the local video of the television and HDMI through a display area preset by the screen, and different videos can be watched by multiple users at the same time.

When the television displays the game template in response to receiving the selection operation of the user on the game template, a seventh display area I in the display displays one-way screen projection data obtained from the fifth electronic equipment I, a seventh display area II displays two-way screen projection data obtained from the fifth electronic equipment II, a seventh display area III displays three-way screen projection data obtained from the fifth electronic equipment III, and a seventh display area IV displays four-way screen projection data obtained from the fifth electronic equipment IV.

For example, continuing to combine with the selection operation of the first multi-window display template shown in fig. 14 (b), as shown in fig. 16 (a), the first multi-window display template is a game template, and the game template may include four display areas, that is, the seventh display area one is an interface corresponding to the first mirror image of the fifth electronic device, the seventh display area two is an interface corresponding to the second mirror image of the fifth electronic device, the seventh display area three is an interface corresponding to the third mirror image of the fifth electronic device, and the seventh display area four is an interface corresponding to the fourth mirror image of the fifth electronic device. As shown in fig. 16 (b), after receiving the data of the fourth game template, displaying based on the first multi-window display template, that is, displaying the data corresponding to the first mirror image of the fifth electronic device in the display area of the upper left quarter corresponding to the screen, displaying the data corresponding to the second mirror image of the fifth electronic device in the display area of the upper right quarter corresponding to the screen, displaying the data corresponding to the third mirror image of the fifth electronic device in the display area of the lower left quarter corresponding to the screen, and displaying the data corresponding to the fourth mirror image of the fifth electronic device in the display area of the lower right quarter corresponding to the screen. In this way, a multiplayer game can be played on a television.

According to the scheme, when the television performs multi-window display, firstly, a multi-window display instruction input by a user is received, and a current use scene is determined; the current use scene comprises an HDMI scene, a DLNA scene or a full scene; then, determining at least one multi-window display template in a plurality of multi-window display templates based on the current use scene, and displaying the multi-window display templates; and finally, after receiving the selection operation of the user on the multi-window display template, performing multi-window display based on the multi-window display template.

According to the scheme, under an actual use scene, a user selects a needed multi-window display template according to a plurality of multi-window display templates corresponding to the current use scene. That is, the scheme of the application can customize the multi-window display template according to the actual use scene of the user, unify multi-window display operation, simplify the multi-window display operation flow, expand the use range of the multi-window, thereby improving the user interaction experience and optimizing the multi-window display effect.

According to the scheme, a user can select a needed multi-window display template through a plurality of multi-window display templates under the current use scene. That is, according to the scheme provided by the application, a user does not need to perform operations such as a display area and the like under an actual use scene, and only needs to select the multi-window display template, so that the display of multi-window data can be realized, the operation of the user can be reduced, and the experience of the user is improved.

Another multi-window display method according to the embodiment of the present application is described in detail below with reference to fig. 18. As shown in fig. 18, taking a display device as a television set as an example, the multi-window display method provided in the present application may include S1801-S1810.

S1801, receiving a multi-window display instruction input by a user.

S1802, determining a current use scene in response to a received multi-window display instruction input by a user, wherein the current use scene comprises an HDMI scene, a DLNA scene or a full scene.

S1803, determining at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates based on the current use scene, and displaying the at least one multi-window display template; the plurality of multi-window display templates includes a first multi-window display template.

S1804, receiving modification operation of at least one multi-window display template corresponding to the current use scene by a user.

The user can modify at least one multi-window display template corresponding to the current use scene displayed by the display device through the control device.

In some embodiments, the user may modify, through the remote control, at least one multi-window display template corresponding to a current usage scenario displayed by the television. The modification operation may be deletion or addition, or may be position adjustment. Namely, the modification operation can delete or add at least one multi-window display template according to personal preference of a user, and the positions of a plurality of multi-window display templates can be adjusted by opening a display interface displayed by a remote controller.

S1805, in response to receiving a modification operation of a user on at least one multi-window display template corresponding to the current use scene, modifying the at least one multi-window display template; and saving the modified at least one multi-window display template.

And the television responds to the received modification operation of the user on at least one multi-window display template corresponding to the current use scene, and performs modification operations such as deletion, addition or position adjustment on the multi-window display template under the current use scene.

For example, in conjunction with fig. 19, in an HDMI scenario, a user may adjust the positions of the first viewing template and the conference template, i.e., exchange the positions of the first viewing template and the conference template.

For example, as shown in fig. 20, in the HDMI scene, the position of the first viewing template is set to the top, and the position of the conference template is not set to the top. When the conference template needs to be set on top, namely the sequence of the first film watching template and the conference template needs to be exchanged, the sequence of the multi-window display template list can be moved through editing the sequence window, namely the sequence of the first film watching template and the conference template is adjusted through triggering a moving sequence control. And then, selecting a middle top of the conference template, and completing the sequence of exchanging the first film viewing template and the conference template.

Therefore, the user can manage the multiple multi-window display templates through modification operations such as adding, deleting or adjusting positions, and the like, and the multiple multi-window display templates can be modified according to personal preferences of the user, so that the experience of the user is improved.

The modified plurality of multi-window display templates are saved by the template data manager, as shown in connection with fig. 21.

When the template data manager writes, the data stored in the local file is read into 1.Map < string, list < template >, wherein key values store different scenes.

In some embodiments, in an HDMI scenario, the Value stores a template list corresponding to the current template. For example: under the HDMI scene, the template list corresponding to the current template is a first film viewing template, a conference template and a viewing template.

When the template manager is exited, the data Map < String >, list < template > > in the memory are written into the file. And displaying different template list data according to different use scenes, wherein the template list data is initialization data.

The user can update the priority of the modified data presentation when modifying the multiple multi-window display template data in the scene according to personal preference, and the presentation list data is ordered according to the priority. The user may delete the unnecessary template data according to personal preference.

S1806, under the condition that multi-window display is performed based on the first multi-window display template, a binding operation of a user on a preset key is received.

When the first multi-window display template is displayed in a multi-window mode, a user can trigger a preset key of the control device to perform binding operation on the first multi-window display template, and a binding operation instruction is generated. The control device sends the binding operation instruction to the television.

In some embodiments, the control device may be a remote controller, and the preset key may be a favorite key in the remote controller. The user may trigger a favorite button in the remote control to perform a binding operation on the first multi-window display template of the current usage field Jing Duiying, and generate a binding operation instruction. And the remote controller sends the binding operation instruction to the television.

S1807, in response to receiving a binding operation of the user on the preset key, binding the preset key with the first multi-window display template.

After receiving the binding operation sent by the control device, the television binds the preset key with the first multi-window display template in response to receiving the binding operation of the user on the preset key, namely, the television can store the corresponding relation between the preset key and the first multi-window display template.

In some embodiments, after receiving the binding operation instruction sent by the remote controller, the television binds the favorite key with the first multi-window display template of the current use field Jing Duiying in response to the binding operation instruction, that is, the television may store the correspondence between the favorite key and the first multi-window display template.

S1808, receiving a triggering operation of a user on a preset key.

After the television stores the corresponding relation between the preset key and the first multi-window display template, the triggering operation of the user on the preset key can be received.

In some embodiments, after the television binds the preset key to the first multi-window display template, the user may press a favorite key in the remote control. After receiving key operation input by a user, the remote controller generates a trigger operation instruction and sends the trigger operation instruction to the television.

S1809, in response to receiving a triggering operation of a user on a preset key, multi-window display is performed based on the first multi-window display template.

After the television receives the triggering operation of the user on the preset key, the television can display the first multi-window display template according to the corresponding relation between the stored favorite key and the first multi-window display template, so that the display of the data corresponding to the multiple windows can be performed based on the first multi-window display template.

The preset keys are bound with the first multi-window display template, and a user displays the first multi-window display template on the screen of the television by triggering the preset keys in the control device, so that multi-window display of the multi-window display template is performed. Therefore, the user can bind the favorite multi-window display template with the preset key, so that the user can display the multi-window display template by operating the preset key, the operation of the user can be further reduced, and the user experience is improved.

S1810, under the condition that the first multi-window display template is displayed, the second multi-window display template is not displayed, and the second multi-window display template is a multi-window display template except the first multi-window display template in the multiple multi-window display templates.

After receiving a selection operation of a user on the first multi-window display template, the television responds to the received selection operation, performs multi-window display based on the first multi-window display template, and does not display multi-window display templates except the first multi-window display template. Therefore, the mutual exclusion processing of the first multi-window display template can ensure that the multi-window display template selected by the user is displayed under the current use scene.

According to the scheme, when the television performs multi-window display, firstly, a multi-window display instruction input by a user is received, and a current use scene is determined; the current use scene comprises an HDMI scene, a DLNA scene or a full scene; then, determining at least one multi-window display template in a plurality of multi-window display templates based on the current use scene, and displaying the multi-window display templates; then, at least one multi-window display template can be modified, and the preset keys are bound with the multi-window display template; responding to the received triggering operation instruction of the user to the preset key, and performing multi-window display based on the first multi-window display template; and finally, under the condition that the first window is displayed, the second multi-window display template is not displayed.

According to the scheme, under the current use scene, a user can select a needed multi-window display template through a plurality of multi-window display templates, and the selected multi-window display template can be modified and a convenient mode can be increased. That is, according to the scheme, a user does not need to perform operations such as display area and the like under the actual use scene, and the multi-window display template can be modified and conveniently added on the basis of selecting the multi-window display template, so that multi-window display can be realized on the basis of reducing user operations.

According to the scheme, under the condition that the first multi-window display template is displayed, the second multi-window display template is not displayed. That is, the scheme of the application can ensure that the multi-window display template selected by the user is displayed under the current use scene, so that the multi-window display template performs multi-window display.

For the multi-window display method, the application also provides a multi-window display device. As shown in fig. 22, the multi-window display apparatus 2200 may include: a receiving module 2201, a determining module 2202, a display module 2203, and the like.

The receiving module 2201 may be configured to receive a multi-window display instruction input by a user.

The determining module 2202 may be configured to determine, in response to a received multi-window display instruction input by a user, a current usage scenario, where the current usage scenario includes an HDMI scenario, a DLNA scenario, or a full scenario.

The determining module 2202 may be further configured to determine, based on the current usage scenario, at least one multi-window display template corresponding to the current usage scenario among the multiple multi-window display templates.

The display module 2203 may be further configured to display at least one multi-window display template corresponding to the determined current usage scenario.

The receiving module 2201 may be further configured to receive a selection operation of the first multi-window display template by a user.

The display module 2203 may be further configured to perform multi-window display based on the first multi-window display template in response to a received user selection operation of the first multi-window display template.

It should be understood that the division of units or modules (hereinafter referred to as units) in the above apparatus is merely a division of logic functions, and may be fully or partially integrated into one physical entity or may be physically separated. And the units in the device can be all realized in the form of software calls through the processing element; or can be realized in hardware; it is also possible that part of the units are implemented in the form of software, which is called by the processing element, and part of the units are implemented in the form of hardware.

For example, each unit may be a processing element that is set up separately, may be implemented as integrated in a certain chip of the apparatus, or may be stored in a memory in the form of a program, and the functions of the unit may be called and executed by a certain processing element of the apparatus. Furthermore, all or part of these units may be integrated together or may be implemented independently. The processing element described herein, which may also be referred to as a processor, may be an integrated circuit with signal processing capabilities. In implementation, each step of the above method or each unit above may be implemented by an integrated logic circuit of hardware in a processor element or in the form of software called by a processing element.

In one example, the units in the above apparatus may be one or more integrated circuits configured to implement the above method, for example: one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of at least two of these integrated circuit forms.

For another example, when the units in the apparatus may be implemented in the form of a scheduler of processing elements, the processing elements may be general-purpose processors, such as CPUs or other processors that may invoke programs. For another example, the units may be integrated together and implemented in the form of a system on chip SOC.

In one implementation, the above means for implementing each corresponding step in the above method may be implemented in the form of a processing element scheduler. For example, the apparatus may comprise a processing element and a storage element, the processing element invoking a program stored in the storage element to perform the method described in the above method embodiments. The memory element may be a memory element on the same chip as the processing element, i.e. a chip memory element.

In another implementation, the program for performing the above method may be on a memory element on a different chip than the processing element, i.e. an off-chip memory element. At this point, the processing element invokes or loads a program from the off-chip storage element onto the on-chip storage element to invoke and execute the method described in the method embodiments above.

For example, embodiments of the present application may also provide an apparatus, such as: the display device may include: a processor, a memory for storing instructions executable by the processor. The processor is configured to execute the above instructions, causing the display device to implement the multi-window display method as described in the previous embodiments. The memory may be located within the display device or may be located external to the display device. And the processor includes one or more.

In yet another implementation, the unit implementing each step in the above method may be configured as one or more processing elements, where the processing elements may be disposed on a display device corresponding to the foregoing, and the processing elements may be integrated circuits, for example: one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of these types of integrated circuits. These integrated circuits may be integrated together to form a chip.

For example, the embodiment of the application also provides a chip, and the chip can be applied to the display device. The chip includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through a circuit; the processor receives and executes computer instructions from the memory of the display device through the interface circuitry to implement the methods described in the method embodiments above.

Embodiments of the present application also provide a computer readable storage medium having computer program instructions stored thereon. The computer program instructions, when executed by a display device, enable the display device to implement the multi-window display method as described above.

The embodiment of the application also provides a computer program product, which comprises computer instructions for running on the display device, and when the computer instructions run on the display device, the display device can realize the multi-window display method. From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be implemented by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to implement all or part of the functions described above.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some interface, device or unit indirect coupling or communication connection, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. With such understanding, the technical solutions of the embodiments of the present application may be essentially or partly contributing to the prior art or all or part of the technical solutions may be embodied in the form of a software product, such as: and (5) program. The software product is stored in a program product, such as a computer readable storage medium, comprising instructions for causing a device (which may be a single-chip microcomputer, chip or the like) or processor (processor) to perform all or part of the steps of the methods described in the various embodiments of the application. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.

For example, embodiments of the present application may also provide a computer-readable storage medium having computer program instructions stored thereon. The computer program instructions, when executed by a display device, cause the display device to implement the multi-window display method as described in the foregoing method embodiments.

The foregoing is merely a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A display device, the display device comprising:

a display;

a memory storing a plurality of multi-window display templates;

a communicator configured to receive an operation of a user;

a controller coupled with the display, the memory, and the communicator and configured to:

determining a current use scene of the display device in response to a multi-window display instruction received by the communicator and input by a user, wherein the current use scene comprises an HDMI scene, a DLNA scene or a full scene;

determining at least one multi-window display template corresponding to the current use scene in the multiple multi-window display templates based on the current use scene, and controlling the display to display the at least one multi-window display template; the plurality of multi-window display templates includes a first multi-window display template;

And responding to the selection operation of the user on the first multi-window display template received by the communicator, and controlling the display to display multiple windows based on the first multi-window display template.

2. The display device of claim 1, wherein the current usage scenario is the HDMI scenario, the first multi-window display template comprises a first display area and at least one second display area, the controller configured to:

controlling the display to display data corresponding to the HDMI in the first display area;

and controlling the display to display the screen throwing data corresponding to the first electronic equipment in the second display area, or displaying the data corresponding to the local display equipment in the second display area.

3. The display device of claim 1, wherein the current usage scenario is the DLNA scenario, the first multi-window display template includes a third display area and a fourth display area, and the controller is configured to:

controlling the display to display screen throwing data corresponding to the second electronic equipment in the third display area;

controlling the display to display screen throwing data corresponding to third electronic equipment in the fourth display area; the screen projection data corresponding to the second electronic device are different from the screen projection data corresponding to the third electronic device.

4. The display device of claim 1, wherein the current usage scenario is the full scenario, the first multi-window display template comprises a fifth display area and a sixth display area, the controller configured to:

controlling the display, and displaying data locally corresponding to the display equipment in the fifth display area;

controlling the display to display data corresponding to the local display equipment in the sixth display area, or display screen projection data corresponding to fourth electronic equipment in the sixth display area, or display data corresponding to the HDMI in the sixth display area; wherein the data locally corresponding to the display device displayed in the fifth display area is different from the data locally corresponding to the display device displayed in the sixth display area.

5. The display device of claim 1, wherein the current usage scenario is the full scenario, the first multi-window display template comprises a plurality of seventh display regions, the controller configured to:

controlling the display to display screen throwing data corresponding to a plurality of fifth electronic devices in the seventh display areas respectively; and the screen projection data corresponding to the plurality of fifth electronic devices are different.

6. The display device of claims 1-5, wherein the controller is further configured to:

responsive to the communicator receiving a user modification operation of at least one multi-window display template corresponding to the current usage scenario, modifying the at least one multi-window display template; the modification operation comprises a new addition operation, a deletion operation or a position adjustment operation;

controlling the memory to store the modified at least one multi-window display template.

7. The display device of claims 1-5, wherein the controller is further configured to:

under the condition that the display performs multi-window display based on the first multi-window display template, responding to the communicator to receive a binding operation of a user on the preset key, and binding the preset key with the first multi-window display template;

and responding to the communicator receiving the triggering operation of the preset key by the user, and controlling the display to display multiple windows based on the first multiple window display template.

8. The display device of claims 1-5, wherein the controller is further configured to:

And under the condition that the display performs multi-window display based on the first multi-window display template, controlling the display not to display a second multi-window display template, wherein the second multi-window display template is a multi-window display template except the first multi-window display template in the multi-window display templates.

9. A method of multi-window display, the method comprising:

responding to a received multi-window display instruction input by a user, and determining a current use scene, wherein the current use scene comprises an HDMI scene, a DLNA scene or a full scene;

determining at least one multi-window display template corresponding to the current use scene in a plurality of multi-window display templates based on the current use scene, and displaying the at least one multi-window display template; the plurality of multi-window display templates includes a first multi-window display template;

responding to a received selection operation instruction of a user on the first multi-window display template, and performing multi-window display based on the first multi-window display template.

10. A computer readable storage medium having stored thereon computer program instructions; it is characterized in that the method comprises the steps of,

The computer program instructions, when executed by an electronic device, cause the electronic device to implement the multi-window display method as claimed in claim 9.