CN117615184A

CN117615184A - Display apparatus and display method

Info

Publication number: CN117615184A
Application number: CN202310798851.4A
Authority: CN
Inventors: 马晓燕; 李金昆; 庞秀娟
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2023-06-30
Filing date: 2023-06-30
Publication date: 2024-02-27

Abstract

The embodiment of the application provides a display device and a display method. The display device includes a display, a communicator, and a controller. Wherein the controller is configured to receive a multi-window display operation of a user input through the communicator while the display is displaying the first user interface; responding to the multi-window display operation, controlling a display to display the first user interface on a first display window, displaying a second user interface on a second display window, and displaying a focus frame at a first focus position of the first user interface; receiving a first focus switching operation input by a user through a communicator; in response to the first focus switching operation, the focus frame is moved from the first focus position to the second focus position of the first user interface or the third focus position of the second user interface. By applying the scheme, the focus switching among the display windows and the control of the control in each display window can be realized in a multi-window display mode.

Description

Display apparatus and display method

Technical Field

The embodiment of the application relates to the technical field of display equipment, in particular to display equipment and a display method.

Background

With the development of smart televisions and the continuous appearance of new display terminals, screen sharing among multiple screens becomes a popular display mode. In the screen sharing process, the display of different screens can be generally realized by different protocols. For example, when display frames corresponding to a plurality of display windows (such as two display windows) are simultaneously displayed on the display device, one of the two display windows may be a screen display window, and the other display window may be a non-screen application display window. In the related art, focus switching cannot be performed between multiple display windows, so that a user cannot control each application (or control) in the two display windows, and thus the use experience of the user is affected.

Disclosure of Invention

The embodiment of the application provides display equipment and a display method, which solve the problems that when the display equipment performs multi-window display, focus switching cannot be performed among a plurality of display windows, and the application or control in each display window cannot be controlled.

In order to achieve the above purpose, the embodiments of the present application adopt the following technical solutions:

a first aspect of embodiments of the present application provides a display device including a display, a communicator, and a controller. Wherein the display is configured to display a user interface. The communicator is configured to receive user operations. The controller is coupled with the display and the communicator and is configured to: receiving a multi-window display operation input by a user through a communicator when the display displays a first user interface; responding to the multi-window display operation, controlling a display to display a first user interface on a first display window, displaying a second user interface on a second display window, and displaying a focus frame at a first focus position of the first user interface; receiving a first focus switching operation input by a user through a communicator; in response to the first focus switching operation, the focus frame is moved from the first focus position to the second focus position of the first user interface or the third focus position of the second user interface.

A second aspect of the embodiments of the present application provides a display method, including: receiving a multi-window display operation input by a user through a communicator when the display displays a first user interface; responding to the multi-window display operation, controlling a display to display a first user interface on a first display window, displaying a second user interface on a second display window, and displaying a focus frame at a first focus position of the first user interface; receiving a first focus switching operation input by a user through a communicator; in response to the first focus switching operation, the focus frame is moved from the first focus position to the second focus position of the first user interface or the third focus position of the second user interface.

A third aspect of embodiments of the present application provides an electronic device having a function of implementing the display method described in the second aspect. The functions can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

A fourth aspect of the embodiments of the present application provides an electronic device, including: a processor and a memory; the memory is configured to store computer instructions that, when executed by the electronic device, cause the electronic device to perform the display method of any of the second aspects described above.

A fifth aspect of embodiments of the present application provides a computer-readable storage medium having instructions stored therein that, when executed on an electronic device, enable the electronic device to perform the display method of any one of the second aspects above.

A sixth aspect of embodiments of the present application provides a computer program product comprising computer instructions which, when run on an electronic device, enable the electronic device to perform the display method of any one of the second aspects above.

A seventh aspect of embodiments of the present application provides an apparatus (e.g., the apparatus may be a system-on-a-chip) comprising a processor for supporting an electronic device to implement the functionality referred to in the second aspect above. In one possible design, the apparatus further includes a memory for storing program instructions and data necessary for the display device. When the device is a chip system, the device can be formed by a chip, and can also comprise the chip and other discrete devices.

Based on the technical scheme provided by the embodiment of the application, by setting focuses on a plurality of display windows in the display device and controls of the user interface corresponding to the display windows, and when a multi-window display operation is received, displaying a focus frame at a first focus position of a first user interface displayed by a first display window, namely, when the display device enters a multi-window display mode, determining that the initial position of the focus frame is the first focus position of the first user interface. Then, after receiving the first focus switching operation, in response to the first focus switching operation, the focus frame may be moved from the first focus position to a second focus position of the first user interface; alternatively, the focus frame may be moved from the first focus position to a third focus position of the second user interface displayed by the second display window. Therefore, through the embodiment of the application, the focal point between the first display window and the second display window can be switched, and the focal point between the controls in the first display window or the second display window can also be switched.

Drawings

The drawings are only for purposes of illustrating embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:

fig. 1 is a schematic diagram of an operation scenario between a display device, a control device, and a server provided in an embodiment of the present application;

fig. 2 is a hardware configuration block diagram of a control device according to an embodiment of the present application;

fig. 3 is a hardware configuration block diagram of a display device according to an embodiment of the present application;

fig. 4 is a schematic diagram of a system of a display device according to an embodiment of the present application;

fig. 5 is a schematic diagram of a display method according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a single window display according to an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of another single window display provided in an embodiment of the present application;

FIG. 8 is a schematic diagram of a multi-window display according to an embodiment of the present application;

FIG. 9 is a schematic diagram of another display method according to an embodiment of the present disclosure;

FIG. 10A is a schematic diagram of another multi-window display provided in an embodiment of the present application;

FIG. 10B is a schematic diagram of yet another multi-window display provided in an embodiment of the present application;

FIG. 11 is a schematic diagram of another display method according to an embodiment of the present disclosure;

FIG. 12 is a schematic diagram of yet another multi-window display provided in an embodiment of the present application;

FIG. 13 is a schematic diagram of yet another multi-window display provided in an embodiment of the present application;

FIG. 14 is a schematic diagram of yet another multi-window display provided in an embodiment of the present application;

FIG. 15 is a schematic diagram of another display method according to an embodiment of the present disclosure;

FIG. 16 is a schematic diagram of yet another multi-window display provided in an embodiment of the present application;

FIG. 17 is a schematic diagram of a further display method according to an embodiment of the present disclosure;

fig. 18 is a schematic diagram of a focus switching device according to an embodiment of the present disclosure;

fig. 19 is a schematic diagram of a display device according to an embodiment of the present application.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "and/or" in this application is merely an association relation describing an associated object, and indicates that three relations may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the front and rear association objects are an or relationship.

The display device provided in the embodiment of the application may have various implementation forms, for example, the display device may be a display device with MIC such as a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. The embodiment of the application does not limit the specific form of the display device. In the embodiment of the application, a display device is taken as a television device as an example for schematic description.

Fig. 1 is a schematic diagram of an operation scenario between a display device, a control device, and a server according to some embodiments of the present application. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control device 100.

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device 200 includes infrared protocol communication, bluetooth protocol communication, or other short-range communication, and the display device 200 is controlled through wireless or wired communication. For example, the user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, the display device 200 may also be controlled by the smart device 300. In some examples, the smart device 300 may be a smart phone, tablet, computer, notebook, or the like. For example, the smart device 300 may implement connection communication with application software installed on the display device 200 through a network communication protocol, for the purpose of one-to-one control operation and data communication; or the audio and video contents displayed on the intelligent device 300 can be transmitted to the display device 200, so as to realize the synchronous display function.

In some embodiments, the display device 200 may also perform control using other means than the control device 100 and the smart device 300, for example, the voice instruction control of the user may be directly received through a module for acquiring voice instructions configured inside the display device 200 device, or the voice instruction control of the user may also be received through a voice control device provided outside the display device 200 device.

As shown in fig. 1, the display device 200 may also be in data communication with the server 400 through a variety of communication means, for example, the display device 200 may be communicatively connected through a local area network (Local Area Network, LAN), wireless local area network (Wireless Local Area Networks, WLAN), or other network.

Fig. 2 is a block diagram of a hardware configuration of a control device 100 according to some embodiments of the present application. As shown in fig. 2, the control apparatus 100 includes a control device 110, a communication interface 130, a user input/output interface 140, a power supply 180, and a memory 190. The control device 100 is configured to control the display device 200, and can receive an operation instruction input by a user, and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and the control device 100 is configured to enable information interaction between the user and the display device 200.

As shown in fig. 2, the control device 110 may also include a processor 112, random access memory RAM 113 and ROM 114, a communication interface 130, and a communication bus (not shown in fig. 2). The control device 110 is used for controlling the operation and the operation of the control apparatus 100, and controlling communication cooperation between components inside the control apparatus 100 and external and internal data processing functions.

Illustratively, the communication interface 130 may include at least one of a WiFi chip 131, a bluetooth component 132, and other near field communication (Near Field Communication, NFC) components 133, among others. The communication interface 130 may encode an instruction input by a user through a WiFi protocol, a bluetooth protocol, or an NFC protocol under the control of the control device 110, and send the instruction to the display device 200, so as to implement communication between control signals and data signals with the display device 200.

The user input/output interface 140 includes an input interface and an output interface, wherein the input interface may include at least one of a microphone 141, a touch pad 142, a sensor 143, keys 144, and other input interfaces.

The memory 190 is used to store various running programs, data and applications for driving and controlling the control device 100 under the control of the control apparatus 110, and may also store various control signal instructions input by a user.

A power supply 180 for providing operation power support for the components in the control device 100 under the control of the control means 110.

Illustratively, taking a display device as an example of a television device, fig. 3 is a block diagram of a hardware configuration of a display device 200 according to some embodiments of the present application.

As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface to an nth interface for input/output.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation Interface, and a user manipulation User Interface (UI).

The display 260 may be a liquid crystal display, an organic light emitting diode (Organic Light Emitting Diode, OLED) display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface operable to receive control signals for controlling the apparatus 100, such as an infrared remote control or the like.

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high definition multimedia interface (High Definition Multimedia Interface, HDMI), analog or data high definition component input interface (component), composite video input interface (Composite Video Baseband Signal, CVBS), universal serial bus (Universal Serial Bus, USB) input interface, RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner and demodulates audio and video signals, such as electronic program guide (Electronic Program Guide, EPG) data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the controller 250 includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), a random access Memory (Random Access Memory, RAM), a Read-Only Memory (ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A user may input a user command through a graphical user interface (Graphic User Interface, GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface. Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of a user interface is a graphical user interface, which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the display device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

It will be appreciated that in general, implementation of display device functions requires software in addition to the hardware support described above.

Fig. 4 is a schematic diagram of a system of a display device according to some embodiments of the present application. In some embodiments, the system of the display device 200 may be divided into four layers, from top to bottom, an application layer (application layer), an application framework layer (Application Framework layer), a An Zhuoyun runtime (Android run) and a system library layer (system runtime layer), and a kernel layer, respectively.

In some embodiments, at least one Application (APP) is running in the Application layer, for example, the at least one Application may include an Application that exposes access conditions and content of an external signal source. These applications may be operating system self-contained Window (Window) programs, system setup programs, or clock programs, etc.; or may be an application developed by a third party developer, such as a web application (also referred to as a web application), to which embodiments of the present application are not limited.

The framework layer provides an application programming interface (Application Programming Interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

For example, the framework layer may also provide a JAVA interface for interfacing with hardware, and implementing interfacing with a lower layer and obtaining information through the JAVA interface of the framework layer. For example, related data of an external signal source of the television can be obtained, access state information of a current signal source can be obtained, display information of the current signal source can be obtained, and the like.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. The kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), MIC drive, power drive, etc.

In general, when the display 260 in the display device 200 simultaneously displays user interfaces corresponding to a plurality of display windows, a user cannot implement focus switching between the plurality of display windows, and cannot implement switching of focus between application programs or controls in each display window. Therefore, the user cannot control the application programs or the controls in each display window, so that related display settings cannot be performed, and the use experience of the user is affected.

In some examples, when display device 200 exits from a multi-window display to a single-window display, a user may implement manipulation of applications or controls in the single display window through control device 100.

In order to solve the above-described problems, the present embodiment provides a display apparatus 200, the display apparatus 200 including a communicator 220, a controller 250, and a display 260. Wherein the display 260 is configured to display a user interface. The communicator 220 is configured to receive user operations. The controller 250 is configured to receive a multi-window display operation of user input through the communicator 220 while the display 260 displays the first user interface; in response to the multi-window display operation, control display 260 displays a first user interface in a first display window, a second user interface in a second display window, and a focus frame in a first focus position of the first user interface; receiving a first focus switching operation input by a user through the communicator 220; in response to the first focus switching operation, the focus frame is moved from the first focus position to the second focus position of the first user interface or the third focus position of the second user interface. The display device 200 provided in the embodiment of the present application may implement switching of focal points between the first display window and the second display window, and may also implement switching of focal points between controls in the first display window or the second display window.

The display method provided in the embodiment of the present application is described in detail below with reference to the accompanying drawings. Note that the display method in the following embodiments may be implemented in the display device 200 having the above-described hardware structure or software structure.

Fig. 5 is a schematic diagram of a display method according to an embodiment of the present application, as shown in fig. 5, the display method includes steps S510 to S540 as follows.

Step S510, receiving, by the communicator, a multi-window display operation input by a user while the display displays the first user interface.

In some examples, the multi-window display operation is used to instruct the display 260 to enter a multi-window display module (which may also be referred to as a split screen mode), i.e., the multi-window display operation is used to instruct the display 260 to simultaneously display user interfaces corresponding to multiple display windows.

Illustratively, the user may send a multi-window display operation to the display device 200 (e.g., communicator 220) through a preset interaction. In some examples, the user may send a multi-window display operation to the display device 200 through a split-screen mode enter key provided on the control device 100 (e.g., remote control) that is associated with the display device 200. For example, when the user presses the split mode enter key, the controller 250 controls the display device 200 to enter the split mode in response to the operation, and the controller 250 controls the display 260 to perform multi-window display. It should be noted that, the keys corresponding to the entry split screen mode and the exit split screen mode on the control device 100 may be the same key or may not be different keys, which is not limited in the embodiment of the present application.

In other examples, the user may also send a multi-window display operation to the display device 200 via voice instructions to control the display device 200 to enter a split screen mode. For example, after the user inputs a wake-up word (e.g., "hi, x"), a voice command (e.g., "switch to split mode") corresponding to the entry into split mode may be input to the display device 200, and in response to the voice command, the controller 250 may control the display 260 to perform multi-window display.

In still other examples, controller 250 may also monitor the status of use of the user and determine whether a split screen mode needs to be entered based on the status of use of the user. If the controller 250 determines that the user has a requirement for multi-window display according to the use state of the user, the display 260 may be controlled to enter the split screen mode, or a switching option of the split screen mode is provided for the user. For example, when the display device 200 performs single window display, if it is detected that a screen projection signal is accessed, the screen separation mode may be automatically switched.

In step S520, in response to the multi-window display operation, the display is controlled to display a first user interface on the first display window, a second user interface on the second display window, and a focus frame on the first focus position of the first user interface.

In some examples, if the plurality of display windows of the display device 200 includes a first display window and a second display window, after the controller 250 receives the multi-window display operation, the display 260 may be controlled to enter a two-screen display in response to the multi-window display operation, i.e., the display 260 may display the first user interface at the first display window while displaying the second user interface at the second display window.

For example, the first display window and the second display window may respectively display user interfaces corresponding to different external signal sources, for example, the first user interface may be a user interface corresponding to a screen-throwing signal source, the second user interface may be a user interface corresponding to an application program, and the first display window and the second display window do not interfere with each other.

It should be noted that the display 260 may further include a greater number of display windows, such as three display windows. For convenience of description, the embodiment of the present application is schematically illustrated by taking the example that the display 260 includes two display windows, i.e., a first display window and a second display window.

For example, the user interface in each display window may be displayed in a horizontal format or in a vertical format, which is not limited in this embodiment of the present application.

In some embodiments, the first display window and the second display window are provided with a focus. If the first user interface corresponding to the first display window and the second user interface corresponding to the second display window include at least one control, a focus may be set on the at least one control. In some examples, the control may not be included in the first user interface or the second user interface.

Illustratively, when the display device 200 is started, the display device 200 may first enter the single window display mode, such as the display 260 displaying the first user interface in the first display window, in which case the controller 250 may control the display 260 to display the focus frame at a focus position in the first user interface.

In some examples, the focus box may be displayed in a highlighted or marked manner. For example, a focus processing module in the controller 250 may mark a focus corresponding to a control in the first user interface and highlight or mark a focus box in the first user interface.

In some examples, controller 250 may determine a start position of the focus frame and display the focus frame at the start position (e.g., the start focus position) before controlling display 260 to display the focus frame. Then, the controller 250 may move the focus frame according to the focus switching operation input by the user, so as to implement switching between focuses corresponding to the controls in the first user interface.

In some embodiments, the start position of the focus frame may be a focus position corresponding to a first control in the first user interface.

Fig. 6 is a schematic diagram of a single window display according to an embodiment of the present application. As shown in fig. 6, the display 260 is currently a single window display, with a first user interface displayed in a first display window. The first user interface includes a plurality of controls, such as three controls (control 601, control 602 and control 603), and each control is provided with a focus. After the start position of the focus frame is determined in the first user interface, the focus frame may be moved.

As shown in fig. 6, the starting position of the focus frame in the first user interface may be the first control position in the upper left of the first user interface, i.e., the position of control 601. Wherein the focus frame of the focus position corresponding to the control 601 may be displayed in a highlighted manner.

In other embodiments, the starting position of the focus frame may also be the focus position corresponding to the preset control in the first user interface. The preset control may be the first control in the first user interface, or may not be the first control in the first user interface.

Illustratively, the controller 250 may determine the starting position of the focus frame by a focus seeking operation. In some examples, the controller 250 may perform the focus seeking operation in a top-to-bottom, and left-to-right order. For example, controller 250 may find the current first focusable control in the first user interface through the resetoreDefaultFocus () in DecoreView, after which the requestFocus () process may be performed. The requestFocus () process may include two parameters, i.e., direction parameter and previuslyfocusedrect parameter, where the direction parameter may be searched according to the current focus direction, and the previuslyfocusedrect parameter may record acquired related information (e.g., focus information).

Fig. 7 is a schematic diagram of another single window display according to an embodiment of the present application. As shown in fig. 7, when the number of the controls in the first user interface is greater and the distribution is more complex, the control with higher use frequency in the first user interface may be determined as the preset control; alternatively, the preset control may be set according to other rules, which is not limited in the embodiment of the present application.

As shown in fig. 7, after the typesetting of the first user interface is completed, the controller 250 determines, through the focus searching operation, that the control "carefully chosen" in the first user interface is the initial focus, that is, the focus position corresponding to the control "carefully chosen" is the initial position of the focus frame, and then displays the focus frame at the focus position corresponding to the control "carefully chosen". That is, the control "cull" is a preset control. Referring to fig. 7, the start position of the focus frame is not the focus position corresponding to the first control "my" in the first user interface, but the preset control "picks" the corresponding focus position.

Fig. 8 is a schematic diagram of a multi-window display according to an embodiment of the present application. As shown in fig. 8, the first display window 810 may be a left drop screen window of the display 260 and the second display window 820 may be a right application window. When the display 260 displays a second user interface including a plurality of application programs (or a plurality of controls) on the right application window, if a multi-window display operation (such as accessing a screen-throwing signal source) input by a user is received, a multi-window display mode is entered, and the display 260 is controlled to display a first user interface including a screen-throwing screen on the left screen-throwing window (i.e., the first display window 810).

Illustratively, after the display 260 enters the multi-window display, the controller 250 needs to re-determine the starting position of the focus frame. In some examples, when the display 260 displays only the second user interface, the start position of the focus frame may be located at a certain focus position in the second user interface, and when the display 260 displays the first user interface while displaying the second user interface, the start position of the focus frame may be determined according to the display sequence of the first display window and the second display window.

For example, the second display window 820 (i.e., the right display window) is the main window (which may also be referred to as a preset window) of the display 260. I.e., the second display window 820 is displayed before the first display window 810, it may be determined that the start position of the focus frame is located at a certain focus position of the second user interface of the previously displayed second display window 820. For another example, after the display 260 enters the multi-window display, the start position of the focus frame may also be located at a focus position of the first user interface of the first display window 810 of the rear display. The embodiments of the present application are not limited in this regard.

It should be noted that, in order to avoid repetition, the process of determining the start position of the focus frame in the first user interface and the second user interface is similar, and in this embodiment, the determination of the start position of the focus frame in the first user interface displayed later is exemplified.

After determining that the start position of the focus frame is located at the first focus of the first user interface of the first display window displayed later, the position of the first focus of the first user interface may be further determined. A process of displaying a focus frame at a first focus position of a first user interface in an embodiment of the present application will be described in detail with reference to fig. 9.

In some embodiments, the first focus comprises a first sub-focus and a second sub-focus.

Fig. 9 is a schematic diagram of another display method provided in the embodiment of the present application, as shown in fig. 9, in step S520 in the above embodiment, a focus frame is displayed at a first focus position of a first user interface, and specifically includes steps S5211 to S5213 described below.

In step S5211, the priority of the first display window is determined.

In some examples, the priority of each display window in the plurality of display windows may include a priority attribute, also referred to as a window attribute, of each display window. Each display window has a preset priority attribute, and the first focus can be set according to the priority attribute of each display window.

In some examples, the first focus may include a first sub-focus corresponding to the first display window and a second sub-focus corresponding to the first control in the first user interface. That is, the priority of the first display window may determine that the start position of the focus frame is at a first sub-focus position corresponding to the first display window (may also be referred to as a focus position corresponding to the large window) or at a corresponding second sub-focus position of the first control in the first user interface (may also be referred to as a focus position of the sub-window).

In step S5212, when the priority of the first display window satisfies the first condition, the focus frame is displayed at the first sub-focus position corresponding to the first display window.

Illustratively, the priority of the first display window satisfying the first condition may include the priority attribute of the first display window being window priority, e.g., the window attribute of the first display window may be "FOCUS_BLOCK_ DESCENDANTS". That is, when the priority attribute of the first display window is "focus_block_ DESCENDANTS", it is indicated that the priority of the first display window satisfies the first condition. In this case, the start position of the focus frame is located at the first sub-focus position corresponding to the first display window.

In some examples, after determining that the start position of the focus frame is located at the first sub-focus position corresponding to the first display window, the controller 250 controls the display 260 to display the focus frame at the first sub-focus position.

Fig. 10A is a schematic diagram of another multi-window display according to an embodiment of the present application. As shown in fig. 10A, the display 260 displays a focus frame at a first sub-focus position corresponding to a first display window 810 (e.g., a left-side drop screen window).

In some examples, as shown in fig. 10A, if the priority attribute (e.g., window attribute) of the first display window 810 is determined to be "focus_block_ DESCENDANTS", the first sub-FOCUS may be acquired through a FOCUS-seeking operation on the left-hand screen window mleftpindowview of the display 260. For example, the Focus processing module in the controller 250 may perform Focus (Focus) marking on the first sub-Focus corresponding to the first display window 810, and the display management module in the controller 250 may set the display state of the first sub-Focus to a displayable state (e.g., a Visible state), and perform display processing on the Focus frame at the first sub-Focus position, that is, set the Focus frame to be highlighted or marked for display at the first Focus position.

In step S5213, if the priority of the first display window satisfies the second condition, the focus frame is displayed at the second sub-focus position corresponding to the first control in the first user interface.

Illustratively, the priority of the first display window satisfying the second condition may include the priority attribute of the first display window being control priority, e.g., the window attribute of the first display window may be "FOCUS_AFTER_ DESCENDANTS". That is, when the priority attribute of the first display window is "focus_enter_ DESCENDANTS", it is indicated that the priority of the first display window satisfies the second condition. In this case, the start position of the focus frame is located at the second sub-focus position corresponding to the first control in the first user interface.

In some examples, after determining that the start position of the focus frame is located at a second sub-focus position corresponding to the first control in the first user interface, the controller 250 controls the display 260 to display the focus frame at the second sub-focus position.

The first control may be a first control of the first user interface, or may be a preset control of the first user interface. For example, as shown in fig. 6, the first control is the first control of the first user interface, and the start position of the focus frame is located at the focus position corresponding to the first control (i.e., control 601) of the first user interface. As shown in fig. 7, the first control is a preset control of the first user interface, and the start position of the focus frame is located at a focus position corresponding to the preset control (e.g. control "carefully selecting") of the first user interface. The first control is not limited in the embodiment of the application. The embodiment of the application takes the first control as the first control of the first user interface as an example for illustration.

Fig. 10B is a schematic diagram of yet another multi-window display according to an embodiment of the present application. As shown in fig. 10B, the display 260 displays a focus frame at a second sub-focus position corresponding to a first control of a first user interface displayed in a first display window 810 (e.g., a left drop screen window).

In some examples, as shown in fig. 10B, if the priority attribute (e.g., window attribute) of the first display window 810 is determined to be "focus_after_ DESCENDANTS", the second sub-FOCUS may be acquired in the first user interface of the first display window 810 (left-side screen window mlefwindowview) through a FOCUS seeking operation. For example, after determining the first control mLeftWindwosChildView0 through the focus searching operation, judging whether the focus corresponding to the first control mLeftWindwosChildView0 can be acquired; if the focus corresponding to the first control mleftwoschild view0 can be obtained, the requestfocus () process is performed on the first control mleftwoschild view0, that is, the display management module in the controller 250 may set the display state of the focus corresponding to the first control mleftwoschild view0 to a displayable state (such as a visual state), and highlight or mark and display the focus frame at the focus position corresponding to the first control mleftwoschild view 0.

In step S530, a first focus switching operation input by a user is received through the communicator.

For example, after the first user interface determines the start position of the focus frame, the controller 250 may receive a first focus switching operation input by the user. Wherein the first focus switching operation is used to instruct the controller 250 to move the focus frame from a first focus position (i.e., a start position of focus) of the first user interface to another focus position. The further focal position may be a focal position of the first user interface or a focal position of the second user interface.

In some examples, the first focus switching operation may be a key input by a user through the control device 100 (e.g., a remote control) for indicating a direction. The keys used for indicating the directions on the remote controller comprise up-shift, down-shift, left-shift and right-shift direction keys. Alternatively, the user may also implement the first focus switching operation by inputting a voice instruction. It should be noted that, the user may also input the first focus switching operation through a device such as a touch screen, a mouse, a keyboard, and the like. The embodiments of the present application are not limited in this regard. For example, the controller 250 may switch the focus position, i.e., move the focus frame position, according to a first focus switching operation input by a user.

In some examples, the controller 250 may determine a movement direction and a movement order of the focus frame according to the first focus switching operation. For example, as shown in FIG. 10B, the highlighted focus frame (i.e., the start position) is located at the focus position corresponding to the first control mLeftWindwosChildView 0 of the first user interface; if the first focus switching operation input by the user is "right shift", the controller 250 may move the focus frame from the focus position corresponding to the first control mleftwoddwoschild view 0 to the focus position corresponding to the second control mleftwoschild view 1 on the right side of the first control.

In response to the first focus switching operation, the focus frame is moved from the first focus position to the second focus position of the first user interface or the third focus position of the second user interface, step S540.

In some examples, the controller 250 may implement switching of focus within the first user interface according to the first focus switching operation, and may also implement switching of focus between the first display window (or first user interface) and the second display window (or first user interface).

In some embodiments, a user interface displayed by at least one of the plurality of display windows may include at least one control. For example, a first user interface displayed by a first display window may include a plurality of controls, which may include a first control and a second control; alternatively, the first user interface may also include a control; alternatively, the control may not be provided in the first user interface. It should be noted that the number of control settings in the second user interface may be the same as or different from the number of control settings in the first user interface, which is not limited in the embodiment of the present application.

The case of moving the focus frame from the first focus position to the second focus position of the first user interface (i.e., switching of the focuses inside the first user interface) and the case of moving the focus frame from the first focus position to the third focus position of the second user interface (i.e., switching of the focuses between the first display window and the second display window) will be described below, respectively.

Fig. 11 is a schematic diagram of another display method according to an embodiment of the present application. In some embodiments, in a case where the focus frame is displayed at the first sub-focus position corresponding to the first display window, and the first user interface includes the first control and the second control, as shown in fig. 11, step S540 includes steps S5411 to S5413 as follows.

In step S5411, in response to the first focus switching operation, the focus attribute of the first control is determined.

In some examples, as shown in fig. 10A, when the controller 250 determines that the start position of the FOCUS frame is the first sub-FOCUS position, that is, determines that the priority attribute of the first display window is "focus_block_ DESCENDANTS", if it is determined that the first user interface includes at least two controls (such as the first control and the second control), the controller 250 may first determine the FOCUS attribute (also referred to as the FOCUS attribute) of the first control in response to the first FOCUS switching operation.

In some embodiments, the focal properties of the control include valid and invalid.

Illustratively, the focus property of the control being valid may include setting the focus property of the control to true; when the focus attribute of the control is valid, it indicates that the controller 250 may obtain the focus corresponding to the control, and may also display the focus frame at the focus position corresponding to the control. Invalidating the focus property of the control may include setting the focus property of the control to false; when the focus attribute is invalid, it indicates that the controller 250 cannot acquire the focus corresponding to the control, and cannot display the focus frame at the focus position corresponding to the control.

It should be noted that the focal properties of the controls in the user interface may be the same or different. For example, the focal properties of the plurality of controls of the first user interface may be valid or invalid; or the focal property of one part of the controls in the first user interface is valid, and the focal property of the other part of the controls is invalid. The embodiments of the present application are not limited in this regard.

Illustratively, the first control of the first user interface may be a first control in the first user interface; for example, the first control may be the first control shown in fig. 6 (i.e., control 601). Alternatively, the first control may be a preset control in the first user interface; for example, the first control may be a preset control (i.e., control "pick") as shown in fig. 7.

In the embodiment of the present application, the first control is taken as an example of the first control in the first user interface, for example, as shown in fig. 10B, the first control may be a first control mlevtwowoschild view 0 in the first user interface.

In step S5412, if the focus attribute of the first control is valid, the focus frame is moved from the first sub-focus position to the second sub-focus position corresponding to the first control.

For example, as shown in fig. 10B, when the focus attribute of the first control (i.e., the first control mleftwoschildview 0) is valid, it indicates that the focus corresponding to the first control may be acquired, and thus, the controller 250 may move the focus frame from the first sub-focus position to the second sub-focus position corresponding to the first control in response to the first focus switching operation.

In some examples, the first focus switching operation may be input through a key (e.g., a confirm key) of the remote controller when the start position of the focus frame is at a first sub-focus position corresponding to the first display window. That is, when determining that the first user interface has a control with a valid focus attribute, the controller 250 may move the focus frame from the focus position corresponding to the first display window (e.g., the left screen window mleftpindowview) to the focus position corresponding to the internal control of the first user interface, then determine the first control through a focus searching operation, and determine whether the second sub focus corresponding to the first control (e.g., the first control) may be acquired; when the second sub-focus corresponding to the first control can be obtained, that is, the focus attribute of the first control is true, the first control is subjected to the requestfocus () process, and the display 260 is controlled to display the focus frame at the second sub-focus position corresponding to the first control.

Fig. 12 is a schematic diagram of still another multi-window display according to an embodiment of the present application. As shown in (a), (b) and (c) of fig. 12, the first user interface displayed by the first display window 810 includes a first control mleftwoddwoschildview 0, a second control mlefwingwoschildview 1, a third control mlefwingwoschildview 2, a fourth control mlefwingwoschildview 3, a fifth control mlefwingwoschildview 4, a sixth control mlefwingwoschildview 5 and a seventh control mleftwoschild child view 6. In some examples, if the focus attribute of the first control mleftwowoskildview 0 is valid, the controller 250 may move the focus frame from the first sub-focus position corresponding to the first display window 810 shown in fig. 12 (a) to the focus position corresponding to the first control mleftwowoskildview 0 shown in fig. 12 (b).

In step S5413, when the focus attribute of the first control is invalid, the focus frame is moved from the first sub-focus position to a fourth focus position corresponding to the second control after the first control.

Illustratively, the focus attribute of the second control is valid.

In some examples, when the focus attribute of the first control is invalid, it indicates that the focus corresponding to the first control cannot be acquired, in which case, in response to the first focus switching operation, the controller 250 may move the focus frame from the first sub-focus position to the fourth focus position corresponding to the second control whose focus attribute is valid after the first control.

That is, when the controller 250 determines that the focal property of the first control is invalid, the determination of the focal property of the second control subsequent to the first control may be continued. And when the focal attribute of the second control is determined to be valid, the focal frame can be moved from the first sub-focal position corresponding to the first display window to the fourth focal position corresponding to the second control.

For example, the controller 250 may determine the second control in a preset focus order. For example, the second control may be a control that is active along a first control followed by a focus attribute (e.g., a first focus attribute) determined in a top-to-bottom, left-to-right order.

In some examples, the controller 250 may sequentially determine the focal attribute of each control after the first control according to the preset focal sequence, until it is determined that one focal attribute in the first user interface is a valid control, and move the focus frame from the first sub-focus position to the focus position corresponding to the first control whose focal attribute is valid.

For example, as shown in (a) of fig. 12, when the first control is the first control mleftwofoschildview 0 and the focus attribute of the first control mleftwoschildview 0 is invalid (such as false), the second control mleftwofoschildview 1, the third control mleftwofoschildview 2, the fourth control mleftwofoschildview 3, the fifth control mleftwofoschild childview 4, the sixth control mleftwofoschild child view 5, and the seventh control mleftwofoschild child view 6 may be determined in that order.

For example, as shown in (a) and (c) in fig. 12, when the focal attribute of 7 controls in the first user interface is invalid except for the first control mleftwowoschild view 0, and the focal attribute of the other 6 controls is valid, the second control may be a second control mleftwoschild view 1 after the first control. The controller 250 may move the focus frame from a first sub focus position corresponding to the first display window shown in fig. 12 (a) to a focus position corresponding to the second control mleftwodwschild view 1 (i.e., the second control) shown in fig. 12 (c).

For another example, when the focal attribute of the first control mleftwoskildview 0, the second control mleftwoskildview 1, the third control mleftwoskildview 2, and the fourth control mleftwoskildview 3 is invalid, the focal attribute of the fifth control mleftwoskildview 4, the sixth control mleftwoskildview 5, and the seventh control mleftwoskildview 6 is valid, the determined second control may be the control in which the first focal attribute is valid after the first control mleftwoskildview 0, that is, the fifth control mlefwingwindoskildview 4.

It should be noted that other rules may be adopted for the preset focus sequence, which is not limited in the embodiment of the present application.

In some embodiments, when the focus frame is displayed at the first sub-focus position corresponding to the first display window and the first user interface does not include a control with a valid focus attribute, the focus frame is moved from the first sub-focus position to a third focus position of the second user interface in response to the first focus switching operation.

That is, when the focus frame is displayed at the first sub-focus position corresponding to the first display window and the first user interface does not include a control with a valid focus attribute, the controller 250 may move the focus frame from the first display window to the second display window in response to the first focus switching operation, so as to implement focus switching between the first display window and the second display window. For example, the user may input a first focus switching operation through a certain key (e.g., a right shift key) among the remote controller keys, so that the controller 250 switches the focus frame from the first display window to the second display window.

In some examples, excluding the control in the first user interface whose focus attribute is valid may include: at least one control is included in the first user interface, and the focal property of the at least one control is invalid.

For example, as shown in fig. 12, when 7 controls are included in the first user interface and the focal property of the 7 controls is invalid, the controller 250 moves the focus frame from the first sub-focus position corresponding to the first display window shown in fig. 12 (a) to the third focus position of the second user interface in the second display window 820.

In other examples, the first user interface may not include a control whose focus attribute is valid further include: the control is not included in the first user interface. For example, when only the screen-cast screen is displayed full screen inside the entire window of the first display window, no control may be provided in the first user interface of the first display window.

Fig. 13 is a schematic diagram of still another multi-window display according to an embodiment of the present application. As shown in fig. 13 (a), the first display window 810 (i.e., left-side screen-drop window) displays the first user interface including the screen-drop screen, and no other controls are included in the first user interface. In this case, the controller 250 moves the focus frame from the first sub-focus position corresponding to the first display window to the third focus position of the second user interface in response to the first focus switching operation.

In some embodiments, the third focus comprises a third sub-focus and a fourth sub-focus. The controller 250 is specifically configured to: determining a priority of the second display window in response to the first focus switching operation; and displaying the focus frame at a third sub-focus position corresponding to the second display window under the condition that the priority of the second display window meets the first condition. And displaying the focus frame at a fourth sub-focus position corresponding to the third control in the second user interface under the condition that the priority of the second display window meets the second condition.

For example, when determining that the first focus switching operation is used to switch the focus frame from the first focus position of the first user interface to the third focus position of the second user interface, the position of the third focus at the second user interface may be determined according to the priority of the second display window. The position of the third focus on the second user interface comprises a third sub-focus position corresponding to the second display window or a fourth sub-focus position corresponding to the third control in the second user interface.

In some examples, when the priority of the second display window meets the first condition, that is, the priority attribute of the second display window is "focus_block_ DESCENDANTS", the third FOCUS is a third sub FOCUS corresponding to the second display window. In this case, the controller 250 may move the focus frame from the first sub-focus position corresponding to the first display window 810 shown in (a) of fig. 13 to the third sub-focus position corresponding to the second display window 820 shown in (b) of fig. 13.

In some examples, when the priority of the second display window meets the second condition, that is, the priority attribute of the second display window is "focus_enter_ DESCENDANTS", the third FOCUS is a fourth sub FOCUS corresponding to the third control in the second user interface. In this case, the controller 250 may move the focus frame from the first sub-focus position corresponding to the first display window 810 shown in (a) of fig. 13 to the fourth sub-focus position corresponding to the third control in the second user interface shown in (c) of fig. 13.

The third control may be the first control in the second user interface, or may also be any control (such as a preset control) in the second user interface, which is not limited in this embodiment of the present application. For example, as shown in (c) of fig. 13, the third control is the first control in the second user interface, and the focal property of the third control is valid.

It should be noted that, the priority of the second display window is similar to the determining process of the priority of the first display window in the above embodiment, and for avoiding repetition, the description is omitted here.

The above-described embodiments have described the movement process of the focus frame in response to the first focus switching operation in the case where the focus frame is displayed at the first sub-focus position corresponding to the first display window. The following describes a moving process of the focus frame in response to the first focus switching operation when the focus frame is displayed at the second sub focus position corresponding to the first control in the first user interface.

It should be noted that, the precondition that the controller 250 controls the display 260 to display the focus frame at the second sub-focus position corresponding to the first control in the first user interface is that the focus attribute of the first control is valid. That is, the controller 250 may control the display 260 to display the focus frame at the second sub-focus position corresponding to the first control in the first user interface only when the focus attribute of the first control is valid.

In some embodiments, in the case where the first user interface includes the second control, the controller 250 moves the focus frame from the second sub-focus position to the fourth focus position corresponding to the second control in response to the first focus switching operation.

Illustratively, the focal property of the second control is valid.

In some examples, when the controller 250 determines that the start position of the FOCUS frame is the second sub-FOCUS position corresponding to the first control of the first user interface (for example, the first control mLeftWindwosChildView 0 in FIG. 10B), that is, determines that the priority attribute of the first display window is "FOCUS_AFTER_ DESCENDANTS", if it is determined that the first user interface further includes at least one control, the controller 250 may determine the second control according to the FOCUS attribute of the at least one control and move the FOCUS frame from the second sub-FOCUS position to the fourth FOCUS position corresponding to the second control in response to the first FOCUS switching operation.

In some examples, as shown in fig. 10B, when the first control is determined to be the first control mleftwowoskildview 0 in the first user interface, the controller 250 determines the second control according to the first focus switch operation.

For example, when the first focus switching operation input by the user is a right movement operation, the controller 250 may determine whether the focus attribute of the first control on the right side of the first control is valid, and when the focus attribute of the first control on the right side of the first control is valid, the first control on the right side of the first control may be determined as the second control. When the focal attribute of the first control on the right side of the first control is invalid, the controller 250 may continue to determine whether the focal attribute of the second control on the right side of the first control is valid, until the first focal attribute after the first control is determined to be valid, and determine the control as the second control.

As shown in fig. 10B, when the first focus switching operation input by the user is a right movement operation, the controller 250 may sequentially determine the focus attribute of each control in the order of the second control mleftwoddwoschildview 1, the third control mlefwingwoschildview 2, the fourth control mlefwingwoschildview 3, the fifth control mlefwingwoschildview 4, the sixth control mlefwingwoschildview 5, and the seventh control mlefwingwoschildview 6. For example, when controller 250 determines that the first focus attribute is a valid control, the control may be determined to be a second control and the focus attribute of the control after the second control need not be determined. For example, when determining that the focal properties of the second control mleftwoschildview 1, the third control mleftwoschildview 2, and the fourth control mleftwoschildview 3 are invalid (e.g., false), and determining that the focal properties of the fifth control mlefwindoschildview 4 after the fourth control are valid (e.g., true), the controller 250 may determine the fifth control mleftwoschildview 4 as the second control. The controller 250 moves the focus frame from the focus position corresponding to the first control mleftwowoschild view 0 to the focus position corresponding to the fifth control mleftwowoschild view 4.

The embodiment of the application schematically illustrates the focus searching sequence when the controller 250 determines the second control by taking the first focus switching operation input by the user as the right moving operation as an example. It should be noted that, the first focus switching operation may be other operations, such as a move, a move up or a move right operation, and when the first focus switching operation is different, the order of the corresponding focus seeking operations may be different. For example, as shown in fig. 10B, when the first focus switching operation input by the user is a move-down operation, the controller 250 may sequentially second control the fourth control mleftwoddwoschildview 3, the fifth control mlefwingwostchildview 4, the second control mlefwingwostchildview 1, the sixth control mlefwindwostchildview 5, the third control mlefwindwostchildview 2, and the seventh control mleftwodwoschildview 6 in the first user interface.

For example, the controller 250 may further continue to receive at least one first focus switching operation of the user input when the focus frame moves to the second control. The controller 250 may move the focus frame from the focus position corresponding to the second control to the target position in response to at least one first focus switching operation.

Fig. 14 is a schematic view of still another multi-window display according to an embodiment of the present application. As shown in fig. 14, an exemplary description is given by taking the current position of the focus frame as the focus position corresponding to the second control mleftwoskildview 1, and the target position of the focus frame as the focus position corresponding to the fifth control mleftwoskildview 4. For example, the communicator 220 may monitor the operation of the remote controller in real time, if the user determines that the direction of the operation of the current user is Right by pressing the Right key of the remote controller (i.e. continuing to input the first focus switching operation), the controller 250 performs the focus searching operation in the Right direction, if the focus attribute of the third control mleftwoddwoschild view 2 on the Right side of the second control mlefwingwoschild view 1 is valid, the controller 250 obtains the focus of the third control mlefwingwodschild view 2, and moves the focus frame from the focus position corresponding to the second control mlefwingwodschild view 1 to the focus position corresponding to the third control mlefwingwoschild view 2. If the user continues to press the right key of the remote controller, the controller 250 may continue to perform the focus searching operation in the right direction, and since the right side of the third control mleftwodwosChildView 2 is the right boundary of the first user interface, no other control exists, that is, no focus may be focused, so the requestFocusNoSearch may return a prompt message of a switching failure (such as return to false), and the focus frame may continue to remain motionless on the third control mleftwodwosChildView 2. In this case, the user may press the down key of the remote controller, so that the controller 250 may continue to perform the focus searching operation, and if the controller 250 obtains the focus corresponding to the fourth control mleftwodwoschildview 3, the focus frame may be moved from the focus position corresponding to the third control mleftwodwoschildview 2 to the focus position corresponding to the fourth control mleftwodwoschildview 3. At this time, the user continues to press the right key of the remote controller, and the controller 250 continues to perform the focus searching operation to the right, and if the controller 250 obtains the focus corresponding to the fifth control mleftwodwoschildview 4, the focus frame may be moved from the focus position corresponding to the fourth control mleftwodwoschildview 3 to the focus position corresponding to the fifth control mleftwodwoschildview 4, so as to move the focus frame from the current position to the target position.

It should be noted that, the user may also move the focus frame from the start position to the target position through other first focus switching operations (such as pressing the down button lamp of the remote controller twice in succession). The embodiments of the present application are not limited in this regard.

In other embodiments, the focus frame is displayed at a second sub-focus position corresponding to the first control in the first user interface, and the focus frame is moved from the second sub-focus position to the first sub-focus position in response to the first focus switching operation when the first user interface does not include other controls whose focus attribute is valid except for the first control.

That is, when the focus frame is displayed at the second sub-focus position corresponding to the first control of the first user interface and the first user interface does not include the controls with valid other focus attributes, the controller 250 may move the focus frame from the focus position corresponding to the first display window internal control to the focus position corresponding to the first display window in response to the first focus switching operation, so as to implement switching of the focus in the first display window.

In some examples, the first user interface may include, excluding other controls whose focus attribute is valid: the first user interface comprises at least one control besides the first control, and the focus attribute of the at least one control is invalid. In other examples, the first user interface may include other controls that are valid for the focus attribute including: the first user interface does not include other controls except the first control.

For example, when the priority of the first display window meets the second condition, that is, the priority attribute of the first display window is "focus_after_ DESCENDANTS", and the first user interface does not include a control whose FOCUS attribute is valid except the first control, the controller 250 moves the FOCUS frame to the first sub-FOCUS position corresponding to the first display window, and controls the display 260 to display the FOCUS frame at the first sub-FOCUS position.

For example, when the priority attribute of the first display window is "focus_after_ DESCENDANTS", if a first FOCUS switching operation input by a user is received, the view group calls requestFocus (), preferentially acquires a FOCUS on a control (also referred to as a sub-view) in the first user interface, and when the control in the first user interface cannot become a FOCUS, the FOCUS can be acquired in the first display window, that is, a FOCUS frame is displayed at a FOCUS position corresponding to the first display window.

In some embodiments, the controller 250 is further configured to: receiving a second focus switching operation input by the user through the communicator 220; in response to the second focus switching operation, the focus frame is moved from the first sub-focus position to a third focus position of the second user interface.

In the above embodiment, the controller 250 may further receive the second focus switching operation input by the user after the focus frame is moved from the second sub-focus position to the first sub-focus position in response to the first focus switching operation. The input manner of the second focus switching operation is similar to that of the first focus switching operation, for example, in order to avoid repetition, the description is omitted here.

In some examples, the second focus switching operation is to instruct the controller 250 to move the position of the focus frame. For example, the second focus switching operation may be the same as or different from the first focus switching operation. When the first focus switching operation is different from the second focus switching operation, the second focus switching operation may instruct the controller 250 to move the focus frame moved through the first focus switching operation from the current position to other positions.

For example, the second focus switching operation may be to move the focus frame from the first sub focus position to which the first focus switching operation has moved to a third focus position of the second user interface. That is, the second focus switching operation may realize switching of the focus between the first display window and the second display window.

Fig. 15 is a schematic diagram of another display method according to an embodiment of the present application, as shown in fig. 15, after step S540 in the above embodiment, the method further includes steps S550 to S570 as follows.

In step S550, in the case where the focus frame is displayed at the fifth focus position corresponding to the third control in the first user interface, the third focus switching operation input by the user is received through the communicator.

In some examples, the first user interface further includes a third control, and the focal property of the third control is valid. The third control may be any control in the first user interface. For example, the third control may be the same control as the first control; alternatively, the third control may be the same control as the second control; alternatively, the third control may be other controls than the first control and the second control. The embodiments of the present application are not limited in this regard.

For example, the fifth focus position corresponding to the third control may be the current position of the focus frame.

In some examples, the third focus switch operation is to indicate to move the focus frame from the current position to another position. For example, the third focus toggle operation may be to move the focus frame from a fifth focus position corresponding to a third control of the first user interface to a third focus position corresponding to the second user interface. That is, the third focus switching operation may realize switching of the focus between the first display window and the second display window.

For example, the third focus switching operation may be used to instruct the controller 250 to switch the fifth focus corresponding to the third control in the first user interface to the third focus (including the third sub-focus and the fourth sub-focus) of the second user interface.

In some examples, the third focus switching operation may be input through a corresponding window switching key, a certain direction key, or other keys on the remote controller, or may be input through a voice command.

In step S560, in response to the third focus switching operation, a position of the third control in the first user interface is determined.

In step S570, if the position of the third control satisfies the window switching condition, the focus frame is moved from the fifth focus position to the third focus position of the second user interface.

In some examples, the controller 250, upon receiving the third focus switch operation, determines a position of the third control in the first user interface in response to the third focus switch operation, and determines whether the position of the third control satisfies the window switch condition.

For example, the position of the third control meeting the window switching condition may include: no other controls exist between the position of the third control and the preset boundary in the first user interface. It should be noted that the window switching conditions may also include other conditions set according to the requirements, and the specific form of the window switching conditions is not limited in the embodiments of the present application.

Fig. 16 is a schematic diagram of still another multi-window display according to an embodiment of the present application. As shown in fig. 16, the window switching condition is taken as an example that no other control exists between the position of the third control and the preset boundary in the first user interface (such as the right boundary of the first user interface), that is, the third control is adjacent to the right boundary of the first user interface.

As shown in fig. 16, the positions of the third control mleftwoskildview 2, the fourth control mleftwoskildview 3, and the seventh control mleftwoskildview 6 in the first user interface are adjacent to the right side edge of the first user interface, and then the positions of the third control mleftwoskildview 2, the fourth control mleftwoskildview 3, and the seventh control mlefwingwoschildview 6 satisfy the window switching condition. That is, in fig. 15, the third control may be the third control mleftwodwoschildview 2, the fourth control mleftwodwoschildview 3, or the seventh control mleftwodwoschildview 6.

For example, in a case where the position of the third control satisfies the window switching condition, the controller 250 may move the focus frame from the fifth focus position corresponding to the third control to the third sub-focus position corresponding to the second display window (the priority of the second display window satisfies the first condition) or to the fourth sub-focus corresponding to the fourth control in the second user interface (the priority of the second display window satisfies the second condition) according to the third focus switching operation and the priority of the second display window.

In some examples, when the user inputs a third focus switch operation, the controller 250 may move the focus frame from the fifth focus position (e.g., the current position) to the third focus position of the second user interface in response to the third focus switch operation; alternatively, the controller 250 may also move the focus frame from the fifth focus position (e.g., the current position) to any one of the second user interfaces in response to the third focus switching operation. For example, the position of the focus frame previously displayed in the second user interface, etc. The embodiments of the present application are not limited in this regard.

Illustratively, after the controller 250 controls the display 260 to display the focus frame, a control operation port input by the control device 100 (remote controller) may be received, and a corresponding second-level or higher-level page presentation may be performed on a control corresponding to the focus position where the focus frame is located.

It should be noted that, the switching of the focus in the second user interface is similar to the switching process of the focus in the first user interface in the above embodiment, and in order to avoid repetition, the description is omitted here.

According to the display method, focuses are set on the multiple display windows and the controls of the user interfaces corresponding to the display windows, when multi-window display operation is received, a focus frame is displayed at the first focus position of the first user interface displayed on the first user interface corresponding to the first display window, namely when the display device enters a multi-window display mode, the initial position of the focus frame is determined to be the first focus position. Then, after receiving the first focus switching operation, in response to the first focus switching operation, the focus frame may be moved from the first focus position to a second focus position of the first user interface; alternatively, the focus frame may be moved from the first focus position to a third focus position of the second user interface displayed by the second display window. Therefore, through the embodiment of the application, the focal point between the first display window and the second display window can be switched, and the focal point between the controls in the first display window or the second display window can also be switched.

Fig. 17 is a schematic diagram of another display method according to an embodiment of the present application, as shown in fig. 17, the method includes steps S1710 to S1770 as follows.

Step S1710, a window display mode of the display device is acquired.

For example, the window display mode of the display apparatus 200 includes a single window display and a multi-window display.

In step S1720, it is determined whether the window display mode is multi-window display.

For example, if it is determined that the window display mode of the display apparatus 200 is the multi-window display, step S1730 is performed; if it is determined that the window display mode of the display apparatus 200 is single window display, step S1750 is performed.

Step S1730, a focus corresponding to the first display window is acquired.

For example, when it is determined that the display mode of the display window is multi-window display, a focus corresponding to a first display window in the plurality of display windows may be acquired. The first display window may be a main display window of the plurality of display windows.

Step S1740, controlling the display to display a focus frame at the focus position corresponding to the first display window.

If the focus corresponding to the first display window is acquired, the display 260 may be controlled to display the focus frame in a highlighted or marked manner at the focus position of the first display window.

Step S1750 listens for a window change of the display device, an internal UI change of the first display window, and a user operation.

The window change may include an operation corresponding to a switch between a first display window and a second display window of the plurality of display windows; the change in UI inside the first display window may include a change in each control in the first user interface displayed by the first display window, and the user operation includes a related focus control operation input by the user through the control apparatus 100 (e.g., remote controller). For example, the user operation may include the first focus switching operation in the above-described embodiment.

Step S1760 determines whether there is a window switching, an internal UI change, or a user operation.

If at least one of window switching, internal UI change, or user operation exists, step 1770 is performed; if there is no window switching, internal UI change, and user operation, step S1750 is executed, and listening is continued.

Step S1770, processing is performed according to a preset focus processing principle.

If the display device 200 is a single window display, determining a focus for each control in the single window according to a preset focus sequence, for example, from top to bottom and from left to right, and displaying a focus frame at the focus position; or, the focus frame can be displayed at the focus position corresponding to the preset control; if the display device 200 is a multi-window display, focal points of multiple windows may be switched first, and then focal points corresponding to the controls in the windows may be switched. The processing of focuses among the controls in each display window is similar to the processing mode of focuses corresponding to the controls in a single window.

It should be noted that, the steps S1710 to S1770 are described in detail in the above embodiments of the steps S520 to S540, and are not repeated here.

The foregoing description of the solution provided in the embodiments of the present application has been mainly presented in terms of a method. To achieve the above functions, it includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the elements and algorithm steps of the examples described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The embodiment of the application may divide the functional modules of the electronic device according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation.

Fig. 18 is a schematic diagram of a focus switching device according to an embodiment of the present application, as shown in fig. 18, the focus switching device 1800 includes a receiving module 1810, a control module 1820, and a switching module 1830. Wherein:

a receiving module 1810 configured to receive a multi-window display operation of a user input through a communicator while the display is displaying the first user interface.

The control module 1820 is configured to control the display to display a first user interface in a first display window, a second user interface in a second display window, and a focus frame in a first focus position of the first user interface in response to a multi-window display operation.

The receiving module 1810 is further configured to receive, via the communicator, a first focus switching operation entered by a user.

The switching module 1830 is configured to move the focus frame from the first focus position to the second focus position of the first user interface or the third focus position of the second user interface in response to the first focus switching operation.

It should be noted that, the focus switching device 1800 provided in the embodiment of the present application includes, but is not limited to, the above-mentioned modules.

With respect to the focus switching apparatus applied to the display device in the above-described embodiments, a specific manner in which each module performs an operation has been described in detail in the foregoing embodiments of the display method, and a detailed description will not be made here.

It should be understood that the division of units or modules (hereinafter referred to as units) in the above apparatus is merely a division of logic functions, and may be fully or partially integrated into one physical entity or may be physically separated. And the units in the device can be all realized in the form of software calls through the processing element; or can be realized in hardware; it is also possible that part of the units are implemented in the form of software, which is called by the processing element, and part of the units are implemented in the form of hardware.

For example, each unit may be a processing element that is set up separately, may be implemented as integrated in a certain chip of the apparatus, or may be stored in a memory in the form of a program, and the functions of the unit may be called and executed by a certain processing element of the apparatus. Furthermore, all or part of these units may be integrated together or may be implemented independently. The processing element herein may also be referred to as a processor and may be an integrated circuit with signal processing capabilities. In implementation, each step of the above method or each unit above may be implemented by an integrated logic circuit of hardware in a processor element or in the form of software called by a processing element.

In some examples, the units in the above apparatus may be one or more integrated circuits configured to implement the above methods, for example: one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of at least two of these integrated circuit forms.

For another example, when the units in the apparatus may be implemented in the form of a scheduler of processing elements, the processing elements may be general-purpose processors, such as CPUs or other processors that may invoke programs. For another example, the units may be integrated together and implemented in the form of a system on chip SOC.

In some examples, the means above to implement each corresponding step in the above method may be implemented in the form of a processing element scheduler. For example, the apparatus may include a processing element and a storage element, the processing element invoking a program stored in the storage element to perform the display method of the above method embodiment. The memory element may be a memory element on the same chip as the processing element, i.e. an on-chip memory element.

In other examples, the program for performing the above method may be on a storage element that is on a different chip than the processing element, i.e., an off-chip storage element. At this time, the processing element calls or loads a program from the off-chip storage element on the on-chip storage element to call and execute the display method of the above method embodiment.

Fig. 19 is a schematic diagram of a display device according to an embodiment of the present application, as shown in fig. 19, a display device 200 includes: a communicator 220, a display 260 and a controller 250. The controller 250 is coupled to the display 260 and the communicator 220, respectively. Wherein:

a display 260 configured to display a user interface.

The communicator 220 is configured to receive user operations.

The controller 250 is configured to receive a multi-window display operation input by the user through the communicator 220 while the display displays the first user interface; in response to the multi-window display operation, control display 260 displays a first user interface in a first display window, a second user interface in a second display window, and a focus frame in a first focus position of the first user interface; receiving a first focus switching operation input by a user through the communicator 220; in response to the first focus switching operation, the focus frame is moved from the first focus position to the second focus position of the first user interface or the third focus position of the second user interface.

In some embodiments, the first focus comprises a first sub-focus and a second sub-focus; the controller 250 is specifically configured to: determining the priority of a first display window; displaying the focus frame at a first sub-focus position corresponding to the first display window under the condition that the priority of the first display window meets a first condition; and displaying the focus frame at a second sub-focus position corresponding to the first control in the first user interface under the condition that the priority of the first display window meets the second condition.

In some embodiments, the controller 250 is specifically configured to: displaying a focus frame at a first sub-focus position corresponding to a first display window, and determining a focus attribute of a first control in response to a first focus switching operation when the first user interface comprises the first control and a second control; under the condition that the focus attribute of the first control is valid, moving the focus frame from the first sub-focus position to a second sub-focus position corresponding to the first control; when the focus attribute of the first control is invalid, moving the focus frame from the first sub focus position to a fourth focus position corresponding to the second control after the first control; the focal attribute of the second control is valid.

In some embodiments, the controller 250 is specifically configured to: and under the condition that the focus frame is displayed at the first sub-focus position corresponding to the first display window and the first user interface does not comprise a control with valid focus attribute, responding to the first focus switching operation, and moving the focus frame from the first sub-focus position to a third focus position of the second user interface.

In some embodiments, the controller 250 is specifically configured to: displaying a focus frame at a second sub-focus position corresponding to the first control in the first user interface, and moving the focus frame from the second sub-focus position to a fourth focus position corresponding to the second control in response to the first focus switching operation when the first user interface comprises the second control; the focal attribute of the second control is valid.

In some embodiments, the controller 250 is specifically configured to: and under the condition that the first user interface does not comprise other controls with valid focus attributes except the first control, the focus frame is displayed at the second sub-focus position corresponding to the first control, and the focus frame is moved from the second sub-focus position corresponding to the first control to the first sub-focus position in response to the first focus switching operation.

In some embodiments, the controller 250 is further configured to: receiving a second focus switching operation input by the user through the communicator 220; in response to a second focus switching operation, the focus frame is moved from the first sub-focus position to the third focus position of the second user interface.

In some embodiments, the controller 250 is further configured to: receiving a third focus switching operation input by a user through the communicator 220 under the condition that a focus frame is displayed at a fifth focus position corresponding to a third control in the first user interface; responsive to a third focus switch operation, determining a position of a third control in the first user interface; and moving the focus frame from the fifth focus position to the third focus position of the second user interface under the condition that the position of the third control meets the window switching condition.

In some embodiments, the third focus comprises a third sub-focus and a fourth sub-focus; the controller 250 is specifically configured to: determining the priority of the second display window; under the condition that the priority of the second display window meets the first condition, moving the focus frame to a third sub-focus position corresponding to the second display window; and under the condition that the priority of the second display window meets the second condition, moving the focus frame to a fourth sub-focus position corresponding to a fourth control in the second user interface.

The embodiment of the application also provides electronic equipment, which comprises: a processor and a memory; the memory is used for storing computer instructions, and when the display device runs, the processor executes the computer instructions stored in the memory, so that the electronic device executes the display method provided by the embodiment of the application.

The embodiment of the application also provides a computer readable storage medium, wherein computer instructions are stored in the computer readable storage medium, and when the computer instructions are run on the display device, the display device can execute the display method provided by the embodiment of the application.

For example, the computer readable storage medium may be ROM, RAM, compact disk read-Only (CD-ROM), magnetic tape, floppy disk, optical data storage device, etc.

The embodiments also provide a computer program product containing computer instructions, which when executed on an electronic device, enable the display device to perform the display method provided by the embodiments of the present application.

The embodiment of the application also provides an apparatus (for example, the apparatus may be a chip system) including a processor for supporting an electronic device to implement the privileged operation execution method provided by the embodiment of the application. In one possible design, the apparatus further includes a memory for storing program instructions and data necessary for the display device. When the device is a chip system, the device can be formed by a chip, and can also comprise the chip and other discrete devices.

The beneficial effects that can be achieved by the focus switching device, the display device, the electronic device, the computer readable storage medium and the like provided in the embodiments of the present application can refer to the beneficial effects in the corresponding display method provided above, and are not described herein again.

From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be performed by different functional modules, that is, the internal structure of the apparatus (e.g., the first control device, the regional controller) is divided into different functional modules, so as to perform all or part of the functions described above. The specific working processes of the above-described system, apparatus (e.g., first control device, area controller) and unit may refer to the corresponding processes in the foregoing method embodiments, which are not described herein again.

The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes or substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A display device, characterized by comprising:

a display configured to: displaying a user interface;

a communicator configured to: receiving user operation;

a controller coupled with the display and the communicator and configured to:

receiving a multi-window display operation input by a user through the communicator when the display displays a first user interface;

controlling the display to display the first user interface on a first display window, display a second user interface on a second display window and display a focus frame at a first focus position of the first user interface in response to the multi-window display operation;

receiving a first focus switching operation input by a user through the communicator;

in response to the first focus switching operation, the focus frame is moved from the first focus position to a second focus position of the first user interface or a third focus position of the second user interface.

2. The display device of claim 1, wherein the first focus comprises a first sub-focus and a second sub-focus; the controller is specifically configured to:

determining the priority of the first display window;

displaying the focus frame at a first sub-focus position corresponding to the first display window under the condition that the priority of the first display window meets a first condition;

and displaying the focus frame at a second sub-focus position corresponding to the first control in the first user interface under the condition that the priority of the first display window meets a second condition.

3. The display device of claim 2, wherein the controller is specifically configured to:

when the focus frame is displayed at a first sub-focus position corresponding to the first display window and the first user interface comprises the first control and the second control, responding to the first focus switching operation, and determining the focus attribute of the first control;

moving the focus frame from the first sub-focus position to the second sub-focus position corresponding to the first control under the condition that the focus attribute of the first control is valid;

When the focus attribute of the first control is invalid, moving the focus frame from the first sub-focus position to a fourth focus position corresponding to a second control after the first control; and the focus attribute of the second control is valid.

4. The display device of claim 2, wherein the controller is specifically configured to:

and under the condition that the focus frame is displayed at a first sub-focus position corresponding to the first display window and the first user interface does not comprise a control with effective focus attribute, responding to the first focus switching operation, and moving the focus frame from the first sub-focus position to the third focus position of the second user interface.

5. The display device of claim 2, wherein the controller is specifically configured to:

displaying the focus frame at a second sub-focus position corresponding to a first control in the first user interface, and moving the focus frame from the second sub-focus position to a fourth focus position corresponding to the second control in response to the first focus switching operation when the first user interface comprises the second control; and the focus attribute of the second control is valid.

6. The display device of claim 2, wherein the controller is further configured to:

and under the condition that the first user interface does not comprise other controls with valid focus attributes except the first control, the focus frame is displayed at a second sub-focus position corresponding to the first control, and the focus frame is moved from the second sub-focus position corresponding to the first control to the first sub-focus position in response to the first focus switching operation.

7. The display device of claim 6, wherein the controller is further configured to:

receiving a second focus switching operation input by a user through the communicator;

and responding to the second focus switching operation, and moving the focus frame from the first sub-focus position to the third focus position corresponding to the second user interface.

8. The display device of claim 1, wherein the controller is further configured to:

receiving a third focus switching operation input by a user through the communicator under the condition that a fifth focus position corresponding to a third control in the first user interface displays the focus frame;

Responsive to the third focus switch operation, determining a position of the third control in the first user interface;

and moving the focus frame from the fifth focus position to the third focus position of the second user interface under the condition that the position of the third control meets a window switching condition.

9. The display device of any one of claims 1-8, wherein the third focus comprises a third sub-focus and a fourth sub-focus; the controller is specifically configured to:

determining the priority of the second display window;

moving the focus frame to the third sub-focus position corresponding to the second display window under the condition that the priority of the second display window meets a first condition;

and under the condition that the priority of the second display window meets a second condition, moving the focus frame to the fourth sub-focus position corresponding to a fourth control in the second user interface.

10. A display method, comprising:

receiving a multi-window display operation input by a user through a communicator when the display displays a first user interface;