CN116347166A

CN116347166A - Display device and window display method

Info

Publication number: CN116347166A
Application number: CN202211688768.3A
Authority: CN
Inventors: 臧晓华; 高同庆
Original assignee: Vidaa Netherlands International Holdings BV
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2022-12-27
Filing date: 2022-12-27
Publication date: 2023-06-27

Abstract

The application provides display equipment and a window display method, wherein the method can respond to a control instruction for window refreshing, acquire window information indicating a window to be refreshed in the control instruction, wherein the window information comprises window number and a buffer area, detect the current layer number, apply the buffer area to a display layer to serve as the buffer area of the display layer if the window number is smaller than or equal to the current layer number, render a user interface according to the buffer area of the display layer, and control a display to display the rendered user interface. The method can directly apply the buffer area of the window to the display layer after the window is drawn, thereby saving the synthesizing process from the window to the layer, and dynamically switching the buffer area in the operation period so as to improve the display refresh rate and the display performance.

Description

Display device and window display method

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to a display device and a window display method.

Background

The display device refers to a terminal device capable of outputting a specific display screen, and may be a terminal device such as a smart television, a communication terminal, a smart advertisement screen, and a projector. Taking intelligent electricity as an example, the intelligent television is based on the Internet application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, and is a television product integrating multiple functions of video, entertainment, data and the like, and the intelligent television is used for meeting the diversified and personalized requirements of users.

The display device may present the application screen by creating a window. Each application corresponds to a window, and when a plurality of different applications exist at the same time, in order to better display the content of each application, the windows need to be displayed in different layers. In this regard, a plurality of preset layers are provided in the display device for displaying different types of windows. Each window is provided with a buffer area for storing the image content of the window, each layer is also provided with a buffer area for storing the image content of the layer, in the process of image display, the image content in the buffer area of one window or a plurality of windows is required to be synthesized into the buffer area of the layer, and the image display is carried out by reading the image data in the buffer area of the layer. Meanwhile, when the window is refreshed each time, the synthesis process of the buffer area is required to be executed, and the display refresh rate and the display effect are reduced.

Disclosure of Invention

The application provides display equipment and a window display method, which are used for solving the problems of lower display efficiency and lower display refresh rate in the display process of the display equipment.

In a first aspect, the present application provides a display device, comprising: a display and a controller. Wherein the display is configured to display a user interface; the controller is configured to perform the following program steps:

Responding to a control instruction for refreshing a window, and acquiring window information indicating a window to be refreshed in the control instruction, wherein the window information comprises the number of windows and a buffer area;

detecting the number of current layers;

if the number of windows is smaller than or equal to the number of current layers, the buffer area is applied to the display layers to serve as the buffer area of the display layers;

and rendering a user interface according to the buffer area of the display layer, and controlling the display to display the rendered user interface.

Optionally, the controller is further configured to perform the following program steps:

if the number of the windows is larger than the number of the current layers, synthesizing the buffer area of the window to be refreshed to the buffer area of the display layer;

Optionally, the controller performs compositing of the buffer of the window to be refreshed into the buffer of the display layer, and is further configured to perform the following program steps:

copying pixel information stored in a buffer area of the window to be refreshed;

and storing the copied pixel information into a buffer area of the display layer.

responding to a window creation instruction input by a user, creating a window and creating a buffer area of the window;

and applying the buffer area of the window to a display layer to control the display to display the window.

responding to a drawing instruction input by a user, and drawing a target window in a buffer area of the target window;

after the completion of drawing is detected, a window refresh operation is triggered to generate a control instruction for window refresh.

traversing all windows;

and screening out effective windows from all windows to serve as the windows to be refreshed, wherein the effective windows are windows which are displayed on a user interface and are not completely covered.

Optionally, the controller performs the application of the buffer to a display layer, and is further configured to perform the following program steps:

acquiring a hierarchical corresponding relation between the window to be refreshed and the display layer;

and applying the buffer area of the window to be refreshed to the corresponding display layer according to the hierarchical corresponding relation.

Optionally, the controller is configured to obtain a hierarchical correspondence between the window to be refreshed and the display layer, and further configured to perform the following program steps:

acquiring the hierarchy of the window to be refreshed;

acquiring the hierarchy of the display layer;

and establishing a hierarchy corresponding relation between the window to be refreshed and the display layer according to the hierarchy of the window to be refreshed and the hierarchy of the display layer, wherein the hierarchy corresponding relation characterizes that the hierarchy of the window to be refreshed is identical to the hierarchy of the display layer.

Optionally, the controller performs rendering of the user interface according to the buffer of the display layer, and is further configured to perform the following program steps:

reading pixel information stored in a buffer area of the display layer;

and rendering a user interface according to the pixel information, and controlling the display to display the rendered user interface.

In a second aspect, the present application further provides a window display method, including:

detecting the number of current layers;

and rendering a user interface according to the buffer area of the display layer, and controlling a display to display the rendered user interface.

According to the technical scheme, the display device and the window display method can respond to the control instruction for window refreshing, acquire window information indicating a window to be refreshed in the control instruction, wherein the window information comprises the number of windows and a buffer zone, detect the number of current layers, apply the buffer zone to the display layers to serve as the buffer zone of the display layers if the number of the windows is smaller than or equal to the number of the current layers, render a user interface according to the buffer zone of the display layers, and control the display to display the rendered user interface. The method can directly apply the buffer area of the window to the display layer after the window is drawn, thereby saving the synthesizing process from the window to the layer, and dynamically switching the buffer area in the operation period so as to improve the display refresh rate and the display performance.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device in an embodiment of the present application;

fig. 2 is a hardware configuration block diagram of a display device in an embodiment of the present application;

fig. 3 is a hardware configuration block diagram of a control device in an embodiment of the present application;

fig. 4 is a schematic software configuration diagram of a display device according to an embodiment of the present application;

FIG. 5 is a schematic diagram of an icon control interface for a display device application provided in some embodiments of the present application;

FIG. 6 is a schematic window diagram of a plurality of applications according to an embodiment of the present application;

FIG. 7 is a schematic flow chart of an embodiment of the present application;

FIG. 8 is a flowchart of a window display method in an embodiment of the application;

FIG. 9 is a flowchart of determining a window to be refreshed according to an embodiment of the present application;

FIG. 10 is a schematic diagram of two active windows in an embodiment of the present application;

FIG. 11 is a schematic diagram illustrating interaction between a window and a layer when displaying the layer according to an embodiment of the present application;

FIG. 12 is a schematic diagram illustrating interaction between a plurality of windows and a layer when displaying the layer in an embodiment of the present application;

FIG. 13 is a schematic diagram of interaction between a window and a layer when the number of windows is smaller than the number of layers in the embodiment of the present application;

FIG. 14 is an interactive schematic diagram of window creation in an embodiment of the present application;

FIG. 15 is a schematic diagram illustrating interaction between a window and a layer when the number of windows is greater than the number of layers in the embodiment of the present application;

fig. 16 is a flow chart of a window display method in different scenes in an application embodiment.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the exemplary embodiments of the present application more apparent, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is apparent that the described exemplary embodiments are only some embodiments of the present application, but not all embodiments.

All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present application, are intended to be within the scope of the present application based on the exemplary embodiments shown in the present application. Furthermore, while the disclosure has been presented in terms of an exemplary embodiment or embodiments, it should be understood that various aspects of the disclosure can be practiced separately from the disclosure in a complete subject matter.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate, such as where appropriate, for example, implementations other than those illustrated or described in accordance with embodiments of the present application.

Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to those elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided in the embodiment of the application may have various implementation forms, for example, may be a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, etc., and the display device 200 is controlled by a wireless or other wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. Such as: the user can input corresponding control instructions through volume up-down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, on-off keys, etc. on the remote controller to realize the functions of the control display device 200.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device. The application program, by configuration, can provide various controls to the user in an intuitive User Interface (UI) on a screen associated with the smart device.

In some embodiments, the display device 200 may receive instructions not using the smart device or control device described above, but rather receive control of the user through touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. Such as: it is possible to implement a control command protocol established between the mobile terminal 300 and the display device 200, synchronize a remote control keyboard to the mobile terminal 300, and implement a function of controlling the display device 200 by controlling a user interface on the mobile terminal 300. The audio/video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. By way of example, display device 200 receives software program updates, or accesses a remotely stored digital media library by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user, and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and may perform an interaction between the user and the display device 200.

As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, a 0LED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

As shown in fig. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (application layer), an application framework layer (Application Framework layer), a An Zhuoyun row (Android run) and a system library layer (system runtime layer), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, a camera application, and the like; and may be an application program developed by a third party developer, such as a hi-see program, a K-song program, a magic mirror program, etc. In particular implementations, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which are not limited in this embodiment of the present application.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (notifinmanager) for controlling display and clearing of notification messages; a Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is to: the lifecycle of each application program is managed, as well as the usual navigation rollback functions, such as controlling the exit of the application program (including switching the currently displayed user interface in the display window to the system desktop), opening, backing (including switching the currently displayed user interface in the display window to the previous user interface of the currently displayed user interface), etc.

In some embodiments, the window manager is configured to manage all window procedures, such as obtaining a display screen size, determining whether there is a status bar, locking the screen, intercepting the screen, controlling display window changes (e.g., scaling the display window down, dithering, distorting, etc.), and so on.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

A specific screen may be presented based on the display device 200 described above. Such as play screens, control interfaces, and other application interfaces. The application installed on the display device 200 may include various forms, for example, a system application, a third party application, etc., according to a developer or operator of the application. Applications installed on a display device may also be divided into multiple types, e.g., video-type applications, reading-type applications, game-type applications, etc., according to the functions that the applications are capable of performing.

As shown in fig. 5, the application layer of the display device 200 may contain at least one application program that may display corresponding icon controls in the display 260, such as: a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control, and the like.

In some embodiments, the live television application may provide live television via different signal sources. For example, a live television application may provide television signals using inputs from cable television, radio broadcast, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

In some embodiments, the video on demand application may provide video from different storage sources. Unlike live television applications, video-on-demand provides video displays from some storage sources. For example, video-on-demand may come from a server side of cloud storage or from a local hard disk storage containing stored video programs, etc.

In some embodiments, the media center application may provide various multimedia content playing applications. For example, a media center may be a different service than live television or video on demand, and a user may access various images or audio through a media center application.

In some embodiments, an application center may be provided to store various applications. The application may be a gaming application or some other application associated with a computer system or other device but which may be running in a smart television. The application center may obtain these applications from different sources, store them in local storage, and then run on display device 200.

The user interface is the basic interaction UI (User Interface) interface provided by the display device 200. In the user interface, a user may interact by entering a number of columns of instructions through the control device 100 to launch any application. For example, the user inputs an adjustment selection frame position to select an application icon to be started by controlling the "up, down, left, right" key in the apparatus 100. Then, by clicking the "ok/0K" key in the control device 100, an instruction for starting the application program is input, so that the operating system can open and run the application program. At this time, an application screen may be presented on the display 260 of the display device 200.

In some embodiments, the display device 200 may load multiple applications simultaneously, i.e., by selecting multiple application icons in the user interface, and keep the loaded multiple applications running simultaneously. The multiple applications loaded simultaneously may be displayed on the same layer, for example, the multiple applications may be displayed in the form of a column on the same layer. However, the display area is compressed by the display mode, so that the display area occupied by each application is smaller and smaller along with the increase of the number of applications loaded simultaneously, and interaction is inconvenient.

Thus, the loaded plurality of applications may be displayed at different layers. The display device 200 may render the application screen by creating a window. Each application program corresponds to a window, and when a plurality of different application programs exist at the same time, the window is displayed through different layers. For example, fig. 6 is a schematic window diagram of a plurality of application programs in the embodiment of the present application, as shown in fig. 6, the windows of application 1, application 2, and application 3 are respectively window 1, window 2, and window 3, the application 2 is displayed on a layer above the application 1, the application 3 is displayed on a layer above the application 2, and three applications are loaded and run simultaneously.

In this embodiment, each layer includes an independent buffer (buffer), which is a block of graphics memory or a continuous memory that can be accessed by graphics devices, where the buffer stores the image content, i.e. pixel information, of the layer, and multiple layers can be combined with each other to form a graphics interface displayed by the display 260. For example, a graphical interface to be displayed may have three layers, the lowest layer being a background image, such as a solid color image, the middle layer being a transparent image with a specific graphical shape, such as a rectangular tile image, and the uppermost layer being a transparent image with a text header, such that the specific image effects of the blended layers are visible in display 260. Application interfaces for different applications can also be presented on multiple layers, with multiple application interfaces being presented.

In some embodiments, an application running on display device 200 may create a single or multiple windows and display the content output by the application in the windows. The plurality of windows are layered on top of each other such that the display 260 displays application interfaces for the plurality of applications. Specifically, during the running process of the application program, the application program creates a window in the underlying graphics system through the window system according to the content to be displayed, draws the content of the application program into the window, and after a series of processes (for example, scaling process, display position changing process, etc.) are performed on the window of the application program, displays the window through the display 260 of the display device 200.

Wherein the window system is a program set for displaying a displayable area of an application program in a window form. Various graphic functions including graphic drawing, graphic copying, etc. are required to be implemented in the embedded graphic user interface. Many of these functions require either extensive data transfer, e.g., graphic copying, or extensive numerical calculations, e.g., drawing spline curves. To improve the graphics performance. A graphics processor is provided in a display chip of the display device 200, and can implement a part of graphics functions from the hardware. The graphics library supporting hardware acceleration can realize the functions through the graphics processor, thereby reducing the load of the CPU, reducing the transmission time of data on a bus and improving the graphics performance.

For example, the DirectFB graphics library is a lightweight graphics library for providing hardware graphics acceleration, input device processing and abstraction, and provides functions of graphics acceleration, input device processing extraction, transparent window and multiple display layers on the basis of frame buffer (frame buffer), so that the DirectFB graphics library has better support for an embedded graphical user interface, namely, the DirectFB is a layer for completing hardware acceleration by encapsulating a graphics algorithm which cannot be supported by the current hardware with software.

In some embodiments, a plurality of layers are preset in the display device 200, and the number of layers may be preset according to the specific hardware configuration of the display device 200. The display device of the embedded system comprises two or three layers, each layer can display different types of windows, each window is provided with a buffer area used for storing the image content of the window, each layer is also provided with a buffer area used for storing the image content of the layer, in the process of displaying the images, the image content in the buffer area of one window or a plurality of windows is required to be synthesized to the buffer area of the layer, and the image display is carried out by reading the image data in the buffer area of the layer.

FIG. 7 is a schematic flow chart of an embodiment of the present application; the screen of the display device 200 in fig. 7 displays a window of an application program, where the window has a buffer area, and the buffer area stores the image content that needs to be displayed by the window, that is, pixel information, and when the window needs to be displayed and refreshed, the pixel information needs to be read from the buffer area and copied into the buffer area of the layer, so that the display device 200 reads the pixel information from the buffer area of the layer, and outputs the pixel information to the display 260 for displaying.

And when drawing the window, for example, moving the window, adjusting the size of the window, etc., window refreshing is performed, and since the area occupied by the window on the screen of the display device 200 changes, the content of the screen display needs to be correspondingly changed, so that pixel data needs to be read from the window and copied into the buffer area of the layer, that is, the synthesis process of the buffer area is performed. Visible. According to the image display method, after the window is drawn, the process of combining the buffer area of the window into the buffer area of the image layer is carried out, so that the display refresh rate is low, and the display performance of the display device is affected.

In order to improve display performance, some embodiments of the present application further provide a window display method, which is applied to the display device 200 and is used for improving a display refresh rate and display performance. Wherein the display apparatus 200 to which the window display method can be applied includes: a display 260 and a controller 250. The display 260 is configured to display a user interface. The controller 250 is configured to execute the window display method, as shown in fig. 8, fig. 8 is a flowchart of the window display method in the application embodiment, and specifically includes the following:

s100, responding to a control instruction for refreshing a window, and acquiring window information indicating a window to be refreshed in the control instruction.

The display device 200 may display a window that the application program needs to display during operation through the display 260. In the running process of the display device 200, a user can select any application program in the application program interface to start running by inputting a control instruction, and in the running process of the application program, the application program creates and draws a window, and the display device 200 displays the created new window for presenting the application program picture by refreshing the current display interface of the display 260, that is, updating the display content displayed on the screen. According to different display devices, a user can input control instructions through a mode of pressing keys of the control device 100 or touch screen touch control.

The window is an operation interface corresponding to one application program on the screen, so that the user can operate the corresponding application program in the window. Each window has a buffer which stores the image content, i.e. pixel information, that the window needs to display. When the image content in the buffer area changes, the window refreshing operation is triggered, and a control instruction for window refreshing is generated to execute window refreshing and update the display content of the window.

In some embodiments, a user may draw a target window in its buffer by inputting a drawing instruction, and after detecting that the drawing is completed, trigger a window refresh operation to generate a control instruction for window refresh. The target window is a window designated by a user, the window is drawn, namely, a buffer area of the window is drawn, and after the drawing is completed, window refreshing operation is triggered, so that a control instruction for window refreshing is generated.

The window drawing includes window moving, window size adjustment, and the like, and for example, a user controls an arrow cursor to move to a window frame by the control device 100, and when the arrow cursor becomes a double-headed arrow cursor, the window size is adjusted by dragging the double-headed arrow cursor. And triggering window refreshing operation after the completion of window drawing is detected, and generating a control instruction for window refreshing so as to execute window refreshing and update the window size of the window.

In some embodiments, the user may also manually input a window refresh command, and the controller 250 may perform window refresh to update the display content of the window in response to the window refresh command input by the user. For example, the user may invoke a menu option of the window, including a "refresh" option, and the user may click on the "refresh" option to enter a window refresh command.

The window refresh is used to update a window displayed on the screen of the display device 200. The display device 200 may perform a window refresh operation in response to a control instruction for window refresh. The pixel data in the buffer corresponding to the read window is copied into the buffer of the layer, so that the display device 200 reads the pixel information from the buffer of the layer and displays the pixel information through the display 260. Because of the process of combining the buffer areas with windows into the buffer areas of the layers, when more windows need to be refreshed and more pixel information need to be copied, the time consumption is longer in the combining process, and the display refresh rate is further reduced. Therefore, in the embodiment of the application, the buffer area of the window can be directly applied to the display layer, so that the synthesis process from the window to the layer is saved, and the buffer area can be dynamically switched in the operation period, so that the display refresh rate and the display performance are improved.

As shown in fig. 8, the controller 250 may obtain window information indicating a window to be refreshed in response to a control instruction for window refresh. The window information comprises the number of windows to be refreshed and a buffer area of the windows to be refreshed, wherein the windows to be refreshed are windows to be refreshed.

In some embodiments, as shown in fig. 9, fig. 9 is a schematic flow chart of determining a window to be refreshed in the embodiment of the present application, when the number of windows of the window to be refreshed is obtained, the controller 250 may traverse all windows, that is, all windows currently displayed by the display device 200, and screen out valid windows from all windows to be used as the window to be refreshed. The effective window is a window which is displayed on a user interface and is not completely covered, namely, the window can be intuitively displayed to a user.

The display device 200 includes 2 display windows, namely, a window a and a window B, wherein the window a blocks the whole content of the window B, that is, the window a is an effective window, the window B is an ineffective window, and the number of windows to be refreshed is 1. That is, when the window refresh operation is performed, only the window a needs to be refreshed, and since the window B is completely covered by the window a, no refresh is required. When the window A is drawn, after the window A is moved, the window B is not completely blocked by the window A, as shown in FIG. 10, FIG. 10 is a schematic diagram of two effective windows in the embodiment of the application, and at this time, when the window refreshing operation is executed, the window A and the window B are both effective windows, and the number of windows to be refreshed is 2.

S200, detecting the number of the current layers.

After acquiring the number of windows to be refreshed, the controller 250 needs to detect the current layer number of the display device 200, where the current layer number is the number of display layers (layers) preset by the display device 200, and may be preset according to the hardware configuration of the display device 200, for example, the display device includes two or three layers for the embedded system.

Determining a step of subsequently executing window refreshing operation according to the number of windows and the number of current layers, and for the case that the number of windows is smaller than or equal to the number of current layers, applying a buffer zone of a window to be refreshed to a display layer as a buffer zone of the display layer, and omitting a window-to-layer synthesis process; for the case that the number of windows is larger than the number of current layers, the buffer area of the window to be refreshed can be synthesized to the buffer area of the display layer.

And S300, if the number of windows is smaller than or equal to the number of the current layers, the buffer area is applied to the display layers to serve as the buffer area of the display layers.

If the number of windows is less than or equal to the number of current layers, that is, the display device 200 may omit the window-to-layer synthesis process, directly apply the buffer region of the window to be refreshed to the display layer, and the window to be refreshed and the display layer use the same buffer region, so that the data copying process between the buffer regions is not required, and the display refresh rate is improved.

In some embodiments, if the number of windows to be refreshed is 1 and the number of current layers is 1, the controller 250 may directly apply the buffer of the window to be refreshed to the buffer of the display layer so that the display device 200 may read pixel information from the buffer of the display layer and display it through the display 260.

For example, as shown in fig. 11, fig. 11 is a schematic diagram illustrating interaction between a window and a layer when displaying the layer in the embodiment of the present application, where the number of the current layers of the display device 200 is 1, that is, layer 1 shown in fig. 11, and window 1 is a window created and drawn by application 1, and window 1 has a buffer, that is, buffer 1 shown in fig. 11. When performing the window refresh operation, the controller 250 may apply the buffer 1 of the window 1 to the layer 1 as the buffer of the layer 1, and may further read the pixel information in the buffer of the layer 1 and output to the display 260 for display.

In some embodiments, if the number of windows of the window to be refreshed is greater than 1, the plurality of windows to be refreshed have different display levels, and the display device 200 needs to display the windows according to the display levels of the windows, so before applying the buffer area of the window to be refreshed to the buffer area of the display layer, the controller 250 may obtain the level correspondence between the window to be refreshed and the display layer, and apply the buffer area of the window to be refreshed to the corresponding display layer according to the level correspondence. That is, the controller 250 may dynamically allocate a display layer to each window for display according to the display level of the window and the upper and lower levels of the display layers.

In some embodiments, the controller 250 may obtain the level of the window to be refreshed and the level of the display layer, and establish a level correspondence between the window to be refreshed and the display layer according to the level of the window to be refreshed and the level of the display layer. The level of the window to be refreshed may represent the upper and lower display levels of the window to be refreshed in the display interface of the display device 200, and the level of the display layer is a preset level relationship of the display layer for the display device 200, and the level correspondence represents that the level of the window to be refreshed is the same as the level of the display layer. For example, the number of the cells to be processed,

as shown in fig. 12, fig. 12 is an interaction schematic diagram of a window and a layer when multiple layers are displayed in the embodiment of the present application, where application 1 and application 2 are application programs running on display device 200, and window 1 and window 2 are windows created and drawn by application 1 and application 2, respectively, windows to be refreshed are window 1 and window 2, and a display level of window 2 is located above a display level of window 1. As shown in fig. 12, the display device 200 has a current layer number of 2, i.e., layer 1 and layer 2 shown in fig. 12, and the layer level of layer 2 is located above layer 1, and the window 1 and the window 2 have one buffer, i.e., buffer 1 and buffer 2 shown in fig. 12, respectively. The controller 250 establishes a hierarchy correspondence between the window to be refreshed and the display layer according to the hierarchy of the window to be refreshed and the hierarchy of the display layer, that is, allocates one display layer for each window. Window 1 may be assigned to layer 1 and window 2 to layer 2. When performing the window refresh operation, the controller 250 may apply the buffer 1 of the window 1 to the layer 1 as the buffer of the layer 1 and the buffer 2 of the window 2 to the layer 2 as the buffer of the layer 2, so that the display device 200 may read pixel information from the buffers of the layer 1 and the layer 2, respectively, and output to the display 260 for display.

In some embodiments, if the number of windows is less than the current layer number, the controller 250 may select the target display layer and apply the buffer of the window to be refreshed to the buffer of the target display layer so that the display device 200 may read pixel information from the buffer of the display layer and display it through the display 260.

In some embodiments, the controller 250 may select the target display layers in a hierarchical order of the display layers, e.g., may preferentially select the display layer of the lowest layer as the target display layer.

For example, as shown in fig. 13, fig. 13 is a schematic diagram of interaction between a window and a layer when the number of windows is smaller than the number of layers in the embodiment of the present application, application 1 is an application program running on display device 200, window 1 is a window created and drawn by application 1, and window 1 has a buffer, that is, buffer 1 shown in fig. 13. The display device 200 has a current layer number of 2, i.e. layer 1 and layer 2 shown in fig. 13, the level of layer 2 being located above layer 1. When performing the window refreshing operation, the controller 250 may select fig. 1 as a target display layer according to the hierarchical order of the display layers, and apply the buffer 1 of the window 1 to the fig. 1 as the buffer of the fig. 1, and further may read the pixel information in the buffer of the fig. 1, and output the pixel information to the display 260 for display.

In some embodiments, a user may input a window creation instruction, and the controller 250 may create a window and a buffer of the window in response to the window creation instruction input by the user, and apply the buffer of the window to a display layer to control the display to display the window.

Taking fig. 13 as an example, an interaction process between the window 1 corresponding to the application 1 and the layer is shown in fig. 13, at this time, a user starts to run another application program in the display device 200, that is, the application 3, and after the application 3 is started, as shown in fig. 14, fig. 14 is an interaction schematic diagram created by the window in the embodiment of the present application, in the running process of the application 3, a buffer zone of the window is created, and window data is drawn in the buffer zone, so that the window of the application 3, that is, the window 3 shown in fig. 14, is created and drawn, the buffer zone of the window 3 is the buffer zone 3, and when the window 3 is displayed by the display 260, the controller 250 may apply the buffer zone 3 of the window 3 to the layer 2 as the buffer zone of the layer 2, and may further read pixel information in the buffer zones of the layer 1 and the layer 2 and output the pixel information to the display 260 for displaying the window 3 of the application 3.

And S400, rendering a user interface according to the buffer area of the display layer, and controlling the display to display the rendered user interface.

After the buffer of the window to be refreshed is applied to the buffer of the display layer, the buffer of the window to be refreshed serves as the buffer of the display layer, and when the window refreshing operation is performed, the controller 250 may read the pixel information stored in the buffer of the display layer, render the user interface according to the pixel information, and control the display to display the rendered user interface, thereby updating the window content displayed on the screen of the display device 200.

In this embodiment, by dynamically setting the switching of the layer buffer, for the case of one window and one display layer, the buffer of the window may be directly applied to the display layer; for the situation that the number of the windows is smaller than or equal to that of the display layers, the buffer zones of the windows can be dynamically set to be applied to the corresponding display layers according to the hierarchical corresponding relation between the windows and the display layers, so that the synthesis process from the windows to the display layers is saved, and the display refresh rate and the display performance are improved.

It can be understood that the copying operation process of the pixel information in the buffer zone is changed into the direct transfer buffer zone in different processes, so that the pixel copying operation is not needed, the time consumption of display refreshing is saved, the display refresh rate is improved, the display performance is improved, and the display requirements of applications with higher requirements on the display refresh rate, such as Netflix and the like, can be met.

In some embodiments, if the number of windows is greater than the number of current layers, synthesizing the buffer of the window to be refreshed into the buffer of the display layer, rendering a user interface according to the buffer of the display layer, and controlling the display to display the rendered user interface.

If the number of windows is greater than the number of current layers, that is, the display device 200 cannot allocate one display layer for each window to display, the controller 250 may combine the buffers of the windows to be refreshed into the buffer of the display layer, specifically, the controller 250 copies the pixel information stored in the buffer of the window to be refreshed and stores the copied pixel information into the buffer of the display layer. For display by reading pixel information in the buffer of the display layer and outputting to the display 260.

For example, as shown in fig. 15, fig. 15 is an interaction schematic diagram of a window and a layer when the number of windows is greater than the number of layers in the embodiment of the present application, application 1 and application 2 are application programs running on the display device 200, and window 1 and window 2 are windows created and drawn by application 1 and application 2 respectively, as shown in fig. 15, the number of current layers of the display device 200 is 1, i.e. layer 1 shown in fig. 15, layer 1 has one buffer zone 0, and window 1 and window 2 have one buffer zone, i.e. buffer zone 1 and buffer zone 2 shown in fig. 15, respectively. When the window refreshing operation is performed, the controller 250 may copy the pixel information in the buffer 1 into the buffer 0, and copy the pixel information in the buffer 2 into the buffer 0, that is, the window-to-layer synthesis process is completed, and then the pixel information may be read in the buffer of the layer 1 and output to the display 260 for display.

The window display method comprises various application scenes. Fig. 16 is a flow chart of a window display method in different scenes in an application embodiment. As shown in fig. 16, the number of windows is compared with the number of current layers by acquiring the number of windows and the number of current layers of the window to be refreshed. For application scenes with the number of windows being greater than that of the current layers, the buffer areas of the windows to be refreshed can be synthesized to the buffer area of the display layer, so that pixel information is read in the buffer area of the display layer and output to the display 260 for display; for application scenarios where the number of windows is less than or equal to the number of current layers, the buffer with the windows to be refreshed may be directly applied to the buffer with the display layers, so that pixel information is read in the buffer with the display layers and output to the display 260 for display, the window-to-layer synthesis process is saved, and the display performance is improved.

For the application scenario that the number of windows is less than or equal to the number of current layers, the method can be further divided into two application scenarios, for the application scenario that the number of windows is less than the number of current layers, one of the display layers can be selected as a target display layer, for example, the target display layer can be selected according to the hierarchical sequence of the display layers, and a buffer area of the window to be refreshed is applied to the target display layer, so that pixel information is read in the buffer area of the display layer and output to the display 260 for display; for the application scenario that the number of windows is equal to the number of current layers, a display layer can be allocated to each window for display according to the hierarchical correspondence between the display layers and the windows, and the buffer area of the window is applied to the corresponding display layer, so that pixel information is read in the buffer area of the display layer and output to the display 260 for display; for the application scene that the number of windows is equal to the number of current layers, there is only one window to be refreshed and one application scene for displaying the layers, and for the scene, the buffer zone of the window to be refreshed can be directly applied to the display layers without considering the hierarchical corresponding relation between the display layers and the windows, so that the executing steps are further saved, and the display refresh rate and the display performance are improved.

It should be noted that the number of display layers and the number of windows are only exemplary, and the number of display layers and the number of windows are not limited. In practical application, different steps can be executed according to the several application scenes displayed by the window, so as to realize window display refreshing.

Based on the above display device 200, a window display method is also provided in some embodiments of the present application. Comprising the following steps:

and responding to a control instruction for refreshing the window, and acquiring window information indicating a window to be refreshed in the control instruction.

Wherein the window information includes a number of windows and a buffer.

The number of current layers is detected.

And if the number of windows is smaller than or equal to the number of current layers, applying the buffer area to the display layers to serve as the buffer area of the display layers.

As can be seen from the above technical solution, the display device and the window display method provided in the foregoing embodiments may respond to a control instruction for window refreshing, obtain window information indicating a window to be refreshed in the control instruction, where the window information includes a window number and a buffer area, then detect a current layer number, if the window number is less than or equal to the current layer number, apply the buffer area to a display layer to serve as the buffer area for displaying the layer, render a user interface according to the buffer area for displaying the layer, and control a display to display the rendered user interface. The method can directly apply the buffer area of the window to the display layer after the window is drawn, thereby saving the synthesizing process from the window to the layer, and dynamically switching the buffer area in the operation period so as to improve the display refresh rate and the display performance.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display configured to display a user interface;

A controller configured to:

detecting the number of current layers;

2. The display device of claim 1, wherein the controller is further configured to:

3. The display device of claim 1, wherein the controller performs compositing the buffer of the window to be refreshed to the buffer of the display layer, further configured to:

4. The display device of claim 1, wherein the controller is further configured to:

5. The display device of claim 1, wherein the controller is further configured to:

6. The display device of claim 1, wherein the controller is further configured to:

traversing all windows;

7. The display device of claim 1, wherein the controller performs the application of the buffer to a display layer, further configured to:

8. The display device of claim 7, wherein the controller performing obtaining the hierarchical correspondence between the window to be refreshed and the display layer is further configured to:

acquiring the hierarchy of the window to be refreshed;

acquiring the hierarchy of the display layer;

and establishing a hierarchy corresponding relation between the window to be refreshed and the display layer according to the hierarchy of the window to be refreshed and the hierarchy of the display layer, wherein the hierarchy corresponding relation is used for representing that the hierarchy of the window to be refreshed is identical to the hierarchy of the display layer.

9. The display device of claim 1, wherein the controller performs a buffer rendering user interface in accordance with the display layer, further configured to:

reading pixel information stored in a buffer area of the display layer;

10. A window display method is characterized by comprising the following steps of

detecting the number of current layers;