WO2021052100A1

WO2021052100A1 - Wayland protocol-based graphics compositing method, apparatus and system, and computer-readable storage medium

Info

Publication number: WO2021052100A1
Application number: PCT/CN2020/110345
Authority: WO
Inventors: 胡冲; 梁玉平
Original assignee: 中兴通讯股份有限公司
Priority date: 2019-09-17
Filing date: 2020-08-20
Publication date: 2021-03-25
Also published as: CN112527219A

Abstract

A wayland protocol-based graphics compositing method, apparatus and system, and a computer-readable storage medium. The wayland protocol-based graphics compositing method is applied to a graphics display compositor, and comprises: acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending, by means of an input management channel, the kernel input event to a graphics application client corresponding to the window focus (S4010); receiving, by means of the window management channel, a window management request sent by at least one graphics application client (S4020); receiving, by means of the graphics management channel, graphics cache drawn by the at least one graphics application client, and applying the graphics cache drawn by the at least one graphics application client to the window management request sent by the at least one graphics application client, so as to obtain a composited graphics window (S4030); and outputting the composited graphics window to at least one display device (S4040).

Description

Graphic synthesis method, device, system and computer readable storage medium based on wayland protocol

Cross-references to related applications

This application is filed based on a Chinese patent application with an application number of 201910878092.6 and an application date of September 17, 2019, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated by reference into this application.

Technical field

This application relates to terminal equipment, for example, to a method, device, system and computer-readable storage medium for graphics synthesis based on the Wayland protocol.

Background technique

Wayland is a graphics display protocol (Protocol). The wayland protocol divides a graphics system into a graphics application client (client) and a graphics display compositor (compositor). The graphic application client and the graphic display synthesis terminal communicate through the wayland protocol.

Among them, the graphic application client communicates with the graphic display synthesis terminal through an event defined by the protocol, and the graphic display synthesis terminal communicates with the graphic application client through a protocol defined request (request). In the Wayland protocol, multiple graphic application clients communicate with a graphic display synthesis terminal.

At present, the graphics display synthesis terminal designed based on the wayland protocol is difficult to achieve the refresh frame rate of the display device due to the structural limitation of the design. As the number of graphics application clients that need to be synthesized increases, the refresh frame rate decreases faster, which may cause Phenomena such as unsmooth display and freezes affect the user experience.

Summary of the invention

This application provides a graphic synthesis method, device, system and computer-readable storage medium based on the Wayland protocol, which can improve the display fluency of the graphic display system based on the Wayland protocol.

The embodiment of the application provides a graphics synthesis method based on the wayland protocol, which is applied to the graphics display synthesis terminal, including: obtaining kernel input events, calculating window focus according to the kernel input events, and sending the kernel input events to the window focus through the input management channel Corresponding graphics application client; receive window management requests sent by at least one graphics application client through the window management channel; receive graphics cache drawn by at least one graphics application client through the graphics management channel, and store graphics drawn by at least one graphics application client Cache the window management request sent by at least one graphics application client to obtain the synthesized graphics window; and output the synthesized graphics window to at least one display device.

The embodiment of the application provides a graphic display synthesis terminal based on the wayland protocol, which includes: a window manager, a synthesis manager, an input manager, an output manager, a message manager, and a resource manager; the window manager manages through the window The channel is connected to at least one graphics application client, and is used to allocate windows for at least one graphics application client, determine the window focus, and receive window management requests sent by at least one graphics application client; the composition manager communicates with at least one graphics through the graphics management channel The application client connection is used to receive the graphics cache drawn by at least one graphics application client, and apply the window management request sent by the at least one graphics application client to the graphics cache drawn by the at least one graphics application client to obtain a synthesized graphics window; The input manager is connected to at least one graphics application client through the input management channel, and is used to obtain input events from the kernel, and send the kernel input events to the corresponding graphics application client according to the window focus determined by the window manager; the output manager is used for The graphic window synthesized by the composition manager is output to at least one display device; the message manager is used to provide a transmission message channel between the window manager, the composition manager, the input manager and the output manager; the resource manager is used to manage the window manager The resource allocation of, composition manager, input manager and output manager, and resource allocation of input management channel, window management channel and graphics management channel.

The embodiment of the application provides a graphics display system based on the wayland protocol, which includes: a graphics display synthesis terminal and at least one graphics application client; the graphics display synthesis terminal and the at least one graphics application client include an input management channel and a window Management channel and graphics management channel; the graphics display synthesis terminal is used to obtain kernel input events, calculate the window focus according to the kernel input events, and send the kernel input events to the graphics application client corresponding to the window focus through the input management channel; through the window management channel Receive a window management request sent by at least one graphics application client; receive a graphics cache drawn by at least one graphics application client through a graphics management channel, and cache the graphics drawn by at least one graphics application client to a window sent by at least one graphics application client Manage the request to obtain the synthesized graphics window; output the synthesized graphics window to at least one display device; the graphics application client is used to draw the graphics buffer according to the kernel input event, obtain the window adjustment instructions input by the user, and redraw according to the window adjustment instructions Shape cache and generate window management request.

The embodiment of the present application provides a computer-readable storage medium storing one or more computer programs, where the one or more computer programs can be executed by one or more processors to realize graphics synthesis based on the wayland protocol Method steps. Description of the drawings

FIG. 1 is a schematic structural diagram of a graphic display system based on the wayland protocol provided by an embodiment;

FIG. 2 is a schematic structural diagram of another graphic display system based on the wayland protocol provided by an embodiment;

FIG. 3 is a schematic structural diagram of another graphic display system based on the wayland protocol provided by an embodiment;

FIG. 4 is a flowchart of a graphic display method based on the wayland protocol provided by an embodiment;

FIG. 5 is a schematic diagram of a structure of a graphic display synthesis terminal based on the wayland protocol provided by an embodiment.

detailed description

Hereinafter, the embodiments of the present application will be described in detail with reference to the accompanying drawings.

Figure 1 is a schematic structural diagram of a graphics display system based on the Wayland protocol provided by an embodiment. As shown in Figure 1, the graphics display system based on the Wayland protocol provided by this embodiment includes: a graphics display synthesis terminal 11 and at least one graphic Application client 12.

The graphics display synthesis terminal 11 and the at least one graphics application client 12 include an input management channel 14, a window management channel 15 and a graphics management channel 16.

The graphics display synthesis terminal 11 is used to obtain the kernel input event, calculate the window focus according to the kernel input event, and send the kernel input event to the graphics application client 12 corresponding to the window focus through the input management channel 14; receive at least one through the window management channel 14 Window management request sent by graphics application client 12; receiving graphics cache drawn by at least one graphics application client 12 through graphics management channel 16, and sending graphics cache drawn by at least one graphics application client 12 to at least one graphics application client 12 Window management request to obtain the synthesized graphic window; output the synthesized graphic window to at least one display device 13.

The graphics application client 12 is used to draw the graphics cache according to the kernel input event, obtain the window adjustment instructions input by the user, redraw the graphics cache according to the window adjustment instructions, and generate a window management request.

Wayland is a graphics display protocol that divides the graphics system into a graphics application client and a graphics display synthesis terminal. The graphics application client and the graphics display synthesis terminal communicate through the wayland protocol, where the graphics application client communicates with the graphics display synthesis terminal through the event defined by the protocol, and the graphics display synthesis terminal communicates with the graphics through the protocol defined request (request) The application client communicates, and the graphic display synthesis terminal can communicate with multiple graphic application clients at the same time. Different graphics display systems can be designed based on the wayland protocol, but the current graphics display system based on the wayland protocol uses a protocol domain socket connection between the graphics application client and the graphics display synthesis terminal, that is, the graphics application The client and the graphics display synthesis terminal are connected through a single channel, so when the number of graphics application clients that need to be synthesized increases, the frame rate will drop, which will cause the display to be unsmooth and stuck.

After analyzing the wayland protocol, the events in the wayland protocol can be divided into three categories, namely: input-related events and requests, graphic display-related events and requests, and window management-related events and requests. Then the three types of events and requests can be separated, and the three types of events and requests can be transmitted between the graphics application client and the graphics display synthesis terminal through different channels. Therefore, in the graphics display system based on the wayland protocol provided in this embodiment, an input management channel 14, a window management channel 15, and a graphics management channel 16 are established between the graphics display synthesis terminal 11 and at least one graphics application client 12.

The input management channel 14 is used to transmit input-related events and requests; the window management channel 15 is used to transmit window management-related events and requests; and the graphics management channel 16 is used to transmit graphics display-related events and requests.

In detail, each application has a corresponding graphics application client 12, and the graphics application client 12 is used to draw the graphics buffer required by the corresponding application for the graphics window, and send the drawn graphics buffer to the graphics display synthesis terminal 11. Then it is sent to the display device by the graphic display synthesis terminal 11 for display. Then the graphics display synthesis terminal first allocates windows to each graphics application client 12, connects to the graphics display synthesis terminal 11 through the window management channel 15, determines the window focus corresponding to each graphics application client 12, and provides it to each graphics application client 12 Various setting interfaces, such as move, resize, maximize, minimize, full screen, etc. Then, after each graphics application client 12 receives the user's input, that is, after obtaining the window adjustment instruction input by the user, the graphics application client 12 will change the corresponding window, and perform operations such as moving, resizing, maximizing, minimizing, Full screen and other processing, and then use a graphics manager (Graphics Processing Unit, GPU) to perform redraw processing, redraw the graphics cache corresponding to the window, and at the same time, the graphics application client 12 generates a window management request. The graphic display synthesis terminal 11 can then receive a window management request sent by at least one graphic application client 12 through the window management channel 15.

The graphics display synthesis terminal 11 is also connected to multiple graphics application clients 12 through the input management channel 14. After it obtains the kernel input event, it calculates the window focus according to the kernel input event, and sends the kernel input event to the window through the input management channel 14. The graphics application client 12 corresponding to the focus.

The graphics display synthesis terminal 11 is also connected to multiple graphics application clients 12 through a graphics management channel 16, receives graphics cache drawn by at least one graphics application client 12 through the graphics management channel 16, and stores graphics drawn by at least one graphics application client 12 The window management request sent by at least one graphics application client 12 is cached to obtain the synthesized graphics window; the synthesized graphics window is output to at least one display device 13.

The graphics application client 12 is used to draw the graphics cache according to the kernel input event, obtain the window adjustment instructions input by the user, redraw the graphics cache according to the window adjustment instructions, and generate a window management request. Then the graphics cache, window adjustment instructions, and kernel input events of the graphics application client 12 interact with the graphics display synthesis terminal 11 through different channels, thereby reducing the information carrying capacity of each data channel.

Since in the graphics display system based on the wayland protocol provided in this embodiment, the graphics display synthesis terminal 11 and at least one graphics application client 12 are connected through three channels, and the three channels transmit different types of events and requests, then it will be able to The response speed is greatly accelerated, and congestion caused by excessive information transmission between the graphics display synthesis terminal 11 and at least one graphics application client 12 can be avoided, so that the display fluency of the graphics display system based on the wayland protocol can be improved.

The graphics display system based on the Wayland protocol provided in this embodiment includes: a graphics display synthesis terminal and at least one graphics application client; the graphics display synthesis terminal and the at least one graphics application client include an input management channel, a window management channel, and graphics management. Channel; the graphics display synthesis terminal is used to obtain the kernel input event, calculate the window focus according to the kernel input event, and send the kernel input event to the graphics application client corresponding to the window focus through the input management channel; receive at least one graphics application through the window management channel A window management request sent by the client; receiving a graphics cache drawn by at least one graphics application client through the graphics management channel, and applying the graphics cache drawn by at least one graphics application client to the window management request sent by at least one graphics application client to obtain a synthesis After the graphics window; output the synthesized graphics window to at least one display device; the graphics application client is used to draw the graphics buffer according to the kernel input event, obtain the window adjustment instructions input by the user, redraw the shape buffer and generate the window according to the window adjustment instructions Management requests. Since events and requests of different categories are transmitted through the three channels, the response speed can be greatly accelerated, and congestion caused by excessive information transmission between the graphics display synthesis terminal and at least one graphics application client can be avoided. Improve the display fluency of the graphics display system based on the wayland protocol.

Fig. 2 is a schematic structural diagram of another graphic display system based on Wayland protocol provided by an embodiment. As shown in Fig. 2, the graphic display system based on Wayland protocol provided by this embodiment is based on Fig. 1, and the graphic display is synthesized The terminal 11 includes a window manager 111, a composition manager 112, an input manager 113, and an output manager 114.

The window manager 111 is connected to at least one graphics application client 12 through the window management channel 15 to allocate windows to the at least one graphics application client 12, determine the window focus, and receive a window management request sent by the at least one graphics application client 12.

The composition manager is connected to at least one graphics application client 12 through the graphics management channel 16 to receive the graphics cache drawn by the at least one graphics application client 12, and apply at least one graphics cache drawn by the at least one graphics application client 12 The window management request sent by the graphics application client 12 obtains the synthesized graphics window.

The input manager 113 is connected to at least one graphics application client 12 through the input management channel 14, and is used to obtain input events from the kernel, and send the kernel input events to the corresponding graphics application client 12 according to the window focus determined by the window manager 111 .

The output manager 114 is configured to output the graphics window synthesized by the synthesis manager 112 to at least one display device 13.

The window manager 111, the composition manager 112, the input manager 113, and the output manager 114 respectively perform parallel processing through multiple threads, which can improve the processing efficiency of the graphics display composition terminal 11.

Fig. 3 is a schematic structural diagram of another graphic display system based on Wayland protocol provided by an embodiment. As shown in Fig. 3, the graphic display system based on Wayland protocol provided by this embodiment is based on Fig. 2, and the graphic display is synthesized The terminal 11 also includes a message manager 115 and a resource manager 116.

The message manager 115 is used to provide a transmission message channel between the window manager 111, the composition manager 112, the input manager 113, and the output manager 114. The message manager 115 mainly implements the communication between the graphics display system based on the wayland protocol and external services, and the internal modules of the graphics display synthesis terminal 11, using serialized message queue communication.

The resource manager 116 is used to manage the resource allocation of the window manager 111, the composition manager 112, the input manager 113, and the output manager 114, and the resource allocation of the input management channel 14, the window management channel 15, and the graphics management channel 16. The resource manager 116 mainly manages the communication resources of each channel between the graphic display synthesis terminal 11 and the graphic application client 12, and performs the window manager 111, the synthesis manager 112, and the input manager 113 according to the request of the graphic application client 12 , Resource allocation of output manager 114.

Each module (including window manager 111, synthesis manager 112, input manager 113, output manager 114, message manager 115, and resource manager 116) in the graphic display synthesis terminal 11 allocates separate threads or thread groups to provide them For the microservice function, each module communicates through the message manager 115, and the resource manager 116 allocates resources to ensure the cooperative operation between the modules.

In an embodiment, the window manager 111 is also configured to perform a unified calculation on the display windows of at least one graphics application client 12, determine the top-level visible display window, and notify the graphics application client 12 corresponding to the invisible window through the window management channel 15 Pause graphics drawing. The window manager 111 uniformly calculates the dirty area, transparent area, Z-sequence, etc. of the display windows of each graphics application client 12 to determine the top-level visible display window, and sends commands to those in the background or blocked by the dedicated window management channel 15 While the graphics application client 12 that makes it invisible suspends graphics drawing, these suspended graphics application clients 12 will no longer occupy GPU resources to ensure the priority occupation of the GPU resources of the top-level window, which is implemented in the multi-graphics application client 12 It can be displayed smoothly in different scenes.

FIG. 4 is a flowchart of a graphic display method based on the wayland protocol provided by an embodiment. As shown in FIG. 4, as shown in FIG. 4, the method provided in this embodiment includes the following steps.

Step S4010: Obtain the kernel input event, calculate the window focus according to the kernel input event, and send the kernel input event to the graphics application client corresponding to the window focus through the input management channel.

Step S4020: Receive a window management request sent by at least one graphics application client through the window management channel.

Step S4030: Receive the graphics cache drawn by at least one graphics application client through the graphics management channel, and apply the graphics cache drawn by the at least one graphics application client to the window management request sent by the at least one graphics application client to obtain a synthesized graphics window.

Step S4040: Output the synthesized graphics window to at least one display device.

The graphics synthesis method based on the Wayland protocol provided in this embodiment is applied to the graphics display synthesis terminal, and the graphics display synthesis terminal may be the graphics display synthesis terminal 11 in the graphics synthesis system based on the wayland protocol in the embodiment shown in FIG. 1. The specific implementation method and technical effect of the graphics display method based on the wayland protocol provided in this embodiment have been described in the embodiment shown in FIG. 1, and will not be repeated here.

In an embodiment, the method for displaying graphics based on the wayland protocol provided by the embodiment of the present application is based on FIG. 4, and further includes: using a graphics manager to allocate windows for at least one graphics application client, determining the window focus, and managing the The channel interface receives the window management request sent by at least one graphics application client; the composition manager receives the graphics cache drawn by at least one graphics application client through the graphics management channel, and applies at least one graphics cache drawn by the at least one graphics application client. The window management request sent by the graphics application client obtains the synthesized graphics window; the input manager is used to obtain input events from the kernel, and the kernel input events are sent to the corresponding graphics application through the input management channel according to the window focus determined by the window manager Client: The output manager is used to output the synthesized graphics window to at least one display device.

In an embodiment, the method for displaying graphics based on the wayland protocol provided by the embodiment of the present application is based on FIG. 4, and further includes: adopting a message manager as one of the window manager, the composition manager, the input manager, and the output manager. Provide a transmission message channel between them; use the resource manager to manage the resource allocation of the window manager, the synthesis manager, the input manager and the output manager, and the resource allocation of the input management channel, window management channel and graphics management channel.

In one embodiment, the graphics display method based on the wayland protocol provided by the embodiment of the present application uses a window manager to perform a unified calculation on the display windows of at least one graphics application client on the basis of FIG. 4 to determine the top-level visible display window. The window management channel notifies the graphics application client corresponding to the invisible window to suspend graphics drawing.

Fig. 5 is a schematic structural diagram of a graphic display synthesis terminal based on the Wayland protocol provided by an embodiment. As shown in Fig. 5, the graphic display synthesis terminal based on the Wayland protocol provided in this embodiment includes:

Window manager 51, composition manager 52, input manager 53, output manager 54, message manager 55, and resource manager 56.

The window manager 51 is connected to at least one graphics application client through a window management channel, and is used to allocate windows to at least one graphics application client, determine the window focus, and receive a window management request sent by at least one graphics application client; the composition manager 52 Connected to at least one graphics application client through a graphics management channel, for receiving graphics cache drawn by at least one graphics application client, and applying the graphics cache drawn by at least one graphics application client to a window management request sent by at least one graphics application client , The synthesized graphics window is obtained; the input manager 53 is connected to at least one graphics application client through the input management channel, and is used to obtain input events from the kernel, and send the kernel input events to the corresponding window focus according to the window focus determined by the window manager 51 The output manager 54 is used to output the graphic window synthesized by the synthesis manager 52 to at least one display device; the message manager 55 is used to provide the window manager 51, the synthesis manager 52, the input manager 53 and The output manager 54 provides a transmission message channel; the resource manager 56 is used to manage the resource allocation of the window manager 51, the composition manager 52, the input manager 53, and the output manager 54, as well as the input management channel, window management channel and Graphic management channel resource allocation.

The graphic display synthesis terminal based on the wayland protocol provided in this embodiment may be the graphic display synthesis terminal in the embodiment shown in FIG. 3.

In an embodiment, the window manager 51 is further configured to perform a unified calculation on the display windows of at least one graphics application client, determine the top-level visible display window, and notify the graphics application client corresponding to the invisible window to suspend graphics drawing through the window management channel.

The embodiment of the present application also provides a storage medium containing computer-executable instructions. When the computer-executable instructions are executed by a computer processor, they are used to execute a wayland protocol-based graphics synthesis method. The method includes: obtaining kernel input events, Calculate the window focus according to the kernel input event, and send the kernel input event to the graphics application client corresponding to the window focus through the input management channel; receive the window management request sent by at least one graphics application client through the window management channel; receive through the graphics management channel The graphics cache drawn by at least one graphics application client applies the window management request sent by the at least one graphics application client to the graphics cache drawn by the at least one graphics application client to obtain the synthesized graphics window; and the synthesized graphics window is output to at least A display device.

The above are only exemplary embodiments of the present application, and are not used to limit the protection scope of the present application.

Those skilled in the art should understand that the term user terminal encompasses any suitable type of wireless user equipment, such as a mobile phone, a portable data processing device, a portable web browser, or a vehicle-mounted mobile station.

In general, the various embodiments of the present application can be implemented in hardware or dedicated circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device, although the present application is not limited thereto.

The embodiments of the present application may be implemented by executing computer program instructions by a data processor of a mobile device, for example, in a processor entity, or by hardware, or by a combination of software and hardware. Computer program instructions can be assembly instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or written in any combination of one or more programming languages Source code or object code.

The block diagram of any logic flow in the drawings of the present application may represent program steps, or may represent interconnected logic circuits, modules, and functions, or may represent a combination of program steps and logic circuits, modules, and functions. The computer program can be stored on the memory. The memory can be of any type suitable for the local technical environment and can be implemented using any suitable data storage technology, such as but not limited to read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), optical Memory devices and systems (Digital Video Disc (DVD) or Compact Disc (CD), etc.. Computer-readable media can include non-transitory storage media. The data processor can be any suitable for the local technical environment. Types, such as but not limited to general-purpose computers, special-purpose computers, microprocessors, digital signal processors (Digital Signal Processing, DSP), application specific integrated circuits (ASICs), programmable logic devices (Field-Programmable Gate Array) , FGPA) and processors based on multi-core processor architecture.

Claims

A graphic synthesis method based on the wayland protocol, applied to the graphic display synthesis terminal, including:

Acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graphics application client corresponding to the window focus through an input management channel;

Receiving a window management request sent by at least one graphics application client through a window management channel;

Receive the graphics cache drawn by the at least one graphics application client through the graphics management channel, and apply the graphics cache drawn by the at least one graphics application client to the window management request sent by the at least one graphics application client to obtain the synthesized Graphics window

The synthesized graphics window is output to at least one display device.
The method according to claim 1, further comprising:

Using a graphics manager to allocate windows to the at least one graphics application client, determine the window focus, and receive a window management request sent by the at least one graphics application client through the window management channel;

The composition manager is used to receive the graphics cache drawn by the at least one graphics application client through the graphics management channel, and apply the graphics cache drawn by the at least one graphics application client to the window sent by the at least one graphics application client Manage the request and get the combined graphics window;

Acquiring input events from the kernel by using an input manager, and sending the kernel input events to the corresponding graphics application client through the input management channel according to the window focus determined by the window manager;

The output manager is used to output the synthesized graphics window to at least one display device.
The method according to claim 2, further comprising:

Using a message manager to provide a transmission message channel between the window manager, the composition manager, the input manager, and the output manager;

A resource manager is used to manage the resource allocation of the window manager, the composition manager, the input manager and the output manager, and the resource allocation of the input management channel, the window management channel and the graphics management channel.
The method according to claim 2 or 3, further comprising:

A window manager is used to perform a unified calculation on the display windows of the at least one graphics application client, determine the top-level visible display window, and notify the graphics application client corresponding to the invisible window to suspend graphics drawing through the window management channel.
A graphic display synthesis terminal based on the wayland protocol, including:

Window manager, composition manager, input manager, output manager, message manager and resource manager;

The window manager is connected to the at least one graphics application client through a window management channel, and is configured to allocate a window to the at least one graphics application client, determine the window focus, and receive the window sent by the at least one graphics application client Management request;

The composition manager is connected to the at least one graphics application client through a graphics management channel, and is configured to receive the graphics cache drawn by the at least one graphics application client, and cache the graphics drawn by the at least one graphics application client. A window management request sent by the at least one graphics application client to obtain a synthesized graphics window;

The input manager is connected to the at least one graphics application client through an input management channel, and is used to obtain input events from the kernel, and send the kernel input events to the corresponding graphics according to the window focus determined by the window manager Application client

The output manager is used to output the graphics window synthesized by the synthesis manager to at least one display device;

The message manager is used to provide a transmission message channel between the window manager, the composition manager, the input manager, and the output manager;

The resource manager is used to manage the resource allocation of the window manager, the composition manager, the input manager, and the output manager, and the resource allocation of the input management channel, the window management channel, and the graphics management channel.
The graphics display synthesis terminal based on the wayland protocol according to claim 5, wherein the window manager is further configured to perform a unified calculation on the display windows of the at least one graphics application client to determine the top-level visible display window, and pass the The window management channel notifies the graphics application client corresponding to the invisible window to suspend graphics drawing.
A graphics display system based on the wayland protocol, including: a graphics display synthesis terminal and at least one graphics application client;

The graphic display synthesis terminal and the at least one graphic application client include an input management channel, a window management channel, and a graphics management channel;

The graphic display synthesis terminal is used to obtain the kernel input event, calculate the window focus according to the kernel input event, and send the kernel input event to the graphics application client corresponding to the window focus through the input management channel; The window management channel receives a window management request sent by the at least one graphics application client; receives the graphics cache drawn by the at least one graphics application client through the graphics management channel, and draws the at least one graphics application client The graphics cache applies a window management request sent by the at least one graphics application client to obtain a synthesized graphics window; and outputs the synthesized graphics window to at least one display device;

The graphics application client is used to draw a graphics cache according to the kernel input event, obtain a window adjustment instruction input by a user, redraw the graphics cache according to the window adjustment instruction, and generate the window management request.
7. The system according to claim 7, wherein the graphic display synthesis terminal includes a window manager, a synthesis manager, an input manager, and an output manager;

The window manager is connected to the at least one graphics application client through the window management channel, and is configured to allocate a window to the at least one graphics application client, determine the window focus, and receive a message sent by the at least one graphics application client Window management request;

The composition manager is connected to the at least one graphics application client through the graphics management channel, and is configured to receive the graphics cache drawn by the at least one graphics application client, and store the graphics drawn by the at least one graphics application client. Cache the window management request sent by the at least one graphics application client to obtain the synthesized graphics window;

The input manager is connected to the at least one graphics application client through the input management channel, and is used to obtain input events from the kernel and send the kernel input events to the corresponding window focus according to the window focus determined by the window manager. Graphics application client;

The output manager is used to output the graphics window synthesized by the synthesis manager to at least one display device.
8. The system according to claim 8, wherein the graphic display synthesis terminal further comprises a message manager and a resource manager;

The message manager is used to provide a transmission message channel between the window manager, the composition manager, the input manager, and the output manager;

The resource manager is used to manage the resource allocation of the window manager, the composition manager, the input manager, and the output manager, and the resource allocation of the input management channel, the window management channel, and the graphics management channel.
The system according to claim 8 or 9, wherein the window manager is further configured to perform a unified calculation on the display windows of the at least one graphics application client, determine the top-level visible display window, and notify the display window through the window management channel. The graphics application client corresponding to the visible window suspends graphics drawing.
A computer-readable storage medium that stores one or more computer programs, wherein the one or more computer programs can be executed by one or more processors to implement any one of claims 1 to 4 The steps of the graphics synthesis method based on the Wayland protocol.