CN112527219A - Graphics synthesis method, device and system based on WAYLAND protocol - Google Patents
Graphics synthesis method, device and system based on WAYLAND protocol Download PDFInfo
- Publication number
- CN112527219A CN112527219A CN201910878092.6A CN201910878092A CN112527219A CN 112527219 A CN112527219 A CN 112527219A CN 201910878092 A CN201910878092 A CN 201910878092A CN 112527219 A CN112527219 A CN 112527219A
- Authority
- CN
- China
- Prior art keywords
- window
- manager
- graphic
- application client
- input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Digital Computer Display Output (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides a method, a device and a system for synthesizing graphs based on a WAYLAND protocol, the method for synthesizing the graphs based on the WAYLAND protocol is applied to a graph display synthesizing end and comprises the following steps: acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graphic application client corresponding to the window focus through an input management channel; receiving a window management request sent by at least one graphic application client through a window management channel; receiving a graphic cache drawn by at least one graphic application client through a graphic management channel, and applying the graphic cache drawn by at least one graphic application client to a window management request sent by at least one graphic application client to obtain a synthesized graphic window; the synthesized graphical window is output to at least one display device.
Description
Technical Field
The present application relates to a terminal device, and for example, to a graphics synthesis method, apparatus and system based on the wayland protocol.
Background
Wayland is a graphics display Protocol (Protocol) that divides a graphics system into a graphics application client (client) and a graphics display composition client (composer). The graphic application client and the graphic display composition end communicate via the wayland protocol.
The graphic application client communicates with the graphic display synthesis end through an event (event) defined by a protocol, and the graphic display synthesis end communicates with the graphic application client through a request (request) defined by the protocol. In the Wayland protocol, a plurality of graphic application clients communicate with one graphic display composition end.
At present, due to structural limitation of design, a graphics display synthesis end designed based on the wayland protocol is difficult to achieve a refresh frame rate of a display device, and as the number of graphics application clients needing to be synthesized is larger, the refresh frame rate is reduced more quickly, so that phenomena such as unsmooth display, blockage and the like can be caused, and user experience is influenced.
Disclosure of Invention
The application provides a method, a device and a system for synthesizing graphs based on a WAYLAND protocol, which can improve the display fluency of a graph display system based on the WAYLAND protocol.
The embodiment of the application provides a graphics synthesis method based on a wayland protocol, which is applied to a graphics display synthesis end and comprises the following steps:
acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graphic application client corresponding to the window focus through an input management channel;
receiving a window management request sent by at least one graphic application client through a window management channel;
receiving a graphic cache drawn by at least one graphic application client through a graphic management channel, and applying the graphic cache drawn by at least one graphic application client to a window management request sent by at least one graphic application client to obtain a synthesized graphic window;
the synthesized graphical window is output to at least one display device.
The embodiment of the application provides a graphical display synthesis end based on the wayland protocol, which is characterized by comprising the following steps:
a window manager, a composition manager, an input manager, an output manager, a message manager, and a resource manager;
the window manager is connected with at least one graphic application client through a window management channel and used for distributing a window for the at least one graphic application client, determining a window focus and receiving a window management request sent by the at least one graphic application client;
the synthesis manager is connected with at least one graph application client through a graph management channel and used for receiving a graph cache drawn by the at least one graph application client and applying the graph cache drawn by the at least one graph application client to a window management request sent by the at least one graph application client to obtain a synthesized graph window;
the input manager is connected with at least one graphic application client through an input management channel and is used for acquiring an input event from the kernel and sending the kernel input event to the corresponding graphic application client according to the window focus determined by the window manager;
the output manager is used for outputting the graphic window synthesized by the synthesis manager to at least one display device;
the message manager is used for providing a message transmission channel among the window manager, the composition manager, the input manager and the output manager;
the resource manager is used for managing the resource allocation of the window manager, the composition manager, the input manager and the output manager, and the resource allocation of the input management channel, the window management channel and the graphic management channel.
The embodiment of the application provides a graphical display system based on the wayland protocol, which is characterized by comprising: the system comprises a graphic display synthesis end and at least one graphic application client;
the input management channel, the window management channel and the graphic management channel are arranged between the graphic display synthesis end and at least one graphic application client;
the graph display synthesis end is used for acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graph application client corresponding to the window focus through an input management channel; receiving a window management request sent by at least one graphic application client through a window management channel; receiving a graphic cache drawn by at least one graphic application client through a graphic management channel, and applying the graphic cache drawn by at least one graphic application client to a window management request sent by at least one graphic application client to obtain a synthesized graphic window; outputting the synthesized graphical window to at least one display device;
the graph application client is used for drawing the graph cache according to the kernel input event, acquiring a window adjusting instruction input by a user, redrawing the graph cache according to the window adjusting instruction and generating a window management request.
Drawings
FIG. 1 is a schematic diagram of a graphical display system based on the WAYLAND protocol according to an embodiment;
FIG. 2 is a schematic diagram of another graphical display system based on the WAYLAND protocol according to an embodiment;
FIG. 3 is a schematic diagram of another graphical display system based on the WAYLAND protocol according to an embodiment;
FIG. 4 is a flowchart of a graphical display method based on the WAYLAND protocol, according to an embodiment;
fig. 5 is a schematic structural diagram of a graphical display composition end based on the wayland protocol according to an embodiment.
Detailed Description
Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings.
Fig. 1 is a schematic structural diagram of a graphical display system based on the wayland protocol according to an embodiment, and as shown in fig. 1, the graphical display system based on the wayland protocol according to the embodiment includes: a graphic display composition end 11 and at least one graphic application client 12.
The graphic display composition end 11 and at least one graphic application client 12 comprise an input management channel 14, a window management channel 15 and a graphic management channel 16.
The graphic display synthesis end 11 is used for acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graphic application client 12 corresponding to the window focus through an input management channel 14; receiving a window management request sent by at least one graphic application client 12 through a window management 14 channel; receiving a graph cache drawn by at least one graph application client 12 through a graph management channel 16, and applying the graph cache drawn by at least one graph application client 12 to a window management request sent by at least one graph application client 12 to obtain a synthesized graph window; the synthesized graphic window is output to the at least one display device 13.
The graphic application client 12 is configured to draw a graphic cache according to the kernel input event, obtain a window adjustment instruction input by a user, redraw the graphic cache according to the window adjustment instruction, and generate a window management request.
Wayland is a graphics display protocol that divides the graphics system into a graphics application client and a graphics display composition client. The graphic application client side and the graphic display synthesis side communicate through a WAYLAND protocol, wherein the graphic application client side communicates with the graphic display synthesis side through events (events) defined by the protocol, the graphic display synthesis side communicates with the graphic application client side through requests (requests) defined by the protocol, and the graphic display synthesis side can communicate with a plurality of graphic application client sides simultaneously. Different graphic display systems can be designed based on the wayland protocol, but in the current graphic display system based on the wayland protocol, a graphic application client and a graphic display synthesis end are connected through a protocol domain socket (domain socket), that is, the graphic application client and the graphic display synthesis end are connected through a single channel, so that when the number of the graphic application clients needing to be synthesized is increased, the frame rate is reduced, and phenomena such as unsmooth display, unsmooth display and the like are caused.
After analyzing the wayland protocol, events in the wayland protocol can be classified into three categories, which are: inputting related events and requests, displaying related events and requests, and managing related events and requests. It is possible to separate the three kinds of events and requests, which are transmitted between the graphic application client and the graphic display composition terminal through different channels, respectively. Therefore, in the graphical display system based on the wayland protocol provided by the embodiment, an input management channel 14, a window management channel 15 and a graph management channel 16 are established between the graphical display synthesis end 11 and at least one graph application client 12.
The input management channel 14 is used for transmitting input-related events and requests; the window management channel 15 is used for transmitting events and requests related to window management; and a graphics management channel 16 for communicating graphics display related events and requests.
In detail, each application program has a corresponding graphics application client 12, and the graphics application client 12 is configured to draw a graphics cache required for a graphics window for the corresponding application program, send the drawn graphics cache to the graphics display composition terminal 11, and then send the graphics display composition terminal 11 to the display device for display. The graphic display composition end firstly allocates a window for each graphic application client 12, connects with the graphic display composition end 11 through the window management channel 15, determines the window focus corresponding to each graphic application client 12, and provides various setting interfaces, such as move, resize, maximize, minimize, full screen, etc., for each graphic application client 12. After receiving the input of the user, that is, after obtaining the window adjustment instruction input by the user, the Graphics application clients 12 change the corresponding window, perform Processing such as moving, resizing, maximizing, minimizing, full-screen, and the like, and then perform redrawing Processing using a Graphics Processing Unit (GPU), redraw the Graphics cache corresponding to the window, and at the same time, the Graphics application clients 12 generate a window management request. The graphic display composition end 11 may receive a window management request sent by at least one graphic application client 12 through the window management channel 15.
The graphic display composition end 11 is further connected to a plurality of graphic application clients 12 through the input management channel 14, after acquiring the kernel input event, calculates a window focus according to the kernel input event, and sends the kernel input event to the graphic application client 12 corresponding to the window focus through the input management channel 14.
The graphic display synthesis end 11 is further connected with a plurality of graphic application clients 12 through a graphic management channel 16, receives a graphic cache drawn by at least one graphic application client 12 through the graphic management channel 16, applies the graphic cache drawn by at least one graphic application client 12 to a window management request sent by at least one graphic application client 12, and obtains a synthesized graphic window; the synthesized graphic window is output to the at least one display device 13.
The graphic application client 12 is configured to draw a graphic cache according to the kernel input event, obtain a window adjustment instruction input by a user, redraw the graphic cache according to the window adjustment instruction, and generate a window management request. Then the graphic cache, the window adjustment instruction and the kernel input event of the graphic application client 12 interact with the graphic display composition end 11 through different channels, so that the information carrying capacity of each data channel is reduced.
In the graphical display system based on the wayland protocol provided by the embodiment, the graphical display synthesis end 11 and the at least one graphical application client 12 are connected through three channels, and the three channels transmit events and requests of different categories respectively, so that the response speed can be greatly increased, congestion caused by excessive information transmitted between the graphical display synthesis end 11 and the at least one graphical application client 12 is avoided, and the display smoothness of the graphical display system based on the wayland protocol can be improved.
The graphical display system based on the wayland protocol provided by the embodiment comprises: the system comprises a graphic display synthesis end and at least one graphic application client; the input management channel, the window management channel and the graphic management channel are arranged between the graphic display synthesis end and at least one graphic application client; the graph display synthesis end is used for acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graph application client corresponding to the window focus through an input management channel; receiving a window management request sent by at least one graphic application client through a window management channel; receiving a graphic cache drawn by at least one graphic application client through a graphic management channel, and applying the graphic cache drawn by at least one graphic application client to a window management request sent by at least one graphic application client to obtain a synthesized graphic window; outputting the synthesized graphical window to at least one display device; the graphic application client is used for drawing a graphic cache according to the event input by the kernel, acquiring a window adjusting instruction input by a user, redrawing the graphic cache according to the window adjusting instruction and generating a window management request.
Fig. 2 is a schematic structural diagram of another graphical display system based on the wayland protocol according to an embodiment, and as shown in fig. 2, in the graphical display system based on the wayland protocol according to the embodiment, based on fig. 1, the graphical display composition end 11 includes a window manager 111, a composition manager 112, an input manager 113, and an output manager 114.
The window manager 111 is connected to the at least one graphics application client 12 through the window management channel 15, and is configured to allocate a window to the at least one graphics application client 12, determine a window focus, and receive a window management request sent by the at least one graphics application client 12.
The composition manager is connected to the at least one graphics application client 12 through the graphics management channel 16 112, and is configured to receive a graphics cache drawn by the at least one graphics application client 12, and apply the graphics cache drawn by the at least one graphics application client 12 to a window management request sent by the at least one graphics application client 12, so as to obtain a synthesized graphics window.
The input manager 113 is connected to at least one graphics application client 12 through the input management channel 14, and is configured to obtain an input event from the kernel, and send the kernel input event to the corresponding graphics application client 12 according to the window focus determined by the window manager 111.
The output manager 114 serves to output the graphic window synthesized by the synthesis manager 112 to at least one display device 13.
The window manager 111, the composition manager 112, the input manager 113, and the output manager 114 perform parallel processing by a plurality of threads, respectively, and thus the processing efficiency of the graphic display composition terminal 11 can be improved.
Fig. 3 is a schematic structural diagram of another graphical display system based on the wayland protocol according to an embodiment, and as shown in fig. 3, based on fig. 2, the graphical display composition end 11 further includes a message manager 115 and a resource manager 116.
The message manager 115 is used to provide a transmission message channel between the window manager 111, the composition manager 112, the input manager 113, and the output manager 114. The message manager 115 mainly implements communication between the graphics display system based on the wayland protocol and external services, and between the modules inside the graphics display composition end 11, and adopts a serialized message queue mode for communication.
The resource manager 116 is for managing resource allocation of the window manager 111, the composition manager 112, the input manager 113, and the output manager 114, and resource allocation of the input management channel 14, the window management channel 15, and the graphic management channel 16. The resource manager 116 mainly manages communication resources of each channel between the graphic display composition terminal 11 and the graphic application client 12, and performs resource allocation of the window manager 111, the composition manager 112, the input manager 113, and the output manager 114 according to a request of the graphic application client 12.
Each module (including the window manager 111, the composition manager 112, the input manager 113, the output manager 114, the message manager 115 and the resource manager 116) in the graphic display composition end 11 allocates a separate thread or thread group to provide the micro service function thereof, each module communicates through the message manager 115, and the resource manager 116 allocates resources to ensure the cooperation operation among the modules.
In an embodiment, the window manager 111 is further configured to perform a unified calculation on the display windows of at least one graphics application client 12, determine a top-level visible display window, and notify the graphics application client 12 corresponding to the invisible window to suspend graphics drawing through the window management channel 15. The window manager 111 calculates the dirty area, the transparent area, the Z sequence, and the like of the display window of each graphics application client 12 uniformly, so as to determine the top-layer visible display window, and sends a command to the graphics application client 12, which is in the background or is blocked to make it invisible, through the dedicated window management channel 15 to suspend graphics drawing, and these suspended graphics application clients 12 will no longer occupy GPU resources, so as to ensure the preferential occupation of the GPU resources of the top-layer window, and realize smooth display in the scene of the multiple graphics application clients 12.
Fig. 4 is a flowchart of a graphical display method based on the wayland protocol according to an embodiment, as shown in fig. 4, and as shown in fig. 4, the method according to the embodiment includes the following steps.
Step S4010, obtaining a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graphic application client corresponding to the window focus through an input management channel.
Step S4020, receiving a window management request sent by at least one graphics application client through a window management channel.
Step S4030, receiving the graphics cache drawn by the at least one graphics application client through the graphics management channel, and applying the graphics cache drawn by the at least one graphics application client to a window management request sent by the at least one graphics application client to obtain a synthesized graphics window.
Step S4040, outputting the synthesized graphic window to at least one display device.
The graphics synthesis method based on the wayland protocol provided in this embodiment is applied to a graphics display synthesis end, which may be the graphics display synthesis end 11 in the graphics synthesis system based on the wayland protocol in the embodiment shown in fig. 1. The specific implementation method and technical effect of the graphical display method based on the wayland protocol provided in this embodiment have been described in the embodiment shown in fig. 1, and are not described herein again.
In an embodiment, the graphical display method based on the wayland protocol provided in the embodiment of the present application further includes, on the basis of fig. 4: a graph manager is adopted to distribute windows for at least one graph application client, a window focus is determined, and a window management request sent by at least one graph application client is received through a window management channel; receiving a graph cache drawn by at least one graph application client through a graph management channel by adopting a synthesis manager, and applying the graph cache drawn by at least one graph application client to a window management request sent by at least one graph application client to obtain a synthesized graph window; acquiring an input event from a kernel by adopting an input manager, and sending the kernel input event to a corresponding graphic application client through an input management channel according to a window focus determined by a window manager; the synthesized graphical window is output to at least one display device with an output manager.
In an embodiment, the graphical display method based on the wayland protocol provided in the embodiment of the present application further includes, on the basis of fig. 4: a message manager is adopted to provide a message transmission channel among the window manager, the synthesis manager, the input manager and the output manager; resource allocation of the window manager, the composition manager, the input manager and the output manager, and resource allocation of the input management channel, the window management channel and the graphic management channel are managed by adopting a resource manager.
In an embodiment, in the graphical display method based on the wayland protocol provided in the embodiment of the present application, on the basis of fig. 4, a window manager is used to perform unified calculation on the display window of at least one graphical application client, determine a top-layer visible display window, and notify, through a window management channel, the graphical application client corresponding to an invisible window to suspend graphical drawing.
Fig. 5 is a schematic structural diagram of a graphical display composition end based on the wayland protocol according to an embodiment, and as shown in fig. 5, the graphical display composition end based on the wayland protocol according to the embodiment includes:
a window manager 51, a composition manager 52, an input manager 53, an output manager 54, a message manager 55, and a resource manager 56.
The window manager 51 is connected with at least one graphic application client through a window management channel, and is configured to allocate a window to the at least one graphic application client, determine a window focus, and receive a window management request sent by the at least one graphic application client; the composition manager 52 is connected to at least one graphics application client through a graphics management channel, and is configured to receive a graphics cache drawn by the at least one graphics application client, and apply the graphics cache drawn by the at least one graphics application client to a window management request sent by the at least one graphics application client, so as to obtain a synthesized graphics window; the input manager 53 is connected with at least one graphic application client through an input management channel, and is configured to obtain an input event from the kernel, and send the kernel input event to the corresponding graphic application client according to the window focus determined by the window manager 51; the output manager 54 is for outputting the graphic window synthesized by the synthesis manager 52 to at least one display device; the message manager 55 is used for providing a transmission message channel among the window manager 51, the composition manager 52, the input manager 53 and the output manager 54; the resource manager 56 is for managing resource allocation of the window manager 51, composition manager 52, input manager 53, and output manager 54, and resource allocation of the input management channel, window management channel, and graphic management channel.
The graphical display composition end based on the wayland protocol provided by the embodiment may be the graphical display composition end in the embodiment shown in fig. 3.
In an embodiment, the window manager 51 is further configured to perform unified computation on the display windows of at least one graphics application client, determine a top-layer visible display window, and notify the graphics application client corresponding to the invisible window to suspend graphics drawing through the window management channel.
Embodiments of the present application also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, perform a method for graphics compositing based on the wayland protocol, the method comprising: acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graphic application client corresponding to the window focus through an input management channel; receiving a window management request sent by at least one graphic application client through a window management channel; receiving a graphic cache drawn by at least one graphic application client through a graphic management channel, and applying the graphic cache drawn by at least one graphic application client to a window management request sent by at least one graphic application client to obtain a synthesized graphic window; the synthesized graphical window is output to at least one display device.
The above description is only exemplary embodiments of the present application, and is not intended to limit the scope of the present application.
It will be clear to a person skilled in the art that the term user terminal covers any suitable type of wireless user equipment, such as a mobile phone, a portable data processing device, a portable web browser or a car mounted mobile station.
In general, the various embodiments of the application may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the application is not limited thereto.
Embodiments of the application may be implemented by a data processor of a mobile device executing computer program instructions, for example in a processor entity, or by hardware, or by a combination of software and hardware. The computer program instructions may be assembly instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages.
Any logic flow block diagrams in the figures of this application may represent program steps, or may represent interconnected logic circuits, modules, and functions, or may represent a combination of program steps and logic circuits, modules, and functions. The computer program may be stored on a memory. The memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as, but not limited to, Read-Only Memory (ROM), Random-Access Memory (RAM), optical storage devices and systems (Digital versatile disks (DVD), Compact Disks (CD)), etc., computer-readable media can comprise non-transitory storage media, data processors can be of any type suitable to the local technical environment, such as, but not limited to, general purpose computers, special purpose computers, microprocessors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Programmable logic devices (FGPAs), and processors based on a multi-core processor architecture.
Claims (10)
1. A graphics synthesis method based on the WAYLAND protocol is applied to a graphics display synthesis end and is characterized by comprising the following steps:
acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graphic application client corresponding to the window focus through an input management channel;
receiving a window management request sent by at least one graphic application client through a window management channel;
receiving a graphic cache drawn by the at least one graphic application client through a graphic management channel, and applying the graphic cache drawn by the at least one graphic application client to a window management request sent by the at least one graphic application client to obtain a synthesized graphic window;
outputting the synthesized graphical window to at least one display device.
2. The method of claim 1, further comprising:
adopting a graphic manager to distribute a window for the at least one graphic application client, determining a window focus, and receiving a window management request sent by the at least one graphic application client through the window management channel;
receiving a graph cache drawn by the at least one graph application client through the graph management channel by adopting a synthesis manager, and applying the graph cache drawn by the at least one graph application client to a window management request sent by the at least one graph application client to obtain a synthesized graph window;
acquiring an input event from a kernel by adopting an input manager, and sending the kernel input event to a corresponding graphic application client through an input management channel according to a window focus determined by the window manager;
the synthesized graphical window is output to at least one display device with an output manager.
3. The method of claim 2, further comprising:
a message manager is adopted to provide a message transmission channel among the window manager, the composition manager, the input manager and the output manager;
and managing the resource allocation of the window manager, the synthesis manager, the input manager and the output manager and the resource allocation of the input management channel, the window management channel and the graphic management channel by adopting a resource manager.
4. The method of claim 2 or 3, further comprising:
and adopting a window manager to perform unified calculation on the display windows of the at least one graphic application client, determining a top-layer visible display window, and informing the graphic application client corresponding to the invisible window to suspend graphic drawing through the window management channel.
5. A graphical display compositing end based on the wayland protocol, comprising:
a window manager, a composition manager, an input manager, an output manager, a message manager, and a resource manager;
the window manager is connected with the at least one graphic application client through a window management channel and used for distributing a window for the at least one graphic application client, determining a window focus and receiving a window management request sent by the at least one graphic application client;
the synthesis manager is connected with the at least one graph application client through a graph management channel and used for receiving a graph cache drawn by the at least one graph application client and applying the graph cache drawn by the at least one graph application client to a window management request sent by the at least one graph application client to obtain a synthesized graph window;
the input manager is connected with the at least one graphic application client through an input management channel and used for acquiring an input event from a kernel and sending the kernel input event to the corresponding graphic application client according to the window focus determined by the window manager;
the output manager is used for outputting the graphic window synthesized by the synthesis manager to at least one display device;
the message manager is used for providing a transmission message channel among the window manager, the composition manager, the input manager and the output manager;
the resource manager is used for managing the resource allocation of the window manager, the composition manager, the input manager and the output manager, and the resource allocation of the input management channel, the window management channel and the graphic management channel.
6. The wayland protocol based graphical display compositing terminal according to claim 5, wherein the window manager is further configured to perform unified computation on the display windows of the at least one graphical application client, determine a top-layer visible display window, and notify a graphical application client corresponding to an invisible window to suspend graphical drawing through the window management channel.
7. A graphical display system based on the wayland protocol, comprising: the system comprises a graphic display synthesis end and at least one graphic application client;
the input management channel, the window management channel and the graphic management channel are arranged between the graphic display synthesis end and the at least one graphic application client;
the graphic display synthesis end is used for acquiring a kernel input event, calculating a window focus according to the kernel input event, and sending the kernel input event to a graphic application client corresponding to the window focus through the input management channel; receiving a window management request sent by the at least one graphic application client through the window management channel; receiving a graphic cache drawn by the at least one graphic application client through the graphic management channel, and applying the graphic cache drawn by the at least one graphic application client to a window management request sent by the at least one graphic application client to obtain a synthesized graphic window; outputting the synthesized graphical window to at least one display device;
and the graphic application client is used for drawing a graphic cache according to the kernel input event, acquiring a window adjusting instruction input by a user, redrawing the graphic cache according to the window adjusting instruction and generating the window management request.
8. The system of claim 7, wherein the graphical display composition side comprises a window manager, a composition manager, an input manager, and an output manager;
the window manager is connected with the at least one graphic application client through the window management channel and used for distributing a window for the at least one graphic application client, determining a window focus and receiving a window management request sent by the at least one graphic application client;
the synthesis manager is connected with the at least one graph application client through the graph management channel and used for receiving a graph cache drawn by the at least one graph application client and applying the graph cache drawn by the at least one graph application client to a window management request sent by the at least one graph application client to obtain a synthesized graph window;
the input manager is connected with the at least one graphic application client through the input management channel and is used for acquiring an input event from a kernel and sending the kernel input event to the corresponding graphic application client according to the window focus determined by the window manager;
the output manager is used for outputting the graphic window synthesized by the synthesis manager to at least one display device.
9. The system of claim 8, wherein the graphical display composition side further comprises a message manager and a resource manager;
the message manager is used for providing a transmission message channel among the window manager, the composition manager, the input manager and the output manager;
the resource manager is used for managing the resource allocation of the window manager, the composition manager, the input manager and the output manager, and the resource allocation of the input management channel, the window management channel and the graphic management channel.
10. The system according to claim 8 or 9, wherein the window manager is further configured to perform unified computation on the display windows of the at least one graphics application client, determine a top-level visible display window, and notify a graphics application client corresponding to an invisible window to suspend graphics drawing through the window management channel.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910878092.6A CN112527219A (en) | 2019-09-17 | 2019-09-17 | Graphics synthesis method, device and system based on WAYLAND protocol |
| PCT/CN2020/110345 WO2021052100A1 (en) | 2019-09-17 | 2020-08-20 | Wayland protocol-based graphics compositing method, apparatus and system, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910878092.6A CN112527219A (en) | 2019-09-17 | 2019-09-17 | Graphics synthesis method, device and system based on WAYLAND protocol |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112527219A true CN112527219A (en) | 2021-03-19 |
Family
ID=74883334
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910878092.6A Pending CN112527219A (en) | 2019-09-17 | 2019-09-17 | Graphics synthesis method, device and system based on WAYLAND protocol |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112527219A (en) |
| WO (1) | WO2021052100A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113467666A (en) * | 2021-09-06 | 2021-10-01 | 北京鲸鲮信息系统技术有限公司 | Method and device for adjusting application window |
| CN113672321A (en) * | 2021-07-26 | 2021-11-19 | 中标软件有限公司 | Implementation method of lightweight wayland synthesizer supporting client window coordinates |
| CN115131488A (en) * | 2022-08-31 | 2022-09-30 | 麒麟软件有限公司 | Method and system for managing display cache in wayland graphic display environment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9396001B2 (en) * | 2010-11-08 | 2016-07-19 | Sony Corporation | Window management for an embedded system |
| CN103268620A (en) * | 2013-04-28 | 2013-08-28 | 华为技术有限公司 | Graphic processing method, graphic processing device and terminal device |
| CN105701037B (en) * | 2015-12-30 | 2019-09-17 | 惠州市德赛西威汽车电子股份有限公司 | Weston and DRM accesses the system and method for display controller simultaneously in vehicle entertainment system |
| CN107292807B (en) * | 2016-03-31 | 2020-12-04 | 阿里巴巴集团控股有限公司 | Graph synthesis method, window setting method and system |
| CN107436760A (en) * | 2017-06-30 | 2017-12-05 | 百度在线网络技术（北京）有限公司 | Multiwindow rendering intent and device |
-
2019
- 2019-09-17 CN CN201910878092.6A patent/CN112527219A/en active Pending
-
2020
- 2020-08-20 WO PCT/CN2020/110345 patent/WO2021052100A1/en active Application Filing
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113672321A (en) * | 2021-07-26 | 2021-11-19 | 中标软件有限公司 | Implementation method of lightweight wayland synthesizer supporting client window coordinates |
| CN113672321B (en) * | 2021-07-26 | 2023-08-22 | 中标软件有限公司 | Implementation method of lightweight wayside synthesizer supporting client window coordinates |
| CN113467666A (en) * | 2021-09-06 | 2021-10-01 | 北京鲸鲮信息系统技术有限公司 | Method and device for adjusting application window |
| CN113467666B (en) * | 2021-09-06 | 2021-11-16 | 北京鲸鲮信息系统技术有限公司 | Method and device for adjusting application window |
| CN115131488A (en) * | 2022-08-31 | 2022-09-30 | 麒麟软件有限公司 | Method and system for managing display cache in wayland graphic display environment |
| CN115131488B (en) * | 2022-08-31 | 2022-11-29 | 麒麟软件有限公司 | Method and system for managing display cache in wayland graphic display environment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021052100A1 (en) | 2021-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3751418B1 (en) | Resource configuration method and apparatus, terminal, and storage medium | |
| WO2021052100A1 (en) | Wayland protocol-based graphics compositing method, apparatus and system, and computer-readable storage medium | |
| TW201040834A (en) | Peer-to-peer dynamically appendable logical displays | |
| EP2624611A1 (en) | Method and system for visualizing an adaptive screen according to a terminal | |
| EP3985658A1 (en) | Information display method and apparatus | |
| EP3133481B1 (en) | Terminal device display method and terminal device | |
| KR20130096059A (en) | Displaying method of remote sink device, source device and system for the same | |
| CN108415772B (en) | Container-based resource adjustment method, device and medium | |
| CN104461052B (en) | Character input method and device between smart machine | |
| EP2849080A1 (en) | Image display method and device | |
| US8860740B2 (en) | Method and apparatus for processing a display driver in virture desktop infrastructure | |
| CN114116092A (en) | Cloud desktop system processing method, cloud desktop system control method and related equipment | |
| WO2017206893A1 (en) | Interface refresh synchronization method and apparatus, terminal, and storage medium | |
| CN113094015A (en) | Holographic multi-screen display implementation method and system, computer equipment and storage medium | |
| CN114265648B (en) | Code scheduling method, server, client and system for acquiring remote desktop | |
| CN113313623A (en) | Watermark information display method, watermark information display device, electronic equipment and computer readable medium | |
| US20230068162A1 (en) | Method of displaying information, electronic device and storage medium | |
| CN109831673B (en) | Live broadcast room data processing method, device, equipment and storage medium | |
| CN115373618B (en) | Multi-screen display method and device, vehicle machine and storage medium | |
| US20120038654A1 (en) | Computer system and related graphics apparatus, display apparatus, and computer program product | |
| CN104571982B (en) | Ultrahigh resolution display system and display control method | |
| CN115866156A (en) | Data processing method and device, electronic equipment and storage medium | |
| EP3974976A1 (en) | Facilitation of guest application display from host operating system | |
| CN109471574B (en) | Method and device for configuring resources | |
| KR20220056645A (en) | Method for controlling virtual multi screen, method for sending and receiving virtual environment, and apparatus implementing the same method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |