CN113448662A - Window image display method, device and storage medium - Google Patents
Window image display method, device and storage medium Download PDFInfo
- Publication number
- CN113448662A CN113448662A CN202010227945.2A CN202010227945A CN113448662A CN 113448662 A CN113448662 A CN 113448662A CN 202010227945 A CN202010227945 A CN 202010227945A CN 113448662 A CN113448662 A CN 113448662A
- Authority
- CN
- China
- Prior art keywords
- window
- image
- server
- display
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000004044 response Effects 0.000 claims abstract description 4
- 230000006870 function Effects 0.000 claims description 11
- 230000002194 synthesizing effect Effects 0.000 claims description 8
- 238000012544 monitoring process Methods 0.000 claims description 6
- 238000009877 rendering Methods 0.000 abstract description 27
- 238000012545 processing Methods 0.000 description 24
- 238000013461 design Methods 0.000 description 22
- 230000008569 process Effects 0.000 description 8
- 230000003993 interaction Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000015572 biosynthetic process Effects 0.000 description 5
- 238000003786 synthesis reaction Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the application provides a window image display method, equipment and a storage medium, which are applied to a client and a server which are created based on a WAYLAND protocol, wherein the method comprises the following steps: the client generates a window object in response to a received input event for requesting image display; the client generates a window surface corresponding to the window object, wherein the window surface is a frame model containing an image to be rendered; based on the window surface, the client renders the image to be rendered and caches the image in a preset memory; and the server reads the rendered images from the preset memory, synthesizes the rendered images, and sends the synthesized images to the terminal for display. The problem that the rendering and displaying speed of the window image is slow in the prior art cannot be solved is solved, and therefore user experience is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of computer images, in particular to a window image display method, window image display equipment and a storage medium.
Background
With the development of science and technology, in the image rendering and display technology, an X Window System (also commonly referred to as X11 or X) is adopted in the conventional technology. The system is a software window system which is displayed in a bitmap mode. The X window system creates a graphical user interface used by the operating system through software tools and architecture protocols, and then gradually expands and adapts to other operating systems of various types. Almost all operating systems now support and use the X-windowing system. The current mainstream desktop environments, GNOME and KDE, are also built based on the X-window system.
Among the entities developed and written according to the standard architecture of the X window system, x.org is the most common. The agreement version used for X. org is X11. The latest reference implementation version is X11Release 7.6 (abbreviation: X11R7.6). However, based on the image rendering and displaying principle of the X window system, in the process of rendering and displaying the object image, the server and the synthesizer in the architecture protocol frequently interact and transfer data, resulting in a slow rendering and displaying speed of the window image.
Therefore, the problem of slow rendering and displaying speed of the window image cannot be solved in the prior art, and user experience is further influenced.
Disclosure of Invention
The embodiment of the application provides a window image display method, a device and a storage medium, which are used for overcoming the problem that the rendering and displaying speed of a window image in the prior art is low, and further improving user experience.
In a first aspect, an embodiment of the present application provides a window image display method, which is applied to a client and a server created based on a wayland protocol, and the method includes:
the client generates a window object in response to a received input event for requesting image display;
the client generates a window surface corresponding to the window object, wherein the window surface is a frame model containing an image to be rendered;
based on the window surface, the client renders the image to be rendered and caches the image in a preset memory;
and the server reads the rendered images from the preset memory, synthesizes the rendered images, and sends the synthesized images to the terminal for display.
In one possible design, creating the server based on the wayland protocol includes:
generating display of a service end to be created based on the wayland protocol;
acquiring epoll _ fd of the server to be created, wherein the server to be created supports the function of monitoring the fd of the client;
generating a socket of a server to be created based on the wayland protocol;
adding the monitored fd of the client to the epoll _ fd of the server to be created through the socket;
and controlling the server to be created to register and provide the service for the client to use according to the added epoll _ fd of the server to be created, and generating the server.
In one possible design, based on the wayland protocol, the server side has a synthesizer built in; the synthesizing the rendered image includes:
and the synthesizer in the server synthesizes the rendered images.
In a possible design, an input event for requesting to display an image corresponds to one window object, and if there are a plurality of rendered images, the corresponding input event is a plurality of input events and the corresponding window objects are a plurality of window objects;
the step of synthesizing the rendered image by a synthesizer in the server side comprises the following steps:
the client determines the image display priority according to image display requests in a plurality of input events sent by the terminal;
and the synthesizer in the server arranges the rendered images according to the sequence from high to low, and merges the views of the sequenced corresponding window objects into a sequence.
In one possible design, the generating the window object includes:
the client calls the display to connect with the server, and acquires a display object corresponding to the client through the server;
the client acquires the current service through the display object;
and the client generates the window object through a window manager according to the current service.
In one possible design, the client generates a window surface corresponding to the window object, including:
the client acquires a display resolution corresponding to the image to be rendered and a gray image of the image to be rendered;
and the client generates the window surface according to the display resolution and the gray level image.
In one possible design, the sending the synthesized image to a terminal for display includes:
generating a display window through the window manager according to the synthesized image;
and the server sends the synthesized image to a terminal through the display window and displays the synthesized image.
In one possible design, the method further includes:
the client updates the display window through the synthesizer in the server; alternatively, the first and second electrodes may be,
and the client establishes a shared memory through the server to update the display window.
In a second aspect, an embodiment of the present application provides a window image display apparatus, including: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executes computer-executable instructions stored by the memory to cause the at least one processor to perform the method of displaying window images as described above in the first aspect and various possible designs of the first aspect.
In a third aspect, an embodiment of the present application provides a computer-readable storage medium, where computer-executable instructions are stored, and when a processor executes the computer-executable instructions, the method for displaying a window image is implemented as described in the first aspect and various possible designs of the first aspect.
The window image display method, the device and the storage medium provided by the embodiment are applied to a client and a server which are created based on the wayland protocol, and firstly, the client responds to a received input event for requesting image display to generate a window object; the client generates a window surface corresponding to the window object, wherein the window surface is a frame model containing an image to be rendered; based on the window surface, the client renders the image to be rendered and caches the image in a preset memory; and the server reads the rendered images from the preset memory, synthesizes the rendered images, and sends the synthesized images to the terminal for display. Therefore, the interactive communication between the client and the server is realized through the wayland protocol, the purposes of rendering, synthesizing and displaying the window image are further achieved, frequent interaction and data transmission of the server and a synthesizer (composer) in the prior art are reduced, the image rendering speed is greatly increased, and the user experience is further improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a window image display method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a window image display method according to yet another embodiment of the present application;
fig. 3 is a schematic flowchart of a window image display method according to another embodiment of the present application;
fig. 4 is a schematic flowchart of a window image display method according to another embodiment of the present application;
FIG. 5 is a schematic diagram of a hierarchy of a multi-window image display provided in an embodiment of the present application;
FIG. 6 is a diagram illustrating multi-window image view synthesis according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a window image display device according to an embodiment of the present application;
fig. 8 is a schematic hardware structure diagram of a window image display device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the prior art, the rendering and displaying principle of an X window system is as follows: 1) the kernel captures a mouse click event and sends the mouse click event to the server X server, and the X server calculates the event and sends the event to a specific window. The application program sends a drawing request to the X server and triggers a button updating action; 2) the X server receives the drawing request and then sends the drawing request to the video driver for rendering and drawing; 3) the X server calculates an updating area and sends the updating area to a synthesizer composer; 4) the composer sends a message of the screen re-composition area to the X server; 5) the X server starts to calculate window overlapping, window clipping and the like; 6) the drawing of the image is started.
In the prior art, an X server in an X window system needs to calculate a window corresponding to an event, but the window position is controlled by a composer, and the X server cannot calculate the correct position of the composer after a special effect change is made. Thus, the application needs to send a drawing request to the X server, thereby increasing the image rendering time. After the X server receives the drawing request of the application program, it needs to calculate the updated area of the screen and send this message to the composer, which will further increase the time for a series of processes such as image rendering to be displayed to the user. In addition, the composer sends the message of the screen re-composition area to the X server, and the X server needs to perform unnecessary work such as window overlapping and window clipping, which increases the processing load of the system and reduces the system performance. Therefore, due to frequent interaction between the composer and the server, the whole rendering and displaying speed of the window image is slow and long, and the user experience is further influenced.
In order to solve the problems, the server side can be used as a synthesizer to realize functions such as image synthesis and the like through the client side and the server side which are established based on the wayland protocol, rendering and displaying of window images are realized, frequent interaction between the server side and the synthesizer is avoided, and then the image rendering and displaying speed is improved.
Specifically, the present embodiment provides a window image display method, which is implemented based on the wayland protocol, wherein a client and a server that implement rendering and displaying of a window image are created based on the wayland protocol. The service end created based on the WAYLAND protocol configures the functions of the synthesizer at the service end, so that the service end can carry the functions of the synthesizer. In practical applications, the wayland can serve as a display server, and the internal architecture can include multiple layers, wherein the wayland architecture can include a client and a server.
The following describes the technical solutions of the present application and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 1 is a schematic flowchart of a window image display method according to an embodiment of the present application. As shown in fig. 1, the method may include:
s101, the client side responds to the received input event for requesting image display, and generates a window object.
In this embodiment, taking a browser as an example, when a user clicks a link while using the browser, that is, an application layer, initiates an image display request, that is, an input event for requesting image display, and then a client created based on the wayland protocol receives the input event, and for the input event, the client creates a window object.
In a possible design, the present embodiment details the creation process of the server based on the above-described embodiment, for example, based on the embodiment illustrated in fig. 1. Creating the server based on the wayland protocol, comprising the steps of:
step a1, generating display of a service end to be created based on the wayland protocol;
a2, acquiring epoll _ fd of the to-be-created server, wherein the to-be-created server supports the function of monitoring fd of the client;
step a3, generating a socket of a service end to be created based on the wayland protocol;
step a4, adding the monitored fd of the client to the epoll _ fd of the server to be created through the socket;
step a5, controlling the service end to be created to register and provide for the service used by the client according to the added epoll _ fd of the service end to be created, and generating the service end.
Based on the WAYLAND protocol, a synthesizer is arranged in the service end; the synthesizing the rendered image includes: and the synthesizer in the server synthesizes the rendered images. In this embodiment, when the server is started, the server display is first created, and the client may communicate with the server by calling the display (display: display handle). Then, obtaining epoll _ fd (epoll _ fd: event monitoring file descriptor) of the server, wherein the server can monitor fd (fd: file descriptor) of the client; adding fd of the client monitored by the server into epoll _ fd of the server by creating a socket (socket: socket) of the server, registering the server to be created based on epoll _ fd of the server according to the server added with fd of the client, providing the service used by the client, generating the server, and further starting the server. The server has a monitoring function and a service function, so that the functions of the synthesizer and the server in the prior art are integrated, and the synthesizer and the server are two separate architecture layers in the prior art, so that the time of frequent interaction between the synthesizer and the server in the rendering display process can be reduced, and the image rendering display time is prolonged.
In a possible design, how a client generates a window object is shown in fig. 2, where fig. 2 is a schematic flow chart of a window image display method according to still another embodiment of the present application, and this embodiment describes, in detail, S101 on the basis of the above-described embodiment, for example, on the basis of the embodiment described in fig. 1. The generating a window object includes:
s201, the client calls the display to connect with the server, and a display object corresponding to the client is obtained through the server;
s202, the client acquires the current service through the display object;
s203, the client generates the window object through a window manager according to the current service.
In this embodiment, the client calls the display connection server, then obtains the display object of the client through the server, obtains the current service through the display object, such as creating a window, and then creates a display window through the window manager, that is, where the image object is displayed.
S102, the client generates a window surface corresponding to the window object, and the window surface is a frame model containing an image to be rendered.
In this embodiment, according to the window object, the client creates a frame model, i.e., a window surface, containing the image to be rendered on the window object.
In a possible design, how to generate a window surface, see fig. 3, fig. 3 is a schematic flow chart of a window image display method according to another embodiment of the present application, and this embodiment describes S102 in detail on the basis of the above-described embodiment, for example, on the basis of the embodiment described in fig. 1. The client generates a window surface corresponding to the window object, including:
s301, the client side obtains a display resolution corresponding to the image to be rendered and a gray image of the image to be rendered;
and S302, the client generates the window surface according to the display resolution and the gray level image.
In this embodiment, the client first obtains a display resolution corresponding to an image to be rendered and a grayscale image with a rendered image. The display resolution is determined according to the size of the browser or the display end, the display resolution is carried when an image display request is sent by the application layer, namely an input event is triggered, and if the display resolution is not carried, the browser can default to the size.
According to the size of the display resolution, a window frame matched with the display resolution and the gray level image can be selected from a preset library, and then the gray level image is synthesized in the window frame based on the window frame to claim the window surface. Therefore, the window surface contains a grayscale image of the image to be rendered.
Specifically, the window surface may also be created by a synthesizer at the server, and the specific process includes: the client calls a display connection server, acquires a display object of the client through the server, acquires a current service through the display object, creates an image surface, namely a window surface, through an image synthesizer, and creates a display window through a window manager.
S103, based on the window surface, the client renders the image to be rendered and caches the image in a preset memory.
In this embodiment, the window surface includes an image to be rendered, the client renders the image to be rendered on the window surface, a local memory is provided locally after the client renders the image, and the client caches the rendered image in the provided local memory, that is, a preset memory.
And S104, the server reads the rendered images from the preset memory, synthesizes the rendered images, and sends the synthesized images to a terminal for displaying.
In the embodiment, after the client caches the rendered image in the local memory, the server reads the rendered image from the preset memory, and then the server can synthesize the image rendered by the client directly through the function of the synthesizer built in the server without sending the image to the synthesizer, so that the synthesizer is controlled to synthesize the image, and the time of the whole rendering process is reduced.
In practical application, an application layer initiates an image display request, a client creates a window image object, namely a window object, according to the display request, then the client obtains an image display resolution, according to the image display resolution, the client creates a local window surface, then based on the window surface, the client performs image rendering and image caching on the rendered image, a server reads the cached image and performs image synthesis through a synthesizer of the server, then the server sends the synthesized image to a display terminal for image display, wherein the display terminal can be a terminal, for example, the display terminal is displayed to a user through a browser.
Specifically, wayland is a display server, all rendering of the wayland occurs in a client, the client calculates an area needing to be rendered by itself after receiving an input event, then a shared space is opened up in a memory, a drawn image is placed in a cache, then an image synthesizer composer of the wayland is notified, and after receiving the information, the composer only needs to compose the drawn image of the client and send the drawn image to a renderer for rendering without requesting the wayland. Therefore, frequent interaction and data transmission between the server and the composer are reduced, and the image rendering speed is greatly improved.
The method is applied to a client and a server which are established based on the WAYLAND protocol, and comprises the steps that firstly, the client responds to a received input event for requesting image display to generate a window object; the client generates a window surface corresponding to the window object, wherein the window surface is a frame model containing an image to be rendered; based on the window surface, the client renders the image to be rendered and caches the image in a preset memory; and the server reads the rendered images from the preset memory, synthesizes the rendered images, and sends the synthesized images to the terminal for display. Therefore, the interactive communication between the client and the server is realized through the wayland protocol, the purposes of rendering, synthesizing and displaying the window image are further achieved, frequent interaction and data transmission of the server and a synthesizer (composer) in the prior art are reduced, the image rendering speed is greatly increased, and the user experience is further improved.
In a possible design, how to combine the images is shown in fig. 4, where fig. 4 is a schematic flowchart of a window image display method according to another embodiment of the present application. The present embodiment describes in detail how to perform image synthesis based on the above-described embodiment, for example, based on the embodiment described in fig. 1. Wherein, an input event for requesting to display an image corresponds to a window object, if the rendered images are multiple, the corresponding input event is multiple and the corresponding window object is multiple; the step of synthesizing the rendered image by a synthesizer in the server side comprises the following steps:
s401, the client determines image display priority according to image display requests in a plurality of input events sent by a terminal;
s402, arranging the rendered images according to a sequence from high to low by a synthesizer in the server, and combining the views of the window objects which correspond to the sequence into a sequence.
In practical application, when a plurality of images need to be rendered, the client arranges each image in sequence from high to low according to the requirement of an application layer. As shown in fig. 5, fig. 5 shows the multi-window image display hierarchy, where OSD Layer 2 is the highest image display Layer, OSD Layer 1 is the middle image display Layer, OSD Layer 0 is the lowest image display Layer, and the image view directions are, from top to bottom, OSD Layer 2, OSD Layer 1, and OSD Layer 0 in this order.
Specifically, the multi-window image view composition may include:
the OSD Layer 2 respectively comprises an image View View 2, an image View View 1 and an image View View 0; the OSD Layer 1 comprises an image View View 1 and an image View View 0 respectively; the OSD Layer 0 contains an image View 0. When the image display layer comprises a plurality of image views, the client-side sequentially arranges the image views according to the caching sequence of each image view, and combines the views of all window image display levels into a sequence. Namely: see fig. 6 for a schematic illustration of multi-window image view synthesis.
And combining the three window images of the OSD Layer 2, the OSD Layer 1 and the OSD Layer 0 into an image sequence, wherein the combined image sequence is the OSD Layer 0View 0, the OSD Layer 1View 1, the OSD Layer 2View 0, the OSD Layer 2View 1 and the OSD Layer 2View 2 in sequence.
In a possible design, how to transmit and display the synthesized image, the present embodiment explains the transmission and display of the synthesized image in detail on the basis of the above-described embodiments. The sending the synthesized image to the terminal for displaying may include the following steps:
b1, generating a display window through the window manager according to the synthesized image;
and b2, the server sends the synthesized image to a terminal through the display window and displays the synthesized image.
In this embodiment, the client calls a display connection server, obtains a display object of the client through the server, obtains a current service through the display object, creates a display window through a window manager based on the current service, and sends and displays the synthesized image to the terminal through the display window. Therefore, frequent interaction and data transmission between the server and the composer are reduced, and the speed of displaying the image to the user is greatly improved
In one possible design, the client may perform the window update through the image compositor of the server (i.e., the compositor of the server). That is, the client updates the display window through the compositor in the server, the method may include the following steps:
the client calls a display connection server, acquires a display object of the client through the server, acquires a current service through the display object, creates an image surface (namely a window surface) through an image synthesizer of the server based on the current service, and creates (updates) a display window through a window manager based on the window surface.
In a possible design, a client may update a window through a server-side shared memory, that is, the client creates a shared memory through the server-side to update the display window, which may include the following steps:
firstly, a client calls a display connection server, a display object of the client is obtained through the server, then a current service is obtained through the display object, then a shared memory pool is created through a shared memory service, an image cache region is created through the shared memory pool, the image cache region is bound to an image surface (namely a window surface) through an image synthesizer, and then a display window is created (updated) through a window manager.
Fig. 7 is a schematic structural diagram of a window image display device according to an embodiment of the present application, corresponding to the window image display method according to the foregoing embodiment. For convenience of explanation, only portions related to the embodiments of the present application are shown. As shown in fig. 7, the window image display device 70 includes: a first module 701 and a second module 702. The first processing module and the second processing module are both created based on the wayland protocol, and the first processing module and the second processing module communicate based on the wayland protocol. The first processing module may be a client and the second processing module may be a server. Specifically, the first processing module 701 is configured to generate a window object in response to a received input event for requesting image display; generating a window surface corresponding to the window object, wherein the window surface is a frame model containing an image to be rendered; rendering the image to be rendered based on the window surface, and caching the image to be rendered in a preset memory; the second processing module 702 is configured to read a rendered image from the preset memory, synthesize the rendered image, and send the synthesized image to a terminal for display.
The apparatus provided in the embodiment of the present application may be configured to implement the technical solution of the method embodiment, and the implementation principle and the technical effect are similar, which are not described herein again in the embodiment of the present application.
In one possible design, the apparatus further includes: a second processing module creation module; the second processing module creating module is used for generating display of a service end to be created based on the wayland protocol; acquiring epoll _ fd of the server to be created, wherein the server to be created supports the function of monitoring the fd of the client; generating a socket of a server to be created based on the wayland protocol; adding the monitored fd of the first processing module to the epoll _ fd of the server to be created through the socket; and controlling the service to be created to register and provide for the service used by the first processing module according to the added epoll _ fd of the service to be created, and generating the second processing module.
In a possible design, an input event for requesting to display an image corresponds to one window object, and if there are a plurality of rendered images, the corresponding input event is a plurality of input events and the corresponding window objects are a plurality of window objects; the first processing module is specifically used for determining image display priority according to image display requests in a plurality of input events sent by the terminal; and the second processing module is specifically configured to arrange the rendered images according to a sequence from high to low, and merge the views of the window objects into a sequence.
In a possible design, the first processing module is specifically configured to invoke the display to connect to the server, and obtain, through the second processing module, a display object corresponding to the client; acquiring current service through the display object; and generating the window object through a window manager according to the current service.
In one possible design, the first processing module is specifically configured to obtain a display resolution corresponding to the image to be rendered and a grayscale image of the image to be rendered; and generating the window surface according to the display resolution and the gray level image.
In one possible design, the second processing module is specifically configured to generate, by the window manager, a display window according to the synthesized image; and sending the synthesized image to a terminal through the display window and displaying the synthesized image.
In one possible design, the first processing module is specifically configured to update the display window through the synthesizer in the second processing module; or, a shared memory is created through the second processing module, and the display window is updated.
The apparatus provided in the embodiment of the present application may be configured to implement the technical solution of the method embodiment, and the implementation principle and the technical effect are similar, which are not described herein again in the embodiment of the present application.
Fig. 8 is a schematic hardware structure diagram of a window image display device according to an embodiment of the present application. As shown in fig. 8, the present embodiment provides an apparatus 80 including: at least one processor 801 and a memory 802. The processor 801 and the memory 802 are connected by a bus 803.
In a specific implementation, at least one processor 801 executes computer-executable instructions stored by the memory 802, so that at least one processor 801 executes the method in the above-described method embodiments.
For a specific implementation process of the processor 801, reference may be made to the above method embodiments, which have similar implementation principles and technical effects, and details of this embodiment are not described herein again.
In the embodiment shown in fig. 8, it should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose processors, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.
The memory may comprise high speed RAM memory and may also include non-volatile storage NVM, such as at least one disk memory.
The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.
The embodiment of the invention also provides a computer-readable storage medium, wherein a computer execution instruction is stored in the computer-readable storage medium, and when a processor executes the computer execution instruction, the window image display method of the embodiment of the method is realized.
The computer-readable storage medium may be implemented by any type of volatile or non-volatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk. Readable storage media can be any available media that can be accessed by a general purpose or special purpose computer.
An exemplary readable storage medium is coupled to the processor such the processor can read information from, and write information to, the readable storage medium. Of course, the readable storage medium may also be an integral part of the processor. The processor and the readable storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the readable storage medium may also reside as discrete components in the apparatus.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A window image display method is applied to a client and a server which are created based on the WAYLAND protocol, and comprises the following steps:
the client generates a window object in response to a received input event for requesting image display;
the client generates a window surface corresponding to the window object, wherein the window surface is a frame model containing an image to be rendered;
based on the window surface, the client renders the image to be rendered and caches the image in a preset memory;
and the server reads the rendered images from the preset memory, synthesizes the rendered images, and sends the synthesized images to the terminal for display.
2. The method of claim 1, wherein creating the server based on the wayland protocol comprises:
generating display of a service end to be created based on the wayland protocol;
acquiring epoll _ fd of the server to be created, wherein the server to be created supports the function of monitoring the fd of the client;
generating a socket of a server to be created based on the wayland protocol;
adding the monitored fd of the client to the epoll _ fd of the server to be created through the socket;
and controlling the server to be created to register and provide the service for the client to use according to the added epoll _ fd of the server to be created, and generating the server.
3. The method according to claim 2, wherein based on the wayland protocol, the server is built-in with a synthesizer; the synthesizing the rendered image includes:
and the synthesizer in the server synthesizes the rendered images.
4. The method of claim 3, wherein an input event for requesting to display an image corresponds to one window object, and if the rendered image is plural, the corresponding input event is plural and the corresponding window object is plural;
the step of synthesizing the rendered image by a synthesizer in the server side comprises the following steps:
the client determines the image display priority according to image display requests in a plurality of input events sent by the terminal;
and the synthesizer in the server arranges the rendered images according to the sequence from high to low, and merges the views of the sequenced corresponding window objects into a sequence.
5. The method of claim 3, wherein the generating a window object comprises:
the client calls the display to connect with the server, and acquires a display object corresponding to the client through the server;
the client acquires the current service through the display object;
and the client generates the window object through a window manager according to the current service.
6. The method of any of claims 1-5, wherein the client generates a window surface corresponding to the window object, comprising:
the client acquires a display resolution corresponding to the image to be rendered and a gray image of the image to be rendered;
and the client generates the window surface according to the display resolution and the gray level image.
7. The method of claim 5, wherein sending the synthesized image to a terminal for display comprises:
generating a display window through the window manager according to the synthesized image;
and the server sends the synthesized image to a terminal through the display window and displays the synthesized image.
8. The method of claim 7, further comprising:
the client updates the display window through the synthesizer in the server; alternatively, the first and second electrodes may be,
and the client establishes a shared memory through the server to update the display window.
9. A window image display apparatus, comprising: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executing the computer-executable instructions stored by the memory causes the at least one processor to perform the window image display method of any one of claims 1 to 8.
10. A computer-readable storage medium having stored therein computer-executable instructions that, when executed by a processor, implement the window image display method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010227945.2A CN113448662A (en) | 2020-03-27 | 2020-03-27 | Window image display method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010227945.2A CN113448662A (en) | 2020-03-27 | 2020-03-27 | Window image display method, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113448662A true CN113448662A (en) | 2021-09-28 |
Family
ID=77807796
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010227945.2A Pending CN113448662A (en) | 2020-03-27 | 2020-03-27 | Window image display method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113448662A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113822962A (en) * | 2021-11-19 | 2021-12-21 | 北京鲸鲮信息系统技术有限公司 | Window information processing method and device, electronic equipment and storage medium |
| CN113946304A (en) * | 2021-09-29 | 2022-01-18 | 湖北亿咖通科技有限公司 | Visible window synthesis method and synthesis device and multi-screen system |
| CN113986372A (en) * | 2021-10-18 | 2022-01-28 | 北京鲸鲮信息系统技术有限公司 | Window plug-in configuration method, window data acquisition method and device |
| CN114020396A (en) * | 2021-11-18 | 2022-02-08 | 湖南麒麟信安科技股份有限公司 | Display method of application program and data generation method of application program |
| CN114090010A (en) * | 2021-10-12 | 2022-02-25 | 元心信息科技集团有限公司 | Transplanting method and device of X11 system, electronic equipment and readable storage medium |
| CN114115688A (en) * | 2021-11-23 | 2022-03-01 | 北京鲸鲮信息系统技术有限公司 | Method and device for suppressing display jitter, electronic equipment and storage medium |
| CN115131488A (en) * | 2022-08-31 | 2022-09-30 | 麒麟软件有限公司 | Method and system for managing display cache in wayland graphic display environment |
| CN115309315A (en) * | 2022-10-11 | 2022-11-08 | 麒麟软件有限公司 | Screenshot method, system and medium for X application in Wayland environment |
| WO2023109140A1 (en) * | 2021-12-14 | 2023-06-22 | 北京字节跳动网络技术有限公司 | Information processing method and apparatus, and electronic device and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1959349A (en) * | 2005-10-31 | 2007-05-09 | 株式会社电装 | Displaying device |
| CN107547474A (en) * | 2016-06-27 | 2018-01-05 | 中兴通讯股份有限公司 | A kind of graphic display method and equipment of heterogeneous dual system |
-
2020
- 2020-03-27 CN CN202010227945.2A patent/CN113448662A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1959349A (en) * | 2005-10-31 | 2007-05-09 | 株式会社电装 | Displaying device |
| CN107547474A (en) * | 2016-06-27 | 2018-01-05 | 中兴通讯股份有限公司 | A kind of graphic display method and equipment of heterogeneous dual system |
Non-Patent Citations (1)
| Title |
|---|
| 佚名: ""Vulkan Tutorial 08 交换链"", 《HTTPS://WWW.CNBLOGS.COM/HEITAO/P/6932912.HTML》 * |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113946304A (en) * | 2021-09-29 | 2022-01-18 | 湖北亿咖通科技有限公司 | Visible window synthesis method and synthesis device and multi-screen system |
| CN114090010A (en) * | 2021-10-12 | 2022-02-25 | 元心信息科技集团有限公司 | Transplanting method and device of X11 system, electronic equipment and readable storage medium |
| CN113986372A (en) * | 2021-10-18 | 2022-01-28 | 北京鲸鲮信息系统技术有限公司 | Window plug-in configuration method, window data acquisition method and device |
| CN114020396A (en) * | 2021-11-18 | 2022-02-08 | 湖南麒麟信安科技股份有限公司 | Display method of application program and data generation method of application program |
| CN113822962B (en) * | 2021-11-19 | 2022-03-18 | 北京鲸鲮信息系统技术有限公司 | Window information processing method and device, electronic equipment and storage medium |
| CN113822962A (en) * | 2021-11-19 | 2021-12-21 | 北京鲸鲮信息系统技术有限公司 | Window information processing method and device, electronic equipment and storage medium |
| CN114115688A (en) * | 2021-11-23 | 2022-03-01 | 北京鲸鲮信息系统技术有限公司 | Method and device for suppressing display jitter, electronic equipment and storage medium |
| WO2023093076A1 (en) * | 2021-11-23 | 2023-06-01 | 北京字节跳动网络技术有限公司 | Method and apparatus for suppressing display jitter, electronic device, and storage medium |
| CN114115688B (en) * | 2021-11-23 | 2023-08-01 | 北京字节跳动网络技术有限公司 | Method and device for inhibiting display jitter, electronic equipment and storage medium |
| WO2023109140A1 (en) * | 2021-12-14 | 2023-06-22 | 北京字节跳动网络技术有限公司 | Information processing method and apparatus, and electronic device and storage medium |
| CN115131488A (en) * | 2022-08-31 | 2022-09-30 | 麒麟软件有限公司 | Method and system for managing display cache in wayland graphic display environment |
| CN115131488B (en) * | 2022-08-31 | 2022-11-29 | 麒麟软件有限公司 | Method and system for managing display cache in wayland graphic display environment |
| CN115309315A (en) * | 2022-10-11 | 2022-11-08 | 麒麟软件有限公司 | Screenshot method, system and medium for X application in Wayland environment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113448662A (en) | Window image display method, device and storage medium | |
| US10353718B2 (en) | Providing access to a remote application via a web client | |
| US20100306066A1 (en) | Techniques for displaying an advertisement across multiple pages | |
| CN111708600A (en) | Page display method, device, equipment and computer readable storage medium | |
| US20060279578A1 (en) | Systems and methods for updating a frame buffer based on arbitrary graphics calls | |
| US20050246634A1 (en) | Synchronized sharing of a dynamically updated image | |
| JP2003526131A (en) | Method and apparatus for tailoring the appearance of a graphical user interface | |
| US20140208326A1 (en) | File presenting method and apparatus for a smart terminal | |
| JP2012511198A (en) | Optimize view element size to maximize most data found in multiple view element GUI | |
| JP2010524081A (en) | Local theme settings for remote applications | |
| US20020188672A1 (en) | Server-based computing environment | |
| CN113918366B (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| CN113050899B (en) | Method and system for directly displaying video and UI drm based on Wayland protocol | |
| CN114741044A (en) | Cross-operating environment display output sharing method based on heterogeneous rendering | |
| CN111367518A (en) | Page layout method and device, computing equipment and computer storage medium | |
| CN111079048B (en) | Page loading method and device | |
| JP5017687B2 (en) | Client device and program | |
| CN112843680A (en) | Picture display method and device, terminal equipment and storage medium | |
| JP2021064359A (en) | Web page processing method, web page processing device, electronic device, non-temporary computer-readable storage medium, and computer program | |
| CN110532494B (en) | User personalized configuration method and system of B/S application and computer equipment | |
| CN114697555B (en) | Image processing method, device, equipment and storage medium | |
| CN113536168B (en) | Component processing method and device | |
| CN111460342A (en) | Page rendering display method and device, electronic equipment and computer storage medium | |
| CN111913711B (en) | Video rendering method and device | |
| US7792921B2 (en) | Metadata endpoint for a generic service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221025 Address after: 83 Intekte Street, Devon, Netherlands Applicant after: VIDAA (Netherlands) International Holdings Ltd. Address before: No.02-2, 13th floor, building B2, phase 4.1, software industry, No.1, East Road, Donghu New Technology Development Zone, Wuhan, Hubei Province Applicant before: Hisense Electronic Technology (Wuhan) Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210928 |
|
| RJ01 | Rejection of invention patent application after publication |