CN110196716B - Graphic display method, graphic display device, electronic equipment and storage medium - Google Patents

Graphic display method, graphic display device, electronic equipment and storage medium Download PDF

Info

Publication number
CN110196716B
CN110196716B CN201810159945.6A CN201810159945A CN110196716B CN 110196716 B CN110196716 B CN 110196716B CN 201810159945 A CN201810159945 A CN 201810159945A CN 110196716 B CN110196716 B CN 110196716B
Authority
CN
China
Prior art keywords
user interface
graphical user
graphic
operation instruction
exa
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810159945.6A
Other languages
Chinese (zh)
Other versions
CN110196716A (en
Inventor
曹惠雄
王洪虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Loongson Technology Corp Ltd
Original Assignee
Loongson Technology Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Loongson Technology Corp Ltd filed Critical Loongson Technology Corp Ltd
Priority to CN201810159945.6A priority Critical patent/CN110196716B/en
Publication of CN110196716A publication Critical patent/CN110196716A/en
Application granted granted Critical
Publication of CN110196716B publication Critical patent/CN110196716B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/34Graphical or visual programming
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/38Creation or generation of source code for implementing user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/20Processor architectures; Processor configuration, e.g. pipelining
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The embodiment of the invention provides a graphic display method, a graphic display device, an electronic device and a storage medium, which are applied to a graphic user interface application program and comprise the following steps: registering an operation instruction in the graphic acceleration structure EXA driver; the operation instruction is executed by a graphics processor GPU; determining a rendering type of a graphical user interface application program when displaying an interface graphic of the graphical user interface application program; determining a target operation instruction based on the rendering type; and executing a target operation instruction by the GPU through the EXA drive control so as to display interface graphics of the graphical user interface application program. Because the operation instruction is driven and controlled by the EXA to be executed, compared with the prior art, the operation instruction does not need to be executed in the CPU, and the occupancy rate of the CPU can be effectively reduced, so that the graphic drawing performance is improved.

Description

Graphic display method, graphic display device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a graphics display method, a graphics display device, an electronic apparatus, and a storage medium.
Background
An embedded system is a specialized computer system that is part of an apparatus or electronic device. Typically, an embedded system is an embedded processor control board in which a control program is stored in a ROM (read only memory). Virtually all electronic devices with digital interfaces, such as watches, microwave ovens, video recorders, automobiles, etc., use embedded systems. With the increasing use of embedded systems, more and more users are placing higher demands on graphics systems.
Taking Qt as an example, qt is a cross-platform c++ graphical user interface application development framework. It may provide all the functionality required for an application developer to build an artistic level GUI (Graphical User Interface ). Qt is easily scalable and allows for true component programming. Since Qt can cross-platform, applications and user interfaces can be developed by using Qt and then deployed into an embedded operating system without having to re-write source code.
Currently, after the Qt drawing is completed, the graphics is copied by software mode implemented by a CPU (Central Processing Unit ) and is filled into a display buffer area for graphic display. Since the current implementation manner of Qt graphic display is to implement operations of copying, filling and the like through CPU software, these operations occupy resources of the CPU and are very inefficient.
Disclosure of Invention
In view of the above problems, embodiments of the present invention have been made to provide a graphic display method, a graphic display apparatus, an electronic device, and a storage medium that overcome or at least partially solve the above problems.
In order to solve the above problems, an embodiment of the present invention discloses a graphic display method applied to a graphic user interface application program, including:
registering an operation instruction in the graphic acceleration structure EXA driver; the operation instruction is executed by a graphics processor GPU;
determining a rendering type of a graphical user interface application program when displaying an interface graphic of the graphical user interface application program;
determining a target operation instruction based on the rendering type;
and executing a target operation instruction by the GPU through the EXA drive control so as to display interface graphics of the graphical user interface application program.
Optionally, before the step of determining the rendering type of the graphical user interface application program when displaying the graphic of the graphical user interface application program, the method further comprises:
binding the EXA driver and a preset graphical user interface graphical library.
Optionally, before the step of executing, by the EXA driver, the GPU with the target operation instruction to display the interface graphic of the gui application, the method further includes:
drawing interface graphics of the graphical user interface application program from the graphical user interface graphic library to a window buffer;
and sending the interface graph of the window buffer to a temporary buffer.
Optionally, the operation instruction includes a copy instruction, and the step of executing, by the EXA driver, the GPU to execute the target operation instruction to display the interface graphic of the graphical user interface application includes:
controlling the GPU to extract an interface graph from the temporary buffer area based on the copy instruction through the EXA driver;
the interface graphic is copied to a display buffer for display on a screen.
Optionally, the operation instruction includes a fill instruction, and the step of executing, by the EXA driver, the GPU to execute the target operation instruction to display the interface graphic of the graphical user interface application includes:
and controlling the GPU to fill background colors in blank areas of a screen based on the filling instruction through the EXA drive.
The embodiment of the invention also discloses a graphic display device of the graphic user interface application program, which is applied to the graphic user interface application program and comprises the following components:
the operation instruction registration module is used for registering an operation instruction in the graphic acceleration structure EXA driver; the operation instruction is executed by a graphics processor GPU;
a rendering type determining module, configured to determine a rendering type of a graphical user interface application program when an interface graphic of the graphical user interface application program is displayed;
a target operation instruction determining module for determining a target operation instruction based on the rendering type;
and the interface graphic display module is used for controlling the GPU to execute the target operation instruction through the EXA drive so as to display the interface graphic of the graphic user interface application program.
Optionally, the method further comprises:
and the binding module is used for binding the EXA driver and a preset graphical user interface graphical library.
Optionally, the method further comprises:
a first buffer module for drawing interface graphics of the graphical user interface application program from the graphical user interface graphic library to a window buffer;
and the second buffer module is used for sending the interface graph of the window buffer area to the temporary buffer area.
The embodiment of the invention also discloses an electronic device, which comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, and the one or more programs comprise instructions for:
registering an operation instruction in the graphic acceleration structure EXA driver; the operation instruction is executed by a graphics processor GPU;
determining a rendering type of a graphical user interface application program when displaying an interface graphic of the graphical user interface application program;
determining a target operation instruction based on the rendering type;
and executing a target operation instruction by the GPU through the EXA drive control so as to display interface graphics of the graphical user interface application program.
The embodiment of the invention also discloses a readable storage medium, which enables the electronic device to execute one or more of the graphic display methods when the instructions in the storage medium are executed by the processor of the electronic device.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the operation instruction executed by the GPU is registered in the EXA drive of the graphic acceleration structure, so that when the interface graphics of the graphical user interface application program are displayed and graphic rendering is carried out, the GPU can be controlled by the EXA drive to execute the corresponding target operation instruction to realize the display of the interface. Because the operation instruction is driven and controlled by the EXA to be executed, compared with the prior art, the operation instruction does not need to be executed in the CPU, and the occupancy rate of the CPU can be effectively reduced, so that the graphic drawing performance is improved.
Drawings
FIG. 1 is a flow chart of the steps of an embodiment 1 of a graphical display method of the present invention;
FIG. 2 is a flow chart of the steps of an embodiment 2 of a graphical display method of the present invention;
FIG. 3 is a basic flow diagram of a graphical display of an embedded Qt application prior to modification;
FIG. 4 is a basic flow diagram of a graphical display of an improved embedded Qt application;
FIG. 5 is a block diagram of an embodiment of a graphics display device of the present invention;
fig. 6 is a block diagram illustrating a configuration of an electronic device for graphic display according to an exemplary embodiment.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
Referring to fig. 1, a flowchart illustrating steps of an embodiment 1 of a graphical display method of the present invention, applied to a graphical user interface application program, may specifically include the steps of:
step 101, registering an operation instruction in a graphic acceleration structure EXA driver; the operating instructions are executed by a graphics processor GPU.
It should be noted that, the embodiment of the present invention is applied to a gui application program, such as a QT application program, and of course, when implementing the embodiment of the present invention, the embodiment of the present invention may also be applied to other gui application programs, which need not be limited thereto.
In a specific implementation, the EXA (Extension XPree 86Acceleration Architecture) driver is an interface between a display card and an X window system in a Linux graphics system, is an interface layer for realizing GPU hardware acceleration of the Linux graphics system, works under an Xserver (graphics interface server) in the X window system and above a GPU (Graphics Processing Unit) driver of the display card, and the X window system realizes 2D display card acceleration of all Linux graphics systems through the EXA driver.
The 2D is also called a plane graph, the 2D graph content only has a horizontal X-axis and a vertical Y-axis, and the traditional manual cartoon and the picture of an application program interface belong to the 2D graph.
The GPU is also called a display core, a visual processor, and a display chip, and is a microprocessor that is specially used for image operation on electronic devices such as a personal computer, a workstation, a game console, a tablet computer, and a smart phone.
In the embodiment of the invention, when the device of the GPU is started, the EXA driver is initialized, and operation instructions, such as a copy instruction, a filling instruction, a combination instruction and the like, which are realized by the EXA driver and accelerated by GPU hardware are registered. Briefly, the operational instructions previously executed by the CPU are, in an embodiment of the invention, modified to be executed by the GPU.
Step 102, determining the rendering type of the graphical user interface application program when displaying the interface graph of the graphical user interface application program.
In the embodiment of the invention, when the interface graphics of the graphical user interface application program are displayed, the rendering type of the graphical user interface application program is required to be determined first, and different rendering types are realized by corresponding operation instructions.
Specifically, the rendering type may include copy, fill, combine, etc., and the operation instruction corresponding to the rendering type may include copy instruction, fill instruction, combine instruction, etc. It should be noted that the rendering types and the operation instructions described above are merely examples, and should not be construed as limiting the present invention when implementing the embodiments of the present invention.
Step 103, determining a target operation instruction based on the rendering type.
After determining the rendering type of the interface graphics displaying the graphical user interface application program, further determining that the operation instruction corresponding to the rendering type is implemented based on the rendering type.
And step 104, executing a target operation instruction by the EXA drive control GPU to display interface graphics of the graphical user interface application program.
After the target operation instruction is determined in the steps, the GPU can be controlled by the EXA drive to execute the target operation instruction, so that the accelerated display of the interface graphics is realized.
In the embodiment of the invention, the operation instruction executed by the GPU is registered in the EXA drive of the graphic acceleration structure, so that when the interface graphics of the graphical user interface application program are displayed and graphic rendering is carried out, the GPU can be controlled by the EXA drive to execute the corresponding target operation instruction to realize the display of the interface. Because the operation instruction is driven and controlled by the EXA to be executed, compared with the prior art, the operation instruction does not need to be executed in the CPU, and the occupancy rate of the CPU can be effectively reduced, so that the graphic drawing performance is improved.
Referring to fig. 2, a flowchart illustrating steps of embodiment 2 of a graphic display method according to the present invention may specifically include the following steps:
step 201, registering an operation instruction in a graphic acceleration structure EXA driver; the operating instructions are executed by a graphics processor GPU.
In the embodiment of the invention, the EXA driver is initialized, and the operation instruction which is realized by the EXA driver and is accelerated by the GPU hardware is registered.
Step 202, binding the EXA driver and a preset graphic user interface graphic library.
In practical applications, in addition to the initialization of the EXA driver, the initialization of the bottom layer of the graphical user interface is also required.
In the embodiment of the invention, the initialization of the bottom layer of the graphical user interface refers to binding operation instructions registered by the EXA driver. That is, when the graphics of the graphical user interface graphic library are invoked, display acceleration can be performed by invoking the EXA driver registered operation instruction. In addition, the graphical user interface graphic library also needs to be initialized. Specifically, necessary modules of the Gui module, the network module, and the like graphical user interface are initialized to be able to realize the desired functions.
Step 203, determining the rendering type of the graphical user interface application program when displaying the interface graphics of the graphical user interface application program.
Step 204, determining a target operation instruction based on the rendering type.
Step 205, graphically drawing an interface of the graphical user interface application program from the graphical user interface graphical library to a window buffer.
And 206, transmitting the interface graph of the window buffer to a temporary buffer.
And step 207, controlling the GPU to extract an interface graph from the time buffer based on the copy instruction through the EXA driver.
Step 208, the interface graphic is copied to a display buffer for display on a screen.
When the interface graphics of the graphical user interface application program are displayed, firstly, a drawing engine of a graphical user interface graphic library draws corresponding interface graphics to a window buffer area, then a scheduling and integrating mechanism in the graphical user interface integrates data of the window buffer area into a temporary buffer area, finally, an operating instruction realized by a GPU is driven by a mechanism of the graphical user interface through EXA, and the interface graphics of the temporary buffer area are copied to a display buffer area (i.e. a screen) for display.
In a preferred embodiment of the present invention, the GPU may be further controlled by the EXA driver to fill a background color in a blank area without a window on the screen based on the filling instruction.
In the embodiment of the invention, the link is established through the embedded graphical user interface and the EXA driver, and the operations of filling, copying and other resource consumption of the application program of the embedded graphical user interface are handed to the GPU for operation, so that the aim of improving the performance of the embedded graphical user interface is fulfilled.
In order to better understand the advantages of embodiments of the present invention, the following description will be made with respect to the accelerated display of the present invention by comparing the basic flow of the graphic display of the embedded Qt application before and after the improvement.
Referring to fig. 3, the basic flow under embedded Qt before improvement is shown:
1) The Qt bottom layer is initialized, frame buffer information is read, and functions (operation instructions) of copying, filling and the like simulated by CPU instructions and realized inside the Qt are bound.
2) Initializing a Qt graphic library, and initializing necessary modules of Qt such as a Gui module, a network module and the like.
3) The application program is executed.
Referring to FIG. 4, the basic flow under the modified embedded Qt application is shown:
1) The EXA driver is initialized. Starting the GPU equipment, and registering the copy, filling and other functions which are realized by the EXA drive and accelerated by the GPU hardware.
2) The Qt floor is initialized. Binding is driven by EXA to registered copy, fill, etc. functions.
3) Initializing a Qt library, and initializing necessary modules of Qt such as a Gui module, a network module and the like.
4) The application program is executed.
According to the operation, the operation instruction which is originally realized by the CPU is changed into the operation instruction realized by the GPU, and in this way, functions such as copying and filling are performed by the GPU instead of being performed by the CPU, so that the CPU can be free to perform other tasks, and the overall efficiency can be greatly improved.
In addition, by applying the embodiment of the invention, the clamping phenomenon can not occur when the embedded Qt application program is displayed, and the CPU occupancy rate can not be too high.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Referring to FIG. 5, a block diagram illustrating an embodiment of a graphical display device of the present invention for application to a graphical user interface application may include the following modules:
an operation instruction registration module 301 for registering an operation instruction in the graphics acceleration architecture EXA driver; the operation instruction is executed by a graphics processor GPU;
a rendering type determining module 302, configured to determine a rendering type of a graphical user interface application program when displaying an interface graphic of the graphical user interface application program;
a target operation instruction determination module 303, configured to determine a target operation instruction based on the rendering type;
and the interface graphic display module 304 is used for controlling the GPU to execute target operation instructions through the EXA drive so as to display interface graphics of the graphical user interface application program.
In a preferred embodiment of the present invention, the apparatus may further comprise:
and the binding module is used for binding the EXA driver and a preset graphical user interface graphical library.
In a preferred embodiment of the present invention, the apparatus may further comprise:
a first buffer module for drawing interface graphics of the graphical user interface application program from the graphical user interface graphic library to a window buffer;
and the second buffer module is used for sending the interface graph of the window buffer area to the temporary buffer area.
In a preferred embodiment of the present invention, the operation instruction includes a copy instruction, and the interface graphic display module 304 may include:
the interface graphic extraction sub-module is used for controlling the GPU to extract an interface graphic from the temporary buffer area based on the copy instruction through the EXA drive;
and the interface graphic copying sub-module is used for copying the interface graphic to a display buffer area to be displayed on a screen.
In a preferred embodiment of the present invention, the operation instruction includes a stuff instruction, and the interface graphic display module 304 may include:
and the background color filling sub-module is used for controlling the GPU to fill the background color in the blank area of the screen based on the filling instruction through the EXA drive.
For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
Fig. 6 is a block diagram illustrating a configuration of an electronic device 500 for graphical display, according to an example embodiment. For example, electronic device 500 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, or the like.
Referring to fig. 6, an electronic device 500 may include one or more of the following components: a processing component 502, a memory 504, a power supply component 506, a multimedia component 508, an audio component 510, an input/output (I/O) interface 512, a sensor component 514, and a communication component 516.
The processing component 502 generally controls overall operation of the electronic device 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 502 may include one or more processors 520 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 502 can include one or more modules that facilitate interactions between the processing component 502 and other components. For example, the processing component 502 may include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.
Memory 504 is configured to store various types of data to support operations at device 500. Examples of such data include instructions for any application or method operating on the electronic device 500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 504 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power component 504 provides power to the various components of the electronic device 500. The power components 504 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 500.
The multimedia component 508 includes a screen between the electronic device 500 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front-facing camera and/or a rear-facing camera. When the electronic device 500 is in an operational mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 510 is configured to output and/or input audio signals. For example, the audio component 510 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 500 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 504 or transmitted via the communication component 516. In some embodiments, the audio component 510 further comprises a speaker for outputting audio signals.
The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 514 includes one or more sensors for providing status assessment of various aspects of the electronic device 500. For example, the sensor assembly 514 may detect the on/off state of the device 500, the relative positioning of components, such as a display and keypad of the electronic device 500, the sensor assembly 514 may also detect a change in position of the electronic device 500 or a component of the electronic device 500, the presence or absence of a user's contact with the electronic device 500, the orientation or acceleration/deceleration of the electronic device 500, and a change in temperature of the electronic device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 516 is configured to facilitate communication between the electronic device 500 and other devices, either wired or wireless. The electronic device 500 may access a wireless network based on a communication standard, such as WiFi,2G, or 3G, or a combination thereof. In one exemplary embodiment, the communication part 514 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 514 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 504, including instructions executable by processor 520 of electronic device 500 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
A non-transitory computer readable storage medium, which when executed by a processor of a terminal, causes the terminal to perform a graphical display method, the method comprising:
registering an operation instruction in the graphic acceleration structure EXA driver; the operation instruction is executed by a graphics processor GPU;
determining a rendering type of a graphical user interface application program when displaying an interface graphic of the graphical user interface application program;
determining a target operation instruction based on the rendering type;
and executing a target operation instruction by the GPU through the EXA drive control so as to display interface graphics of the graphical user interface application program.
Optionally, before the step of determining the rendering type of the graphical user interface application program when displaying the graphic of the graphical user interface application program, the method further comprises:
binding the EXA driver and a preset graphical user interface graphical library.
Optionally, before the step of executing, by the EXA driver, the GPU with the target operation instruction to display the interface graphic of the gui application, the method further includes:
drawing interface graphics of the graphical user interface application program from the graphical user interface graphic library to a window buffer;
and sending the interface graph of the window buffer to a temporary buffer.
Optionally, the operation instruction includes a copy instruction, and the step of executing, by the EXA driver, the GPU to execute the target operation instruction to display the interface graphic of the graphical user interface application includes:
controlling the GPU to extract an interface graph from the temporary buffer area based on the copy instruction through the EXA driver;
the interface graphic is copied to a display buffer for display on a screen.
Optionally, the operation instruction includes a fill instruction, and the step of executing, by the EXA driver, the GPU to execute the target operation instruction to display the interface graphic of the graphical user interface application includes:
and controlling the GPU to fill background colors in blank areas of a screen based on the filling instruction through the EXA drive.
For the electronic device embodiments, the description is relatively simple as it is substantially similar to the method embodiments, and reference should be made to the description of the method embodiments for relevant points.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The foregoing has described in detail a graphics display method, a graphics display device for an application program, an electronic device and a storage medium, and specific examples have been used herein to illustrate the principles and embodiments of the present invention, and the above examples are only for aiding in the understanding of the method and core concept of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims (10)

1. A graphical display method, applied to a graphical user interface application program, comprising:
registering an operation instruction in the graphic acceleration structure EXA driver; the operation instruction is executed by a graphics processor GPU;
determining, by the graphics processor GPU, a rendering type of the graphical user interface application while displaying an interface graphic of the graphical user interface application;
determining a target operation instruction based on the rendering type;
and executing a target operation instruction by the GPU through the EXA drive control so as to display interface graphics of the graphical user interface application program.
2. The method of claim 1, wherein prior to the step of determining the rendering type of the graphical user interface application program when displaying the graphic of the graphical user interface application program, further comprising:
binding the EXA driver and a preset graphical user interface graphical library.
3. The method of claim 2, further comprising, prior to the step of executing, by the EXA driver control GPU, target operational instructions to display interface graphics of the graphical user interface application:
drawing interface graphics of the graphical user interface application program from the graphical user interface graphic library to a window buffer;
and sending the interface graph of the window buffer to a temporary buffer.
4. The method of claim 3, wherein the operation instructions comprise copy instructions, and wherein the step of executing the target operation instructions by the EXA driver control GPU to display interface graphics of the graphical user interface application comprises:
controlling the GPU to extract an interface graph from the temporary buffer area based on the copy instruction through the EXA driver;
the interface graphic is copied to a display buffer for display on a screen.
5. The method of claim 4, wherein the operation instructions comprise stuff instructions, and wherein the step of executing the target operation instructions by the EXA driver control GPU to display interface graphics of the graphical user interface application comprises:
and controlling the GPU to fill background colors in blank areas of a screen based on the filling instruction through the EXA drive.
6. A graphical display device for a graphical user interface application program, comprising:
the operation instruction registration module is used for registering an operation instruction in the graphic acceleration structure EXA driver; the operation instruction is executed by a graphics processor GPU;
a rendering type determining module for determining, by the graphics processor GPU, a rendering type of a graphical user interface application when displaying an interface graphic of the graphical user interface application;
a target operation instruction determining module for determining a target operation instruction based on the rendering type;
and the interface graphic display module is used for controlling the GPU to execute the target operation instruction through the EXA drive so as to display the interface graphic of the graphic user interface application program.
7. The apparatus as recited in claim 6, further comprising:
and the binding module is used for binding the EXA driver and a preset graphical user interface graphical library.
8. The apparatus as recited in claim 7, further comprising:
a first buffer module for drawing interface graphics of the graphical user interface application program from the graphical user interface graphic library to a window buffer;
and the second buffer module is used for sending the interface graph of the window buffer area to the temporary buffer area.
9. An electronic device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs comprising instructions for:
registering an operation instruction in the graphic acceleration structure EXA driver; the operation instruction is executed by a graphics processor GPU;
determining a rendering type of a graphical user interface application program when displaying an interface graphic of the graphical user interface application program;
determining a target operation instruction based on the rendering type;
and executing a target operation instruction by the GPU through the EXA drive control so as to display interface graphics of the graphical user interface application program.
10. A readable storage medium, characterized in that instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the graphical display method of one or more of the method claims 1-5.
CN201810159945.6A 2018-02-26 2018-02-26 Graphic display method, graphic display device, electronic equipment and storage medium Active CN110196716B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810159945.6A CN110196716B (en) 2018-02-26 2018-02-26 Graphic display method, graphic display device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810159945.6A CN110196716B (en) 2018-02-26 2018-02-26 Graphic display method, graphic display device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN110196716A CN110196716A (en) 2019-09-03
CN110196716B true CN110196716B (en) 2023-07-25

Family

ID=67751255

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810159945.6A Active CN110196716B (en) 2018-02-26 2018-02-26 Graphic display method, graphic display device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN110196716B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110780962B (en) * 2019-10-15 2022-02-01 四川长虹电器股份有限公司 Application window title bar and window control display method in X window manager

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103440612A (en) * 2013-08-27 2013-12-11 华为技术有限公司 Image processing method and device in GPU vitualization
CN105122204A (en) * 2014-03-13 2015-12-02 华为技术有限公司 Graphic processing method, guest operating system (os) and guest os system
US9508108B1 (en) * 2008-11-07 2016-11-29 Google Inc. Hardware-accelerated graphics for user interface elements in web applications
CN106683035A (en) * 2015-11-09 2017-05-17 龙芯中科技术有限公司 GPU acceleration method and GPU acceleration device
CN106940653A (en) * 2017-04-14 2017-07-11 北京小米移动软件有限公司 Control method, device and the computer-readable recording medium of application program

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090282390A1 (en) * 2008-05-08 2009-11-12 Microsoft Corporation Parallel Run-Time Rendering Debugger
US20150199788A1 (en) * 2012-04-12 2015-07-16 Google Inc. Accelerating graphical rendering through legacy graphics compilation
TWI498849B (en) * 2012-11-05 2015-09-01 Nvidia Corp Method for graphics driver level decoupled rendering and display
CN104765595B (en) * 2014-01-08 2018-05-22 联发科技(新加坡)私人有限公司 A kind of method and device for showing graphic user interface
WO2015150342A1 (en) * 2014-03-30 2015-10-08 Universiteit Gent Program execution on heterogeneous platform
US20190130875A1 (en) * 2016-03-31 2019-05-02 Huawei Technologies Co., Ltd. Application Program Processing Method And Terminal Device
CN105955687B (en) * 2016-04-29 2019-12-17 华为技术有限公司 Image processing method, device and system
CN107369194B (en) * 2016-05-11 2022-04-15 龙芯中科技术股份有限公司 Method and device for filling pattern

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9508108B1 (en) * 2008-11-07 2016-11-29 Google Inc. Hardware-accelerated graphics for user interface elements in web applications
CN103440612A (en) * 2013-08-27 2013-12-11 华为技术有限公司 Image processing method and device in GPU vitualization
CN105122204A (en) * 2014-03-13 2015-12-02 华为技术有限公司 Graphic processing method, guest operating system (os) and guest os system
CN106683035A (en) * 2015-11-09 2017-05-17 龙芯中科技术有限公司 GPU acceleration method and GPU acceleration device
CN106940653A (en) * 2017-04-14 2017-07-11 北京小米移动软件有限公司 Control method, device and the computer-readable recording medium of application program

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于OpenGL的快速图像渲染方法;乔少杰;王有为;倪胜巧;彭京;;计算机应用研究(第05期) *

Also Published As

Publication number Publication date
CN110196716A (en) 2019-09-03

Similar Documents

Publication Publication Date Title
EP3674868A1 (en) Multimedia resource management method and apparatus, and storage medium
EP3163884A1 (en) Image acquiring method and apparatus, computer program and recording medium
CN106775202B (en) Information transmission method and device
CN107992257B (en) Screen splitting method and device
CN106126025B (en) Interactive method and device for copying and pasting
EP3147802B1 (en) Method and apparatus for processing information
CN110704059A (en) Image processing method, image processing device, electronic equipment and storage medium
US20170308397A1 (en) Method and apparatus for managing task of instant messaging application
CN104850643B (en) Picture comparison method and device
WO2016150104A1 (en) App theme loading method and device
CN112882784A (en) Application interface display method and device, intelligent equipment and medium
CN110196716B (en) Graphic display method, graphic display device, electronic equipment and storage medium
CN110865864B (en) Interface display method, device and equipment for quick application and storage medium
CN112508020A (en) Labeling method and device, electronic equipment and storage medium
CN108829473B (en) Event response method, device and storage medium
CN107885464B (en) Data storage method, device and computer readable storage medium
CN112306702B (en) Data sharing method and device, electronic equipment and storage medium
CN114827721A (en) Video special effect processing method and device, storage medium and electronic equipment
CN109389547B (en) Image display method and device
CN110457084B (en) Loading method and device
CN110134370B (en) Graph drawing method and device, electronic equipment and storage medium
CN105892832B (en) Method and device for displaying display information
CN112506393B (en) Icon display method and device and storage medium
EP2940981A2 (en) Method and device for synchronizing photographs
US20220291890A1 (en) Method for interaction between devices and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 100095 Building 2, Longxin Industrial Park, Zhongguancun environmental protection technology demonstration park, Haidian District, Beijing

Applicant after: Loongson Zhongke Technology Co.,Ltd.

Address before: 100095 Building 2, Longxin Industrial Park, Zhongguancun environmental protection technology demonstration park, Haidian District, Beijing

Applicant before: LOONGSON TECHNOLOGY Corp.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant