WO2016155329A1

WO2016155329A1 - Graphic processing method, device and system

Info

Publication number: WO2016155329A1
Application number: PCT/CN2015/094969
Authority: WO
Inventors: 姜霄棠; 周振坤; 李云夕
Original assignee: 华为技术有限公司
Priority date: 2015-04-02
Filing date: 2015-11-19
Publication date: 2016-10-06
Also published as: US10198785B2; EP3267391A1; EP3267391B1; EP3267391A4; CN104809684A; US20180018751A1; CN104809684B

Abstract

A graphic processing method, device and system. The method comprises: receiving a command queue inputted by a current frame, the command queue comprising a plurality of drawing commands; splitting, according to bounding rectangle information and drawing area information, each of irregular drawing commands into at least one first type of drawing command and at least one second type of drawing command; classifying, according to the bounding rectangle information and the drawing area information, regular drawing commands in the plurality of drawing commands, and the split first type of drawing command and the second type of drawing command, into a plurality of drawing command sets, such that drawing commands belonging to different drawing command sets are not intersected with each other; performing, according to the bounding rectangle information and the drawing area information, an intersection test on the plurality of drawing command sets; merging, according to an execution content, a drawing mode and the drawing area information, drawing commands of the plurality of drawing command sets undergone the intersection test; and executing the merged drawing command of each of the drawing command sets.

Description

Graphic processing method, device and system

The present application claims priority to Chinese Patent Application No. 201510154809.4, entitled "Graphical Processing Method, Apparatus and System", filed on Apr. 2, 2015, the entire contents of .

Technical field

Embodiments of the present invention relate to the field of image processing, and, more particularly, to a graphics processing method, apparatus, and system.

Background technique

The graphics engine is a graphics library that encapsulates graphics operations for application development. Designed by the system or designed by the developer. Every time the interface changes (start, slide, jump, animation, etc.), the graphics engine needs to completely draw the appropriate interface. When the graphics engine is drawn, a large number of central processing units (CPUs), graphics processing units (Graphic Processing Units), and double rate synchronous dynamic random access memory (Double Data Rate, DDR) resources are consumed depending on the number of pixels. Ideally, the number of pixels that the graphics engine draws at a time is the width and height of the screen, but it exceeds this number when overdraws. Over-drawing refers to the case where the same pixel is repeatedly drawn.

An existing method for eliminating over-drawing uses a method of intersection detection and drawing command merging in drawing to remove over-drawing.

However, the existing method of eliminating over-drawing cannot draw irregular graphics, such as rectangles, triangles, and ellipses rotated at any angle. At the same time, the time complexity of intersection detection is high, and the over-elimination is offset in the case of many graphics. The income drawn.

Summary of the invention

Embodiments of the present invention provide a graphics processing method, apparatus, and system, which can eliminate excessive drawing to some extent while reducing the complexity of intersection detection.

In a first aspect, a graphics processing method is provided, the method comprising: receiving a command queue of a current frame input, the command queue includes a plurality of drawing commands, each of the drawing commands carrying an outsourcing rectangle information, an execution content, a drawing mode, and Draw area information, which includes overlay mode, mixed a mode or a waiting mode; according to the outsourcing rectangle information and the drawing area information, splitting each of the plurality of drawing commands into at least one first drawing command and at least one second drawing command, wherein The drawing area of the first type of drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is the drawing area corresponding to the irregular drawing command, and the at least one first is removed. The drawing area of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, and the drawing mode of the at least one second type drawing command is a waiting mode; And according to the outsourcing rectangle information and the drawing area information, the rule drawing command of the plurality of drawing commands, and the first type drawing command and the second class drawing after the irregular drawing drawing command of the plurality of drawing commands are split Commands are grouped into multiple drawing command sets so that drawing commands belonging to different drawing command sets do not intersect each other; According to the outsourcing rectangle information and the drawing area information, the intersection of the plurality of drawing command sets is respectively detected, so that the drawing commands in each drawing command set do not intersect each other; according to the execution content, the drawing mode and the drawing area information And respectively drawing the command combination for the plurality of drawing command sets subjected to the intersection detection; performing the combined drawing command of each drawing command set.

With reference to the first aspect, in a first possible implementation, each of the plurality of drawing commands is split into at least one first type drawing command according to the outsourcing rectangle information and the drawing area information. And the at least one second type drawing command is specifically implemented as: obtaining the maximum inscribed rectangle information of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command; and using the outsourcing rectangle information of the irregular drawing command And the maximum inscribed rectangle information, the irregular drawing command is split into a first type drawing command and at least one second type drawing command, wherein the area corresponding to the first type drawing command is the irregular drawing command Corresponding maximum inscribed rectangle, the drawing area corresponding to the at least one second type drawing command is a corner area of the drawing area corresponding to the irregular drawing command except the maximum inscribed rectangle.

With reference to the first aspect, in a second possible implementation, each of the plurality of drawing commands is split into at least one first type drawing command according to the outsourcing rectangle information and the drawing area information. And the at least one second type drawing command is specifically implemented as: when the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a plurality of triangular drawing areas, and according to the irregularity The segmentation method of the polygon splits the irregular drawing command into a plurality of third class drawing commands, and the plurality of third class drawing commands have a one-to-one correspondence with the drawing regions of the plurality of triangles; Three types of drawing commands, according to the third class The outsourcing rectangle information and the drawing area information of the command are drawn, and the maximum inscribed rectangle information of the third type drawing command is obtained; and the third type drawing command is obtained by using the outsourcing rectangle information and the maximum inscribed rectangle information of the third type drawing command. Splitting into a first type of drawing command and at least one of the second type of drawing commands, wherein the area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the third type drawing command, the at least one second The drawing area corresponding to the class drawing command is a corner area of the drawing area corresponding to the third type drawing command except the maximum inscribed rectangle.

In a second aspect, a graphics processing method is provided, the method comprising: receiving a command queue of a current frame input, the command queue including a plurality of application programming interface API commands; converting the plurality of API commands into a plurality of drawing commands, Each of the drawing commands carries the outsourcing rectangle information, the execution content, the drawing mode, and the drawing area information, and the drawing mode includes an overlay mode, a blending mode, or a waiting mode; according to the outsourcing rectangle information and the drawing area information, the plurality of drawing commands are Each of the irregular drawing commands is split into at least one first type drawing command and at least one second type drawing command, wherein the drawing area of the first type drawing command is a rectangle in the drawing area corresponding to the irregular drawing command The drawing area of the at least one second type drawing command is a corner area remaining after the drawing area corresponding to the at least one first type drawing command is removed by the drawing area corresponding to the irregular drawing command, and the at least one first type drawing command is The drawing mode is the same as the drawing mode of the irregular drawing command, the at least one second class The drawing mode of the command is a waiting mode; according to the outsourcing rectangle information and the drawing area information, the rule drawing command of the plurality of drawing commands, and the irregular drawing command of the plurality of drawing commands are split by the first The class drawing command and the second class drawing command are grouped into a plurality of drawing command sets, so that the drawing commands belonging to different drawing command sets do not intersect each other; according to the outsourcing rectangle information and the drawing area information, the plurality of drawing command sets are respectively performed The intersecting detection is such that the drawing commands in each of the plurality of drawing command sets do not intersect each other; and the drawing commands are merged respectively according to the execution content, the drawing mode, and the drawing area information; Perform a merged draw command for each draw command set.

With reference to the second aspect, in a first possible implementation, each of the plurality of drawing commands is split into at least one first type drawing command according to the outsourcing rectangle information and the drawing area information. And the at least one second type drawing command is specifically implemented as: obtaining the maximum inscribed rectangle information of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command; and using the outsourcing rectangle information of the irregular drawing command And the maximum inscribed rectangle information, the irregular drawing command is split into a first type drawing command and at least one second type drawing command, wherein the area corresponding to the first type drawing command is the irregular drawing command Corresponding maximum An inscribed rectangle, the drawing area corresponding to the at least one second type drawing command is a corner area of the drawing area corresponding to the irregular drawing command except the maximum inscribed rectangle.

With reference to the second aspect, in a second possible implementation, each of the plurality of drawing commands is split into at least one first type drawing command according to the outsourcing rectangle information and the drawing area information. And the at least one second type drawing command is specifically implemented as: when the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a plurality of triangular drawing areas, and according to the irregularity The polygon segmentation method splits the irregular drawing command into a plurality of third class drawing commands, and each of the drawing classes corresponding to the third class drawing command is one of the drawing regions of the plurality of triangles; for each third The class drawing command obtains the maximum inscribed rectangle information of the third type drawing command according to the outsourcing rectangle information and the drawing area information of the third class drawing command; and the outsourcing rectangle information and the maximum inscribed rectangle by using the third class drawing command Information, splitting the third type of drawing command into one first type drawing command and at least one second type drawing command, The area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the third type drawing command, and the drawing area corresponding to the at least one second type drawing command is the drawing area corresponding to the third type drawing command except the maximum The corner area outside the rectangle is inscribed.

In a third aspect, a graphics processing apparatus is provided, the graphics processing apparatus comprising: a command collection module, configured to receive a command queue of a current frame input, the command queue includes a plurality of drawing commands, each of the drawing commands carrying an outer rectangle Information, execution content, drawing mode, and drawing area information, the drawing mode includes an overlay mode, a mixed mode, or a wait mode; a command splitting module for each of the plurality of drawing commands according to the outsourcing rectangle information and the drawing area information An irregular drawing command is split into at least one first drawing command and at least one second drawing command, wherein a drawing area of the first drawing command is a rectangle in a drawing area corresponding to the irregular drawing command, The drawing area of the at least one second type drawing command is a drawing area corresponding to the drawing area corresponding to the irregular drawing command, and the remaining corner area after the drawing area of the at least one first type drawing command is removed, and the drawing mode of the at least one first type drawing command Same as the drawing mode of the irregular drawing command, the at least one second type drawing The drawing mode of the command is a waiting mode; the command grouping module is configured to split the rule drawing command of the plurality of drawing commands and the irregular drawing command of the plurality of drawing commands according to the outsourcing rectangle information and the drawing area information The first type drawing command and the second type drawing command are grouped into a plurality of drawing command sets, so that the drawing commands belonging to different drawing command sets do not intersect each other; the intersection detecting module is configured to use the outsourcing rectangle information and the drawing area Information, respectively performing intersection detection on the plurality of drawing command sets, so that the plurality of drawing commands are collectively in each drawing command set The drawing commands do not intersect each other; the command merging module is configured to respectively perform drawing command merging on the plurality of drawing command sets subjected to intersection detection according to the execution content, the drawing mode, and the drawing area information; and the executing module is configured to execute each drawing command Set the merged draw command.

With reference to the third aspect, in a first possible implementation manner, the command splitting module is specifically configured to: obtain an outer bounding rectangle of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command Information; using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command, splitting the irregular drawing command into one first type drawing command and at least one second type drawing command, wherein the first The area corresponding to the class drawing command is the largest inscribed rectangle corresponding to the irregular drawing command, and the drawing area corresponding to the at least one second type drawing command is the drawing area corresponding to the irregular drawing command except the largest inscribed rectangle Corner area.

With reference to the third aspect, in a second possible implementation, the command splitting module is specifically configured to: when the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of the plurality of triangles, and splitting the irregular drawing command into a plurality of third type drawing commands according to the segmentation method of the irregular polygon, the plurality of third type drawing commands and the drawing area of the plurality of triangles a one-to-one correspondence relationship; for each third type drawing command, obtaining the maximum inscribed rectangle information of the third type drawing command according to the outsourcing rectangle information and drawing area information of the third type drawing command; The outsourcing rectangle information of the three types of drawing commands and the maximum inscribed rectangle information, the third type drawing command is split into a first class drawing command and at least one second class drawing command, wherein the first class drawing command The corresponding area is a maximum inscribed rectangle corresponding to the third type drawing command, and the drawing area corresponding to the at least one second type drawing command is the third type drawing Drawing command corresponding to the region except the corner region of the largest inscribed rectangle.

In a fourth aspect, a graphics processing apparatus is provided, the graphics processing apparatus comprising: a command collection module, configured to receive a command queue of a current frame input, the command queue includes a plurality of application programming interface API commands; and a command conversion module Converting the plurality of API commands into a plurality of drawing commands, each of the drawing commands carrying outsourcing rectangle information, execution content, drawing mode, and drawing area information, the drawing mode including an overlay mode, a mixed mode, or a waiting mode; a sub-module, configured to split each of the plurality of drawing commands into at least one first-type drawing command and at least one second-type drawing command according to the outsourcing rectangle information and the drawing area information, where The drawing area of the first type of drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is the drawing area corresponding to the irregular drawing command, and the at least one first class is removed. The remaining corner area after drawing the drawing area of the command, the at least one The drawing mode of the first type drawing command is the same as the drawing mode of the irregular drawing command, the drawing mode of the at least one second type drawing command is a waiting mode; the command grouping module is configured to use the outsourcing rectangle information and the drawing area information, The rule drawing command of the plurality of drawing commands, and the first type drawing command and the second type drawing command after the split drawing command of the plurality of drawing commands are grouped into a plurality of drawing command sets, The drawing commands belonging to different drawing command sets are mutually disjoint; the intersection detecting module is configured to perform intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that each of the plurality of drawing command sets is drawn The command in the command set does not intersect with each other; the command merge module is configured to respectively perform drawing command combining on the plurality of drawing command sets subjected to intersection detection according to the execution content, the drawing mode, and the drawing area information; and the executing module is configured to execute each The drawing command set is a combined drawing command.

With reference to the fourth aspect, in a first possible implementation manner, the command splitting module is configured to: obtain an outer bounding rectangle of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command Information; using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command, splitting the irregular drawing command into one first type drawing command and at least one second type drawing command, wherein the first The area corresponding to the class drawing command is the largest inscribed rectangle corresponding to the irregular drawing command, and the drawing area corresponding to the at least one second type drawing command is the drawing area corresponding to the irregular drawing command except the largest inscribed rectangle Corner area.

With reference to the fourth aspect, in a second possible implementation, the command splitting module is specifically configured to: when the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of the plurality of triangles, and splitting the irregular drawing command into a plurality of third type drawing commands according to the segmentation method of the irregular polygon, the plurality of third type drawing commands and the drawing area of the plurality of triangles a one-to-one correspondence relationship; for each third type drawing command, obtaining the maximum inscribed rectangle information of the third type drawing command according to the outsourcing rectangle information and drawing area information of the third type drawing command; The outsourcing rectangle information of the three types of drawing commands and the maximum inscribed rectangle information, the third type drawing command is split into a first class drawing command and at least one second class drawing command, wherein the first class drawing command The corresponding area is a maximum inscribed rectangle corresponding to the third type drawing command, and the drawing area corresponding to the at least one second type drawing command is the third type drawing Drawing command corresponding to the region except the corner region of the largest inscribed rectangle.

In a fifth aspect, a computer system is provided, the computer system comprising a processor and a memory;

This memory is used to store the program;

The processor is used to execute a program stored in the memory, and is specifically used to perform the following operations:

Receiving a command queue of a current frame input, the command queue includes a plurality of drawing commands, each of which carries an outsourcing rectangle information, an execution content, a drawing mode, and a drawing area information, and the drawing mode includes an overlay mode, a mixed mode, or a standby mode. ;

Decoding, according to the outsourcing rectangle information and the drawing area information, each of the plurality of drawing commands into at least one first class drawing command and at least one second class drawing command, wherein the first class drawing command The drawing area is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is a drawing area corresponding to the irregular drawing command, and the drawing area of the at least one first type drawing command is removed. a remaining corner area, a drawing mode of the at least one first type drawing command is the same as a drawing mode of the irregular drawing command, and a drawing mode of the at least one second type drawing command is a waiting mode;

And according to the outsourcing rectangle information and the drawing area information, the rule drawing command of the plurality of drawing commands, and the first type drawing command and the second class drawing after the irregular drawing drawing command of the plurality of drawing commands are split Commands are grouped into multiple drawing command sets so that drawing commands belonging to different drawing command sets do not intersect each other;

Performing intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that the drawing commands in each drawing command set in the plurality of drawing command sets do not intersect each other;

Performing drawing command combining on the plurality of drawing command sets subjected to intersection detection according to the execution content, the drawing mode, and the drawing area information;

Perform a merged draw command for each draw command set.

With reference to the fifth aspect, in a first possible implementation, the method is configured to split each of the plurality of drawing commands into at least one first class drawing according to the outsourcing rectangle information and the drawing area information. In the process of the command and the at least one second type of drawing command, the processor is specifically configured to: obtain the maximum inscribed rectangle information of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command; The outsourcing rectangle information of the rule drawing command and the maximum inscribed rectangle information, the irregular drawing command is split into a first class drawing command and at least one second class drawing command, wherein the first class drawing command corresponds to The area is a maximum inscribed rectangle corresponding to the irregular drawing command, and the drawing area corresponding to the at least one second type drawing command is a corner area of the drawing area corresponding to the irregular drawing command except the maximum inscribed rectangle.

With reference to the fifth aspect, in a second possible implementation, in the method for splitting each of the plurality of drawing commands into at least one first class drawing according to the outsourcing rectangle information and the drawing area information In the process of commanding and at least one second type of drawing command, the processor is specifically used to: When the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of a plurality of triangles, and the irregular drawing command is split according to the segmentation method of the irregular polygon. Dividing into a plurality of third class drawing commands, the plurality of third class drawing commands and the drawing regions of the plurality of triangles have a one-to-one correspondence relationship; for each third class drawing command, drawing commands according to the third class The outer rectangle information and the drawing area information are obtained, and the maximum inscribed rectangle information of the third type drawing command is obtained; and the third type drawing command is split by using the outsourcing rectangle information and the maximum inscribed rectangle information of the third type drawing command. The first type drawing command and the at least one second type drawing command, wherein the area corresponding to the first type drawing command is a maximum inscribed rectangle corresponding to the third type drawing command, and the at least one second type drawing The drawing area corresponding to the command is a corner area of the drawing area corresponding to the third type drawing command except the maximum inscribed rectangle.

In a sixth aspect, a computer system is provided, the computer system comprising a processor and a memory;

This memory is used to store the program;

Receiving a command queue of a current frame input, the command queue including a plurality of application programming interface API commands;

Converting the plurality of API commands into a plurality of drawing commands, each of the drawing commands carrying outsourcing rectangle information, execution content, drawing mode, and drawing area information, the drawing mode including an overlay mode, a mixed mode, or a waiting mode;

Perform a merged draw command for each draw command set.

With reference to the sixth aspect, in a first possible implementation, the method is configured to split each of the plurality of drawing commands into at least one first class drawing according to the outsourcing rectangle information and the drawing area information. In the process of the command and the at least one second type of drawing command, the processor is specifically configured to: obtain the maximum inscribed rectangle information of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command; The outsourcing rectangle information of the rule drawing command and the maximum inscribed rectangle information, the irregular drawing command is split into a first class drawing command and at least one second class drawing command, wherein the first class drawing command corresponds to The area is a maximum inscribed rectangle corresponding to the irregular drawing command, and the drawing area corresponding to the at least one second type drawing command is a corner area of the drawing area corresponding to the irregular drawing command except the maximum inscribed rectangle.

With reference to the sixth aspect, in a second possible implementation, in the method for splitting each of the plurality of drawing commands according to the outsourcing rectangle information and the drawing area information into at least one first class drawing In the process of the command and the at least one second type of drawing command, the processor is specifically configured to: when the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into multiple triangles. a region, and splitting the irregular drawing command into a plurality of third class drawing commands according to the segmentation method of the irregular polygon, wherein the plurality of third class drawing commands and the drawing regions of the plurality of triangles are one by one Corresponding relationship; for each third type drawing command, obtaining the maximum inscribed rectangle information of the third type drawing command according to the outsourcing rectangle information and drawing area information of the third type drawing command; using the third type drawing command Outsourcing rectangle information and maximum inscribed rectangle information, splitting the third type drawing command into one first type drawing command and at least one second a drawing command, wherein the area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the third type drawing command, and the drawing area corresponding to the at least one second type drawing command is a drawing corresponding to the third type drawing command The area except the maximum inscribed rectangle.

In a seventh aspect, a graphic display system is provided, the graphic display system comprising:

a graphics processing apparatus according to the third aspect or the first possible implementation of the third aspect or the second possible implementation of the third aspect;

The graphic display device has a communication connection with the graphic processing device for displaying a graphic obtained by the graphic processing device executing the merged drawing command.

In an eighth aspect, a graphic display system is provided, the graphic display system comprising:

a graphics processing apparatus according to the fourth aspect or the first possible implementation of the fourth aspect or the second possible implementation of the fourth aspect;

In one aspect, the graphics processing method, apparatus, and system of the embodiment of the present invention split the irregular drawing command in the command queue of the current frame into a rule drawing command and an irregular drawing command according to the drawing area, and divide the pre-split rule. The drawing command and the split rule drawing command and the irregular drawing command are grouped into a plurality of mutually disjoint drawing command sets, and then each drawing command set is respectively subjected to intersection detection and command merging, since the drawing commands are grouped into multiple Drawing the command set and then performing the intersection detection can greatly reduce the time of the intersection detection, and since the original irregular drawing command is split into the rule drawing command and the irregular drawing command, the split rule drawing command obtains several after the intersection detection. A new rule drawing command, one or more of the several new rule drawing commands may be merged in the command merge operation, which can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing. .

On the other hand, the graphics processing method, apparatus, and system of the embodiment of the present invention convert a plurality of API commands in a command queue of a current frame into a plurality of drawing commands, and then press the irregular drawing commands of the plurality of drawing commands. The drawing area is divided into a rule drawing command and an irregular drawing command, and the rule drawing command before splitting and the split rule drawing command and the irregular drawing command are grouped into a plurality of mutually disjoint drawing command sets, and then Each drawing command set performs intersection detection and command merging separately. Since the drawing commands are grouped into multiple drawing command sets and then intersected detection, the time of intersection detection can be greatly reduced, and the original irregular drawing command is split into rule drawing commands. And the irregular drawing command, the split rule drawing command obtains a number of new rule drawing commands after the intersection detection, and one or more of the several new rule drawing commands may be one or more in the command combining operation. Merging, can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only some of the present invention. For the embodiments, those skilled in the art can obtain other drawings according to the drawings without any creative work.

FIG. 1 is a schematic diagram of a logical architecture of a terminal device.

2 is a schematic diagram of a method of intersection detection according to an embodiment of the present invention.

Figure 3 is a schematic illustration of the principles of the invention in accordance with an embodiment of the present invention.

4 is a schematic flow chart of a graphics processing method according to an embodiment of the present invention.

FIG. 5 is a schematic flowchart of a method for command splitting according to an embodiment of the present invention.

Fig. 6 is a schematic view showing the maximum inscribed rectangle in a rectangle rotated at an arbitrary angle.

Figure 7 is a schematic illustration of the largest inscribed rectangle in the ellipse.

Figure 8 is a schematic illustration of the largest inscribed rectangle in the triangle.

FIG. 9 is a schematic diagram of a drawing area corresponding to a drawing command of a display space according to an embodiment of the present invention.

FIG. 10 is a schematic diagram of a drawing area after the display space is divided by the R+tree algorithm according to an embodiment of the present invention.

FIG. 11 is a schematic diagram of a drawing area after a secondary partitioning of a display space by using an R+tree algorithm according to an embodiment of the present invention.

FIG. 12 is a schematic diagram of a node of an R+ tree according to an embodiment of the present invention.

FIG. 13 is a schematic diagram showing the evolution of a command queue in a graphics processing method according to an embodiment of the present invention.

FIG. 14 is a schematic structural diagram of a graphics processing apparatus according to an embodiment of the present invention.

FIG. 15 is a schematic diagram of a specific process of graphics processing according to an embodiment of the present invention.

Figure 16 is a block diagram showing the structure of a computer system according to an embodiment of the present invention.

FIG. 17 is a schematic diagram of another graphics processing method according to an embodiment of the present invention.

FIG. 18 is a schematic structural diagram of another graphics processing apparatus according to an embodiment of the present invention.

FIG. 19 is a schematic diagram of a specific process of another graphics process according to an embodiment of the present invention.

20 is a schematic structural diagram of another computer system according to an embodiment of the present invention.

Figure 21 is a block diagram showing the structure of a graphic display system in accordance with an embodiment of the present invention.

FIG. 22 is a schematic structural diagram of another graphic display system according to an embodiment of the present invention.

FIG. 23 is a schematic structural diagram of still another graphic display system according to an embodiment of the present invention.

FIG. 24 is a schematic structural diagram of still another graphic display system according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, those of ordinary skill in the art are not making innovations. All other embodiments obtained under the premise of productive labor are within the scope of the invention.

A terminal, which may be referred to as a User Equipment ("UE"), a user, etc., may be performed by a radio access network (for example, a Radio Access Network ("RAN") and one or more core networks. The communication may be a mobile terminal, such as a mobile phone (or "cellular" phone) and a computer with a mobile terminal, for example, a portable, pocket, handheld, computer built-in or car-mounted mobile device, which is wireless The access network exchanges languages and/or data.

In order to facilitate the understanding of the embodiments of the present invention, several elements introduced in the description of the embodiments of the present invention are first described herein.

Maximum Inscribed Rectangle: The four vertices are on the edge of the graph, and the rectangles formed are all inside the graph. The rectangle is called the inscribed rectangle of the graph. When the area of the inscribed rectangle is the largest, it is called the maximum inscribed rectangle. The maximum inscribed rectangle in the embodiment of the present invention must also satisfy the condition: it may be assumed that one side of the desktop of the terminal is A, and the two parallel sides of the largest inscribed rectangle are parallel to the side A, and the other two parallel sides and the side A vertical.

Drawing command: The graphic engine renders the graphics rendering command to the terminal. Generally, it can include four types of information: Rect, Work, Mode, and Shape. Among them, Rect represents the outsourcing rectangle information of the area drawn by the drawing command; Work represents the execution content of the drawing command; Mode represents the drawing mode of the drawing command, that is, the drawing mode and the mixed mode on the canvas, including overlay (Opaque), blending (Blend) ) and wait (Wait) three types; Shape describes the shape of the area of the drawing command, such as rectangle / circle / point / line, etc., draw the shape of the area of the command, that is, the drawing area of the drawing command.

FIG. 1 is a schematic structural diagram of a terminal device.

The logical structure of a computing node applied by the graphics processing method provided by the embodiment of the present invention is described by using FIG. 1 as an example. The computing node may be a terminal device, and the terminal device may specifically be a smart phone. As shown in FIG. 1 , the hardware layer of the terminal device includes a CPU, a GPU, and the like, and may further include a memory, an input/output device, a memory, a memory controller, a network interface, and the like. The input device may include a keyboard, a mouse, a touch screen, and the like. The output device may include a display device such as an LCD, a CRT, a Holographic image, a Projector, and the like. Above the hardware layer you can run an operating system (such as Android) and some applications. The core library is the core part of the operating system, including input/output services, core services, graphics device interfaces, and graphics engine (Graphics Engine) for CPU and GPU graphics processing. The graphics engine may include a 2D engine, a 3D engine, a composition, a Frame Buffer, an EGL, and the like. In addition, the terminal further includes a driving layer, a frame layer, and an application layer. The driver layer can include CPU driver, GPU driver, display Controller drive, etc. The framework layer may include a graphic service (Graphic Service), a system service (System service), a web service (Web Service), and a customer service (Customer Service); and the graphic service may include, for example, a widget (widget) or a canvas (Canvas). , Views, Render Script, etc. The application layer may include a desktop, a media player, a browser, and the like.

The method of the embodiment of the present invention may be performed by a 2D engine in the core library layer of FIG. 1.

As shown in FIG. 1 , the graphics processing method provided by the embodiment of the present invention is applied to a computing node, where the computing node may be a terminal device, where the hardware layer of the terminal device may include a processor, for example, a central processing unit (Center Processing) Unit, CPU), Graphic Processing Unit (GPU), Display Controller, Memory, Memory Controller, Input Device, Display Device, etc. The Kernel Library can include input/ The output structure (I/O Service), the core service (Kernel Service), and the graphics engine (Graphic Engine), it should be understood that the logical structure of the execution body of the method of the embodiment of the present invention can refer to FIG.

An existing method for eliminating over-drawing uses intersecting detection, command merging, and over-drawing in drawing, and the algorithm of the intersection detection algorithm and the command merging algorithm is as follows.

Intersection detection algorithm:

Input: a series of drawing commands with drawing areas within a drawing partition

Output: A series of disjoint drawing areas with drawing commands.

step:

1. Put all drawing areas into the area pool.

2. Start checking the first drawing area A:

3. Detect whether A intersects with other drawing areas in the area pool.

4. If there is no intersection, the next drawing area is processed.

5. If there is a drawing area B intersecting A in the area pool, then the intersection area A and B are obtained, and the commands of A and B are aggregated in C, and A and B are divided into a series of sub-areas by C. Delete A and B in the zone pool and add C and subzones to the zone pool. 2 is a schematic diagram of a method of intersection detection according to an embodiment of the present invention. As shown in the left diagram of FIG. 2, the drawing area A1 (large rectangular area) and the drawing area A2 (small rectangular area) intersect, and the intersection area is B3 (actually A2); at this time, as shown in FIG. As shown in the figure on the right, A1 and A2 can be divided into B1, B2, B3, B4, and B5 according to the intersection area B3.

6. Traverse the area pool until you have traversed all areas of the area pool.

It should be understood that in the intersection detection, the drawing partition is a large area range. When the drawing area of the drawing command is within the range covered by the drawing partition, the drawing command is said to be a drawing command in the drawing partition.

In addition, the two drawing areas do not intersect, which means that there is no overlapping area between the two drawing areas. If the two drawing commands do not intersect, it refers to the area where there is no overlap between the drawing areas of the two drawing commands. Similarly, multiple drawing areas do not intersect, which means that there is no overlapping area between multiple drawing areas; if multiple drawing commands do not intersect, it means that there is no overlapping area between drawing areas of multiple drawing commands.

Command merge algorithm:

Input: A drawing area with a series of drawing commands

Output: A drawing area with a series of drawing commands

step:

1. Sort all drawing commands in the drawing area by depth

2. Start with the second command and sequence the commands in sequence:

If the identifier of the current command is Wait, no processing is performed;

If the current command identifier is Override (Opaque), remove all commands preceding the current command;

If the current command identifier is Blend and the identifier of the previous command is Wait, no processing is performed;

If the current command identifier is Blend, and the work of the previous command cannot be mixed with the Work of the current command, it is not processed;

If the current command identifier is Blend, and the identifier of the previous command is not Wait, and the Work of the previous command can be mixed with the Work of the current command, the current command is merged with the previous command into one command.

It should be understood that in the drawing command, Work represents the execution content of the drawing command. For example, image sampling, and so on.

Figure 3 is a schematic illustration of the principles of the invention in accordance with an embodiment of the present invention. As shown in FIG. 3, the method of the embodiment of the present invention can be divided into a collection phase and an execution phase. In the collection phase, a set of commands that apply input in the same frame are collected and assembled into an original command queue; in the execution phase, the original queue is over-drawn and culled by over-drawing the culling engine to form a new set of commands, and then Execute the output to the display device. Compared with delayed rendering, although it is divided into two processes of collecting and executing, there are the following differences: (1) Each command is independent of each other except the rendering target; (2) There are no instructions that only change state, all commands produce actual rendering effects, and each command has its own independent state.

4 is a schematic diagram of a graphics processing method according to an embodiment of the present invention. The method of Figure 4 is performed by a graphics processing device. Specifically, the graphics processing device may be a computer system such as a graphics engine or the like, or a graphics processor such as a GPU chip, and the like. As shown in FIG. 4, the method includes:

S410. Receive a command queue of a current frame input.

The command queue includes a plurality of drawing commands, each of which carries an outsourcing rectangle information, an execution content, a drawing mode, and a drawing area information, and the drawing mode includes an overlay mode, a mixed mode, or a waiting mode.

The drawing command generally includes four types of information: outer rectangle information (Rect), execution content (Work), drawing mode (Mode), and drawing area (Shape).

Where Rect represents the outsourcing rectangle information of the drawing area corresponding to the drawing command, and the drawing area is located in the outer rectangle. Preferably, the outer bounding rectangle of the drawing area is; Work represents the execution content of the drawing command; Mode represents the drawing mode of the drawing command, that is, the drawing result and the mixed mode on the canvas, including coverage (Opaque), blending (Blend), and waiting (Wait). Three types; Shape describes the shape of the area in which the command is drawn, such as rectangle/circle/point/line, etc., and draws the shape of the area of the command, that is, the drawing area of the drawing command.

An example of a specific drawing command, covering an elliptical image onto the region of [20,20]To[300,400], the elliptic parameter equation is [((x-160)/140)]^2+[((y-210) ) / 190)] ^ 2 = 1. The content of the drawing command may include:

Outsourcing rectangle: [20,20]To[300,300]

Execution content: image sampling

Drawing mode: overlay

Area shape: elliptic parameter equation [((x-160)/140)]^2+[((y-210)/190)]^2=1

S420. Split each of the plurality of drawing commands into at least one first type drawing command and at least one second type drawing command according to the outsourcing rectangle information and the drawing area information.

The drawing area of the at least one first type drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is the drawing area corresponding to the irregular drawing command. Remaining at least one drawing area of the first type of drawing command a corner area, the drawing mode of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, and the drawing mode of the at least one second type drawing command is a waiting mode.

It should be understood that, in the embodiment of the present invention, the regular shape refers to a rectangle parallel to the boundary corresponding to the display desktop. Normally, the display area of the display desktop is a rectangle, assuming a rectangular ABCD. Assuming that the rectangle EFGH is located in the rectangle ABCD, and the side EF is parallel to the side AB, the side FG is parallel to the side BC, it can be said that the rectangle EFGH is a regular shaped area.

All shapes except the regular shape are called irregular shapes. The drawing area corresponding to the drawing command is a regular shape, which may be called a rule command; the drawing area corresponding to the drawing command is an irregular shape, and may be called an irregular command.

It should be understood that after a drawing command is split, the drawing content is correspondingly reflected in the drawing command after splitting. E.g. In the above example, the execution content of the drawing command is image sampling. After the drawing command is split, the execution content of the split drawing command is also image sampling, and the respective drawing regions are respectively image-sampled.

In the embodiment of the present invention, the command splitting process is not required for the rule command, and the command splitting process is required for the irregular command.

Optionally, as an embodiment, an irregular drawing command may be split into a first class drawing command and at least one second class drawing command. A specific command splitting method is shown in FIG. 5, which may include:

S421: Obtain out the maximum inscribed rectangle information of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command.

In the embodiment of the present invention, the maximum inscribed rectangle of the irregular drawing command refers to a rectangle of a regular shape having the largest area among the inscribed rectangles of the drawing area corresponding to the irregular drawing command. A rectangle of a regular shape, that is, a rectangle whose boundary is parallel to the boundary corresponding to the display desktop.

Let's take several common irregular patterns as an example to find the maximum inscribed rectangle.

Fig. 6 is a schematic view showing the maximum inscribed rectangle in a rectangle rotated at an arbitrary angle. As shown in FIG. 6, the rectangle ABCD is a rotation rectangle, and the rectangle PSQR is an inscribed rectangle of the rotation rectangle ABCD. Among them, among the four vertices of the rotating rectangle ABCD, the coordinates of point A are (0, 0), the coordinates of point B are (x2, y2), the coordinates of point C are (x1, y1), and P is the inscribed rectangle PSQR and long side. The intersection of AC, Q is the intersection of the inscribed rectangle PSQR and the long side BD. It is possible to record the value of AP/AC as p, and the value of BQ/BD as q, then the solution equation of the largest inscribed rectangle can be obtained:

0.0 ≤ p ≤ 1.0;

0.0≤q≤1.0;

Max: ((2-q)x2+(1-p-q)x1)*((2-q)y2+(1-p-q)y1).

Figure 7 is a schematic illustration of the largest inscribed rectangle in the ellipse. As shown in Fig. 7, the center point of the hypothetical ellipse is not (x ₀ , y ₀ ), and the elliptic parameter equation is: [((xx ₀ )/a)]^2+[((yy ₀ )/b)] ^2=1, the distance between the coordinates of the intersection of the inscribed rectangle and the ellipse (A, B, C or D) to the center point of the ellipse is r, and the angle is p, which lists the parametric equation of the rectangle ABCD:

(xx ₀ , yy ₀ )=(a*cos(p), b*sin(p));

Its circumscribed rectangle is: (x ₀ -a, y ₀ -b) To(x ₀ +a, y ₀ +b);

According to the function of p and area, p is obtained. When p is equal to 45 degrees, the maximum inscribed rectangle is obtained, which can be expressed as:

(x ₀ -a*cos(45°), y ₀ -b*sin(45°)) To(x ₀ +a*cos(45°), y ₀ +b*sin(45°)).

Figure 8 is a schematic illustration of the largest inscribed rectangle in the triangle. As shown in Fig. 8, the rectangle ABCD is an inscribed rectangle of the triangle EFG. Find the best segmentation point on each edge of each of the three rows to obtain the corresponding inscribed rectangle on each edge. For example, take point A on the edge of EF, and then take two lines from point A in parallel with the side of the display desktop. The two lines drawn intersect with the edges FG, EG of the triangle EFG and points B and C, respectively, to determine the rectangle ABCD. It may be noted that EA/EF is p, and the area S of the rectangular ABCD can be expressed as a parameter expression containing p. When the area of S is the largest, point A is the best dividing point of the edge EF. Similarly, the best segmentation points on the edges FG, EG can be obtained separately. The largest of the rectangular areas corresponding to the best dividing points on the three sides, that is, the largest inscribed rectangle obtained by the triangle EFG. The specific calculation method belongs to the category of geometric mathematics, and the embodiments of the present invention are not described herein again.

Of course, there may be other types of irregular patterns. The algorithm for determining the maximum inscribed rectangle of the irregular pattern belongs to the category of geometric mathematics, and details are not described herein again.

S422. Split the irregular drawing command into a first class drawing command and at least one second class drawing command by using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command.

The area of the first type of drawing command is the maximum inscribed rectangle of the irregular drawing command, and the drawing area of the at least one second type drawing command is the drawing area of the irregular drawing command except the maximum inscribed rectangle. The corners draw the area.

For example, in the graphs shown in FIGS. 6, 7, and 8, the outer envelope is divided into a maximum inscribed rectangle and a plurality of irregular corner regions. At the same time, for the maximum inscribed rectangular area, the drawing mode remains unchanged, and the drawing mode of the remaining corner areas is changed to the waiting mode state.

In the embodiment of the present invention, the original irregular command of the triangle, the rotation rectangle or the ellipse with the shape of the drawing area is split into a rule drawing command and a plurality of new irregular drawing commands according to the maximum inscribed rectangle, and split. After the rule drawing command, after the intersection detection, several new rule drawing commands are obtained, and one or more of the new rule drawing commands may be merged in the command combining operation, thereby being able to Increase the effect of eliminating overdraw.

Optionally, as another embodiment, one irregular drawing command may be split into multiple first class drawing commands and multiple second class drawing commands. When the drawing area corresponding to the irregular drawing command is an irregular polygon, step 420 may be specifically implemented as:

Dividing the drawing area of the irregular polygon into a drawing area of a plurality of triangles, and splitting the irregular drawing command into a plurality of third type drawing commands according to the segmentation method of the irregular polygon, the plurality of third types a one-to-one correspondence between the drawing command and the drawing area of the plurality of triangles;

And for each third type drawing command, obtaining the maximum inscribed rectangle information of the third type drawing command according to the outsourcing rectangle information and the drawing area information of the third type drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the third class drawing command, splitting the third class drawing command into one first class drawing command and at least one second class drawing command, wherein the first The area corresponding to the class drawing command is the largest inscribed rectangle corresponding to the third type drawing command, and the drawing area corresponding to the at least one second type drawing command is the drawing area corresponding to the third type drawing command except the maximum inscribed rectangle. Corner area.

In the embodiment of the present invention, by splitting the irregular polygon into a plurality of triangles, each triangle is split into a maximum inscribed rectangle and three corner regions, and the original drawing command is removed according to the split region. Divided into a plurality of rule drawing commands and a plurality of new irregular drawing commands, the split rule drawing commands obtain a number of new rule drawing commands after the intersection detection, and the new rule drawing commands may be One or more of them are merged in the command merge operation, so that the effect of eliminating over-drawing can be increased to some extent.

S430, according to the outsourcing rectangle information and the drawing area information, the rule drawing command of the plurality of drawing commands, and the first type drawing command and the second after the irregular drawing drawing command of the plurality of drawing commands are split Class drawing commands are grouped into multiple drawing command sets so that drawing commands belonging to different drawing command sets do not intersect each other.

After the splitting of the command in step S420, the current command queue includes a rule drawing command that exists when the command queue is received, and a first type drawing command and a second type drawing command after the irregular command is split.

According to the outsourcing rectangular area information and the drawing area information of each drawing command, the drawing area in the current command queue can be divided into multiple drawing partitions, so that the drawing areas in different drawing partitions do not intersect each other, that is, the drawing areas of different drawing partitions There is no overlapping area between them. Then, the drawing commands in each drawing partition are combined into one drawing command set, and one drawing partition corresponds to one drawing command set.

After the drawing command is partitioned, the entire desktop is divided into a number of different drawing command sets.

By dividing the drawing command according to the drawing area, the drawing command in each drawing command set is a finite number, and the time for intersecting detection of the drawing command in the drawing command set can be greatly reduced.

A method of an embodiment of the present invention uses an R+tree algorithm to select a loading factor, each time loading a finite strip drawing command to divide the drawing command into a plurality of drawing command sets.

Sweep algorithm and overall algorithm pack including split line selection

Repeat until S’ is empty

When the command is split, the order of the commands is scrambled. Therefore, each command can be added with a depth value in the order of execution so that the order of execution is known later.

FIG. 9 is a schematic diagram of a drawing area corresponding to a drawing command of a display space according to an embodiment of the present invention. Among them, there are 12 drawing commands, which respectively correspond to 12 drawing areas on the display space.

Taking the loading factor ff equal to 5 as an example, the command grouping of the R+ tree algorithm is performed.

FIG. 10 is a schematic diagram of a drawing area after the display space is divided by the R+ algorithm in the embodiment of the present invention. According to the R+ tree algorithm, the boundary line of each rectangle is exhausted. The first division is as shown in FIG. 10, and five rectangles (1, 2.1, 3, 4, 5.1) are divided, and the area of the divided rectangle is the smallest. Incorporate the rectangle (1, 2.1, 3, 4, 5.1) into the first leaf node.

FIG. 11 is a schematic diagram of a drawing area after the display space is secondarily divided by the R+ algorithm according to an embodiment of the present invention. According to the R+ tree algorithm, the boundary line of each rectangle is exhausted in the remaining area, and the second division is as shown in FIG. 11, and five rectangles (2.2, 6.1, 7, 9, 10) are divided, and the rectangle is divided. The smallest area. Incorporate the rectangle (2.2, 6.1, 7, 9, 10) into the second leaf node.

The number of rectangles remaining after the two divisions has not exceeded the loading factor, so the rectangles (5.2, 8, 11, 12) of the remaining area directly construct the child nodes.

FIG. 12 is a schematic diagram of a node of an R+ tree according to an embodiment of the present invention. After two divisions of the R+ tree algorithm, an R+ tree diagram as shown in FIG. 12 is finally formed. In Figure 12, the R+ tree includes leaf nodes (1, 2.1, 3, 4, 5.1), (2.2, 6.1, 7, 9, 10) and (5.2, 8, 11, 12), each leaf node represents a drawing Command set.

In the embodiment of the present invention, by using the R+ tree algorithm, the drawing command grouping can be quickly performed, and each drawing command set after grouping is controlled to a certain scale, thereby reducing the time complexity of the intersection detection and greatly improving the time complexity. The graphics processing efficiency of the graphics processing device.

S440. Perform intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that the drawing commands in each drawing command set in the plurality of drawing command sets do not intersect each other.

After the drawing command set is divided, the drawing command in each drawing command set can be detected by the intersection. The specific implementation can refer to the prior art, and details are not described herein again.

S450: Perform drawing command combining on the plurality of drawing command sets subjected to the intersection detection according to the execution content, the drawing mode, and the drawing area information.

After the intersecting detection drawing command set, the drawing command may be combined according to the execution content, the drawing mode, and the drawing area information of each drawing command to eliminate the over-drawn portion. For a specific implementation, reference may be made to the prior art, and details are not described herein again.

S460: Perform a merged drawing command for each drawing partition.

Specifically, when the drawing command of each drawing partition is executed, the order of execution can be determined according to the depth of each drawing command.

It should be understood that the final drawing command for each drawing partition means that each drawing partition is cross-checked. The test and draw commands are combined to get the draw command.

In the embodiment of the present invention, the irregular drawing command in the command queue of the current frame is divided into a rule drawing command and an irregular drawing command according to the drawing area, and the rule drawing command and the split rule before the splitting are drawn. The command and the irregular drawing command are grouped into a plurality of mutually dissimilar drawing command sets, and then each of the drawing command sets are respectively subjected to intersection detection and command merging, since the drawing commands are grouped into a plurality of drawing command sets and then intersected detection can be greatly The time for the intersection detection is reduced, and since the original irregular drawing command is split into the rule drawing command and the irregular drawing command, the split rule drawing command obtains several new rule drawing commands after the intersection detection, the plurality of It is possible that one or more of the new rule drawing commands will be merged in the command merging operation, which can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing.

FIG. 13 is a schematic diagram showing the evolution of a command queue in a graphics processing method according to an embodiment of the present invention. The specific evolution process is as follows:

Step 1: Enter the command queue.

In FIG. 4, that is, step S410, the command queue of the current frame input is received.

Step 2: Command split.

The input command queue is split according to step S420 of FIG. 4 to form a temporary command queue.

The third step: command partition.

According to step S430 of FIG. 4, the temporary command queue is command-partitioned to obtain a series of drawing partitions, and each drawing partition corresponds to a sub-command set of drawing commands. Among them, the drawing commands in different sub-command sets do not intersect. The two drawing commands do not intersect, which means that the drawing areas corresponding to the two drawing commands do not overlap.

The fourth step: intersection detection.

Intersection detection is performed for each sub-command set in accordance with step S440 of FIG. After each sub-command set performs intersection detection, it will get a series of disjoint drawing commands. It should be understood that after the intersection detection, the drawing areas corresponding to any two drawing commands in the same sub-command set do not overlap each other.

The fifth step is to merge the commands.

According to step S450 of FIG. 4, the drawing commands obtained after the intersection detection of each sub-command set are combined and combined to form a new command queue. The command queue is the input command queue.

In the embodiment of the present invention, the irregular drawing command in the command queue of the current frame is divided into a rule drawing command and an irregular drawing command according to the drawing area, and the rule drawing command before splitting and The split rule drawing command and the irregular drawing command are grouped into a plurality of mutually dissimilar drawing command sets, and then each drawing command set is respectively subjected to intersection detection and command merging, since the drawing commands are grouped into multiple drawing command sets. Performing the intersection detection can greatly reduce the time of intersection detection, and since the original irregular drawing command is split into the rule drawing command and the irregular drawing command, the split rule drawing command obtains several new rules after the intersection detection. Drawing commands, one or more of the several new rule drawing commands may be merged in the command merging operation, which can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing.

FIG. 14 is a schematic structural diagram of a graphics processing apparatus 1400 according to an embodiment of the present invention. As shown in FIG. 14, the graphics processing apparatus 1400 may include a command collection module 1401, a command splitting module 1402, a command grouping module 1403, an intersection detecting module 1404, a command combining module 1405, and an executing module 1406. among them,

The command collection module 1401 is configured to receive a command queue of the current frame input. The command queue includes a plurality of drawing commands, each of which carries an outsourcing rectangle information, an execution content, a drawing mode, and a drawing area information, and the drawing mode includes an overlay mode, a mixed mode, or a waiting mode.

The command splitting module 1402 is configured to split each of the plurality of drawing commands into at least one first type drawing command and at least one second type drawing command according to the outsourcing rectangle information and the drawing area information. The drawing area of the first type of drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is the drawing area corresponding to the irregular drawing command, and the at least one is removed. a drawing area remaining after the drawing area of the first type drawing command, the drawing mode of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, and the drawing mode of the at least one second type drawing command is waiting mode.

The command grouping module 1403 is configured to: according to the outsourcing rectangle information and the drawing area information, the rule drawing command of the plurality of drawing commands, and the first drawing of the irregular drawing command of the plurality of drawing commands after the splitting The command and the second type of drawing command are grouped into a plurality of drawing command sets such that drawing commands belonging to different drawing command sets do not intersect each other.

The intersection detecting module 1404 is configured to perform intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that the drawing commands in each drawing command set in the plurality of drawing command sets do not intersect each other.

The command merging module 1405 is configured to separately perform drawing command merging on the plurality of drawing command sets that have undergone intersection detection according to the execution content, the drawing mode, and the drawing area information.

The execution module 1406 is configured to execute the merged drawing command for each drawing command set.

In the embodiment of the present invention, the graphics processing apparatus 1400 splits the irregular drawing command in the command queue of the current frame into a rule drawing command and an irregular drawing command according to the drawing area, and draws the command and splits the rule before the splitting. The following rule drawing command and irregular drawing command are grouped into a plurality of mutually dissimilar drawing command sets, and then each drawing command set is respectively subjected to intersection detection and command merging, and the drawing commands are grouped into a plurality of drawing command sets. Intersection detection can greatly reduce the time of intersection detection, and since the original irregular drawing command is split into a rule drawing command and an irregular drawing command, the split rule drawing command obtains several new rule drawing commands after the intersection detection. One or more of the several new rule drawing commands may be merged in the command merge operation, which can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing.

Optionally, as an embodiment, the command splitting module 1402 is specifically configured to:

Obtaining a maximum inscribed rectangle information of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command, the irregular drawing command is split into a first class drawing command and at least one second class drawing command, wherein the first class drawing The area corresponding to the command is a maximum inscribed rectangle corresponding to the irregular drawing command, and the drawing area corresponding to the at least one second type drawing command is a corner area of the drawing area corresponding to the irregular drawing command except the maximum inscribed rectangle .

In the embodiment of the present invention, the graphics processing apparatus 1400 splits the original irregular command of the triangle, the rotation rectangle, or the ellipse with the shape of the drawing area into a rule drawing command and several new irregular drawing according to the maximum inscribed rectangle. The command, the split rule drawing command obtains a number of new rule drawing commands after the intersection detection, and one or more of the new rule drawing commands may be merged in the command merge operation, thereby enabling To some extent, the effect of eliminating over-drawing is increased.

Optionally, as another embodiment, the command splitting module 1402 is specifically configured to:

When the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of a plurality of triangles, and the irregular drawing command is split according to the segmentation method of the irregular polygon. Dividing into a plurality of third class drawing commands, the plurality of third class drawing commands and the drawing regions of the plurality of triangles have a one-to-one correspondence relationship;

For each third class drawing command, the outsourcing rectangle information and drawing according to the third class drawing command The area information is obtained, and the maximum inscribed rectangle information of the third type drawing command is obtained;

In the embodiment of the present invention, the graphics processing apparatus 1400 splits the irregular polygon into a plurality of triangles, and then splits each triangle into a maximum inscribed rectangle and three corner regions, and according to the split region, The original drawing command is split into a plurality of rule drawing commands and a plurality of new irregular drawing commands, and the split rule drawing commands obtain a plurality of new rule drawing commands after the intersection detection, and the plurality of new rule drawing commands It is possible that one or more of them will be merged in the command merge operation, so that the effect of eliminating over-drawing can be increased to some extent.

Optionally, the command grouping module 1403 is specifically configured to: according to the outsourcing rectangle information and the drawing area information, draw a command in the plurality of drawing commands, and an irregular drawing command in the plurality of drawing commands by adopting an R+ tree algorithm. The split first drawing command and the second type drawing command are grouped into a plurality of drawing command sets, so that drawing commands belonging to different drawing command sets do not intersect each other.

In the embodiment of the present invention, the graphics processing apparatus 1400 can quickly perform drawing command grouping by using the R+ tree algorithm, and control each drawing command set after grouping to a certain scale, thereby reducing the time complexity of the intersection detection. The graphics processing efficiency of the graphics processing device is greatly improved.

In addition, the graphics processing device 1400 can also perform the functions of the FIG. 4 and FIG. 13 and implement the functions of the graphics processing device in the embodiments shown in FIG. 4 and FIG.

In various embodiments of the above graphics processing apparatus, it should be understood that, in one implementation, the command collection module may be implemented by a communication interface, a command splitting module, a command grouping module, an intersection detecting module, and a command merge. The module, the execution module may be implemented by a processor executing a program or instruction in a memory (in other words, by a processor and a special instruction in a memory coupled to the processor); in another In the implementation mode, the command collection module, the command splitting module, the command grouping module, the intersection detecting module, the command combining module, and the executing module can also be implemented by an Application Specific Integrated Circuit (ASIC), and the specific implementation manner is as follows. There is technology, no more details here; the invention includes but is not limited to The foregoing implementation manners are understood to be within the scope of the embodiments of the present invention as long as they are implemented according to the embodiments of the present invention.

A specific application method of the graphics processing apparatus of the embodiment of the present invention is shown in FIG. FIG. 15 is a schematic diagram of a specific process of graphics processing according to an embodiment of the present invention. In Figure 15, the application is a user-oriented product that requires physical support for graphics processing. Specifically, the application can be a web game, a CAD drawing tool, or the like. The graphics processing device 1400 may correspond to the implementation of the combination of software and hardware of the graphics engine, the processor driver and the processor shown in FIG. 15 (it should be understood that the graphics engine and the processor driver herein can be understood as programs stored in the memory). Or instruction). Specifically, the drawing command output by the application is processed by the graphics engine to obtain a series of new drawing commands, and the graphics engine sends the processed series of new drawing commands to the corresponding processor through the processor driver (for example, the graphics engine will process After a series of new drawing commands are sent to the DSP by Digital Signal Processing (DSP) driver, or sent to the CPU through the CPU driver, or sent to the GPU through the GPU driver, and then by the processor (for example) The DSP, CPU or GPU executes, and the final rendering result is output to a display device (such as the display unit in Fig. 16).

The graphics processing apparatus 1400 in the above-described embodiments of the present invention may be implemented in the form of hardware, software, or a combination of hardware and software, and in particular, may be implemented as one or more computer systems or other processing systems.

An exemplary implementation of the graphics processing apparatus will now be described with reference to FIG. 16. For ease of description, the graphics processing apparatus of the following embodiments are collectively referred to as a computer system:

16 is a block diagram showing the structure of a computer system 1600 according to an embodiment of the present invention. One embodiment of the present invention, as shown in FIG. 16, computer system 1600 can include a processor 1602, a memory 1604, a communication interface 1601, and a display interface 1603.

The processor 1602, the memory 1604, the communication interface 1601, and the display interface 1603 are interconnected by a communication architecture 1606. The communication architecture 1606 can be a bus or a network or the like. Specifically, when the communication architecture 1606 is a bus, the bus may be an ISA bus, a PCI bus, or an EISA bus. The bus can be divided into an address bus, a data bus, a control bus, and the like. When the communication infrastructure 1606 is a network, the network can be a wired network, such as a fiber optic network, a telephone line, etc., or a wireless network such as a cell connection, a radio frequency connection, or other communication channel.

Display interface 1603 can be coupled to display unit 1605. Display unit 1605 includes a display (eg, a touch screen, LCD, CRT, Holographic, or Projector) Wait). The display interface 1603 is for outputting the display data of the computer system 1600 to the display unit 1605 to which the computer system 1600 is connected, and is displayed by the display unit 1605. Specifically, the memory 1603 may further include a frame buffer, and the computer system 1600 processes the display data in the frame buffer, and outputs the data of the frame buffer to the display unit 1605 through the display interface 1603 after the processing. The display unit 1605 can be used to display information input by the user or information provided to the user and various menu interfaces in the device (eg, mobile terminal, computer, smart set top box, smart integrated machine, etc.) in which the graphics processing device is located. The display unit 1605 can include a display panel. Alternatively, the display panel can be configured in the form of an LCD (Liquid Crystal Display) or an OLED (Organic Light-Emitting Diode). Optionally, the display unit 1605 can further include a touch panel, the touch panel is overlaid on the display panel to form a touch display screen.

Communication interface 1601 is used to enable communication between computer system 1600 and devices external to computer system 1600. Communication interface 1601 can convert data from computer system 1600 to signal 1607, via communication path 1608, or receive signal 1607 from communication path 1608 and convert to data. In particular, the communication interface 1601 can be a modem, a network interface (eg, an Ethernet interface), a communication port, a PCMCIA expansion slot, a PCMCIA expansion card, and the like. Signal 1607 can be an optical signal, an electrical signal, or other form of signal. Communication path 1608 can be a fiber optic network, a telephone line, a cell connection, a radio frequency connection, or other communication channel.

The memory 1604 is configured to store a program. In particular, the program can include program code, the program code including computer operating instructions. Memory 1604 can include read only memory and random access memory and provides instructions and data to processor 1602. Memory 1604 may include high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

The processor 1602 executes the program stored in the memory 1604, and is specifically configured to perform the following operations:

Decoding, according to the outsourcing rectangle information and the drawing area information, each of the plurality of drawing commands into at least one first class drawing command and at least one second class drawing command, wherein the first class drawing command The drawing area is within the drawing area corresponding to the irregular drawing command a rectangle, the drawing area of the at least one second type drawing command is a corner area remaining after the drawing area corresponding to the irregular drawing command is removed from the drawing area of the at least one first type drawing command, and the at least one first type drawing command The drawing mode is the same as the drawing mode of the irregular drawing command, and the drawing mode of the at least one second type drawing command is the waiting mode;

Perform a merged draw command for each draw command set.

The method performed by the graphics processing apparatus disclosed in any of the embodiments of FIG. 4 or FIG. 13 of the present invention may be applied to the processor 1602 or implemented by the processor 1602. In an embodiment of the invention, computer system 1600 can include one or more processors 1602. The processor 1602 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 1602 or an instruction in a form of software. The processor 1602 may be a general-purpose processor, including a central processing unit (CPU), a network processor (Network Processor, NP for short, etc.; or a digital signal processor (DSP), an application specific integrated circuit. (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or dedicated processor, such as a Graphic Processing Unit (PPU). The processor 1602 can implement or perform the various methods, steps, and logic blocks disclosed in the embodiments of the present invention. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present invention may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor. The software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium is located in the memory 1603, and the processor 1602 reads the information in the memory 1604 and completes the steps of the above method in combination with its hardware.

In the embodiment of the present invention, the graphics processing apparatus 1600 splits the irregular drawing command in the command queue of the current frame into a rule drawing command and an irregular drawing command according to the drawing area, and draws the command and splits the rule before the splitting. The following rule drawing command and irregular drawing command are grouped into a plurality of mutually dissimilar drawing command sets, and then each drawing command set is respectively subjected to intersection detection and command merging, and the drawing commands are grouped into a plurality of drawing command sets. Intersection detection can greatly reduce the time of intersection detection, and since the original irregular drawing command is split into a rule drawing command and an irregular drawing command, the split rule drawing command obtains several new rule drawing commands after the intersection detection. One or more of the several new rule drawing commands may be merged in the command merge operation, which can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing.

Optionally, as an embodiment, in the method according to the outsourcing rectangle information and the drawing area information, splitting each of the plurality of drawing commands into at least one first type drawing command and at least one second In the process of class drawing commands, the processor 1602 is specifically configured to:

In the embodiment of the present invention, the computer system 1600 splits the original incomplete command of the triangle, the rotation rectangle or the ellipse with the shape of the drawing area into a rule drawing command and several new irregular drawing commands according to the maximum inscribed rectangle. The split rule drawing command obtains a number of new rule drawing commands after the intersection detection, and one or more of the new rule drawing commands may be merged in the command combining operation, thereby being able to To some extent, the effect of eliminating excessive drawing is increased.

Optionally, as another embodiment, in the method for splitting each of the plurality of drawing commands into at least one first type drawing command and at least one according to the outsourcing rectangle information and the drawing area information. In the process of drawing a command of the second class, the processor 1602 is specifically configured to:

When the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of a plurality of triangles, and according to the cutting of the irregular polygon The sub-method divides the irregular drawing command into a plurality of third-type drawing commands, and the plurality of third-class drawing commands have a one-to-one correspondence with the drawing regions of the plurality of triangles;

In the embodiment of the present invention, the computer system 1600 splits the irregular polygon into a plurality of triangles, and then splits each triangle into a maximum inscribed rectangle and three corner regions, and according to the split region, the original The drawing command is split into a plurality of rule drawing commands and a plurality of new irregular drawing commands, and the split rule drawing commands obtain a plurality of new rule drawing commands after the intersection detection, and the plurality of new rule drawing commands are It is possible that one or more of them will be merged in the command merge operation, thereby increasing the effect of eliminating over-drawing to some extent.

Optionally, the processor 1602 is specifically configured to: according to the outsourcing rectangle information and the drawing area information, draw a command in the plurality of drawing commands, and an irregular drawing command in the multiple drawing commands by adopting an R+ tree algorithm. The split first drawing command and the second type drawing command are grouped into a plurality of drawing command sets, so that drawing commands belonging to different drawing command sets do not intersect each other.

In the embodiment of the present invention, the computer system 1600 can quickly perform drawing command grouping by using the R+ tree algorithm, and control each drawing command set after grouping to a certain scale, thereby reducing the time complexity of intersection detection, and greatly To a certain extent, the graphics processing efficiency of the graphics processing device is improved.

In addition, the computer system 1600 can also perform the functions of the FIG. 4 and FIG. 13 and implement the functions of the graphics processing apparatus in the embodiment shown in FIG. 4 and FIG.

FIG. 17 is a schematic diagram of another graphics processing method according to an embodiment of the present invention. The method of Figure 17 is performed by a graphics processing device. Specifically, the graphics processing device may be a computer system such as a graphics engine or the like, or a graphics processor such as a GPU chip, and the like. As shown in FIG. 17, the method includes:

S1710: Receive a command queue of the current frame input.

The command queue includes multiple application programming interfaces (Application Programming Interface, API) command.

S1720. Convert the plurality of API commands into multiple drawing commands.

Each of the drawing commands carries outsourcing rectangle information, execution content, drawing mode, and drawing area information, and the drawing mode includes an overlay mode, a mixed mode, or a standby mode.

In a specific application, the Skia module in the Android terminal can be modified, a class of delayed rendering function (SkDeferredMultiCanvas class) is created, and a command parsing module SkCommand is newly created, and the Skia drawing API is converted into an over-drawing culling engine to be recognized. The command.

S1730. Split each of the plurality of drawing commands into at least one first type drawing command and at least one second type drawing command according to the outsourcing rectangle information and the drawing area information.

The drawing area of the first type of drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is the drawing area corresponding to the irregular drawing command, and the at least one is removed. a drawing area remaining after the drawing area of the first type drawing command, the drawing mode of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, and the drawing mode of the at least one second type drawing command is waiting mode

For the specific implementation of step S1730, refer to the embodiment shown in step S420 and FIG. 5.

S1740. The rule drawing command in the plurality of drawing commands, and the first type drawing command and the second after the irregular drawing command in the plurality of drawing commands are split according to the outsourcing rectangle information and the drawing area information. Class drawing commands are grouped into multiple drawing command sets so that drawing commands belonging to different drawing command sets do not intersect each other.

For the specific implementation of step S1740, reference may be made to the embodiment shown in step 230.

S1750: Perform intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that the drawing commands in each drawing command set in the plurality of drawing command sets do not intersect each other.

S1760: Perform drawing command combining on the plurality of drawing command sets subjected to intersection detection according to the execution content, the drawing mode, and the drawing area information.

For the specific implementation of the steps S1750 and S1760, reference may be made to the prior art, and details are not described herein again.

S1770, performing a combined drawing command for each drawing command set.

When rendering the calling API, the command parsing module first parses the command into the command queue. When it needs to be displayed on the screen, the over-drawing culling engine is called to process the command queue, and the rendering task is cropped. Then execute the command to call the SkCanvas that actually performs the drawing.

Modify the Android Framework layer and call the new SkDeferredMultiCanvas instead of the original SkCanvas for drawing.

In the embodiment of the present invention, by converting a plurality of API commands in the command queue of the current frame into multiple drawing commands, the irregular drawing commands in the plurality of drawing commands are divided into rule drawing commands and irregularities according to the drawing area. Draw a command, and group the rule drawing command before splitting and the rule drawing command and the irregular drawing command into a plurality of disjoint drawing command sets, and then perform intersection detection and command respectively for each drawing command set. Merging, since dividing the drawing command into multiple drawing command sets and performing intersection detection can greatly reduce the time of intersection detection, and splitting the original irregular drawing command into a rule drawing command and an irregular drawing command, the split rule The drawing command obtains a number of new rule drawing commands after the intersection detection, and one or more of the several new rule drawing commands may be merged in the command combining operation, which can increase the elimination over-drawing to some extent. The effect of the graphics processing can be improved.

Optionally, as an embodiment, step S1730 is specifically implemented as:

Optionally, as another embodiment, step S1730 is specifically implemented as:

Optionally, step S1740 is specifically implemented by: using an R+tree algorithm, according to the outsourcing rectangle information and the drawing area information, the rule drawing command in the plurality of drawing commands, and the irregular drawing command in the plurality of drawing commands The split first type drawing command and the second type drawing command are grouped into a plurality of drawing command sets, so that drawing commands belonging to different drawing command sets do not intersect each other.

FIG. 18 is a schematic structural diagram of a graphics processing apparatus 1800 according to an embodiment of the present invention. As shown in FIG. 18, the graphics processing apparatus 1800 may include a command collection module 1801, a command conversion module 1802, a command splitting module 1803, a command grouping module 1804, an intersection detecting module 1805, a command combining module 1806, and an executing module 1807. among them,

The command collection module 1801 is configured to receive a command queue of a current frame input, where the command queue includes a plurality of API commands.

The command conversion module 1802 is configured to convert the plurality of API commands into a plurality of drawing commands, each of the drawing commands carrying outsourcing rectangle information, execution content, drawing mode, and drawing area information, where the drawing mode includes an overlay mode and a mixed mode. Or wait mode.

The command splitting module 1803 is configured to, according to the outsourcing rectangle information and the drawing area information, the plurality of Each of the irregular drawing commands in the drawing command is split into at least one first type drawing command and at least one second type drawing command. The drawing area of the first type of drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is the drawing area corresponding to the irregular drawing command, and the at least one is removed. a drawing area remaining after the drawing area of the first type drawing command, the drawing mode of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, and the drawing mode of the at least one second type drawing command is waiting mode.

The command grouping module 1804 is configured to: according to the outsourcing rectangle information and the drawing area information, the rule drawing command of the plurality of drawing commands, and the first drawing of the irregular drawing command of the plurality of drawing commands after the splitting The command and the second type of drawing command are grouped into a plurality of drawing command sets such that drawing commands belonging to different drawing command sets do not intersect each other.

The intersection detecting module 1805 is configured to perform intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that the drawing commands in each drawing command set in the plurality of drawing command sets do not intersect each other.

The command merging module 1806 is configured to separately perform drawing command merging on the plurality of drawing command sets that have undergone intersection detection according to the execution content, the drawing mode, and the drawing area information.

The execution module 1807 is configured to execute the merged drawing command for each drawing command set.

In the embodiment of the present invention, the graphics processing apparatus 1800 converts multiple API commands in the command queue of the current frame into multiple drawing commands, and then divides the irregular drawing commands of the multiple drawing commands into rules according to the drawing area. The command and the irregular drawing command, and the rule drawing command before the splitting and the split rule drawing command and the irregular drawing command are grouped into a plurality of mutually dissimilar drawing command sets, and then each drawing command set is separately performed. Intersection detection and command merging, since the drawing commands are grouped into multiple drawing command sets and then intersected detection can greatly reduce the time of intersection detection, and since the original irregular drawing command is split into a rule drawing command and an irregular drawing command, The divided rule drawing command obtains several new rule drawing commands after the intersection detection, and one or more of the several new rule drawing commands may be merged in the command combining operation, which can be to some extent Increase the effect of eliminating over-draw, which can improve the performance of graphics processing.

Optionally, as an embodiment, the command splitting module 1803 is specifically configured to:

And obtaining the maximum inscribed rectangle information of the irregular drawing command according to the outsourcing rectangle information and the drawing area information of the irregular drawing command.

Using the outsourcing rectangle information of the irregular drawing command and the maximum inscribed rectangle information, the irregularity is The drawing command is split into a first type drawing command and at least one second type drawing command, wherein the area corresponding to the first type drawing command is a maximum inscribed rectangle corresponding to the irregular drawing command, the at least one The drawing area corresponding to the second type of drawing command is a corner area of the drawing area corresponding to the irregular drawing command except the maximum inscribed rectangle.

In the embodiment of the present invention, the graphics processing apparatus 1800 splits the original irregular command of the triangle, the rotation rectangle, or the ellipse with the shape of the drawing area into a rule drawing command and several new irregular drawing according to the maximum inscribed rectangle. The command, the split rule drawing command obtains a number of new rule drawing commands after the intersection detection, and one or more of the new rule drawing commands may be merged in the command merge operation, thereby enabling To some extent, the effect of eliminating over-drawing is increased.

Optionally, as another embodiment, the command splitting module 1803 is specifically configured to:

When the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of a plurality of triangles, and the irregular drawing command is split according to the segmentation method of the irregular polygon. The method is divided into a plurality of third class drawing commands, and the plurality of third class drawing commands have a one-to-one correspondence with the drawing regions of the plurality of triangles.

For each third type drawing command, the maximum inscribed rectangle information of the third type drawing command is obtained according to the outsourcing rectangle information and the drawing area information of the third type drawing command.

In the embodiment of the present invention, the graphics processing apparatus 1800 splits the irregular polygon into a plurality of triangles, and then splits each triangle into a maximum inscribed rectangle and three corner regions, and according to the split region, The original drawing command is split into a plurality of rule drawing commands and a plurality of new irregular drawing commands, and the split rule drawing commands obtain a plurality of new rule drawing commands after the intersection detection, and the plurality of new rule drawing commands It is possible that one or more of them will be merged in the command merge operation, so that the effect of eliminating over-drawing can be increased to some extent.

Optionally, the command grouping module 1804 is specifically configured to: according to the outsourcing rectangle information and the drawing area information, draw a command in the plurality of drawing commands, and an irregular drawing command in the plurality of drawing commands by adopting an R+ tree algorithm. The first type of drawing command and the second type of drawing after splitting Commands are grouped into multiple drawing command sets so that drawing commands belonging to different drawing command sets do not intersect each other.

In the embodiment of the present invention, the graphics processing apparatus 1800 can quickly perform drawing command grouping by using the R+ tree algorithm, and control each drawing command set after grouping to a certain scale, thereby reducing the time complexity of the intersection detection. The graphics processing efficiency of the graphics processing device is greatly improved.

In addition, the graphics processing device 1800 can also perform the method of FIG. 17 and implement the functions of the graphics processing device in the embodiment shown in FIG.

In various embodiments of the above graphics processing apparatus, it should be understood that, in one implementation, the command collection module may be implemented by a communication interface, a command splitting module, a command grouping module, an intersection detecting module, and a command merge. The module, the execution module may be implemented by a processor executing a program or instruction in a memory (in other words, by a processor and a special instruction in a memory coupled to the processor); in another In the implementation mode, the command collection module, the command splitting module, the command grouping module, the intersection detecting module, the command combining module, and the executing module can also be implemented by an Application Specific Integrated Circuit (ASIC), and the specific implementation manner is as follows. The present invention is not limited to the foregoing embodiments; the present invention includes, but is not limited to, the foregoing implementations, and it should be understood that the solutions that are implemented according to the inventive concept are within the scope of the embodiments of the present invention.

A specific application method of the graphics processing apparatus in the embodiment of the present invention is shown in FIG. FIG. 19 is a schematic diagram of a specific process of graphics processing according to an embodiment of the present invention. In Figure 19, the application is a user-oriented product that requires physical support for graphics processing. Specifically, the application can be a web game, a CAD drawing tool, or the like. The graphics processing device 1800 can correspond to the implementation of the combination of software and hardware of the graphics engine, the processor driver and the processor shown in FIG. 19 (it should be understood that the graphics engine and the processor driver herein can be understood as programs stored in the memory). Or instruction). Specifically, the drawing command output by the application is processed by the graphics engine to obtain a series of new drawing commands, and the graphics engine sends the processed series of new drawing commands to the corresponding processor through the processor driver (for example, the graphics engine will process After a series of new drawing commands are sent to the DSP by Digital Signal Processing (DSP) driver, or sent to the CPU through the CPU driver, or sent to the GPU through the GPU driver, and then by the processor (for example) The DSP, CPU or GPU executes, and the final rendering result is output to a display device (such as the display unit in Fig. 20).

An exemplary implementation of the graphics processing apparatus will now be described with reference to FIG. 20. For ease of description, the graphics processing apparatus of the following embodiments are collectively referred to as a computer system:

FIG. 20 is a schematic structural diagram of a computer system 2000 according to an embodiment of the present invention. One embodiment of the present invention, as shown in FIG. 20, computer system 2000 can include a processor 2002, a memory 2004, a communication interface 2001, and a display interface 2003.

The processor 2002, the memory 2004, the communication interface 2001, and the display interface 2003 are interconnected by a communication architecture 2006. The communication architecture 2006 can be a bus or a network. Specifically, when the communication architecture 2006 is a bus, the bus may be an ISA bus, a PCI bus, or an EISA bus. The bus can be divided into an address bus, a data bus, a control bus, and the like. When the communication infrastructure 2006 is a network, the network may be a wired network, such as a fiber optic network, a telephone line, etc., or a wireless network such as a cell connection, a radio frequency connection, or other communication channel.

The display interface 2003 can be connected to the display unit 2005. The display unit 2005 includes a display (eg, a touch screen, an LCD, a CRT, a Holographic or Projector, etc.). The display interface 2003 is for outputting display data of the computer system 2000 to the display unit 2005, and is displayed by the display unit 2005. Specifically, the memory 2003 may further include a frame buffer, and the computer system 2000 processes the display data in the frame buffer, and outputs the data of the frame buffer to the display unit 2005 through the display interface 2003 after the processing. The display unit 2005 can be used to display information input by the user or information provided to the user and various menu interfaces in the device (eg, mobile terminal, computer, smart set top box, smart integrated machine, etc.) in which the graphics processing device is located. The display unit 2005 may include a display panel. Alternatively, the display panel may be configured in the form of an LCD (Liquid Crystal Display) or an OLED (Organic Light-Emitting Diode). Optionally, the display unit 2005 further includes a touch panel, and the touch panel is overlaid on the display panel to form a touch display screen.

The communication interface 2001 is for implementing communication between the computer system 2000 and devices external to the computer system 2000. Communication interface 2001 may convert data from computer system 2000 to signal 2007, via communication path 2008, or receive signal 2007 from communication path 2008 and convert to data. In particular, the communication interface 2001 can be a modem, a network interface (eg, an Ethernet interface), a communication port, a PCMCIA expansion slot, a PCMCIA expansion card, and the like. Signal 2007 can be an optical signal, an electrical signal, or other form of signal. The communication path 2008 can be a fiber optic network, a telephone line, a cell connection, a radio frequency connection, or other communication channel.

The memory 2004 is used to store programs. Specifically, the program may include program code, the process The sequence code includes computer operating instructions. Memory 2004 can include read only memory and random access memory and provides instructions and data to processor 2002. The memory 2004 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.

The processor 2002 executes the program stored in the memory 2004, and is specifically configured to perform the following operations:

Perform a merged draw command for each draw command set.

The method performed by the graphics processing apparatus disclosed in any of the embodiments of FIG. 17 of the present invention may be applied to the processor 2002 or implemented by the processor 2002. In an embodiment of the invention, computer system 2000 may include one or more processors 2002. Processor 2002 may be an integrated circuit chip with signal processing capabilities. In the implementation process, the steps of the above method can be adopted The integrated logic circuit of the hardware in the processor 2002 or the instruction in the form of software is completed. The processor 2002 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP Processor, etc.), or a digital signal processor (DSP), an application specific integrated circuit. (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or dedicated processor, such as a Graphic Processing Unit (PPU). The processor 2002 can implement or perform the various methods, steps, and logic blocks disclosed in the embodiments of the present invention. The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present invention may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor. The software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage medium is located in the memory 2003, and the processor 2002 reads the information in the memory 2004 and performs the steps of the above method in combination with its hardware.

In the embodiment of the present invention, the computer system 2000 converts multiple API commands in the command queue of the current frame into multiple drawing commands, and then splits the irregular drawing commands of the multiple drawing commands into rule drawing commands according to the drawing area. And irregularly drawing commands, and grouping the rule drawing commands before splitting and the split rule drawing commands and irregular drawing commands into a plurality of mutually disjoint drawing command sets, and then respectively intersecting each drawing command set Detection and command merging, since dividing the drawing command into multiple drawing command sets and performing intersection detection can greatly reduce the time of intersection detection, and splitting the original irregular drawing command into a rule drawing command and an irregular drawing command, splitting After the rule drawing command, after the intersection detection, several new rule drawing commands are obtained, and one or more of the new rule drawing commands may be merged in the command combining operation, which can be increased to some extent. Eliminate the effects of over-drawing, which can improve the performance of graphics processing.

Optionally, as an embodiment, in the method according to the outsourcing rectangle information and the drawing area information, splitting each of the plurality of drawing commands into at least one first type drawing command and at least one second In the process of class drawing commands, the processor 2002 is specifically used to:

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command, splitting the irregular drawing command into one first type drawing command and at least one second type drawing command, The area corresponding to the first type of drawing command is the largest inscribed rectangle corresponding to the irregular drawing command, and the drawing area corresponding to the at least one second type drawing command is the drawing area corresponding to the irregular drawing command except the maximum Connect the corner area outside the rectangle.

In the embodiment of the present invention, the computer system 2000 divides the original irregular command of the triangle, the rotation rectangle or the ellipse with the shape of the drawing area into a rule drawing command and several new irregular drawing commands according to the maximum inscribed rectangle. The split rule drawing command obtains a number of new rule drawing commands after the intersection detection, and one or more of the new rule drawing commands may be merged in the command combining operation, thereby being able to To some extent, the effect of eliminating excessive drawing is increased.

Optionally, as another embodiment, in the method for splitting each of the plurality of drawing commands into at least one first type drawing command and at least one according to the outsourcing rectangle information and the drawing area information. In the process of drawing a command of the second class, the processor 2002 is specifically used to:

Optionally, the processor 2002 is specifically configured to: according to the outsourcing rectangle information and the drawing area information, draw a command in the plurality of drawing commands, and the multiple drawing by adopting an R+tree algorithm The first type drawing command and the second type drawing command after the splitting of the irregular drawing command in the command are grouped into a plurality of drawing command sets, so that drawing commands belonging to different drawing command sets do not intersect each other.

In the embodiment of the present invention, the computer system 2000 splits the irregular polygon into a plurality of triangles, and then splits each triangle into a maximum inscribed rectangle and three corner regions, and according to the split region, the original The drawing command is split into a plurality of rule drawing commands and a plurality of new irregular drawing commands, and the split rule drawing commands obtain a plurality of new rule drawing commands after the intersection detection, and the plurality of new rule drawing commands are It is possible that one or more of them will be merged in the command merge operation, thereby increasing the effect of eliminating over-drawing to some extent.

In addition, the computer system 2000 can also perform the method of FIG. 17 and implement the functions of the graphics processing apparatus in the embodiment shown in FIG.

FIG. 21 is a schematic structural diagram of a graphic display system 2100 according to an embodiment of the present invention. As shown in FIG. 21, the graphic display system 2100 can include a graphics processing device 2101 and a graphics display device 2102. among them,

The graphics processing device 2101 may be the graphics processing device 1400 shown in the embodiment of FIG.

The graphic display device 2102 has a communication connection with the graphic processing device 2101 for displaying a graphic obtained by the graphic processing device executing the merged drawing command.

In the embodiment of the present invention, the graphic display system 2100 splits the irregular drawing command in the command queue of the current frame into a rule drawing command and an irregular drawing command according to the drawing area, and draws the command and splits the rule before the splitting. The following rule drawing command and irregular drawing command are grouped into a plurality of mutually dissimilar drawing command sets, and then each drawing command set is respectively subjected to intersection detection and command merging, and the drawing commands are grouped into a plurality of drawing command sets. Intersection detection can greatly reduce the time of intersection detection, and since the original irregular drawing command is split into a rule drawing command and an irregular drawing command, the split rule drawing command obtains several new rule drawing commands after the intersection detection. One or more of the several new rule drawing commands may be merged in the command merge operation, which can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing.

FIG. 22 is a schematic structural diagram of a graphic display system 2200 according to an embodiment of the present invention. As shown in FIG. 22, the graphic display system 2200 can include a graphics processing device 2201 and a graphics display device 2202. among them,

The graphics processing device 2201 may be the graphics processing device 1800 shown in the embodiment of FIG.

The graphic display device 2202 has a communication connection with the graphic processing device 2201 for displaying a graphic obtained by the graphic processing device executing the merged drawing command.

In the embodiment of the present invention, the graphic display system 2200 passes the command queue of the current frame. The API commands are converted into multiple drawing commands, and the irregular drawing commands of the plurality of drawing commands are divided into the rule drawing command and the irregular drawing command according to the drawing area, and the rules before the splitting are drawn and the commands are split. The rule drawing command and the irregular drawing command are grouped into a plurality of mutually dissimilar drawing command sets, and then each drawing command set is respectively subjected to intersection detection and command merging, and the drawing commands are grouped into a plurality of drawing command sets and then intersected. The detection can greatly reduce the time of intersection detection, and since the original irregular drawing command is split into the rule drawing command and the irregular drawing command, the split rule drawing command obtains several new rule drawing commands after the intersection detection. One or more of the several new rule drawing commands may be merged in the command merging operation, which can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing.

FIG. 23 is a schematic structural diagram of a graphic display system 2300 according to an embodiment of the present invention. As shown in FIG. 23, graphics display system 2300 can include computer system 2301 and graphics display device 2302. among them,

Computer system 2301 can be computer system 1600 shown in the embodiment of FIG.

The graphic display device 2302 has a communication connection with the computer system 2301 for displaying a graphic obtained by the computer system executing the merged drawing command.

In the embodiment of the present invention, the graphic display system 2300 splits the irregular drawing command in the command queue of the current frame into a rule drawing command and an irregular drawing command according to the drawing area, and draws the command and splits the rule before the splitting. The following rule drawing command and irregular drawing command are grouped into a plurality of mutually dissimilar drawing command sets, and then each drawing command set is respectively subjected to intersection detection and command merging, and the drawing commands are grouped into a plurality of drawing command sets. Intersection detection can greatly reduce the time of intersection detection, and since the original irregular drawing command is split into a rule drawing command and an irregular drawing command, the split rule drawing command obtains several new rule drawing commands after the intersection detection. One or more of the several new rule drawing commands may be merged in the command merge operation, which can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing.

FIG. 24 is a schematic structural diagram of a graphic display system 2400 according to an embodiment of the present invention. As shown in FIG. 24, graphics display system 2400 can include computer system 2401 and graphics display device 2402. among them,

Computer system 2401 may be computer system 2000 as shown in the embodiment of FIG.

The graphic display device 2402 has a communication connection with the computer system 2401 for displaying a graphic obtained by the computer system executing the merged drawing command.

In the embodiment of the present invention, the graphic display system 2400 converts multiple API commands in the command queue of the current frame into multiple drawing commands, and then presses the irregular drawing commands of the plurality of drawing commands. The drawing area is divided into a rule drawing command and an irregular drawing command, and the rule drawing command before splitting and the split rule drawing command and the irregular drawing command are grouped into a plurality of mutually disjoint drawing command sets, and then Each drawing command set performs intersection detection and command merging separately. Since the drawing commands are grouped into multiple drawing command sets and then intersected detection, the time of intersection detection can be greatly reduced, and the original irregular drawing command is split into rule drawing commands. And the irregular drawing command, the split rule drawing command obtains a number of new rule drawing commands after the intersection detection, and one or more of the several new rule drawing commands may be one or more in the command combining operation. Merging can increase the effect of eliminating over-drawing to a certain extent, thereby improving the performance of graphics processing.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

The function is implemented in the form of a software functional unit and sold or made as a standalone product When used, it can be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc., specifically, for example, a processor in a computer device) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

The above is only a specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims

A graphics processing method, comprising:

Receiving a command queue of the current frame input, the command queue includes a plurality of drawing commands, each of the drawing commands carrying outsourcing rectangle information, execution content, drawing mode and drawing area information, and the drawing mode includes an overlay mode and a mixed mode Or waiting mode;

Decoding, according to the outsourcing rectangle information and the drawing area information, each of the plurality of drawing commands into at least one first class drawing command and at least one second class drawing command, wherein the first class a drawing area of the drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and a drawing area of the at least one second type drawing command is the drawing area corresponding to the irregular drawing command, and the at least one first is removed a corner area remaining after the drawing area of the drawing command, the drawing mode of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, and the drawing mode of the at least one second type drawing command is Waiting mode

And dividing the rule drawing command of the plurality of drawing commands, and the first type drawing command after splitting the irregular drawing command of the plurality of drawing commands according to the outsourcing rectangle information and the drawing area information The second type of drawing commands are grouped into a plurality of drawing command sets, so that drawing commands belonging to different drawing command sets do not intersect each other;

Performing intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that the drawing commands in each drawing command set in the plurality of drawing command sets do not intersect each other;

And performing, according to the execution content, the drawing mode, and the drawing area information, the drawing command combination of the plurality of drawing command sets that have undergone the intersection detection;

Perform a merged draw command for each draw command set.
The method according to claim 1, wherein said splitting each of said plurality of drawing commands into at least one first according to said outsourcing rectangle information and said drawing area information The class drawing command and the at least one second class drawing command include:

Obtaining, according to the outsourcing rectangle information and the drawing area information of the irregular drawing command, the maximum inscribed rectangle information of the irregular drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command, splitting the irregular drawing command into one of the first class drawing command and at least one of the second class drawing commands, wherein An area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the irregular drawing command, and a drawing area corresponding to the at least one second type drawing command is the irregularity Then, the drawing area corresponding to the drawing command has a corner area other than the maximum inscribed rectangle.
The method according to claim 1, wherein said splitting each of said plurality of drawing commands into at least one first according to said outsourcing rectangle information and said drawing area information The class drawing command and the at least one second class drawing command include:

When the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of a plurality of triangles, and according to the segmentation method of the irregular polygon, the The rule drawing command is split into a plurality of third class drawing commands, and the plurality of third class drawing commands are in a one-to-one correspondence with the drawing regions of the plurality of triangles;

Obtaining a maximum inscribed rectangle information of the third type of drawing command according to the outsourcing rectangle information and the drawing area information of the third type drawing command for each third type drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the third class drawing command, splitting the third class drawing command into one of the first class drawing command and at least one of the second class drawing commands, wherein The area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the third type of drawing command, and the drawing area corresponding to the at least one second type of drawing command is a drawing corresponding to the third type of drawing command. The area of the corner except the maximum inscribed rectangle.
A graphics processing method, comprising:

Receiving a command queue of a current frame input, the command queue including a plurality of application programming interface API commands;

Converting the plurality of API commands into a plurality of drawing commands, each of the drawing commands carrying outsourcing rectangle information, execution content, drawing mode, and drawing area information, the drawing mode including an overlay mode, a mixed mode, or a waiting mode;

Decoding, according to the outsourcing rectangle information and the drawing area information, each of the plurality of drawing commands into at least one first class drawing command and at least one second class drawing command, wherein the first class a drawing area of the drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and a drawing area of the at least one second type drawing command is the drawing area corresponding to the irregular drawing command, and the at least one first is removed a corner area remaining after the drawing area of the drawing command, the drawing mode of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, and the drawing mode of the at least one second type drawing command is Waiting mode

And dividing the rule drawing command of the plurality of drawing commands, and the first type drawing command after splitting the irregular drawing command of the plurality of drawing commands according to the outsourcing rectangle information and the drawing area information The second type of drawing commands are grouped into multiple drawing command sets, so that they belong to different drawing The command commands of the command set do not intersect each other;

Performing intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that the drawing commands in each drawing command set in the plurality of drawing command sets do not intersect each other;

And performing, according to the execution content, the drawing mode, and the drawing area information, the drawing command combination of the plurality of drawing command sets that have undergone the intersection detection;

Perform a merged draw command for each draw command set.
The method according to claim 4, wherein said splitting each of said plurality of drawing commands into at least one first according to said outsourcing rectangle information and said drawing area information The class drawing command and the at least one second class drawing command include:

Obtaining, according to the outsourcing rectangle information and the drawing area information of the irregular drawing command, the maximum inscribed rectangle information of the irregular drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command, splitting the irregular drawing command into one of the first class drawing command and at least one of the second class drawing commands, wherein An area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the irregular drawing command, and a drawing area corresponding to the at least one second type drawing command is a drawing area corresponding to the irregular drawing command. The maximum inscribed corner area outside the rectangle.
The method according to claim 4, wherein said splitting each of said plurality of drawing commands into at least one first according to said outsourcing rectangle information and said drawing area information The class drawing command and the at least one second class drawing command include:

When the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of a plurality of triangles, and according to the segmentation method of the irregular polygon, the The rule drawing command is split into a plurality of third class drawing commands, and the plurality of third class drawing commands are in a one-to-one correspondence with the drawing regions of the plurality of triangles;

Obtaining a maximum inscribed rectangle information of the third type of drawing command according to the outsourcing rectangle information and the drawing area information of the third type drawing command for each third type drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the third class drawing command, splitting the third class drawing command into one of the first class drawing command and at least one of the second class drawing commands, wherein The area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the third type of drawing command, and the drawing area corresponding to the at least one second type of drawing command is a drawing corresponding to the third type of drawing command. The area of the corner except the maximum inscribed rectangle.
A graphics processing device, comprising:

a command collection module, configured to receive a command queue of a current frame input, where the command queue includes a plurality of drawing commands, each of the drawing commands carrying outsourcing rectangle information, execution content, drawing mode, and drawing area information, and the drawing mode Including overlay mode, mixed mode or standby mode;

a command splitting module, configured to split each of the plurality of drawing commands into at least one first type drawing command and at least one second type drawing command according to the outsourcing rectangle information and the drawing area information, The drawing area of the first type of drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is a drawing area corresponding to the irregular drawing command. Removing a corner area remaining after the drawing area of the at least one first type drawing command, the drawing mode of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, the at least one second The drawing mode of the class drawing command is the waiting mode;

a command grouping module, configured to, according to the outsourcing rectangle information and the drawing area information, the rule drawing command of the plurality of drawing commands, and the first drawing of the plurality of drawing commands by the irregular drawing command The class drawing command and the second class drawing command are grouped into a plurality of drawing command sets, so that drawing commands belonging to different drawing command sets do not intersect each other;

An intersection detecting module, configured to perform intersection detection on the plurality of drawing command sets according to the outsourcing rectangle information and the drawing area information, so that the drawing commands in each drawing command set in the plurality of drawing command sets do not intersect each other;

a command merging module, configured to respectively perform drawing command merging on the plurality of drawing command sets that have undergone intersection detection according to execution content, drawing mode, and drawing area information;

An execution module for executing the merged draw command for each draw command set.
The graphics processing device of claim 7, wherein the command splitting module is specifically configured to:

Obtaining, according to the outsourcing rectangle information and the drawing area information of the irregular drawing command, the maximum inscribed rectangle information of the irregular drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command, splitting the irregular drawing command into one of the first class drawing command and at least one of the second class drawing commands, wherein An area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the irregular drawing command, and a drawing area corresponding to the at least one second type drawing command is a drawing area corresponding to the irregular drawing command. The maximum inscribed corner area outside the rectangle.
A graphics processing apparatus according to claim 7, wherein said command splitting mode The block is specifically used to:

When the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of a plurality of triangles, and according to the segmentation method of the irregular polygon, the The rule drawing command is split into a plurality of third class drawing commands, and the plurality of third class drawing commands are in a one-to-one correspondence with the drawing regions of the plurality of triangles;

Obtaining a maximum inscribed rectangle information of the third type of drawing command according to the outsourcing rectangle information and the drawing area information of the third type drawing command for each third type drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the third class drawing command, splitting the third class drawing command into one of the first class drawing command and at least one of the second class drawing commands, wherein The area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the third type of drawing command, and the drawing area corresponding to the at least one second type of drawing command is a drawing corresponding to the third type of drawing command. The area of the corner except the maximum inscribed rectangle.
A graphics processing device, comprising:

a command collection module, configured to receive a command queue of a current frame input, where the command queue includes a plurality of application programming interface API commands;

a command conversion module, configured to convert the plurality of API commands into a plurality of drawing commands, each of the drawing commands carrying outsourcing rectangle information, execution content, drawing mode, and drawing area information, where the drawing mode includes an overlay mode, Mixed mode or standby mode;

a command splitting module, configured to split each of the plurality of drawing commands into at least one first type drawing command and at least one second type drawing command according to the outsourcing rectangle information and the drawing area information, The drawing area of the first type of drawing command is a rectangle in the drawing area corresponding to the irregular drawing command, and the drawing area of the at least one second type drawing command is a drawing area corresponding to the irregular drawing command. Removing a corner area remaining after the drawing area of the at least one first type drawing command, the drawing mode of the at least one first type drawing command is the same as the drawing mode of the irregular drawing command, the at least one second The drawing mode of the class drawing command is the waiting mode;

a command grouping module, configured to, according to the outsourcing rectangle information and the drawing area information, the rule drawing command of the plurality of drawing commands, and the first drawing of the plurality of drawing commands by the irregular drawing command The class drawing command and the second class drawing command are grouped into a plurality of drawing command sets, so that drawing commands belonging to different drawing command sets do not intersect each other;

An intersection detecting module, configured to map the plurality of pieces according to the outsourcing rectangle information and the drawing area information The command set respectively performs intersection detection, so that the drawing commands in each of the plurality of drawing command sets do not intersect each other;

a command merging module, configured to respectively perform drawing command merging on the plurality of drawing command sets that have undergone intersection detection according to execution content, drawing mode, and drawing area information;

An execution module for executing the merged draw command for each draw command set.
The graphics processing device of claim 10, wherein the command splitting module is specifically configured to:

Obtaining, according to the outsourcing rectangle information and the drawing area information of the irregular drawing command, the maximum inscribed rectangle information of the irregular drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the irregular drawing command, splitting the irregular drawing command into one of the first class drawing command and at least one of the second class drawing commands, wherein An area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the irregular drawing command, and a drawing area corresponding to the at least one second type drawing command is a drawing area corresponding to the irregular drawing command. The maximum inscribed corner area outside the rectangle.
The graphics processing device of claim 10, wherein the command grouping module is specifically configured to:

When the drawing area corresponding to the irregular drawing command is an irregular polygon, the drawing area of the irregular polygon is divided into a drawing area of a plurality of triangles, and according to the segmentation method of the irregular polygon, the The rule drawing command is split into a plurality of third class drawing commands, and the plurality of third class drawing commands are in a one-to-one correspondence with the drawing regions of the plurality of triangles;

Obtaining a maximum inscribed rectangle information of the third type of drawing command according to the outsourcing rectangle information and the drawing area information of the third type drawing command for each third type drawing command;

Using the outsourcing rectangle information and the maximum inscribed rectangle information of the third class drawing command, splitting the third class drawing command into one of the first class drawing command and at least one of the second class drawing commands, wherein The area corresponding to the first type of drawing command is a maximum inscribed rectangle corresponding to the third type of drawing command, and the drawing area corresponding to the at least one second type of drawing command is a drawing corresponding to the third type of drawing command. The area of the corner except the maximum inscribed rectangle.
A graphic display system, comprising:

A graphics processing apparatus according to any one of claims 7 to 9, and

The graphic display device has a communication connection with the graphic processing device for displaying a graphic obtained by the graphic processing device executing the merged drawing command.
A graphic display system, comprising:

A graphics processing apparatus according to any one of claims 10 to 12, and

The graphic display device has a communication connection with the graphic processing device for displaying a graphic obtained by the graphic processing device executing the merged drawing command.