JP7471512B2 - Drawing processing device, drawing processing system, drawing processing method, and drawing processing program - Google Patents

Description

The present disclosure relates to a drawing processing device that performs processing to draw drawing information, a drawing processing system that uses the drawing processing device, a drawing processing method, and a drawing processing program.

Two-dimensional, three-dimensional, and other model objects may be displayed on a display device such as a monitor. In this case, two-dimensional objects are drawn directly into the destination buffer, which is the buffer to which the objects are drawn, while three-dimensional objects are projected into two dimensions and then drawn into the destination buffer. When the center of a pixel in the destination buffer falls within the object, that pixel is filled and the object is drawn. Note that objects come in a variety of sizes, from small objects less than one pixel to objects that span several pixels.

Patent Document 1 discloses a technique for drawing such objects. Patent Document 1 discloses a technique in which a drawing processing device renders only specific objects, such as small characters and thin lines, at high resolution, and renders other objects at low resolution.

JP 2009-274366 A

However, in the conventional drawing processing device described above, high-resolution rendering refers to performing processing on a pixel-by-pixel basis for all pixel positions, while low-resolution rendering refers to performing processing on a multi-pixel basis only for pixel positions with even values in the X and Y coordinates. Therefore, for example, if a small drawing object with a drawing size of less than one pixel is not positioned at the center of a pixel, the drawing object will not be drawn and will disappear from the display screen.

The present disclosure has been made to solve the above-mentioned problems, and aims to provide a drawing processing device, a drawing processing system, a drawing processing method, and a drawing processing program that can draw a drawing object and display the drawing object on a display screen even if the drawing object is not located at the center of a pixel in two or more dimensions.

The drawing processing device according to the present disclosure includes a dotting unit that draws dots on pixels in a buffer corresponding to a position of a drawing object in two or more dimensions, and draws the drawing object in the buffer; an output control unit that controls the scene drawn in the buffer to be output to an output device; an application determination unit that determines whether the drawing object is a first drawing object to be drawn in a first buffer that is a drawing destination, or a second drawing object to be drawn in a second buffer that is a buffer different from the first buffer; a first drawing object drawing unit that draws the drawing object determined to be the first drawing object by the application determination unit in the first buffer; and a blending processing unit that alpha-blends the second buffer into the first buffer with an alpha value that represents the transparency of the drawing object, wherein the buffer is the second buffer, the dotting unit draws dots on pixels in the second buffer that correspond to the position of the second drawing object, and draws the second drawing object in the second buffer, and the output control unit controls the scene drawn in the first buffer after alpha blending to be output to the output device .

The present disclosure relates to a drawing processing system, which includes: an input device that accepts an input of a two or more dimensional drawing object; and a drawing processing device that performs drawing processing to draw the drawing object as a scene in a buffer;
and an output device that outputs the scene, wherein the drawing processing device comprises a dotting unit that draws dots on pixels in the buffer corresponding to a position of the drawing object, and draws the drawing object in the buffer; an output control unit that controls so as to output the scene drawn in the buffer to the output device ; an application determination unit that determines whether the drawing object is a first drawing object to be drawn in a first buffer that is a drawing destination, or a second drawing object to be drawn in a second buffer that is a buffer different from the first buffer; a first drawing object drawing unit that draws the drawing object determined to be the first drawing object by the application determination unit in the first buffer; and a blending processing unit that alpha-blends the second buffer into the first buffer with an alpha value that represents a transparency of the drawing object, wherein the buffer is the second buffer, and the dotting unit draws dots on pixels in the second buffer corresponding to a position of the second drawing object, and the output control unit controls so as to output the alpha-blended scene drawn in the first buffer to the output device .

The drawing processing method according to the present disclosure includes a step of a dotting unit dotting pixels in a buffer corresponding to a position of a two or more dimensional drawing object, and drawing the drawing object in the buffer; a step of an output control unit controlling the output of the scene drawn in the buffer to an output device ; a step of an application determination unit determining whether the drawing object is a first drawing object to be drawn in a first buffer that is a drawing destination, or a second drawing object to be drawn in a second buffer that is a buffer different from the first buffer; a step of a first drawing object drawing unit drawing the drawing object determined to be the first drawing object by the application determination unit in the first buffer; and a step of a blending processing unit alpha-blending the second buffer into the first buffer with an alpha value representing the transparency of the drawing object, wherein the buffer is the second buffer, the dotting unit dotting pixels in the second buffer corresponding to the position of the second drawing object, and drawing the second drawing object in the second buffer, and the output control unit controlling the output of the alpha-blended scene drawn in the first buffer to the output device .

A drawing processing program according to the present disclosure causes a computer to perform the following processes: drawing dots on pixels in a buffer corresponding to a position of a drawing object in two or more dimensions, and drawing the drawing object in the buffer; controlling the computer to output the scene drawn in the buffer to an output device; determining whether the drawing object is a first drawing object to be drawn in a first buffer that is a drawing destination, or a second drawing object to be drawn in a second buffer that is a buffer different from the first buffer; drawing the drawing object determined to be the first drawing object in the determining process in the first buffer; and alpha-blending the second buffer with the first buffer using an alpha value that represents the transparency of the drawing object, the buffer being the second buffer; and controlling the computer to draw dots on pixels in the second buffer corresponding to the position of the second drawing object, and draw the second drawing object in the second buffer, and output the alpha-blended scene drawn in the first buffer to the output device .

According to the present disclosure, the dotting unit puts a dot on a pixel in the buffer corresponding to the position of a drawing object in two or more dimensions, draws the drawing object in the buffer, and the output control unit controls so as to output the scene drawn in the buffer to an output device, so that even if the drawing object in two or more dimensions is not located at the center of the pixel, the drawing object can be drawn and displayed on the display screen.

1 is a block diagram of a drawing processing system including a drawing processing device according to a first embodiment; FIG. 2 is a hardware configuration diagram of the drawing processing system according to the first embodiment. 4 is a flowchart showing the operation of the drawing processing system according to the first embodiment. 4 is an example of drawing information according to the first embodiment. 4 is a flowchart showing the operation of the drawing processing device according to the first embodiment; FIG. 2 is a diagram of a destination buffer and a detail buffer in the first embodiment. 13 is a diagram showing a rendering result of a polygon model to which the non-applied rendering is to be rendered in a rendering destination buffer superimposed on the polygon model to which the non-applied rendering is to be rendered. FIG. 13A and 13B are diagrams showing the rendering result of a polygon model that is a non-applied rendering target, which is rendered in a destination buffer. 1 is a conceptual diagram showing how a three-dimensional object to be rendered is projected and transformed into two dimensions using a bounding box to roughly calculate the area of the object to be rendered. 13 is a diagram showing a result of drawing a polygon model to be applied to a detail buffer superimposed on a plurality of polygon models. 13A and 13B are diagrams showing the rendering results of a polygon model that is an application rendering target, which is rendered in a detail buffer. 13 is a diagram showing a drawing result obtained by drawing a polygon model of an application drawing target in a detail buffer, a drawing result obtained by drawing a polygon model of another application drawing target in a detail buffer, and a plurality of polygon models superimposed on each other. FIG. 13A and 13B are diagrams showing a rendering result obtained by rendering a polygon model of an application rendering target in a detail buffer and a rendering result obtained by rendering a polygon model of another application rendering target in a detail buffer. This figure shows the drawing result of a polygon model of an applied drawing target drawn in a detail buffer, the drawing result of a polygon model of another applied drawing target drawn in a detail buffer, and the drawing result of a further polygon model of an applied drawing target drawn in a detail buffer superimposed with multiple polygon models. A figure showing the drawing result of a polygon model of an applied drawing target drawn in a detail buffer, the drawing result of a polygon model of another applied drawing target drawn in a detail buffer, and the drawing result of a further polygon model of an applied drawing target drawn in a detail buffer. FIG. 13 shows the rendering result when all polygon models are rendered in the rendering destination buffer. FIG. 11 is a block diagram of a drawing processing system including a drawing processing device according to a second embodiment. 10 is a flowchart showing an operation of a drawing processing system according to a second embodiment of the present disclosure. 10 is a flowchart showing an operation of a drawing processing device according to a second embodiment of the present disclosure. FIG. 11 is a block diagram of a drawing processing system including a drawing processing device according to a third embodiment. 13 is a flowchart showing the operation of a drawing processing device according to a third embodiment of the present disclosure. 13 is a diagram showing a comparison between a detail buffer corresponding to a polygon model to which the third embodiment is applied and the detail buffer of the first embodiment. FIG. A figure showing a detail buffer corresponding to a polygon model that is an application drawing target in embodiment 3, another detail buffer corresponding to a polygon model that is another application drawing target, and yet another detail buffer corresponding to a polygon model that is yet another application drawing target. 13 is a diagram showing a schematic representation of position information, which is information indicating where in the destination buffer the detail buffer corresponds; FIG. FIG. 13 is a diagram showing a schematic representation of position information, which is information indicating to which position in the destination buffer another detail buffer corresponds; FIG. 13 is a diagram showing a schematic representation of position information, which is information indicating to which position in the destination buffer a detail buffer corresponds; This is a diagram showing an example of position information that combines information on where a detail buffer corresponds to where in the destination buffer, information on where another detail buffer corresponds to where in the destination buffer, and information on where yet another detail buffer corresponds to where in the destination buffer. 13 is a diagram showing a drawing result obtained by drawing a polygon model of an applied drawing target in a detail buffer, a drawing result obtained by drawing a polygon model of another applied drawing target in another detail buffer, and multiple polygon models of applied drawing targets superimposed on each other. 13A and 13B are diagrams showing a rendering result obtained by rendering a polygon model of an application rendering target in a detail buffer and a rendering result obtained by rendering a polygon model of another application rendering target in another detail buffer. This figure shows the drawing result of a polygon model of an applied drawing target drawn in a detail buffer, the drawing result of a polygon model of another applied drawing target drawn in a detail buffer, and the drawing result of a further polygon model of an applied drawing target drawn in a detail buffer superimposed with multiple polygon models. A figure showing the drawing result of a polygon model of an applied drawing target drawn in a detail buffer, the drawing result of a polygon model of another applied drawing target drawn in a detail buffer, and the drawing result of a further polygon model of an applied drawing target drawn in a detail buffer.

Embodiment 1.
In embodiment 1, as an example, a case in which the present disclosure is applied to a case in which the drawing information, which is information about the drawing of the entire scene, contains a drawing target that is not located at the center of a pixel is described below.

In a drawing processing system to which the present disclosure is applied, drawing targets are first divided into applied drawing targets that are drawn in the drawing destination buffer after applying detailed drawing processing that performs detailed drawing, and non-applied drawing targets that are drawn directly in the drawing destination buffer without applying detailed drawing processing. The drawing processing system draws the non-applied drawing targets directly in the drawing destination buffer, calculates the area of the applied drawing targets, and determines an alpha value representing the transparency of the applied drawing targets from the calculated area. The drawing processing system draws the applied drawing targets in a detailed buffer that is a buffer different from the drawing destination buffer, and obtains the number of drawn pixels. From the number of drawn pixels obtained for each applied drawing target, the drawing processing system identifies the lost applied drawing targets that are the applied drawing targets that have not been drawn in the detailed buffer and have disappeared, and draws a dot in the pixel in the detailed buffer that corresponds to the position of the lost applied drawing target, and draws the lost applied drawing target in the detail buffer. The drawing processing system draws the lost applied drawing targets in the drawing destination buffer by alpha blending the RGB values of the lost applied drawing targets with the alpha value of the lost applied drawing targets at the pixels corresponding to the lost applied drawing targets drawn in the detail buffer. By doing so, even if the drawing object is not positioned at the center of a pixel, the drawing object can be drawn and displayed on the display screen. This will be described in detail below.

Figure 1 is a block diagram of a drawing processing system 1 including a drawing processing device 100 according to embodiment 1. The drawing processing system 1 includes an input device 4 to which tag information indicating whether detailed drawing processing is to be applied to each drawing target included in the drawing information and the drawing information are input, a drawing processing device 100 that performs processing to draw the drawing information using the drawing information and the tag information, and an output device 5 that outputs a scene processed by the drawing processing device 100.

The input device 4 accepts drawing information for the entire scene, including information on drawing targets, such as polygon models, input by the user. The user tags each drawing target as either an applicable drawing target or an inapplicable drawing target, based on the drawing size, brightness, importance, etc. of the drawing target. The input device 4 accepts the tagging of each drawing target by the user as tag information.

The rendering processing device 100 performs a rendering process to render the rendering information as a scene in the rendering destination buffer. Specifically, the rendering processing device 100 renders the non-applied rendering target tagged as not applying the detailed rendering process in the rendering destination buffer. The rendering processing device 100 calculates the area of the applied rendering target tagged as applying the detailed rendering process, and determines an alpha value representing the transparency of the applied rendering target from the calculated area. The rendering processing device 100 renders the applied rendering target in a detailed buffer, which is a buffer different from the rendering destination buffer, and obtains the number of rendered pixels. From the number of rendered pixels obtained for each applied rendering target, the rendering processing device 100 identifies the lost applied rendering target, which is the applied rendering target that has not been rendered in the detailed buffer and has disappeared, and draws a dot in the pixel in the detailed buffer corresponding to the position of the lost applied rendering target, and renders the lost applied rendering target in the detailed buffer. The rendering processing device 100 alpha-blends the RGB values of the lost applied rendering target with the alpha value of the lost applied rendering target at the pixel corresponding to the lost applied rendering target rendered in the detail buffer, thereby rendering the lost applied rendering target in the rendering destination buffer. In this way, by marking a pixel in the detail buffer corresponding to the position of the loss-adapted drawing object and drawing the loss-adapted drawing object in the detail buffer, the drawing object can be drawn and displayed on the display screen even if the drawing object is not located at the center of the pixel.

The output device 5 outputs the scene drawn in the destination buffer by the drawing processing device 100. The output device 5 is, for example, a display device such as a display, and displays the scene drawn in the destination buffer by the drawing processing device 100.

Next, the drawing processing device 100 will be described below, also using Figure 1.

The drawing processing device 100 includes an acquisition unit 101 that acquires drawing information and tag information including a drawing target from the input device 4, a creation unit 102 that creates a drawing destination buffer and a detail buffer, an application determination unit 106 that uses the tag information to determine whether the drawing target is an unapplied drawing target to be drawn in the drawing destination buffer or an applied drawing target to be drawn in a detail buffer that is a buffer different from the drawing destination buffer, depending on whether or not the drawing target is to be subjected to detailed drawing processing, a unapplied drawing target drawing unit 107 that draws in the drawing destination buffer an unapplied drawing target tagged as not to be subjected to detailed drawing processing, a calculation unit 104 that calculates the area of an applied drawing target tagged as being subjected to detailed drawing processing, a determination unit 105 that determines the alpha value of the applied drawing target from the calculated area, and an applied drawing target drawing unit that draws the applied drawing target in the detail buffer and acquires the number of pixels drawn. a dotting unit 112 for identifying a lost applied drawing target that is an applied drawing target that has not been drawn in the detail buffer and has disappeared from the number of drawn pixels acquired for each applied drawing target, and for drawing the lost applied drawing target in the detail buffer by dotting a pixel in the detail buffer corresponding to the position of the lost applied drawing target, a blending processing unit 110 for drawing the applied drawing target including the lost applied drawing target in the drawing destination buffer by alpha-blending the RGB values of the applied drawing target including the lost applied drawing target with the alpha values of the applied drawing target including the lost applied drawing target in response to the pixels painted in the detail buffer, an output control unit 111 for controlling the output device 5 to output the scene drawn in the drawing destination buffer, a drawing destination buffer storage unit 103 for storing the drawing destination buffer, and a detail buffer storage unit 109 for storing the detail buffer. The drawing destination buffer corresponds to the first buffer, and the detail buffer corresponds to the second buffer. The non-applied drawing target corresponds to the first drawing target, and the applied drawing target corresponds to the second drawing target. The non-applied drawing target drawing unit 107 corresponds to the first drawing target drawing unit, and the applied drawing target drawing unit 108 corresponds to the second drawing target drawing unit.

Next, we will explain the hardware configuration of the drawing processing system 1 relating to embodiment 1.

Figure 2 is a hardware configuration diagram of the drawing processing system 1 according to embodiment 1. Using Figure 2, the configuration of the drawing processing system 1 including the drawing processing device 100 according to embodiment 1 will be described.

The drawing processing system 1, as an example, is composed of a bus 41, a CPU (Central Processing Unit) 42, a main memory 43, a GPU (Graphics Processing Unit) 44, a graphics memory 45, an input interface 46, and an output interface 47.

The bus 41 is a signal path that electrically connects each device and exchanges data. The devices and equipment of the drawing processing system 1 are connected via communication. The communication used may be wired communication or wireless communication.

The CPU 42 reads and executes a program stored in the main memory 43. Specifically, the CPU 42 loads at least a part of the OS (Operating System) stored in the main memory 42, and executes the program while executing the OS. The CPU 42 connects to other devices via the bus 41 and controls the devices. The CPU 42 may be a microprocessor, a microcomputer, or a DSP (Digital Signal Processor) as long as it is an IC (Integrated Circuit) that performs processing.

The main memory 43 stores a program that describes software, firmware, or a combination of software and firmware, and an OS. The main memory 43 also stores various information, etc. The main memory 43 is, for example, a volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory), a non-volatile semiconductor memory such as a HDD (Hard Disk Drive), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD (Digital Versatile Disc), or a portable recording medium.

The GPU 44 reads a program stored in the graphic memory 45 and executes the drawing process. Specifically, the GPU 44 loads at least a part of the OS stored in the graphic memory 45 and executes the drawing process program while running the OS. The acquisition unit 101, creation unit 102, application determination unit 106, non-applied drawing target drawing unit 107, calculation unit 104, decision unit 105, applied drawing target drawing unit 108, dotting unit 112, blend processing unit 110, and output control unit 111 of the drawing processing device 100 are realized by the GPU 44 reading and executing the program loaded in the graphic memory 45.

The graphic memory 45 stores a program and an OS in which software, firmware, or a combination of software and firmware is written. The graphic memory 45 also stores various information. The graphic memory 45 is, for example, a volatile semiconductor memory such as a RAM, a non-volatile semiconductor memory such as a ROM, a flash memory, an EPROM, an EEPROM, or a HDD, or a portable recording medium such as a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD. The acquisition unit 101, the creation unit 102, the application determination unit 106, the non-application drawing target drawing unit 107, the calculation unit 104, the determination unit 105, the application drawing target drawing unit 108, the dotting unit 112, the blend processing unit 110, and the output control unit 111 of the drawing processing device 100 are realized by a program stored in the graphic memory 45. Furthermore, a destination buffer storage unit 103 for storing the destination buffer and a detail buffer storage unit 109 for storing the detail buffer are realized by the graphic memory 45 .

The graphics memory 45 may realize the functions of the acquisition unit 101, creation unit 102, application determination unit 106, non-applied drawing target drawing unit 107, calculation unit 104, decision unit 105, applied drawing target drawing unit 108, dotting unit 112, blend processing unit 110, and output control unit 111 of the drawing processing device 100 in separate memories. Also, the drawing destination buffer storage unit 103 and detail buffer storage unit 109 may be realized in separate memories.

In the first embodiment, the processing including the drawing processing performed by the drawing processing device 100 is performed by the GPU 44 and the graphic memory 45, and the processing other than the processing including the drawing processing performed by the drawing processing device 100 is performed by the CPU 42 and the main memory 43. Note that the drawing processing system 1 may have only one of the CPU 42 and the GPU 44, which may realize all the processing. Also, the drawing processing system 1 may have only one of the main memory 43 and the graphic memory 45, which may realize the same function as the memory that is not included. Information of each part may be stored in either the main memory 43 or the graphic memory 45. Also, information of each part may be stored in a combination of the main memory 43 and the graphic memory 45.

The input interface 46 is a device that allows drawing information and tag information to be input. The input interface 46 is, for example, an input using a keyboard, mouse, voice input, etc., and receiving information via communication. The input device 4 is realized by the input interface 46.

The output interface 47 is a device that outputs the drawn scene. The output interface 47 is, for example, a display device such as a display or a projector. The output device 5 is realized by the output interface 47.

Each function of the drawing processing system 1 can be realized by hardware, software, firmware, or a combination of these. Each function of the drawing processing system 1 may be realized partially by dedicated hardware and partially by software or firmware. For example, part of the function of the drawing processing system 1 may be realized by a processing circuit as dedicated hardware, and the remaining part may be realized by a CPU reading and executing a program stored in memory. The software, firmware, or a combination of software and firmware may be written as a program.

Next, the operation of the drawing processing system 1 will be described.

Figure 3 is a flowchart showing the operation of the drawing processing system 1 according to embodiment 1. The operation of the drawing processing system 1 will be described below with reference to Figure 3.

In step S1, the input device 4 accepts input of drawing information including a drawing target. For example, a user uses a mouse, keyboard, etc. to specify drawing information and input it to the input device 4, and the input device 4 accepts the input.

The drawing information received by the input device 4 may be any type of information, such as drawing information received via communication without being specified by the user, drawing information automatically extracted that satisfies predetermined criteria, drawing information extracted by machine learning, etc. In the first embodiment, for example, the drawing target is a three-dimensional polygon model, and the drawing information includes information on the drawing target which is a polygon model. The information on the drawing target which is a polygon model includes RGB values, position information, etc.

Figure 4 is an example of drawing information in embodiment 1. The drawing information includes polygon model 51, polygon model 52, polygon model 53, and polygon model 54, which are the drawing targets. Note that in Figure 4, polygon models 51 to 54 are shown as if they were drawn on a buffer of the same size as the drawing destination buffer, so as to make the drawing flow easier to understand.

Returning to FIG. 3, the input device 4 receives input of tag information, which is information indicating whether the drawing targets included in the received drawing information are applicable drawing targets or non-applicable drawing targets, together with the drawing information. The tag information corresponds to each drawing target.

For example, the user determines for each drawing target based on the drawing size whether the polygon model to be drawn is large enough that detailed drawing processing is not required, or whether the polygon model to be drawn is small enough that detailed drawing processing is required. The user inputs tag information tagging each drawing target into the input device 4 using a mouse, keyboard, voice input, etc., with drawing targets determined to be large as non-applicable drawing targets and drawing targets determined to be small as applicable drawing targets. The input device 4 accepts the input.

In the first embodiment, it is assumed that, with respect to the drawing information in Fig. 4, the user has determined that polygon models 51 to 53 are small enough in size to require detailed drawing processing, and that polygon model 54 is large enough in size that detailed drawing processing is not required. It is assumed that the input device 4 has received tag information input by the user, in which polygon model 51 is tagged as an applicable drawing target, tag information in which polygon model 52 is tagged as an applicable drawing target, tag information in which polygon model 53 is tagged as an applicable drawing target, and tag information in which polygon model 54 is tagged as a non-applicable drawing target.

Note that the criteria for determining whether a drawing target is an applied drawing target or a non-applied drawing target are not limited to the size of the drawing target. For example, the user may determine whether a drawing target is an applied drawing target or a non-applied drawing target based on luminance, importance, etc. The user may also determine whether a drawing target is an applied drawing target or a non-applied drawing target based on a combination of the drawing size, luminance, importance, etc. Specifically, the user may determine a drawing target that is determined to be of high importance and that the user does not want to disappear as an applied drawing target, and a drawing target that is of low importance as a non-applied drawing target. The user may also determine a drawing target as an applied drawing target if its size is equal to or smaller than a predetermined size and its luminance is equal to or greater than a predetermined luminance, and other drawing targets as non-applied drawing targets. The determination of whether a drawing target is an applied drawing target or a non-applied drawing target may be determined based on the user's preference.

Returning to Figure 3, the input device 4 transmits the drawing information and tag information to the drawing processing device 100 and proceeds to step S2.

In step S2, the drawing processing device 100 receives drawing information and tag information from the input device 4. The drawing processing device 100 performs drawing processing using the received drawing information and tag information. Details will be described later. The drawing processing device 100 controls the output device 5 to output the scene drawn in the destination buffer, and proceeds to step S3.

In step S3, the output device 5 outputs the scene drawn in the destination buffer to a display device such as a display under the control of the drawing processing device 100.

After step S3 is executed, the process returns to step S1, and the above-described process is repeated until a trigger for terminating the process occurs, such as turning off the power or performing an end operation. Note that although the above-described process is repeated, it is also possible to perform the process only once without repeating it.

Next, the operation of the drawing processing device 100 will be described.

Figure 5 is a flowchart showing the operation of the drawing processing device 100 according to embodiment 1. The operation of the drawing processing device 100 will be described below with reference to Figure 5.

In step S11, the acquisition unit 101 acquires drawing information and tag information from the input device 4. The acquisition unit 101 transmits the drawing information and tag information to the creation unit 102 and proceeds to step S12.

In step S12, the creation unit 102 receives the drawing information and tag information from the acquisition unit 101, and creates a drawing destination buffer in the drawing destination buffer storage unit 103. The creation unit 102 also creates a detail buffer in the detail buffer storage unit 109. All applicable drawing targets are drawn in the detail buffer. The detail buffer has the same resolution as the drawing destination buffer.

Figure 6 is a diagram of the destination buffer 55 and the detail buffer 56 in embodiment 1. In embodiment 1, the destination buffer 55 is 8 pixels high and 8 pixels wide, for a total of 64 pixels. The detail buffer 56 is also 8 pixels high and 8 pixels wide, for a total of 64 pixels. In other words, the detail buffer 56 has the same resolution as the destination buffer 55.

Returning to Figure 5, the creation unit 102 transmits the drawing information and tag information to the application determination unit 106 and proceeds to step S13.

In step S13, the application determination unit 106 receives the drawing information and tag information from the creation unit 102, and uses the tag information to determine whether the drawing target is an applied drawing target or a non-applied drawing target. The application determination unit 106 transmits the drawing information and all of the tag information of the drawing target that is a non-applied drawing target to the non-applied drawing target drawing unit 107. The non-applied drawing target drawing unit 107 receives the drawing information and the tag information of the drawing target that is a non-applied drawing target from the application determination unit 106, and draws the non-applied drawing target in the drawing destination buffer of the drawing destination buffer memory unit 103.

In the first embodiment, the application determination unit 106 transmits the drawing information and the tag information of the polygon model 54 tagged as a non-applicable drawing target to the non-applicable drawing target drawing unit 107 in response to the drawing information in FIG. 4. The non-applicable drawing target drawing unit 107 receives the drawing information and the tag information of the polygon model 54 tagged as a non-applicable drawing target from the application determination unit 106, and draws the polygon model 54 in the drawing destination buffer 55 of the drawing destination buffer storage unit 103.

Figure 7 is a diagram superimposing the non-applied drawing target polygon model 54 and the drawing result 57 of the non-applied drawing target polygon model 54 drawn in the drawing destination buffer 55. As shown in the drawing result 57 in Figure 7, the non-applied drawing target drawing unit 107 fills the pixels of the drawing destination buffer 55 with the RGB values associated with the drawing target included in the drawing information so as to resemble the shape of the polygon model 54.

Figure 8 shows the rendering result 57 of the polygon model 54 to be rendered as a non-applied rendering target, rendered in the rendering destination buffer 55. Figure 8 shows only the actual rendering result 57, without the superimposed display of the polygon model 54 in Figure 7.

Returning to Figure 5, when the non-applicable drawing target drawing unit 107 finishes drawing the non-applicable drawing target in the destination buffer, the non-applicable drawing target drawing unit 107 sends a notification of the end of drawing in the destination buffer to the application processing unit 106 and the blending processing unit 110, and proceeds to step S14.

In step S14, when the application determination unit 106 receives a notification of the end of drawing to the destination buffer from the non-applied drawing target drawing unit 107, it transmits the drawing information and tag information of the drawing target that is the applied drawing target to the calculation unit 104.

In embodiment 1, the application determination unit 106 transmits to the calculation unit 104 the drawing information of Figure 4, the tag information of polygon model 51 tagged as an application drawing target, the tag information of polygon model 52 tagged as an application drawing target, and the tag information of polygon model 53 tagged as an application drawing target.

The calculation unit 104 receives drawing information and tag information of the drawing target that is the applied drawing target from the application determination unit 106, and calculates the area of the applied drawing target. The area may be calculated accurately for each applied drawing target, or may be approximated using a bounding box or the like to roughly estimate the area of each applied drawing target. In the case of a three-dimensional applied drawing target, the applied drawing target is projected into two dimensions and then the area of the applied drawing target is calculated.

Figure 9 is a conceptual diagram showing how a three-dimensional drawing object 81 is projected into two dimensions using a bounding box 80 to estimate the area of the drawing object 81. For example, one method of approximating the area of the drawing object 81 is to surround the three-dimensional house-shaped drawing object 81 with a bounding box 80, and use the area 82 of the bounding box 80 corresponding to the surface to be projected into two dimensions as an estimate of the area of the drawing object 81 when the three-dimensional drawing object 81 is projected into two dimensions.

In Fig. 9, one face of the bounding box 80 overlaps exactly with the surface to be projected into two dimensions, but even if one face of the bounding box 80 does not overlap, if the bounding box 80 is projected onto the surface to be projected into two dimensions, an approximate value of the area of the drawing object 81 when the three-dimensional drawing object 81 is projected into two dimensions can be obtained. Also, although Fig. 9 explains parallel projection, it is also applicable to perspective projection, etc.

In this way, by projecting the three-dimensional drawing object 81 into two dimensions using the bounding box 80 and estimating the area of the drawing object 81, the drawing process load can be reduced compared to projecting the drawing object 81 directly into two dimensions and calculating the area of the drawing object 81. Note that the more complex the shape of the drawing object 81, the higher the drawing process load, so the more complex the shape of the drawing object 81, the more effective it is at reducing the drawing process load when projecting the three-dimensional drawing object 81 into two dimensions using the bounding box 80 and estimating the area of the drawing object 81.

Returning to Figure 5, in embodiment 1, the calculation unit 104 receives from the application determination unit 106 drawing information, tag information of polygon model 51 tagged as an application drawing target, tag information of polygon model 52 tagged as an application drawing target, and tag information of polygon model 53 tagged as an application drawing target.

The calculation unit 104 calculates the areas of polygon models 51 to 53. For example, the calculation unit 104 calculates the area of polygon model 51 to be 0.4 pixels, the area of polygon model 52 to be 0.7 pixels, and the area of polygon model 53 to be 1.2 pixels. Hereinafter, the information indicating the areas of the applicable drawing targets calculated by the calculation unit 104 will be referred to as area information.

The calculation unit 104 transmits the drawing information, the tag information of the drawing object that is the applicable drawing object, and the area information of the applicable drawing object to the determination unit 105, and proceeds to step S15.

In step S15, the determination unit 105 receives drawing information, tag information of the drawing object that is the applied drawing object, and area information of the applied drawing object from the calculation unit 104. The determination unit 105 uses the area information to determine an alpha value that represents the transparency of the applied drawing object. Specifically, when the area information indicates that the area of the applied drawing object is 1.0 pixel or less, the determination unit 105 determines the area as the alpha value of the applied drawing object. On the other hand, when the area information indicates that the area of the applied drawing object is greater than 1.0 pixel, the determination unit 105 determines 1.0 as the alpha value of the applied drawing object.

In embodiment 1, the determination unit 105 receives from the calculation unit 104 drawing information, tag information of polygon model 51 tagged as an applicable drawing target, tag information of polygon model 52 tagged as an applicable drawing target, tag information of polygon model 53 tagged as an applicable drawing target, area information that the area of polygon model 51 is 0.4 pixels, area information that the area of polygon model 52 is 0.7 pixels, and area information that the area of polygon model 53 is 1.2 pixels.

The determination unit 105 determines the alpha value of the polygon model 51 using the area information of the polygon model 51. Specifically, the determination unit 105 determines the alpha value of the polygon model 51 to be 0.4 because it is known from the area information that the area of the polygon model 51 is 0.4 pixels, which is less than or equal to 1.0 pixel.

The determination unit 105 determines the alpha value of the polygon model 52 using the area information of the polygon model 52. Specifically, the determination unit 105 determines the alpha value of the polygon model 52 to be 0.7 because it is known from the area information that the area of the polygon model 52 is 0.7 pixels, which is less than or equal to 1.0 pixel.

The determination unit 105 determines the alpha value of the polygon model 53 using the area information of the polygon model 53. Specifically, the determination unit 105 determines the alpha value of the polygon model 53 to be 1.0 because it is known from the area information that the area of the polygon model 53 is 1.2 pixels, which is larger than 1.0 pixel. Hereinafter, the information indicating the alpha value of the applicable drawing target determined by the determination unit 105 is referred to as alpha value information.

The determination unit 105 transmits the drawing information, tag information of the drawing target that is the applied drawing target, and alpha value information of the applied drawing target to the applied drawing target drawing unit 108, and proceeds to step S16.

In step S16, the applied drawing target drawing unit 108 receives drawing information, tag information of the drawing target that is the applied drawing target, and alpha value information of the applied drawing target from the determination unit 105, and draws the applied drawing target in the detail buffer of the detail buffer storage unit 109. At this time, the alpha value information is also stored in the detail buffer. In addition, the applied drawing target drawing unit 108 obtains the number of pixels drawn in the detail buffer each time it draws the applied drawing target in the detail buffer.

In embodiment 1, the applied drawing target drawing unit 108 receives from the determination unit 105 drawing information, tag information of polygon model 51 tagged as the applied drawing target, tag information of polygon model 52 tagged as the applied drawing target, tag information of polygon model 53 tagged as the applied drawing target, alpha value information that the alpha value of polygon model 51 is 0.4, alpha value information that the alpha value of polygon model 52 is 0.7, and alpha value information that the alpha value of polygon model 53 is 1.0.

The applicable drawing target drawing unit 108 draws the polygon model 51 in the detail buffer 56 of the detail buffer memory unit 109.

Figure 10 shows a drawing result 58 of the polygon model 51 to be applied, which is drawn in the detail buffer 56, superimposed on multiple polygon models 51 to 53. Since the polygon model 51 contains the center of one pixel in the detail buffer 56, the pixel is filled with the RGB values associated with the polygon model 51 contained in the drawing information, and the polygon model 51 is drawn. The result of drawing the polygon model 51 is the drawing result 58 of one pixel in Figure 10.

Figure 11 shows the rendering result 58 of the polygon model 51 to be applied, rendered in the detail buffer 56. Figure 11 shows only the actual rendering result 58, without the superimposed display of the multiple polygon models 51 to 53 in Figure 10.

The applied drawing target drawing unit 108 stores an alpha value, which is 0.4 for the alpha value of the polygon model 51, in the pixel of the drawing result 58 based on the alpha value information of the polygon model 51. The value in the pixel of Figure 11 represents the stored alpha value.

In addition, after the applied drawing object drawing unit 108 has completed the process of drawing the polygon model 51 in the detail buffer 56, it acquires the number of pixels that have actually been filled in the detail buffer 56 by the polygon model 51. In the case of the polygon model 51, as can be seen from FIG. 11, the applied drawing object drawing unit 108 acquires information that the number of pixels actually drawn in the detail buffer 56 is 1 pixel.

Similarly, the applied drawing target drawing unit 108 draws the polygon model 52 in the detail buffer 56 of the detail buffer memory unit 109.

However, since polygon model 52 does not include the center of any pixel in detail buffer 56, it is not drawn and disappears. Therefore, even if the applied drawing object drawing unit 108 performs a process to draw polygon model 52 in detail buffer 56, the result will be as shown in Figures 10 and 11, where only polygon model 51 is drawn.

After the applied drawing object drawing unit 108 has completed the process of drawing the polygon model 52 in the detail buffer 56, it obtains the number of pixels that have actually been filled in the detail buffer 56 by the polygon model 52. In the case of the polygon model 52, as can be seen from FIG. 11, not a single pixel has been filled in the detail buffer 56 by the polygon model 52, so the applied drawing object drawing unit 108 obtains information that the number of pixels is 0.

Next, the applicable drawing target drawing unit 108 draws the polygon model 53 in the detail buffer 56 of the detail buffer memory unit 109.

Figure 12 is a diagram superimposing a rendering result 58 obtained by rendering polygon model 51, which is the applicable rendering target, in detail buffer 56, a rendering result 59 obtained by rendering polygon model 53, which is another applicable rendering target, in detail buffer 56, and multiple polygon models 51 to 53. Since polygon model 53 includes the center of one pixel in detail buffer 56, polygon model 53 is rendered by filling that pixel with the RGB values associated with polygon model 53 included in the rendering information. The result of rendering polygon model 53 is rendering result 59 of one pixel in Figure 10.

Figure 13 shows a drawing result 58 obtained by drawing a polygon model 51, which is the applicable drawing target, in the detail buffer 56, and a drawing result 59 obtained by drawing a polygon model 53, which is another applicable drawing target, in the detail buffer 56. Figure 13 shows only the actual drawing results 58-59, without the superimposed display of the multiple polygon models 51-53 in Figure 12.

The applied drawing target drawing unit 108 stores an alpha value, which is 1.0 for the alpha value of the polygon model 53, in the pixel of the drawing result 59 based on the alpha value information of the polygon model 53. The value in each pixel in FIG. 13 represents the stored alpha value.

After the applied drawing object drawing unit 108 has completed the process of drawing the polygon model 53 in the detail buffer 56, it acquires the number of pixels that have actually been filled in the detail buffer 56 by the polygon model 53. In the case of the polygon model 53, as can be seen from FIG. 13, the applied drawing object drawing unit 108 acquires information that one pixel is the number of pixels that have actually been drawn in the detail buffer 56. Hereinafter, the information indicating the number of pixels drawn in the detail buffer by the applied drawing object acquired by the applied drawing object drawing unit 108 will be referred to as pixel count information.

Returning to Figure 5, the applied drawing target drawing unit 108 transmits the drawing information, tag information of the drawing target that is the applied drawing target, alpha value information, and pixel count information to the dotting unit 112, and proceeds to step S17.

In step S17, the dotting unit 112 receives drawing information, tag information of the drawing target that is the applied drawing target, alpha value information, and pixel count information from the applied drawing target drawing unit 108. From the pixel count information, the dotting unit 112 identifies the lost applied drawing target that is the applied drawing target that was not drawn by the applied drawing target drawing unit 108 and disappeared, and marks a dot on the pixel in the detail buffer that corresponds to the position of the lost applied drawing target, and draws the lost applied drawing target in the detail buffer. At this time, the alpha value of the alpha value information is also stored in the detail buffer.

In embodiment 1, the dotting unit 112 receives from the application drawing target drawing unit 108 drawing information, tag information of polygon model 51 tagged as the application drawing target, tag information of polygon model 52 tagged as the application drawing target, tag information of polygon model 53 tagged as the application drawing target, alpha value information that the alpha value of polygon model 51 is 0.4, alpha value information that the alpha value of polygon model 52 is 0.7, alpha value information that the alpha value of polygon model 53 is 1.0, pixel count information that the number of pixels drawn in the detail buffer 56 by polygon model 51 is 1 pixel, pixel count information that the number of pixels drawn in the detail buffer 56 by polygon model 52 is 0 pixels, and pixel count information that the number of pixels drawn in the detail buffer 56 by polygon model 53 is 1 pixel.

From the pixel count information, the dotting unit 112 identifies an applied drawing target with a pixel count of 0 pixels as a lost applied drawing target, which is an applied drawing target that has disappeared without being drawn by the applied drawing target drawing unit 108. Specifically, since the pixel count information of the polygon model 52 is 0 pixels, the dotting unit 112 identifies the polygon model 52 as a lost applied drawing target.

The dotting unit 112 puts a dot on a pixel in the detail buffer 56 corresponding to the position of the polygon model 52, which is the disappearance application drawing target, and draws the disappearance application drawing target in the detail buffer. Specifically, the dotting unit 112 puts a dot on a pixel in the detail buffer 56 corresponding to the position of the vertex of the polygon model 52. Here, when drawing a drawing target of two or more dimensions, if the center of a pixel is included in the drawing target in the buffer, the pixel is filled and the drawing target is drawn, but when drawing a one-dimensional drawing target, that is, when drawing a point, the pixel where the dot is put in the buffer is filled and the drawing target is drawn. Therefore, the dotting unit 112 can draw the polygon model 52, which is the disappearance application drawing target, in the detail buffer 56 by putting a dot on a pixel in the detail buffer 56 corresponding to the position of the vertex of the polygon model 52. Note that, in the case of a drawing target without vertices such as a circle or an ellipse, the dotting unit 112 approximates a polygon and puts a dot at the position of the vertex of the polygon.

Figure 14 is a diagram superimposing a drawing result 58 of polygon model 51, which is the applicable drawing target, drawn in detail buffer 56, a drawing result 59 of polygon model 53, which is another applicable drawing target, drawn in detail buffer 56, a drawing result 60 of polygon model 52, which is yet another applicable drawing target, drawn in detail buffer 56, and multiple polygon models 51 to 53. Since polygon model 52 has three vertices, dotting unit 112 dots pixels in detail buffer 56 that correspond to the positions of the three vertices of polygon model 52. Then, three pixels in detail buffer 56 that correspond to the three vertices of polygon model 52 are filled with the RGB values associated with polygon model 52 included in the drawing information, and polygon model 52 is drawn. The result of drawing polygon model 52 is the three-pixel drawing result 60 in Figure 14.

Figure 15 shows a drawing result 58 obtained by drawing polygon model 51, which is the applicable drawing target, in detail buffer 56, a drawing result 59 obtained by drawing polygon model 53, which is another applicable drawing target, in detail buffer 56, and a drawing result 60 obtained by drawing polygon model 52, which is yet another applicable drawing target, in detail buffer 56. Figure 15 shows only the actual drawing results 58-60, without the superimposed display of multiple polygon models 51-53 in Figure 14.

The dotting unit 112 stores an alpha value, which is 0.7 for the alpha value of the polygon model 52, in each pixel that constitutes the drawing result 60 based on the alpha value information of the polygon model 52. The values in each pixel in Figure 15 represent the stored alpha values.

Returning to FIG. 5, the dotting unit 112 sends a notification of the end of drawing in the detail buffer to the blending processing unit 110, and proceeds to step S18. Also, if there is no loss-applied drawing target, the dotting unit 112 does nothing because the applicable drawing target has already been drawn in the detail buffer, and sends a notification of the end of drawing in the detail buffer to the blending processing unit 110, and proceeds to step S18.

In step S18, when the blending processing unit 110 receives a notification of the end of drawing to the destination buffer from the non-applicable drawing object drawing unit 107 and a notification of the end of drawing to the detail buffer from the dotting unit 112, it alpha-blends the RGB values with the alpha value for each pixel of the detail buffer stored in the detail buffer 109 for the destination buffer stored in the destination buffer memory unit 103, and draws the applicable drawing object in the destination buffer.

In the first embodiment, the blending processing unit 110 alpha-blends the RGB values for each pixel of the detail buffer 56 in FIG. 15 with an alpha value for the drawing destination buffer 55 in FIG. 8, and draws the polygon models 51 to 53 to be applied to the drawing destination buffer 55. Specifically, the blending processing unit 110 alpha-blends the RGB values of the polygon model 51 in FIG. 15 with an alpha value of 0.4 for each pixel of the drawing result 58 of the polygon model 51 in FIG. 15 for the drawing destination buffer 55 in FIG. 8 stored in the drawing destination buffer storage unit 103. Similarly, the blending processing unit 110 alpha-blends the RGB values of the polygon model 52 in FIG. 15 with an alpha value of 0.7 for each pixel of the drawing result 60 of the polygon model 52 in FIG. 15 for the drawing destination buffer 55 in FIG. 8 stored in the drawing destination buffer storage unit 103. The blending processing unit 110 alpha-blends the RGB values of the polygon model 53 in FIG. 15 for one pixel of the rendering result 59 of the polygon model 53 in FIG. 15 with an alpha value of 1.0 for the rendering destination buffer 55 in FIG. 8 stored in the rendering destination buffer memory unit 103.

Figure 16 shows the rendering result when all polygon models are rendered in destination buffer 55. Rendering of polygon model 51 in destination buffer 55 results in rendering result 61. Rendering result 61 is the result of alpha blending the RGB values of polygon model 51 with an alpha value of 0.4 for one pixel of rendering result 58 of polygon model 51 in Figure 15 to destination buffer 55 in Figure 8, and is painted with simulated vertical stripes in Figure 16.

The rendering result 62 is the result of rendering polygon model 52 in destination buffer 55. The rendering result 62 is the result of alpha blending the RGB values of polygon model 52 with an alpha value of 0.7 for each of the three pixels of rendering result 60 of polygon model 52 in Figure 15 to destination buffer 55 in Figure 8, and is simulated by being shaded in Figure 16.

The rendering result 63 is the result of rendering polygon model 53 in destination buffer 55. The rendering result 63 is the result of alpha blending the RGB values of polygon model 53 with an alpha value of 1.0 for one pixel of rendering result 59 of polygon model 53 in Figure 15 to destination buffer 55 in Figure 8, and is painted with simulated horizontal stripes in Figure 16.

The rendering result 57 is the result of drawing the polygon model 54 in the rendering destination buffer 55. The rendering result 57 in Figure 16 is the same as the rendering result 57 in Figure 8.

Returning to Figure 5, the blending processing unit 110 sends a notification of the end of alpha blending to the output control unit 111 and proceeds to step S19.

In step S19, the output control unit 111 receives a notification of the end of alpha blending from the blending processing unit 110 and controls the output device 5 to output the destination buffer stored in the destination buffer memory unit 103.

In embodiment 1, the display device, which is the output device 5, is controlled to output the scene drawn in the drawing destination buffer 55 stored in the drawing destination buffer memory unit 103.

After step S19 is executed, the process returns to step S11, and the above-described process is repeated until a trigger for terminating the process occurs, such as turning off the power or performing an end operation. Note that although the above-described process is repeated, it is also possible to perform the process only once without repeating it.

As described above, in the drawing processing system 1 of embodiment 1, the non-applicable drawing target drawing unit 107 draws the drawing target determined by the application determination unit 106 to be an applicable drawing target in the drawing destination buffer stored in the drawing destination buffer memory unit 103, the calculation unit 104 calculates the area of the drawing target determined by the application determination unit 106 to be an applicable drawing target, the determination unit 105 determines the alpha value of the applicable drawing target from the calculated area, the applicable drawing target drawing unit 108 draws the applicable drawing target in the detail buffer, which is a buffer different from the drawing destination buffer, the dotting unit 112 draws the applicable drawing target in the detail buffer by dotting pixels in the detail buffer corresponding to the position of the applicable drawing target, the blending processing unit 110 alpha-blends the detail buffer with the alpha value of the applicable drawing target, and the output control unit 111 controls the output device 5 to output the scene drawn in the drawing destination buffer. Therefore, even if the drawing target is not located at the center of the pixel, the drawing target can be drawn and displayed on the display screen.

Embodiment 2.
In the first embodiment, in the drawing processing system 1, the input device 4 accepts input of drawing information and tag information, the acquisition unit 101 acquires the drawing information and the tag information from the input device 4, and the application determination unit 106 uses the tag information to determine whether the drawing target is an applied drawing target or a non-applied drawing target. In the second embodiment, as shown in Figures 17 to 19, in the drawing processing system 2, the input device 6 accepts only the input of drawing information, the acquisition unit 201 acquires the drawing information from the input device 6, and the application determination unit 202 determines from the drawing information whether the drawing target is an applied drawing target or a non-applied drawing target.

This determination eliminates the need for the user to input tag information into the input device 6, and the drawing processing system 2 automatically determines whether the drawing target is an applicable drawing target or an inapplicable drawing target, thereby reducing the burden on the user.

Note that in embodiment 1, the drawing processing system 1 draws both non-applied and applied drawing targets together, but in embodiment 2, the drawing processing system 2 draws the drawing targets one by one. Other than that, it is the same as embodiment 1. In the following explanation, the configurations and operations explained in embodiment 1 are given the same reference numerals and duplicate explanations are omitted.

As in the first embodiment, in the second embodiment, as an example, a case where the present disclosure is applied to a case where the drawing information, which is information about the drawing of the entire scene, contains a drawing target that is not located at the center of a pixel is described below.

Figure 17 is a block diagram of a drawing processing system 2 including a drawing processing device 200 according to embodiment 2. The drawing processing system 2 includes an input device 6 to which drawing information is input, a drawing processing device 200 that performs processing to draw the drawing information using the drawing information, and an output device 5 that outputs a scene processed by the drawing processing device 200.

In embodiment 2, instead of the input device 4, acquisition unit 101, application determination unit 106, non-applicable drawing target drawing unit 107, calculation unit 104, determination unit 105, applied drawing target drawing unit 108, dotting unit 112, and blending processing unit 110 of embodiment 1, an input device 6, acquisition unit 201, application determination unit 202, non-applicable drawing target drawing unit 203, calculation unit 204, determination unit 205, applied drawing target drawing unit 209, dotting unit 210, blending processing unit 207, termination determination unit 206, and accumulation memory unit 208 are added to the functional block diagram configuration.

The input device 6 only accepts drawing information of the entire scene, including information on the drawing target, such as a polygon model, input by the user.

The drawing processing device 200 includes an acquisition unit 201 that acquires drawing information from the input device 6, a creation unit 102 that creates a drawing destination buffer and a detail buffer, an application determination unit 202 that determines whether the drawing target is a non-applicable drawing target to be drawn in the drawing destination buffer or an applied drawing target to be drawn in a detail buffer that is a buffer different from the drawing destination buffer, depending on whether or not the drawing target is to be subjected to detailed drawing processing from the drawing information, a non-applicable drawing target drawing unit 203 that draws a non-applicable drawing target tagged as not to be subjected to detailed drawing processing in the drawing destination buffer, a calculation unit 204 that calculates the area of an applied drawing target tagged as being subjected to detailed drawing processing, a determination unit 205 that determines the alpha value of the applied drawing target from the calculated area, an applied drawing target drawing unit 209 that draws the applied drawing target in the detail buffer and acquires the number of pixels drawn, and a determination unit 208 that determines whether the applied drawing target is not drawn in the detail buffer and is erased from the acquired number of drawn pixels. The apparatus includes a dotting unit 210 for identifying whether the applicable drawing object is a lost applicable drawing object, and for the lost applicable drawing object, for drawing the lost applicable drawing object in the detail buffer by dotting a pixel in the detail buffer corresponding to the position of the lost applicable drawing object, a termination determination unit 206 for determining termination based on whether there is a drawing object in the drawing information that has not been drawn in the drawing destination buffer or the detail buffer, a blending processing unit 207 for drawing the applicable drawing object in the drawing destination buffer by alpha-blending the RGB value of the applicable drawing object with the alpha value of the applicable drawing object corresponding to the pixel painted in the detail buffer, an output control unit 111 for controlling the output device 5 to output the scene drawn in the drawing destination buffer, a drawing destination buffer storage unit 103 for storing the drawing destination buffer, a detail buffer storage unit 109 for storing the detail buffer, and an accumulation storage unit 208 for accumulating and storing information drawn in the detail buffer. The non-applied drawing object drawing unit 203 corresponds to the first drawing object drawing unit, and the applied drawing object drawing unit 209 corresponds to the second drawing object drawing unit.

Next, we will explain the hardware configuration of the drawing processing system 2 in embodiment 2. The hardware configuration diagram of the drawing processing system 2 is the same as Figure 2 in embodiment 1.

However, the hardware configuration of the input device 6 is the same as that of the input device 4. The hardware configuration of the acquisition unit 201 is the same as that of the acquisition unit 101. The hardware configuration of the application determination unit 202 is the same as that of the application determination unit 106. The hardware configuration of the non-applicable drawing target drawing unit 203 is the same as that of the non-applicable drawing target drawing unit 107. The hardware configuration of the calculation unit 204 is the same as that of the calculation unit 104. The hardware configuration of the determination unit 205 is the same as that of the determination unit 105. The hardware configuration of the applied drawing target drawing unit 209 is the same as that of the applied drawing target drawing unit 108. The hardware configuration of the dotting unit 210 is the same as that of the dotting unit 112. The hardware configuration of the blend processing unit 207 is the same as that of the blend processing unit 110. The termination determination unit 206 is realized by a program stored in the graphic memory 45, and is realized by the GPU 44 reading and executing the program loaded into the graphic memory 45. The accumulation memory unit 208 is realized by the graphic memory 45.

In addition, the graphics memory 45 may be configured so that the functions of the termination determination unit 206 and the functions of the other units are realized by separate memories. Also, the accumulation storage unit 208 and the other storage units may be realized by separate memories. Otherwise, the hardware configuration is the same as that of the first embodiment.

Next, the operation of the drawing processing system 2 will be described.

Figure 18 is a flowchart showing the operation of the drawing processing system 2 according to embodiment 2 of the present disclosure. The operation of the drawing processing system 2 is described below with reference to Figure 18.

In step S4, the input device 6 accepts input of drawing information. For example, the user uses a mouse, keyboard, etc. to specify drawing information and input it to the input device 6, and the input device 6 accepts the input.

As in the first embodiment, the drawing information received by the input device 6 may be any type of drawing information, such as drawing information received via communication without being specified by the user, drawing information automatically extracted that satisfies a predetermined criterion, drawing information extracted by machine learning, etc. In the second embodiment, as in the first embodiment, for example, the drawing target is a three-dimensional polygon model, and the drawing information includes information on the drawing target that is a polygon model.

In the second embodiment, similarly to the first embodiment, the case where the present disclosure is applied to Fig. 4 will be described below. The input device 6 transmits drawing information to the drawing processing device 200, and the process proceeds to step S5.

In step S5, the drawing processing device 200 receives drawing information from the input device 6. The drawing processing device 200 performs drawing processing using the received drawing information. Details will be described later. The drawing processing device 200 controls the output device 5 to output the scene drawn in the destination buffer, and proceeds to step S6.

In step S6, the output device 5 outputs the scene drawn in the destination buffer to a display device such as a display under the control of the drawing processing device 200, similar to step S3 in embodiment 1.

After step S6 is executed, the process returns to step S4, and the above-mentioned process is repeated until a trigger for terminating the process occurs, such as turning off the power or performing an end operation. Note that although the above-mentioned process is repeated, it is also possible to perform it only once without repeating it.

Next, the operation of the drawing processing device 200 will be described.

Figure 19 is a flowchart showing the operation of the drawing processing device 200 according to embodiment 2 of the present disclosure. The operation of the drawing processing device 200 is described below with reference to Figure 19.

In step S21, the acquisition unit 201 acquires drawing information from the input device 6. The acquisition unit 201 transmits the drawing information to the creation unit 102 and proceeds to step S22.

In step S22, the creation unit 102 receives drawing information from the acquisition unit 201. The creation unit 102 transmits the drawing information to the application determination unit 202 and proceeds to step S23. Otherwise, step S22 is the same as step S12 in embodiment 1. However, in embodiment 1, all applied drawing targets are drawn in the detail buffer, whereas in embodiment 2, one applied drawing target is drawn.

In step S23, the application determination unit 202 receives drawing information from the creation unit 102. The application determination unit 202 uses the drawing information to determine whether one of the drawing targets included in the drawing information is an applied drawing target or a non-applied drawing target. In the second embodiment, for example, the application determination unit 202 calculates the area s of the drawing target and determines whether the area s is less than a predetermined and stored threshold value X. The threshold value X may be determined based on the user's preference, such as 1.0 pixel or 5.0 pixel, to determine whether the size is large enough that the user does not need to perform detailed drawing processing on the drawing target, or small enough that detailed drawing processing is performed.

The method of calculating the area s of the drawing target may be to calculate the area of the drawing target itself, or to roughly estimate the area of the drawing target by approximating using a bounding box or the like as in Fig. 9 of the first embodiment. In the second embodiment, for example, the approximate value of the area of the polygon model 51 in Fig. 4 is 0.8 pixels,

It is assumed that the estimated area of the model 52 is 1.4 pixels, the estimated area of the polygon model 53 is 2.4 pixels, and the estimated area of the polygon model 54 is 16.8 pixels. It is also assumed that the predetermined threshold value X is 3.0 pixels.

If the area s of the drawing object is equal to or greater than a predetermined threshold value X, the application determination unit 202 returns No in step S23. Since the drawing size of the drawing object is large, the application determination unit 202 determines that detailed drawing processing is not required and generates tag information indicating that the drawing object is a non-applicable drawing object. The application determination unit 202 transmits the drawing information and tag information of the drawing object that is a non-applicable drawing object to the non-applicable drawing object drawing unit 203, and proceeds to step S24.

In the second embodiment, in the case of polygon model 54, the estimated area of polygon model 54 is 16.8 pixels, which is greater than the predetermined threshold value of 3.0 pixels, and therefore polygon model 54 is determined to be No in step S23. Since the drawing size of polygon model 54 is large, application determination unit 202 determines that detailed drawing processing is not required, and generates tag information indicating that polygon model 54 is an inapplicable drawing target. Application determination unit 202 transmits the drawing information and the tag information of polygon model 54 tagged as an inapplicable drawing target to drawing unit 203, and proceeds to step S24.

On the other hand, if the area s of the drawing object is less than the predetermined threshold value X, the application determination unit 202 returns Yes in step S23. The application determination unit 202 determines that detailed drawing processing is necessary because the drawing size of the drawing object is small, and generates tag information indicating that the drawing object is an applicable drawing object. The application determination unit 202 transmits the drawing information and the tag information of the drawing object that is the applicable drawing object to the calculation unit 204, and proceeds to step S25.

In the second embodiment, in the case of polygon model 51, the estimated area of polygon model 51 is 0.8 pixels, which is less than the predetermined threshold value of 3.0 pixels, so the result for polygon model 51 is step S23: Yes. Since the drawing size of polygon model 51 is small, the application determination unit 202 determines that detailed drawing processing needs to be performed, and generates tag information indicating that polygon model 51 is an application drawing target. The application determination unit 202 transmits the drawing information and the tag information of polygon model 51 tagged as an application drawing target to the calculation unit 204, and proceeds to step S25.

Similarly, in the case of polygon model 52, the estimated area of polygon model 52 is 1.4 pixels, which is less than the predetermined threshold value of 3.0 pixels, so polygon model 52 is step S23: Yes. The application determination unit 202 determines that detailed drawing processing is required because the drawing size of polygon model 52 is small, and generates tag information indicating that polygon model 52 is an applicable drawing target. The application determination unit 202 transmits the drawing information and the tag information of polygon model 52 tagged as an applicable drawing target to the calculation unit 204, and proceeds to step S25.

In the case of polygon model 53, the estimated area of polygon model 53 is 2.4 pixels, which is less than the predetermined threshold value of 3.0 pixels, so step S23: Yes for polygon model 53. The application determination unit 202 determines that detailed drawing processing needs to be performed because the drawing size of polygon model 53 is small, and generates tag information indicating that polygon model 53 is an applicable drawing target. The application determination unit 202 transmits the drawing information and the tag information of polygon model 53 tagged as an applicable drawing target to the calculation unit 204, and proceeds to step S25.

In step S24, the non-applicable drawing target drawing unit 203 receives drawing information and tag information of the drawing target that is a non-applicable drawing target from the application determination unit 202, and draws the non-applicable drawing target in the drawing destination buffer of the drawing destination buffer memory unit 103.

In embodiment 2, the non-applicable drawing target drawing unit 203 receives drawing information and tag information of a polygon model 54 tagged as a non-applicable drawing target from the application determination unit 202, and draws the polygon model 54 in the drawing destination buffer 55 of the drawing destination buffer memory unit 103.

The diagram showing the rendering result 57 of the polygon model 54 rendered in the rendering destination buffer 55 superimposed on the polygon model 54 is similar to FIG. 7 in the first embodiment. Also, the diagram showing the rendering result 57 of the polygon model 54 rendered in the rendering destination buffer 55 is similar to FIG. 8 in the first embodiment.

When the non-applicable drawing target drawing unit 203 has finished drawing one non-applicable drawing target in the destination buffer, the drawing unit 203 sends a notification of the end of drawing in the destination buffer to the end determination unit 206 and proceeds to step S29.

On the other hand, in step S25, the calculation unit 204 receives the drawing information and the tag information of the drawing object that is the applied drawing object from the application determination unit 202, and calculates the area of the applied drawing object. The method of calculating the area is the same as in step S14 of the first embodiment.

In the second embodiment, the calculation unit 204 receives from the application determination unit 202 drawing information and tag information of the polygon model 51 tagged as the application drawing target. Alternatively, the calculation unit 204 receives from the application determination unit 202 drawing information and tag information of the polygon model 52 tagged as the application drawing target. Alternatively, the calculation unit 204 receives from the application determination unit 202 drawing information and tag information of the polygon model 53 tagged as the application drawing target.

The calculation unit 204 calculates the area of the applicable drawing target described in the tag information received from the application determination unit 202. If the applicable drawing target described in the tag information is a polygon model 51, the calculation unit 204 calculates the area of the polygon model 51. For example, the calculation unit 204 calculates the area of the polygon model 51 to be 0.4 pixels.

Similarly, when the applicable drawing target described in the tag information is polygon model 52, calculation unit 204 calculates the area of polygon model 52. For example, calculation unit 204 calculates the area of polygon model 52 to be 0.7 pixels.

When the applicable drawing target described in the tag information is polygon model 53, calculation unit 204 calculates the area of polygon model 53. For example, calculation unit 204 calculates the area of polygon model 53 to be 1.2 pixels. Hereinafter, information indicating the area of the applicable drawing target calculated by calculation unit 204 will be referred to as area information, as in embodiment 1.

The calculation unit 204 transmits the drawing information, the tag information of the drawing object that is the applicable drawing object, and the area information of the applicable drawing object to the determination unit 205, and proceeds to step S26.

In step S26, the determination unit 205 receives the drawing information, the tag information of the drawing object that is the applied drawing object, and the area information of the applied drawing object from the calculation unit 204. The determination unit 205 uses the area information to determine an alpha value that represents the transparency of the applied drawing object. The method of determining the alpha value is the same as in step S15 of the first embodiment.

In the second embodiment, for example, the determination unit 205 receives from the calculation unit 204 the drawing information, the tag information of the polygon model 51 tagged as the applicable drawing target, and the area information indicating that the area of the polygon model 51 is 0.4 pixels. The method of determining the alpha value of the polygon model 51 is the same as in step S15 in the first embodiment, and the determination unit 205 determines the alpha value of the polygon model 51 to be 0.4.

Alternatively, the determination unit 205 receives from the calculation unit 204 the drawing information, the tag information of the polygon model 52 tagged as the applicable drawing target, and the area information indicating that the area of the polygon model 52 is 0.7 pixels. The method of determining the alpha value of the polygon model 52 is the same as in step S15 of the first embodiment, and the determination unit 205 determines the alpha value of the polygon model 52 to be 0.7.

Alternatively, the determination unit 205 receives from the calculation unit 204 the drawing information, tag information of the polygon model 53 tagged as the applicable drawing target, and area information indicating that the area of the polygon model 53 is 1.2 pixels. The method of determining the alpha value of the polygon model 53 is similar to step S15 in the first embodiment, and the determination unit 205 determines the alpha value of the polygon model 53 to be 1.0. Hereinafter, the information indicating the alpha value of the applicable drawing target determined by the determination unit 205 is referred to as alpha value information, as in the first embodiment.

The determination unit 205 transmits the drawing information, tag information of the drawing target that is the applied drawing target, and alpha value information of the applied drawing target to the applied drawing target drawing unit 209, and proceeds to step S27.

In step S27, the applied drawing target drawing unit 209 receives drawing information, tag information of the drawing target that is the applied drawing target, and alpha value information of the applied drawing target from the determination unit 205, and draws the applied drawing target in the detail buffer of the detail buffer storage unit 109. At this time, the alpha value information is also stored in the detail buffer. The applied drawing target drawing unit 209 also obtains the number of pixels drawn in the detail buffer. The method of drawing the drawing target, the method of storing the alpha value information in the detail buffer, and the method of obtaining the number of pixels drawn in the detail buffer are the same as in step S16 in embodiment 1. However, in embodiment 2, the drawing processing system 2 draws the drawing targets one by one, so polygon model 51, polygon model 52, and polygon model 53 are not drawn simultaneously.

In the second embodiment, for example, the applied drawing target drawing unit 209 receives drawing information from the determination unit 205, tag information of the polygon model 51 tagged as the applied drawing target, and alpha value information indicating that the alpha value of the polygon model 51 is 0.4. The applied drawing target drawing unit 209 draws the polygon model 51 in the detail buffer 56 of the detail buffer storage unit 109. The drawing result 58 in which the applied drawing target polygon model 51 is drawn in the detail buffer 56 and the multiple polygon models 51 to 53 are superimposed is the same as FIG. 10 in the first embodiment. Also, the drawing result 58 in which the applied drawing target polygon model 51 is drawn in the detail buffer 56 is the same as FIG. 11 in the first embodiment. The applied drawing target drawing unit 209 stores an alpha value indicating that the alpha value of the polygon model 51 is 0.4 in the pixel of the drawing result 58. Furthermore, the applied drawing object drawing unit 209 acquires information that the number of pixels actually filled in the detail buffer 56 by the polygon model 51 is 1 pixel.

Alternatively, the applied drawing target drawing unit 209 receives drawing information from the determination unit 205, tag information of the polygon model 52 tagged as the applied drawing target, and alpha value information indicating that the alpha value of the polygon model 52 is 0.7. The applied drawing target drawing unit 209 draws the polygon model 52 in the detail buffer 56 of the detail buffer storage unit 109. However, since the polygon model 52 does not include the center of any pixel in the detail buffer 56, it is not drawn and disappears, as in the first embodiment. Therefore, even if the applied drawing target drawing unit 209 performs a process of drawing the polygon model 52 in the detail buffer 56, the polygon model 52 is not drawn, and the detail buffer 56 in FIG. 6 remains empty. The applied drawing target drawing unit 209 obtains information that 0 pixels is the number of pixels actually filled in the detail buffer 56 by the polygon model 52.

Alternatively, the applied drawing target drawing unit 209 receives drawing information from the determination unit 205, tag information of the polygon model 53 tagged as the applied drawing target, and alpha value information indicating that the alpha value of the polygon model 53 is 1.0. The applied drawing target drawing unit 209 draws the polygon model 53 in the detail buffer 56 of the detail buffer storage unit 109. A drawing result 59 in which the applied drawing target polygon model 53 is drawn in the detail buffer 56 and multiple polygon models 51 to 53 are superimposed is the same as the drawing in FIG. 12 of the first embodiment from which the drawing result 58 in which the applied drawing target polygon model 51 is drawn in the detail buffer 56 is deleted. Also, a drawing showing the drawing result 59 in which the applied drawing target polygon model 53 is drawn in the detail buffer 56 is the same as the drawing in FIG. 13 of the first embodiment from which the drawing result 58 in which the applied drawing target polygon model 51 is drawn in the detail buffer 56 is deleted. The applied drawing target drawing unit 209 stores an alpha value, in which the alpha value of the polygon model 53 is 1.0, in a pixel of the drawing result 59. The applied drawing target drawing unit 209 also acquires information that the number of pixels actually filled in the detail buffer 56 by the polygon model 53 is 1 pixel. Hereinafter, the information indicating the number of pixels drawn in the detail buffer by the applied drawing target acquired by the applied drawing target drawing unit 209 will be referred to as pixel number information, as in the first embodiment.

The applied drawing target drawing unit 209 transmits the drawing information, tag information of the drawing target that is the applied drawing target, alpha value information, pixel count information, and alpha value information of the applied drawing target to the dotting unit 210, and proceeds to step S28.

In step S28, the dotting unit 210 receives drawing information, tag information of the drawing target that is the applied drawing target, alpha value information, and pixel number information from the applied drawing target drawing unit 209. The dotting unit 210 determines from the pixel number information whether the applied drawing target is a lost applied drawing target that is an applied drawing target that has disappeared without being drawn by the applied drawing target drawing unit 209. If the applied drawing target is a lost applied drawing target, the dotting unit 210 marks a pixel in the detail buffer corresponding to the position of the lost applied drawing target, and draws the lost applied drawing target in the detail buffer. At this time, alpha value information is also stored in the detail buffer. The method of determining whether the applied drawing target is a lost applied drawing target, the method of marking a pixel in the detail buffer corresponding to the position of the lost applied drawing target, and drawing the lost applied drawing target in the detail buffer, and the method of storing alpha value information in the detail buffer are the same as in step S17 of the first embodiment. Also, if the applied drawing target is not a lost applied drawing target, the dotting unit 210 does nothing, as in step S17 of the first embodiment, since the applied drawing target has already been drawn in the detail buffer.

In the second embodiment, for example, the dotting unit 210 receives drawing information from the application drawing target drawing unit 209, tag information of the polygon model 51 tagged as the application drawing target, alpha value information indicating that the alpha value of the polygon model 51 is 0.4, and pixel count information indicating that the number of pixels drawn by the polygon model 51 in the detail buffer 56 is 1 pixel. From the pixel count information, the dotting unit 210 determines that the polygon model 51 is not a loss application drawing target because the pixel count information of the polygon model 51 is 1 pixel. Since the polygon model 51 has already been drawn in the detail buffer, the dotting unit 210 does nothing.

Alternatively, the dotting unit 210 receives from the application drawing target drawing unit 209 drawing information, tag information of the polygon model 52 tagged as the application drawing target, alpha value information indicating that the alpha value of the polygon model 52 is 0.7, and pixel count information indicating that the number of pixels drawn in the detail buffer 56 by the polygon model 52 is 0 pixels. From the pixel count information, the dotting unit 210 identifies the polygon model 52 as the disappearance application drawing target since the pixel count information of the polygon model 52 is 0 pixels.

The dotting unit 210 draws the disappearance application drawing target in the detail buffer, as in step S17 in the first embodiment. The drawing result 60 of the application drawing target polygon model 52 in the detail buffer 56 and the multiple polygon models 51 to 53 are superimposed on each other in the figure shown in FIG. 14 in the first embodiment, with the drawing result 58 of the application drawing target polygon model 51 in the detail buffer 56 and the drawing result 59 of another application drawing target polygon model 53 in the detail buffer 56 deleted. The drawing result 60 of the application drawing target polygon model 52 in the detail buffer 56 is similar to the drawing in FIG. 15 in the first embodiment, with the drawing result 58 of the application drawing target polygon model 51 in the detail buffer 56 and the drawing result 59 of another application drawing target polygon model 53 in the detail buffer 56 deleted. The dotting section 210 stores, based on the alpha value information of the polygon model 52, an alpha value that the alpha value of the polygon model 52 is 0.7 in each pixel that constitutes the drawing result 60.

Alternatively, the dotting unit 210 receives drawing information from the application drawing target drawing unit 209, tag information of the polygon model 53 tagged as the application drawing target, alpha value information indicating that the alpha value of the polygon model 53 is 1.0, and pixel count information indicating that the number of pixels drawn by the polygon model 53 in the detail buffer 56 is 1 pixel. From the pixel count information, the dotting unit 210 determines that the polygon model 53 is not a loss application drawing target because the pixel count information of the polygon model 53 is 1 pixel. Since the polygon model 53 has already been drawn in the detail buffer, the dotting unit 210 does nothing.

The dotting unit 210 sends a notification of the end of drawing to the detail buffer to the end determination unit 206 and proceeds to step S29.

In step S29, when the end determination unit 206 receives a notification of the end of drawing to the destination buffer from the non-applicable drawing object drawing unit 203, or a notification of the end of drawing to the detail buffer from the dotting unit 210, it determines whether there are any other drawing objects to be drawn in the destination buffer.

If the end determination unit 206 has not yet performed drawing processing in the non-applicable drawing object drawing unit 203, the applicable drawing object drawing unit 209, or the dotting unit 210, and there is a drawing object to be drawn in the drawing destination buffer, the result is step S29: Yes. If the end determination unit 206 receives a notification of the end of drawing to the drawing destination buffer from the non-applicable drawing object drawing unit 203, and there is still a drawing object to be drawn in the drawing destination buffer, the process returns to step S23 and performs drawing processing on the drawing object that has not yet been drawn.

When the completion determination unit 206 receives a notification from the dotting unit 210 that drawing to the detail buffer has been completed, and if there are still drawing objects to be drawn in the destination buffer, it stores in the accumulation memory unit 208 the detail buffer that has undergone drawing processing that was stored in the detail buffer memory unit 109, and makes it possible to create a new detail buffer in the detail buffer memory unit 109. Then, the process returns to step S23, and the drawing processing device 200 performs drawing processing on the drawing objects that have not yet been drawn.

On the other hand, if the completion determination unit 206 has not yet performed the drawing process and there is no drawing target to be drawn in the drawing destination buffer, the result is step S29: No. The completion determination unit 206 transmits all of the detailed buffers stored in the accumulation memory unit 208 to the blend processing unit 207 in a lump, and proceeds to step S30.

In the second embodiment, if there is any one of polygon model 51, polygon model 52, polygon model 53, and polygon model 54 that has not been subjected to the rendering process, the termination determination unit 206 returns to step S29: Yes. If the rendering process of polygon model 54 is performed, the termination determination unit 206 receives a notification from the non-applicable rendering object rendering unit 203 that rendering to the rendering destination buffer has been completed, and there is still a rendering object to be rendered in the rendering destination buffer, the termination determination unit 206 returns to step S23 and performs rendering of the rendering object that has not been subjected to the rendering process.

When the completion determination unit 206 receives a notification from the dotting unit 210 that the drawing of any of the polygon models 51 to 53 has been completed, and there is still a drawing object to be drawn in the drawing destination buffer, it causes the accumulation memory unit 208 to store the detail buffer in which any of the polygon models 51 to 53 stored in the detail buffer memory unit 109 has been drawn, and makes it possible to create a new detail buffer in the detail buffer memory unit 109, and then returns to step S23 to perform the drawing process of the drawing object that has not yet been drawn.

On the other hand, if the completion determination unit 206 has completed the rendering process for all of the polygon models 51 to 54, the result of step S29 is No. The completion determination unit 206 transmits all of the detailed buffers in which the polygon models 51 to 53 stored in the accumulation memory unit 208 have been rendered to the blend processing unit 207 in a batch, and proceeds to step S30.

In step S30, the blending processing unit 207 receives all of the detail buffers in which the applicable drawing target has been drawn from the end determination unit 206 at once. In the first embodiment, the blending processing unit 110 alpha-blends one detail buffer with the drawing destination buffer, but in the second embodiment, the blending processing unit 207 alpha-blends multiple detail buffers with the drawing destination buffer. Specifically, the blending processing unit 207 performs the process of alpha-blending one detail buffer with the drawing destination buffer in sequence for the number of detail buffers. The alpha-blending method is the same as in step S18 in the first embodiment. The drawing result in which all polygon models are drawn in the drawing destination buffer 55 is the same as in FIG. 16 in the first embodiment.

The blending processing unit 207 sends a notification of the end of alpha blending to the output control unit 111 and proceeds to step S31. Otherwise, step S30 is the same as step S18 in embodiment 1.

In step S31, the output control unit 111 receives a notification of the end of alpha blending from the blend processing unit 207. Otherwise, step S31 is the same as step S19 in embodiment 1.

After step S31 is executed, the process returns to step S21, and the above-described process is repeated until a trigger for terminating the process occurs, such as turning off the power or performing an end operation. Note that although the above-described process is repeated, it may be performed only once without repeating the process.

As described above, in the drawing processing system 2 of the second embodiment, the non-applicable drawing target drawing unit 203 draws the drawing target determined by the application determination unit 202 to be an applicable drawing target in the drawing destination buffer stored in the drawing destination buffer memory unit 103, the calculation unit 204 calculates the area of the drawing target determined by the application determination unit 202 to be an applicable drawing target, the determination unit 205 determines the alpha value of the applicable drawing target from the calculated area, the applicable drawing target drawing unit 209 draws the applicable drawing target in the detail buffer, which is a buffer different from the drawing destination buffer, the dotting unit 210 draws the applicable drawing target in the detail buffer by dotting pixels in the detail buffer corresponding to the position of the applicable drawing target, the blending processing unit 207 alpha-blends the detail buffer with the alpha value of the applicable drawing target, and the output control unit 111 controls the output device 5 to output the scene drawn in the drawing destination buffer. Therefore, even if the drawing target is not located at the center of the pixel, the drawing target can be drawn and displayed on the display screen.

In addition, in the second embodiment, the drawing processing system 2 has the input device 6 only accept input of drawing information, the acquisition unit 201 acquires the drawing information from the input device 6, and the application determination unit 202 determines from the drawing information whether the drawing target is an applied drawing target or a non-applied drawing target. This determination eliminates the need for a user or the like to input tag information into the input device 6, and the drawing processing system 2 automatically determines whether the drawing target is an applied drawing target or a non-applied drawing target, thereby reducing the burden on the user.

In step S23 of the second embodiment, for example, the application determination unit 202 calculates the area s of the drawing object and determines whether the area s is less than the threshold value X that has been previously determined and stored. However, the threshold value may be changed for each drawing object based on the brightness value, importance, etc. of each drawing object. For example, if the brightness value of the drawing object is lower than the threshold Y, the brightness is determined to be low and the threshold X is reduced, and if the brightness value of the drawing object is higher than the threshold Y, the brightness is determined to be high and the threshold X is increased. By changing the threshold X, a drawing object with low brightness will not be an applicable drawing object even if its area is smaller, so the probability of it being determined to be a non-applicable drawing object increases, and the drawing processing load can be reduced. On the other hand, a drawing object with high brightness will not be an non-applicable drawing object unless its area is larger, so the probability of it being determined to be a applicable drawing object increases and it becomes more difficult to disappear. Similarly, for example, if importance is given to the drawing object in advance, if the importance of the drawing object is lower than the threshold Z, the threshold X is reduced as the importance is low, and if the importance of the drawing object is higher than the threshold Z, the threshold X is increased as the importance is high. By changing the threshold value X, a drawing target with low importance will not be an applied drawing target even if its area is smaller, so the probability of it being determined as a non-applied drawing target increases, and the drawing processing load can be reduced. On the other hand, a drawing target with high importance will not be an applied drawing target unless its area is larger, so the probability of it being determined as a applied drawing target increases, and it becomes more difficult to disappear.

In the second embodiment, the drawing processing system 2 includes an accumulation storage unit 208, and when there is still a drawing object to be drawn in the drawing destination buffer, the end determination unit 206 stores the detailed buffer that has been subjected to drawing processing stored in the detail buffer storage unit 109 in the accumulation storage unit 208, and after a new detailed buffer can be created in the detail buffer storage unit 109, the drawing processing device 200 performs drawing processing on the drawing object that has not been subjected to drawing processing. However, the drawing processing system 2 does not include the accumulation storage unit 208, and the drawing processing device 200 may perform drawing processing on the drawing object that has not been subjected to drawing processing by overwriting and saving the detailed buffer that has been subjected to drawing processing stored in the detail buffer storage unit 109.

Embodiment 3.
In the first embodiment, in the drawing processing system 1, the creation unit 102 creates one detailed buffer with the same resolution as the drawing destination buffer in the detailed buffer storage unit 109, and the applied drawing object drawing unit 108 or the dotting unit 112 draws all the applied drawing objects in the detailed buffer. In the third embodiment, as shown in Figs. 20 to 31, the allocation creation unit 302 creates a detailed buffer in the detailed buffer storage unit 303 corresponding to the range of each applied drawing object, and the applied drawing object drawing unit 108 or the dotting unit 112 draws the applied drawing object in the detailed buffer corresponding to the range of the applied drawing object.

When the proportion of the range not used in drawing the applicable drawing target is high due to this drawing, it is only necessary to create a detailed buffer corresponding to the range of the applicable drawing target, so there is no need to create buffers unnecessarily and memory usage can be reduced. Other than that, it is the same as in embodiment 1. In the following explanation, the configuration and operation explained in embodiment 1 are given the same reference numerals and duplicate explanations are omitted.

As in embodiment 1, in embodiment 3, as an example, a case in which the present disclosure is applied to a case in which the drawing information, which is information about the drawing of the entire scene, contains a drawing target that is not located at the center of a pixel is described below.

Figure 20 is a block diagram of a drawing processing system 3 including a drawing processing device 300 according to embodiment 3. The drawing processing system 3 includes an input device 4 to which tag information indicating whether detailed drawing processing is to be applied to each drawing target included in the drawing information and the drawing information are input, a drawing processing device 300 that performs processing to draw the drawing information using the drawing information and the tag information, and an output device 5 that outputs the scene processed by the drawing processing device 300.

In embodiment 3, instead of the creation unit 102, detail buffer memory unit 109, applied drawing target drawing unit 108, dotting unit 112, and blending processing unit 110 in FIG. 1 of embodiment 1, a creation unit 301, a detail buffer memory unit 303, an applied drawing target drawing unit 304, dotting unit 305, a blending processing unit 306, and an allocation creation unit 302 are added as components of the functional block diagram.

The drawing processing device 300 includes an acquisition unit 101 that acquires drawing information and tag information including a drawing target from the input device 4, a creation unit 301 that creates a drawing destination buffer, an application determination unit 106 that uses the tag information to determine whether the drawing target is a non-applicable drawing target to be drawn in the drawing destination buffer or an applicable drawing target to be drawn in a detailed buffer that is a buffer different from the drawing destination buffer, depending on whether or not the drawing target is to be subjected to detailed drawing processing, a non-applicable drawing target drawing unit 107 that draws a non-applicable drawing target tagged as not to be subjected to detailed drawing processing in the drawing destination buffer, an allocation creation unit 302 that creates detailed buffers corresponding to the range of an applicable drawing target tagged as being subjected to detailed drawing processing, a calculation unit 104 that calculates the area of an applicable drawing target tagged as being subjected to detailed drawing processing, a determination unit 105 that determines the alpha value of the applicable drawing target from the calculated area, and a detailed buffer that draws the applicable drawing target in the detailed buffer. the applied drawing object drawing unit 304 for calculating the number of pixels drawn and acquiring the number of pixels drawn, a dotting unit 305 for identifying a lost applied drawing object which is an applied drawing object that has not been drawn in the detail buffer and has disappeared from the number of pixels drawn acquired for each applied drawing object, and for drawing the lost applied drawing object in the detail buffer by dotting a pixel in the detail buffer corresponding to the position of the lost applied drawing object, a blending processing unit 306 for drawing the applied drawing object including the lost applied drawing object in the drawing destination buffer by alpha-blending the RGB values of the applied drawing object including the lost applied drawing object with the alpha value of the applied drawing object including the lost applied drawing object in response to the pixel painted in the detail buffer, an output control unit 111 for controlling the output device 5 to output the scene drawn in the drawing destination buffer, a drawing destination buffer storage unit 103 for storing the drawing destination buffer, and a detail buffer storage unit 303 for storing the detail buffer. Note that the non-applied drawing object drawing unit 107 corresponds to the first drawing object drawing unit, and the applied drawing object drawing unit 304 corresponds to the second drawing object drawing unit.

Next, we will explain the hardware configuration of the drawing processing system 3 in embodiment 3. The hardware configuration diagram of the drawing processing system 3 is the same as Figure 2 in embodiment 1.

However, the hardware configuration of the creation unit 301 is the same as that of the creation unit 102. The hardware configuration of the detail buffer memory unit 303 is the same as that of the detail buffer memory unit 109. The hardware configuration of the applied drawing target drawing unit 304 is the same as that of the applied drawing target drawing unit 108. The hardware configuration of the dot unit 305 is the same as that of the dot unit 112. The hardware configuration of the blend processing unit 306 is the same as that of the blend processing unit 110. The allocation creation unit 302 is realized by a program stored in the graphics memory 45, and is realized by the GPU 44 reading and executing the program loaded into the graphics memory 45. Note that the graphics memory 45 may realize the functions of the allocation creation unit 302 and the functions of the other units in separate memories.

Next, the operation of the drawing processing system 3 and the drawing processing device 300 will be described.

The flowchart showing the operation of the drawing processing system 3 relating to embodiment 3 of the present disclosure is similar to Figure 3 of embodiment 1.

Figure 21 is a flowchart showing the operation of the drawing processing device 300 according to embodiment 3 of the present disclosure. The operation of the drawing processing device 300 will be described below with reference to Figure 21.

In step S41, the acquisition unit 101 transmits the drawing information and the tag information to the creation unit 301, and proceeds to step S42. Otherwise, step S41 is the same as step S11 in the first embodiment.

In step S42, the creation unit 301 creates only a drawing destination buffer and does not create a detail buffer. The creation unit 301 transmits the drawing information and tag information to the application determination unit 106 and proceeds to step S43. Otherwise, step S42 is the same as step S12 in the first embodiment.

In step S43, the application determination unit 106 receives drawing information and tag information from the creation unit 301. The non-applied drawing target drawing unit 107 sends a notification of the end of drawing to the drawing destination buffer to the application processing unit 106 and the blending processing unit 306, and proceeds to step S44. Otherwise, step S43 is the same as step S13 in embodiment 1.

In step S44, when the application determination unit 106 receives a notification of the end of drawing to the drawing destination buffer from the non-applied drawing target drawing unit 107, it transmits the drawing information and tag information of the drawing target that is the applied drawing target to the allocation creation unit 302.

In embodiment 3, the application determination unit 106 transmits to the allocation creation unit 302 the drawing information of Figure 4, the tag information of polygon model 51 tagged as an application drawing target, the tag information of polygon model 52 tagged as an application drawing target, and the tag information of polygon model 53 tagged as an application drawing target.

The allocation creation unit 302 receives drawing information and tag information of the drawing target that is the applicable drawing target from the application determination unit 106, and creates a corresponding detailed buffer for each applicable drawing target in the detail buffer storage unit 303. Each corresponding applicable drawing target is drawn in each detailed buffer. Note that the detail buffer has the same resolution as the destination buffer. The allocation creation unit 302 also creates position information, which is information about which position in the destination buffer each detailed buffer corresponds to, and stores this in each detailed buffer.

In the third embodiment, the allocation creation unit 302 receives from the application determination unit 106 the drawing information, the tag information of the polygon model 51 tagged as the application drawing target, the tag information of the polygon model 52 tagged as the application drawing target, and the tag information of the polygon model 53 tagged as the application drawing target. The allocation creation unit 302 creates a detail buffer 64 corresponding to the polygon model 51 in the detail buffer storage unit 303. The allocation creation unit 302 also creates a detail buffer 65 corresponding to the polygon model 52 in the detail buffer storage unit 303. The allocation creation unit 302 also creates a detail buffer 66 corresponding to the polygon model 53 in the detail buffer storage unit 303. The polygon model 51 is drawn in the detail buffer 64, the polygon model 52 in the detail buffer 65, and the polygon model 53 in the detail buffer 66. The detail buffers 64 to 66 have the same resolution as the drawing destination buffer 55.

Figure 22 is a diagram showing a comparison between the detail buffers 64-66 corresponding to the polygon models 51-53 to be applied in embodiment 3 and the detail buffer 56 in embodiment 1. In embodiment 3, the detail buffers 64-66 have the same resolution as the rendering destination buffer 55, which is the same as in embodiment 1. In other words, the detail buffer 56 in embodiment 1 and the detail buffers 64-66 in embodiment 3 have the same resolution.

Here, the detail buffer 56 in embodiment 1 is 8 pixels high and 8 pixels wide, for a total of 64 pixels. Meanwhile, the detail buffer 64 in embodiment 3 is 3 pixels high and 3 pixels wide, for a total of 9 pixels. The detail buffer 65 is 2 pixels high and 3 pixels wide, for a total of 6 pixels. The detail buffer 66 is 3 pixels high and 3 pixels wide, for a total of 36 pixels. In embodiment 3, no detail buffers are created outside of the detail buffers 64 to 66, so the size of the detail buffers created is smaller than in embodiment 1, making it possible to reduce memory usage.

Figure 23 is a diagram showing a detail buffer 64 corresponding to a polygon model 51 that is the target of application drawing in embodiment 3, another detail buffer 65 corresponding to a polygon model 52 that is another target of application drawing, and a further detail buffer 66 corresponding to a polygon model 53 that is yet another target of application drawing.

Also, the allocation creation unit 302 creates position information 67, which is information regarding which position in the drawing destination buffer 55 the detail buffer 64 corresponds to, position information 68, which is information regarding which position in the drawing destination buffer 55 the detail buffer 65 corresponds to, and position information 69, which is information regarding which position in the drawing destination buffer 55 the detail buffer 66 corresponds to. The allocation creation unit 302 stores the position information 67 in the detail buffer 64, the position information 68 in the detail buffer 65, and the position information 69 in the detail buffer 66.

Figure 24 is a diagram showing an example of position information 67, which is information about which position in the destination buffer 55 the detail buffer 64 corresponds to. The dotted line area 64 on the destination buffer 55 corresponds to the position of the detail buffer 64.

Figure 25 is a diagram showing an example of position information 68, which is information indicating which position in the destination buffer 55 another detail buffer 65 corresponds to. The dotted range 65 on the destination buffer 55 corresponds to the position of the detail buffer 65.

Figure 26 is a diagram showing an example of position information 69, which is information indicating which position in the destination buffer 55 a further detailed buffer 66 corresponds to. The dotted range 66 on the destination buffer 55 corresponds to the position of the detailed buffer 66.

In the third embodiment, the position information is separated for each polygon model to be applied for drawing, but the detailed buffer memory unit 303 may store a single piece of position information indicating which position in the drawing destination buffer 55 each of all polygon models to be applied for drawing corresponds to.

Figure 27 is a diagram showing an example of position information that combines information on which position in destination buffer 55 detail buffer 64 corresponds to, information on which position in destination buffer 55 another detail buffer 65 corresponds to, and information on which position in destination buffer 55 yet another detail buffer 66 corresponds to. The dotted-line range 64 on destination buffer 55 corresponds to the position of detail buffer 64, the dotted-line range 65 on destination buffer 55 corresponds to the position of detail buffer 65, and the dotted-line range 66 on destination buffer 55 corresponds to the position of detail buffer 66.

The range of the detail buffer 64 corresponding to polygon model 51 is the range in which the entire polygon model 51 can be drawn. The range of the detail buffer 65 corresponding to polygon model 52 is the range in which the entire polygon model 52 can be drawn. The range of the detail buffer 66 corresponding to polygon model 53 is the range in which the entire polygon model 53 can be drawn. The range of the detail buffer corresponding to the applicable drawing target may be determined in advance, may be determined by the user by receiving input from the user, or may be determined according to the area of the drawing target; there are no limitations on how the range is determined.

For example, when determining based on the area of the drawing target, the allocation creation unit 302 may calculate the area of each drawing target as in the calculation unit 104 of embodiment 1, or may approximate the area of each drawing target by approximating using a bounding box or the like. In the case of a three-dimensional drawing target, the drawing target is projected into two dimensions and then the area of the drawing target is calculated. The method of approximating the area of each drawing target using a bounding box or the like is the same as in Figure 9 of embodiment 1. The allocation creation unit 302 may create a detailed buffer with a larger range than the applicable drawing target.

Returning to FIG. 21, the allocation creation unit 302 transmits the drawing information and the tag information of the drawing target that is the applied drawing target to the calculation unit 104, and proceeds to step S45. In embodiment 3, the allocation creation unit 302 transmits to the calculation unit 104 the drawing information, the tag information of polygon model 51 tagged as the applied drawing target, the tag information of polygon model 52 tagged as the applied drawing target, and the tag information of polygon model 53 tagged as the applied drawing target.

In step S45, the calculation unit 104 receives drawing information and tag information of the drawing target that is the applied drawing target from the assignment creation unit 302. In embodiment 3, the calculation unit 104 receives drawing information, tag information of polygon model 51 tagged as the applied drawing target, tag information of polygon model 52 tagged as the applied drawing target, and tag information of polygon model 53 tagged as the applied drawing target from the assignment creation unit 302. Otherwise, step S45 is the same as step S14 in embodiment 1.

In step S46, the determination unit 105 transmits the drawing information, the tag information of the drawing target that is the applied drawing target, and the alpha value information of the applied drawing target to the applied drawing target drawing unit 304, and proceeds to step S47. Otherwise, step S46 is the same as step S15 in the first embodiment.

In step S47, the applied drawing target drawing unit 304 receives drawing information, tag information of the drawing target that is the applied drawing target, and alpha value information of the applied drawing target from the determination unit 105, and draws each applied drawing target in each detailed buffer of the detail buffer storage unit 303. At this time, the alpha value information is also stored in each detailed buffer. In addition, the applied drawing target drawing unit 304 obtains the number of pixels drawn in the detail buffer each time it draws the applied drawing target in the detail buffer.

In embodiment 3, similarly to embodiment 1, the applied drawing target drawing unit 304 receives from the determination unit 105 drawing information, tag information of polygon model 51 tagged as the applied drawing target, tag information of polygon model 52 tagged as the applied drawing target, tag information of polygon model 53 tagged as the applied drawing target, alpha value information that the alpha value of polygon model 51 is 0.4, alpha value information that the alpha value of polygon model 52 is 0.7, and alpha value information that the alpha value of polygon model 53 is 1.0.

The applied drawing target drawing unit 304 draws a polygon model 51 in the detail buffer 64 of the detail buffer storage unit 303. The applied drawing target drawing unit 304 also draws a polygon model 52 in the detail buffer 65 of the detail buffer storage unit 303. The applied drawing target drawing unit 304 also draws a polygon model 53 in the detail buffer 66 of the detail buffer storage unit 303.

Figure 28 shows a superimposition of a drawing result 70 in which polygon model 51, which is the applicable drawing target, is drawn in detail buffer 64, a drawing result 71 in which polygon model 53, which is another applicable drawing target, is drawn in another detail buffer 66, and multiple polygon models 51 to 53, which are applicable drawing targets.

As in the first embodiment, as shown in FIG. 28, polygon model 51 includes the center of one pixel in detail buffer 64, so that pixel is filled with the RGB values associated with polygon model 51 included in the drawing information, and polygon model 51 is drawn. The result of drawing polygon model 51 is drawing result 70 of one pixel in FIG. 28. Polygon model 52 does not include the center of any pixel in detail buffer 65, so it is not drawn and disappears. Therefore, nothing is drawn in detail buffer 65. Polygon model 53 includes the center of one pixel in detail buffer 66, so that pixel is filled with the RGB values associated with polygon model 53 included in the drawing information, and polygon model 53 is drawn. The result of drawing polygon model 53 is drawing result 71 of one pixel in FIG. 28. The drawing result 70 in the third embodiment is the same as drawing result 58 in FIG. 12 in the first embodiment. The rendering result 71 of the third embodiment is the same as the rendering result 59 of the first embodiment shown in FIG.

Figure 29 shows a drawing result 70 obtained by drawing polygon model 51, which is the applicable drawing target, in detail buffer 64, and a drawing result 71 obtained by drawing polygon model 53, which is another applicable drawing target, in another detail buffer 66. Figure 29 shows only the actual drawing results 70-71, without the superimposed display of multiple polygon models 51-53 in Figure 28. As with Figure 28, the drawing result 70 of embodiment 3 is the same as drawing result 58 in Figure 13 of embodiment 1. The drawing result 71 of embodiment 3 is the same as drawing result 59 in Figure 13 of embodiment 1.

The applied drawing target drawing unit 304 stores an alpha value, where the alpha value of polygon model 51 is 0.4, in a pixel of the drawing result 70, based on the alpha value information of polygon model 51. The applied drawing target drawing unit 304 also stores an alpha value, where the alpha value of polygon model 53 is 1.0, in a pixel of the drawing result 71, based on the alpha value information of polygon model 53. The values in the pixels in Figure 29 represent the stored alpha values.

After the applied drawing target drawing unit 304 has performed a process of drawing the polygon model 51 in the detail buffer 64, it obtains the number of pixels that have actually been filled in the detail buffer 64 by the polygon model 51. In the case of the polygon model 51, as can be seen from FIG. 29, the applied drawing target drawing unit 304 obtains information that the number of pixels that have actually been drawn in the detail buffer 64 is 1 pixel. After the applied drawing target drawing unit 304 has performed a process of drawing the polygon model 52 in the detail buffer 65, it obtains information that the number of pixels that have actually been filled in the detail buffer 65 by the polygon model 52. In the case of the polygon model 52, as can be seen from FIG. 29, not a single pixel has been filled in the detail buffer 65 by the polygon model 52, so the applied drawing target drawing unit 304 obtains information that the number of pixels is 0 pixel. After the applied drawing target drawing unit 304 has performed a process of drawing the polygon model 53 in the detail buffer 66, it obtains information that the number of pixels that have actually been filled in the detail buffer 66 by the polygon model 53. 29, in the case of polygon model 53, the applied drawing object drawing unit 304 acquires information that the number of pixels actually drawn in the detail buffer 66 is 1 pixel. Hereinafter, the information indicating the number of pixels drawn in the detail buffer by the applied drawing object acquired by the applied drawing object drawing unit 304 will be referred to as pixel number information, as in the first embodiment.

Returning to Figure 21, the application drawing target drawing unit 304 transmits the drawing information, tag information of the drawing target that is the application drawing target, alpha value information, and pixel count information to the dotting unit 305, and proceeds to step S48.

In step S48, the dotting unit 305 receives drawing information, tag information of the drawing target that is the applied drawing target, alpha value information, and pixel count information from the applied drawing target drawing unit 304. From the pixel count information, the dotting unit 305 identifies the lost applied drawing target that is the applied drawing target that was not drawn by the applied drawing target drawing unit 304 and disappeared, and dots the pixel in the detail buffer that corresponds to the position of the lost applied drawing target, and draws the lost applied drawing target in the detail buffer. At this time, the alpha value of the alpha value information is also stored in the detail buffer.

In embodiment 3, similarly to embodiment 1, the dotting unit 305 receives from the application drawing target drawing unit 304 drawing information, tag information of polygon model 51 tagged as the application drawing target, tag information of polygon model 52 tagged as the application drawing target, tag information of polygon model 53 tagged as the application drawing target, alpha value information that the alpha value of polygon model 51 is 0.4, alpha value information that the alpha value of polygon model 52 is 0.7, alpha value information that the alpha value of polygon model 53 is 1.0, pixel count information that the number of pixels drawn in the detail buffer 56 by polygon model 51 is 1 pixel, pixel count information that the number of pixels drawn in the detail buffer 56 by polygon model 52 is 0 pixels, and pixel count information that the number of pixels drawn in the detail buffer 56 by polygon model 53 is 1 pixel.

As in the first embodiment, the dotting unit 305 uses the pixel count information to identify an applied drawing target with a pixel count of 0 pixels as a lost applied drawing target, which is an applied drawing target that has disappeared without being drawn by the applied drawing target drawing unit 304. Specifically, since the pixel count information of the polygon model 52 is 0 pixels, the dotting unit 305 identifies the polygon model 52 as a lost applied drawing target.

The dotting unit 305 puts dots on pixels in the detail buffer 65 that correspond to the positions of the polygon model 52, which is the drawing target for loss application, and draws the drawing target for loss application in the detail buffer. The dotting unit 305 puts dots on pixels in the detail buffer 65 that correspond to the positions of the vertices of the polygon model 52, and draws the polygon model 52, which is the drawing target for loss application, in the detail buffer 65. Note that in the case of a drawing target that has no vertices, such as a circle or ellipse, the dotting unit 305 approximates a polygon and puts dots at the positions of the vertices of the polygon.

Figure 30 shows a drawing result 70 of polygon model 51, which is the applicable drawing target, drawn in detail buffer 64, a drawing result 71 of polygon model 53, which is another applicable drawing target, drawn in detail buffer 66, a drawing result 72 of polygon model 52, which is yet another applicable drawing target, drawn in detail buffer 65, and multiple polygon models 51 to 53 superimposed on each other. As polygon model 52 has three vertices, as in embodiment 1, dotting unit 305 dots pixels in detail buffer 65 corresponding to the positions of the three vertices of polygon model 52. Then, three pixels in detail buffer 65 corresponding to the positions of the three vertices of polygon model 52 are filled with RGB values associated with polygon model 52 included in the drawing information, and polygon model 52 is drawn. The result of drawing polygon model 52 is the three-pixel drawing result 72 in Figure 30.

Figure 31 shows a drawing result 70 in which polygon model 51, the applicable drawing target, is drawn in detail buffer 64, a drawing result 71 in which polygon model 53, another applicable drawing target, is drawn in detail buffer 66, and a drawing result 72 in which polygon model 52, yet another applicable drawing target, is drawn in detail buffer 65. Figure 31 shows only the actual drawing results 70-72, without the superimposed display of multiple polygon models 51-53 in Figure 30.

The dotting unit 305 stores an alpha value, which is 0.7 for the alpha value of the polygon model 52, in each pixel that constitutes the drawing result 72 based on the alpha value information of the polygon model 52. The values in each pixel in Figure 31 represent the stored alpha values.

Returning to FIG. 21, the dotting unit 305 sends a notification of the end of drawing to the detail buffer to the blending processing unit 306, and proceeds to step S49. Also, if there is no loss-applied drawing target, the dotting unit 305 does nothing because the applicable drawing target has already been drawn in the detail buffer, and sends a notification of the end of drawing to the detail buffer to the blending processing unit 306, and proceeds to step S49.

In step S49, when the blending processing unit 306 receives a notification of the end of drawing to the destination buffer from the non-applicable drawing object drawing unit 107 and a notification of the end of drawing to the detail buffer from the dotting unit 305, it uses the position information of each detailed buffer stored in the detail buffer 303 to alpha-blend the RGB values with the alpha value for each pixel of each detailed buffer stored in the detail buffer 303 for the drawing destination buffer stored in the destination buffer memory unit 103, and draws the applicable drawing object in the drawing destination buffer.

In the third embodiment, the blending processing unit 306 uses the position information 67 stored in the detail buffer 64 to alpha-blend the RGB values with the alpha value for each pixel of the detail buffer 64 in Fig. 31 for the drawing destination buffer 55 in Fig. 8, and draws the polygon model 51, which is the applicable drawing target, in the drawing destination buffer 55. Specifically, the blending processing unit 306 alpha-blends the RGB values of the polygon model 51 with an alpha value of 0.4 for each pixel of the drawing result 70 of the polygon model 51 in Fig. 31 at a position corresponding to the position information 67 for the drawing destination buffer 55 in Fig. 8 stored in the drawing destination buffer storage unit 103.

Similarly, the blending processing unit 306 uses the position information 68 stored in the detail buffer 65 to alpha-blend the RGB values with the alpha value for each pixel of the detail buffer 65 in FIG. 31 for the drawing destination buffer 55 in FIG. 8, and draws the polygon model 52, which is the applicable drawing target, in the drawing destination buffer 55 in FIG. 8. Specifically, the blending processing unit 306 alpha-blends the RGB values of the polygon model 52 with the alpha value of each pixel of the drawing result 72 of the polygon model 52 in FIG. 31 at a position corresponding to the position information 68 for the drawing destination buffer 55 in FIG. 8 stored in the drawing destination buffer storage unit 103.

The blending processing unit 306 uses the position information 69 stored in the detail buffer 66 to alpha-blend the RGB values with the alpha value for each pixel of the detail buffer 66 in Fig. 31 for the drawing destination buffer 55 in Fig. 8, and draws the polygon model 53, which is the applicable drawing target, in the drawing destination buffer 55. Specifically, the blending processing unit 306 alpha-blends the RGB values of the polygon model 53 with an alpha value of 1.0 for each pixel of the drawing result 71 of the polygon model 53 in Fig. 31 at a position corresponding to the position information 69 for the drawing destination buffer 55 in Fig. 8 stored in the drawing destination buffer storage unit 103.

The diagram showing the rendering result when all polygon models are rendered in the destination buffer 55 is similar to Figure 16.

The blending processing unit 306 sends a notification of the end of alpha blending to the output control unit 111 and proceeds to step S50.

In step S50, the output control unit 111 receives a notification of the end of alpha blending from the blend processing unit 306. Otherwise, step S50 is the same as step S19 in embodiment 1.

After step S50 is executed, the process returns to step S41, and the above-described process is repeated until a trigger for terminating the process occurs, such as turning off the power or performing an end operation. Note that although the above-described process is repeated, it is also possible to perform the process only once without repeating it.

As described above, in the drawing processing system 3 of the third embodiment, the non-applicable drawing target drawing unit 107 draws the drawing target determined by the application determination unit 106 as a non-applicable drawing target in the drawing destination buffer stored in the drawing destination buffer memory unit 103, the calculation unit 104 calculates the area of the drawing target determined by the application determination unit 106 as an applicable drawing target, the determination unit 105 determines the alpha value of the applicable drawing target from the calculated area, the applicable drawing target drawing unit 304 draws the applicable drawing target in the detail buffer, which is a buffer different from the drawing destination buffer, the dotting unit 305 draws the applicable drawing target in the detail buffer by dotting pixels in the detail buffer corresponding to the position of the applicable drawing target, the blending processing unit 306 alpha-blends the detail buffer with the alpha value of the applicable drawing target, and the output control unit 111 controls the output device 5 to output the scene drawn in the drawing destination buffer, so that even if the drawing target is not located at the center of the pixel, the drawing target can be drawn and displayed on the display screen.

In addition, in the third embodiment, the drawing processing system 3 has the allocation creation unit 302 create a detailed buffer in the detail buffer storage unit 303 corresponding to the range of each applied drawing object, and the applied drawing object drawing unit 304 and the dotting unit 305 draw the applied drawing object in the detailed buffer corresponding to the range of the applied drawing object. By this drawing, when the proportion of the range not used for drawing the applied drawing object is high, the drawing processing system 3 only needs to create a detailed buffer corresponding to the range of the applied drawing object, so there is no need to create buffers unnecessarily and memory usage can be reduced.

In the first to third embodiments, when drawing objects with large differences in drawing size are mixed in the same scene, conventional drawing processing devices are required to draw the entire scene, and in order to draw small drawing objects, such as those smaller than one pixel, so that they do not disappear from the display screen, it is necessary to draw the drawing objects at a higher magnification or with a larger number of pixel divisions. In other words, in a conventional drawing processing device, when drawing objects with large differences in drawing size are mixed in a scene, if the entire scene is drawn at a magnification or division number corresponding to the smallest drawing object, the other drawing objects are also drawn at a higher resolution or with a larger number of divisions, which increases the drawing processing load. However, since drawing processing systems 1 to 3 do not need to draw at a higher resolution, it is possible to reduce the drawing processing load caused by drawing objects so that they do not disappear from the display screen.

In embodiments 1 to 3, drawing processing systems 1 to 3 have a calculation unit that calculates the area of the applicable drawing object and a determination unit that calculates an alpha value from that area, so that the luminance value of the drawing object can be determined according to the size of the drawing object, resulting in an appropriate luminance. Furthermore, drawing processing systems 1 to 3 perform alpha blending, so the background color does not disappear.

In the first to third embodiments, the drawing processing systems 1 to 3 have an applied drawing object drawing unit that draws the applied drawing object in the detail buffer and obtains the number of drawn pixels, and a dotting unit that identifies the lost applied drawing object that was not drawn in the detail buffer from the number of drawn pixels obtained for each applied drawing object, dots the pixels in the detail buffer corresponding to the position of the lost applied drawing object, and draws the lost applied drawing object in the detail buffer. However, the drawing processing systems 1 to 3 may eliminate the applied drawing object drawing unit, and the dotting unit may dot the pixels in the detail buffer corresponding to the position of the applied drawing object for all applied drawing objects, and draw all applied drawing objects in the detail buffer. However, in order to eliminate the applied drawing object drawing unit and have the dotting unit draw all applied drawing objects in the detail buffer, if the applied drawing object has a complex shape, the number of dots to be dotted increases, so it is better to provide an applied drawing object drawing unit and have the dotting unit dot the pixels in the detail buffer corresponding to the position of the lost applied drawing object, and draw the lost applied drawing object in the detail buffer, thereby reducing the load on the drawing process. Furthermore, the drawing processing systems 1 to 3 can perform drawing more accurately if they draw an applicable drawing object having a certain area in the applicable drawing object drawing section.

In embodiments 1 to 3, the drawing processing systems 1 to 3 have a dot marking unit that marks pixels in the detail buffer corresponding to the positions of the vertices of the disappearance-applied drawing object, but it is also possible to mark pixels in the detail buffer corresponding to the position of the center of gravity of the disappearance-applied drawing object. However, if the dot marking unit marks pixels in the detail buffer corresponding to the position of the center of gravity of the disappearance-applied drawing object, it is necessary to calculate the center of gravity. The drawing processing systems 1 to 3 can reduce the drawing processing load by having the dot marking unit mark pixels in the detail buffer corresponding to the positions of the vertices of the disappearance-applied drawing object, rather than marking pixels in the detail buffer corresponding to the position of the center of gravity of the disappearance-applied drawing object.

In embodiments 1 to 3, drawing processing systems 1 to 3 sequentially process the drawing of non-applied drawing targets and then the drawing of applied drawing targets, but they may be drawn simultaneously in parallel, the drawing order may be reversed, or the drawing of non-applied drawing targets and the drawing of applied drawing targets may be processed in a random order. Also, if there are multiple non-applied drawing targets, drawing processing systems 1 to 3 may draw the multiple non-applied drawing targets in sequence, or may draw the non-applied drawing targets in parallel simultaneously. Similarly, if there are multiple applied drawing targets, drawing processing systems 1 to 3 may draw the multiple applied drawing targets in sequence, or may draw the applied drawing targets in parallel simultaneously.

In embodiments 1 to 3, the drawing processing systems 1 to 3 are provided with a detailed buffer storage unit, but the storage unit may be divided into multiple units for processing. Also, in the drawing processing systems 1 to 3, the drawing processing devices 100 to 300 are provided with a drawing destination buffer storage unit and a detailed buffer storage unit, but these storage units may be provided in a device different from the drawing processing devices 100 to 300, such as a cloud. The drawing processing devices 100 to 300 may exchange information with the storage units via communication.

In the first embodiment, in the drawing processing system 1, the creation unit 102 creates a destination buffer and a detail buffer in step S12, but the destination buffer and the detail buffer may be created in advance. Also, after the creation unit 102 creates the destination buffer in step S12, the creation unit 102 may create the detail buffer between steps S13 to S16. The destination buffer may be created any time before drawing is performed in the destination buffer. Also, the detail buffer may be created any time before drawing is performed in the detail buffer. Similarly, in the second and third embodiments, the destination buffer may be created any time before drawing is performed in the destination buffer. Also, the detail buffer may be created any time before drawing is performed in the detail buffer.

In the first to third embodiments, the drawing processing systems 1 to 3 use a bounding box 80 when calculating an approximate value of the area of each drawing object, but it is not limited to a box; it may be a shape that has fewer vertices than the drawing object, such as a sphere, a rugby ball shape, a triangular prism, or a triangular pyramid, and whose area is easier to calculate than the area of the drawing object. A combination of these may also be used. Note that bounding boxes and the like can be used not only to estimate the area of three-dimensional drawing objects, but also to estimate the area of two-dimensional drawing objects. In this case, a sphere is replaced with a circle, a rugby ball shape with an ellipse, and triangular prisms and pyramids with triangles, which are easier to calculate.

In the first to third embodiments, the drawing processing systems 1 to 3 are applied, for example, to the case where the drawing object is a polygon model, which is one of the surface models of three-dimensional graphics, but they can also be applied to surface models other than polygon models, solid models, point models, etc. Also, the drawing processing systems 1 to 3 can be applied to the case where the drawing object is not three-dimensional graphics but two-dimensional graphics.

In embodiments 1 to 3, the drawing processing systems 1 to 3 are applied, for example, when the drawing object is to display an RGB color drawing represented by RGB values, but they can also be applied when displaying a drawing represented in grayscale or HSB color.

However, the drawing processing device, drawing processing system, drawing processing method, and drawing processing program shown in the above-mentioned embodiments are merely examples, and can be configured in combination with other devices as appropriate, and are not limited to the configuration of the embodiments alone.

1 to 3: drawing processing system; 4, 6: input device;
5 output device, 41 bus, 42 CPU,
43 main memory, 44 GPU,
45 Graphic memory, 46 Input interface,
47 Output interface, 51-54 Polygon model,
55 drawing destination buffer,
56, 64 to 66, 70 to 72 Detail buffer,
57-63 Drawing results, 67-69 Position information,
80 bounding boxes,
81 Drawing object, 82 Area,
100 to 300: drawing processing device; 101, 201: acquisition unit;
102, 301 creation unit, 103 drawing destination buffer storage unit,
104, 204 calculation unit, 105, 205 determination unit,
106, 202 application determination unit,
107, 203 non-applicable drawing object drawing section,
108, 209, 304 Applied drawing object drawing unit,
109, 303 detailed buffer memory unit,
110, 207, 306 blend processing unit,
111 output control unit, 112, 210, 305 dotting unit,
206 End determination unit, 208 Accumulation storage unit,
302 Allocation creation unit.

Claims (13)

a dotting unit that draws dots on pixels in a buffer corresponding to positions of a two or more dimensional drawing object, and draws the drawing object in the buffer;
an output control unit that controls the scene drawn in the buffer to be output to an output device ;
an application determination unit that determines whether the drawing target is a first drawing target to be drawn in a first buffer that is a drawing destination, or a second drawing target to be drawn in a second buffer that is a buffer different from the first buffer;
a first drawing object drawing unit that draws the drawing object determined to be the first drawing object by the application determination unit in the first buffer;
a blend processing unit that alpha-blends the first buffer with the second buffer using an alpha value that represents the transparency of the drawing object,
the buffer is the second buffer,
the dotting unit draws a dot on a pixel in the second buffer corresponding to a position of the second drawing object, thereby drawing the second drawing object in the second buffer;
The output control unit controls so as to output the alpha-blended scene drawn in the first buffer to the output device.
Drawing processing unit. a calculation unit that calculates an area of the drawing object determined to be the second drawing object by the application determination unit;
The drawing processing device according to claim 1 , further comprising a determination unit that determines an alpha value representing a transparency of the second drawing object from the area calculated by the calculation unit. a second drawing object drawing unit that draws the second drawing object in the second buffer and obtains the number of pixels filled when the second drawing object is drawn in the second buffer;
3. The drawing processing device according to claim 1, wherein the dotting unit dots a dot at a position in the second buffer corresponding to the second drawing object where the pixel count is 0 pixels, and draws the second drawing object in the second buffer. 4. The drawing processing device according to claim 1 , wherein the dotting unit puts a dot on a pixel in the second buffer corresponding to a position of a vertex of the second drawing object or a position of a center of gravity of the second drawing object. The drawing processing device according to claim 2 , wherein the calculation unit calculates, as the area of the second drawing object, an area roughly estimated using a shape that is similar to the second drawing object and has a smaller number of vertices than the second drawing object. The drawing processing device according to claim 1 , further comprising an allocation creation unit that creates the second buffer for each of the second drawing objects in accordance with an area of each of the second drawing objects. 7. The drawing processing device according to claim 6, wherein the allocation creation unit calculates a size of the second buffer for each of the second drawing objects relative to the first buffer by setting the area of the second drawing object to an approximate area of a shape that is similar to the second drawing object and has fewer vertices than the second drawing object. an acquisition unit that acquires tag information that is information indicating whether the drawing target is the first drawing target or the second drawing target;
The drawing processing device according to claim 1 , wherein the application determination unit determines whether the drawing target is the first drawing target or the second drawing target by using the tag information. The drawing processing device according to claim 1 , wherein the application determination unit determines whether the drawing target is the first drawing target or the second drawing target by using an area of the drawing target. The drawing processing device according to claim 9 , wherein the application determination unit varies a threshold value used to determine whether the drawing object is the first drawing object or the second drawing object by using at least one of the luminance of the drawing object or an importance previously assigned to the drawing object . an input device that accepts input of a two or more dimensional drawing object;
a drawing processing device that performs drawing processing to draw the drawing object in a buffer as a scene;
an output device for outputting the scene;
The drawing processing device includes:
a dotting unit that draws a dot on a pixel in the buffer corresponding to a position of the drawing object, thereby drawing the drawing object in the buffer;
an output control unit that controls the scene drawn in the buffer to be output to the output device ;
an application determination unit that determines whether the drawing target is a first drawing target to be drawn in a first buffer that is a drawing destination, or a second drawing target to be drawn in a second buffer that is a buffer different from the first buffer;
a first drawing object drawing unit that draws the drawing object determined to be the first drawing object by the application determination unit in the first buffer;
a blend processing unit that alpha-blends the first buffer with the second buffer using an alpha value that represents the transparency of the drawing object,
the buffer is the second buffer,
the dotting unit draws a dot on a pixel in the second buffer corresponding to a position of the second drawing object, thereby drawing the second drawing object in the second buffer;
The output control unit controls so as to output the alpha-blended scene drawn in the first buffer to the output device.
Drawing processing system. a dotting unit drawing dots on pixels in a buffer corresponding to positions of a drawing object in two or more dimensions, thereby drawing the drawing object in the buffer;
an output control unit controlling the scene drawn in the buffer to be output to an output device ;
a step of an application determination unit determining whether the drawing target is a first drawing target to be drawn in a first buffer that is a drawing destination, or a second drawing target to be drawn in a second buffer that is a buffer different from the first buffer;
a first drawing object drawing unit drawing the drawing object determined to be the first drawing object by the application determination unit in the first buffer;
a blending processing unit alpha-blending the second buffer into the first buffer using an alpha value that represents a transparency of the rendering object;
the buffer is the second buffer,
the dotting unit draws a dot on a pixel in the second buffer corresponding to a position of the second drawing object, thereby drawing the second drawing object in the second buffer;
The output control unit controls so as to output the alpha-blended scene drawn in the first buffer to the output device.
Drawing processing method. On the computer,
plotting pixels in a buffer corresponding to positions of a two or more dimensional object to be drawn in the buffer;
a process of controlling output of the scene drawn in the buffer to an output device ;
a process of determining whether the drawing target is a first drawing target to be drawn in a first buffer that is a drawing destination, or a second drawing target to be drawn in a second buffer that is a buffer different from the first buffer;
a process of drawing the drawing target determined to be the first drawing target in the process of determining, in the first buffer;
alpha-blending the first buffer with the second buffer using an alpha value that represents the transparency of the rendering target;
the buffer is the second buffer,
causing the computer to plot pixels in the second buffer corresponding to the location of the second object, thereby rendering the second object into the second buffer;
Controlling the computer to output the alpha-blended scene drawn in the first buffer to the output device.
Drawing processing program.

Images