WO2007013492A1 - Multilayer reflection shading image creating method and computer - Google Patents

Abstract

[PROBLEMS] To provide a multilayer reflection shading image creating method and device for computer graphics enabling high-speed shading computation, and a computer. [MEANS FOR SOLVING PROBLEMS] An image creating device (1) comprises layer color creating means (2) for receiving the results of shading by a single light source or bylight sources and a surface layer set value representing to which surface layer the shading results belong and creating surface layer colors for at least two layers, layer coefficient blending means (3) for receiving the surface colors and a blend coefficient and creating the surface layer colors of at least the two layer after blending, and a color blending means (4) for combining the surface layer colors after the blending into a single color. Even without considering the light incident on pixels other than a specific pixel, brightness computation can be efficiently conducted. Therefore, a multilayer reflection shading image creating device for computer graphics enabling high-speed computation of shading is provided.

Description

 Specification

 Multilayer reflection shading image generation method and computer

 Technical field

 The present invention relates to a multilayer reflection shading image generation method for computer graphics, a computer, and the like. In particular, the present invention is a multi-layer reflection for real-time 3D computer graphics that effectively performs luminance calculation in consideration of light scattering on the surface of a translucent object (for example, human skin or large stone). The present invention relates to a shading image generation method and a computer.

 Background art

 [0002] In computer graphics, translucent objects (such as human skin and marble) have their pixels shaded in consideration of the complex scattering of light incident on the object surface. Made. As a method for calculating the complicated reflection on the object surface, there is a method using BS¾RDF (bidirectional surface scattering reflect distribution function) (for example, see Non-Patent Document 1 and Non-Patent Document 2 below).

 [0003] However, in the method using BSSRDF, in order to shade a certain pixel, it is necessary to consider not only the incident light to that pixel but also the incident light to pixels other than that pixel. there were. For this reason, the conventional method has a problem that it cannot calculate shadows at high speed!

 [0004] Tokui Literature 1: A Practical Model for Subsurface Light Transport, Henrik Wann Jense n Stephen R. Marschner Marc Levoy Pat Hanrahan, Stanford University, To appear in the SIGGRAPHconference proceedings

 Non-Patent Document 2: Anlnexpensive BRDF Model for Physically-based Rendering, Christop he Schlick, Eurographics' 94, Computer Graphics Forrum, vl3, n3, p233-246, 1994 Disclosure of the invention

 Problems to be solved by the invention

[0005] An object of the present invention is to provide a multi-layer reflection shading image generation method for computer graphics, a computer, and the like that can calculate a shadow and the like at high speed. To do.

 Means for solving the problem

 [0006] Basically, the present invention combines the blending coefficient for synthesizing the surface color with the single light source or multiple light source shading results for a specific pixel, and determines the surface color after blending for at least two layers. By generating and synthesizing it into a single color, it is possible to effectively perform luminance calculations and generate shaded image data for computer graphics without considering the incident light to pixels other than a specific pixel. It is based on the knowledge that it is possible.

 That is, according to the first aspect of the present invention, a computer receives a shading result of a single light source or a plurality of light sources for a specific pixel, and a surface layer setting value indicating to which surface layer the shading result belongs. Based on the set value of the surface layer, the sieving result is distributed to each surface layer to generate at least two surface layer colors, and the surface layer color for at least two layers is combined with a blend coefficient for synthesizing the surface layer color. By generating the surface color after blending for at least two layers and combining the surface color after blending for at least two layers into a single color, without considering the incident light to pixels other than the specific pixel, The present invention relates to an image generation method for generating image data for computer graphics related to the specific pixel.

[0008] Further, another aspect of the present invention is an image generation apparatus for computer graphics, in which a single light source or a plurality of light sources for a specific pixel is shaded, and on which surface the shading result is stored. A layer color generation means for receiving a surface layer setting value indicating whether it belongs and generating at least two surface colors; a surface color for at least two layers generated by the layer color generation means; and a surface color A layer coefficient blending means for generating a blended surface coefficient for at least two layers by combining a blend coefficient for each of the surface color, and generating a blended surface coefficient. Color blending means for synthesizing at least _two layers of the blended surface layer color output from the blending means into a single color. The layer color generation means receives a shading result of a single light source or a plurality of light sources for the specific pixel and a surface layer setting value indicating which surface layer the shading result belongs to. At least two surface colors are generated, and the layer coefficient blending means receives at least two surface colors generated by the layer force error generating means and a blend coefficient for synthesizing the surface colors. , Combining the blending coefficients for each of the surface layer colors, generating a surface layer color after blending for at least two layers, and the color blending means blending for at least two layers output from the layer coefficient blending means The present invention relates to an image generation device that generates image data for computer graphics by combining the subsequent surface color into a single color. Furthermore, another aspect of the present invention is a computer, a game machine, a mobile phone, a navigation system, a computer program, and a computer-readable recording medium storing the computer program using such an image generation apparatus. About throat.

 The invention's effect

 [0009] In the present invention, a blending coefficient for synthesizing the surface layer color is combined with the shading result of a single light source or a plurality of light sources for a specific pixel to generate a surface layer color after blending for at least two layers. Combine into one color. As a result, according to the present invention, since it is possible to perform luminance calculation and the like without considering light incident on pixels other than a specific pixel, it is possible to compute shadows and the like at high speed. A multilayer reflection shading image generation method and a computer can be provided. Brief Description of Drawings

FIG. 1 is a block diagram showing a basic configuration of an image generation apparatus according to the present invention.

 FIG. 2 is a flowchart for explaining the image generation method of the present invention.

 FIG. 3 is a block diagram showing a basic configuration of a computer system according to an embodiment of the present invention.

 FIG. 4 is a block diagram showing a graphics device according to an embodiment of the present invention.

 FIG. 5 is a block diagram showing shading means according to an embodiment of the present invention.

FIG. 6 is a block diagram for explaining layer color generation means and layer coefficient blending means. FIG. 7 is a block diagram showing an example of layer color generation means (or part thereof).

 FIG. 8 is a block diagram showing a configuration example of layer coefficient blending means.

 FIG. 9 is a block diagram showing an example of color blending means.

 [FIG. 10] FIG. 10 is a block diagram showing the circuit configuration of the layer 0 blend inside the color blending means.

 [FIG. 11] FIG. 11 is a block diagram of the image generation apparatus in which the shading result and blend coefficient for each light source output from the shading means are processed as serial data and the number of powers of the surface layer is 4.

 [FIG. 12] FIG. 12 is a diagram showing a flow of blending processing of one pixel.

 FIG. 13 is a block diagram showing an embodiment (computer) of the present invention.

 FIG. 14 is a block diagram of an embodiment (game machine) according to the present invention.

 FIG. 15 shows an embodiment of the present invention (a mobile phone with a computer graphic function).

) Is a block diagram.

 FIG. 16 is a block diagram of an embodiment (navigation system) of the present invention.

Explanation of symbols

[0011] 1 Image generator

 2 Layer color generation means

 3 Layer coefficient blending means

 4 Color blending means

 BEST MODE FOR CARRYING OUT THE INVENTION

[Outline of Image Generating Device]

FIG. 1 is a block diagram showing the basic configuration of the image generation apparatus of the present invention. As shown in FIG. 1, the image generation device (1) of the present invention is a computer for computer graphics or a device constituting the computer, and the result of shading of a single light source or a plurality of light sources for a specific pixel is obtained. A layer color generation means (2) for receiving a surface layer setting value indicating to which surface layer the shading result belongs and generating at least two surface colors; and at least the layer color generation means generated by the layer color generation means Surface layer for 2 layers Layer coefficient blending means for receiving a color and a blend coefficient for synthesizing the surface layer color, combining the blend coefficient for each of the surface layer colors, and generating a surface color after blending for at least two layers (3 ) And a color blending means (4) for synthesizing the surface color after blending for at least two layers output from the layer coefficient blending means into a single color.

 In this specification, “shading result” means, for example, the results of luminance calculations such as nuclear acid reflection (diffuse), specular reflection (specular), and indirect light (ambient) from each light source. This means the brightness calculation result for each light source. For example, there are four types: a diffuser from the first light source, a diffuser from the first light source, a diffuser from the second light source, and a diffuser from the second light source. , It is preferable that the shading results have multiple types of power. The light source may be a parallel light source, a point light source, or a spot light source. In addition, the relationship between the light sources in the multiple light sources is arbitrary.

 [0014] The surface layer means each surface layer having different characteristics with respect to light such as reflectance and refractive index with respect to light incident on an object. A layer is also called a layer.

 [0015] "Surface layer setting value" means a setting value or a distribution command for distributing the shading result to the surface layer. The surface layer setting value is information that indicates which shading result is to be assigned among multiple operation results that are shading results for each surface layer. The surface layer setting value may be obtained by a program that causes the computer to function to assign a predetermined shading result among a plurality of calculation results that are shading results for each surface layer. Also, the surface layer setting value may be obtained by a circuit that functions to allocate a predetermined shading result among a plurality of calculation results that are shading results for each surface layer, a memory that stores such allocation information, and the like. Good. For example, when there are 8 surface shading results from A to H and there are 3 layers, A, B, D, F, and H are assigned to the first surface, and A, C, E Assign G and G to the second surface layer and B and H to the third surface layer.

[0016] "Blend coefficient" is used to obtain the surface layer color by multiplying it with the shading result. This means the inner product value. The blending coefficient may be obtained, for example, by obtaining the inner product by the inner product calculating circuit using various vectors included in the vertex data. In addition, since the inner product of various vectors is obtained when the scaling means described later performs the calculation, the inner product of these vectors may be used as appropriate to obtain the blend coefficient. The blend coefficient may be input to the layer coefficient blending means described later via a nose. In addition, the blend coefficient may be stored in a memory or the like and read as appropriate.

 The “single color” to be combined means a calculation result such as luminance at a pixel of a multilayer reflection shading image. Hereinafter, each constituent unit constituting the image generating apparatus (1) according to the first embodiment of the present invention will be described.

 [0018] [Layer color generation means]

 The layer color generation means (2) receives a shading result of a single light source or a plurality of light sources for a specific pixel and a surface layer setting value indicating which surface layer the shading result belongs to, and generates a surface color for at least two layers. It is a means to do. “Generate surface color” includes selecting the surface color to obtain the surface color. The shading result of a single light source or multiple light sources for a specific pixel is obtained by the shading means in the computer, which will be described later, and is transmitted to the layer color generation means (2) via, for example, a bus. The shading result is preferably a shading result considering light from multiple light sources. For example, the CPU can read the surface setting value from the memory that stores the surface setting value or the program in the main memory and input it to the layer color generation means via the nose. ,.

[0019] The layer color generation means (2) receives a shading result of a single light source or a plurality of light sources for a specific pixel and a surface layer setting value indicating to which surface layer the shading result belongs, and receives at least two surface layers. It may be implemented by hardware such as a circuit for generating colors. The layer color generation means (2) receives a shading result of a single light source or a plurality of light sources for a specific pixel and a surface layer setting value indicating to which surface layer the shading result belongs, and at least for two layers. It may be implemented by software such as a program that causes a computer to function as a means for generating the surface color of the image, or by both hardware and software. Hardue Examples of the key include a control unit, a calculation unit, a storage unit, an input / output unit, and a system node that connects them. Then, when the predetermined information is input to the input unit force, the calculation unit reads the input data, the data stored in the storage unit, the surface layer setting value, etc. in response to a command from the control unit. The memory is used as a work area and predetermined calculations are performed. The calculation result is temporarily stored in the memory, for example, and then output from the output unit. These data may be transmitted through a bus, for example.

 [0020] As the layer color generation means (2), a light selection setting means for outputting an assignment command for assigning the input shading result to each surface layer using the surface layer setting value, and a light selection setting means power Examples include a layer color selection means for selecting an input shading result for each surface layer in accordance with an allocation command. Then, a seeding result of a single light source or a plurality of light sources for a specific pixel and a surface layer setting value indicating to which surface layer the seeding result belongs are received, and the light selection setting means receives the input shading result as a surface layer. The layer color selection means assigns each surface layer using a set value, and selects the shading result input for each surface layer in accordance with an assignment command from the light selection setting means, thereby at least two layers. Generate a surface color. For example, when 8 shading results from A to H are input from the shading means, A, B, D, F and H are allocated from the memory to the first surface layer, and A, C, E and Allocate G to the second surface layer, assign B and H to the third surface layer, read the surface layer setting values, assign the shading results in this way, and generate (select) each layer color.

 [0021] [Layer coefficient blending means]

 The layer coefficient blending means (3) receives the surface color of at least two layers generated by the layer color generation means and the blend coefficient for synthesizing the surface layer color, and sets the blend coefficient for each of the surface color. It is a means for generating a surface color after blending and blending for at least two layers.

[0022] The layer coefficient blending means (3) receives the surface color for at least two layers generated by the layer color generation means and the blend coefficient for synthesizing the surface layer color, and receives each of the surface color. Combined with blending coefficient, surface color after blending for at least two layers It may be implemented by hardware such as a circuit for generating. The layer coefficient blending means (3) receives at least two surface layer colors generated by the layer color generation means from the computer and a blend coefficient for synthesizing the surface layer colors. It may be implemented by software such as a program for functioning as a means to generate a surface color after blending at least two layers by combining blending coefficients, or by both hardware and software . The hardware includes a control unit, arithmetic unit, storage unit, input / output unit, and a system bus that connects them. When predetermined information is input from the input unit, in response to a command from the control unit, the calculation unit reads out the input data and data such as blend coefficients stored in the storage unit. The memory is used as a work area and predetermined calculations are performed. Specific operations include multiplication of the blend coefficient and surface color, and summation that produces several calculation results. The calculation result is temporarily stored in the memory, for example, and then output from the output unit. These data may be transmitted via a bus, for example.

 [0023] [Color blending means]

 Color blending means (4) is a means for synthesizing at least two layers of the blended surface layer color output from the layer coefficient blending means into a single color. This determines the color or brightness at a pixel.

[0024] The color blending means (4) may be implemented by hardware such as a circuit for synthesizing the surface color after blending at least two layers output from the layer coefficient blending means into a single color, It may be implemented by software such as a program for causing a computer to function as a means for synthesizing at least two layers of blended surface colors output from the layer coefficient blending means into a single color. May be implemented by both. The hardware includes a control unit, a calculation unit, a storage unit, an input / output unit, and a system bus that connects them. When predetermined information is input from the input unit, the control unit receives an instruction from the control unit, and reads the input data and data stored in the storage unit. For example, the memory of the storage unit is read from the work area. To perform a predetermined calculation. The calculation result is temporarily stored in a memory, for example. And then output from the output section. These data may be transmitted via a bus, for example.

 [Basic operation of image generation apparatus]

 The image generation device (1) of the present invention obtains image data as follows, for example. FIG. 2 is a flowchart for explaining the image generation method of the present invention. As shown in Fig. 2, the layer color generation means receives the shading result of a single light source or a plurality of light sources for the specific pixel and the surface layer setting value indicating which surface layer the shading result belongs to (step 1). . Specifically, for example, it receives the results of swaying, such as diffuse and specular, obtained by the shading means via a bus. In addition, the CPU receives a command from a program stored in the main memory, reads the surface layer setting value stored in the memory or the like, and transmits the surface layer setting value to the layer color generation unit via a bus or the like. In this way, the surface layer setting value transmitted is received.

 [0026] Then, the layer color generation means generates surface colors of at least two layers (for example, three layers) (step 2). Specifically, an assignment command for assigning to each surface layer is output using the surface layer setting value, and an input shading result is selected for each surface layer according to the assignment command, so that the surface layer for each surface layer is selected. Generate colors (for example, containing one or more seeding results).

 [0027] Next, the layer coefficient blending means receives at least two layer surface colors generated by the layer color generation means and a blend coefficient for synthesizing the surface layer colors, and each of the surface layer colors is received. Combine the blend coefficients to generate at least two surface colors after blending (Step 3). For example, the blend coefficient is stored in a memory as an inner product value of a predetermined vector, so the CPU receives a program command stored in the main memory, reads the blend coefficient stored in the memory, etc. It communicates to the layer-one coefficient blending means via a bus. The layer coefficient blending means generates the blended surface color by multiplying the received blend coefficient with the surface color generated by the layer color generation means.

[0028] Next, at least the color blending means is output from the layer coefficient blending means. Also, the surface color after blending for two layers is received and added to generate a single color image data (step 4). Specifically, a single color may be synthesized by calculating the sum of the surface colors using an adder circuit, adder, or addition program.

 [0029] By using the result of sueding at a specific pixel and dividing it into multiple surface layers and combining it with the blending coefficient, a single color is taken into account. Colors can be calculated, and brightness calculations can be performed effectively without taking into account incident light on pixels other than specific pixels. As a result, the image generation apparatus of the present invention can calculate shadows and the like at high speed.

 [0030] [Computer]

 FIG. 3 is a block diagram showing the basic configuration of a computer system according to an embodiment of the present invention. As shown in FIG. 3, the computer system 10 according to the present embodiment includes a CPU 11, a memory 12, I / 013, a graphics device 14, and a display 15. The CPU 11, memory 12, I / 013, graphics device 14, and display 15 are connected to the system node 16 and transfer data to each other. For example, since the graphic device 14 incorporates the above-described image forming apparatus of the present invention, the predetermined processing described above can be performed to effectively obtain a shaded image, and the display is considered in consideration of shading. An image is displayed.

 [0031] [Graphic device]

FIG. 4 is a block diagram illustrating a graphics device according to an embodiment of the present invention. This graphic device may function as a graphic device indicated by reference numeral 14 in FIG. 3 or a part thereof, and may be a part constituting a computer. As shown in Fig. 4, the graphics device according to this embodiment performs vertex data interpolation with a geometry engine 22 (geometric operation circuit, device, part, etc.) 22 that receives vertex data 21 and the like and performs geometric operations. Vertex data interpolation means (vertex data interpolation circuit, device, part, etc.) 23, seeding means (shading circuit, device, part, etc.) 24 for shading calculation, and texture means (texture synthesis) for texture synthesis 25), texture memory 26 for storing textures, etc., layer color A generation means 2, a layer coefficient blending means 3, and a color blending means 4 are provided, and each element is connected by a system bus 16 or the like.

 [0032] [Basic operation of graphic device]

 The basic operation of the graphic device will be described below. The geometry engine 22 is connected to the system bus 16 of the computer system 10 and receives vertex data 21 as input data. The geometry engine 22 performs geometric transformation on the vertex data, performs perspective transformation and viewport mapping, and then outputs the transformed vertex data to the vertex data interpolation means 23. The vertex data interpolating means 23 interpolates each parameter associated with the inside of the polygon (usually a triangle) that also constitutes the input vertex data force, and outputs it to the shading means 24 and the texture means 25, respectively.

 The texture unit 25 calculates the access address to the texture memory 26 for the u and v coordinate forces input from the vertex data interpolation unit 23, and receives the corresponding data from the texture memory 26. The data input from the texture memory 26 is, for example, one or more of color data, bump mapping data, and tangent vector data. The texture means 25 determines whether the data input from the texture memory 26 is for bump mapping or tangent vector data, and if the input data is for bump mapping or tangent vector data, Output data to 24. On the other hand, if the data input from the texture memory 26 is error data, the data is output to the color blending means 4.

 [0034] The shading means 24 performs the luminance calculation for each pixel in units of light source units for the interpolation data inputted from the vertex data interpolation means 23 and the bump mapping data inputted from the texture means 25 or the tangent vector data. The result is output to the layer color generation means 2. Thereafter, for example, color information for shading is obtained in accordance with the operation of the image forming apparatus described above.

 [0035] [Shading means]

Next, a basic configuration example and an operation example of the shading means 24 will be described. FIG. 5 is a block diagram showing shading means according to an embodiment of the present invention. As shown in FIG. 5, the shading means according to this embodiment is a system interface (I ZF) 31, bump rotation, tangent rotation, or half vector generation calculation for bump rotation, tangent rotation, half vector generation means 32, and light attenuation means (light attenuation circuit) for determining attenuation factors, etc. 33, inner product calculation means (such as an arithmetic circuit such as a multiplication circuit) 34 for performing inner product calculation, etc., write-shading means (such as an arithmetic circuit) 35 (35a to 35d) for performing shading calculation, etc. And light blending means 36 (36a to 36d) for obtaining a shading result using the attenuation coefficient from the light attenuating means and the input value from the light shading means.

 [0036] Each element constituting the shading means may be implemented by hardware such as a circuit, may be implemented by software such as a program, or may be implemented by both hardware and software. . Also, each may be configured as a device, a part, or the like. Examples of hardware include a control unit, a calculation unit, a storage unit, an input / output unit, and a system node that connects them. When predetermined information is input from the input unit, the control unit receives a command from the control unit and reads the input data or data stored in the storage unit. For example, the memory of the storage unit is used as a work area. Use it to perform specified calculations. The calculation result is temporarily stored in the memory, for example, and then output from the output unit. These data may be transmitted through a bus, for example.

 [0037] [Shading process]

 Next, an example of shading processing will be described. The shading means 24 includes a vertex data interpolation means 23 (Fig. 4), a plurality of light vectors Ln (41), a line-of-sight vector V (42), a normal vector N (43) and a texture means 25 (Fig. 4). Using the input tangent vector T (44) and bump vector B (45), the luminance calculation is performed for the number of light vectors, and the result is output to the light blending means 36. In the example shown in Fig. 5, since the number of light vectors Ln is 4, the luminance calculation and the resulting output are also equivalent to 4 light sources. In this example, the number of light vectors is four.

[0038] Vertex data interpolation means 23 (Fig. 4) Normal vector (43) N to which force is also input is input to texture means 25 (Fig. 4) force tangent vector T (44) or bump vector B (45). If it is valid, the normal rotation vector N (43) is rotated by the bump rotation tangent rotation noise vector generation means 32, and the result N ′ is output to the inner product calculation means 34. Also, The output rotation tangent rotation half vector generation means 32 generates a half vector H which is a bisection vector of the sum of the plurality of light vectors Ln41 and the line-of-sight vector V42 and outputs the same to the inner product calculation means 34. The inner product calculation means 34 performs calculation (mainly inner product calculation) for luminance calculation from various input vectors. For example, the results of four types of inner product calculations (NV, VH, NH, and NL) are output to light shading units 35a to 35d for each light source, for example, with a blend coefficient of 46. The blend coefficient 46 is also transmitted to the layer coefficient blending means 3. In the light shading means 35a to 35d, the bidirectional reflectance distribution function (bidirectional

 reflectance distribution fonction) and outputs the result to the light blending means 36a to 36d for each light source.

[0039] The light attenuation means 33 obtains the attenuation coefficient (48a to 48h) of each light vector using the light vector Ln and the information input via the system IZF31, and the light blending means 36a to 36d for each light source. Output to. In addition, the attenuation coefficient for each layer may be output to the color blending means.

 [0040] The blending means 36a to 36d for each light source attenuate the input of the shading means 35a to 35d according to the attenuation coefficient input from the light attenuation means 33, respectively, and obtain the shading result (47a to 47h). Output to the layer color generation means. In the figure, 47a and 47b indicate the diffuse component and specular component of light source 0, respectively, and 47c and 47d indicate the diffuse component and specular component of light source 1, respectively. 47e and 47f indicate the diffuse component and specular component of light source 2, respectively, and 47g and 47h indicate the diffuse component and specular component of light source 0, respectively. The blend coefficients 46 such as inner product values NV, VH, NH, and NL output from the inner product calculation means 34 are output as blend coefficients 46 of a plurality of layers. As shown in the figure, the luminance calculation results that also output the light blending means 36a to 36d may be output separately for the diffuse reflection (diffuse) component and the specular reflection (specular) component, A combination of these may be output. Also, the diffuse and specular of a single light source may be represented by 8 bits each for RGB.

[0041] [Layer color generation means, layer coefficient blending means] FIG. 6 is a block diagram for explaining the layer color generation means 2 and the layer coefficient blending means 3. In this embodiment, the layer color generation means 2 includes a light selection setting means 51 for outputting an assignment command for assigning the input shading result to each surface layer using the surface layer setting values, and the light selection setting means. And a layer color selection means 52 for selecting the input shading result for each surface layer according to the allocation command. In this embodiment, the layer color generation means 2 assigns the luminance calculation results (47a to 47h) for a plurality of light sources inputted from the shading means 24 to a plurality of surface layers approximating the internal scattering of the object surface, The surface color (61a to 61f) for each layer is output. On the other hand, layer coefficient blending means 3 performs color blending of the surface color (62a to 62f) for each surface layer (layer 1) after blending, for example, by multiplying the blending coefficient by the blending coefficient assigned to each layer. Output to means 4 (Fig. 4).

 [0042] Then, the shading results (47a to 47h), which are the brightness calculation results of the diffuser and the specular of the four light sources to which the 24 powers of the shading means are input, are obtained by the layer color generation means 2, for example, on the surface of the object. Assigned to each surface layer that approximates internal scattering.

 [0043] The surface layer setting values are stored in, for example, a program in the main memory, a predetermined memory, a table, or the like, and the CPU or the like receives information on the program in the main memory and reads information on the surface setting values as appropriate. This can be communicated to the light selection setting means 51 via the nose 16 or system I / F53. The light selection setting means 51 outputs an allocation command to each surface layer to the layer first power selection means 52 using the surface layer setting value. For example, the shading results 47a, 47b, and 47h need only be assigned to the first layer. In this way, the surface color (61a to 61f) for each surface layer (layer) is output. In the figure, 61a and 61b indicate the diffuse component and the specular component of layer 0, respectively. 61c and 61d indicate the diffuse component and the specular component of layer 1, respectively. 61f shows the diffuse component and specular component of layer 2, respectively.

In the present embodiment, since the number of surface layers is 3, there are three types of light selection setting means 52 (LselO, Lsell, Lsel2). That is, the number of light selection setting means 52 may be the same as the number of surface layers, or one. Also, it may be more than the number of surface layers. The number of surface layers is 2 or more. If it is above, it is not limited to 3 etc. Each light selection / setting means 52 in this embodiment is composed of, for example, 4 bits each, and means that there is a light source in which each bit is assigned to each surface layer. The light source assigned to each surface layer may be performed for each RGB component as follows, for example. The following is for layer 0 only, but the same formula can be used for layer 1 and layer 2.

 That is, the diffuse component 61a of layer 0 is any one of the diffuse components (47a, 47c, 47e, and 47f) of light source 0 to light source 4, or the sum of two or more of them. The zero specular component 61b may be one of the specular components of light source 0 to light source 4 (47b, 47d, 47f, and 47g), or the sum of two or more of them. Which component should be used can be assigned by an assignment command based on the surface layer setting value. The same applies to the other layers. In other words, the light components for each light source are converted into light components for each layer.

 FIG. 7 is a block diagram showing an example of layer color generation means (or part thereof). What is shown in FIG. 7 is a block diagram showing the part of the layer color generating means for layer 0 or the layer power selection means in FIG. As shown in FIG. 7, this layer single error generation means comprises a selector 71 such as an AND gate and an adder 72 such as an adder circuit, and is connected to each write selection setting means 51 by a system bus or the like. In addition, each light blend means may be connected by a system bus or the like. The selector may be mounted so that only the data set in advance is selected and passed, and specific data is passed according to the selection command from each light selection setting means 51. It may be implemented so that In addition, each selector (eight selectors in the figure) may receive different scheding results 47a to 47h, or a certain shading result may be input to two or more selectors. Shading results may be input to all selectors.

[0047] Then, for example, each selector determines whether or not to output an input signal in accordance with a command from each light selection setting means 51, and each output signal is added by an adder circuit or the like. Output as surface color 61a, 61b. For example, in the selector 71a to which the shading result 47a and the command from the light selection setting means 53 are input, if the command is ON (1). For example, if the selector force is also output as a shading result 47a and the command is OFF (0), the selector force will not be output as a shading result 47a! The same applies to other selectors. Then, for example, predetermined ones from the diffuses of each layer are output to the adder 72a, added by the adder 72a, and output as, for example, the diffuse component 61a of layer 0 (one component of the surface layer color of the surface layer 0) .

 [0048] The color components synthesized on each surface layer by the layer color selecting means 52 are then input to the layer coefficient blending means 3, and each surface layer is selected according to the blend coefficient 46 output from the inner product calculating means 34, for example. It is only necessary to perform coefficient calculation for combination. The operation of the layer coefficient blending means 3 will be described in detail below with reference to FIG. Fig. 8 is a block diagram showing a configuration example of the layer coefficient blending means. As shown in Fig. 8, the layer coefficient blending means is implemented by, for example, a RAM table and an integration circuit.

 [0049] It should be noted that as the blend coefficient in the layer coefficient blending means, the inner product value NV of the normal vector N and the line-of-sight vector V; the inner product value NH of the bisector of the normal vector N, the line-of-sight vector V and the light vector L NH ; Linear product value VH of bisection vector of line-of-sight vector V, line-of-sight vector V, and light vector L; or inner product value NL of normal vector N and light vector. The blending coefficient may be one type, but it is preferable that multiple types are prepared and blended appropriately.

[0050] In the layer coefficient blending means, for example, the color of each surface layer is multiplied by a coefficient such as a blend coefficient as follows.

[0051] For layer 0, the diffuse output (62a) is the product of α0 and the diffuse input of layer 0 (61a), and the specular output (62b) is α θ, layer 0 spe This is the product of the kyura input (61b).

 [0052] For layer 1, the diffuse output (62c) is the product of (1 – α θ), α ΐ and the layer 1 diffuse input (61c), and the specular output (62d) is ( 1—α θ), α ΐ and the layer 1 specular input (61d).

[0053] For layer 2, the diffuse output (62e) is the product of (1 — α θ) and (1 — α 1) and the diffuse input of layer 2 (61e). 62f) is the product of (1 α θ) and (1 α ΐ) and the layer 2 specular input (61f). [0054] Here, α θ and al are expressed as functions with the blend coefficients BO, Bl (46a, 46b) as arguments. α θ

 = ID (BO), α θΐ = fl (Bl), etc. In this embodiment, B0 and B1 are inner products such as VH (VH0 -VH3 for each light source), NV, NL (NL0-NL3 for each light source), NH (NH0-NH3 for each light source), etc. Blend coefficient) may be used. When VH is used as the blend coefficient, blending of each layer is executed in relation to the light source and line of sight, and in the case of NV, blending of each layer is executed in relation to the normal and line of sight of the object.

 In the example of FIG. 8, the functions of 上 記 (ΒΟ) and ID (Bl) are implemented as a RAM table. The RAM tables 81 and 82 are preferably provided for each RGB, for example. That is, the layer coefficient blending means according to this aspect is provided for each of the blend coefficients, and is provided for each RGB to which a predetermined blend coefficient is input, and RAM tables 81 and 82; 61f) and a multiplier 83 such as a multiplication circuit for multiplying the coefficient according to the blend coefficient. Then, a coefficient (α, 1−α, etc.) corresponding to the blend coefficient is read from the RAM table, and the multiplier multiplies the output of the layer force error generation means and the coefficient corresponding to the blend coefficient. To do. Each element is connected by a bus or the like so that signals can be exchanged.

 [0056] Blend coefficients B0 (46a) and Bl (46b) are connected to the address lines of independent RAM tables 81 and 82, respectively, and blend coefficients B0 (46a) and Bl (46b) according to the values set in the RAM in advance. Outputs the values α and 1− α corresponding to. In the preferred embodiment of the present invention, the inversion value of α is output as 1−α as an approximation of 1−a, but is not limited to this. Further, it is preferable to use any blending coefficient as a or 1−α, and this blending coefficient includes the inner product calculated by the inner product calculating means. Next, the multiplier 83 multiplies the shading result (surface color) of each layer, such as diffuse and specular, input from the layer color selection means 52, and the blend coefficient is multiplied by each layer. Reflect in Diffuses and Speckyula. In this way, the surface color (62a to 62f) for each blended surface layer can be obtained.

[0057] After the diffusion coefficient and the specular of each surface layer are multiplied by the blend coefficient, the surface layer color (62a to 62f) of each blended surface layer is converted into the final 1 pixel by the color blending means 4. It is synthesized as RGB representing the cell color. The operation of the color coefficient blending means 4 will be described in detail below with reference to FIGS. 9 and 10.

 [0058] [Color blending means]

 FIG. 9 is a block diagram showing an example of color blending means. Fig. 10 is a block diagram showing the circuit configuration of the layer 0 blend inside the force Lablender. As shown in FIG. 9, as the color blending means, there is a color blending means including blending means 86a to 86c for each layer connected to the means via the system interface 85, and an adding circuit 87. As a blend portion of each layer, there is one that includes a multiplier 88 and a calorie calculator 89 as shown in FIG.

 [0059] In the blending means 86a to 86c, the attenuation adjustment values such as diffuse, specularity and attenuation rate for each layer (this is obtained by the light attenuation means 33, for example, the system bus 16, the system I / F85). After being multiplied by the blending means 86a to 86c), the diffuse and specular values are added, and finally the color values of all the surface layers are added by the adder 87. The texture means 25 (FIG. 4) may be synthesized using the texture color input to the blending means 86a to 86c via the bus 16 or the like. Usually, the texture color only affects the diffuse and not the specular. This is why the color of each layer was separated into diffuse and specular until the data input stage to color blending means4. In other words, in a preferred embodiment of the present invention, a texture color is input to the force Lablend means 4, and no texture color is input to the layer color generation means 2 and the layer coefficient blending means 3. If the texture color is synthesized immediately after the shading means 24, it is not necessary to separate the diffuser and the specular as in this embodiment.

 [0060] [Another Embodiment]

Next, an image forming apparatus according to another embodiment of the present invention will be described. Figure 11 is a block diagram of the image generation device when the shading results and blending coefficients for each light source output from the shading means are processed as serial data and the surface power is several. In this embodiment, layer color selection means, α / 1-α generation means for generating a and 1 a, and a / 1 to a generation means are generated. An intermediate register t updating means for updating a predetermined value t based on the generated l-string _n , a t value storing means such as a buffer for storing the t value, an output of the layer color generating means, and a / 1-a Multiplying means such as a multiplication circuit for multiplying the α generated by the generating means by the t value stored by the t value storing means, the output value Mn of the multiplying means force, and the initial value clear An addition means such as an adder circuit for addition, a Csum value storage means such as a buffer for storing the value added by the addition means, an initial value init input to the intermediate register t update means, and an initial value init Control means for obtaining an initial value clear to be input to the intermediate register t updating means, to be input to the adding means, and to input the initial value clear to the adding means. The layer color selection means functions as the layer color generation means, the α Z1—α generation means, the intermediate register t update means, and the multiplication means function as the layer coefficient blending means, and the multiplication means and the addition means function as the color blending means. To do.

 In the case of the image forming apparatus according to this embodiment, the final RGB data generation rate per unit time decreases, but the same processing can be performed with a small number of computing resources. The combination of blend coefficients to the surface color is composed of only three multipliers for each RGB. In addition, the means for combining surface colors into a single color consists of adding the input value for each RGB and its own value. In this example, the diffuse and specular are grouped for each RGB at the output stage of the shading means, and one set of RGB data is input to the layer-one blending means for each light source. And

 [0062] The input signal LC in Fig. 11 is RGB data input of the shading result for each light source in which the shading means power is also input serially. On the other hand, BF is coefficient information (NV, etc.) for composing each layer. LC and BF are valid when VALIDJN signal power is used, and the final RGB color output Csum is valid when VALID_OUT is valid.

FIG. 12 is a diagram showing the flow of a certain pixel blend process. In this example, when the VALIDJN force is 1, the data LC0-LC3 for four light sources and the blend coefficient BFO-BF2 of each layer are input to the layer color selection means. The layer color selection means converts the data for the four light sources into data for each layer according to the preset surface layer setting values and outputs the data to the multiplication means. BF0-BF2 is input to the a / l ~ a generator, and outputs α and l-α in the same manner as the RAM table (81, 82) in Fig. 8. At this time, from the control means α _n and 1- α for which layer depending on Ln input to a l- a _n generation means. Whether to output the value of is determined. Next, the layer data output from the layer color selection means and the α output from the oc / 1-α generation means are input to the multiplication means, and l-α is input to the intermediate register t update means. The intermediate register t update means is initialized to 1 by the init signal input to the control means, and then the t value storage means stores the value that is input and 1-α that is input, and the result is a new result. The t value is stored in the t value storage means. The multiplication unit multiplies Layer data by α and t and outputs it as Mn. The adding means initializes the Cs wake-up memory means to 0 by the clear signal, adds the sequentially inputted Mn to the value stored in the Cs wake-up memory means, and stores the result as a new value in the Cs wake-up memory means . Then, the adding means outputs the value Cs alert stored in the Cs alert memory as the final RGB color.

 [0064] Next, an example of operation in units of cycles when one pixel is processed will be described. The initial state is t = 1, Csum = 0. The calculated value of the multiplication means, the t value stored in the t storage means, and the final RGB color Csum value stored in the Csum storage means are as follows for each cycle. In cycle 4, VALID_OUT

 1 is output as

 [0065] Multiplication means

 t Storage means Final RGB color

 CycleO: MO = LO X t X at

 = t * (l- a) Csum

 o

 = 0

 Cyclel: Ml = Ll X t X a

 1

 t = t * (l- a)

 1

 Csum = Csum

 + MO

 Cycle2: M2 = L2 X t X a

 = t * (l-) Csum

 2

 = Csum + Ml

Cycle3: M3 = L3 X t = 1 [initialized by init] Csum = Csum + M2

 Cycle4:

 Csum = Csum + M3

 (In Cycle4, VALID—OUT = 1)

[0066] As a result, VALID.OUT =

 The following data is output as the final RGB color Csum when 1. That is, the final RG B color Csum = L X a + L Χ (1—α) Χ a + L Χ (1—α) Χ (1—α) Χ a + L Χ (1—α) Χ (

 0 0 1 0 1 2 0 1 2 3 0

1- α) Χ (1- α). Here, Ln is data indicating each layer, and a, a, a

1 2 1 2 3 is a value generated by the α / 1-α generating means.

 [0067] [Program]

 The image generation apparatus of the present invention is basically implemented by hardware, but may be implemented by software. As such software, a computer receives a shading result of a single light source or a plurality of light sources for a specific pixel and a surface layer setting value indicating which surface layer the shading result belongs to, and obtains surface color for at least two layers. Receiving a layer color generating means for generating, a surface color for at least two layers generated by the layer color generating means, and a blend coefficient for synthesizing the surface color; and blending each of the surface color The layer coefficient blending means for combining the coefficients and generating the surface color after blending for at least two layers, and the surface color after blending for at least two layers output from the layer coefficient blending means into a single color Computer graphics to function as a color blending means for composition Of the program, and the like. Since each means obtained by this program has the same function as described above, the above description will be applied mutatis mutandis.

 [0068] [Recording medium]

The present invention can also provide a recording medium storing the above-mentioned program and readable by a computer. Such recording media include CD-ROMs, DVDs, hard disks, or memory in computers. When predetermined information is input to the input unit of the computer, the program is read in response to a command from the control unit, and the arithmetic unit that receives the command from the control unit is input using the read program. Data, Data stored in the storage unit is read, for example, the memory of the storage unit is used as a work area, and predetermined calculations are performed. For example, the calculation results are temporarily stored in the memory and then output from the output section. These data may be transmitted through a bus, for example. In this way, hardware resources and programs work together.

 [0069] [Computer configuration]

 FIG. 13 is a block diagram showing an embodiment (computer) of the present invention. This embodiment relates to a computer based on computer graphics (such as a graphic computer). As shown in Fig. 13, the computer 101 includes a central processing unit (CPU) 102, a geometry calculation unit such as a geometry calculation circuit 103, a rendering unit such as a renderer 104, a texture generation unit such as a texture generation circuit 105, and an illumination. An illumination processing unit such as a processing circuit 107, a display information creation unit such as a display circuit 108, a frame buffer 109, and a monitor 110 are provided. These elements are connected by means of a nose and can transmit data to each other. In addition, it may have a main memory (not shown), various tables, a work memory 111 serving as a work area, a texture memory 112 for storing textures, and the like. The hardware that constitutes each unit is connected through, for example, a bus. The storage unit may be composed of RAM such as VRAM, CR-ROM, DVD, hard disk, etc.

 The central processing unit (CPU) 102 is a device for controlling a program for generating an image. The work memory 111 may store data used by the CPU 102, a display list, and the like. The CPU 102 may read a program stored in the main memory and perform predetermined processing. However, the predetermined processing may be performed only by hardware processing. For example, the CPU 102 reads polygon data as world coordinate three-dimensional object data from the work memory 111 and outputs the polygon data to the geometry calculation circuit 103. Specific examples include a main processor, a coprocessor, a data processor, four arithmetic circuits, or a general-purpose arithmetic circuit. These are connected by a bus, etc., so that signals can be exchanged. In addition, a data decompression processor for decompressing compressed information may be provided.

[0071] The geometry calculation circuit 103 performs a view with the viewpoint as the origin on the input polygon data. This is a circuit for performing coordinate conversion on the data of the point coordinate system. The geometry calculation circuit 103 outputs the processed polygon data to the renderer 104. Specific geometry operation circuits include a geometry processor, coprocessor, data processor, four arithmetic operation circuit, or general-purpose operation circuit connected to the main processor via a bus.

The renderer 104 is a circuit or device for converting polygon unit data into pixel unit data. The renderer 104 outputs the pixel unit data to the texture generation circuit 105. Specific examples of the renderer 104 include a data processor, four arithmetic circuits, or a general-purpose arithmetic circuit connected to the main processor via a bus.

 The texture generation circuit 105 is a circuit for generating a texture color in units of pixels based on the texture data stored in the texture memory 112. The texture generation circuit 105 outputs pixel unit data having texture color information to the illumination processing circuit 107. Specific examples of the texture generation circuit 105 include a data processing processor, four arithmetic operation circuits, or a general-purpose operation circuit connected to the main processor through a bus.

 The illumination processing circuit 107 is a circuit for performing shading on the polygon having the texture color information using a normal vector, a barycentric coordinate, and the like in units of pixels. The illumination processing circuit 107 outputs the shaded image data to the display circuit 108. Specific examples of the illumination processing circuit 107 include a data processing processor, four arithmetic operation circuits, and a general-purpose operation circuit connected to the main processor through a bus. Then, the information on the light, such as a table stored in the memory, can be read and shaded as appropriate.

 [0075] The display circuit 108 writes the image data input from the illumination processing circuit 107 into the frame buffer 109, reads out the image data written into the frame buffer 109, and controls it to obtain display image information. Circuit. The display circuit 108 outputs display image information to the monitor 110. Specific display circuits include a drawing processor, a data processor, four arithmetic operation circuits, or a general-purpose operation circuit connected to the main processor via a bus.

[0076] The monitor 110 performs computer graphics according to the input display image information. An apparatus for displaying an image.

 Since the computer according to the present invention includes the image generation device according to the present invention in the illumination processing unit such as an illumination processing circuit, it can effectively generate a shading image or the like.

 [0078] [Computer operation]

 Hereinafter, an operation example of generating an image using a computer will be described. The CPU 102 reads the polygon data from the work memory 111 and outputs the polygon data to the geometry calculation circuit 103. The geometry calculation circuit 103 performs processing such as coordinate conversion of the input polygon data to data in a viewpoint coordinate system with the viewpoint as the origin. The geometry calculation circuit 103 outputs the processed polygon data to the renderer 104. The renderer 104 converts polygon data into pixel data. The renderer 104 outputs the pixel unit data to the texture generation circuit 105. The texture generation circuit 105 generates a texture color for each pixel based on the texture data stored in the texture memory 112. The texture generation circuit 105 outputs pixel unit data having texture color information to the illumination processing circuit 107. Illumination processing circuit 107 shades polygons having texture color information using normal vectors, barycentric coordinates, etc. in pixel units. The illumination processing circuit 107 outputs the shaded image data to the display circuit 108. The display circuit 108 writes the image data input from the illumination processing circuit 107 into the frame buffer 109 and reads out the image data written into the frame buffer 109 to obtain display image information. The display circuit 108 outputs display image information to the monitor 110. The monitor 110 displays a computer graph status image according to the input display image information.

 [0079] Since the computer of the present invention includes the image generation device of the present invention in an illumination processing unit such as an illumination processing circuit, brightness calculation and the like can be performed without considering incident light to pixels other than a specific pixel. Since this can be done effectively, it is possible to calculate shadows at high speed.

 [0080] [Game console configuration]

FIG. 14 is a block diagram of an embodiment (game machine) according to the present invention. The embodiment shown in this block diagram is particularly suitably used as a portable, home or business game machine. Can be done. Therefore, in the following, it will be described as a game machine. Note that the game machine shown in FIG. 5 may include at least the processing unit 200 (or may include the processing unit 200 and the storage unit 270, or the processing unit 200, the storage unit 270, and the information storage medium 280). Other blocks (for example, the operation unit 260, the display unit 290, the sound output unit 292, the portable information storage device 294, and the communication unit 296) can be optional components.

 The processing unit 200 performs various processing such as control of the entire system, instruction instruction to each block in the system, game processing, image processing, and sound processing. The functions of the processing unit 200 can be realized by hardware such as various processors (CPU, DSP, etc.) or ASIC (gate array, etc.) and a given program (game program).

 [0082] The operation unit 260 is used by the player to input operation data. The function of the operation unit 260 can be realized by, for example, a controller equipped with a lever, a button, an outer frame, and nodeware. In particular, in the case of a portable game machine, the operation unit 260 may be formed integrally with the game machine body. Processing information from the controller is transmitted to the main processor via a serial interface (I / F) or bus.

 The storage unit 270 is a work area such as the processing unit 200 or the communication unit 296. It may also store programs and various tables. The storage unit 270 may include, for example, a main memory 272, a frame buffer 274, and a texture storage unit 276, and may also store various tables. The functions of the storage unit 270 can be realized by hardware such as ROM and RAM.

 Examples of RAM include VRAM, DRAM, and SRAM, which can be selected appropriately according to the application. The VRAM that constitutes the frame buffer 274 is used as a work area for various processors.

Information storage medium (storage medium usable by computer) 280 stores information such as programs and data. The information storage medium 280 can be sold as a so-called game cassette. The functions of the information storage medium 280 can be realized by hardware such as an optical disk (CD, DVD), a magneto-optical disk (MO), a magnetic disk, a hard disk, a magnetic tape, or a memory (ROM). The processing unit 200 performs various processes based on the information stored in the information storage medium 280. The information storage medium 280 includes the present invention (actual The information (program or program and data) for executing the means of the embodiment (particularly the blocks included in the processing unit 200) is stored. Note that the information storage medium 280 is not necessarily required when information such as program data is stored in the storage unit. Part or all of the information stored in the information storage medium 280 is transferred to the storage unit 270, for example, when the system is powered on. In addition, as information stored in the information storage medium 280, a program code for performing predetermined processing, image data, sound data, shape data of display objects, table data, list data, and processing of the present invention are instructed. Information that includes at least two, such as information for processing and information for processing according to the instructions.

[0085] The display unit 290 outputs an image generated by the present embodiment, and its functions are CRT (CRT), LCD (Liquid Crystal), OEL (Organic Electroluminescent Device), PDP (Plasma Display). Panel) or HMD (head-mounted display).

 [0086] The sound output unit 292 outputs sound. The functions of the sound output unit 292 can be realized by hardware such as speakers. Sound output is processed by a sound processor connected to the main processor via a bus, for example, and output from a sound output unit such as a speaker.

 The portable information storage device 294 stores player personal data, save data, and the like. Examples of the portable information storage device 294 include a memory card and a portable game device. The functions of the portable information storage device 294 can be achieved by known storage means such as a memory card, a flash memory, a hard disk, and a USB memory.

 The communication unit 296 is an arbitrary unit that performs various controls for communicating with the outside (for example, a host device or another image generation system). The functions of the communication unit 296 can be realized by hardware such as various processors or communication ASICs, and programs.

 The program or data for executing the game machine may be distributed to the information storage medium 280 via the information storage medium power network and communication unit 296 of the host device (server).

[0090] The processing unit 200 includes a game processing unit 220, an image processing unit 230, and a sound processing unit 250. Specifically, main processor, coprocessor, geometry processor, drawing Examples include processors, data processors, four arithmetic circuits, and general-purpose arithmetic circuits. These are appropriately connected by a bus or the like so that signals can be exchanged. A data decompression processor may also be provided to decompress the compressed information.

 [0091] Here, the game processing unit 220 receives coins (price) acceptance processing, various mode setting processing, game progress processing, selection screen setting processing, object position and rotation angle (X, Y or Z axis). Rotation angle) processing, object motion processing (motion processing), viewpoint position (virtual camera position) and line-of-sight angle (virtual camera rotation angle) processing, map object and other objects into the object space Various game processes such as placement process, hit check process, process for calculating game results (results, results), process for multiple players to play in a common game space, game over process, etc. This is based on operation data from the unit 260, personal data from the portable information storage device 294, stored data, game programs, and the like.

 The image processing unit 230 performs various types of image processing in accordance with instructions from the game processing unit 220 and the like. The sound processing unit 250 performs various types of sound processing in accordance with instructions from the game processing unit 220.

 [0093] All of the functions of the game processing unit 220, the image processing unit 230, and the sound processing unit 250 may be realized by a hard ware, or all of them may be realized by a program. Or it may be realized by both hardware and program. Examples of the image processing unit 230 include a geometry calculation unit 2 32 (three-dimensional coordinate calculation unit) and a drawing unit 240 (rendering unit).

 [0094] The geometry computation unit 232 performs various geometry computations (three-dimensional coordinate computation) such as coordinate transformation, clipping processing, perspective transformation, or light source computation. Then, the object data (after the perspective transformation) after the geometry processing (object vertex coordinates, vertex texture coordinates, luminance data, etc.) is stored in the main memory 272 of the storage unit 270 and saved, for example.

 The drawing unit 240 draws an object in the frame buffer 274 based on the object data after the geometry calculation (after perspective transformation) and the texture stored in the texture storage unit 276.

Examples of the drawing unit 240 include a texture mapping unit 242 and a shading processing unit 244. Specifically, it can be implemented by a drawing processor. Drawing processor Is connected to the texture storage unit, various tables, frame buffers, VRAM, etc. via a bus, and further to the display.

 The texture mapping unit 242 reads the environment texture from the texture storage unit 276, and maps the read environment texture to the object.

 The shading processing unit 244 performs shading processing on the object. For example, the geometry processing unit 232 performs light source calculation and obtains the luminance (RGB) of each vertex of the object based on the light source information for shading processing, the lighting model, and the normal vector of each vertex of the object. . Based on the luminance of each vertex, the shading processing unit 244 obtains the luminance of each dot on the primitive surface (polygon, curved surface) by, for example, honshading or Gouraud shading.

 [0099] The geometry calculation unit 232 includes a normal vector processing unit 234. The normal vector processing unit 234 performs a process of rotating the normal vector of each vertex of the object (in a broad sense, the normal vector of the surface of the object) by a rotation matrix to the local coordinate system force world coordinate system. May be.

 [0100] In the game machine of the present invention, for example, the shading processing unit 244 includes the image generation device of the present invention.

 [0101] [Basic operation of game console]

 When the system is turned on, some or all of the information stored in the information storage medium 280 is transferred to the storage unit 270, for example. A game processing program is stored in the main memory 272, for example, and various data are stored in the texture storage unit 276, a table (not shown), or the like.

 [0102] The operation information from the operation unit 260 is transmitted to the processing unit 200 via, for example, a serial interface and a bus (not shown), and sound processing and various image processing are performed. The sound information processed by the sound processing unit 250 is transmitted to the sound output unit 292 via the bus and released as sound. In addition, save information stored in the portable information storage device 194 such as a memory card is transmitted to the processing unit 200 via a serial interface or bus (not shown), and predetermined data is read from the storage unit 170.

[0103] The image processing unit 230 performs various image processing in accordance with instructions from the game processing unit 220. I do. Specifically, the geometry calculation unit 232 performs various geometry calculations (three-dimensional coordinate calculation) such as coordinate conversion, clipping processing, perspective conversion, or light source calculation. Then, the object data (after the perspective transformation) after the geometry processing (object vertex coordinates, vertex texture coordinates, luminance data, etc.) is stored in the main memory 272 of the storage unit 270, for example. Next, the rendering unit 240 renders the object in the frame buffer 274 based on the object data after the geometry calculation (after perspective transformation) and the texture stored in the texture storage unit 276.

[0104] The information stored in the frame buffer 274 is transmitted to the display unit 290 via the bus and is drawn. In this way, it functions as a game machine with computer graphics.

 [0105] Since the game machine of the present invention includes, for example, the image generation device of the present invention in the shading processing unit 244, the luminance calculation and the like can be effectively performed without considering incident light to pixels other than the specific pixel. Therefore, it is possible to calculate shadows at high speed.

 [0106] [Configuration of mobile phone]

 FIG. 15 is a block diagram of an embodiment of the present invention (a mobile phone with a computer graphic function). The embodiment shown in this block diagram can be suitably used particularly as a mobile phone with a three-dimensional computer darling function, particularly a mobile phone with a game function and a mobile phone with a navigation function.

 As shown in FIG. 15, this mobile phone includes a control unit 221 and a memory unit that stores programs and image data for the control unit 221 and serves as a work area such as the control unit and the communication unit. 22, wireless communication function unit 223 for wireless communication, imaging unit 224, which is an optional element such as a CCD camera that captures still images and videos and converts them to digital signals, and displays images and characters Display unit 225 such as LCD, operation unit 226 including numeric keys and various function keys, audio input unit 227 such as a microphone for voice calls, and audio output for outputting sounds such as a receiver and speaker Unit 228, a battery 229 for operating the mobile phone terminal, and a power source unit 230 that stabilizes and distributes battery 229 to each functional unit.

[0108] The control unit 201 controls the entire mobile phone system and gives instructions to each block in the system. Various processes such as display, game processing, image processing, and sound processing are performed. The functions of the control unit 221 can be realized by hardware such as various processors (CPU, DSP, etc.) or ASIC (gate array, etc.) and a given program (game program).

More specifically, the control unit includes an image processing unit (not shown), and the image processing unit includes a geometry calculation unit such as a geometry calculation circuit and a drawing unit (renderer). Furthermore, a texture generation circuit, an illumination processing circuit, or a display circuit may be provided. Furthermore, the drawing processing circuit in the computer or game machine described above may be provided as appropriate.

[0110] The mobile phone of the present invention includes the image generating device of the present invention in, for example, a drawing unit (renderer).

 [0111] [Operation example of mobile phone]

 First, the voice communication operation will be described. For example, the voice input to the voice input unit 227 is converted into digital information by the interface, subjected to predetermined processing by the control unit 221, and output as a radio signal from the wireless communication function unit 223. When receiving the other party's sound information, the wireless communication function unit 223 receives the wireless signal, and after being subjected to a predetermined conversion process, is output from the audio output unit 228 under the control of the control unit 221. The

 [0112] Next, the operations and processes for processing an image are basically the same as the operations and processes in the computer and game machine described above. When processing information is input from the operation unit 224 via an interface or bus (not shown), for example, a geometry processor or the like is operated based on a command from the image processing unit in the control unit 221, a work area such as a RAM, and various tapes. Geometry is calculated using the appropriate information. Further, the renderer of the control unit 221 performs rendering processing based on the command of the image processing unit in the control unit 221. Image information that has been appropriately subjected to force ring processing, tacking processing, anti-aliasing processing, etc., is subjected to predetermined drawing processing by a drawing processor, stored in the frame buffer, and displayed as an image on the display unit. In this way, 3D computer graphics are displayed.

[0113] Since the mobile phone of the present invention includes, for example, the image generation device of the present invention in a drawing unit (renderer), brightness calculation and the like can be performed without considering incident light to pixels other than a specific pixel. Since it can be performed effectively, it is possible to calculate shadows and the like at high speed. Since the level of computer graphics, especially 3D computer graphics, in mobile phones is not so high, the shading technique as in the present invention is not required, but by incorporating the image generating apparatus of the present invention, it is not possible to It will be possible to display beautiful images effectively.

[0114] [Configuration of car navigation system]

 FIG. 16 is a block diagram of an embodiment (navigation system) of the present invention. The embodiment represented by this block diagram can be suitably used particularly as car navigation with a three-dimensional computer graphic function. As shown in Fig. 16, this navigation system includes a GPS unit 241, an autonomous positioning unit 242 as an optional element, a map storage unit 243, a control unit 244, a display unit 245, and a map as an optional element. And a matching unit 246.

 [0115] The GPS unit 241 is a GPS unit that is equipped with a GPS receiver and obtains vehicle positioning data by simultaneously receiving radio waves from multiple GPS satellite forces. The GPS unit 241 obtains the absolute position of the vehicle from the data received by the GPS receiver. This positioning data includes vehicle direction information and elevation angle information in addition to the vehicle position information. .

 [0116] The autonomous positioning unit 242 is an autonomous positioning unit that includes an autonomous sensor and calculates the travel distance and direction of the vehicle from the output data of the autonomous sensor. Autonomous sensors include wheel-side sensors that detect signals according to the number of wheel rotations, acceleration sensors that detect vehicle acceleration, and gyro sensors that detect vehicle angular velocity. In this example, a three-dimensional gyro sensor that can also detect the attitude angle in the pitch motion direction of the vehicle (hereinafter referred to as “pitch angle”) is used as the gyro sensor. Therefore, the autonomous positioning unit 242 force is also output. The positioning data includes the pitch angle of the vehicle.

[0117] The map storage unit 243 is a map storage unit that stores digital map data having 2D map information, 3D road information, and 3D building information. CD-ROMs and hard disks are examples of storage media that make up the map storage unit 243. The map data is preferably divided and stored in multiple blocks because it takes a long time to read when the amount of data is large. The road information may include information indicating major points (nodes) such as intersections and inflection points. The node information includes coordinate data at the points, and road information. The road may be approximated as a straight line (link) connecting the nodes. In this system, 3D road information means that node information power 3D coordinate data is provided.

[0118] Based on the vehicle position information obtained from the GPS unit 241 or the autonomous positioning unit 242, the control unit 244 reads out map data of a predetermined area corresponding to the vehicle position from the map storage unit 243. It is for performing control.

The display unit 245 is for displaying the map data read out by the positioning control unit 244.

 [0120] The map matching unit 246 corrects the position of the vehicle on the road based on the vehicle positioning data and the 3D road information of the map data.

 [0121] The car navigation system according to the present invention includes, for example, a control unit including a geometric operation unit and a drawing unit.

 The (renderer) includes the image generation apparatus of the present invention.

 [0122] [Operation example of car navigation system]

 The GPS unit 241 simultaneously receives radio waves from multiple GPS satellite forces to obtain vehicle positioning data. The autonomous positioning unit 242 calculates the travel distance and direction of the vehicle from the output data of the autonomous sensor. The control unit 244 performs predetermined processing on the data obtained from the GPS unit 241 or the autonomous positioning unit 242 to obtain vehicle position information. Then, based on the vehicle position information, map data of a predetermined area related to the vehicle position is read from the map storage unit 243. In addition, in response to operation information from an operation unit (not shown), the display mode is changed, and map data corresponding to the display mode is read. Further, the control unit 244 performs predetermined drawing processing based on the position information, and displays a 3D building image, 3D map image, 3D car image, and the like. In addition, force ring processing is performed based on the Z value. The display unit 245 displays the map data read by the control unit 244.

[0123] The car navigation system according to the present invention includes, for example, the image generation device according to the present invention in a drawing unit (renderer), so that brightness calculation and the like can be performed without considering incident light to pixels other than a specific pixel. Can be done effectively. As a result, the car navigation system of the present invention can calculate shadows and the like at high speed. Since the level of computer graphics, especially 3D computer graphics, in car navigation systems is not so high, the shading technology as in the present invention is not required, but the image generation device of the present invention is intentionally included. Therefore, the beauty of the shadow and the image can be displayed effectively.

Industrial applicability

 The image generating apparatus of the present invention can generate three-dimensional computer graphics, and can be used in the field of computers. Further, it can be suitably used in the fields of game machines, mobile phones, navigation devices and the like.

Claims

The scope of the claims

 [1] Computer is

 A shading result of a single light source or a plurality of light sources for a specific pixel and a surface layer setting value indicating to which surface layer the seeding result belongs are received, and the shading result is distributed to each surface layer based on the surface layer setting value. Generate the surface color for two layers,

 Combining the surface color for at least two layers and the blending coefficient for synthesizing the surface color to produce at least two surface colors after blending,

 By combining the surface color after blending the at least two layers into a single color, the computer graphics for the specific pixel can be used without considering the incident light to the pixels other than the specific pixel. An image generation method for generating image data.

[2] The image generation method according to [1], wherein the color combined with the single color is a color for obtaining a multilayer reflection shading image for computer graphics.

[3] An image generation device for computer graphics,

 Layer color generation means for receiving a single light source or multiple light source seeding result for a specific pixel and a surface layer setting value indicating which surface layer the seeding result belongs to, and generating at least two surface colors When,

 The surface color for at least two layers generated by the layer color generation means and the blend coefficient for synthesizing the surface layer color are received, the blending coefficient is combined for each of the surface layer colors, and the surface color after blending Layer coefficient blending means for generating at least two layers,

 Color blending means for synthesizing at least two layers of blended surface layer colors output from the layer coefficient blending means into a single color;

 Comprising

 The layer color generation means receives a shading result of a single light source or a plurality of light sources for the specific pixel and a surface layer setting value indicating to which surface layer the shading result belongs, and generates surface colors for at least two layers. ,

The layer coefficient blending means is less generated by the layer color generation means. In both cases, the surface layer color for two layers and the blending coefficient for synthesizing the surface layer color are received, the blending coefficient is combined for each of the surface layer colors, and the surface layer color after blending for at least two layers is generated.

 An image generating device for generating image data for computer graphics by combining the color of the surface color after blending at least two layers output by the color blending means into a single color.

4. The image generating apparatus according to claim 3, wherein a multilayer reflection shading image for computer graphics is obtained.

[5] The layer color generation means includes:

 A light selection setting means for outputting an assignment command for assigning the input shading result to each surface layer using the surface layer setting value;

 Layer color selection means for selecting, for each surface layer, a shading result input according to the light selection setting means power allocation command,

 Receives a single light source or multiple light source shading result for a specific pixel, and a surface layer setting value indicating which surface layer the seeding result belongs to,

 The light selection setting means outputs an assignment command to each surface layer by using the surface layer setting value and the input shading result,

 The layer color selection means generates a surface color for at least two layers by selecting a shading result input for each surface layer in accordance with an assignment command from the light selection setting means.

 The image generation apparatus according to claim 3.

 6. The image generating apparatus according to claim 3, wherein the shading result is an operation result obtained by obtaining a diffuse or specular from each light source.

[7] The blend coefficient is the inner product value NV of the normal vector N and the eye vector V; the inner product value NH of the bisection vector of the normal vector N, the eye vector V, and the light vector L; 4. The inner product value VH of the bisection vector of the line vector V and the light vector L; or the inner product value NL of the normal vector N and the light vector L, either one or more of the forces. Image generation device.

[8] The layer coefficient blending means is provided for each of the blend coefficients, a RAM table provided for each RGB to which a predetermined blend coefficient is input,

 A multiplier for multiplying the output of the layer color generation means by a coefficient corresponding to the blend coefficient;

 Read out the coefficient corresponding to the blend coefficient from the RAM table cover,

 The multiplier multiplies the output of the layer color generation means by a coefficient corresponding to the blend coefficient.

 The image generation apparatus according to claim 3.

[9] A computer comprising the image generating device according to [3].

10. A game machine comprising the image generating device according to claim 3.

11. A mobile phone comprising the image generating device according to claim 3.

12. A navigation system comprising the image generating device according to claim 3.

[13]

 Layer color generation means for receiving a single light source or multiple light source seeding result for a specific pixel and a surface layer setting value indicating which surface layer the seeding result belongs to, and generating at least two surface colors When,

 The surface color for at least two layers generated by the layer color generation means and the blending coefficient for synthesizing the surface layer color are received, and the blending coefficient is combined for each of the surface layer colors, and at least for two layers. Layer coefficient blending means for generating the surface color after blending,

 A computer graphics program for functioning as a color blending means for synthesizing a surface color after blending at least two layers outputted from the layer coefficient blending means into a single color.

[14] A recording medium readable by a computer storing the program according to claim 13.