JP2006318390A - Image generation system, program, and information storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To render reflection with enhanced reality while maintaining a material feeling of an original image with a little data quantity in reflection mapping. <P>SOLUTION: A reflection texture includes at least α value information as pixel information. A texture coordinate computing part 116 includes a reflection mapping texture coordinate computing part 117 finding a texture coordinate corresponding to a vertex based on a normal line vector matching the vertex. A mapping processing part 124 includes a reflection mapping processing part 117 mapping the reflection texture to an object based on the reflection mapping texture coordinate. A rendering processing part 120 includes an α multiplication processing part performing multiplication processing Cd×αs between a color value Cd of the original image and the reflection-mapped reflection texture α value αs for each pixel for finding a color value of the each pixel. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image generation system, a program, and an information storage medium.

  Conventionally, an image generation system (game system) that generates an image that can be viewed from a virtual camera (a given viewpoint) in an object space (virtual three-dimensional space) in which an object such as a character is set is known. It is popular as a place to experience so-called virtual reality.

In a game image generated by such an image generation system, reflection mapping is known as one of methods for expressing light reflection. Reflection mapping is a technique that uses a mapping to express how light is reflected and the environment around the object reflected on the surface of the object. Specifically, light is reflected on a virtual sphere set outside the object. An image of the reflection and the environment is stretched, and the color of the intersection of the reflection vector and the reflection vector is mapped onto the object surface.
Japanese Patent Laid-Open No. 13-070633

  In the prior art, when adding an original image and a reflection texture when performing reflection mapping on the original image, α addition synthesis is performed. However, when the original image and the reflection texture are added and synthesized, there is a problem that the ratio of light and darkness of the original image is lost and the image becomes brighter and the texture of the material is lost.

  In order to solve this, there is a method of preparing a reflection texture according to the material of the original image, but in this case, a reflection texture must be prepared for each material, and the amount of data increases.

  The present invention has been made in view of the problems as described above, and an object of the present invention is to provide an image that can reflect reflections realistically while maintaining the material feeling of the original image with a small amount of data in reflection mapping. To provide a generation system, a program, and an information storage medium.

(1) The present invention
An image generation system for generating an image visible from a virtual camera in an object space,
A texture storage unit for storing a reflection texture for expressing reflection on the object;
A texture coordinate calculation unit for reflection mapping for obtaining texture coordinates corresponding to the vertex based on a normal vector corresponding to the vertex of the object;
A reflection mapping processing unit for mapping the reflection texture to the object based on the texture coordinates for reflection mapping;
A drawing processing unit that calculates and draws a color value based on pixel information of the original image and pixel information of the mapped reflection texture for each pixel,
The reflection texture includes at least α value information as pixel information,
The drawing processing unit
Image generation characterized by including an α multiplication processing unit that performs a multiplication process Cd × αs of the color value Cd of the original image and the reflection texture α value αs for each pixel to calculate the color value of each pixel. Related to the system. The present invention also relates to a program that causes a computer to function as each of the above-described units. The present invention also relates to a computer-readable information storage medium that stores (records) a program that causes a computer to function as each unit.

  Here, the texture is information for expressing, for example, color, brightness, surface normal, transparency, and other surface characteristics.

  The reflection texture is a texture for expressing reflection of light on an object and environmental depression.

  The reflection texture may have only an alpha channel or an RGB channel.

  Here, the texture may be composed of pixel information corresponding to each pixel of the image, for example. Here, the pixel information of the image (texture) may be composed of only the α channel, may be composed of only the color value (for example, RBG) channel, or may include both.

  The texture coordinate calculation unit for reflection mapping is based on a normal vector corresponding to the vertex of the object in the camera coordinate system or the screen coordinate system (may be only the main line vector or may be based on the normal vector and the vertex). Thus, texture coordinates (UV coordinate value, ST coordinate value) corresponding to the vertex may be obtained.

  In the prior art, when adding the original image and the reflection texture when performing the reflection mapping on the original image, the α addition synthesis is performed. There was a problem that the unevenness of the material was lost.

  However, according to the present invention, the color value of each pixel is calculated by performing the multiplication process Cd × αs of the color value (for example, RGB value) Cd of the original image and the α value αs of the reflection texture subjected to reflection mapping for each pixel. Thus, it is possible to draw a composite image in which the texture, unevenness, brightness, and pattern characteristics of the original image are not lost.

  For this reason, it is not necessary to prepare a reflection texture according to the original image. Therefore, it is possible to realize a reflection mapping that enables a realistic expression of reflection while maintaining the original image with a small amount of data. .

(2) The present invention
An image generation system for generating an image visible from a virtual camera in an object space,
A background texture for generating an original image of the object, a texture storage unit for storing a reflection texture for expressing reflection on the object,
A texture coordinate calculation unit for obtaining texture coordinates when mapping the background texture and reflection texture to the object;
A mapping processing unit that maps the background texture and the reflection texture to the object based on the obtained texture coordinates;
A drawing processing unit that calculates and draws a color value based on pixel information of the original image and pixel information of the mapped reflection texture for each pixel,
The reflection texture includes at least α value information as pixel information,
The texture coordinate calculation unit
Including a texture coordinate calculation unit for reflection mapping that obtains texture coordinates corresponding to the vertex based on a normal vector corresponding to the vertex of the object;
The mapping processing unit
A reflection mapping processing unit for mapping the reflection texture to the object based on the texture coordinates for reflection mapping;
The drawing processing unit
Image generation characterized by including an α multiplication processing unit that performs a multiplication process Cd × αs of the color value Cd of the original image and the α value αs of the reflection texture that is reflection-mapped for each pixel to calculate the color value of each pixel. Related to the system. The present invention also relates to a program that causes a computer to function as each of the above-described units. The present invention also relates to a computer-readable information storage medium that stores (records) a program that causes a computer to function as each unit.

  Here, the texture is information for expressing, for example, color, brightness, surface normal, transparency, and other surface characteristics.

  The background texture is a texture that is mapped to an object in order to express the texture, texture, pattern, etc. of the object, thereby generating an original image of the object.

  The reflection texture is a texture for expressing reflection of light on an object and environmental depression.

  When mapping the background texture and reflection texture to an object after geometry processing (for example, after perspective transformation), once rendering the original image generated by mapping the background texture to the object after geometry processing (for example, after perspective transformation) After drawing in the buffer, the reflection texture may be mapped to an object after geometry processing (for example, after perspective transformation) and synthesized with the original image drawn in the drawing buffer.

  If multi-texture mapping is possible, multi-texture mapping is applied to the object after geometry processing (for example, after perspective transformation) of the base texture and reflection texture, and the result of combining the original image and reflection texture is drawn. You may do it.

  The reflection texture may have only an alpha channel or an RGB channel.

  Here, the texture may be composed of pixel information corresponding to each pixel of the image, for example. Here, the pixel information of the image (texture) may be composed of only the α channel, may be composed of only the color value (for example, RBG) channel, or may include both.

  The texture mapping includes, for example, reflection mapping (reflection mapping or environment mapping).

  The texture coordinate calculation unit for reflection mapping is based on a normal vector corresponding to the vertex of the object in the camera coordinate system or the screen coordinate system (may be only the main line vector or may be based on the normal vector and the vertex). Thus, texture coordinates (UV coordinate value, ST coordinate value) corresponding to the vertex may be obtained.

  In the prior art, when adding the original image and the reflection texture when performing the reflection mapping on the original image, the α addition synthesis is performed. There was a problem that the unevenness of the material was lost.

  However, according to the present invention, the color value of each pixel is calculated by performing the multiplication process Cd × αs of the color value (for example, RGB value) Cd of the original image and the α value αs of the reflection texture subjected to reflection mapping for each pixel. Thus, it is possible to draw a composite image in which the texture, unevenness, brightness, and pattern characteristics of the original image are not lost.

  For this reason, it is not necessary to separately prepare the reflection texture corresponding to the background texture, so that it is possible to realize the reflection mapping capable of expressing the reflection with reality while maintaining the texture of the background with a small amount of data.

(3) In the image generation system, the program, and the information storage medium according to the present invention,
The texture storage unit
Storing a reflection texture with color value information for each pixel;
The drawing processing unit
It includes an α power addition processing unit for performing a process of adding / subtracting the color value Cs of the corresponding pixel of the reflection texture to the multiplication result Cd × αs of each pixel and calculating the color value of each pixel.

  According to the present invention, when the original image is generally dark and the desired amount of reflected light cannot be obtained only by the result of α multiplication, for example, the color channel of the reflection map created in advance with a dark (light) color is used. By adding to the result of α multiplication, the amount of reflected light can be compensated.

  Hereinafter, this embodiment will be described.

  In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Configuration FIG. 1 shows an example of a functional block diagram of an image generation system (game system) of the present embodiment. Note that the image generation system of this embodiment may have a configuration in which some of the components (each unit) in FIG. 1 are omitted.

  The operation unit 160 is for a player to input operation data, and the function can be realized by a lever, a button, a steering, a microphone, a touch panel display, a housing, or the like.

  The storage unit 170 serves as a work area for the processing unit 100, the communication unit 196, and the like, and its function can be realized by a RAM or the like.

  The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), magneto-optical disk (MO), magnetic disk, hard disk, and magnetic tape. Alternatively, it can be realized by a memory (ROM). The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores (records and stores) a program for causing the computer to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit).

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by a CRT, LCD, touch panel display, HMD (head mounted display), or the like. The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  The portable information storage device 194 stores player personal data, game save data, and the like. Examples of the portable information storage device 194 include a memory card and a portable game device.

  The communication unit 196 performs various controls for communicating with the outside (for example, a host device or other image generation system), and functions thereof are hardware such as various processors or a communication ASIC, It can be realized by a program.

  Note that a program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the host device (server) to the information storage medium 180 (storage unit 170) via the network and communication unit 196. You may do it. Use of the information storage medium of such a host device (server) can also be included in the scope of the present invention.

  The processing unit 100 (processor) performs processing such as game processing, image generation processing, or sound generation processing based on operation data and programs from the operation unit 160. Here, as the game process, a process for starting a game when a game start condition is satisfied, a process for advancing the game, a process for placing an object such as a character or a map, a process for displaying an object, and a game result are calculated. There is a process or a process of ending a game when a game end condition is satisfied. The processing unit 100 performs various processes using the storage unit 170 as a work area. The functions of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.), ASIC (gate array, etc.), and programs.

  The processing unit 100 includes an object space setting unit 110, a movement / motion processing unit 112, a virtual camera control unit 114, a texture coordinate calculation unit 116, an image generation unit 120, and a sound generation unit 130. Some of these may be omitted.

  The object space setting unit 110 is a variety of objects (objects composed of primitive surfaces such as polygons, free-form surfaces or subdivision surfaces) representing display objects such as characters, trees, cars, columns, walls, buildings, and maps (terrain). The process of setting the placement in the object space is performed. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects.

  The movement / motion processing unit 112 performs a movement / motion calculation (movement / motion simulation) of an object (such as a car, an airplane, or a character). In other words, an object (moving object) is moved in the object space or an object is moved based on operation data, a program (movement / motion algorithm), or various data (motion data) input by the player through the operation unit 160. Perform processing (motion, animation). Specifically, a simulation process for sequentially obtaining object movement information (position, rotation angle, speed, or acceleration) and motion information (position or rotation angle of each part object) every frame (1/60 second). I do. Here, the frame is a unit of time for performing object movement / motion processing (simulation processing) and image generation processing.

  The virtual camera control unit 114 performs a process of controlling the virtual camera for generating an image at a given (arbitrary) viewpoint in the object space. That is, a process for controlling the position (X, Y, Z) or the rotation angle (rotation angle about the X, Y, Z axes) of the virtual camera (process for controlling the viewpoint position and the line-of-sight direction) is performed.

  For example, when an object is photographed from behind using a virtual camera, the position or rotation angle (direction of the virtual camera) of the virtual camera is controlled so that the virtual camera follows changes in the position or rotation of the object. In this case, the virtual camera can be controlled based on information such as the position, rotation angle, or speed of the object obtained by the movement / motion processing unit 112. Alternatively, the virtual camera may be rotated at a predetermined rotation angle while being moved along a predetermined movement route. In this case, the virtual camera is controlled based on virtual camera data for specifying the position (movement path) and rotation angle of the virtual camera.

  The texture coordinate calculation unit 116 performs processing for obtaining texture coordinates when mapping the background texture and the reflection texture to the object.

  The texture coordinate calculation unit 116 also includes a reflection mapping texture coordinate calculation unit 117 that obtains texture coordinates corresponding to the vertex based on the normal vector corresponding to the vertex of the object.

  The texture coordinate calculation unit 117 for reflection mapping is, for example, a normal vector of a surface of an object in a given coordinate system (a coordinate system related to a virtual camera) (a normal vector representing the direction of the surface; set to the vertex of the object). (Normal vector) coordinate components (X, Y coordinate components) are obtained. Then, reflection mapping texture coordinates (U, V coordinates) may be obtained based on the obtained coordinate components. For example, the texture coordinate is obtained by obtaining the coordinate component of the normal vector (normal vector) in the camera coordinate system (viewpoint coordinate system). Alternatively, texture coordinates are obtained by perspective-transforming the normal vector to obtain the coordinate component of the normal vector in the screen coordinate system. When obtaining the coordinate component of the normal vector in the screen coordinate system, it is desirable to normalize the length of the normal vector after perspective transformation (normalization to a unit vector).

  The texture coordinate calculation unit 116 obtains texture coordinates (U, V) by normalizing the coordinate components (NX, NY) of the normal vector. Specifically, the normal vector coordinate components (NX, NY) are normalized so that the range of values is (−1.0 to 1.0) to (0.0 to 1.0), for example. The coordinates (U, V) are obtained.

  The image generation unit 120 performs drawing processing based on the results of various processes (game processing) performed by the processing unit 100, thereby generating an image and outputting the image to the display unit 190. In the case of generating a so-called three-dimensional game image, first, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, or perspective transformation is performed, and drawing data ( The position coordinates, texture coordinates, color data, normal vector, α value, etc.) of the vertexes of the primitive surface are created. Then, based on the drawing data (primitive surface data), the perspective transformation (geometry processing) object (one or a plurality of primitive surfaces) is converted into image data in units of pixels such as a drawing buffer 172 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated.

  The image generation unit 120 includes a hidden surface removal unit 122, a texture mapping unit 124, and an α synthesis unit 126. Note that some of these may be omitted.

  The hidden surface removal unit 122 performs hidden surface removal processing by a Z buffer method (depth comparison method) using a Z buffer 174 (depth buffer) in which a Z value (depth information) is stored.

  The mapping unit 124 performs processing to map the texture (texel value) corresponding to the background texture or the reflection texture stored in the texture storage unit 176 to the object. Specifically, the texture (surface property such as α value, color brightness, or normal) is read from the texture storage unit 176 using the texture coordinates set (given) to the vertex of the object (primitive surface). . The texture coordinates used for texture reading can be obtained by the texture coordinate calculation unit 116. The texture mapping unit 124 maps a texture that is a two-dimensional image or pattern onto an object. In this case, processing for associating pixels and texels, bilinear interpolation (texel interpolation), and the like are performed.

  The α synthesis unit 126 performs α synthesis processing (α blending, α addition or α subtraction, α multiplication, α power addition, etc.) based on the α value (A value). For example, when α synthesis is α blending, a synthesis process as shown in the following equation is performed.

RQ = (1−α) × R1 + α × R2 (1)
GQ = (1−α) × G1 + α × G2 (2)
BQ = (1−α) × B1 + α × B2 (3)
Taking the case where the synthesis process is addition α blending as an example, the color synthesis unit 126 performs the α synthesis process according to the following equation.

RQ = R1 + α × R2 (4)
GQ = G1 + α × G2 (5)
BQ = B1 + α × B2 (6)
Taking the case where the composition processing is α multiplication as an example, the color composition unit 126 performs the α composition processing according to the following equation.

RQ = α × R1 (7)
GQ = α × G1 (8)
BQ = α × B1 (9)
Taking the case where the synthesis process is addition of α power as an example, the color synthesis unit 126 performs the α synthesis process according to the following equation.

RQ = α × R1 + R2 (7)
GQ = α × G1 + G2 (8)
BQ = α × B1 + B2 (9)
Here, R1, G1, and B1 are R, G, and B components of the color (luminance) of an image (background image) that has already been drawn in the drawing buffer 172, and R2, G2, and B2 are in the drawing buffer 172. The R, G, and B components of the color of the object (primitive) to be drawn. RQ, GQ, and BQ are R, G, and B components of the color of an image obtained by α blending. The α value is information that can be stored in association with each pixel (texel, dot), for example, plus alpha information other than color information. The α value can be used as mask information, translucency (equivalent to transparency and opacity), bump information, and the like.

  In the present embodiment, the reflection texture includes at least α value information as pixel information, and the image generation unit 120 multiplies the color value Cd of the original image and the α value αs of the reflection texture subjected to reflection mapping for each pixel. Processing Cd × αs is performed to calculate the color value of each pixel.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, or sounds, and outputs the game sounds to the sound output unit 192.

  Note that the image generation system of the present embodiment may be a system dedicated to the single player mode in which only one player can play, or may be a system having a multiplayer mode in which a plurality of players can play. Further, when a plurality of players play, game images and game sounds to be provided to the plurality of players may be generated using one terminal, or connected via a network (transmission line, communication line) or the like. Alternatively, it may be generated by distributed processing using a plurality of terminals (game machine, mobile phone).

2. Next, the method of this embodiment will be described with reference to the drawings.

2.1 α Multiplication Processing in Reflection Mapping Next, an example in which an image of a spherical object with unevenness is expressed will be described. FIG. 2A shows a background texture for generating an original image of an object, and FIG. 2B shows an image (referred to as an original image) obtained by mapping a background texture to a spherical object.

  The ground texture is an image that expresses the texture of the sphere (in this case, the unevenness). Here, among the materials, the “protruding place (the place that reflects light well) is a bright color”, “indented place ( An image with a pattern of “a dark color in a place that does not reflect much light)” is used as the background.

  Next, the characteristics of the present embodiment will be described by taking as an example the case where the reflection texture is mapped to the original image to express the reflection of the light of the spherical object.

  FIGS. 3A to 3C are examples of generating an image in which light is reflected by the α addition process at the time of reflection mapping.

  FIG. 3A shows a reflection texture Cs (for example, texture) relating to a color (for example, the RGB value of each pixel), and FIG. 3B shows a reflection texture As for an α value (for convenience, even if there is no RGB information, the image and Expression).

  These may be prepared as separate textures, or one texture may have both color information and α value information.

  FIG. 3C shows a result (α-added synthesized image 240) in which the reflection texture (Cs, As) is mapped to the original image (220 in FIG. 2B) Cd, synthesized by α addition, and drawn. The α addition process at the time of drawing is given by (Cs-0) As + Cd.

  FIG. 4 is a diagram for explaining the α addition process.

  Pixel P1 (r1, g1, b1) of the original image (Cd) 220, pixel P2 (r2, g2, b2, α2) of the reflection texture (Cs, As) corresponding to (mapped) the pixel P1 of the original image Then, the corresponding pixel P3 (r3, g3, b3) of the α-added synthesized image 240 is as follows.

r3 = r1 + α2 × r2
g3 = g1 + α2 × g2
b3 = b1 + α2 × b2
When the reflection texture is reflection mapped to the original image in this way and α is added and synthesized, the “place where light is not reflected so much” drawn in a dark color as shown in FIG. There was a problem that the feeling of unevenness was lost.

  FIGS. 5A and 5B are examples of generating an image in which light is reflected by α multiplication processing at the time of reflection mapping.

  FIG. 5A shows the reflection texture As regarding the α value. In this example, the color information of each pixel is not necessary. Therefore, it is possible to use a texture having only α value information for each pixel, or use a texture having both color information and α value information for each pixel, and use only α value information. Also good.

  FIG. 5B shows a rendering result (α multiplication composite image 240) obtained by mapping the reflection texture (As) to the original image (220 in FIG. 2B) Cd and synthesizing by α multiplication. Is given by (Cs-0) As + 0.

  FIG. 6 is a diagram for explaining the α multiplication processing.

  When the pixel P1 (r1, g1, b1) of the original image (Cd) 220 and the pixel P2 (r2, g2, b2, α2) of the reflection texture (As) corresponding (mapped) to the pixel P1 of the original image are: The corresponding pixel P4 (r4, g4, b4) of the α multiplication composite image 260 is as follows.

r4 = α2 × r1
g4 = α2 × g1
b4 = α2 × b1
In this way, when the reflection texture is reflected and mapped by α multiplication and addition synthesis on the original image, drawing can be performed so as to maintain the light / dark ratio of Cd (ratio of unevenness) as shown in FIG. 5B. It is possible to prevent the unevenness of the material from being lost.

  FIGS. 7A to 7C are examples of generating an image in which light is reflected by the α power addition process at the time of reflection mapping.

  FIG. 7A shows a reflection texture related to a color (for example, an RGB value of each pixel), and FIG. 7B shows a reflection texture related to an α value. These may be prepared as separate textures, or one texture may have both color information and α value information.

  FIG. 7C is a drawing result (α-power addition combined image 280) obtained by mapping the reflection texture (Cs, As) to the original image (220 in FIG. 2B) Cd and adding α power, and at the time of drawing The α power addition process is given by (Cd − 0) As + Cs.

  FIG. 8 is a diagram for explaining the α power addition process.

  Pixel P1 (r1, g1, b1) of the original image (Cd) 220, pixel P2 (r2, g2, b2, α2) of the reflection texture (Cs, As) corresponding to (mapped) the pixel P1 of the original image Then, the corresponding pixel P5 (r5, g5, b5) of the α power addition composite image 280 is as follows.

r5 = α2 × r1 + r2
g5 = α2 × g1 + g2
b5 = α2 × b1 + b2
When the reflection texture is reflected and mapped to the original image in this way, α power addition synthesis is performed, as shown in FIG. 7C, the original image Cd is totally dark, and the amount of reflected light is obtained only by the result of α multiplication. If this is not the case, it can be compensated by adding the color channel of the reflection map created in advance with a dark (light) color as shown in FIG.

2.2 Texture coordinate calculation for reflection mapping In this embodiment, a normal vector corresponding to the vertex of the object (in the camera coordinate system or the screen coordinate system) may be used. The reflection texture texture coordinate calculation processing for obtaining the texture coordinates (UV coordinate value, ST coordinate value) corresponding to the vertex is performed.

  Then, by performing reflection mapping using the reflection texture coordinates, image expression such as reflection and reflection of light of the object is realized.

  FIG. 9 is a diagram for explaining an example of a texture coordinate calculation process for reflection mapping.

  Here, a description will be given of a case where reflection of light when a light source is in the direction of the virtual camera is expressed by reflection mapping.

  For example, in FIG. 9, a normal vector representing the orientation of each surrounding surface is set for the object OB. This normal vector is set at each vertex (definition point) of the object or set at each surface of the object. Specifically, normal vector data (X, Y, Z coordinate component data) is included in the vertex data of the object.

  In the present embodiment, the coordinate components (NX, NY) of the normal vector N when viewed from the virtual camera VC are obtained. Specifically, the X and Y coordinate components (NX, NY) of the normal vector N in the camera coordinate system (viewpoint coordinate system) and screen coordinate system of the virtual camera VC are obtained. For example, in FIG. 9, the coordinate components (NX1, NY1) in the camera coordinate system or the screen coordinate system of the normal vector N1 pointing in the direction parallel to the viewing direction of the virtual camera VC (parallel in the opposite direction) are obtained. Further, a coordinate component (NX2, NY2) in the camera coordinate system or the screen coordinate system of the normal vector N2 that faces in a direction orthogonal to the line-of-sight direction is obtained.

  Then, based on the coordinate components (NX, NY) of the obtained normal vector N, the texture coordinates (U, V) are obtained. For example, the texture coordinates (U1, V1) are obtained based on the coordinate components (NX1, NY1) of the normal vector N1, and the texture coordinates (U2, V2) are obtained based on the coordinate components (NX2, NY2) of the normal vector N2. Desired. That is, texture coordinates (U1, V1) for addressing the position of the center of the circle of the texture are obtained from the coordinate components (NX1, NY1) of the normal vector N1 parallel to the line-of-sight direction of the virtual camera VC. On the other hand, texture coordinates (U2, V2) for addressing the position of the outer circumference (circle boundary) of the texture are obtained from the coordinate components (NX2, NY2) of the normal vector N2 orthogonal to the viewing direction of the virtual camera VC. . Accordingly, the texel value set at the center of the texture circle is drawn on the pixel of the surface of the normal vector N1, and the texel value set on the outer periphery of the texture circle is drawn on the pixel of the surface of the normal vector N2. Is done.

3. Processing of this embodiment Next, a detailed processing example of this embodiment will be described using the flowcharts of FIGS.

  FIG. 10 is a flowchart for explaining a case in which processing is performed by hardware not equipped with the multi-texture function. If the multi-texture function is not implemented, map to the underlying texture object, draw the original image once in the drawing buffer, then map the reflection texture to the object and α multiply the original image drawn in the drawing buffer. Alternatively, α power addition synthesis is performed.

  First, an object is arranged and set in the object space (step S1). Specifically, the position and rotation angle of the object in the object space are obtained based on operation information and a program input by the operation unit, and the arrangement is set in the object space. Then, the virtual camera is arranged and set in the object space (step S2). Specifically, the position and rotation angle of the virtual camera are obtained based on the position information of the object, virtual camera data, and the like, and are arranged and set in the object space.

  Next, geometry processing such as perspective transformation of the object is performed (step S3). For example, coordinate conversion from the world coordinate system to the camera coordinate system (viewpoint coordinate system) or coordinate conversion from the camera coordinate system to the screen coordinate system is performed for the object.

  Next, the texture coordinates of the ground texture are obtained (step S4).

  Next, based on the obtained texture coordinates, the base texture is mapped to the object after the geometry processing and the original image is drawn (step S5).

  Next, the coordinate component (NX, NY) of the normal vector of the object in the camera coordinate system or the screen coordinate system is obtained (step S6, see FIG. 9).

  Next, the value range of the coordinate component (NX, NY) of the normal vector is normalized from (−0.1 to 1.0) to (0.0 to 1.0) to reflect the reflection texture coordinates (U, V). Is obtained (step S8).

  Based on the obtained reflection texture coordinates, the reflection texture is subjected to reflection mapping to the object (step S8).

  For each pixel, the color value of the original image and the α value of the reflection texture subjected to reflection mapping are combined by α multiplication and rendered (step S9).

  For each pixel, the color value of the original image and the α value and color value of the reflection texture that has been reflection-mapped may be combined by α-power addition synthesis and rendered.

  As a result, an image expressing the reflection of the light of the object can be generated without losing the contrast ratio of the original image as shown in FIG.

FIG. 11 is a flowchart for explaining a case where processing is performed by hardware in which the multi-texture function is implemented.
When the multi-texture function is implemented, both the background texture and the reflection texture can be mapped and synthesized, and the processing result can be drawn.

  Steps S11 to S14 and steps S16 to S17 are the same as steps S1 to S4 and steps S6 to S7 in FIG. In step S19, the background texture and the reflection texture are subjected to multi-texture mapping based on the obtained texture coordinates, and the color value of the background texture mapped for each pixel and the α value of the reflection texture mapped to the reflection are multiplied by α. To draw (step S18).

  The color value of the background texture mapped for each pixel and the α value and color value of the reflection texture mapped by reflection mapping may be drawn by adding α to the power.

  12A to 12E are diagrams for explaining a case where hardware having an α synthesis processing function is used.

Expression 300 in FIG. 12A is an α composition expression that can be calculated by the α composition processing unit.
(X1-x2) The alpha synthesis process is performed by designating parameters x1 to x4 of x3 + x4. Here, various α synthesis processes shown in FIGS. 12B to 12E can be performed according to the designated contents of the parameters x1 to x4.

  FIG. 12B is an example of parameter specification when the α addition synthesis process is performed.

  When Cs (for example, the color value of the reflection texture) is set to x1, 0 is set to x2, αs (for example, the α value of the reflection texture) is set to x3, and Cd (the color value of the background texture) is set to x4, α addition synthesis is performed as indicated by 310. It becomes a formula and can perform alpha addition composition processing.

  FIG. 12C shows an example of parameter specification when the α multiplication and synthesis process is performed.

  If Cd (background texture color value) is set to x1, 0 is set to x2, αs is set to x3 (for example, the α value of the reflection texture), and 0 is set to x4, an α multiplication synthesis formula is obtained as shown at 320. Can be done.

  FIG. 12D shows an example of specifying parameters when performing the α power addition synthesis process.

  When Cd (background texture color value) is set to x1, 0 is set to x2, αs is set to x3 (for example, the α value of reflection texture), and Cs is set to x4 (for example, the color value of reflection texture) is added to the power of α as shown at 330 It becomes a formula of synthesis, and α power addition synthesis processing can be performed.

  FIG. 12E shows an example of parameter specification when the α power addition synthesis process is performed with multi-texture.

  When Cs1 (background texture color value) is set to x1, 0 is set to x2, αs2 (for example, the α value of reflection texture) is set to x3, and Cs2 (for example, the color value of reflection texture) is set to x4, α multiplication synthesis is performed as shown by 340. The α multiplication and synthesis process can be performed.

4). Hardware Configuration FIG. 13 shows an example of a hardware configuration that can realize this embodiment. The main processor 900 operates based on a program stored in a CD 982 (information storage medium), a program downloaded via the communication interface 990, a program stored in the ROM 950, or the like, and includes game processing, image processing, sound processing, and the like. Execute. The coprocessor 902 assists the processing of the main processor 900, and executes matrix operation (vector operation) at high speed. For example, when a matrix calculation process is required for a physical simulation for moving or moving an object, a program operating on the main processor 900 instructs (requests) the process to the coprocessor 902.

  The geometry processor 904 performs geometry processing such as coordinate conversion, perspective conversion, light source calculation, and curved surface generation based on an instruction from a program operating on the main processor 900, and executes matrix calculation at high speed. The data decompression processor 906 performs decoding processing of compressed image data and sound data, and accelerates the decoding processing of the main processor 900. Thereby, a moving image compressed by the MPEG method or the like can be displayed on the opening screen or the game screen.

  The drawing processor 910 executes drawing (rendering) processing of an object composed of primitive surfaces such as polygons and curved surfaces. When drawing an object, the main processor 900 uses the DMA controller 970 to pass the drawing data to the drawing processor 910 and, if necessary, transfers the texture to the texture storage unit 924. Then, the drawing processor 910 draws the object in the frame buffer 922 while performing hidden surface removal using a Z buffer or the like based on the drawing data and texture. The drawing processor 910 also performs α blending (translucent processing), depth cueing, mip mapping, fog processing, bilinear filtering, trilinear filtering, anti-aliasing, shading processing, and the like. When an image for one frame is written in the frame buffer 922, the image is displayed on the display 912.

  The sound processor 930 includes a multi-channel ADPCM sound source and the like, generates game sounds such as BGM, sound effects, and sounds, and outputs them through the speaker 932. Data from the game controller 942 and the memory card 944 is input via the serial interface 940.

  The ROM 950 stores system programs and the like. In the case of an arcade game system, the ROM 950 functions as an information storage medium, and various programs are stored in the ROM 950. A hard disk may be used instead of the ROM 950. The RAM 960 is a work area for various processors. The DMA controller 970 controls DMA transfer between the processor and the memory. The CD drive 980 accesses a CD 982 in which programs, image data, sound data, and the like are stored. The communication interface 990 performs data transfer with the outside via a network (communication line, high-speed serial bus).

  The processing of each unit (each unit) in this embodiment may be realized entirely by hardware, or may be realized by a program stored in an information storage medium or a program distributed via a communication interface. Also good. Alternatively, it may be realized by both hardware and a program.

  When the processing of each part of this embodiment is realized by both hardware and a program, a program for causing the hardware (computer) to function as each part of this embodiment is stored in the information storage medium. More specifically, the program instructs the processors 902, 904, 906, 910, and 930, which are hardware, and passes data if necessary. Each processor 902, 904, 906, 910, 930 realizes the processing of each unit of the present invention based on the instruction and the passed data.

  The present invention is not limited to that described in the above embodiment, and various modifications can be made.

  For example, terms (α values / luminance, gradient patterns, polygons, etc.) cited as broad or synonymous terms (texel values, texel value patterns, primitive surfaces, etc.) in the description or drawings are described in the specification or In other descriptions in the drawings, terms can be replaced with terms having a broad meaning or the same meaning.

  In the invention according to the dependent claims of the present invention, a part of the constituent features of the dependent claims can be omitted. Moreover, the principal part of the invention according to one independent claim of the present invention can be made dependent on another independent claim.

  Also, the texture mapping process is not limited to that described in the present embodiment, and a conversion process equivalent to these is also included in the scope of the present invention. The present invention can be applied to various games. Further, the present invention is applied to various image generation systems such as a business game system, a home game system, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, a system board for generating a game image, and a portable terminal. it can.

The functional block diagram of the image generation system of this embodiment. 2A shows the background texture, and FIG. 2B shows the original image. FIGS. 3A to 3C are examples of generating an image in which light is reflected by the α addition process at the time of reflection mapping. The figure for demonstrating (alpha) addition process. FIGS. 5A and 5B are examples of generating an image in which light is reflected by α multiplication processing at the time of reflection mapping. The figure for demonstrating (alpha) multiplication processing. FIGS. 7A to 7C are examples of generating an image in which light is reflected by the α power addition process at the time of reflection mapping. The figure for demonstrating (alpha) power addition process. The figure for demonstrating an example of the texture coordinate calculation process for reflection mapping. The flowchart figure for demonstrating the case where it processes by the hardware which is not mounting the multi-texture function. The flowchart figure for demonstrating the case where it processes by the hardware which implements the multi-texture function. 12A to 12E are diagrams for explaining a case where hardware having an α synthesis processing function is used. It is a hardware structural example.

Explanation of symbols

100 processing unit, 110 object space setting unit, 112 movement / motion processing unit, 114 virtual camera control unit, 116 texture coordinate calculation unit, 120 image generation unit, 122 hidden surface removal unit, 124 texture mapping unit, 126 α synthesis unit, 130 sound generation unit, 160 operation unit, 170 storage unit, 172 drawing buffer, 174 Z buffer, 176 texture storage unit, 180 information storage medium, 190 display unit, 192 sound output unit, 194 portable information storage device, 196 communication unit

Claims (6)

An image generation system for generating an image visible from a virtual camera in an object space,
A texture storage unit for storing a reflection texture for expressing reflection on the object;
A texture coordinate calculation unit for reflection mapping for obtaining texture coordinates corresponding to the vertex based on a normal vector corresponding to the vertex of the object;
A reflection mapping processing unit for mapping the reflection texture to the object based on the texture coordinates for reflection mapping;
A drawing processing unit that calculates and draws a color value based on pixel information of the original image and pixel information of the mapped reflection texture for each pixel,
The reflection texture includes at least α value information as pixel information,
The drawing processing unit
Image generation characterized by including an α multiplication processing unit that performs a multiplication process Cd × αs of the color value Cd of the original image and the α value αs of the reflection texture that is reflection-mapped for each pixel to calculate the color value of each pixel. system. An image generation system for generating an image visible from a virtual camera in an object space,
A background texture for generating an original image of the object, a texture storage unit for storing a reflection texture for expressing reflection on the object,
A texture coordinate calculation unit for obtaining texture coordinates when mapping the background texture and reflection texture to the object;
A mapping processing unit that maps the background texture and the reflection texture to the object based on the obtained texture coordinates;
A drawing processing unit that calculates and draws a color value based on pixel information of the original image and pixel information of the mapped reflection texture for each pixel,
The reflection texture includes at least α value information as pixel information,
The texture coordinate calculation unit
Including a texture coordinate calculation unit for reflection mapping that obtains texture coordinates corresponding to the vertex based on a normal vector corresponding to the vertex of the object;
The mapping processing unit
A reflection mapping processing unit for mapping the reflection texture to the object based on the texture coordinates for reflection mapping;
The drawing processing unit
Image generation characterized by including an α multiplication processing unit that performs a multiplication process Cd × αs of the color value Cd of the original image and the α value αs of the reflection texture that is reflection-mapped for each pixel to calculate the color value of each pixel. system. In any one of Claims 1 thru | or 2.
The texture storage unit
Storing a reflection texture with color value information for each pixel;
The drawing processing unit
An image generation system comprising: an α power addition processing unit for performing a process of adding / subtracting a color value Cs of a corresponding pixel of the reflection texture to a multiplication processing result Cd × αs of each pixel and calculating a color value of each pixel . A program for generating an image visible from a virtual camera in an object space,
A texture storage unit for storing a reflection texture for expressing reflection on the object;
A texture coordinate calculation unit for reflection mapping for obtaining texture coordinates corresponding to the vertex based on a normal vector corresponding to the vertex of the object;
A reflection mapping processing unit for mapping the reflection texture to the object based on the texture coordinates for reflection mapping;
For each pixel, let the computer function as a drawing processing unit that calculates and draws color values based on the pixel information of the reflection texture mapped with the pixel information of the original image,
The reflection texture includes at least α value information as pixel information,
The drawing processing unit
A program comprising an α multiplication processing unit that performs a multiplication process Cd × αs of a color value Cd of an original image and an α value αs of a reflection texture subjected to reflection mapping for each pixel to calculate a color value of each pixel. A program for generating an image visible from a virtual camera in an object space,
A background texture for generating an original image of the object, a texture storage unit for storing a reflection texture for expressing reflection on the object,
A texture coordinate calculation unit for obtaining texture coordinates when mapping the background texture and reflection texture to the object;
A mapping processing unit that maps the background texture and the reflection texture to the object based on the obtained texture coordinates;
For each pixel, let the computer function as a drawing processing unit that calculates and draws color values based on the pixel information of the reflection texture mapped with the pixel information of the original image,
The reflection texture includes at least α value information as pixel information,
The texture coordinate calculation unit
Including a texture coordinate calculation unit for reflection mapping that obtains texture coordinates corresponding to the vertex based on a normal vector corresponding to the vertex of the object;
The mapping processing unit
A reflection mapping processing unit for mapping the reflection texture to the object based on the texture coordinates for reflection mapping;
The drawing processing unit
A program comprising an α multiplication processing unit that performs a multiplication process Cd × αs of a color value Cd of an original image and an α value αs of a reflection texture subjected to reflection mapping for each pixel to calculate a color value of each pixel.   A computer-readable information storage medium, wherein the program according to claim 4 or 5 is stored.