JP4782583B2 - Program, information storage medium, and image generation system - Google Patents

Description

  The present invention relates to a program, an information storage medium, and an image generation system.

  Conventionally, an image generation system (game system) that generates an image that can be viewed from a virtual camera (a given viewpoint) in an object space (virtual three-dimensional space) in which objects such as characters and cars are arranged and set is known. It is very popular for experiencing so-called virtual reality. Taking an image generation system for enjoying a soccer game as an example, the player enjoys the game by manipulating the characters displayed on the screen and dribbling or shooting.

  In such an image generation system, the demand for realism of the generated image is increasing year by year. Therefore, it is desirable that the lighting and unevenness of the character's skin (surface) can be expressed realistically.

However, in conventional image generation systems, a character image is generated by repeatedly mapping a texture representing the character's skin color. Therefore, the generated character image becomes an artificial image made of polygons, and there is a problem that the virtual reality of the player cannot be improved.
JP 2001-325605 A

  The present invention has been made in view of the problems as described above. An object of the present invention is to provide a program, an information storage medium, and an image generation system that enable generation of a realistic image by lighting processing or bump processing. It is to provide.

  The present invention is an image generation system for generating an image, an object space setting unit for setting an object space in which a character composed of a plurality of three-dimensional part objects moves, a texture storage unit for storing textures, A lighting processing unit that performs lighting processing based on the illumination model and the light source information, and the texture storage unit has a color pattern corresponding to a developed view of a first part object of the plurality of part objects. A reflection having a color map texture in which the surface color of the first part object is set to a texel and a reflection information pattern corresponding to a development view of the first part object, and the reflection information being set in the texel A map texture, and the lighting processing unit Tsu based the reflection information set to texels flop texture and the lighting model to the light source information, related to the image generation system performs lighting processing of the first part object. The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

  According to the present invention, the image of each part of the first part object can be drawn in detail on the color map texture. Therefore, a more realistic image can be generated as compared with the method of repeatedly mapping the same texture. It is also possible to draw the state of the reflection information of each part of the first part object in detail on the reflection map texture. Therefore, it is possible to realize gloss expression in each part of the first part object only by drawing the reflection information with respect to the texel corresponding to the lighting processing area among the parts of the first part object. As a result, it is possible to represent various patterns of images simply by changing the reflection information pattern of the reflection map texture. Also, when a given image pattern is drawn on the color map texture, it is possible to write reflection information corresponding to the image pattern to the texel of the reflection map texture.

  In the image generation system, the program, and the information storage medium according to the present invention, the first part object is an object of the character's arm, face, foot, or weapon, and the lighting processing unit includes the reflection map texture. Based on the reflection information, the illumination model, and the light source information set in the texel, lighting processing of the character arm, face, foot, or weapon object may be performed.

  In this way, a realistic writing process for the character's arm, face, foot, or weapon becomes possible.

  Further, in the image generation system, the program, and the information storage medium according to the present invention, among the texels of the reflection map texture, in the texels corresponding to regions other than the lighting processing region where the lighting processing is performed, the specular calculation of the lighting processing is performed. A first value to be invalidated is set, and the lighting processing unit may invalidate the specular calculation when the reflection information is set to the first value.

  In this way, the reflection information of the reflection map texture can be used as mask information, and the specular calculation can be invalidated in a portion that becomes unnatural when a specular image is generated.

  In the image generation system, the program, and the information storage medium according to the present invention, the texture storage unit stores a reflectance as the reflection information in an α plane of the reflection map texture, and the lighting processing unit includes the α plane. A lighting process in which light is specularly reflected at the reflectance described above may be performed.

  In this way, the reflectance of the specular reflection of light can be controlled using the α plane of the reflection map texture.

  In the image generation system, the program, and the information storage medium according to the present invention, the texture storage unit stores a glossy color as the reflection information in a color plane of the reflection map texture, and the lighting processing unit includes the color plane. It is also possible to perform a lighting process in which light is specularly reflected in the glossy color.

  In this way, the gloss color of the surface of the first part object can be controlled using the color plane of the reflection map texture.

  In the image generation system, the program, and the information storage medium according to the present invention, the texture storage unit has a normal vector pattern corresponding to the development view of the first part object, and the normal vector information is set in the texel. A normal map texture to be stored, and based on the normal map texture, a bump processing unit that performs bump processing to represent the unevenness of the surface of the first part object may be included (as the bump processing unit) As a computer.

  In this way, not only the glossy expression of the surface of the first part object by the lighting process but also the uneven expression of the surface can be realized, and the realism of the image can be improved.

  The image generation system, program, and information storage medium according to the present invention include a vertex shader unit that performs processing in units of vertices and a pixel shader unit that performs processing in units of pixels (the computer as the vertex shader unit and pixel shader unit). And the lighting processing unit included in the pixel shader unit may perform the lighting processing.

  In this way, lighting processing can be realized by the pixel shader unit, and glossy expression with high accuracy in units of pixels becomes possible.

  The image generation system, program, and information storage medium according to the present invention include a vertex shader unit that performs processing in units of vertices and a pixel shader unit that performs processing in units of pixels (the computer as the vertex shader unit and pixel shader unit). The lighting processing unit included in the pixel shader unit may perform the lighting processing, and the bump processing unit included in the pixel shader unit may perform the bump processing.

  In this way, both the lighting process and the bump process can be realized by the pixel shader unit, and a process in units of pixels in which the lighting process and the bump process are linked becomes possible.

  In the image generation system, the program, and the information storage medium according to the present invention, the vertex shader unit converts the first and second normal vectors into a world coordinate system, and the pixel shader unit includes the normal line. The normal vector obtained by the map texture is coordinate-converted into a world coordinate system based on the first and second subnormal vectors, and the bump processing unit is configured to convert the bump based on the normal vector after the coordinate conversion. Processing may be performed.

  Thus, if it calculates by the vector coordinate-transformed to the world coordinate system, a calculation precision can be improved. If the normal vector is coordinate-converted into the world coordinate system using the first and second subnormal vectors, bump processing using the normal vector after the coordinate conversion can be realized.

  In the image generation system, the program, and the information storage medium according to the present invention, the parameter calculation unit that calculates the parameter of the character, the reflection map texture is changed based on the calculated parameter, and the first It may include a change processing unit that changes at least one of the area and shape of the lighting processing area where the lighting processing is performed on the surface of the part object (the computer may function as the parameter calculation unit and the change processing unit). ).

  In this way, the area and shape of the lighting processing region change in real time according to the calculated parameters. Therefore, realistic glossy expression of the surface of the first part object is possible.

  In the image generation system, the program, and the information storage medium according to the present invention, the texture storage unit has a normal vector pattern corresponding to the development view of the first part object, and the normal vector information is set in the texel. A bump processing unit that stores a normal map texture to be processed and performs a bump process for representing the unevenness of the surface of the first part object based on the normal map texture (a computer as the bump processing unit) And the change processing unit may change the normal map texture in conjunction with the change of the reflection map texture when the reflection map texture changes.

  In this way, the uneven state in the lighting processing area changes in conjunction with the change in the lighting processing area, and the realism of the image can be improved.

  In the image generation system, the program, and the information storage medium according to the present invention, when a hit event occurs for the first part object, a hit check unit that detects a hit area and the detected hit area correspond to the hit area. The texel area may include a change processing unit that changes the reflection map texture (the computer may function as the hit check unit and the change processing unit).

  In this way, when a hit event occurs, the gloss in the hit area also changes, and various image representations are possible.

  The present invention also provides an image generation system for generating an image, an object space setting unit for setting an object space in which a character composed of a plurality of three-dimensional part objects moves, and a texture storage unit for storing textures And a bump processing unit that performs a bump process, wherein the texture storage unit has a color pattern corresponding to a developed view of a first part object of the plurality of part objects, and the first part object A color map texture in which the surface color of texel is set to texel and a normal vector pattern corresponding to the development drawing of the first part object, and information on the normal vector is set to texel And the bump processing unit determines whether or not the previous map is based on the normal map texture. Relating to an image generation system for performing bump processing for representing the irregularities in the surface of the first part object. The present invention also relates to a program that causes a computer to function as each of the above-described units or a computer-readable information storage medium that stores the program.

  According to the present invention, since the image of each part of the first part object can be drawn in detail on the color map texture, a more realistic image can be generated. It is also possible to draw the normal vector information of each part of the first part object in detail on the normal map texture. Therefore, by simply drawing normal vector information for the area of the first part object that you want to represent the unevenness, you can realize the unevenness expression in each part of the first part object and generate various images. it can. Further, when a given image pattern is drawn on the color map texture, it is possible to write normal vector information corresponding to the image pattern into the texel of the normal map texture.

  In the image generation system, the program, and the information storage medium according to the present invention, when a hit event occurs for the first part object, a hit check unit that detects a hit area and the detected hit area correspond to the hit area. The texel region may include a change processing unit that changes the normal map texture (the computer may function as the hit check unit and the change processing unit).

  In this way, when a hit event occurs, the uneven state in the hit area also changes, and various image representations are possible.

  The image generation system, program, and information storage medium according to the present invention include a vertex shader unit that performs processing in units of vertices and a pixel shader unit that performs processing in units of pixels (a computer as the vertex shader unit and pixel shader unit). The bump processing unit included in the pixel shader unit may perform the bump processing.

  In this way, bump processing can be realized by the pixel shader unit, and high-precision unevenness can be expressed in units of pixels.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Configuration FIG. 1 shows an example of a functional block diagram of an image generation system (game system) of the present embodiment. Note that the image generation system of the present embodiment may have a configuration in which some of the components (each unit) in FIG. 1 are omitted.

  The operation unit 160 is for a player to input operation data, and the function can be realized by a lever, a button, a touch panel display, or the like. The storage unit 170 serves as a work area for the processing unit 100, the communication unit 196, and the like, and its function can be realized by a RAM (VRAM) or the like.

  An information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and its function can be realized by an optical disk (CD, DVD), hard disk, memory (ROM), or the like. The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by a CRT, LCD, touch panel display, HMD (head mounted display), or the like. The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  The portable information storage device 194 stores player personal data, game save data, and the like. Examples of the portable information storage device 194 include a memory card and a portable game device. The communication unit 196 performs various controls for communicating with the outside (for example, a host device or other image generation system), and functions thereof are hardware such as various processors or communication ASICs, programs, and the like. It can be realized by.

  A program (data) for causing a computer to function as each unit of the present embodiment is distributed from the information storage medium of the host device (server) to the information storage medium 180 (or storage unit 170) via the network and communication unit 196. May be. Use of an information storage medium by such a host device (server) can also be included in the scope of the present invention.

  The processing unit 100 (processor) performs processing such as game processing, image generation processing, or sound generation processing based on operation data and programs from the operation unit 160. Here, as the game process, a process for starting a game when a game start condition is satisfied, a process for advancing the game, a process for placing an object such as a character or a map, a process for displaying an object, and a game result are calculated. There is a process or a process of ending a game when a game end condition is satisfied. The processing unit 100 performs various processes using the storage unit 170 (main storage unit 172) as a work area. The functions of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.), ASIC (gate array, etc.), and programs.

  The processing unit 100 includes an object space setting unit 110, a movement / motion processing unit 112, a virtual camera control unit 114, a parameter calculation unit 116, a change processing unit 118, a hit check unit 119, a drawing unit 120, and a sound generation unit 130. Note that some of these may be omitted.

  The object space setting unit 110 is composed of various objects (polygons, free-form surfaces, subdivision surfaces, etc.) representing display objects such as characters (people, robots, etc.), stadiums, buildings, trees, walls, maps (terrain). The object is placed and set in the object space. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Place the object. Specifically, the model data storage unit 176 of the storage unit 170 stores model data of a moving object (character), a fixed object (building), and a background object (map, celestial sphere). Then, the object space setting unit 110 performs an object setting (arrangement) process in the object space using the model data.

  The movement / motion processing unit 112 performs movement / motion calculation (movement / motion simulation) of an object (such as a character). That is, an object (model object) is moved in the object space or an object is moved based on operation data input by the player through the operation unit 160, a program (movement / motion algorithm), various data (motion data), or the like. Perform processing (motion, animation). Specifically, a simulation process for sequentially obtaining object movement information (position, rotation angle, speed, or acceleration) and motion information (part object position or rotation angle) every frame (1/60 second). Do. A frame is a unit of time for performing object movement / motion processing (simulation processing) and image generation processing.

  The virtual camera control unit 114 performs a virtual camera (viewpoint) control process for generating an image viewed from a given (arbitrary) viewpoint in the object space. Specifically, processing for controlling the position (X, Y, Z) or rotation angle (rotation angle about the X, Y, Z axis) of the virtual camera (processing for controlling the viewpoint position, the line-of-sight direction or the angle of view) I do.

  For example, when an object (eg, character, ball, car) is photographed from behind using a virtual camera, the position or rotation angle of the virtual camera (the direction of the virtual camera is set so that the virtual camera follows changes in the position or rotation of the object. ) To control. In this case, the virtual camera can be controlled based on information such as the position, rotation angle, or speed of the object obtained by the movement / motion processing unit 112. Alternatively, the virtual camera may be controlled to rotate at a predetermined rotation angle or to move along a predetermined movement path. In this case, the virtual camera is controlled based on the virtual camera data for specifying the position (movement path) or rotation angle of the virtual camera.

  The parameter calculation unit 116 calculates various parameters used for game processing. For example, the parameter calculation unit 116 calculates a parameter (status parameter) related to the character. Specifically, the physical strength (stamina) parameter, the exercise amount (movement amount, movement information) parameter, and the elapsed time (exercise time) parameter of the character are calculated. Here, the physical strength parameter is a parameter representing the remaining physical strength of the character, and decreases with the continuation of the movement / motion of the character or with the passage of time. The momentum parameter is a parameter that quantitatively represents the degree of movement of the character, and increases as the character moves and moves. The time lapse parameter is a parameter representing the passage of time related to the character, and increases with the passage of time after the character starts moving / motion (exercise), for example.

  The change processing unit 118 performs a process of changing the reflection map texture based on the parameter calculated by the parameter calculation unit 116. For example, the reflection map texture is replaced (switched) or the reflection information of the reflection map texture is rewritten based on the calculated parameters. By changing the reflection map texture in this way, the area, shape, light reflectance, and gloss color of the lighting processing region are changed. Specifically, the area of the lighting processing area (occupied area on the character surface) is increased as the physical strength parameter calculated by the parameter calculation unit 116 decreases, the momentum parameter increases, or the time lapse parameter increases. Process.

  The change processing unit 118 performs processing for changing the normal map texture based on the parameter calculated by the parameter calculation unit 116. For example, the normal map texture is replaced (switched) or the normal vector information of the normal map texture is rewritten based on the calculated parameters. The change processing unit 118 performs processing for changing the normal map texture in conjunction with the change of the reflection map texture when the reflection map texture is changed. For example, when the area, shape, etc. of the lighting processing region changes due to a change in the reflection map texture, the normal map texture in the lighting processing region is changed in conjunction with the change in the area, shape, etc.

  The hit check unit 119 performs a hit check process for the character. Specifically, hit check processing is performed between a character (model object) and another object (primitive). Here, the other object is another character, a part object of the other character, a play object such as a ball, an attack against the character, or the like. Other objects may be displayed objects or virtual objects that are not displayed. The hit area detection by the hit check process can be realized, for example, by obtaining the intersection of the character plane and the movement trajectory of another object. Note that the character object to be hit-checked with another object may be a model object for display or a model object (simple object) for hit check. Here, the display model object is a model object actually displayed on the screen. The model objects for hit check (hit volume, hit box) are prepared separately from the model object for display for hit check, and the model object (the number of polygons and vertices is simplified) that simplifies the shape of the model object for display. Object).

  In this embodiment, the hit check unit 119 detects a hit area that is a hit position when a hit event (an event in which another object hits the character) occurs for the first part object constituting the character. Then, the change processing unit 118 performs a process of changing the reflection map texture or the normal map texture in the texel area corresponding to the detected hit area. Specifically, the reflection information and normal vector information of the texel corresponding to the hit area among the texels of the reflection map texture and normal map texture are rewritten.

  The drawing unit 120 performs drawing processing based on the results of various processing (game processing) performed by the processing unit 100, thereby generating an image and outputting the image to the display unit 190. When generating a so-called three-dimensional game image, model data including vertex data (vertex position coordinates, texture coordinates, color data, normal vector, α value, etc.) of each vertex of the model (object) is first input. Based on the vertex data included in the input model data, vertex processing (shading by a vertex shader) is performed. When performing the vertex processing, vertex generation processing (tessellation, curved surface division, polygon division) for re-dividing the polygon may be performed as necessary.

  The drawing unit 120 performs geometry processing, hidden surface removal processing, α blending, and the like when drawing an object.

  In the geometry processing, processing such as coordinate conversion, clipping processing, perspective projection conversion, or light source calculation is performed on the object. Then, model data (positional coordinates of object vertices, texture coordinates, color data, normal vectors, α values, etc.) after geometry processing (after perspective projection conversion) is stored in the storage unit 170.

  As the hidden surface removal processing, hidden surface removal processing can be performed by a Z buffer method (depth comparison method, Z test) using a Z buffer (depth buffer) in which Z values (depth information) of drawing pixels are stored. . That is, when drawing pixels corresponding to the primitive of the object are drawn, the Z value stored in the Z buffer is referred to. Then, the Z value of the referenced Z buffer is compared with the Z value at the drawing pixel of the primitive, and the Z value at the drawing pixel is a Z value (for example, a small Z value) on the near side when viewed from the virtual camera. In some cases, the drawing process of the drawing pixel is performed and the Z value of the Z buffer is updated to a new Z value.

  α blending (α synthesis) is a translucent synthesis process (usually α blending, addition α blending, subtraction α blending, or the like) based on an α value (A value).

  The α value is information that can be stored in association with each pixel (texel, dot), for example, plus alpha information other than color information. The α value can be used as mask information, translucency (equivalent to transparency and opacity), bump information, and the like.

  The drawing unit 120 includes a vertex shader unit (vertex processing unit) 122 and a pixel shader unit (pixel processing unit) 124.

  The vertex shader unit 122 performs vertex processing which is processing per vertex (per vertex processing). In this vertex processing, according to a vertex processing program (vertex shader program, first shader program), vertex movement processing, coordinate conversion processing (world coordinate conversion, camera coordinate conversion, vertex coordinate conversion), lighting processing, or data output processing (Register storage processing) is performed. Then, based on the processing result, the vertex data given for the vertex group constituting the object is changed (updated, adjusted). Then, rasterization (scan conversion) is performed based on the vertex data after the vertex processing, and the surface of the polygon (primitive) is associated with the pixel.

  Following this rasterization, the pixel shader unit 124 performs pixel processing, which is per pixel processing. In this pixel processing (shading by pixel shader, fragment processing), texture fetching (texture mapping), lighting processing, color data setting / changing, translucency according to the pixel processing program (pixel shader program, second shader program) Synthesis, anti-aliasing, etc. are performed. Then, the final drawing color of the pixels constituting the image is determined, and the drawing color of the perspective-transformed object is output (drawn) to the drawing buffer 174 (buffer that can store image information in units of pixels; VRAM, rendering target). . That is, in pixel processing, per-pixel processing for setting or changing image information (color, normal, luminance, α value, etc.) in units of pixels is performed. Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated.

  The vertex processing and the pixel processing can be realized by hardware that enables a polygon (primitive) drawing process to be programmed by a shader program described in a shading language, that is, a so-called programmable shader (vertex shader or pixel shader). Programmable shaders can be programmed with vertex-level processing and pixel-level processing, so that the degree of freedom of drawing processing is high, and expressive power is greatly improved compared to conventional hardware-based fixed drawing processing. Can do.

  In this embodiment, the object space setting unit 110 sets an object space in which the character (model object) moves. Further, the texture storage unit 178 has a color pattern corresponding to the developed view of the first part object among the plurality of part objects constituting the character (model object), and the surface color of the first part object is texel. Stores the color map texture of the development scheme set to “1”. Further, a reflection map texture having a reflection information pattern corresponding to the development drawing of the first part object and reflection information set in the texel is stored.

  The lighting processing unit 126 included in the pixel shader unit 124 performs the lighting process. Specifically, this lighting processing is performed using light source information (light vector, light source color, brightness, light source type, etc.), illumination model, normal vector, object material parameters (color, material), and the like. As lighting models, there are lumbard lighting models that consider only ambient light and diffuse light, phon lighting models that consider specular light in addition to ambient light and diffuse light, and Brin phon lighting models. .

  In this embodiment, the lighting processing unit 126 uses the reflection information set in the texels of the reflection map texture stored in the texture storage unit 178, the illumination model (the lighting model arithmetic expression), and the light source information (light vector). Based on this, the lighting process of the first part object is performed. For example, a lighting process (specular calculation) for expressing gloss (reflection of light) is performed in a lighting process area (for example, a liquid adhesion area) set as an area where the lighting process is performed on the surface of the character. For example, using the reflection information (reflectance) of the reflection map texture as mask information, the lighting processing area and other areas are discriminated based on the reflection information, and the reflection information, lighting model, and light source are determined for the determined lighting processing area. Perform lighting processing based on information. For example, among the texels of the reflection map texture, a texel corresponding to a region other than the lighting processing region is set with a first value (for example, a value of 0) that invalidates the specular calculation, and a texel corresponding to the lighting processing region. , A value other than the first value (for example, a value greater than 0 and 1 or less) is set. When the reflection information is set to the first value, the specular value obtained by the specular calculation is set to zero. On the other hand, when the reflection information is set to a value other than the first value, the specular calculation is performed using that value as the reflectance.

  Note that the first part object is, for example, an arm, face (head), foot, or weapon (sword, handgun, etc.) object of the character, and the lighting processing unit 126 reflects the reflection information set in the texel of the reflection map texture. Based on the lighting model and the light source information, lighting processing is performed on the character's arm, face, foot, or weapon object.

  In the present embodiment, the texture storage unit 178 stores a normal map texture for representing the unevenness (bump) on the surface of the first part object. Specifically, it stores a normal map texture of a development map method having a normal vector pattern corresponding to the development drawing of the first part object, and information of the normal vector set in the texel. The bump processing unit 128 included in the pixel shader unit 124 performs a bump process for representing the unevenness of the surface of the first object based on the normal map texture fetched from the texture storage unit 178. Specifically, bump processing is performed in the lighting processing area based on the information of the normal vector set in the texel of the normal map texture, and the surface of the first part object appears as if there is an unevenness. The shading process is performed. Note that a modification may be made in which the lighting processing unit 126 and the bump processing unit 128 are not included in the pixel shader unit 124.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, or sounds, and outputs the game sounds to the sound output unit 192.

  Note that the image generation system of the present embodiment may be a system dedicated to the single player mode in which only one player can play, or may be a system having a multiplayer mode in which a plurality of players can play. Further, when a plurality of players play, game images and game sounds to be provided to the plurality of players may be generated using one terminal, or connected via a network (transmission line, communication line) or the like. Alternatively, it may be generated by distributed processing using a plurality of terminals (game machine, mobile phone).

2. 2. Method of this Embodiment 2.1 Lighting Processing Using Texture in a Development View Method FIG. 2A shows an example of a first part object POB constituting a character. Although an actual character part object is formed in a complex manner by a large number of polygons, FIG. 2A shows an example in which the part object POB is a hexagonal prism in order to simplify the description.

  In the present embodiment, the character is composed of a plurality of three-dimensional part objects (part objects). Specifically, it is composed of part objects representing a character's right arm, left arm, head (face), right foot, left foot, weapon, or torso. For these part objects, a color map texture, a reflection map texture, and a normal map texture corresponding to the development of each part object are prepared and mapped to each part object.

  For example, FIGS. 2B and 2C show examples of color map textures and reflection map textures in a developed view that are mapped to the hexagonal column part object POB in FIG. The color map texture of FIG. 2B has a color pattern corresponding to the development view of the part object POB, and is a texture in which the surface color of the part object POB is set to texel. The reflection map texture of FIG. 2C has a reflection information pattern corresponding to the development view of the part object POB, and is a texture in which reflection information to be mapped to the part object POB is set in the texel. In the present embodiment, the lighting processing unit 126 performs the lighting processing of the part object POB based on the reflection information, the illumination model, and the light source information set in the texel of the reflection map texture.

  For example, in the present embodiment, image representation of sweat (liquid, moisture in a broad sense) adhering to the skin (surface in a broad sense) of a character (part object) is realized by the following method. In the following description, the method of the present embodiment is described as an example in which the method of the present invention is applied to the reflection of light of the liquid adhering to the surface of the character. However, the method of the present embodiment is not limited to this and depends on an object other than the liquid. It can also be applied to light reflection. For example, the method of the present embodiment is also applicable to the reflection of light by clothes worn by a character, the reflection of light by ornaments worn by the character, and the reflection of light on the surface of a weapon (eg, sword, gun) possessed by the character. Is applicable. Hereinafter, a case where the liquid adhering to the character is sweat will be described as an example, but the liquid of the present embodiment is not limited to sweat. For example, it may be rain drops or tears flowing from the eyes of the character. Or the liquid etc. which adhere to the surface of monsters, such as a half fisherman who emerges from the sea, may be sufficient.

  In this embodiment, in order to express the sweat of the character, the reflection map texture schematically shown in FIG. 3A is stored in the texture storage unit 178. In this reflection map texture, reflection information for expressing the gloss of sweat (shine) is set in the texel. As this reflection information, the reflectance of light with sweat, the glossy color (light source color) of the reflected light with sweat, and the like can be considered. This reflection information can also function as mask information for distinguishing between a region where light is reflected by a liquid and a region where light is not reflected.

  For example, in FIG. 3A, a texel (texel area) of a reflection map texture corresponding to a sweat adhesion area (lighting processing area in a broad sense) set as an area to which sweat (liquid) adheres in the skin (surface) of the character. ), The reflectance Ks is set to 1.0 (maximum value), for example. As a result, a reflection map texture having a reflectance Ks = 1.0 is mapped onto the sweat adhesion region of the character. On the other hand, in a texel corresponding to an area other than the sweat adhesion area (lighting processing area), the reflectance Ks is set to, for example, 0.0 (minimum value), which is a first value that invalidates the specular calculation of the lighting processing. The As a result, a reflection map texture having a reflectance Ks = 0.0 is mapped in this area. When the reflectance Ks (reflection information) is set to 0.0 (first value) in this way, the specular calculation by the lighting processing unit 126 is invalidated and the specular value becomes zero. FIG. 3A shows the case where the reflectance Ks set in the texel of the reflection map texture is 0.0 and 1.0, but an intermediate value between them may be set in the texel. . For example, the gradient setting may be performed such that the reflectance Ks gradually decreases from the region where the reflectance Ks = 1.0 toward the region where Ks = 0.0.

  Now, as a mathematical model for simulating an illumination phenomenon in the real world, various illumination models are used in this type of image generation system. FIG. 3B shows an example of an illumination model when the light source is parallel light. This Brin Fong illumination model (specular reflection model) can be expressed by the following equation (1), for example.

I = Ks * (N * H) ^P * Is + Kd * (N * L) * Id + Ka * Ia (1)
Here, Ks, Kd, and Ka are reflectivities (reflection coefficients) for specular light, diffuse light, and ambient light, respectively, and Is, Id, and Ia are intensities of specular light, diffuse light, and ambient light ( Brightness, color). N is a normal vector of the object, L is a light vector of the light source LS, H is a half vector, and P is a specular reflection index (highlight characteristic coefficient). The half vector H can be expressed as H = (E + L) / | E + L |.

  In the Brin von lighting model, the intensity of specular light is expressed by the power of the inner product of the normal vector N and the half vector H. Accordingly, the specular light becomes stronger as the direction of the normal vector N and the half vector H becomes closer. Further, when the specular reflection index P is as small as 10 or less, for example, the specular reflection highlight spreads over a wide range, and when the specular reflection index P is as large as about 100, the highlight becomes a small point.

  The illumination model of the present embodiment may be a phone illumination model represented by the following equation (2).

I = Ks * (L * R) ^P * Is + Kd * (N * L) * Id + Ka * Ia (2)
Here, R is a reflection vector, and can be obtained by the equation R = −E + 2 (N · E) N. In this Phong illumination model, the intensity of specular light is expressed as the power of the inner product of the light vector L and the reflection vector R. Therefore, the specular light becomes stronger as the direction of the light vector L and the reflection vector R becomes closer.

  In addition, the illumination model of this embodiment is not limited to the illumination model of said Formula (1) (2). For example, brightness correction or the like may be performed on the illumination models of the above formulas (1) and (2), or an illumination model represented by a formula different from the above formulas (1) and (2) may be used.

  In this embodiment, the lighting processing unit 126 performs lighting processing on the surface of the character based on the reflection information of the reflection map texture in FIG. 3A, the illumination model in FIG. 3B, and the light source information. Yes. Specifically, a lighting process is performed to represent the reflection of sweat light in the sweat adhesion region.

  For example, as a method of a comparative example, a method of expressing sweat by performing a coloring process of sweat color on a sweat adhesion region of a character is conceivable. Specifically, a sweat color map texture is mapped to the sweat adhesion region.

  However, in this comparative method, even if the line-of-sight vector, light vector, and character position / direction relationship change, the sweat gloss does not change, and the same sweat image is always generated. It is scarce.

  On the other hand, according to the method of the present embodiment, when the line-of-sight vector, the light vector, and the position / direction relationship of the character change, the degree of reflection of light by sweat changes accordingly. For example, in FIG. 3B, when the angle formed by the half vector H and the normal vector N of the character (or the angle formed by L and R) is close to 0 degrees, the light of sweat is generated in the sweat adhesion region. An image that appears strongly reflected is generated. On the other hand, when the positional relationship between the half vector H and the normal vector N (or the angle between L and R) is large, an image in which the reflection of sweat light in the sweat adhesion region is weak is generated. Therefore, compared to the method of the comparative example, the realism of the generated image can be significantly improved.

  For example, consider a case where the present embodiment is applied to a sports game such as a soccer game. In this case, when the character moves on the field of the stadium, the direction of the normal vector N of the skin of the character, the direction of the light vector L from the lighting arranged in the stadium, and the line-of-sight vector of the virtual camera that follows the character Depending on the position / direction relationship of E, the light of the character's sweat changes in real time. Therefore, it is possible to give the player a virtual reality that looks as if a real person is playing soccer.

  In the present embodiment, when the reflectance Ks, which is the reflection information of the reflection map texture, is set to 0.0, the specular calculation is invalidated even if the portion is exposed to light, and no specular reflection of light occurs. It becomes like this. Therefore, the specular calculation can be invalidated only by setting Ks = 0.0 for a portion that becomes unnatural when specular reflection occurs, and the character design can be facilitated.

2.2 Detailed example of texture in developed view method FIGS. 4, 5, and 6 show detailed examples of the color map texture, reflection map texture, and normal map texture used in this embodiment, respectively. These textures are textures mapped to arm part objects among a plurality of part objects constituting the character.

  For example, the color map texture of FIG. 4 has a color pattern (texture color pattern) corresponding to a development view of an arm part object (first part object in a broad sense). Then, the color of the surface of the arm part object is set in the texel of the color map texture. That is, when a three-dimensional arm part object that is a closed figure is turned into an expanded view that is an open figure, a color map texture having a color pattern to be mapped to the developed view is prepared. In other words, one color map texture is prepared which is mapped so as to wrap the arm part object. For example, in the color map texture of FIG. 4, the front and back portions of the arms (parts in a broad sense) have different color patterns, and the lower arm portions and upper arm portions of the arms also have different color patterns. In this way, the color map texture of the development scheme in which the color pattern of each part of the arm is different is mapped so as to wrap the arm part object.

  For example, in the method of the comparative example of FIG. 9A, the part object POB is composed of a plurality of polygons PL. An arm image is generated by repeatedly mapping the color map texture TEX representing the skin pattern on each of the plurality of polygons PL.

  The method of this comparative example has an advantage that the storage capacity of the texture can be saved. However, since the skin pattern in each part of the arm is the same, the generated image is monotonous. Therefore, an artificially visible character image made of polygons is generated, and the virtual reality of the player cannot be improved.

  On the other hand, if a color map texture as shown in FIG. 4 is used, a detail image of each part of the arm can be drawn on the color map texture. Therefore, compared to the method of the comparative example in FIG. 9A, the realism of the generated arm image can be significantly improved. Then, a real character image having a real human skin color can be generated, and the virtual reality of the player can be improved.

  In this embodiment, as shown in FIG. 5, similarly to the color map texture of FIG. 4, a development map type texture is used for the reflection map texture. The reflection map texture of FIG. 5 has a reflection information pattern (mask pattern) corresponding to the development view of the arm part object. Then, the reflection information to be mapped on the surface of the arm part object is set in the texel of the reflection map texture. That is, a reflection map texture having a reflection information pattern to be mapped to a developed view of an arm part object that is a closed figure is prepared. In other words, one reflection map texture is prepared which is mapped so as to enclose the arm part object. For example, in the reflection map texture of FIG. 5, the front and back portions of the arms have different reflection information patterns, and the lower arm portion and the upper arm portion of the arms also have different reflection information patterns. Then, the reflection map texture of the development view method in which the reflection information pattern of each part of the arm is different is mapped so as to wrap the arm part object.

  For example, in the method of the comparative example in FIG. 9B, a reflection map texture is prepared that becomes brighter as it approaches the center of the circle and becomes darker as it moves away from the center of the circle. When the directions of the half vector H and the normal vector L coincide, reflection information (reflectance = 1.0) near the center of the circle is fetched and mapped. On the other hand, when the directions of the half vector H and the normal vector L do not match, the reflection information (reflectance = 0.0) near the contour of the circle is fetched and mapped.

  However, in the method of this comparative example, only a monotone specular effect in which a highlight is generated at a place where the half vector H and the normal vector L coincide with each other can be realized. Therefore, it becomes difficult to realize the specular effect of light due to the sweat of the character.

  On the other hand, in the present embodiment, the light in the lighting processing area is simply drawn on the texel area of the reflection map texture corresponding to the lighting processing area in each part of the arm part object. The specular effect can be realized. Accordingly, by changing the reflection information pattern of the reflection map texture, the specular effect of various reflection patterns can be expressed, and a realistic character image can be generated. For example, it is assumed that an image pattern representing muscle muscles is drawn in the color map texture of FIG. In this case, in the reflection map texture of FIG. 5, reflection information having a high reflectance is written to the texels in the region corresponding to the pattern image representing the muscle muscles in order to express the sweat of the character. That is, when a given image pattern is drawn on the color map texture, the reflection information corresponding to the image pattern is written to the texel of the reflection map texture (texel corresponding to the area where the image pattern is drawn). . In this way, it is possible to generate an image that looks as if sweat or the like is flowing along the muscles of the arm muscles of the character.

  Further, in the present embodiment, as shown in FIG. 6, similarly to the color map texture of FIG. 4 and the reflection map texture of FIG. The normal map texture of FIG. 6 has a normal vector pattern (mask pattern) corresponding to the developed view of the arm part object. The normal vector to be mapped to the surface of the arm part object is set in the texel of the normal map texture. That is, a normal map texture having a normal vector pattern to be mapped to a developed figure is prepared. In other words, one normal map texture that is mapped so as to wrap around the arm part object is prepared. In this way, the normal map texture of the developed view method in which the normal vector pattern of each part of the arm is different is mapped so as to wrap the arm part object.

  FIG. 7 shows an example of an arm image of a character generated by this embodiment. In FIG. 7, the gloss of sweat of the arm of the character is expressed realistically. When the directions of the normal vector N and the half vector H (or L and R) in FIG. 3B coincide with each other, the gloss of sweat in the sweat adhesion region (lighting processing region) increases, and the directions of these vectors are equal. Failure to do so reduces the gloss of sweat in the sweat adhesion area. Further, in FIG. 7, the gloss of sweat is expressed along the muscle muscles of the character. In the present embodiment, since the unevenness of sweat is expressed using a normal map texture, sweat that appears stereoscopically rather than planarly is expressed.

  FIG. 8 shows an example of a character face (head) image generated by the present embodiment. In FIG. 8, a sweat adhesion region (lighting processing region) is set on the face of the character, below the eyes, and above the lips. In this embodiment, the lighting processing unit 126 performs lighting processing for expressing the gloss of sweat in these sweat adhesion areas, and the bump processing unit 128 performs bump processing for expressing the unevenness of sweat. Perform in the sweat adhesion area. By doing so, in these sweat adhesion regions, not only the gloss of sweat but also the unevenness of sweat (skin) comes to be expressed. In other words, it is possible to generate an image that looks as if the sweat shining with the light is attached along the unevenness of the skin (skin), giving the player the impression that the sweat is attached to the real skin. Can do.

  In this regard, with the method of FIG. 9B, it is difficult to generate an image as shown in FIG. 8 because it is not possible to realize a process that links the lighting process and the bump process. On the other hand, in this embodiment, the lighting processing unit 126 and the bump processing unit 128 are included in the pixel shader unit 124, and the lighting processing unit 126 and the bump processing unit 128 use the reflection map texture and the normal map texture. To perform lighting processing and bump processing in units of pixels. Therefore, it is possible to realize a process in which the lighting process and the bump process are linked, and an image in which both the gloss of sweat and the unevenness of sweat are expressed as shown in FIG. 8 can be generated.

  In FIG. 8, for example, an unnatural image appears when the specular effect appears in the eyelid area, the nostril area, or the chin area. In this regard, in this embodiment, the specular calculation can be invalidated by setting Ks = 0.0 in these portions. Therefore, even if light from the light source hits this portion, specular reflection does not occur in this portion, and a more natural and realistic image can be generated with a small processing load.

2.3 Reflection Map Texture FIG. 10 is an explanatory diagram of the reflection map texture. In FIG. 10, the texture storage unit 178 stores the reflectance (reflection coefficient) as reflection information in the α plane of the reflection map texture. The lighting processing unit 126 performs a lighting process in which light is specularly reflected at the reflectance of the α plane in the sweat adhesion region (lighting processing region). On the other hand, the texture storage unit 178 stores glossy color (light source color) such as sweat as reflection information in the color plane of the reflection map texture. For example, glossy R, G, and B data are stored in texels on the R, G, and B planes of the reflection map texture. The lighting processing unit 126 performs a lighting process in which light is specularly reflected by the glossy color of the color plane in the sweat adhesion region.

  According to the reflection map texture of FIG. 10, it is possible to control the intensity of light reflection in the sweat adhesion region using the reflectance set in the α plane. On the other hand, the color reflected by sweat can be controlled based on the glossy colors set in the R, G, and B color planes. For example, a character with yellow skin can be controlled to set the glossy color of sweat to yellow, and a character with white skin can be set to set the glossy color of sweat to a bluish color. Thereby, a more realistic image can be generated.

  In FIG. 10, the glossy color is set as the reflection information of the reflection map texture, but it is also possible to set only the reflectance without setting these glossy colors. The reflection information set in the α plane may be the reflectance itself or a parameter (mask parameter) equivalent to the reflectance. Further, a modification in which the reflectance is set to any one of R, G, and B color planes is also possible.

2.4 Normal Map Texture In this embodiment, bump processing is performed in the sweat adhesion region (lighting processing region) based on the normal map texture for representing the unevenness of the character's sweat (skin). In this case, as shown in FIG. 11, in the reflection map texture, the reflectance Ks is set to a high value in the sweat adhesion region, and also in this normal map texture, a normal vector that expresses irregularities in the sweat adhesion region. Is set to Specifically, in the normal map texture, the X, Y, and Z coordinates (coordinates in the vertex coordinate system) of the bump normal vector NB are stored in the R, G, and B planes of the texture, respectively. Accordingly, on a flat surface where all the normal vectors NB are oriented in the Z direction, the X and Y coordinates (R and G components) of the normal vector NB are 0, and only the Z coordinate (B component) is the value. Therefore, the normal map texture color is blue. On the other hand, as shown by A1 in FIG. 11, since the X and Y coordinates of the bump normal vector NB have values, the color of the normal map texture is different from blue. In this embodiment, as shown in A2 of FIG. 11, in the sweat adhesion region where the reflectance Ks is set to a high value, the X and Y coordinates of the normal vector NB have values, and other than blue It is colored. Then, by performing shading using such a normal vector NB, a sweat shape as shown in A1 can be pseudo-expressed. Thereby, a realistic image as shown in FIGS. 7 and 8 can be generated.

2.5 Vertex Shader and Pixel Shader FIG. 12A shows a detailed configuration example of the vertex shader unit 122 and the pixel shader unit 124. The function of the vertex shader unit 122 (vertex processing unit) can be realized by hardware such as a vector operation unit and a vertex shader program (vertex processing program) as shown in FIG. This vertex shader program describes variables, functions, and the like for performing processing for each vertex. The function of the pixel shader unit 124 (pixel processing unit) can also be realized by hardware such as a vector operation unit and a pixel shader program (pixel processing program) as shown in FIG. This pixel shader program describes variables, functions, and the like for performing processing for each pixel.

  In FIG. 12A, the vertex shader unit 122 includes a coordinate conversion unit 10 and an output unit 12. Here, the coordinate conversion unit 10 performs coordinate conversion to various coordinate systems. Specifically, for example, as shown in FIG. 13A, vertex coordinates PV, line-of-sight vector E, light vector L, normal vector N, normal vector (tangent vector) T, and normal vector B are Convert from the local coordinate system to the world coordinate system. Only a part of these vectors may be converted to the world coordinate system. The output unit 12 stores the vertex coordinates PV, the line-of-sight vector E, the light vector L and the like after conversion in an output register and passes them to the pixel shader unit 124.

  The rasterization processing unit 123 performs rasterization (scan line conversion) processing. Specifically, processed raster data is input from the vertex shader unit 122 to the rasterization processing unit 123. Then, the rasterize processing unit 123 performs a process for generating pixels constituting the polygon based on the processed vertex data. In this case, for example, interpolation processing (linear interpolation, etc.) such as vertex coordinates, various vectors (normal vectors, etc.), vertex colors, vertex texture coordinates, etc. included in the vertex data is performed. In addition, the pixel color, texture coordinates in the pixel, and the like are obtained.

  The pixel shader unit 124 includes a texture fetch unit 20 (texture mapping unit) and a pixel processing unit 22. The texture fetch unit 20 performs texture fetch processing (mapping and sampling processing). Specifically, texture data is read from the texture storage unit 178 using the texture coordinates of the pixels.

  The pixel processing unit 22 performs various processing processes on the pixel data. By this processing, the color of the pixel (fragment) is determined. Then, after the processing (pixel shader), for example, a scissor test, alpha testing, depth test or stencil test is executed to finally determine whether or not the pixel (fragment) is displayed. Note that after the pixel is determined to be displayed, further pixel data processing (fog, translucent synthesis, anti-aliasing) is performed, and the processed pixel data is written into the frame buffer.

  In this embodiment, a lighting processing unit 126 and a bump processing unit 128 are included in the pixel shader unit 124 (pixel processing processing unit 22), and perform lighting processing and bump processing in units of pixels. Accordingly, the final color of each pixel of the character's part object is obtained by a pixel-based lighting process and a bump process using a reflection map texture and a normal map texture of a development map system as shown in FIGS. Can do. Therefore, it is easy to generate an image in which both the gloss of the character's sweat and the unevenness of the surface are expressed.

  In the present embodiment, as shown in FIG. 13A, the vertex shader unit 122 converts the first and second normal vectors T, B and the like into the world coordinate system. Then, the pixel shader unit 124 converts the normal vector NB obtained from the normal map texture into the world coordinate system based on the first and second subordinate vectors T and B. Specifically, when the X-coordinate and Y-coordinate of the normal vector NB for bumps are set to NBX and NBY, coordinate conversion represented by the formula NBX × T + NBY × B is performed. The bump processing unit 128 performs bump processing based on the normal vector NB after coordinate conversion.

  For example, FIG. 13B shows an example of a vertex coordinate system (tangent vector space). This vertex coordinate system is a coordinate system in which the normal vectors T and B calculated for each vertex of the object OB are base vectors. In this vertex coordinate system, the normal vector is oriented in the positive direction of the Z axis at all vertices. Further, the binormal vector T (tangent vector) points in the direction along the X axis, and the binormal vector B points in the direction along the Y axis.

  When performing bump processing (bump map) using a normal map texture, the vertex shader unit 122 generally performs coordinate conversion of the line-of-sight vector E and the light vector L into the vertex coordinate system (tangent vector space). is there. This is because the X and Y coordinates of the normal vector NB of the normal map texture can be used as texture coordinates U and V as they are.

  In this regard, in this embodiment, the vertex shader unit 122 performs coordinate conversion of the line-of-sight vector E, the light vector L, and the like into the world coordinate system instead of the vertex coordinate system, and outputs them. By using the world coordinate system in this way, the accuracy of calculations using these vectors can be improved.

  However, if these vectors are vectors in the world coordinate system, there is a problem that the X and Y coordinates of the normal vector NB of the normal map texture cannot be used as the texture coordinates U and V as they are.

  Therefore, in the present embodiment, as shown in FIG. 13A, the vertex shader unit 122 also converts the normal vectors T and B into the world coordinate system. Then, the pixel shader unit 124 converts the normal vector NB of the normal map texture into the world coordinate system using, for example, the formula NBX × T + NBY × B based on the subordinate normal vectors T and B after the coordinate conversion. In this way, the normal map texture shown in FIG. 6 can be handled in the same coordinate system as the color map texture and reflection map texture of FIGS. 4 and 5, and mapped to the arm part object of the character. Processing can be simplified.

2.6 Changes in Reflection Map Texture and Normal Map Texture In the images of FIGS. 7 and 8, there is a problem that if the sweat of the character always adheres to the sweat adhesion region at the same fixed location, the image lacks realism.

  Therefore, in this embodiment, the parameter calculation unit 116 calculates parameters such as a character status parameter. Then, the change processing unit 118 changes the reflection map texture as schematically shown in B1, B2, and B3 in FIG. 14 based on the calculated parameters, and the area (large size) of the sweat adhesion region (lighting processing region). ), Shape (outer shape), light reflectance, gloss color, and the like are changed. For example, in B1 of FIG. 14, the texel region where the reflectance is set to a large value (for example, Ks = 1.0) is small, and the area of the sweat adhesion region is also small. And in B2 and B3 of FIG. 14, the area | region of the texel in which a reflectance is set to a big value becomes large gradually, and the shape also changes. This increases the area of the sweat adhesion region and changes its shape. Accordingly, it is possible to generate a realistic image in which the sweat particles generated in B1 of FIG. 14 gradually increase and flow downward.

  In this embodiment, when the reflection map texture changes, the change processing unit 118 changes the normal map texture in conjunction with the change of the reflection map texture. For example, when the area and shape of the sweat adhesion region (lighting processing region) change, the normal map texture in the sweat adhesion region (lighting processing region) is changed in conjunction with the change in the area and shape of the sweat adhesion region. Specifically, as shown in B1, B2, and B3 of FIG. 14, when the area and shape of the sweat adhesion region (the texel region corresponding to the sweat adhesion region) change, it is shown in C1, C2, and C3 in conjunction with it. To change the normal map texture. That is, the normal vector NB (X, Y coordinates) of the normal map texture in the sweat adhesion region is changed so that the sweat unevenness in the sweat adhesion region is represented as an image. For example, in C1 of FIG. 14, the color of the normal map texture is a color other than blue only at the place where sweat is generated, and is blue in other regions. In C2 and C3 in FIG. 14, the area of the region where the normal map texture is a color other than blue gradually increases. By doing so, it is possible to realistically express how the generated sweat particles gradually increase and flow downward.

  Note that the processing (texture animation) for changing the reflection map texture or the normal map texture may be realized by replacing the texture or by rewriting the texture.

  When realizing by replacing texture, prepare multiple reflection map textures and normal map textures in advance, and calculate the parameters calculated from these multiple reflection map textures and normal map textures. Texture textures as shown in B1 to B3 and C1 to C3 in FIG. 14 are realized by sequentially selecting textures corresponding to the above and reading them from the texture storage unit 178.

  On the other hand, when it is realized by rewriting the texture, the texture animation is realized by rewriting the texel values of the reflection map texture and the normal map texture corresponding to the sweat adhesion region in real time. Specifically, for example, a basic reflection map texture and normal map texture are prepared. If it is determined that sweat has occurred, the reflection information and normal vector of the texel in the area corresponding to the place where the sweat occurs are rewritten as shown in B1 and C1 of FIG. For example, the reflection information is rewritten so that the reflectance of the region becomes high, and the normal vector is rewritten so that irregularities can be seen in the region. Then, according to the calculated parameter value of the character, as shown in B2, B3, C2, and C3 in FIG. 14, the texel reflection information and the normal vector in the region corresponding to the sweat adhesion region are sequentially rewritten. In this way, it is not necessary to prepare a plurality of textures, and texture animation that saves the storage capacity of the memory becomes possible.

  Note that changing the normal map texture in conjunction with the change in the reflection map texture means replacing the normal map texture at the same timing (almost the same timing) when the reflection map texture is replaced, for example. It is. Alternatively, when the reflection map texture is rewritten, the normal map texture is rewritten at the same timing (substantially the same timing). In this case, not only the timing but also the place to be rewritten is almost the same in the reflection map texture and the normal map texture. By doing this, it is possible to express how the gloss of sweat and the unevenness of sweat change in conjunction with each other.

  Next, a method for calculating character parameters will be described. In the present embodiment, the parameter calculation unit 116 calculates a physical strength parameter, an exercise amount parameter, a time lapse parameter, or the like of the character. Then, as the physical strength parameter decreases, the momentum parameter increases, or the time lapse parameter increases, the area (total area) of the sweat adhesion region where the sweat writing process is performed is increased. In this way, as the character's physical strength decreases, the amount of exercise increases, or the exercise time increases, the occupation area of the character's sweat adhesion region increases, and the character's amount of sweat increases in a realistic manner.

  FIG. 15A to FIG. 16B show examples of table data used in this embodiment. For example, FIGS. 15A, 15 </ b> B, and 15 </ b> C are table data that associates the physical strength parameter PP, the exercise amount parameter PE, and the time passage parameter PT of the character with the sweat amount parameters PS <b> 1, PS <b> 2, and PS <b> 3, respectively. For example, in FIG. 15A, the value of the sweat amount parameter PS1 increases as the value of the physical strength parameter PP of the character decreases. In FIG. 15B, the value of the sweat amount parameter PS2 increases as the value of the character's exercise amount parameter PE increases. In FIG. 15C, the value of the sweat amount parameter PS3 increases as the value of the time lapse parameter (exercise time parameter) PT of the character increases.

  Based on these parameters PS1, PS2, and PS3, a total sweat amount (liquid amount) parameter PS = F (PS1, PS2, PS3) is obtained. Here, F (PS1, PS2, PS3) is a predetermined function having PS1, PS2, and PS3 as arguments. As such a function, for example, F (PS1, PS2, PS3) = k1 * PS1 + k2 * PS2 + k3 * PS3 can be considered.

  The table data of FIG. 16A includes the calculated sweat amount parameter PS and a plurality of reflection map textures RFTEX01, RFTEX02, RFTEX03,..., A normal map texture NTEX01, prepared for texture animation. Table data that associates NTEX02, NTEX03,... That is, as the value of the sweat amount parameter PS increases, the reflection map texture to be fetched in the lighting process is sequentially replaced as RFTEX01, RFTEX02, RFTEX03,. In conjunction with the replacement of these reflection map textures, the normal map texture to be fetched by the bump processing is also sequentially replaced as NTEX01, NTEX02, NTEX03,. As a result, texture animation as shown in B1 to B3 and C1 to C3 in FIG. 14 is realized, and the amount of sweat on the character's skin increases as the character's physical strength decreases, the amount of exercise increases, or the exercise time elapses. The image expression that goes on can be realized.

  The weather condition in the game space (object space) in which the character moves may be reflected in the sweat amount parameter PS. For example, in the table data of FIG. 16B, the weather and temperature of the game space (stadium) are associated with the weather coefficient.

  For example, when the weather is fine and the temperature is high, the weather coefficient increases, thereby increasing the rate of increase of the sweat amount parameter PS. Therefore, the rate of increase in the area of the sweat adhesion region is increased, and it is possible to express how the character is likely to sweat. In addition, for example, when the weather is cloudy and the temperature is low, the weather coefficient becomes small, and thereby the rate of increase of the sweat amount parameter PS becomes small. Therefore, the rate of increase in the area of the sweat adhesion region is reduced, and it is possible to express how the character is less likely to sweat.

  The sweat volume parameter PS may be controlled by a coefficient other than the weather coefficient. For example, a coefficient indicating the character's tension level, game tightness level, audience / cheering level, and the like may be prepared, and the sweat amount parameter PS may be controlled by this coefficient.

2.7 Changes in Reflection Map Texture and Normal Map Texture in Hit Area In this embodiment, when a hit event occurs for the part object POB as shown in FIG. 17A, a hit area (hit position) shown in D1 Is detected. Then, as shown by D2 in FIG. 17B, a process of changing the reflection map texture is performed in the area of the texel corresponding to the detected hit area. That is, the reflection information set in the texel is rewritten. Further, as indicated by D3 in FIG. 17C, a process of changing the normal map texture is performed in the texel region corresponding to the detected hit region. That is, the normal vector information set in the texel is rewritten.

  That is, in the present embodiment, a reflection map texture and a normal map texture of a development view method as shown in FIGS. 17B and 17C are prepared and wrapped around the part object POB shown in FIG. To be mapped. Accordingly, the hit area indicated by D1 in FIG. 17A and the texel areas indicated by D2 and D3 in FIGS. 17B and 17C have a one-to-one correspondence. Therefore, the texel regions (D2, D3) of the reflection map texture and the normal map texture corresponding to the hit region D1 in FIG. 17A can be easily specified. Therefore, it is possible to easily rewrite the reflection information and normal vector information of the specified D2 and D3 texel regions.

  For example, as a hit event in FIG. 17A, an event in which a punch or kick of another character hits the character can be considered. When such a hit event occurs, the reflectance of the texel of the reflection map texture corresponding to the hit area is set to a large value, for example. Further, the normal vector information of the texel of the normal map texture corresponding to the hit area is rewritten as indicated by A1 in FIG. In this way, a bump can be formed by bump processing in an area where a punch or kick has been hit, and an image can be generated in which the bump appears to be lit by lighting processing.

  In the present embodiment, the lighting process using the reflection map texture may not be performed, but only the color setting process using the color map texture and the bump process using the normal map texture may be performed. That is, the rewrite processing of the color map texture and the normal map texture may be performed without performing the rewrite processing of the reflection map texture. For example, when a bullet fired from a gun hits a character, the color of the texel of the color map texture corresponding to the hit area is rewritten to a bullet hole color indicating that the bullet has hit. Similarly, the normal vector information of the texel of the normal map texture corresponding to the hit area is rewritten to information that the surface of the hit area appears to be depressed. By doing so, it is possible to generate an image in which a bullet hole is generated in the area where the bullet is hit and the bullet hole is depressed by the bump processing.

  In particular, the pixel shader unit 124 performs lighting processing and bump processing using textures in the development schemes of FIGS. 17A, 17 </ b> B, and 17 </ b> C, so that processing efficiency can be improved. For example, as a comparative example of the present embodiment, a method of preparing a bullet hole expression texture and mapping the bullet hole expression texture to the bullet hit position is conceivable. However, according to the method of this comparative example, it is necessary to perform a process of mapping the texture by specifying the bullet hit position, which increases the processing load. On the other hand, according to the pixel shader processing using the texture of the development scheme, the rewrite processing of the reflection map texture and the normal map texture is performed as shown in D2 and D3 of FIGS. It is only necessary to transfer the texture after the rewriting process to the pixel shader unit 124. In this case, since the hit area of D1 in FIG. 17A and the texel areas of D2 and D3 in FIGS. 17B and 17C have a one-to-one correspondence, it is easy to specify the area to be rewritten. is there. Further, the pixel shader unit 124 that performs processing in units of pixels does not need to be aware of the position of the hit area. Therefore, the processing load of the pixel shader unit 124 can be reduced, and the overall processing load can also be reduced.

2.8 Detailed Processing Example Next, a detailed processing example of this embodiment will be described with reference to the flowchart of FIG.

  First, character movement / motion processing is performed (step S1). Specifically, based on operation data from the operation unit 160, a program, and the like, a change in character position, a change in direction, and a change in motion (motion) for each frame are calculated in real time.

  Next, the physical strength parameter, the momentum parameter, and the time passage parameter of the character are calculated (step S2). For example, a calculation for gradually decreasing the physical strength parameter of the character is performed according to the amount of movement and the amount of movement of the character. Further, the momentum parameter of the character is calculated based on the moving speed and acceleration of the character. In addition, after the game starts, the time elapsed parameter counting operation is started to calculate the time elapsed parameter. Then, based on the calculated physical strength parameter, exercise amount parameter, and time lapse parameter, the sweat amount parameter is calculated by a method such as that shown in FIGS. 15A, 15B, and 15C (step S3).

  Next, as described with reference to FIG. 17A, it is determined whether or not a hit event has occurred. If a hit event has occurred, the position of the hit area is specified (step S4).

  Next, vertex shader processing by the vertex shader program is started (step S5). Specifically, the binormal vector of each vertex described in FIG. 13B is acquired (step S6). Next, the vertex coordinates, the line-of-sight vector, the light vector, the normal vector, and the normal vector are coordinate-converted from the local coordinate system to the world coordinate system, stored in the output register, and passed to the pixel shader unit (step S7).

  Next, based on the sweat amount parameter (character parameter) calculated in step S3 and the position of the hit area specified in step S4, the color of the development scheme as shown in FIG. 4, FIG. 5, and FIG. The map texture, reflection map texture, and normal map texture are rewritten and transferred to the VRAM (pixel shader side) or the like (step S8). For example, the reflection information of the reflection map texture and the normal vector information of the normal map texture are rewritten and transferred by the method described with reference to FIGS.

  Next, pixel shader processing is started (step S9). Specifically, a color map texture, a reflection map texture, and a normal map texture of a development view scheme as exemplified in FIGS. 4, 5, and 6 are fetched (step S10). Then, as described in FIGS. 13A and 13B, the bump normal vector read from the fetched normal map texture is coordinate-converted into the world coordinate system using the sub normal vector (step S11). . Next, lighting processing is performed using the illumination model described in FIG. 3B, and a specular value, a diffuse value, and an ambient value are calculated (step S12). At this time, the reflection information read from the fetched reflection map texture is reflected in the specular value. For example, the specular value is set to 0 when the reflectance, which is the shooting information, is 0.0. If the reflectance is not 0.0, a specular value corresponding to the reflectance is obtained. Finally, the final color is obtained and output based on the calculated specular value, diffuse value, ambient value, color information of the fetched color map texture, and the like (step S13).

3. Hardware Configuration FIG. 19 shows an example of a hardware configuration capable of realizing this embodiment. The main processor 900 operates based on a program stored in a DVD 982 (information storage medium, which may be a CD), a program downloaded via the communication interface 990, a program stored in the ROM 950, or the like. Perform processing, sound processing, etc. The coprocessor 902 assists the processing of the main processor 900, and executes matrix operation (vector operation) at high speed. For example, when a matrix calculation process is required for a physical simulation for moving or moving an object, a program operating on the main processor 900 instructs (requests) the process to the coprocessor 902.

  The geometry processor 904 performs geometry processing such as coordinate conversion, perspective conversion, light source calculation, and curved surface generation based on an instruction from a program operating on the main processor 900, and executes matrix calculation at high speed. The data decompression processor 906 performs decoding processing of compressed image data and sound data, and accelerates the decoding processing of the main processor 900. Thereby, a moving image compressed by the MPEG method or the like can be displayed on the opening screen or the game screen.

  The drawing processor 910 executes drawing (rendering) processing of an object composed of primitive surfaces such as polygons and curved surfaces. When drawing an object, the main processor 900 uses the DMA controller 970 to pass the drawing data to the drawing processor 910 and, if necessary, transfers the texture to the texture storage unit 924. Then, the drawing processor 910 draws the object in the frame buffer 922 while performing hidden surface removal using a Z buffer or the like based on the drawing data and texture. The drawing processor 910 also performs α blending (translucent processing), depth cueing, mip mapping, fog processing, bilinear filtering, trilinear filtering, anti-aliasing, shading processing, and the like. When a programmable shader such as a vertex shader or a pixel shader is installed, the vertex data is created / changed (updated) and the drawing color of a pixel (or fragment) is determined according to the shader program. When an image for one frame is written in the frame buffer 922, the image is displayed on the display 912.

  The sound processor 930 includes a multi-channel ADPCM sound source and the like, generates game sounds such as BGM, sound effects, and sounds, and outputs them through the speaker 932. Data from the game controller 942 and the memory card 944 is input via the serial interface 940.

  The ROM 950 stores system programs and the like. In the case of an arcade game system, the ROM 950 functions as an information storage medium, and various programs are stored in the ROM 950. A hard disk may be used instead of the ROM 950. The RAM 960 is a work area for various processors. The DMA controller 970 controls DMA transfer between the processor and the memory. The DVD drive 980 (may be a CD drive) accesses a DVD 982 (may be a CD) in which programs, image data, sound data, and the like are stored. The communication interface 990 performs data transfer with the outside via a network (communication line, high-speed serial bus).

  The processing of each unit (each unit) in this embodiment may be realized entirely by hardware, or may be realized by a program stored in an information storage medium or a program distributed via a communication interface. Also good. Alternatively, it may be realized by both hardware and a program.

  When the processing of each part of this embodiment is realized by both hardware and a program, a program for causing the hardware (computer) to function as each part of this embodiment is stored in the information storage medium. More specifically, the program instructs the processors 902, 904, 906, 910, and 930, which are hardware, and passes data if necessary. Each processor 902, 904, 906, 910, 930 realizes the processing of each unit of the present invention based on the instruction and the passed data.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, in the specification or drawings, terms (liquid adhesion area / sweat adhesion area, sweat, arm parts) described at least once together with different terms (lighting processing area, liquid, first part object, etc.) in a broader sense or the same meaning Object etc.) may be replaced by the different terms anywhere in the specification or drawings.

  Also, the lighting processing, bump processing, lighting model, and parameter calculation method are not limited to those described in this embodiment, and processing and methods equivalent to these are also included in the scope of the present invention. The present invention can be applied to various games. Further, the present invention is applied to various image generation systems such as a business game system, a home game system, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, a system board for generating game images, and a mobile phone. it can.

The example of a functional block diagram of the image generation system of this embodiment. FIGS. 2A, 2B, and 2C are explanatory diagrams of the technique of the present embodiment that uses the texture of the development view method. FIGS. 3A and 3B are explanatory diagrams of the lighting processing of the present embodiment. Example of color map texture. Example of reflection map texture. Example of normal map texture. The example of the arm image of the character produced | generated by this embodiment. The example of the image of the face of the character produced | generated by this embodiment. 9A and 9B are explanatory diagrams of the method of the comparative example. Explanatory drawing of a reflection map texture. Explanatory drawing of a normal map texture. 12A and 12B are explanatory diagrams of a vertex shader unit and a pixel shader unit. 13A and 13B are explanatory diagrams of the coordinate conversion process to the world coordinate system. Explanatory drawing of the method of changing a reflection map texture and a normal map texture. 15A, 15B, and 15C are examples of table data. 16A and 16B show examples of table data. 17A, 17B, and 17C are explanatory diagrams of a technique for rewriting the reflection map texture and the normal map texture based on the position of the hit area. The detailed example of the process of this embodiment. Hardware configuration example.

Explanation of symbols

10 coordinate conversion unit, 12 output unit, 20 texture fetch unit,
22 pixel processing unit, 100 processing unit, 110 object space setting unit,
112 movement / motion processing unit, 114 virtual camera control unit, 116 parameter calculation unit,
118 change processing unit, 119 hit check unit, 120 drawing unit,
122 vertex shader section, 123 rasterization processing section, 124 pixel shader section,
126 lighting processing unit, 128 bump processing unit, 130 sound generation unit,
160 operation unit, 170 storage unit, 172 main storage unit, 174 drawing buffer,
176 model data storage unit, 178 texture storage unit,
180 information storage medium, 190 display unit, 192 sound output unit,
194 Portable information storage device, 196 communication unit

Claims (17)

A program for generating an image,
An object space setting unit for setting an object space in which a character composed of a plurality of three-dimensional part objects moves;
A color map texture of a development view method having a color pattern corresponding to a development view of a first part object of the plurality of part objects, wherein a color of a surface of the first part object is set to a texel; A texture storage unit for storing a reflection map texture of a development map method having a reflection information pattern corresponding to the development drawing of the first part object, and reflection information set in a texel;
A hit check unit that detects a hit area when a hit event occurs for the first part object;
In the texel region corresponding to the detected hit region, a change processing unit that changes the reflection map texture of the development view method,
A vertex shader that performs processing in units of vertices;
As a pixel shader that performs processing in units of pixels,
Make the computer work,
The reflection map texture after the change processing by the change processing unit is transferred to the pixel shader unit side,
The lighting processing unit included in the pixel shader unit fetches the reflection map texture after the change processing in which the reflection information in the texel region corresponding to the hit region is rewritten, and the fetched reflection map texture and real A program characterized in that the lighting processing of the first part object is performed in units of pixels based on an illumination model which is a mathematical model arithmetic expression for simulating illumination phenomena in the world and light source information. . In claim 1,
The first part object is an object of the character's arm, face, foot, or weapon,
The lighting processing unit
A program for performing a lighting process on an arm, face, foot, or weapon object of the character based on the reflection information, the illumination model, and the light source information set in the texel of the reflection map texture. In claim 1 or 2,
Among the texels of the reflection map texture, a texel corresponding to a region other than the lighting processing region where the lighting processing is performed is set with a first value that disables the specular calculation of the lighting processing,
The lighting processing unit
A program that invalidates the specular calculation when the reflection information is set to a first value. In any one of Claims 1 thru | or 3,
The texture storage unit
In the α plane of the reflection map texture, the reflectance is stored as the reflection information,
The lighting processing unit
A program for performing a lighting process in which light is specularly reflected by the reflectance of the α plane. In claim 4,
The texture storage unit
A gloss color is stored as the reflection information in the color plane of the reflection map texture,
The lighting processing unit
A program for performing a lighting process in which light is specularly reflected by the glossy color of the color plane. In any one of Claims 1 thru | or 5,
The texture storage unit
Having a normal vector pattern corresponding to a development view of the first part object, storing a normal map texture of a development view method in which normal vector information is set in a texel;
The bump processing unit included in the pixel shader unit performs a bump process for expressing the irregularities on the surface of the first part object on a pixel basis, based on the normal map texture of a development view method. program. In claim 6,
The vertex shader part is
In the coordinate system that is set for each vertex of the object and the normal vector of each vertex points in the positive direction of the Z-axis, the vector that points in the direction along the X-axis is the tangent vector, and along the Y-axis If the vector facing the direction is a binormal vector, the tangent vector and the binormal vector are coordinate-converted to the world coordinate system,
The pixel shader unit includes:
The normal vector obtained by the normal map texture is coordinate-converted into a world coordinate system based on the tangent vector and the sub normal vector, and the bump processing is performed based on the normal vector after the coordinate conversion. A featured program. A program for generating an image,
An object space setting unit for setting an object space in which a character composed of a plurality of three-dimensional part objects moves;
A color map texture of a development view method having a color pattern corresponding to a development view of a first part object of the plurality of part objects, wherein a color of a surface of the first part object is set to a texel; A texture storage unit for storing a reflection map texture of a development map method having a reflection information pattern corresponding to the development drawing of the first part object, and reflection information set in a texel;
A parameter calculation unit for calculating the parameters of the character;
On the basis of the calculated the parameters, by changing the reflection map texture development view scheme, the-Lighting processing of the surface of the first part object is at least one of area and shape of the lighting processing area is performed A change processing unit to change;
A vertex shader that performs processing in units of vertices;
As a pixel shader that performs processing in units of pixels,
Make the computer work,
The reflection map texture after the change processing by the change processing unit is transferred to the pixel shader unit side,
A lighting processing unit included in the pixel shader unit fetches the reflection map texture after the change processing in which at least one of the area and shape of the lighting processing region changes based on the parameter, and the fetched reflection map texture; The lighting process of the first part object is performed in units of pixels based on an illumination model that is an arithmetic expression of a mathematical model for simulating an illumination phenomenon in the real world and light source information. program. In claim 8,
The texture storage unit
Having a normal vector pattern corresponding to a development view of the first part object, storing a normal map texture of a development view method in which normal vector information is set in a texel;
The change processing unit
When the reflection map texture changes, the normal map texture is changed in conjunction with the change of the reflection map texture,
The reflection map texture and the normal map texture after the change processing by the change processing unit are transferred to the pixel shader unit side,
A bump processing unit included in the pixel shader unit fetches the normal map texture after the change processing, and represents the unevenness of the surface of the first part object based on the fetched normal map texture. A program characterized by performing bump processing in units of pixels. A program for generating an image,
An object space setting unit for setting an object space in which a character composed of a plurality of three-dimensional part objects moves;
A color map texture of a development view method having a color pattern corresponding to a development view of a first part object of the plurality of part objects, wherein a color of a surface of the first part object is set to a texel; A texture storage unit that stores a normal map texture of a development view method having a normal vector pattern corresponding to the development view of the first part object, and normal vector information set in a texel;
A hit check unit that detects a hit area when a hit event occurs for the first part object;
In the texel region corresponding to the detected hit region, a change processing unit that changes the normal map texture of the development scheme,
A vertex shader that performs processing in units of vertices;
As a pixel shader that performs processing in units of pixels,
Make the computer work,
The normal map texture after the change processing by the change processing unit is transferred to the pixel shader unit side,
The bump processing unit included in the pixel shader unit fetches the normal map texture after the change processing in which normal vector information in the texel region corresponding to the hit region is rewritten, and the fetched normal map texture Based on the above, a program for performing bump processing for expressing the irregularities on the surface of the first part object in units of pixels. In claim 10,
The vertex shader part is
In the coordinate system that is set for each vertex of the object and the normal vector of each vertex points in the positive direction of the Z-axis, the vector that points in the direction along the X-axis is the tangent vector, and along the Y-axis If the vector facing the direction is a binormal vector, the tangent vector and the binormal vector are coordinate-converted to the world coordinate system,
The pixel shader unit includes:
The normal vector obtained by the normal map texture is coordinate-converted into a world coordinate system based on the tangent vector and the sub normal vector, and the bump processing is performed based on the normal vector after the coordinate conversion. A featured program.   A computer-readable information storage medium, wherein the program according to any one of claims 1 to 11 is stored. An image generation system for generating an image,
An object space setting unit for setting an object space in which a character composed of a plurality of three-dimensional part objects moves;
A color map texture of a development view method having a color pattern corresponding to a development view of a first part object of the plurality of part objects, wherein a color of a surface of the first part object is set to a texel; A texture storage unit for storing a reflection map texture of a development map method having a reflection information pattern corresponding to the development drawing of the first part object, and reflection information set in a texel;
A hit check unit that detects a hit area when a hit event occurs for the first part object;
In the texel region corresponding to the detected hit region, a change processing unit that changes the reflection map texture of the development view method,
A vertex shader that performs processing in units of vertices;
A pixel shader that performs processing in units of pixels,
The reflection map texture after the change processing by the change processing unit is transferred to the pixel shader unit side,
The lighting processing unit included in the pixel shader unit fetches the reflection map texture after the change processing in which the reflection information in the texel region corresponding to the hit region is rewritten, and the fetched reflection map texture and real An image characterized in that the lighting process of the first part object is performed in units of pixels based on an illumination model that is a mathematical model arithmetic expression for simulating illumination phenomena in the world and light source information. Generation system. An image generation system for generating an image,
An object space setting unit for setting an object space in which a character composed of a plurality of three-dimensional part objects moves;
A color map texture of a development view method having a color pattern corresponding to a development view of a first part object of the plurality of part objects, wherein a color of a surface of the first part object is set to a texel; A texture storage unit for storing a reflection map texture of a development map method having a reflection information pattern corresponding to the development drawing of the first part object, and reflection information set in a texel;
A parameter calculation unit for calculating the parameters of the character;
On the basis of the calculated the parameters, by changing the reflection map texture development view scheme, the-Lighting processing of the surface of the first part object is at least one of area and shape of the lighting processing area is performed A change processing unit to change;
A vertex shader that performs processing in units of vertices;
A pixel shader that performs processing in units of pixels,
The reflection map texture after the change processing by the change processing unit is transferred to the pixel shader unit side,
A lighting processing unit included in the pixel shader unit fetches the reflection map texture after the change processing in which at least one of the area and shape of the lighting processing region changes based on the parameter, and the fetched reflection map texture; The lighting process of the first part object is performed in units of pixels based on an illumination model that is an arithmetic expression of a mathematical model for simulating an illumination phenomenon in the real world and light source information. Image generation system. In claim 14,
The texture storage unit
Having a normal vector pattern corresponding to a development view of the first part object, storing a normal map texture of a development view method in which normal vector information is set in a texel;
The change processing unit
When the reflection map texture changes, the normal map texture is changed in conjunction with the change of the reflection map texture,
The reflection map texture and the normal map texture after the change processing by the change processing unit are transferred to the pixel shader unit side,
A bump processing unit included in the pixel shader unit fetches the normal map texture after the change processing, and represents the unevenness of the surface of the first part object based on the fetched normal map texture. An image generation system that performs bump processing in units of pixels. An image generation system for generating an image,
An object space setting unit for setting an object space in which a character composed of a plurality of three-dimensional part objects moves;
A color map texture of a development view method having a color pattern corresponding to a development view of a first part object of the plurality of part objects, wherein a color of a surface of the first part object is set to a texel; A texture storage unit that stores a normal map texture of a development view method having a normal vector pattern corresponding to the development view of the first part object, and normal vector information set in a texel;
A hit check unit that detects a hit area when a hit event occurs for the first part object;
In the texel region corresponding to the detected hit region, a change processing unit that changes the normal map texture of the development scheme,
A vertex shader that performs processing in units of vertices;
A pixel shader that performs processing in units of pixels,
The normal map texture after the change processing by the change processing unit is transferred to the pixel shader unit side,
The bump processing unit included in the pixel shader unit fetches the normal map texture after the change processing in which normal vector information in the texel region corresponding to the hit region is rewritten, and the fetched normal map texture The image generation system according to claim 1, wherein bump processing for expressing irregularities on the surface of the first part object is performed in units of pixels. In claim 16,
The vertex shader part is
In the coordinate system that is set for each vertex of the object and the normal vector of each vertex points in the positive direction of the Z-axis, the vector that points in the direction along the X-axis is the tangent vector, and along the Y-axis If the vector facing the direction is a binormal vector, the tangent vector and the binormal vector are coordinate-converted to the world coordinate system,
The pixel shader unit includes:
The normal vector obtained by the normal map texture is coordinate-converted into a world coordinate system based on the tangent vector and the sub normal vector, and the bump processing is performed based on the normal vector after the coordinate conversion. A featured image generation system.