JP2012234441A - Program, information storage medium, image generation system and server system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program, an information storage medium and an image generation system capable of reflecting a discoloration processing parameter of a first object on a second object.SOLUTION: An image generation system includes: an event determination unit for determining the occurrence of a contact event in which a first object comes into contact with a second object; a discoloration processing unit for obtaining a discoloration processing parameter set for the first object and performing discoloration processing in accordance with the obtained discoloration processing parameter on an area of the second object corresponding to a contact position of the first object when the contact event occurs between the first object and the second object; and an image generation unit for generating an image viewed from a virtual camera in an object space where plural objects including the first and second objects are arranged and set.

Description

  The present invention relates to a program, an information storage medium, an image generation system, a server system, and the like.

  Conventionally, there has been known an image generation system (game system) that generates an image that can be seen from a virtual camera (a given viewpoint) in an object space (virtual three-dimensional space) in which model objects such as characters are arranged and set. It is popular as a place to experience so-called virtual reality. Taking an image generation system capable of enjoying a fighting game as an example, a player operates a character (model object) using an operation unit (game controller), and another character (enemy character) operated by the opponent player or the computer. Enjoy the game by playing against.

  In such an image generation system, it is desirable that the surface of the model object can be realistically expressed, for example. For example, if the clothes and body dirt of a character that is a model object can be expressed realistically, the virtual reality of the player can be further improved. As a conventional technique for realizing such a dirt treatment, there is a technique disclosed in Patent Document 1, for example.

  However, with the conventional dirt process, the character's clothes and body dirt can be expressed to some extent realistic, but the character's clothes and body dirt may adhere to other objects, and the character's dirt may be washed away by water. Image representation could not be realized.

JP 2001-167291 A

  According to some aspects of the present invention, it is possible to provide a program, an information storage medium, an image generation system, a server system, and the like that can reflect the color change processing parameter of the first object on the second object.

  According to one aspect of the present invention, an event determination unit that determines the occurrence of a contact event in which a first object contacts a second object, and the case where the contact event of the first object and the second object occurs In addition, the color change processing parameter set for the first object is acquired, and the color change processing corresponding to the acquired color change processing parameter is performed according to the second object corresponding to the contact position of the first object. A color change processing unit that performs an area on the object, and an image generation unit that generates an image viewed from a virtual camera in an object space in which a plurality of objects including the first and second objects are arranged and set. Related to image generation system. The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

  According to one aspect of the present invention, when a contact event of the first and second objects occurs, the parameter for color change processing set for the first object is acquired. Then, a color change process corresponding to the acquired color change process parameter is performed on the area on the second object corresponding to the contact position, and an image that can be seen from the virtual camera is generated in the object space. In this way, it is possible to realize a process of reflecting the color change processing parameter of the first object to the second object and changing the color of the area on the second object. A high-quality image can be generated.

  In the aspect of the invention, the color change processing unit may perform a process of enlarging the size of the color change area on the second object on which the color change process is performed with the passage of time from the contact position. .

  In this way, an image in which the discoloration area gradually expands after the occurrence of the contact event is generated, so that a more realistic discoloration image of the second object can be generated.

  In the aspect of the invention, the color change processing parameter is a parameter for color change processing of the first object, and the color change processing unit performs the color change processing in a period in which the contact event occurs. A process of enlarging the size of the color change region on the second object to be performed as time elapses is performed, and the color change color of the first object set by the parameter for color change processing is changed over time. Attenuating processing may be performed along with this.

  In this way, the color change processing of the second object can be realized by effectively utilizing the color change processing parameters used for the color change processing of the first object. Then, while the second object changes color, it is possible to realize an image expression in which the color of the first object gradually attenuates.

  In the aspect of the invention, the discoloration processing unit may be a vertex that is determined to be in contact with the second object among a plurality of vertices constituting the first object when the contact event occurs. The color change processing according to the color change processing parameters set for the image may be performed on the area on the second object corresponding to the contact position.

  In this way, it is possible to perform the color change process according to the color change process parameters set for the vertices constituting the first object on the area on the second object.

  In the aspect of the invention, the event determination unit may determine whether the first object and the first object are based on a positional relationship between a representative point of a plurality of vertices constituting the first object and the second object. It may be determined whether the contact event of the second object has occurred.

  Thus, by determining the occurrence of the contact event using the representative point of the vertex, the processing load can be reduced.

  In the aspect of the invention, the color change processing unit may specify and specify a color change region on the second object based on position information of representative points of a plurality of vertices constituting the first object. The color change process may be performed on the color change region.

  In this way, the discoloration area can be identified with a smaller processing load than when the discoloration area on the second object is identified using the vertex position information.

  In the aspect of the invention, the representative point of the plurality of vertices of the first object may be a skeleton joint for motion processing of the first object.

  In this way, it is possible to realize a contact event determination process, a discoloration area specifying process, and the like by effectively utilizing the skeleton for motion processing of the first object.

  In the aspect of the invention, the color change processing unit may use the color change processing parameter value of the vertex determined to have contacted the second object during a period in which the contact event is generated as time elapses. Attenuating processing may be performed along with this.

  In this way, it is possible to realize an image representation in which the color of the color change is attenuated by attenuating the value of the color change processing parameter at the vertex of the first object during the period in which the contact event occurs. become.

  In one aspect of the present invention, an effect processing unit may be included that performs an effect process different from the color change process on an area on the second object corresponding to the contact position of the first object. The computer may function as an effect processing unit).

  In this way, in conjunction with the color change process of the second object, an effect process different from the color change process can be performed on the second object.

  In the aspect of the invention, the color change processing unit performs a process of expanding the size of the color change area on the second object on which the color change process is performed with time from the contact position, and the effect. The processing unit may perform a process of expanding the size of the effect area on the second object on which the effect process is performed from the contact position as time passes.

  In this way, it is possible to generate an image in which the discoloration area where the discoloration process of the second object is performed is gradually enlarged and the effect area where the effect process of the second object is performed is also gradually enlarged. Become.

  In the aspect of the invention, the second object may be an object representing a liquid, and the effect processing unit may perform the effect process of the ripples of the liquid as the effect process.

  In this way, when the second object is a liquid, it is possible to perform the color change process of the liquid caused by the first object coming into contact with the liquid and the effect process of the ripples generated in the liquid in conjunction with each other. become.

  In the aspect of the invention, the effect processing unit may perform an effect process representing a change in the refractive index of the liquid as the ripple effect process.

  In this way, it is possible to generate an image representing the ripples of the liquid by performing the effect processing representing the change in the refractive index of the liquid.

  Further, according to one aspect of the present invention, a texture storage unit that stores the texture for effect processing is included (the computer is caused to function as the texture storage unit), and the effect processing unit is set for a predetermined channel component of the texture for effect processing The effect processing of the second object is performed using the effect processing parameter, and the discoloration processing unit is set for another channel component different from the predetermined channel component of the effect processing texture. The discoloration process of the second object may be performed using the discoloration process parameter.

  In this way, it is possible to effectively use the texture for effect processing to realize not only the effect processing of the second object but also the color change processing of the second object, saving the storage capacity of the texture, etc. It will be able to plan.

  In the aspect of the invention, the effect processing unit may perform the effect processing of the second object using an effect processing normal information parameter set for the predetermined channel component of the effect processing texture. You may go.

  In this way, the effect processing of the second object can be realized using the effect processing normal information parameter set in the effect processing texture.

  In one aspect of the present invention, the image processing apparatus includes a texture storage unit that stores the texture for effect processing and the texture for color change processing (the computer functions as the texture storage unit), and the effect processing unit includes channel components of the texture for effect processing. The effect processing of the second object is performed using the effect processing parameter set for the color change processing unit, and the color change processing unit sets the color change processing parameter set for the channel component of the color change processing texture The discoloration process of the second object may be performed using.

  In this way, the discoloration processing of the second object can be realized using the discoloration processing texture prepared separately from the effect processing texture, so that more diverse and high-definition images can be generated. It becomes possible.

  In the aspect of the invention, the first object may be an object representing a character appearing in a game, the second object may be an object representing a liquid, and the color change processing unit may include the character of the character. The portion of the character that has been immersed in the liquid when the contact event that causes the character to be discolored and the character is immersed in the liquid is performed based on the color change processing parameter. A process for changing the color of the liquid may be performed based on the color change processing parameter.

  In this way, when the character is immersed in the liquid, an image in which the liquid changes color is generated, and an unprecedented image expression becomes possible.

  In the aspect of the invention, the color change processing unit may perform a process of attenuating the color change by the color change processing parameter for each part of the character immersed in the liquid. .

  In this way, it is possible to generate an image having an expression in which the color of the character changes when the character is immersed in the liquid and the color of the character is attenuated.

  According to another aspect of the present invention, there is provided an event determination unit that determines the occurrence of a contact event in which the first object contacts the second object, and the contact event of the first object and the second object is generated. In this case, the parameter for color change processing set for the first object is acquired, and the color change processing corresponding to the acquired parameter for color change processing is performed in accordance with the contact position of the first object. Image generation for generating an image that can be viewed from a virtual camera in an object space in which a plurality of objects including the first and second objects are arranged and set for an area on the second object. The present invention relates to a server system including an image generation data generation unit that generates image data.

1 is a configuration example of an image generation system according to the present embodiment. The structural example of the server system of this embodiment. 3A and 3B are explanatory diagrams of the color change processing method of the present embodiment. FIG. 4A to FIG. 4C are also explanatory diagrams of the color change processing method of this embodiment. 5A and 5B are examples of game images generated according to the present embodiment. FIG. 6A and FIG. 6B are also examples of game images generated by this embodiment. FIG. 7A and FIG. 7B are also examples of game images generated by this embodiment. The example of the game image produced | generated by this embodiment. FIGS. 9A and 9B are explanatory diagrams of vertex data and the like. FIG. 10A and FIG. 10B are explanatory diagrams of a method using a joint as a representative point of a vertex. FIG. 11A and FIG. 11B are explanatory diagrams such as a process for attenuating the stain color at the apex. Explanatory drawing of the motion data (skeleton information) of a character. FIGS. 13A and 13B are explanatory diagrams of a method using a ripple processing texture and a stain processing texture. Explanatory drawing of the method of expanding a ripple area | region and a dirt area | region with progress of time. 15A and 15B are explanatory diagrams of normal information parameters. FIGS. 16A to 16C are explanatory diagrams of a method for generating a refraction image and a reflection image of a water surface using normal line information parameters. The example of the water surface image produced | generated by this embodiment. The flowchart explaining the process of this embodiment. The flowchart explaining the process of this embodiment. The flowchart explaining the process of this embodiment.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Configuration FIG. 1 shows an example of a block diagram of an image generation system (game device) of the present embodiment. Note that the configuration of the image generation system of the present embodiment is not limited to that shown in FIG. 1, and various modifications may be made such as omitting some of the components (each unit) or adding other components. .

  The operation unit 160 is for a player to input operation data, and functions thereof are direction instruction keys, operation buttons, analog sticks, levers, various sensors (such as an angular velocity sensor and an acceleration sensor), a microphone, or a touch panel type. This can be realized with a display.

  The operation unit 160 includes an image sensor realized by, for example, a color image sensor or a depth sensor. Note that the function of the operation unit 160 may be realized only by the image sensor.

  The storage unit 170 serves as a work area for the processing unit 100, the communication unit 196, and the like, and its function can be realized by a RAM (DRAM, VRAM) or the like. Then, the game program and game data necessary for executing the game program are held in the storage unit 170.

  An information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and functions thereof by an optical disk (CD, DVD), HDD (hard disk drive), memory (ROM, etc.), and the like. realizable. The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, in the information storage medium 180, a program for causing a computer (an apparatus including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by an LCD, an organic EL display, a CRT, a touch panel display, an HMD (head mounted display), or the like. The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  The auxiliary storage device 194 (auxiliary memory, secondary memory) is a storage device used to supplement the capacity of the storage unit 170, and can be realized by a memory card such as an SD memory card or a multimedia card.

  The communication unit 196 communicates with the outside (for example, another image generation system, a server, or a host device) via a wired or wireless network, and functions as a communication ASIC, a communication processor, or the like. It can be realized by hardware and communication firmware.

  Note that a program (data) for causing a computer to function as each unit of the present embodiment is obtained from an information storage medium of a server (host device) via an information storage medium 180 (or storage unit 170, auxiliary storage) via a network and communication unit 196. May be distributed to the device 194). Use of an information storage medium by such a server (host device) can also be included in the scope of the present invention.

  The processing unit 100 (processor) performs game processing, image generation processing, sound generation processing, and the like based on operation data from the operation unit 160, a program, and the like. The processing unit 100 performs various processes using the storage unit 170 as a work area. The functions of the processing unit 100 can be realized by hardware such as various processors (CPU, GPU, etc.), ASIC (gate array, etc.), and programs.

  The processing unit 100 includes a game calculation unit 102, an object space setting unit 104, a moving body calculation unit 106, a virtual camera control unit 108, an event determination unit 110, a color change processing unit 112, an effect processing unit 114, an image generation unit 120, and sound generation. Part 130. Various modifications may be made such as omitting some of these components (each unit) or adding other components.

  The game calculation unit 102 performs game calculation processing. Here, as a game calculation, a process for starting a game when a game start condition is satisfied, a process for advancing the game, a process for calculating a game result, or a process for ending a game when a game end condition is satisfied and so on.

  The object space setting unit 104 performs an object space setting process in which a plurality of objects are arranged. For example, various objects (polygon, free-form surface or sub-surface) representing display objects such as characters (people, animals, robots, cars, ships, airplanes, etc.), maps (terrain), buildings, courses (roads), trees, walls, water surfaces, etc. The object is configured to place and set objects (objects composed of primitive surfaces such as division surfaces) in the object space. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects. Specifically, the object data storage unit 172 of the storage unit 170 stores object data such as the position, rotation angle, moving speed, moving direction, etc. of the object (part object) in association with the object number. . The object space setting unit 104 performs a process of updating the object data for each frame, for example.

  The moving body calculation unit 106 performs control processing for moving a moving body (moving body object) such as a character or a car. Also, control processing for operating the moving body is performed. That is, based on operation data input by the player through the operation unit 160, a program (movement / motion algorithm), various data (motion data), etc., a moving body (object, model object) is moved in the object space, Performs control processing to move the moving body (motion, animation). Specifically, a simulation process for sequentially obtaining movement information (position, rotation angle, speed, or acceleration) and motion information (part object position or rotation angle) of a moving body for each frame (1/60 second). I do. A frame is a unit of time for performing a moving / movement process (simulation process) and an image generation process of a moving object.

  For example, the moving body computing unit 106 performs motion processing (motion reproduction, motion generation) for causing a model object such as a character to perform motion (animation). This motion processing can be realized by reproducing the motion of the model object based on the motion data stored in the motion data storage unit 174.

  The virtual camera control unit 108 performs control processing of a virtual camera (viewpoint, reference virtual camera) for generating an image that can be seen from a given (arbitrary) viewpoint in the object space. Specifically, processing for controlling the position (X, Y, Z) or rotation angle (rotation angle about the X, Y, Z axis) of the virtual camera (processing for controlling the viewpoint position, the line-of-sight direction or the angle of view) I do.

  For example, when a character is photographed from behind using a virtual camera, the position (viewpoint position) and direction (gaze direction) of the virtual camera are controlled so that the virtual camera follows changes in the position or direction of the character. In this case, the virtual camera can be controlled based on information such as the position, direction, or speed of the character obtained by the moving body computing unit 106. Alternatively, the virtual camera may be controlled to rotate at a predetermined rotation angle or to move along a predetermined movement path. In this case, the virtual camera is controlled based on virtual camera data for specifying the position (movement path) or direction of the virtual camera.

  The event determination unit 110 performs a determination process of occurrence of various events during the game. The color change processing unit 112 performs processing for changing the color of an object. The effect processing unit 114 performs object effect processing. Details of the processes of the event determination unit 110, the color change processing unit 12, and the effect processing unit 114 will be described later.

  The image generation unit 120 performs drawing processing based on the results of various processing (game processing and simulation processing) performed by the processing unit 100, thereby generating an image and outputting the image to the display unit 190. Specifically, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. Based on the processing result, drawing data (the position of the vertex of the primitive surface) Coordinates, texture coordinates, color data, normal vector, α value, etc.) are created. Then, based on this drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is converted into image information in units of pixels such as a drawing buffer 179 (frame buffer, work buffer, etc. Draw in a buffer that can be stored. Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated.

  Note that the drawing processing performed by the image generation unit 120 can be realized by vertex shader processing, pixel shader processing, or the like.

  For example, in vertex processing, geometry processing such as vertex movement processing, coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, or perspective transformation is performed in accordance with a vertex processing program (vertex shader program, first shader program). Based on the processing result, the vertex data given to the vertex group constituting the object is changed (updated or adjusted). Then, rasterization (scan conversion) is performed based on the vertex data after the vertex processing, and the surface of the polygon (primitive) is associated with the pixel.

  In pixel processing, according to a pixel processing program (pixel shader program, second shader program), various processes such as texture reading from the texture storage unit 176 (texture mapping), color data setting / change, translucent composition, anti-aliasing, etc. Processing is performed to determine the final drawing color of the pixels constituting the image, and the drawing color of the perspective-transformed object is output (drawn) to the drawing buffer 179. That is, in pixel processing, per-pixel processing for setting or changing image information (color, normal, luminance, α value, etc.) in units of pixels is performed. Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated.

  The vertex processing and the pixel processing can be realized by hardware that enables a polygon (primitive) drawing process to be programmed by a shader program described in a shading language, that is, a so-called programmable shader (vertex shader or pixel shader). Programmable shaders can be programmed with vertex-level processing and pixel-level processing, so that the degree of freedom of drawing processing is high, and expressive power is greatly improved compared to conventional hardware-based fixed drawing processing. Can do.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, or sounds, and outputs the game sounds to the sound output unit 192.

  In this embodiment, the event determination unit (hit determination unit) 110 determines the occurrence of a contact event (hit event) in which the first object contacts the second object. For example, it is determined whether or not the first object hits the second object. Specifically, the event determination unit 110 generates a contact event between the first object and the second object based on a positional relationship between the representative points of a plurality of vertices constituting the first object and the second object. It is determined whether or not it has occurred. For example, when the representative point of the vertex of the first object is included in the second object, it is determined that the contact event of the first and second objects has occurred.

  Here, the first object is a model object such as a character. The second object is an object to be contacted with the first object. For example, an object representing a liquid (liquid surface) such as water (water surface), a floor, a wall (floor surface, wall surface), or the like. This is an object representing a solid object (solid surface). Alternatively, the second object may be a model object such as a character. Note that the second object may be an actually displayed object or a non-displayed object used for contact event determination. The contact in the contact event may be, for example, a contact between the surface of the first object and the surface of the second object, or a contact in which a part of the first object enters the second object. May be.

  The representative points of the plurality of vertices of the first object are, for example, skeleton joints (joint points) for motion processing of the first object. In other words, the motion data storage unit 174 stores motion data of a first object such as a character, and the motion processing of the first object is performed by performing playback processing of the motion data. In this motion processing, information on the skeleton of the first object is used, and the skeleton is composed of a plurality of bones (arcs) and joints connecting the bones, and these joints are used as representative points of the vertices. Used. However, the representative point is not limited to the skeleton joint, and for example, one of a plurality of vertices may be set as the representative point of the vertices.

  Further, the color change processing unit 112 acquires (specifies) a color change processing parameter set for the first object when a contact event between the first object and the second object occurs. Then, the color change process corresponding to the acquired color change process parameter is performed on the area (color change area) on the second object corresponding to the contact position of the first object. Specifically, the color change processing unit 112 changes the color set for a vertex determined to have contacted the second object among a plurality of vertices constituting the first object when a contact event occurs. The color change process corresponding to the processing parameter is performed on the area (color change process area) on the second object corresponding to the contact position. In addition, the color change processing unit 112 specifies a color change area on the second object based on, for example, the position information of the representative point of the vertex of the first object, and performs the color change process on the specified color change area. For example, it is determined whether or not a representative point such as a joint of the first object has contacted (included) the second object. Based on the position information), the contact position is specified and the discoloration area is set. Then, a color change process for changing the color of the second object in the set color change area is performed.

  Here, the parameter for the color change process is a parameter used for performing the color change process, and may be a color parameter (for example, RGB color data) representing the color of the color change (dirt color in a narrow sense), It may be a color change degree parameter (dirt degree parameter) representing the degree of color change (dirt degree in a narrow sense). Further, when the color change process of the second object is performed, the parameter for the color change process set in the part corresponding to the contact position among the parts of the first object is acquired. Specifically, the color change processing parameters for the first object set at the vertex determined to be in contact with the second object (the vertex of the portion corresponding to the contact position) are acquired. Then, using the acquired parameter for color change processing for the first object, color change processing (dirt processing in a narrow sense) of the second object is performed. For example, an area on the second object corresponding to the contact position is set as a color change area, and the color change processing of the second object is performed.

  Then, the image generation unit 120 generates an image that can be seen from the virtual camera in an object space in which a plurality of objects including the first and second objects are arranged and set. That is, an image (game image) on which the first and second objects subjected to the color change process are displayed is generated.

  In this way, it is possible to perform the color change process of the second object that has contacted the first object by effectively using the parameter for the color change process set for the first object. Therefore, it is possible to express an image that looks as if the second object has been discolored with the color of the first object, and an unprecedented real image can be generated.

  Further, the color change processing unit 112 performs a process of enlarging the size of the color change area on the second object on which the color change process is performed as time passes. For example, a color change process is performed so that the color change area gradually increases with time from the contact position of the first and second objects (centered on the contact position). For example, the color change processing parameter is a parameter for the color change processing of the first object. That is, it is a parameter used for the process of changing the color of the first object. Then, the color change processing unit 112 performs a process of enlarging the size of the color change area on the second object on which the color change process is performed in a period in which the contact event occurs, and a parameter for the color change process. A process of attenuating the discoloration color of the first object set by the step with time is performed. Specifically, the color change processing unit 112 performs a process of attenuating the value of the color change processing parameter of the vertex determined to have contacted the second object with the passage of time during the period in which the contact event occurs. . As a result, in the second object, the discoloration area due to the contact of the first object gradually increases with time, while the discoloration color (density and luminance) of the first object becomes Decreases gradually over time (color fades). Accordingly, when the first and second objects touch, the discolored color of the first object gradually diffuses and spreads to the second object representing, for example, a liquid or the like, and the first object due to the liquid or the like. It is possible to realize an image expression in which the discolored color is washed away.

  The effect processing unit 114 performs an effect process different from the color change process on the area on the second object corresponding to the contact position of the first object. Specifically, when the second object is an object representing a liquid (water in a narrow sense), the effect processing unit 114 performs an effect process of a liquid ripple as the effect process. That is, effect processing is performed to generate an image that appears to have ripples on the surface of the liquid. Note that the effect processing performed by the effect processing unit 114 is not limited to such ripple effect processing. For example, various effects are generated on the surface of the second object by the contact between the first object and the second object. Can be assumed. For example, the effect process may be an effect process for expressing a ground crack or a crack of a second object representing a floor or a wall.

  In addition, the color change processing unit 112 performs a process of expanding the size of the color change area on the second object on which the color change process is performed as time elapses from the contact position, while the effect processing unit 114 also performs the effect process. The size of the effect area on the second object is increased with the passage of time from the contact position. In this way, after the occurrence of the contact event, the discoloration area of the second object gradually increases with time, and the effect area (ripple area, etc.) of the second object also increases with time. Gradually grows. In other words, it becomes possible to generate an image in which the discoloration area and the effect area are enlarged in association with each other, thereby enabling more realistic and diverse image expression.

  Further, the effect processing unit 114 performs effect processing representing a change in the refractive index of the liquid as ripple effect processing. For example, an effect process is performed to generate a refraction image in which an image of an object that is visible inside or inside the liquid appears to be distorted due to a change in the refractive index of the liquid. Alternatively, as the ripple effect process, an effect process representing a change in the reflectance of the liquid surface may be performed. For example, effect processing is performed to generate a reflection image in which an image of an object reflected on the surface of the liquid looks distorted due to a change in the reflectance of the surface of the liquid.

  The texture storage unit 176 stores, for example, a texture for effect processing (for example, ripple processing) as a texture used for texture mapping.

  Then, the effect processing unit 114 uses the effect processing parameters set for the predetermined channel components (for example, the first and second color components) of the effect processing texture to perform the effect processing (ripple processing) of the second object. Etc.). On the other hand, the color change processing unit 112 uses the color change processing parameter set for another channel component (for example, the third color component) different from the predetermined channel component of the effect processing texture, and uses the color change processing parameter. Perform discoloration processing.

  Specifically, the effect processing unit 114 sets the effect processing normal information parameters (first and second normal lines) set for predetermined channel components (first and second color components) of the texture for effect processing. The effect processing of the second object is performed using the coordinate component. On the other hand, the color change processing unit 112 uses the color change processing parameter (monochromatic color data) set for the other channel component (third color component) of the texture for effect processing to change the color of the second object. Process.

  In this way, it is possible to execute both the effect processing of the second object and the color change processing of the second object by effectively utilizing the effect processing texture.

  The texture storage unit 176 may store the effect processing texture and the discoloration processing texture separately. In this case, the effect processing unit 114 uses the effect processing parameter (for example, the normal line information parameter) set for the channel component of the effect processing texture in the texture storage unit 176 to perform the effect processing of the second object. I do. On the other hand, the color change processing unit 112 uses the color change processing parameters (for example, RGB color data) set for the channel components (for example, the first to third color components) of the color change processing texture, Perform object discoloration processing.

  In this way, while performing effect processing using the texture for effect processing, it is possible to realize discoloration processing for a non-monochromatic color using the texture for discoloration processing, so that a higher quality image can be generated. Become.

  Further, when the first object is an object representing a character appearing in the game and the second object is an object representing a liquid, the discoloration processing unit 112 is based on the character discoloration processing parameter, Processing to change the surface of the character is performed. For example, a process for changing the character's clothes and skin due to dirt is performed. Then, when a contact event in which the character is immersed in the liquid (an event in which the character is immersed in water) occurs, the color-changing processing unit 112 is based on the parameter for color-changing processing of the portion (vertex) immersed in the liquid among the respective portions of the character. A process for changing the color of the liquid is performed.

  In this way, the dirt adhering to the character flows into the liquid, which makes it possible to generate an image that looks like the liquid is dirty and discolored, enabling a realistic image expression unprecedented.

  In this case, the color change processing unit 112 performs a process of attenuating the color (density and luminance) of the color change by the color change processing parameter for each part of the character that has been immersed in the liquid. In this way, the dirt attached to the character flows into the liquid, so that the character's dirt gradually disappears, and it becomes possible to generate an image that looks like the character's clothes and skin dirt are washed away by the liquid. In addition, more realistic image expression becomes possible.

  Note that the method of this embodiment may be realized by a server system. FIG. 2 shows a configuration example in the case of being realized by a server system.

  Server system 500 is communicatively connected to terminal apparatuses TM1 to TMn via network 510. For example, the server system 500 is a host, and the terminal devices TM1 to TMn are clients. The server system 500 can be realized by, for example, one or a plurality of servers (authentication server, game server, communication server, billing server, etc.). The network 510 (distribution network, communication line) is a communication path using, for example, the Internet or a wireless LAN. In addition to a LAN using a dedicated line (dedicated cable) or Ethernet (registered trademark) for direct connection, telephone communication A communication network such as a network, a cable network, or a wireless LAN can be included. The communication method may be wired / wireless.

  The terminal devices TM1 to TMn are realized by, for example, a stationary home game device, a portable game device, an arcade game device, or the like. A stationary home game device is a game device that is assumed to be installed and used at home, and an arcade game device is a game device that is assumed to be installed and used in a game facility or the like. is there. The portable game device may be a dedicated game device or a general-purpose device capable of executing a game program such as a mobile phone or a portable information terminal.

  The server system 500 includes a processing unit 600, a storage unit 670, an information storage medium 680, and a communication unit 696. The processing unit 600 includes a game calculation unit 602, an object space setting unit 604, a moving object calculation unit 606, a virtual camera control unit 608, an event determination unit 610, a color change processing unit 612, an effect processing unit 614, and an image generation data generation unit 620. The sound generation data generation unit 630 is included. The functions, operations, etc. of these units (blocks) are the same as those of the units (blocks) in FIG.

  For example, the event determination unit 610 of the server system 500 determines the occurrence of a contact event in which the first object contacts the second object. The color change processing unit 612 acquires a color change processing parameter set for the first object when a contact event between the first object and the second object occurs. Then, the color change process corresponding to the acquired color change process parameter is performed on the area on the second object corresponding to the contact position of the first object. In addition, the color change processing unit 612 also performs processing for enlarging the size of the color change area on the second object on which the color change processing is performed, with the passage of time from the contact position. The effect processing unit 614 performs effect processing different from the color change processing on the area on the second object corresponding to the contact position of the first object. Then, the image generation data generation unit 620 generates image generation data for generating an image that can be viewed from the virtual camera in an object space in which a plurality of objects including the first and second objects are arranged and set.

  Note that the image generation data for generating the image is data for displaying the image generated by the method of the present embodiment on each of the terminal devices TM1 to TMn, and may be the image data itself. In addition, various data (object data, control result data, determination result data, display screen setting data, etc.) used by each terminal device to generate an image may be used. For example, the server system 500 acquires operation information from the operation unit of each terminal device, performs various control processes and various determination processes, generates images, and distributes them to the terminal devices TM1 to TMn (stream distribution) Etc.), the image generation data described above is the image data itself. On the other hand, the server system 500 acquires operation information from the operation unit of each terminal device, performs various control processes and various determination processes, and the terminal devices TM1 to TMn are based on the control results and determination results. When an image is generated, the above-described image generation data is control result data, determination result data, object data, or the like. The same applies to the sound generation data generated by the sound generation data generation unit 630.

  The game calculation unit 602, the object space setting unit 604, the moving body calculation unit 606, the virtual camera control unit 608, the event determination unit 610, the color change processing unit 612, the effect processing unit 614, the image generation data generation unit 620, and sound generation Detailed functions and operations of the data generation unit 630, the storage unit 670, the information storage medium 680, the communication unit 696, and the like are the same as those described above with reference to FIG.

2. Next, the method of this embodiment will be described in detail.

2.1 Color Change Processing First, an outline of the color change processing (dirt processing) of this embodiment will be described. In FIG. 3A, a color change processing parameter is set for the first object OB1, and an image in which the surface of the first object OB1 is changed by the color change processing parameter is generated. As the color change processing parameter, for example, a color parameter (RGB data) representing the color of the color change, a color change degree parameter representing the degree of color change, and the like can be assumed. The color change processing parameter is, for example, vertex data of the first object OB1. Is set.

  In FIG. 3B, a contact event between the first object OB1 and the second object OB2 occurs. The occurrence of this contact event can be determined based on, for example, the positional relationship between the vertex of the first object OB1 or the representative point of the vertex and the second object OB2. For example, when it is determined that the vertex or representative point of the first object OB1 is included in the second object OB2, it can be determined that the first object OB1 has contacted the second object OB2. .

  In this embodiment, when such a contact event occurs, the color change processing parameters set for the first object OB1 are acquired. For example, a parameter for color change processing set for the vertex of the first object OB1 is acquired. Then, a color change process corresponding to the acquired color change process parameter is performed on the second object OB2. For example, as shown in FIG. 3B, a color change process is performed on an area (color change area) on the second object OB2 corresponding to the contact position of the first object OB1.

  As a result, it is possible to generate an image in which the second object OB2 changes color and becomes dirty. That is, the discoloration state of the first object OB1 is transmitted to the second object OB2, and an image in which the second object OB2 is discolored can be generated.

  In this embodiment, as shown in FIGS. 4A and 4B, the size of the color change area on the second object OB2 on which the color change process is performed gradually increases with time. For example, the discoloration region gradually expands so as to spread around the contact position of the first and second objects OB1 and OB2 in FIG.

  In the period in which the contact event occurs in this way, the size of the color change area on the second object OB2 on which the color change process is performed gradually increases with time, and the color change processing parameter The discolored color of the set first object OB1 gradually attenuates with time.

  Thus, for example, as shown in FIG. 4C, when the contact event ends and the first object OB1 moves away from the second object OB2, the color of the color change in the color change region of the first object OB1 is changed. An image that is attenuated and thinned is generated.

  For example, it is assumed that the first object OB1 is an object representing a character appearing in the game, and the second object OB2 is an object representing a liquid.

  In this case, in the present embodiment, as shown in FIG. 3A, the character surface is discolored and stained based on the discoloration processing parameters of the character (OB1).

  Next, as shown in FIG. 3B, when a contact event occurs in which the character (OB1) is immersed in the liquid (OB2), a color change processing parameter for a portion of the character (OB1) that is immersed in the liquid. Based on the above, a process for changing the color of the liquid (OB2) is performed. As a result, the dirt of the character is transmitted to the liquid, and an image in which the liquid is discolored and dirty is generated.

  As shown in FIGS. 4A and 4B, the liquid discoloration region due to the dirt of the character gradually expands. That is, the discoloration due to the dirt of the character is transmitted to the liquid, and the discoloration area gradually spreads on the liquid side.

  At this time, among the portions of the character that are immersed in the liquid, the color of the discoloration due to the discoloration processing parameter gradually attenuates. Therefore, as shown in FIG. 4C, when the contact event ends and the character leaves the liquid, the discoloration of the character's dirt is attenuated, and it appears as if the character's dirt has been washed away by the liquid. Image representation can be realized.

  In the following, as described above, the first object is an object representing a character, the second object is an object representing water (liquid), and an image in which the dirt of the character falls into the water and the water becomes dirty. A case where the method of the present embodiment is applied to the expression will be mainly described as an example. However, the first and second objects and the color change processing of the present embodiment are not limited to this, and various modifications can be made. For example, the method of this embodiment may be applied to a color change process in which dirt (for example, blood glue) of a character (first object) adheres to a wall or a floor (second object).

  FIG. 5A to FIG. 8 show examples of game images generated by the method of this embodiment.

  In FIG. 5A, a contact event occurs in which the character OBC (first object in a broad sense) is immersed in water OBW (second object in a broad sense). At this time, for example, the character OBC has been subjected to stain processing (discoloration processing) on its surface by a color change processing parameter (dirt processing parameter) set at the vertex, and as shown in A1, the character OBC OBC clothes and skin stains are expressed.

  In FIG. 5B, the character OBC that has been immersed in the water surface is bending the knee, and dirt adhering to the legs of the character OBC flows as shown in A2, and an image in which the water OBW changes color due to the dirt is generated. .

  In A3 in FIG. 6A, A4 in FIG. 6B, and A5 in FIG. 7A, the discolored region of the water OBW due to dirt gradually spreads over time. At this time, for example, A6 in FIG. 6B represents a state in which dirt attached to the legs of the character OBC is washed away by the water OBW.

  In FIG. 7B, the character OBC that has been immersed in the water OBW stands up. At this time, as shown in A7, the dirt attached to the back of the character OBC is also washed away by the water OBW.

  In FIG. 8, the character OBC is completely up. 8A and 8B, the dirt attached to the character OBC in FIG. 5A is completely washed away by the water OBW, and the dirt is removed. The state of being is expressed.

  As described above, according to the method of the present embodiment, not only the color change caused by the dirt on the surface of the character or the like as the first object can be expressed, but also the dirt flows to the water or the like as the second object. You can express how you are going. That is, it is possible to express how the dirt attached to the character is washed away by water and the water gets dirty by effectively utilizing the parameters for color change processing used for the color change processing of the character. Furthermore, it is possible to express a state in which the dirt area transmitted to the water gradually spreads with time and is washed away with water so that the dirt of the character gradually decreases with time. Therefore, it is possible to realize a realistic video expression that could not be expressed by the conventional dirt processing, and to further improve the virtual reality of the player.

2.2 Details of Color Change Processing Next, a detailed example of color change processing (dirt processing) according to the present embodiment will be described. The color change processing method of the present embodiment is not limited to the method described below, and various modifications can be made.

  FIG. 9A shows an example of vertex data set at the vertex of a character (first object in a broad sense). This vertex data is stored in the vertex data storage unit 178 of FIG. In the vertex data of FIG. 9A, for each vertex (V1, V2, V3...), The position of the vertex, the stain color (color of discoloration in a broad sense), and the degree of stain (degree of discoloration in a broad sense). ) Are associated and stored.

  Here, the stain color parameter is data representing the stain color (RGB). The stain degree parameter is a parameter representing the degree of stain (the degree of discoloration). For example, in the case where a stain having a different color is expressed in each part of the character, a stain color parameter is used as a stain processing parameter (color change processing parameter in a broad sense). On the other hand, for dirt that becomes the same single color in each part of the character, a dirt degree parameter is used as a dirt processing parameter.

  For example, when performing an image expression that stains the clothes and skin of the character due to the poison sprayed from the opponent character (color change source), the stain color varies depending on the type of poison (type of color change source). A stain color parameter is used as a stain processing parameter. Specifically, among the vertices constituting the character object, the color corresponding to the poison type is set as the stain color parameter for the vertex of the portion sprayed with poison. By doing so, it is possible to realize an image expression in which the portion sprayed with poison by the opponent character is discolored due to the color of the poison.

  Further, for example, when a battle is performed on a game stage on the sand ground, the color of the sand dust is set as a single stain color and is associated with the game stage. Then, the density (intensity) of the dust dust color is changed according to the size of the dirt degree parameter set at the vertex constituting the character. For example, the dirt level parameter is set to a large value for the apex of the foot portion of the character close to the sand ground. In this way, when the character stands on the ground of the game stage, it is possible to realize a dirty expression that looks as if the dust on the ground has adhered to the feet of the character. If it is determined that the part of the character's hand or the like has approached the ground, the stain degree parameter is set to a large value for the vertex of the part of the hand or the like. In this way, when the part of the character's hand or the like approaches the ground, it is possible to realize a stain expression that looks as if the dust on the ground has adhered to the part.

  FIG. 9B is a diagram for explaining a method for generating a stain image using a stain processing parameter such as a stain color parameter and a stain degree parameter set in the vertex data.

  For example, when the stain color parameter of FIG. 9A is set for the vertices V1 to V4 of FIG. 9B, the stain color (in a broad sense, represented by the stain color parameters of the vertices V1 to V4). By interpolating (rasterizing) the discolored color), the stain color of each pixel PX is obtained. If the dirt level parameter shown in FIG. 9A is set for the vertices V1 to V4, the dirt degree parameter and a set color (for example, dust color) set in association with the game stage or the like. Based on the above, the stain color of each vertex V1 to V4 is obtained. Then, the stain color of each pixel PX is obtained by interpolating the stain colors of the vertices V1 to V4.

  Then, the stain color obtained by interpolation of the stain color of the vertex and the color of the character's original picture texture (texture representing clothes or skin color / pattern) are synthesized in units of pixels (for example, α blending). By doing so, the final color of each pixel is obtained. By doing so, it is possible to generate an image in which the clothes and colors of the character are stained. Note that processing in units of vertices using vertex data and the like can be realized by a vertex shader, and processing in units of pixels can be realized by a pixel shader.

  Further, in the present embodiment, the image representation in which the dirt of the character is dropped and spreads on the water surface as shown in FIGS. 5A to 8 is set as the vertex data of the character as shown in FIG. 9A. This is realized by effectively using the processing parameters (dirt color parameter, stain degree parameter, etc.).

  That is, when a contact event in which the character is immersed in water occurs, a dirt processing parameter set for a vertex determined to be immersed in water (contacted with water) among a plurality of vertices constituting the character. The soiling process corresponding to is performed on the area on the water surface corresponding to the contact position of the character and the water. That is, the dirt processing parameters shown in FIG. 9A are acquired from the apex determined to have been immersed in water, and the dirt processing is performed on the water surface to spread and spread.

  In this way, as shown by A1 in FIG. 5A, the dirt processing parameters used for the character dirt processing are effectively used to perform the dirt processing in which the character dirt is removed and the water surface is spread. Can also be realized.

  For example, as shown in FIG. 10A, in the present embodiment, based on the positional relationship between joints J1, J2, and J3 that are representative points of a plurality of vertices constituting the character OBC and water (water surface) OBW, It is determined whether or not a contact event in which the character OBC is immersed in the water OBW has occurred. That is, when there are joints (J1, J2) located below the water surface, it is determined that the character is immersed in water.

  In the present embodiment, based on the position information of the joints of the character (the representative point of the vertex in a broad sense), a dirt area (discoloration area) on the water surface is specified, and a dirt process (discoloration process) is performed on the specified dirt area. )I do. For example, in FIG. 10A, since the joints J1 and J2 are soaked in water, a dirt process for generating dirt from the positions of the joints J1 and J2 is performed.

  FIG. 10B shows an example of joint data set for a character's joint. In the joint data of FIG. 10B, the position of the joint and the dirt processing flag (FL1, FL2, FL3...) Are associated with each joint (J1, J2, J3...) Of the character. ing. Here, the stain processing flag is a flag that is set to ON (for example, “1”) when performing the stain processing.

  For example, in FIG. 11A, the joint J1 is a representative point of the vertices V1 to V8. For example, the joint closest in distance to the vertices V1 to V8 is J1. When it is determined that the vertex V1 is located below the water surface, the vertex V1 notifies the joint J1 closest to the vertex V1 that it is immersed in water. As a result, the stain processing flag FL1 of the joint J1 in FIG. 10B is turned on, and the stain processing for generating the stain from the position of the joint J1 is started. That is, based on the position of the joint J1 (XJ1, YJ1, ZJ1), the position where dirt is generated on the water surface is specified, and from the specified position, as shown in FIGS. 5 (A) to 7 (B). Dirt processing that expresses how the dirt gradually spreads is executed. Specifically, as will be described later, the position of occurrence of dirt on the texture (the ripple processing texture and the dirt processing texture) used for the dirt processing is specified from the position of the joint J1. Then, by performing a texture rewriting process (dirt processing parameter rewriting process) representing a state where the dirt gradually spreads from the specified dirt occurrence position, the dirt process is realized.

  In this case, as shown in FIG. 11B, a process of gradually attenuating the stain color (density and luminance) of the vertex V1 determined to have been immersed in water is performed. In other words, during the period in which the contact event occurs, processing is performed to attenuate the dirt processing parameter value at the vertex of the character determined to have contacted with water as time passes. For example, in FIG. 11B, RGB data of (R1, G1, B1) is set as the dirt color parameter of the vertex V1 of the character. When it is determined that the vertex V1 is immersed in water, the values of R1, G1, and B1, which are the RGB data of the dirt color parameter, gradually decrease from that point in time as shown in FIG. And then decays.

  In this way, when the character is immersed in water, it is possible to realize a video expression in which the dirt in the part soaked in water flows down and becomes beautiful, which was not possible with conventional dirt processing. An image can be generated.

  FIG. 12 shows an example of motion data that is skeleton information of a model object MOB representing a character or the like. As shown in FIG. 12, the model object MOB includes a plurality of part objects PB0 to PB15. The positions and rotation angles (directions) of these part objects (parts) are the positions of the bones B0 to B19 (the positions of the joints J0 to J15) and the rotation angles (the positions relative to the parent bones) constituting the skeleton model of the model object MOB. Relative rotation angle of the child's bone). Note that these bones and joints are virtual and are not actually displayed objects.

  The bones (motion bones, joints, part objects) constituting the skeleton of the model object MOB have a parent-child (hierarchical) structure. For example, the parents of the hand bones B7 and B11 become the forearm bones B6 and B10, the parents of B6 and B10 become the upper arm bones B5 and B9, and the parents of B5 and B9 become the shoulder bones B4 and B8. The same applies to the legs, shins, thighs, hips, chest, and head bones.

  The motion data storage unit 174 in FIG. 1 stores the positions and rotation angles of these bones (part objects, joints) as motion data. Only the rotation angle of the bone may be included in the motion data, and the position of the bone (arc) (the position of the joint) may be included in the model data of the model object.

  For example, it is assumed that the walking motion is composed of reference motions (motions in each frame) M0, M1, M2,. Then, the position or rotation angle of each bone in each of these reference motions M0, M1, M2,... MN is stored in advance as motion data. Then, for example, the position and rotation angle of each bone (each part object) of the reference motion M0 are read, and then the position and rotation angle of each bone of the reference motion M1 are read. By sequentially reading the data, motion processing (motion reproduction) is realized.

  The motion data stored in the motion data storage unit 174 is generally obtained by motion capture or created by a designer. The motion data is represented by the position of the parent bone, the relative position of the child bone with respect to the rotation angle, and the relative rotation angle (rotation angle around three axes). Specifically, rotation angles (relative rotation angles) around the X axis, Y axis, and Z axis of the child bone with respect to the parent bone are stored as motion data. The relative position (relative distance) of the child bone relative to the parent bone may be included in the model data of the model object (character), for example.

  In this embodiment, a skeleton joint for character motion processing as shown in FIG. 12 is adopted as a representative point of a plurality of vertices of the character (first object). By doing so, it is possible to effectively use the skeleton joint of the motion data to realize a contact determination process, a water surface contamination process, and the like, and the process can be made more efficient.

  For example, if dirt processing is performed with all the vertices of a character set as dirt generation points, the processing load of the dirt processing may increase.

  In this respect, if the joint that is the representative point of the vertex instead of the vertex is set as the stain occurrence point and the stain processing is performed, the number of joints is much smaller than the number of the vertex, so the processing load of the stain processing is reduced. It is possible to reduce the processing efficiency.

2.3 Dirt Processing and Ripple Processing Next, specific examples of the water surface smear processing and the ripple processing according to the present embodiment will be described in detail with reference to FIGS.

  In this embodiment, an effect process different from the dirt process (discoloration process) is performed on the area on the water surface corresponding to the contact position of the character. Specifically, effect processing for expressing ripples on the water surface (liquid) is performed as effect processing. For example, in FIG. 6A, when the character is immersed in water, dirt spreads around the position immersed in water (contact position) as shown in A3, and ripples (water) generated when the character enters the water. (Wave) is also expanded. Specifically, from the position where the character is immersed in water, the size of the dirty area gradually spreads over time, and the ripple effect area size also gradually spreads over time. Do. In this way, when the character is immersed in water, an image in which both dirt and ripples spread from the portion immersed in water can be generated, and a more realistic image can be generated.

  Specifically, in the present embodiment, a ripple processing texture (effect processing texture in a broad sense) as shown in FIG. 13A is prepared and stored in the texture storage unit 176 in FIG. In the ripple processing texture, parameters for effect processing of water (second object) are set for the R component and B component (predetermined channel component in a broad sense), for example. Specifically, a water ripple processing normal information parameter (effect processing normal information parameter) is set for the R component and B component of the ripple processing texture, and using this ripple processing normal information parameter, Ripple effect processing is performed.

  On the other hand, as shown in FIG. 13A, in the ripple processing texture, for example, for the G component (in a broad sense, another channel component different from the predetermined channel component), a water stain processing parameter (discoloration processing) is used. Parameter) is set. Then, using this stain processing parameter, water stain processing (discoloration processing) is performed. For example, for a dark stain, the stain processing parameter set for the G component is set to a large value, and for a light stain, the stain processing parameter set for the G component is set to a small value. It expresses with.

  In this way, it is possible to effectively use the ripple processing texture for expressing the ripples of the water, and to realize the water stain processing, thereby saving the storage capacity of the texture.

  As shown in FIG. 13B, both a ripple processing texture (effect processing texture) and a stain processing texture (discoloration processing texture) are prepared and stored in the texture storage unit 176. Good.

  In this case, the water ripple processing parameter (effect processing parameter) is set for the channel component of the ripple processing texture (effect processing texture) (for example, at least two channel components of R, G, and B components). Set. Specifically, a normal line information parameter for ripple processing is set, and water ripple processing (effect processing) is performed.

  On the other hand, as shown in FIG. 13B, for the channel components (for example, R, G, B components) of the stain processing texture (color change processing texture), the water stain processing parameters (color change processing parameters). Set. Specifically, a water stain color parameter is set, and water stain processing (discoloration processing) is performed.

  For example, the technique shown in FIG. 13A has a disadvantage that although only one color component can be used as a stain color, only a single color stain can be expressed, although the use storage capacity of the texture can be saved. For example, in A3 of FIG. 6A, only a smear image in which the entire surface is a single color such as black or red can be generated.

  On the other hand, in the method of FIG. 13B, although a stain processing texture is separately required, a plurality of color components can be used as the stain color, so that stains other than a single color can be expressed. For example, at A3 in FIG. 6A, it is possible to generate a smear image having a different color at each location on the water surface. Therefore, various dirt images can be generated, and various image expressions can be realized.

  If the ripple processing texture and the stain processing texture as shown in FIGS. 13A and 13B are used, the ripple and stain animation processing as shown in FIG. 14 can be realized. That is, in FIG. 14, the size of the effect area on which the ripple processing is performed gradually increases with the passage of time from the contact position of the character shown in B <b> 1 (the position where the character's feet or the like are immersed in water). ing. In addition, the size of the area where the smearing process is performed gradually increases with the passage of time from the contact position of the character and water shown in B2. This can be realized by performing texture animation processing that rewrites the texel values of the ripple processing texture and the stain processing texture as time passes as shown in FIGS. 13 (A) and 13 (B). That is, for the ripples, an image in which the ripples gradually spread can be generated by performing a texel value rewriting process so that the ripples spread concentrically from the position B1 in FIG. As for the stain color, an image in which the stain gradually spreads can be generated by performing a texel value rewriting process in which the stain spreads around the position B2 in FIG.

  Here, the occurrence positions of ripples and stains shown in B1 and B2 of FIG. 14 are specified based on the position information of the joints (representative points of vertices in a broad sense) described in FIGS. 10A and 10B. . For example, when the foot of the character is immersed in water, the generation position on the texture of ripples and dirt shown in B1 and B2 of FIG. 14 is specified by the position of the joint of the foot. Then, an animation process is performed on the texture in which ripples and dirt spread around the specified occurrence position. In this way, it is possible to perform processing in which ripples and dirt spread from a position corresponding to the joint of the character's foot immersed in water. Therefore, as the character's feet are immersed in water, the ripples spread around and the image of the character's feet, etc. flowing out of the water and spreading around it becomes possible, making it more realistic and virtual reality. A high image can be generated.

  In the above description, the case where the stain color parameter is used as the stain treatment on the water surface has been mainly described, but the present embodiment is not limited to this. For example, by acquiring a contamination level parameter at each pixel by a pixel shader on the water surface, and changing the transparency (α value) of the water surface or changing the color of the water surface based on the acquired contamination level parameter, A dirt treatment may be realized.

  FIGS. 15A and 15B show examples of normal information parameters set in the R component and the B component of the ripple processing texture of FIG. 13A. In FIG. 15A and FIG. 15B, the numerical range of each component of the R component and the B component is 0.0 to 1.0, and the R component is the X component of the normal line (normal vector). And the B component corresponds to the normal Z component. The X component (R component) and the Z component (B component) of the normal line N1 in FIG. 15A are (0.5, 0.5). In this case, the normal line N1 is the same as that in FIG. It becomes an upward normal. Further, the X component and the Z component of the normal line N2 are (1.0, 0.5). In this case, the normal line N2 is a normal line facing right in FIG. Further, the X component and the Z component of the normal line N3 are (0.0, 0.5). In this case, the normal line N3 is a leftward normal line in FIG. The same applies to the normal lines N4 and N5 in FIG.

  In the present embodiment, ripple effect processing is realized by performing effect processing that represents a change in the refractive index of water (liquid) using such normal information parameters.

  For example, in FIG. 16A, the foot of the character OBC is immersed in the water OBW. In this case, the positions indicated by C1 and C2 in FIG. 16A are specified from the positions of the joints of the legs of the character OBC, and an image in which ripples and dirt spread is generated from these C1 and C2.

  Specifically, an image as shown in FIG. 16B is generated as an image obtained by viewing the scene of FIG. 16A from the viewpoint of the virtual camera (the viewpoint of the player). Then, the generated image of FIG. 16B is subjected to image processing that distorts the image using the normal line information parameter of the ripple processing texture described with reference to FIGS. A refraction image that looks as if the refractive index of (liquid) has changed is generated.

  For example, the image shown in FIG. 16B is used as the texture of the refraction image, and is mapped to an object representing the water surface (an object composed of one or a plurality of polygons). At that time, the texture coordinates (U, V coordinates), which are the reference positions of the texture of the refraction image, are changed using the normal line information parameter of the ripple processing texture described with reference to FIGS. 15 (A) and 15 (B). By doing so, an image that looks as if the refractive index of water (liquid) has changed is generated.

  For example, FIG. 17 shows an example of an image generated by effect processing for changing the refractive index of water. In D1 and D2 of FIG. 17, the texture reference position varies depending on the normal information parameter, so that an image can be generated in which the feet below the water surface appear to be distorted by a change in the refractive index of water due to ripples. become.

  FIG. 16C is an image obtained by inverting the image of FIG. 16B and the like up and down with reference to the water surface line. Then, by performing image processing that distorts the image of FIG. 16C using the normal information parameter of the ripple processing texture, a reflection image that looks as if the reflectance of water (liquid) has changed is generated. To do.

  For example, the image of FIG. 16C is used as the texture of the reflected image and mapped to an object representing the water surface. At that time, it is as if the reflectance of water has changed by changing the texture coordinates (U, V coordinates) which are the reference positions of the texture of the reflected image using the normal information parameter of the ripple processing texture. Generate an image that looks like In this way, a reflected image that appears on the water surface (for example, an image in which a portion of the character that has not been immersed in water is reflected on the water surface) is generated as if it is distorted due to a change in the reflectance of water due to ripples. become able to.

  As described above, according to the present embodiment, when the feet of the character are soaked in water, dirt on the feet spreads on the water surface, and ripples caused by soaking the feet spread on the water surface. It becomes possible to generate a simple image. Therefore, it is possible to realize an image expression that could not be realized by the conventional stain processing, and it is possible to generate an image with high quality and high virtual reality.

2.4 Detailed Processing Example Next, a detailed processing example of the present embodiment will be described with reference to the flowcharts of FIGS. FIG. 18 is a flowchart of the joint processing described in FIGS. 10A and 10B.

  First, it is determined whether or not all the joints of the character have been processed (step S1). If all the joints have been processed, the joint processing is terminated. On the other hand, when all the joints are not processed, an unprocessed joint is selected (step S2). Then, the stain processing flag of the selected joint is cleared (for example, “0”) (step S3). This dirt processing flag is the flag described with reference to FIG. 10B, and is a flag that is turned on (for example, “1”) in step S15 of FIG. 19 described later. Then, as described with reference to FIG. 10A, it is determined whether or not the position of the selected joint is immersed in water (step S4). And when it is immersed in water, the selected joint is registered as a stain | pollution | contamination process target joint (step S5). That is, it is registered and stored in the storage unit 170 of FIG.

  FIG. 19 is a flowchart of the vertex processing described in FIGS. 9A, 9B, 11A, 11B, and the like.

  First, it is determined whether or not all vertices of the character have been processed (step S11). If all vertices have been processed, the vertex processing is terminated. On the other hand, if not all vertices are processed, unprocessed vertices are selected (step S12). Then, a stain color parameter that is a parameter for color change processing of the selected vertex is acquired (step S13). That is, the stain color parameter set as vertex data in FIG. 9A is acquired.

  Next, it is determined whether or not the selected vertex is discolored due to dirt based on the obtained dirt color parameter (step S14). For example, when at least one of the R, G, and B components of the stain color parameter is greater than 0 (when greater than a predetermined threshold), the vertex is discolored due to stain. To be judged. If it is determined that the color is changed due to dirt, the dirt processing target joint (joint registered in step S5 in FIG. 18) closest to the selected vertex is searched, and the dirt processing flag is turned on. (Step S15).

  For example, in FIG. 11A, suppose that it is determined that the vertex V1 has been changed in color by the stain based on the stain color parameter of the vertex V1. Assume that the joint J1 is registered as a stain processing target joint. In this case, J1 which is the joint closest to the vertex V1 is searched, and the stain processing flag (see FIG. 10B) of the joint J1 is set to ON (eg, “1”). This stain processing flag is cleared, for example, as shown in step S3 of FIG. When it is determined that the joint is registered as a stain processing target joint and the apex near the joint is discolored due to the stain, the stain processing flag of the joint is turned on as shown in step S5 of FIG. As a result, a stain process for producing stain from the joint is performed.

  Next, as described with reference to FIG. 11B, processing for attenuating the stain color of the stain color parameter of the selected vertex is performed (step S16). For example, processing for attenuating the R, G, and B components of the stain color parameter by a certain value is performed. As a result, it is possible to generate an image that looks as if the character is dirty and flows into the water.

  FIG. 20 is a flowchart illustrating a detailed example of ripple processing and stain processing using a ripple processing texture.

  First, it is determined whether or not it is a frame update (step S21). If it is determined that the frame update timing is reached, as described with reference to FIGS. 13A to 14, animation processing is performed on the normal information parameters that are the R and B components of the ripple processing texture. Then, a process for enlarging the ripple area is performed (step S22). Also, the process of enlarging the dirt region is performed by performing the animation process of the dirt color parameter which is the G component of the ripple processing texture (step S23).

  Next, as described with reference to FIGS. 16A to 17, a refraction image and a reflection image of the water surface are generated based on the normal information parameter subjected to the animation process in step S22 (step S24). Further, based on the stain color parameter subjected to the animation process in step S23, a stain image of the water surface is generated (step S25). Then, the generated refraction image, reflection image, and dirt image of the water surface are mapped to the water surface object (step S26). For example, image synthesis is performed in which these refraction images, reflection images, and dirt images are α-blended at a given α value. By doing so, it is possible to generate an image of the water surface in which ripples and dirt spread from the portion of the character immersed in water.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, in the specification or the drawings, terms (dirt processing, ripple processing, character, character) described together with different terms (discoloration processing, effect processing, first object, second object, etc.) that are broader or synonymous at least once. Water, etc.) may be replaced with the different terms anywhere in the specification or drawings. Further, the contact event determination process of the first and second objects, the object color change process, the object effect process, and the like are not limited to those described in this embodiment, and techniques equivalent to these are also within the scope of the present invention. included. The present invention can be applied to various games. Further, the present invention is applied to various image generation systems such as a business game system, a home game system, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, a system board for generating a game image, and a mobile phone. it can.

OB1 first object, OB2 second object, OBC character,
OBW water, J1-J3 joint, V1-V8 apex,
100 processing unit, 102 game calculation unit, 104 object space setting unit,
106 moving body calculation unit, 108 virtual camera control unit, 110 event determination unit,
112 color change processing unit, 114 effect processing unit,
120 image generation unit, 130 sound generation unit, 160 operation unit,
170 storage unit, 172 object data storage unit,
174 motion data storage unit, 176 texture storage unit,
178 vertex data storage unit, 179 drawing buffer,
180 information storage medium, 190 display unit, 192 sound output unit, 194 auxiliary storage device,
196 Communication Department,
500 server system, 510 network, TM1-TMn terminal device,
600 processing unit, 602 game calculation unit, 604 object space setting unit,
606 moving body calculation unit, 608 virtual camera control unit, 610 event determination unit,
612 color change processing unit, 614 effect processing unit,
620 Image generation data generation unit, 630 Sound generation data generation unit

Claims (20)

An event determination unit that determines the occurrence of a contact event in which the first object contacts the second object;
When the contact event of the first object and the second object occurs, the color change processing parameter set for the first object is acquired, and the color change processing parameter is obtained according to the acquired color change processing parameter A color change processing unit that performs the color change processing on a region on the second object corresponding to the contact position of the first object;
In an object space where a plurality of objects including the first and second objects are arranged and set, as an image generation unit that generates an image seen from a virtual camera,
A program characterized by causing a computer to function. In claim 1,
The color change processing unit
The program which performs the process which expands the magnitude | size of the color-change area | region on the said 2nd object in which the said color-change process is performed with progress of time from the said contact position. In claim 2,
The discoloration processing parameter is a discoloration processing parameter for the first object,
The color change processing unit
In the period in which the touch event occurs, the size of the color change area on the second object on which the color change process is performed is enlarged with time, and set by the parameter for the color change process A program for performing a process of attenuating the discolored color of the first object as time passes. In any one of Claims 1 thru | or 3,
The color change processing unit
When the contact event occurs, according to the discoloration processing parameter set for the vertex determined to have contacted the second object among the plurality of vertices constituting the first object A program for performing a color change process on an area on the second object corresponding to the contact position. In claim 4,
The event determination unit
Whether or not the contact event of the first object and the second object has occurred based on the positional relationship between the representative points of a plurality of vertices constituting the first object and the second object. A program characterized by judging. In claim 4 or 5,
The color change processing unit
Based on position information of representative points of a plurality of vertices constituting the first object, a color change area on the second object is specified, and the color change process is performed on the specified color change area. A featured program. In claim 5 or 6,
The program characterized in that the representative points of the plurality of vertices of the first object are skeleton joints for motion processing of the first object. In any of claims 4 to 7,
The color change processing unit
A program for performing a process of attenuating with time the value of the parameter for color change processing at a vertex determined to have contacted the second object during a period in which the contact event occurs. In any one of Claims 1 thru | or 8.
As an effect processing unit that performs an effect process different from the color change process on an area on the second object corresponding to the contact position of the first object,
A program characterized by causing a computer to function. In claim 9,
The color change processing unit
Performing a process of enlarging the size of the discoloration area on the second object on which the discoloration process is performed with the passage of time from the contact position;
The effect processing unit
A program for performing a process of enlarging the size of an effect area on the second object on which the effect process is performed with the passage of time from the contact position. In claim 9 or 10,
The second object is an object representing a liquid;
The effect processing unit
A program for performing an effect process on the ripples of the liquid as the effect process. In claim 11,
The effect processing unit
A program characterized by performing an effect process representing a change in the refractive index of the liquid as the ripple effect process. In any of claims 9 to 12,
As a texture storage unit that stores textures for effect processing,
Make the computer work,
The effect processing unit
The effect processing of the second object is performed using an effect processing parameter set for a predetermined channel component of the effect processing texture,
The color change processing unit
A program for performing the color change processing of the second object using a color change processing parameter set for another channel component different from the predetermined channel component of the effect processing texture. In claim 13,
The effect processing unit
A program for performing the effect processing of the second object using an effect processing normal information parameter set for the predetermined channel component of the effect processing texture. In any of claims 9 to 12,
As a texture storage unit that stores texture for effect processing and texture for discoloration processing,
Make the computer work,
The effect processing unit
The effect processing of the second object is performed using the effect processing parameter set for the channel component of the effect processing texture,
The color change processing unit
A program for performing the color change processing of the second object using a color change processing parameter set for a channel component of the color change processing texture. In any one of Claims 1 thru | or 15,
The first object is an object representing a character appearing in a game, the second object is an object representing a liquid,
The color change processing unit
Based on the color change processing parameters of the character, a process for changing the color of the character surface,
When the contact event in which the character is immersed in the liquid occurs, a process for changing the color of the liquid is performed based on the parameter for the color change process of the portion of the character immersed in the liquid. A featured program. In claim 16,
The color change processing unit
A program for performing a process of attenuating the color of the discoloration according to the discoloration processing parameter for each part of the character immersed in the liquid.   A computer-readable information storage medium, wherein the program according to any one of claims 1 to 17 is stored. An event determination unit that determines the occurrence of a contact event in which the first object contacts the second object;
When the contact event of the first object and the second object occurs, the color change processing parameter set for the first object is acquired, and the color change processing parameter is obtained according to the acquired color change processing parameter A color change processing unit that performs the color change processing on a region on the second object corresponding to the contact position of the first object;
An image generation unit configured to generate an image viewed from a virtual camera in an object space in which a plurality of objects including the first and second objects are arranged and set;
An image generation system comprising: An event determination unit that determines the occurrence of a contact event in which the first object contacts the second object;
When the contact event of the first object and the second object occurs, the color change processing parameter set for the first object is acquired, and the color change processing parameter is obtained according to the acquired color change processing parameter A color change processing unit that performs the color change processing on a region on the second object corresponding to the contact position of the first object;
An image generation data generation unit for generating image generation data for generating an image viewed from a virtual camera in an object space in which a plurality of objects including the first and second objects are arranged and set;
A server system comprising: