JP2010033301A - Image generation system, program and information storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image generation system, a program and an information storage medium which can reflect image effects according to the characteristics of color components in an image. <P>SOLUTION: This image generation system for processing an original image in which the colors of pixels are designated by the color values of a plurality of types of color components is provided with: a first color processing part 122 for searching a first color value as a difference between a gray scale value obtained by converting the color values of the plurality of types of color components of each of pixels configuring the original image and a first threshold; a second color processing part 124 for searching a second color value as a difference between the color value of a prescribed color component configuring the color of each pixel configuring the original image and a second threshold; a shaded image generation part 126 for generating a shaded image based on the first color value and the second color value; and a composition processing part 128 for compounding the original image with the shaded image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image generation system, a program, and an information storage medium.

  Conventionally, an image generation system (game system) that generates an image that can be viewed from a virtual camera (a given viewpoint) in an object space that is a virtual three-dimensional space is known, and is popular as a so-called virtual reality experience. Is expensive. Taking an image generation system capable of enjoying a fighting game as an example, a player performs operations (attack operation, defense operation, movement operation, etc.) related to a moving body (character, etc.) using an operation unit (game controller, etc.). Enjoy a game of fighting with the moving bodies of other players (including computer players).

By the way, regarding the above-described image generation system, a filter technique has been developed that can further process an image (original image) once drawn to create an image having an atmosphere different from that of the original image. For example, there is a filter method that extracts a predetermined color information from an original image drawn in a buffer to generate a filter image, and synthesizes the filter image with the original image to express a blur of strong light incident in the line-of-sight direction. It has been proposed (see Patent Document 1).
Japanese Patent Laid-Open No. 2003-85578

  However, in the conventionally proposed filter method, an intermediate image is generated by extracting certain color information regardless of the characteristics of the color components in the image. Therefore, depending on the characteristics of the color components in the image, the image by the filter method may be used. There is a problem that the image effect may not be reflected in a region where the effect is to be reflected.

  The present application has been made in view of the above circumstances, and an object thereof is to provide an image generation system, a program, and an information storage medium capable of reflecting an image effect according to the characteristics of color components in an image. There is.

(1) The present invention
An image generation system for processing an original image in which pixel colors are designated by color values of a plurality of types of color components,
A first color processing unit that obtains a first color value that is a difference between a gray scale value obtained by converting color values of the plurality of types of color components of each pixel constituting the original image and a first threshold value; ,
A second color processing unit for obtaining a second color value that is a difference between a color value of a predetermined color component constituting the color of each pixel constituting the original image and a second threshold value;
A blurred image generating unit that generates a blurred image based on the first color value and the second color value;
The present invention relates to an image generation system including a synthesis processing unit that synthesizes the original image and the blurred image. The present invention also relates to a program that causes a computer to function as each of the above-described units, and a computer-readable information storage medium that stores such a program.

  According to the present invention, the blurred image can be generated by the first color value based on the gray scale value and the second color value based on the color value of the predetermined color component. It is possible to generate a blurred image in accordance with.

(2) In the image generation system, program, and information storage medium of the present invention,
The synthesis processing unit
The color value of each pixel of the blurred image may be added to the color value of each pixel of the original image.

  In this way, since the color value of the area corresponding to the blurred image is increased, an image effect that the area corresponding to the blurred image shines can be reflected.

(3) In the image generation system, program, and information storage medium of the present invention,
The original image is an image subjected to shading that reflects on the object the color of the light source arranged in the object space,
The second color processing unit is
The second color value may be obtained using the color component having the highest color value among the plurality of types of color components constituting the color of the light source as the predetermined color component.

  Here, “reflect the color of the light source on the object” can reflect the color of the light source calculation result on the object.

  In this way, it is possible to reflect the image effect in accordance with the characteristics of the color components of the light source as a tendency.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Configuration FIG. 1 shows an example of a functional block diagram of an image generation system (game system) of the present embodiment. Note that the image generation system of the present embodiment may have a configuration in which some of the components (each unit) in FIG. 1 are omitted.

  The operation unit 160 is for the player to input operation data of a player object (an example of a moving object, a player character operated by the player, etc.), and its functions are lever, button, steering, microphone, touch panel type. It can be realized by a display or a housing. The storage unit 170 serves as a work area for the processing unit 100, the communication unit 196, and the like, and its functions can be realized by a RAM (main memory 172), a VRAM (video memory 174), or the like.

  The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), magneto-optical disk (MO), magnetic disk, hard disk, and magnetic tape. Alternatively, it can be realized by a memory (ROM). The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by a CRT, LCD, touch panel display, HMD (head mounted display), or the like. The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  The portable information storage device 194 stores player personal data, game save data, and the like. Examples of the portable information storage device 194 include a memory card and a portable game device. The communication unit 196 performs various controls for communicating with the outside (for example, a host device or other image generation system), and functions thereof are hardware such as various processors or communication ASICs, programs, and the like. It can be realized by.

  Note that a program (data) for causing a computer to function as each unit of the present embodiment is obtained from an information storage medium included in the host device (server) via the network and communication unit 196 (or the main memory of the storage unit 170). 172). Use of the information storage medium of such a host device (server) can also be included in the scope of the present invention.

  The processing unit 100 (processor) performs processing such as game processing, image generation processing, or sound generation processing based on operation data and programs from the operation unit 160. Here, as the game process, a process for starting a game when a game start condition is satisfied, a process for advancing the game, a process for placing an object such as a character or a map, a process for displaying an object, and a game result are calculated. There is a process or a process of ending a game when a game end condition is satisfied. The processing unit 100 performs various processes using the main memory 172 in the storage unit 170 as a work area. The functions of the processing unit 100 can be realized by hardware such as various processors (CPU (main processor), GPU (drawing processor), DSP, etc.), ASIC (gate array, etc.), and programs.

  The processing unit 100 includes an object space setting unit 110, a movement / motion processing unit 112, a virtual camera control unit 114, a drawing unit 120, a filter processing unit 121, and a sound generation unit 130. Note that some of these may be omitted.

  The object space setting unit 110 represents display objects such as a character, a car, a building, a tree, a pillar, a wall, a course (road), and a map (terrain) based on the object data stored in the object data storage unit 172. Various kinds of objects (objects composed of primitives such as polygons, free-form surfaces or subdivision surfaces) and light sources indicating the direction, intensity and color of light travel are set in the object space. That is, the position and rotation angle (synonymous with direction and direction) of the object in the world coordinate system are determined, and the determined rotation angle (about the X, Y, and Z axes) is determined at the determined position (X, Y, Z). Rotate the object and light source.

  The movement / motion processing unit 112 performs a movement / motion calculation (movement / motion simulation) of an object (such as a character, a car, or an airplane). That is, based on operation data input by the player through the operation unit 160, a program (movement / motion algorithm), various data (motion data), or the like, the object is moved in the object space, or the object is moved (motion, animation). ) Is performed. Specifically, object movement information (position, rotation angle, speed, or acceleration) and motion information (position or rotation angle of each part that constitutes the object) are sequentially transmitted every frame (1/60 seconds). Perform the required simulation process. A frame is a unit of time for performing object movement / motion processing (simulation processing) and image generation processing.

  The virtual camera control unit 114 performs a virtual camera (viewpoint) control process for generating an image viewed from a given (arbitrary) viewpoint in the object space. Specifically, processing for controlling the position (X, Y, Z) or rotation angle (rotation angle about the X, Y, Z axis) of the virtual camera (processing for controlling the viewpoint position, the line-of-sight direction or the angle of view) I do.

  For example, when an object (for example, a character or a car) is photographed from behind with a virtual camera, the position or rotation angle (the direction of the virtual camera) of the virtual camera is set so that the virtual camera follows changes in the position or rotation of the object. Control. In this case, the virtual camera can be controlled based on information (an example of predetermined control information) such as the position, rotation angle, or speed of the object obtained by the movement / motion processing unit 112. Alternatively, control may be performed such that the virtual camera is rotated at a predetermined rotation angle or moved along a predetermined movement path. In this case, the virtual camera is controlled based on virtual camera data (an example of predetermined control information) for specifying the position (movement path) or rotation angle of the virtual camera. When there are a plurality of virtual cameras (viewpoints), the above control process is performed for each virtual camera.

  The drawing unit 120 performs drawing processing based on the results of various processing (game processing) performed by the processing unit 100, thereby generating an image and outputting the image to the display unit 190. When generating a so-called three-dimensional game image, first, object data (model data) including vertex data (vertex position coordinates, texture coordinates, color data, normal vector, α value, etc.) of each vertex of the object (model) ) Is input from the object data storage unit 172B, and vertex processing (shading by a vertex shader) is performed based on the vertex data included in the input object data. When performing the vertex processing, vertex generation processing (tessellation, curved surface division, polygon division) for re-dividing the polygon may be performed as necessary. In the vertex processing, according to the vertex processing program (vertex shader program, first shader program), vertex movement processing, coordinate conversion (world coordinate conversion, camera coordinate conversion), clipping processing, perspective processing, and other geometric processing are performed. On the basis of the processing result, the vertex data given to the vertex group constituting the object is changed (updated or adjusted). Then, rasterization (scan conversion) is performed based on the vertex data after the vertex processing, and the surface of the polygon (primitive) is associated with the pixel (pixel). Subsequent to rasterization, pixel processing (shading or fragment processing by a pixel shader) for drawing pixels (fragments forming a display screen) constituting an image is performed. In pixel processing, according to a pixel processing program (pixel shader program, second shader program), various processes such as texture reading (texture mapping), color data setting / change, translucent composition, anti-aliasing, etc. are performed, and an image is processed. The final drawing color of the constituent pixels is determined, and the drawing color of the perspective-transformed object is rendered as a rendering target (buffer capable of storing image information in units of pixels. Frame buffer 172B of main memory 172, work buffer 174C of video memory 174 And output (draw) to the frame buffer 174D). That is, in pixel processing, per-pixel processing for setting or changing image information (color (color value, luminance value), normal, α value, etc.) in units of pixels is performed. Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated. Note that when there are a plurality of virtual cameras (viewpoints), an image can be generated so that an image seen from each virtual camera can be displayed as a divided image on one screen.

  The vertex processing and pixel processing are realized by hardware that enables polygon (primitive) drawing processing to be programmed by a shader program written in a shading language, so-called programmable shaders (vertex shaders and pixel shaders). Programmable shaders can be programmed with vertex-level processing and pixel-level processing, so that the degree of freedom of drawing processing is high, and expressive power is greatly improved compared to conventional hardware-based fixed drawing processing. Can do.

  The drawing unit 120 performs geometry processing, texture mapping, hidden surface removal processing, α blending, and the like when drawing an object.

  In the geometry processing, processing such as coordinate conversion, clipping processing, perspective projection conversion, or light source calculation is performed on the object. The object data (positional coordinates of object vertices, texture coordinates, color data (luminance data), normal vector, α value, etc.) after geometry processing (after perspective projection conversion) is stored in the object data in the main memory 172. Stored in the part 172A.

  Texture mapping is a process for mapping a decal texture (texel value) stored in the decal texture storage unit 174A of the video memory 174 to an object. Specifically, the texture (surface properties such as color (RGB) and α value) is read from the decal texture storage unit 174A of the video memory 174 using the texture coordinates set (given) at the vertex of the object. Then, a texture that is a two-dimensional image is mapped to an object. In this case, processing for associating pixels with texels, bilinear interpolation, trilinear interpolation, etc. are performed as texel interpolation.

  As the hidden surface removal processing, hidden surface removal processing by a Z buffer method (depth comparison method, Z test) using a Z buffer 174B (depth buffer) in which a Z value (depth information) of a drawing pixel is stored may be performed. it can. That is, when drawing a pixel corresponding to the primitive of the object, the Z value stored in the Z buffer 174B is referred to. Then, the Z value of the referenced Z buffer is compared with the Z value at the drawing pixel of the primitive, and the Z value at the drawing pixel is a Z value (for example, a small Z value) on the near side when viewed from the virtual camera. If there is, the drawing process of the drawing pixel is performed and the Z value of the Z buffer 174B is updated to a new Z value.

  As the α blending, a translucent synthesis process (usually α blending, addition α blending, subtraction α blending, or the like) based on the α value (A value) is performed. For example, in the case of normal α blending, the following processes (1) to (3) are performed.

RQ = (1−α) × R1 + α × R2 (1)
GQ = (1−α) × G1 + α × G2 (2)
BQ = (1−α) × B1 + α × B2 (3)
In addition, in the case of addition α blending, the following expressions (4) to (6) are performed. In the case of simple addition, α = 1 and the following formulas (4) to (6) are performed.

RQ = R1 + α × R2 (4)
GQ = G1 + α × G2 (5)
BQ = B1 + α × B2 (6)
In the case of subtractive α blending, the processing of the following equations (7) to (9) is performed. In the case of simple subtraction, α = 1 and the following formulas (7) to (9) are processed.

RQ = R1-α × R2 (7)
GQ = G1-α × G2 (8)
BQ = B1-α × B2 (9)
Here, R1, G1, and B1 are RGB components of an image (original image) already drawn in the frame buffer 172B or the frame buffer 174D, and R2, G2, and B2 are drawn in the frame buffer 172B or the frame buffer 174D. This is the RGB component of the image to be processed. RQ, GQ, and BQ are RGB components of an image obtained by α blending. The α value is information that can be stored in association with each pixel (texel, dot), for example, plus alpha information other than color information. The α value can be used as mask information, translucency (equivalent to transparency and opacity), bump information, and the like.

  The filter processing unit 121 generates a filter image for the original image in which the object space viewed from the virtual camera is drawn, and performs a filter process for synthesizing the original image and the filter image. In the present embodiment, the filter processing unit 121 includes a first color processing unit 122, a second color processing unit 124, an intermediate image generation unit 125, a blurred image generation unit 126, and a synthesis processing unit 128.

  The first color processing unit 122 converts a gray scale value obtained by converting a luminance value (an example of a color value) of an RGB component (an example of a plurality of types of color components) of each pixel (pixel) constituting the original image, A first luminance value that is a difference from the threshold value is obtained. In the present embodiment, the first color processing unit 122 subtracts the first threshold value from the grayscale value of each pixel that constitutes the original image, so that the pixel having a higher luminance value than the first threshold value. A luminance value exceeding a first threshold is extracted for.

  The second color processing unit 124 obtains a second luminance value that is a difference between the luminance value of a predetermined color component constituting the color of each pixel constituting the original image and the second threshold value. In the present embodiment, the second color processing unit 124 subtracts the second threshold value from the luminance value of the R component (red component, an example of a predetermined color component) of each pixel constituting the original image, For a pixel having an R component luminance value higher than the second threshold value, an R component luminance value exceeding the second threshold value is extracted.

  Here, in this embodiment, the original image is an image subjected to shading that reflects the color of the light source arranged in the object space on the object, but the light source of this embodiment constitutes the color of the light source. Among RGB components, the luminance value of the R component is the highest. Therefore, the second color processing unit 124 obtains the second color value by setting the R component having the highest luminance value among the RGB components constituting the color of such a light source as a predetermined color component. Accordingly, the second color processing unit 124 can extract the luminance value of the pixel in which many light source colors are reflected from the original image.

  The first threshold value and the second threshold value may be the same value or different values. The intensity of the light source and the scene (view volume in the view volume) seen from the virtual camera may be used. Any value can be set in accordance with the characteristics of the color components in the image, such as colors distributed in a large amount. The predetermined color component may be a color component other than the R component, such as a G component (green component) or a B component (blue component), and any color component may be selected depending on the characteristics of the color component in the image. It can be set as a predetermined color component.

  The intermediate image generation unit 125 generates an intermediate image (an example of a filter image) based on the first luminance value and the second luminance value obtained as described above. In the present embodiment, the intermediate image generation unit 125 uses, for each pixel constituting the original image, a first color (first color vector, gray) having the first luminance value as the luminance value of each color component of RGB. , Adding and adding the second color (second color vector, red) with the second luminance value as the R component luminance value and 0 as the luminance value of the other color components (G component and B component) Find the color. Then, the intermediate image generation unit 125 draws the added color of each pixel by extending the added color of each pixel or multiplying the added color of each pixel by a predetermined coefficient, thereby expanding the added color. Generated intermediate image is generated.

  The blurred image generation unit 126 performs a blurring process using bilinear interpolation that smoothes the pixel color with the peripheral pixel color and a blurring process that replaces the pixel color with the peripheral pixel color, while performing the blurring process on the intermediate image. The color of the pixel is drawn to generate a blurred image (an example of a filter image).

  The composition processing unit 128 synthesizes the original image and the blurred image. In the present embodiment, the composition processing unit 128 adds the luminance value of each pixel of the blurred image to the luminance value of each pixel of the original image.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, or sounds, and outputs the game sounds to the sound output unit 192.

  Note that the image generation system of the present embodiment may be a system dedicated to the single player mode in which only one player can play, or may be a system having a multiplayer mode in which a plurality of players can play. Further, when a plurality of players play, game images and game sounds to be provided to the plurality of players may be generated using one terminal, or connected via a network (transmission line, communication line) or the like. Alternatively, it may be generated by distributed processing using a plurality of terminals (game machine, mobile phone).

2. Next, the method of this embodiment will be described with reference to the drawings. In the present embodiment, in order to express glare and glare in the image, luminance values of bright pixels are extracted from the pixels constituting the original image to generate an intermediate image, and the original image is generated based on the intermediate image. By processing the image, an image in which bright pixels of the original image and surrounding pixels are further brightened is generated. In particular, in the present embodiment, the first luminance value, which is the difference between the gray scale value obtained by converting the luminance value of the RGB component of each pixel constituting the original image, and the first threshold value, and each constituting the original image An intermediate image is generated based on the luminance value of the R component of the pixel and the second luminance value that is the difference between the second threshold value. Thereby, in the present embodiment, an intermediate image is generated in accordance with the characteristics of the color components in the image.

  FIG. 2 is a diagram for explaining an intermediate image generation method characteristic of the present embodiment. As shown by a1 in FIG. 2, in this embodiment, first, the grayscale value A of the pixel is calculated from the luminance values of the RGB components of the first pixel P1 of the original image drawn in the first work buffer. = 0.3R + 0.6G + 0.1B. Then, a luminance value 200 (an example of a first threshold value) is subtracted from the obtained gray scale value A as a threshold value to obtain a first luminance value C1. That is, in this embodiment, the gray scale value A of each pixel constituting the original image is used as a reference indicating the brightness of the pixel, and when this gray scale value A is higher than the threshold value, the threshold value is set. The first luminance value C1 that exceeds is extracted.

  Here, in the present embodiment, the gray scale value A is calculated as A = 0.3R + 0.6G + 0.1B by weighting in consideration of how each RGB color is viewed by human eyes. That is, even if the luminance values of RGB are the same, blue (B) looks darkest, so the influence of the B component is weak (0.1), and red (R) appears darker than blue (B). Since the influence level of the R component is the next weakest (0.3) and green (G) looks brightest, the gray scale value is calculated so that the influence level of the G component is the strongest (0.6). Therefore, in the present embodiment, it is possible to extract the luminance value of the bright pixel among the pixels constituting the original image along the way the brightness is visible to the human eye.

  Further, in the present embodiment, by arranging the light source in the object space, a process for increasing the luminance value according to the reflectance of the light is performed on the pixel corresponding to the region where the light from the light source is reflected. ing. In the present embodiment, a red or yellow light source having the highest luminance value of the R component is disposed as such a light source. Therefore, for a pixel corresponding to a region where light from the light source is reflected, the region A process for increasing the luminance value of the R component according to the reflectance of the light is performed. Therefore, in the present embodiment, the luminance value of the R component is often high for the pixel to which the image effect expressing the glare is to be reflected.

  However, in this embodiment, since the gray scale value A is used as a reference indicating the brightness of the pixel, even if the luminance value of the R component is high, the gray scale value A of the pixel is weighted by the R component. Is small (0.3), the luminance value becomes low, and may be treated as a dark pixel. For example, even if the luminance value of the R component is 200 or more, the first luminance value C1 exceeding the threshold is not extracted because the gray scale value A is 200 or less in a1 of FIG. 1 luminance value C1 = 0).

  Here, if the threshold value is lowered so that the first luminance value C1 is extracted even for such a pixel, the first exceeding the threshold value is not a pixel that should reflect the image effect expressing the glare. Luminance value C1 may be extracted. Particularly, a pixel having a high luminance value of the G component has a large weighting of the gray scale value A (0.6), and the luminance value of the gray scale value A is relatively high. If not, the first luminance value C1 exceeding the threshold value is extracted.

  Therefore, in the present embodiment, the first luminance value C1 is extracted as indicated by a1 in FIG. 2, and the luminance value of the R component of the first pixel P1 of the original image is extracted as indicated by a2 in FIG. A luminance value 200 (an example of a second threshold value, which is the same as the first threshold value and the second threshold value in this embodiment) is subtracted as a threshold value to obtain a second luminance value C2. Desired. That is, in this embodiment, the luminance value of the R component of each pixel constituting the original image is also used as a reference indicating the brightness of the pixel, and the threshold value is obtained when the luminance value of the R component is higher than the threshold value. A second luminance value C2 exceeding the value is extracted.

  Thus, in this embodiment, the grayscale value A is used as a reference indicating the brightness of the pixel, so that the brightness of the bright pixel among the pixels constituting the original image along the way the brightness is visible to the human eye. While the value is extracted, the luminance value of the R component is also used as a reference indicating the brightness of the pixel, so that it corresponds to the region where the light from the light source is reflected without lowering the threshold value. The luminance value of the pixel can be extracted. That is, in the present embodiment, the luminance value of the pixel that should reflect the image effect expressing the glare can be appropriately extracted according to the color of the light source.

  Then, as indicated by a3 in FIG. 2, the result of subtracting the luminance value 200 from the gray scale value A is clamped to a value of 0 to 1.0, and the first luminance value C1 is obtained. Then, as shown by a4 in FIG. 2, the luminance value C1 is multiplied by the luminance value of each of the RGB components of the pixel to be converted into the first color information (C1 × R, C1 × G, C1 × B). The Further, as indicated by a5 in FIG. 2, the result of subtracting the luminance value 200 from the luminance value of the R component is clamped to a value of 0 to 1.0 to obtain the second luminance value C2.

  Then, as shown by a6 in FIG. 2, the C1 × R which is the R component of the first color information is compared with the second luminance value C2, and the C1 × R which is the R component of the first color information is compared. If it is larger (Y), the first color information (C1 × R, C1 × G, C1 × B) is selected as shown by a7 in FIG. 2, and the second luminance value C2 is larger. In this case (N), the second color information (C1 × R, C1 × G, C1 × B) in which the R component of the first color information is set to the second luminance value C2 as indicated by a8 in FIG. ) Is selected. That is, the larger one of C1 × R which is the R component of the first color information and the second luminance value C2 is selected as the luminance value of the R component.

  When the first color information (C1 × R, C1 × G, C1 × B) is selected, the first color information (C1 × R, C1 × G) is displayed as indicated by a9 in FIG. , C1 × B), the luminance value of each color component is raised to a power of a predetermined index x, and is expanded so that the gradation difference of the luminance value becomes clear. Then, as indicated by a11 in FIG. 2, the first color information after expansion is output to the first pixel PP1 of the second work buffer. On the other hand, when the second color information (C1 × R, C1 × G, C1 × B) is selected, the second color information (C1 × R, C1 × G) is displayed as indicated by a10 in FIG. , C1 × B), the luminance value of each color component is raised to a power of a predetermined index x, and is expanded so that the gradation difference of the luminance value becomes clear. Then, as indicated by a11 in FIG. 2, the decompressed second color information is output to the first pixel PP1 of the second work buffer.

  Then, the processing of a1 to a11 is performed for all the pixels of the original image, and an intermediate image based on the decompressed color information is drawn.

  In this way, in this embodiment, when added to the original image, an intermediate image can be generated in which bright pixels among the pixels constituting the original image are brightened and red pixels are reddish.

  FIG. 3 is a diagram for explaining a generation method of a blurred image obtained by blurring an intermediate image. As shown in b1 of FIG. 3, in this embodiment, the color of each pixel of the intermediate image is smoothed using the bilinear filter method for the intermediate image drawn in the second work buffer as described above. The blurring process is performed, and a blurred image is generated in the third work buffer.

  As blurring processing, by repeatedly reducing and enlarging the image, the color of each pixel is smoothed (interpolated) by taking in the color of the surrounding pixels using the bilinear filter method, and while shifting the texture coordinates There is a technique of blurring an image by smoothing the color of each pixel with the color of surrounding pixels by drawing with the bilinear filter method. The blurring processing method is not limited to the above, and various methods can be employed.

  FIG. 4 is a diagram for explaining a method of synthesizing the blurred image and the original image. As shown in c1 of FIG. 4, in the present embodiment, the brightness value of each pixel is added to the blurred image generated in the third work buffer as described above and the original image generated in the first work buffer. Is synthesized. Thus, in the present embodiment, the bright area of the original image is made brighter and the red area is made red, so that even when a red or yellow light source set with the highest luminance value of the R component is arranged, It is possible to appropriately reflect the image effect expressing the glare according to the color of the light source in the region where the image effect expressing the glare is to be reflected.

3. Processing of this embodiment Next, a detailed processing example of this embodiment will be described using a flowchart. FIG. 5 is a flowchart showing an outline of processing performed for each frame. As shown in FIG. 5, in this embodiment, first, shader processing is performed (step S10), and an object existing in a scene (in a view volume) seen from a virtual camera arranged in the object space is projected onto the screen. Then, the perspectively projected object is drawn in the frame buffer to generate an original image. Then, a filter process for reflecting an image effect expressing glare in the original image is performed (step S12).

  FIG. 6 is a flowchart showing details of the filter processing performed in step S12 of FIG. In the filter process, first, an intermediate image generation process for generating an intermediate image is performed (step S20), and a blurred image generation process for generating a blurred image based on the intermediate image is performed (step S22). A blurred image composition process is performed to add and compose (step S24).

  FIG. 7 is a flowchart showing details of the intermediate image generation process performed in step S20 of FIG. In the intermediate image generation processing, first, first color processing for obtaining a first luminance value C1 for the first pixel P1 of the original image is performed (step S30), and the second luminance value C2 for the same pixel P1. The second color processing for obtaining is performed (step S32). Then, C1 × R, which is the R component of the first color information, is compared with the second luminance value C2, and if C1 × R, which is the R component of the first color information, is larger, the first Color information (C1 × R, C1 × G, C1 × B) is selected, and the second luminance value C2 is larger, the R component of the first color information becomes the second luminance value C2. The second color information (C1 × R, C1 × G, C1 × B) thus selected is selected (step S34). Then, decompression processing for decompressing the color information of the selection result is performed (step S36), and the color information of the decompression result is output to the second work buffer (step S38). If the color information is not output for all the pixels constituting the original image (N in step S40), the processing from step S30 to step S40 is repeated to obtain the color information for all the pixels constituting the original image. Is output (Y in step S40), the intermediate image generation process is terminated.

  FIG. 8 is a flowchart showing details of the first color processing performed in step S30 of FIG. In the first color processing, first, a gray scale value A is obtained based on the luminance values of the RGB color components of the pixel to be processed (step S50). Then, the first luminance value C1 is obtained by subtracting the threshold value from the gray scale value A (step S52). Then, first color information obtained by applying the first luminance value C1 to the RGB color components is obtained (step S54).

  FIG. 9 is a flowchart showing details of the second color processing performed in step S32 of FIG. In the second color processing, first, the second luminance value C2 is obtained by subtracting the threshold value from the luminance value of the R component of the pixel to be processed (step S60). Then, the second luminance value C2 is set as the luminance value of the R component (step S62).

4). Hardware Configuration Example An example of a hardware configuration for realizing the image generation system according to the present embodiment will be described with reference to FIG. Note that FIG. 10 illustrates only the main configuration, and hardware (such as a memory controller and a speaker) that is not illustrated in FIG. 10 can be provided as necessary.

  The main processor 10 operates based on a program stored on the optical disc 72 (information storage medium such as CD, DVD, Blu-ray disc), a program transferred via the communication interface 80, a program stored on the hard disk 60, or the like. The main memory 40 accessible via the internal bus b4 is used as a work area (work area) to execute various processes such as game processing, image processing, and sound processing.

  The main processor 10 includes a single processor 12 and a plurality of vector processors 14. The processor 12 executes various processes such as OS execution, hardware resource management, game processing, and operation management of the vector processor 14. The vector processor 14 is a processor specialized for vector operations, and mainly executes processing such as geometry processing and codec processing of image data and sound data.

  The drawing processor 20 is configured to be accessible to the video memory 30 via the internal bus b1 (first internal bus). The drawing processor 20 also includes an internal bus b2 (second internal bus) that connects the drawing processor 20 and the main processor 10, a bus b3 inside the main processor 10, and an internal bus b4 that connects the main processor 10 and the main memory 40. The main memory 40 is configured to be accessible via the. That is, the drawing processor 20 can use the video memory 30 and the main memory 40 as rendering targets.

  The drawing processor 20 performs geometric processing such as coordinate transformation, perspective transformation, light source calculation, and curved surface generation, has a product-sum calculator and a divider capable of high-speed parallel computation, and performs matrix computation (vector computation). Run fast. For example, when processing such as coordinate transformation, perspective transformation, and light source calculation is performed, a program operating on the main processor 10 instructs the drawing processor 20 to perform the processing.

  The drawing processor 20 executes a rendering process of an image of an object after geometry processing (an object composed of a primitive surface such as a polygon or a curved surface) at high speed. In the multi-pass rendering process, the drawing processor 20 performs the hidden surface removal using the Z buffer 34 or the like based on the drawing data (vertex data and other parameters) and the like, and displays the image in the video memory 30 or the main memory. Render to one of 40 memories. Then, a process of rendering a new image in the other memory based on the image stored in one of the video memory 30 and the main memory 40 is performed as many times as necessary. The drawing processor 20 can perform filter processing such as glare filter processing, motion blur processing, depth of field processing, and fog processing as the multi-pass rendering processing.

  When the image is rendered in the frame buffer 32 provided in the video memory 30 in the final rendering pass, the image is output to the display 50. When an image is rendered in the main memory 40 in the final rendering pass, the image is copied (written) to the frame buffer 32 and output to the display 50.

  The hard disk 60 stores system programs, save data, personal data, and the like.

  The optical drive 70 drives an optical disc 72 (information storage medium) that stores programs, image data, sound data, and the like, and enables access to these programs and data.

  The communication interface 80 is an interface for transferring data to and from the outside via a network. In this case, as a network connected to the communication interface 170, a communication line (analog telephone line, ISDN), a high-speed serial bus, or the like can be considered. By using a communication line, data transfer via the Internet becomes possible. Further, by using the high-speed serial bus, data transfer with other image generation systems becomes possible.

  As described above, the image generation system (computer) according to the present embodiment can access the video memory 30 via the internal bus b1 (first internal bus) and also uses the internal bus b2 (second internal bus). A shader program that allows the drawing processor 20 to function as the filter processing unit 121 is an optical disk 72 (an example of an information storage medium) or a hard disk 60 (information storage medium). Stored in an example medium).

  In the image generation system of the present embodiment, the rendering processor 20 functioning as the filter processing unit 121 by the shader program is stored in the other memory different from the one memory of the video memory 30 or the main memory 40 in which the original image is generated. A filter image is generated, and the filter image generated in the other memory is added and combined with the original image generated in one memory.

  In this way, the drawing processor 20 writes image data into the memory (video memory 30 or main memory 40), or the drawing processor 20 reads image data from the memory (video memory 30 or main memory 40). Since the load on the internal buses b1 and b2 can be distributed, the use efficiency of the bandwidth of the internal buses b1 and b2 can be increased. In particular, in the image generation system of this embodiment, the rendering processor 20 reads a Z value from the Z buffer 34 that stores a large amount of data or writes a Z value in the hidden surface removal process using the Z buffer 34. Since the internal bus b1 that accesses the video memory 30 is frequently used, the bandwidth of the internal bus b1 becomes a bottleneck by distributing the buffer that generates the original image and the buffer that generates the filter image. Thus, it is possible to prevent the processing from being delayed.

  Note that all the units (units) of the present embodiment may be realized only by hardware, or only by a program stored in an information storage medium or a program distributed via a communication interface. May be. Alternatively, it may be realized by both hardware and a program.

  And when each part of this embodiment is implement | achieved by both hardware and a program, the program for functioning hardware (computer) as each part of this embodiment is stored in an information storage medium. Become. More specifically, the program instructs each processor 10, 20, etc., which is hardware, and passes data if necessary. Each of the processors 10 and 20 implements each unit of the present invention based on the instruction and the passed data.

  The present invention is not limited to that described in the above embodiment, and various modifications can be made. For example, terms cited as broad or synonymous terms in the description in the specification or drawings can be replaced with broad or synonymous terms in other descriptions in the specification or drawings. Further, the glare filter technique is not limited to that described in the present embodiment, and techniques equivalent to these techniques are also included in the scope of the present invention.

  The present invention can also be applied to various games (such as fighting games, shooting games, robot fighting games, sports games, competitive games, role playing games, music playing games, dance games, etc.). Further, the present invention is applied to various image generation systems such as a business game system, a home game system, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, a system board for generating a game image, and a mobile phone. it can.

  In the above embodiment, the gray scale value A is described as an example in which A = 0.3R + 0.6G + 0.1B is obtained, but the gray scale value A is set to A = (R + G + B) / 3. It may be required.

  Further, in the above embodiment, the first color information and the second color information are obtained for each pixel, and the addition and expansion processing is performed, so that the color information of each pixel constituting the intermediate image is changed for each pixel. As described above with reference to an example of output to two work buffers, the first color information image obtained by converting the color information of each pixel of the original image into the first color information and the color information of each pixel of the original image The second color information image converted into the second color information is generated, and the first color information image and the second color information image are added and expanded to generate an intermediate image. It may be.

  FIG. 11 is a diagram for explaining an intermediate image generation method of such an example. In this embodiment, as indicated by d1 in FIG. 11, first, the luminance value of each RGB component of each pixel of the original image drawn in the first work buffer is set to A = 0.3R + 0.6G + 0.1B. Thus, a gray scale value A image converted into the gray scale value A obtained in this way is generated. Then, as shown in d2 of FIG. 11, the monochrome first threshold image in which the luminance value of each color component of each pixel is 200 is subtracted from the grayscale value A image, and the luminance of each color component of each pixel is subtracted. By setting the value to the first luminance value C1, a first color information image in which the color information of each pixel is the first color information is generated.

  At the same time, as indicated by d3 in FIG. 11, the original image drawn in the first work buffer has the R component luminance value of each pixel of the original image as the R component luminance value, and 0 is the G component and B component. An R component image having the luminance value of the component is generated. Then, as shown by d4 in FIG. 11, a red second threshold image in which the luminance value of the R component of each pixel is set to 200 and the luminance values of the G component and the B component are set to 0 is obtained from the R component image. By subtracting, the luminance value of the R component of each pixel is set to the second luminance value C2, and the luminance values of the G component and B component are set to 0, whereby the color information of each pixel is set to the second color information. Two color information images are generated.

  Then, as shown in d5 of FIG. 11, the first color information image and the second color information image are added and synthesized to generate an added color information image. As shown in d6 of FIG. 11, the added color information image The luminance value of each color component of each pixel is raised to a power of a predetermined index x and expanded to generate an intermediate image based on the added color information after expansion.

The functional block diagram of the image generation system of this embodiment. Explanatory drawing of the method of producing | generating the intermediate image of this embodiment. Explanatory drawing of the method of producing | generating the blurred image of this embodiment. Explanatory drawing of the method of producing | generating the frame image of this embodiment. The flowchart which shows the flow of the process of this embodiment. The flowchart which shows the flow of the process of this embodiment. The flowchart which shows the flow of the process of this embodiment. The flowchart which shows the flow of the process of this embodiment. The flowchart which shows the flow of the process of this embodiment. 2 is a hardware configuration example of an image generation system according to the present embodiment. Explanatory drawing of the method of producing | generating the intermediate image of deformation | transformation embodiment.

Explanation of symbols

100 processing unit, 110 object space setting unit, 112 movement / motion processing unit,
114 virtual camera control unit, 120 drawing unit, 121 filter processing unit,
122 first color processing unit, 124 second color processing unit, 125 intermediate image generation unit,
126 blur image generation unit, 128 synthesis processing unit 130 sound generation unit, 160 operation unit, 170 storage unit, 172 main memory,
172A object data storage unit, 172B frame buffer,
174 video memory, 174A decal texture storage, 174B Z buffer,
174C work buffer, 174D frame buffer,
180 information storage medium, 190 display unit, 192 sound output unit,
194 Portable information storage device, 196 communication unit

Claims (5)

A program for processing an original image in which pixel colors are specified by color values of a plurality of types of color components,
A first color processing unit that obtains a first color value that is a difference between a gray scale value obtained by converting color values of the plurality of types of color components of each pixel constituting the original image and a first threshold value; ,
A second color processing unit for obtaining a second color value that is a difference between a color value of a predetermined color component constituting the color of each pixel constituting the original image and a second threshold value;
A blurred image generating unit that generates a blurred image based on the first color value and the second color value;
A program that causes a computer to function as a synthesis processing unit that synthesizes the original image and the blurred image. In claim 1,
The synthesis processing unit
A program that adds the color value of each pixel of the blurred image to the color value of each pixel of the original image. In claim 1 or 2,
The original image is an image subjected to shading that reflects on the object the color of the light source arranged in the object space,
The second color processing unit is
A program for obtaining the second color value by using, as the predetermined color component, a color component having the highest color value among a plurality of types of color components constituting the color of the light source.   An information storage medium readable by a computer, wherein the program according to any one of claims 1 to 3 is stored. An image generation system for processing an original image in which pixel colors are designated by color values of a plurality of types of color components,
A first color processing unit that obtains a first color value that is a difference between a gray scale value obtained by converting color values of the plurality of types of color components of each pixel constituting the original image and a first threshold value; ,
A second color processing unit for obtaining a second color value that is a difference between a color value of a predetermined color component constituting the color of each pixel constituting the original image and a second threshold value;
A blurred image generating unit that generates a blurred image based on the first color value and the second color value;
An image generation system comprising: a synthesis processing unit that synthesizes the original image and the blurred image.