JP3766394B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing apparatus, an image processing method, and a program, and more particularly to a technique for suitably displaying an object located in a spatial region related to a light source such as a light volume using a stencil buffer.
[0002]
[Prior art]
There is known an image processing apparatus that sets an object, a light source, and a viewpoint in a virtual three-dimensional space, and displays a visual field image representing a state of viewing the virtual three-dimensional space from the viewpoint on a monitor. In such an image processing apparatus, a state in which an object is illuminated by a light source is usually represented in a visual field image.
[0003]
However, in ordinary light source processing, it is difficult to express a state where an object located in a limited space area is particularly brightly illuminated, such as a spotlight or a sunbeam. In this regard, in a technique called volume light, a light volume that expresses the range through which light rays pass, such as a spotlight and sunbeams, is prepared, and the part (the part located in the light volume) of the object located therein is prepared. I try to increase the brightness.
[0004]
FIG. 7 is a diagram for explaining a conventional volume write technique. As shown in the figure, in this technique, an invisible light volume 102 is arranged in addition to an object 100 in a virtual three-dimensional space. A portion 104 of the object 100 located within the light volume 102 is displayed with the brightness increased.
[0005]
[Problems to be solved by the invention]
However, the conventional volume light technology does not consider the light beam direction, and even if the light is to be blocked by the polygon arranged upstream of the volume light, the light is transmitted to the polygon arranged downstream. There was a case where the video expression as if it was hit was made. For example, as shown in FIG. 8, when it is attempted to display a state in which an object that is exposed to light is viewed from the back side, the object 100 positioned in the light volume 102 using the conventional volume light technology is used. As shown in FIG. 9, there is a problem in that the portion 106 is displayed in a state where the brightness is increased even though the portion 106 is the back surface side when viewed from the light source side.
[0006]
The present invention has been made in view of the above problems, and an object thereof is to provide an image processing apparatus, an image processing method, and a program capable of suitably displaying an object arranged in a spatial region such as a light volume. There is to do.
[0007]
[Means for Solving the Problems]
In order to solve the above problems, an image processing apparatus according to the present invention includes a visual field image storage unit that stores a visual field image representing a state in which a virtual three-dimensional space in which an object is arranged is viewed from a given viewpoint, and the visual field Based on the light source position and the position of the object, the virtual 3 from the area representing the part of the object located in the first space area set in the virtual three-dimensional space corresponding to the light source position. Brightness increasing means for increasing the brightness of the brightness increasing area, which is an area excluding the area representing the part of the object located in the second space area set in the dimension space.
[0008]
Further, the image processing method according to the present invention includes a step of storing a visual field image representing a state in which a virtual three-dimensional space in which an object is arranged is viewed from a given viewpoint in a visual field image storage unit, Set in the virtual three-dimensional space based on the light source position and the position of the object from an area representing the part of the object located in the first spatial area set in the virtual three-dimensional space corresponding to the light source position A brightness increasing step for increasing the brightness of the brightness increasing area, which is an area excluding the area representing the part of the object located in the second spatial area.
[0009]
In addition, the program according to the present invention corresponds to a visual field image storage unit that stores a visual field image representing a state in which a virtual three-dimensional space in which an object is arranged is viewed from a given viewpoint, and corresponds to a light source position in the visual field image. The second set in the virtual three-dimensional space based on the light source position and the position of the object from the region representing the part of the object located in the first spatial region set in the virtual three-dimensional space This is a program for causing a computer to function as a brightness increasing means for increasing the brightness of a brightness increasing area, which is an area excluding an area representing the part of the object located in a spatial area.
[0010]
In the present invention, the first and second space regions are set in a virtual three-dimensional space. The first space area is, for example, a light volume and corresponds to a light source position provided in the virtual three-dimensional space. The second space area is, for example, a shadow volume, and is set in a virtual three-dimensional space based on the light source position and the object.
[0011]
According to the present invention, the brightness increasing region of the visual field image is displayed in a state where the brightness is increased. This brightness increase area is an area obtained by excluding an area representing an object part located in the second space area from an area representing an object part located in the first space area. According to the present invention, the second space area is set in the virtual three-dimensional space in relation to the light source position and the object position, and the area representing the part of the object located in the second space area is excluded from the brightness increase area. Therefore, an object arranged in a space area such as a light volume can be suitably displayed.
[0012]
The brightness increasing means includes numerical information storage means for storing numerical information in association with each pixel constituting the visual field image, and the first spatial region among the visual field images stored in the visual field image storage means. First numerical information changing means for changing numerical information stored in the numerical information storage means in association with pixels constituting a region representing the portion of the object located inside, and stored in the visual field image storage means Second numerical information changing means for changing numerical information stored in the numerical information storage means in association with pixels constituting a region representing the part of the object located in the second spatial region in the visual field image; And a lightness increase area determination means for determining the lightness increase area based on numerical information stored in the numerical information storage means.
[0013]
Further, the image processing apparatus according to the present invention includes a visual field image storage unit that stores a visual field image representing a state in which a virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint, and a light source among the visual field images. The light source position and the position of the plurality of objects are set in the virtual three-dimensional space from the region representing the portion of the plurality of objects located in the first space region set in the virtual three-dimensional space corresponding to the position. Brightness increasing means for increasing the brightness of the brightness increasing area, which is an area excluding the area representing the portion of the plurality of objects located in the first space area.
[0014]
In addition, the image processing method according to the present invention includes a visual field image storage step of storing a visual field image representing a state in which a virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint in a visual field image storage unit; Based on the light source position and the position of the plurality of objects from an area representing a portion of the plurality of objects located in the first space area set in the virtual three-dimensional space corresponding to the light source position in the image. A brightness increasing step for increasing the brightness of the brightness increasing area, which is an area excluding the area representing the portion of the plurality of objects located in the second space area set in the virtual three-dimensional space. .
[0015]
In addition, the program according to the present invention includes a visual field image storage unit that stores a visual field image representing a state in which a virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint, and the light source position in the visual field image. Correspondingly, based on the light source position and the position of the plurality of objects, the virtual three-dimensional from the region of the visual field image representing the portion of the plurality of objects located in the first space area set in the virtual three-dimensional space. A program for causing a computer to function as a brightness increasing means for increasing the brightness of a brightness increasing area, which is an area excluding an area representing a portion of the plurality of objects located in a second space area set in a space.
[0016]
In the present invention, the first and second space regions are set in a virtual three-dimensional space. The first space area is, for example, a light volume and corresponds to a light source position provided in the virtual three-dimensional space. The second space area is, for example, a shadow volume, and is set in a virtual three-dimensional space based on the light source position and each object.
[0017]
According to the present invention, the brightness increasing region of the visual field image is displayed in a state where the brightness is increased. This brightness increase area is an area obtained by excluding an area representing an object part located in the second space area from an area representing an object part located in the first space area. According to the present invention, the second space area related to the light source position and the object position is set in the virtual three-dimensional space, and the area representing the part of the object located in the second space area is excluded from the brightness increase area. It is possible to suitably display objects arranged in a space area such as a light volume.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
[0019]
FIG. 1 is a diagram showing a configuration of a game device (image processing device) according to an embodiment of the present invention. A game apparatus 10 shown in the figure is an embodiment of an image processing apparatus according to the present invention, and a DVD-ROM 25 serving as an information storage medium is attached to a home game machine 11 connected to a monitor 18 and a speaker 22. It is constituted by. Here, the DVD-ROM 25 is used to supply the game program to the consumer game machine 11, but any other information storage medium such as a CD-ROM or a ROM card can be used. In addition, a game program and game data can be supplied to the consumer game machine 11 from a remote place via a communication network such as the Internet.
[0020]
The home-use game machine 11 is a known computer game system, in which a microprocessor 14, an image processing unit 16, a main memory 26, and an input / output processing unit 30 are connected to each other via a bus 12 so that mutual data communication is possible. The unit 30 is connected to a controller 32, an audio processing unit 20, and a DVD-ROM playback unit 24. Each component of the consumer game machine 11 other than the controller 32 is housed in a housing. For example, a household television receiver or the like is used for the monitor 18, and a built-in speaker or the like is used for the speaker 22, for example.
[0021]
The microprocessor 14 controls each part of the consumer game machine 11 based on an operating system stored in a ROM (not shown) and a game program read from the DVD-ROM 25. The bus 12 is for exchanging addresses and data among the units of the consumer game machine 11. The main memory 26 includes a RAM, and game programs (including game data) read from the DVD-ROM 25 are read and written as necessary, and various data are used for the operation of the microprocessor 14. It is read and written. The image processing unit 16 includes a VRAM. The image processing unit 16 receives the image data sent from the microprocessor 14 and draws a game screen on the VRAM. The image processing unit 16 converts the content into a video signal and sends it to the monitor 18 at a predetermined timing. Output.
[0022]
The input / output processing unit 30 is an interface for relaying data communication between the controller 32, the audio processing unit 20, the DVD-ROM playback unit 24, and the microprocessor 14. The controller 32 is an input means for a player to perform a game operation. The input / output processing unit 30 acquires operation states of various buttons of the controller 32 at a constant cycle (for example, every 1/60 seconds), and passes operation signals representing the operation states to the microprocessor 14 via the bus 12. The microprocessor 14 determines the player's game operation based on the operation signal. The sound processing unit 20 includes a sound buffer, and reproduces data such as music and game sound effects that are read from the DVD-ROM 25 and stored in the sound buffer in accordance with instructions from the microprocessor 14. 22 to output. The DVD-ROM playback unit 24 reads a game program recorded on the DVD-ROM 25 in accordance with an instruction from the microprocessor 14.
[0023]
Hereinafter, a procedure for executing the improved write volume processing using the image processing apparatus having such a configuration will be described.
[0024]
FIG. 2 is a perspective view showing a part of the virtual three-dimensional space. As shown in the figure, an object 44, an invisible light volume 40, and an invisible shadow volume 42 are arranged in this space. The light source position and the light irradiation direction are virtually set in the virtual three-dimensional space, and the light volume 40 is set to extend in the light irradiation direction. The shadow volume 42 divides a shadow area (spatial area) formed by the object 44 blocking light emitted from the light source. The light source side surface of the object 44 is an end face, and the light irradiation direction. Is set to stretch. The light volume 40 and the shadow volume 42 can be easily set using various known techniques, for example. The end face of the shadow volume 42 is not necessarily coincident with the side surface portion of the object 44 itself, and is prepared in advance in association with the object 44 and coincides with the side surface portion of the shadow volume object driven by the object 44. You may make it make it.
[0025]
In the image processing apparatus according to the present embodiment, a viewpoint is set in the virtual three-dimensional space, and an image showing a state of viewing the virtual three-dimensional space from the same viewpoint, that is, a visual field image is stored in the image processing unit 16. Is displayed on the monitor 18. At this time, the visible object 44 is displayed on the monitor 18, and the invisible light volume 40 and shadow volume 42 are not displayed. Instead, the brightness change process is performed on the image area set according to the relationship between the light volume 40 and the shadow volume 42 and the object 44. That is, in the present embodiment, numerical data (stencil buffer) corresponding to the visual field image shown in FIG. 3 is stored in the image processing unit 16, and this data corresponds to each pixel constituting the visual field image. In addition, numerical information is stored. In this embodiment, in the same data, “+1” is stored in association with the pixels constituting the screen area representing the portion where the object 44 is located in the light volume 40. ing. Further, “−1” is added to the numerical values associated with the pixels constituting the screen area representing the part where the object 44 is located in the shadow volume 42.
[0026]
For this reason, “1” is associated with an area of the object 44 that is in the light volume 40 and that is outside the shadow volume 42, and a part of the object 44 that is in the light volume 40 and is in the shadow volume. “0” is associated with the area representing the portion within 42, and “−1” is associated with the area representing the portion outside the write volume and representing the portion within the shadow volume 42 of the object 44. It is done. In addition, “0” is associated with other areas. When the numerical data corresponding to the visual field image is generated as described above, the present image processing apparatus increases the brightness of the pixel associated with a value larger than zero in the numerical data in the numerical image data. . When increasing the brightness, the brightness can be changed by changing it by a predetermined ratio or adding a certain amount based on the color information originally stored in association with each pixel in the visual field image. Thus, according to the present embodiment, it is possible to obtain the display of the field-of-view image shown in FIG. 4 and to prevent problems such as light beam penetration.
[0027]
FIG. 5 is a functional block diagram of the image processing apparatus according to the present embodiment. As shown in the figure, the image processing apparatus according to the present embodiment functionally includes a display unit 52, a visual field image storage unit 54, a numerical information storage unit 56, a drawing unit 58, an environment information storage unit 60, and an environment processing unit. 62 is comprised. These functions are realized when the consumer game machine 11 executes a program stored in the DVD-ROM 25.
[0028]
Here, the visual field image storage unit 54 is configured to include the VRAM provided in the image processing unit 16, and the virtual three-dimensional space constructed in the main memory 26 is set to the given space. The visual field image showing the state seen from the viewpoint is stored. This visual field image stores color information for each pixel constituting the image. The display unit 52 displays the visual field image stored in the visual field image storage unit 54, and includes the monitor 18 here. The numerical information storage unit 56 includes a VRAM (stencil buffer) provided in the image processing unit 16, and stores numerical information for each pixel constituting the visual field image. Here, the numerical information corresponding to each pixel indicates whether the pixel represents a portion located in the light volume 40 of the object 44 or a portion located in the shadow volume 42. The corresponding value is stored.
[0029]
Specifically, “+1” is stored when representing a portion in the write volume 40 and outside the shadow volume 42, and “0” is represented when representing a portion within the write volume 40 and within the shadow volume 42. ”Is stored,“ 0 ”is stored when representing a portion outside the write volume 40 and outside the shadow volume 42, and“ −1 ”when representing a portion outside the write volume and within the shadow volume Is stored.
[0030]
The environment processing unit 62 obtains environment information including the position and orientation of the object arranged in the virtual three-dimensional space, the viewpoint position, the viewing direction, the light source position, the color and intensity of light in real time (for example, every 1/60 seconds). And is configured around the microprocessor 14. The environment information calculated by the environment processing unit 62 is stored in an environment information storage unit 60 that includes the main memory 26.
[0031]
Based on the environment information stored in the environment information storage unit 60, the drawing unit 58 generates a visual field image showing a state in which the visual line direction is viewed from the viewpoint position in the virtual three-dimensional space, and the visual field image storage unit 54 To store. In addition, the drawing unit 58 represents an area (representing a part of the object 44 positioned in the light volume 40 set in the virtual three-dimensional space corresponding to the light source position in the field image stored in the field image storage unit 54 ( This is an area obtained by removing an area (see reference numeral 46) representing a portion of the object 44 located in the shadow volume 42 set in the virtual three-dimensional space based on the light source position and the position of the object 44 from the reference numeral 50). The stored contents of the visual field image storage unit 54 are updated so as to increase the brightness of the brightness increase region.
[0032]
Specifically, the drawing unit 58 associates with the pixels constituting the region representing the part of the object 44 located in the light volume 40 in the visual field image stored in the visual field image storage unit 54 and the numerical information storage unit 56. The numerical information stored in is changed to increase by one. Also, the numerical information stored in the numerical information storage unit 56 in association with the pixels constituting the region representing the portion of the object 44 located in the shadow volume 42 in the visual field image stored in the visual field image storage unit 54 is 1 Change only to decrease. Then, the brightness increase region is determined based on the numerical information stored in the numerical information storage unit 56, and the brightness of the region in the visual field image stored in the visual field image storage unit 54 is increased. Specifically, for a pixel associated with numerical information greater than 0 in the numerical information storage unit 56, the brightness of the color information stored in the visual field image storage unit 54 in association with that pixel is increased. Change as follows.
[0033]
FIG. 6 is a flowchart showing image processing by the image processing apparatus according to the present embodiment. The processing shown in the figure is executed at predetermined time intervals (for example, every 1/60 seconds) in accordance with a program stored in the DVD-ROM 25.
[0034]
In this processing, first, the environment processing unit 62 performs environment processing based on a program read from the DVD-ROM 25 (S101). In the environment processing, the positions and orientations of all static objects and dynamic objects in the virtual three-dimensional space are calculated. Static objects, such as road objects, mountain objects, grassland objects, etc., do not change the position and orientation in the virtual three-dimensional space even if time passes. On the other hand, the dynamic object changes its position and posture as time elapses, such as a player character or a car object that is an operation target of the player. The position and orientation of the dynamic object change according to the operation signal input from the controller 32. In the environment processing (S101), the viewpoint, the angle of view, and the field of view (calculated based on the line-of-sight direction and the angle of view) are also calculated. In the subsequent processing, only objects located within the visual field range are picked up and set as targets for subsequent game processing.
[0035]
Next, the drawing unit 58 performs geometry processing (S102). In the geometry processing, coordinate conversion from the world coordinate system to the viewpoint coordinate system (a coordinate system in which the viewpoint is the origin, the front of the viewpoint is the Z direction, the horizontal direction is the X direction, and the vertical method is the Y direction) is performed. Further, the color information of the vertices of each polygon constituting the object is corrected based on the light source information (light source color and position). Further, clipping processing is also performed. Furthermore, the drawing unit 58 forms a visual field image based on the vertex coordinates, vertex color information, texture coordinates, and alpha value of each polygon belonging to the visual field range, and stores it in the visual field image storage unit 54 (S103).
[0036]
Next, the drawing unit 58 initializes the numerical information storage unit 56 and stores zero in association with all the pixels constituting the visual field image. For pixels representing the object portion in the light volume 40 in particular, 1 is added to the numerical information (0) stored in the numerical information storage unit 56 in association with these pixels (S104). Furthermore, the drawing unit 58 adds −1 to the numerical information stored in the numerical information storage unit 56 in association with the pixels representing the object portion in the shadow volume 42 (S105). Thereafter, the drawing unit 58 refers to the numerical information storage unit 56 to determine a pixel associated with a numerical value greater than zero, and the color information stored in the visual field image storage unit 54 in association with the pixel. Is changed to increase the brightness (S106). The visual field image in which the color information is changed in this way is read from the visual field image storage unit 54 at a predetermined timing and displayed on the display unit 52.
[0037]
According to the image processing described above, it is possible to prevent a problem that a portion located on the back surface side as viewed from the light source position among the object portions located in the light volume 40 is displayed brightly. Similarly, it is possible to prevent a problem that a portion of the eyelid that is shielded by other objects arranged on the light source side among the object portions located in the light volume 40 is displayed brightly.
[0038]
The present invention is not limited to the above embodiment.
[0039]
For example, in the above description, only one visible object is arranged in the virtual three-dimensional space, but a plurality of objects may be arranged. In this case, the shadow volume may be set for all objects, or the shadow volume may be set only for a part of objects (for example, objects closest to the light source among objects located in the light volume). A plurality of write volumes may be set.
[0040]
【The invention's effect】
As described above, according to the present invention, an object placed in a space area such as a light volume can be suitably displayed.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a hardware configuration of an image processing apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram showing objects, shadow volumes, and light volumes arranged in a virtual three-dimensional space.
FIG. 3 is a conceptual diagram of a numerical information storage unit (stencil buffer).
FIG. 4 is a view showing a visual field image displayed on a monitor in the image processing apparatus according to the embodiment of the present invention.
FIG. 5 is a functional block diagram of an image processing apparatus according to an embodiment of the present invention.
FIG. 6 is a flowchart showing image display processing by the image processing apparatus according to the embodiment of the present invention.
FIG. 7 is a diagram for explaining a conventional volume write technique.
FIG. 8 is a diagram for explaining a problem of a conventional volume write technique.
FIG. 9 is a diagram showing an example of a visual field image displayed on a monitor by a conventional volume light technique.
[Explanation of symbols]
10 game machines, 11 consumer game machines, 12 buses, 14 microprocessors, 16 image processing units, 18 monitors, 20 sound processing units, 22 speakers, 24 DVD-ROM playback units, 25 DVD-ROMs, 26 main memories, 30 Input / output processing unit, 40,102 Light volume, 42 Shadow volume, 44,100 Object, 46 Shadow volume area, 48 Outer area, 50, Light volume area, 52 Display unit, 54 Field image storage unit, 56 Numerical information Storage unit, 58 drawing unit, 60 environment information storage unit, 62 environment processing unit.

Claims (5)

Visual field image storage means for storing a visual field image representing a state in which a virtual three-dimensional space in which an object is arranged is viewed from a given viewpoint;
Among the field of view image, a region representing a portion of the object corresponding to the light source position located in the first space region set in the virtual three-dimensional space, based on the position of the light source position and the object is a region outside the region that represents the portion of the object located in the second space region set in the virtual three-dimensional space Te, and brightness increase means for increasing the brightness of the brightness ascending region, the including images processing device In
The brightness increasing means is
Numerical information storage means for storing numerical information in association with each pixel constituting the visual field image;
Numerical information stored in the numerical information storage means in association with pixels constituting an area representing the part of the object located in the first space area in the visual field image stored in the visual field image storage means. First numerical information changing means for changing;
Numerical information stored in the numerical information storage means in association with pixels constituting an area representing the part of the object located in the second space area in the visual field image stored in the visual field image storage means. A second numerical information changing means for changing;
Lightness increase area determination means for determining the lightness increase area based on numerical information stored in the numerical information storage means;
An image processing apparatus comprising: Storing in the visual field image storage means a visual field image representing a state in which the virtual three-dimensional space in which the object is arranged is viewed from a given viewpoint;
Among the field of view image, a region representing a portion of the object corresponding to the light source position located in the first space region set in the virtual three-dimensional space, based on the position of the light source position and the object A brightness increasing step for increasing the brightness of the brightness increasing area, which is an area outside the area representing the part of the object located in the second space area set in the virtual three-dimensional space .
The brightness increasing step includes:
Storing numerical information in numerical information storage means in association with each pixel constituting the visual field image;
Numerical information stored in the numerical information storage means in association with pixels constituting an area representing the part of the object located in the first space area in the visual field image stored in the visual field image storage means. A first numerical information changing step to be changed;
Numerical information stored in the numerical information storage means in association with pixels constituting an area representing the part of the object located in the second spatial area in the visual field image stored in the visual field image storage means. A second numerical information changing step to be changed;
A lightness increase region determination step of determining the lightness increase region based on numerical information stored in the numerical information storage means;
An image processing method comprising: Field-of-view image storage means for storing a field-of-view image representing a state in which a virtual three-dimensional space in which an object is arranged is viewed from a given viewpoint, and, in the field-of-view image, set in the virtual three-dimensional space corresponding to the light source position a region representing a portion of the object located in the first space region which is the located in the second space region set in the virtual three-dimensional space based on the position of the light source position and the object In a program for causing a computer to function as a brightness increase means for increasing the brightness of a brightness increase area, which is an area outside an area representing an object part ,
The brightness increasing means is
Numerical information storage means for storing numerical information in association with each pixel constituting the visual field image,
Numerical information stored in the numerical information storage means in association with pixels constituting an area representing the part of the object located in the first space area in the visual field image stored in the visual field image storage means. First numerical information changing means for changing,
Numerical information stored in the numerical information storage means in association with pixels constituting an area representing the part of the object located in the second spatial area in the visual field image stored in the visual field image storage means. Second numerical information changing means for changing,
Brightness increase area determination means for determining the brightness increase area based on numerical information stored in the numerical information storage means,
A program characterized by that. The image processing apparatus according to claim 1 .
The image processing apparatus according to claim 1, wherein the first space area is a write volume. The image processing apparatus according to claim 1 or 4 ,
The image processing apparatus according to claim 1, wherein the second space area is a shadow volume.

Images