JP3656062B2 - Image composition apparatus and video game apparatus using the same - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image composition apparatus using a depth cueing technique and a video game apparatus using the same.
[0002]
[Background Art and Problems to be Solved by the Invention]
2. Description of the Related Art Conventionally, an image composition device that synthesizes a pseudo three-dimensional image using a computer graphics technique is known, and is widely used in, for example, video games, various simulators, and other applications.
[0003]
In such an image synthesizing apparatus, a technique called depth cueing is used in which the luminance of each polygon is changed according to the distance from the viewpoint.
[0004]
However, the conventional image synthesizing apparatus has a problem that depth cueing cannot be performed while reducing the hardware load.
[0005]
That is, when image synthesis is performed using the depth cueing technique, the luminance of each polygon is changed based on the Z coordinate value representing the distance between the viewpoint and each polygon in the virtual three-dimensional space 300, and the depth direction is used as the background. Melting is done.
[0006]
However, in the conventional technique, if the luminance in the depth direction is to be changed over N stages (N is an integer) based on the Z coordinate value, it is necessary to prepare N color palette memories and write color information. For example, it is necessary to write the base color in the palette 1, write the next color in the palette 2, and write the color that blends into the background into the last palette N. In order to smoothly change the brightness using this method, a large number of palettes must be prepared, and accordingly, there is a problem that the memory capacity increases and the entire apparatus becomes expensive.
[0007]
In particular, in today's image composition apparatuses, a large number of basic palettes are often provided in order to display colors in a fine manner. In this case, if the number of basic pallets is M, M × N pallets must be prepared, the memory capacity is further increased, and the burden on the CPU used for the calculation is increased accordingly. . For this reason, it is inevitable that the entire apparatus becomes more expensive and complicated.
[0008]
The present invention has been made in view of such a conventional problem, and an object of the present invention is to provide an image composition device capable of performing depth cueing with a simple configuration and a video game device using the image composition device. There is.
[0009]
[Means for Solving the Problems]
In order to achieve the above object, the present invention provides:
In an image synthesizer that projects and converts a three-dimensional object expressed by combining polygons in a virtual three-dimensional space onto a projection plane of a viewpoint coordinate system, calculates the previous color designation data of each pixel, and combines the display image ,
Depth cueing information setting means for setting the depth color signal for depth cueing according to the display scene, and calculating depth information in the viewpoint coordinate system of each polygon,
A first color palette for outputting a color signal as a previous color signal based on the previous color designation data output for each pixel;
Based on the depth information, the previous color signal, and the back color signal, a color signal calculation means for outputting a color signal depth-cueed for each pixel;
It is characterized by including.
[0010]
The depth cueing information setting means of the apparatus of the present invention sets the depth color signal for depth cueing according to each display scene.
[0011]
Further, the depth cueing information setting means outputs depth information of each polygon in the viewpoint coordinate system for each pixel.
[0012]
The color palette outputs a color signal as a previous color signal based on color designation data output for each pixel.
[0013]
Then, the color signal calculation means calculates and outputs the color signal depth-cueed for each pixel based on the depth information, the previous color signal, and the back color signal, and displays it on the display.
[0014]
Thus, according to the present invention, the depth-cueed color signal can be obtained by calculation by setting the depth color signal for depth-cueing according to each display scene. Therefore, even when the luminance in the depth direction is changed in multiple stages, it is not necessary to prepare a large number of color palettes, and the configuration of the entire circuit can be made simple and inexpensive.
[0015]
The present invention also provides:
In an image synthesizer that projects and converts a three-dimensional object expressed by combining polygons in a virtual three-dimensional space onto a projection plane of a viewpoint coordinate system, calculates the previous color designation data of each pixel, and combines the display image ,
Depth cueing information setting means for setting depth color designation data for depth cueing according to the display scene, and calculating depth information in the viewpoint coordinate system of each polygon,
A first color palette for outputting a color signal as a previous color signal based on the previous color designation data output for each pixel;
A second color palette for outputting a color signal as a back color signal based on the back color designation data;
Based on the depth information, the previous color signal, and the back color signal, a color signal calculation means for outputting a color signal depth-cueed for each pixel;
It is characterized by including.
[0016]
By adopting such a configuration, according to the present invention, it is not necessary to prepare a large number of color palettes even when the luminance in the depth direction is changed in multiple stages, and the configuration of the entire circuit is simple and inexpensive. can do.
[0017]
Here, the device of the present invention is
Depth information conversion means for converting and outputting actual depth information Z in the viewpoint coordinate system of each polygon into depth information Z ′ for depth cueing;
The color signal calculation means includes
It is preferable to form a color signal that is depth-cueed for each pixel based on the depth information Z ′ for depth cueing, the previous color signal, and the back color signal.
[0018]
As described above, according to the present invention, the depth information Z in the viewpoint coordinate system of each polygon is converted into depth information Z ′ by depth information conversion means. Thereby, more effective depth cueing processing can be performed according to the display scene.
[0019]
Further, the depth information converting means includes
A plurality of conversion table memories in which the different conversion tables are stored;
Depending on the display object, the actual depth information Z can be converted into depth information Z ′ for depth cueing using any one of the plurality of conversion tables.
[0020]
Thus, according to the present invention, a plurality of conversion table memories storing different conversion tables are provided, and the actual depth information Z is depth-squeezed using one of the plurality of conversion tables according to the display target. It is converted and output to depth information Z ′ for ing. Thereby, it is possible to effectively perform depth cueing according to the display target.
[0021]
Further, the depth information converting means includes
A conversion table memory storing a conversion table for converting and outputting actual depth information Z in the viewpoint coordinate system of each polygon to depth information Z ′ for depth cueing;
Table rewriting means for rewriting the contents of the conversion table stored in the conversion table memory in accordance with switching of the display scene;
It is preferable to form so that it may contain.
[0022]
In this way, by rewriting the conversion table stored in the conversion table memory in accordance with each display scene, depth cueing according to the display scene can be performed more effectively.
[0023]
In the type of apparatus that does not use the second color palette,
The depth cueing information setting means includes:
The back color signal is set as luminance signal information for each color of R, G, and B, and when the display scene is switched, the luminance signal information is gradually changed toward the target value after switching over time. It is preferable.
[0024]
In this case, the depth cueing information setting means
Luminance signal information h expressed by the following equation, where T is the time required for scene switching and t is the elapsed time, from the target value i of the previous scene to the target value j of the next scene at the time of scene switching. For each color of R, G, B,
h = (j−i) × (t / T) + i
It is preferable that the calculated values are sequentially set as the back color signal.
[0025]
In this way, the depth cueing process at the time of scene switching can be performed smoothly.
In the type of apparatus using the second color palette,
The depth cueing information setting means includes:
At the time of switching the display scene, the luminance signal information of each color of R, G, B of the back color signal is read out from the second color palette so as to gradually change toward the target value after switching over time. It is preferable to form so as to calculate and output the back color designation data.
[0026]
In this case, the depth cueing information setting means
Luminance signal information h expressed by the following equation, where T is the time required for scene switching and t is the elapsed time, from the target value i of the previous scene to the target value j of the next scene at the time of scene switching. It is preferable that the back color designation data for reading out from the second color palette is calculated and output for each of R, G, and B colors.
[0027]
h = (j−i) × (t / T) + i
In this way, the depth cueing process at the time of scene switching can be performed smoothly.
[0028]
The depth cueing information setting means includes
For each of the polygons, processing target identification data as to whether or not to be a target of depth cueing processing is calculated and output,
The color signal calculation means includes
Based on the processing target identification data, it can be determined whether or not the pixel is a polygon pixel to be processed, and the depth-cueed color signal is calculated for the processing target pixel.
[0029]
In this way, it is determined whether or not to display the depth cueing process for each display polygon, and the depth cueing process is selectively performed in units of polygons, so that objects that are not subject to depth cueing are selected on the display. Can be set automatically. For example, when a night scene is displayed, a polygon in which light leaks from the window can be effectively displayed by not making the polygon representing the building window a depth cueing target.
[0030]
The first color palette is
It is formed to output R, G, B color signals with N levels of brightness,
The color signal calculation means includes
The front color signal is a and the back color signal is b.
c = (b−a) × (Z ′ / N) + a
Thus, the color signal c depth-cueed for each pixel can be output.
[0031]
As described above, by performing a predetermined linear interpolation calculation, the depth-cueed color signal can be easily obtained for each pixel.
[0032]
The video game device of the present invention is
Player operating means operated by the player;
Based on an input signal from the player operation means and a pre-stored game program, a predetermined game calculation is performed in which a three-dimensional object represented by combining polygons appears in a virtual three-dimensional game space, The image synthesizing apparatus of the present invention formed to project the three-dimensional object onto the projection plane of the viewpoint coordinate system, calculate color designation data for each pixel, and synthesize a display image;
And a game image is displayed on a display.
[0033]
By doing so, it is possible to obtain a video game apparatus capable of displaying a depth-cueed game image on a display using an image composition apparatus having a simple configuration.
[0034]
DETAILED DESCRIPTION OF THE INVENTION
Next, preferred embodiments of the present invention will be described in detail with reference to the drawings.
[0035]
FIG. 2 schematically shows the appearance of the business video game apparatus 10 of the embodiment.
[0036]
The commercial video game apparatus 10 according to the embodiment is configured such that a player drives a racing car that runs on a circuit course and competes with a computer car operated by a computer or a racing car driven by another player in order and time. Yes.
[0037]
For this reason, the arcade game apparatus 10 is formed in the same manner as an actual driver seat of a racing car. When a certain game fee is paid, the game is started, and the player sitting on the seat 12 operates the handle 14, the shift lever 16, and other pedals while looking at the scenery displayed on the display 18 and imaginary. Drive a racing car and play a game.
[0038]
FIG. 1 is a block diagram of the professional video game apparatus.
[0039]
The commercial video game apparatus 10 according to the embodiment includes an operation unit 20, a game image calculation unit 22, a palette controller 24, and the display 18.
[0040]
The operation unit 20 is a member operated by the player, such as the handle 14, the shift lever 16, and other pedals shown in FIG.
[0041]
The game image calculation unit 22 performs various game calculations based on an input signal from the player operation unit 20 and a predetermined game program, and uses the palette controller 24 to display a game for a driving game on the display 18. Display the screen. Here, the game image calculation unit 22 performs a game calculation so that the racing car moves in a predetermined three-dimensional game space by the player's control, and thus various objects and objects in the three-dimensional game space are recorded. The moving body is perspective-projected to a predetermined projection surface to form a game screen, which is displayed on the display 18.
[0042]
FIG. 3 shows a principle diagram of such an image composition method.
[0043]
In the game image calculation unit 22 of the embodiment, information regarding the three-dimensional game space 100 and the three-dimensional object 110 appearing in the three-dimensional game space 100 is stored in advance. The image information related to the three-dimensional object 110 is expressed as a shape model composed of a plurality of polygons 112-1, 112-2, 112-3... And stored in advance in a memory.
[0044]
Taking a driving game as an example, the three-dimensional object 110 is a racing car that appears in the three-dimensional game space 100. In the three-dimensional game space 100, there are various other three types representing backgrounds such as roads and houses. Dimensional objects are placed.
[0045]
When the player 200 operates the handle or the like of the operation unit 20 to perform operations such as rotation and translation, the game image calculation unit 22 is a three-dimensional vehicle that is a racing car, a road, or a house based on the operation signal and the game program. Calculations such as rotation and translation of the object 110 are performed in real time. The three-dimensional object 110 and other three-dimensional objects are perspective-projected on the perspective projection surface 120 of the viewpoint coordinate system, and are displayed on the display 18 as a pseudo three-dimensional image 122.
[0046]
Therefore, the player 200 operates the operation unit 20 and steers the racing car, thereby virtualizing a state in which the player 200 participates in the race while driving the racing car in the circuit course set in the three-dimensional game space 100. It can be simulated.
[0047]
When a computer graphics method is used, the shape model of the three-dimensional object 110 is created using an independent body coordinate system. That is, each polygon constituting the three-dimensional object 110 is arranged on this body coordinate system, and its shape model is specified.
[0048]
Further, the three-dimensional game space 100 is configured using the world coordinate system, and the three-dimensional object 110 represented using the body coordinate system is arranged in the world coordinate system according to the motion model.
[0049]
Then, data is converted into a viewpoint coordinate system in which the position of the viewpoint 210 is the origin and the direction of the line of sight is the positive direction of the Z axis, and each coordinate is perspective-projected into the screen coordinate system that is the projection plane 120. Then, the color designation data 300 of the perspective-projected image is calculated for each pixel and output to the color palette memory 28 shown in FIG.
[0050]
The color palette memory 28 is stored as data of 256 different luminances in which the three primary colors of R, G, and B are in the range of 0 to 255. The R, G, and B luminances are designated by the color designation data 300, and a color signal that is a combination thereof is output as the previous color signal 310. For example, the luminance of each primary color of R, G, B is represented by a number from 0 (lowest) to 255 (highest). For example, since black has no color at all, the luminance is represented by (0, 0, 0) when represented by (R, G, B). Pure red is (255, 0, 0), mixed color of red and blue is (124, 0, 44), etc. A color signal composed of such combination information is designated for each pixel by the color designation data 300 and is output as a previous color signal 310.
[0051]
As a result, an image in the field of view of the three-dimensional game space 100 seen from the viewpoint 210 is displayed in color on the display 18.
[0052]
In particular, the game image calculation unit 22 of the embodiment is formed so that the position of the viewpoint 210 can be arbitrarily changed in the three-dimensional game space 100 configured by the world coordinate system. The business video game apparatus 10 of the embodiment sets the viewpoint position to the driver's seat position of the racing car during the game. As a result, on the display 18, the scenery when the front is viewed from the driver's seat of the racing car operated by the player is displayed as a game screen, and the player 200 actually drives the racing car. You can drive as you feel.
[0053]
The feature of the present invention is that the depth cueing process of the color image displayed on the display is easily and effectively performed without increasing the memory capacity of the color palette memory 28 or the like.
[0054]
For this reason, the image composition apparatus according to the embodiment is configured to include a depth cueing information setting unit 26 and a palette controller 24.
[0055]
The depth cueing information setting unit 26 is provided in the game image calculation unit 22 and is configured to output a back color signal 320 as luminance signal information of each color of R, G, and B according to each display scene. ing.
[0056]
In this embodiment, four scenes of morning, noon, evening, and night are used as will be described later. Depending on the scene, for example, a color signal of white in the morning, blue in the day, red in the evening, and black in the evening is calculated and output as the back color signal.
[0057]
Note that handling many color signals in the game image calculation unit 22 may cause a problem in calculation efficiency. For this reason, when the calculation processing of the back color signal to be used increases, for example, when handling a plurality of back color signals in one display scene, the palette memory 29 dedicated to the back color as shown in FIG. Is preferably used. Then, all the color signals used as the back color signal are stored in the palette memory 29 dedicated to the back color. That is, a plurality of color signals composed of combinations of the R, G, and B primary colors are stored as the back color signal.
[0058]
The depth cueing information setting unit 26 calculates color designation data 318 for calling a desired back color signal 320 from the palette memory 29 dedicated to the back color according to each display scene, and outputs the data to the palette memory 29. It is formed as follows. Thus, even when there are many types of back color signals to be used, a desired back color signal 320 corresponding to the display screen can be output from the palette memory 29 without imposing a heavy burden on the game image calculation unit 22.
[0059]
Further, as shown in FIG. 1, the depth cueing information setting unit 26 calculates flag data 330 (processing target identification data) as to whether or not to make a depth cueing process target for each polygon, Depth information Z (Z is represented as a representative value of polygons) and table designation data 340 in the viewpoint coordinate system are calculated and output. Here, the flag data 330, the table specifying data 340, and the Z representative value Z are output as accompanying data in synchronization with the output of the color specifying data 300 output for each pixel.
[0060]
Here, the depth cueing information setting unit 26 is configured to calculate and set the back color signal as luminance signal information for each color of R, G, and B. When the display scene is switched, the luminance signal information is gradually changed toward the target value after switching as time elapses.
[0061]
For example, when switching the display scene, if the time required for scene switching is T and the elapsed time from the start of scene switching is t, the change in the luminance signal from the target value i of the previous scene to the target value j of the next scene Is calculated for each color of R, G, and B as luminance signal information h shown in the following equation.
[0062]
h = (j−i) × (t / T) + i (1)
The luminance signal information of each color of R, G, and B calculated in this way is sequentially calculated and output as the back color signal at the time of scene switching. Thereby, the screen at the time of scene switching can be changed naturally.
[0063]
As shown in FIG. 8, when the rear color dedicated palette memory 29 is used, the depth cueing information setting is similarly performed so that the rear color signal at the time of scene switching is output from the palette memory 29 while gradually changing. The unit 26 may be formed so as to calculate the back color designation data 318. In this way, in the embodiment shown in FIG. 8 as well, the screen at the time of scene switching can be changed naturally as in the embodiment shown in FIG.
[0064]
The palette controller 24 includes the color palette memory 28, an information conversion unit 30, and a color signal calculation unit 36.
[0065]
The information conversion unit 30 is configured to convert the depth information Z in the viewpoint coordinate system of each polygon into depth information Z ′ for depth cueing and output it to the color signal calculation unit 36.
[0066]
In the embodiment, the information conversion unit 30 includes a table rewriting unit 32 and a conversion table 34.
[0067]
The table rewriting unit 32 displays on the conversion table 34 based on scene setting data for each display scene (for example, display scenes such as morning, noon, evening, night, etc.) calculated and set by the game image calculation unit 22. Calculate and set the conversion table according to the scene. This conversion table is a data table for converting the depth information Z into depth information Z ′ for depth cueing and outputting it. Depending on how the conversion table 34 is set, the atmosphere of each display scene can be effectively produced as described later.
[0068]
The color signal calculation unit 36 determines whether or not the input color signal 310 is subject to depth cueing based on the data input in this way. If it is determined that it is the target, a predetermined depth cueing calculation is performed, and a depth-cueed color signal 350 is output. This color signal 350 is A / D converted by an A / D converter (not shown) and is displayed. To enter.
[0069]
That is, the color signal calculation unit 36 determines whether or not the color signal 310 of the pixel is a target of the depth cueing process based on the flag data 330 output for each pixel. If not, the color signal 310 output from the color palette memory 28 is output to the display 18 as it is. When the depth queuing process is performed, the previous color signal 310 input from the color palette memory 28, the input back color signal 320, and the converted depth information Z input from the conversion table 34 are displayed. Based on ′, color signal calculation processing based on the following equation is performed. Here, a represents the front color signal 310, b represents the back color signal 320, and N represents the luminance level of the color palette memory 28 (N = 255 in the embodiment).
[0070]
c = (b−a) × (Z ′ / N) + a (2)
Then, the color signal C depth-cueed by the calculation is obtained and output to the display 18.
[0071]
In this manner, the depth signal for each polygon can be calculated and displayed on the display 18.
[0072]
FIG. 4 shows a principle diagram of the depth cueing process of the embodiment. In the drawing, the front color 310 is set to a depth position of Z ′ = 0, and the back color 320 is set to a depth position of Z ′ = 255. The depth color 320 is set to Z ′ = 255, which means that the depth-cueed output color merges with the color of the depth color 320 as the depth Z ′ of each pixel increases. I mean.
[0073]
That is, as described above, the output color 350 of each pixel is obtained by linear interpolation using the depth information Z ′ for depth cueing, the front color “a”, the back color “b”, and the like according to the equation (2).
[0074]
This linear interpolation operation is performed for each of the three primary colors R, G, and B output from the color palette memory 28 as the previous color signal 310. In this way, the depth-cueed color signal C is output between the arbitrarily set back color 320 only by using the color palette memory 28 in which basic color data is written. Can do.
[0075]
In particular, the palette controller 24 of the embodiment does not perform depth cueing using the actual depth information Z of each pixel, but converts this into depth information Z ′ for depth cueing using a conversion table. The depth cueing process is performed. Therefore, when linear interpolation is performed using the actual depth information Z, the output color C becomes P1 shown in FIG. 4, whereas in the embodiment, the actual depth information Z is used as the depth information suitable for the display scene. It is formed so as to obtain an output color 350 converted into Z ′ and subjected to depth queuing processing.
[0076]
That is, in the present invention, the depth cueing process can be performed using the actual depth information Z, but the actual depth information Z is suitable for depth cueing using the information conversion unit 30 as in the present embodiment. Therefore, more effective depth cueing processing can be performed.
[0077]
Furthermore, in the present embodiment, by switching the conversion table stored in the conversion table 34 according to each display scene, the optimum depth cueing process suitable for the display scene can be performed by calculation.
[0078]
The conversion table 34 may be the same for all polygons. For example, a plurality of conversion tables 34 are prepared according to the characteristics of the polygon (characteristics to be displayed) and used for each polygon. The table to be selected may be selected by the table designation data 340. By doing so, it is possible to obtain more detailed depth cueing, for example, expressing an object illuminated by light at night or expressing a car tail lamp in fog.
[0079]
A plurality of the back color signals 320 may be set for one scene. In this way, for example, when a tunnel with yellow light is approaching while traveling on a night road, the tunnel part is set to a yellow back color signal, and the other parts are Depth cueing processing can be performed in which the black back color signal representing the night scene is set and expressed. That is, it is possible to independently set the depth color signals according to the display target, and to perform depth cueing processing with a richer effect.
[0080]
FIG. 5 shows a flowchart showing the depth cueing processing operation of the apparatus of the embodiment, and FIGS. 6 and 7 show specific examples of the display image.
[0081]
First, it is assumed that the game image calculation unit 22 calculates the game screen shown in FIG. 6 and displays it on the display 18 without performing depth cueing processing. In this case, the game image calculation unit 22 outputs flag data 330 indicating that depth cueing processing is not performed on all pixels, and outputs color designation data 300 for each pixel.
[0082]
Therefore, the color signal 310 itself output from the color palette memory 28 is displayed on the display 18 in accordance with the flow of steps S1, S2, and S3 of FIG.
[0083]
Next, the game screen displayed on the display 18 is divided into four scenes of morning → daytime → evening → night → morning, and the game image calculation unit 22 according to the embodiment has its own depth cue according to each scene. Assume that ingress processing is performed.
[0084]
In this case, in the morning scene, the white color representing the morning glory is set as the back color signal 320, and in the daytime scene, the blue color representing the bright daytime is set (in this case, the distant view is the blue sea or the blue Set in red for the evening scene, and set black for the darkness in the evening scene. At this time, switching of the back color signal 320 at the time of scene switching is performed gradually according to the following equation so that the color change does not become unnatural. Here, b represents the calculated back color signal, b1 represents the back color signal of the previous scene, and b2 represents the back color signal of the next scene. However, k is assumed to change sequentially from 0 to 255 continuously or discontinuously for each frame.
[0085]
b = (b2−b1) × (k / 255) + b1 (3)
Further, the table rewriting unit 32 converts the conversion table of the conversion table 34 to Z ′ = f1 (Z), Z ′ = f2 (Z), z ′ = f3 (for each scene of morning, noon, evening, and night). Z) and z ′ = f4 (Z) are sequentially rewritten. At this time, rewriting at the time of switching of each scene is performed so that the color change does not become unnatural. For example, when switching from the morning to the noon scene, the conversion table is switched from f1 (Z) to f2 (Z). At this time, the conversion table gradually approaches from f1 (Z) to f2 (Z). Rewrite the table contents.
[0086]
For example, the conversion formula in which the conversion of the depth information Z is expressed by a linear function
f1 (Z) = 1.5 · Z
f2 (Z) = 2.0 · Z
When the setting scene is switched, the conversion table f (Z) is, for example, f (Z) = 1.5 · Z, f (Z) = 1.6 · Z, f (Z) = 1. .7 · Z... F (Z) = 2.0 · Z.
[0087]
When the depth cueing process is performed, the game image calculation unit 22 calculates and outputs the color designation data 300 for each pixel constituting the game screen, and synchronizes with the output of the color designation data 300 to obtain the depth cue. The back color signal 320, the flag data 330, the table designation data 340, and the depth information Z are output as the accompanying data for the ing. In the embodiment of FIG. 8, the back color signal 320 is output from the palette memory 29.
[0088]
Then, based on the flag data 330 output for each pixel, it is determined whether or not the pixel is a pixel to which depth cueing is applied (step S2). Then, the back color signal 320 is set (step S4), the conversion table 34 to be used is further selected based on the table designation data 340, and the depth information Z for depth cueing is selected based on the Z representative value of the polygon based on the selected conversion table. Convert to ´ and output.
[0089]
Based on the data thus obtained, the color signal 310 output from the color palette memory 28 is linearly interpolated according to the equation (2), and the color signal 350 subjected to the depth cueing process is output ( Step S7).
[0090]
The image synthesizing apparatus according to the embodiment repeats such processing for each pixel. In particular, the operation is performed so as to selectively perform the depth cueing process on the polygon for which the depth cueing process is designated by the flag data 330 (steps S5 to S7).
[0091]
With the above configuration, for example, in the morning scene setting, when the morning conversion table Z ′ = f1 (Z) is set in the conversion table 34 and white is set as the back color signal 320, FIG. The game screen shown in FIG. 5 is processed by depth cueing so that it becomes a screen with morning glory.
[0092]
At this time, the apparatus according to the embodiment is configured such that the conversion table 34 can be selected by the table designation data 34 for each display polygon. For this reason, for example, the conversion table 34 in which the polygon group 430 near the coast displayed in the center in the figure and the polygon group 430 on the land side displayed in the right side in the figure can be used respectively. As a result, the game screen is configured so that, for example, palm trees displayed near the coast are displayed as objects in a thick mist, and buildings displayed on the right side in the figure are displayed as objects that can be seen far away. it can.
[0093]
When the scene is switched from morning to noon, the conversion table in the conversion table 34 is rewritten so as to gradually switch from f1 (Z) to f2 (Z), and the back color signal 320 is also changed from white to blue. It is set to change gradually.
[0094]
Thereby, the game screen shown in FIG. 6 is displayed as a bright daytime screen reflecting the blueness of the sky. At this time, the conversion table 34 converts the depth information Z into a value of Z ′ for depth cueing so that a far object can be seen clearly.
[0095]
Further, when the scene is switched from noon to evening, the conversion table of the conversion table 34 is similarly rewritten, and the back color signal 320 is set to red to give the evening atmosphere, as shown in FIG. The game screen will be displayed as an evening image dyed in the sunset.
[0096]
Further, when the scene is switched to night, the conversion table of the conversion table 34 is similarly rewritten, and the back color signal 320 is set to black representing the darkness of the night. At this time, the conversion table 34 needs to perform image processing so that an object that is relatively well visible on the game screen shown in FIG. 6 is not visible due to the darkness of the night. Therefore, the conversion table is set so that objects that are more than a certain distance are hardly visible. As a result, as shown in FIG. 7, all objects that are more than a certain distance from the viewpoint position are displayed as black that blends into the back color signal, and a night scene can be produced.
[0097]
In particular, in the image synthesizing apparatus according to the embodiment, such depth cueing processing is performed for each polygon. Therefore, the polygon representing the window 410 of the building 400 is set by calculating the flag data 330 so that the depth cueing process is not performed, thereby synthesizing a game screen in which only the building window 410 appears brightly shining in a dark landscape. Can be displayed.
[0098]
In this way, objects that are not subject to depth cueing can be selectively set and displayed on the screen, so that "night lights" etc. can be expressed and "headlights of oncoming vehicles" etc. can be expressed effectively be able to.
[0099]
In the above-described embodiment, the change in time such as morning, noon, evening, and night is expressed by the depth cueing process. However, the present invention is not limited to this, and various scene settings can be effectively performed. For example, it can be used to change the weather (scenes with fog, clouds, gas, etc.) and other special expressions on the screen.
[0100]
In the above embodiment, a plurality of conversion table memories storing different conversion tables are provided, and the conversion table stored in each conversion table memory is rewritten according to the display scene. The depth cueing may be performed without rewriting the conversion table stored in the table.
[0101]
In the above-described embodiment, the present invention has been described by taking the case where the game screen of the video game apparatus is synthesized as an example. Can be used widely.
[0102]
In addition, the image composition apparatus of the present invention can be widely applied to image composition apparatuses that output the color designation data 300 using various image composition methods such as texture mapping and paint processing.
[Brief description of the drawings]
FIG. 1 is a block diagram of an image composition device for a video game to which the present invention is applied.
FIG. 2 is an external perspective explanatory view of a commercial video game apparatus using the image composition apparatus shown in FIG. 1;
FIG. 3 is an explanatory diagram of a principle of creating a pseudo three-dimensional image of the image composition device according to the embodiment.
FIG. 4 is a diagram illustrating the principle of depth cueing processing performed by the image composition apparatus according to the embodiment.
FIG. 5 is a flowchart illustrating the depth cueing processing operation of the image composition apparatus according to the embodiment.
FIG. 6 is an explanatory diagram of a game screen created by the image composition device of the embodiment.
FIG. 7 is an explanatory diagram showing an example of a game screen that has been subjected to depth cueing processing for a night scene.
FIG. 8 is a block diagram showing another example of an image composition device for a video game to which the present invention is applied.
[Explanation of symbols]
18 display
26 Depth cueing information setting means
28 Color palette
30 Information converter
36 color signal calculation means
300 color specification data
320 Back color signal
350 color signal

Claims (5)

In an image synthesizer for projecting and transforming a three-dimensional object represented in a virtual three-dimensional space onto a projection plane of a viewpoint coordinate system, calculating a previous color designation data of each pixel, and synthesizing a display image,
Depth cueing information setting means for setting depth color signals for depth cueing according to a display scene and calculating depth information of the three-dimensional object in the viewpoint coordinate system;
A first color palette for outputting a color signal as a previous color signal based on the previous color designation data output for each pixel;
Based on the depth information, the previous color signal, and the back color signal, a color signal calculation means for outputting a color signal depth-cueed for each pixel;
Depth information conversion means for converting and outputting actual depth information Z of the three-dimensional object in the viewpoint coordinate system to depth information Z ′ for depth cueing according to the display scene ;
The color signal calculation means includes
An image synthesizing apparatus that outputs a depth signal for each pixel based on the depth information Z ′ for depth cueing, the previous color signal, and the back color signal. In an image synthesizer for projecting and transforming a three-dimensional object represented in a virtual three-dimensional space onto a projection plane of a viewpoint coordinate system, calculating a previous color designation data of each pixel, and synthesizing a display image,
Depth cueing information setting means for setting depth color designation data for depth cueing according to a display scene and calculating depth information of the three-dimensional object in the viewpoint coordinate system;
A first color palette for outputting a color signal as a previous color signal based on the previous color designation data output for each pixel;
A second color palette for outputting a color signal as a back color signal based on the back color designation data;
Based on the depth information, the previous color signal, and the back color signal, a color signal calculation means for outputting a color signal depth-cueed for each pixel;
Depth information conversion means for converting and outputting actual depth information Z of the three-dimensional object in the viewpoint coordinate system to depth information Z ′ for depth cueing according to the display scene ;
The color signal calculation means includes
An image synthesizing apparatus that outputs a depth signal for each pixel based on the depth information Z ′ for depth cueing, the previous color signal, and the back color signal. In an image synthesizer for projecting and transforming a three-dimensional object expressed by combining polygons in a virtual three-dimensional space onto a projection plane of a viewpoint coordinate system, calculating a previous color designation data of each pixel, and synthesizing a display image,
A depth cueing information setting means for setting depth information in the viewpoint coordinate system of each polygon, while setting a depth color signal for depth cueing according to the characteristics of each polygon,
A first color palette for outputting a color signal as a previous color signal based on the previous color designation data output for each pixel;
Based on the depth information, the previous color signal, and the back color signal, a color signal calculation means for outputting a color signal depth-cueed for each pixel;
Depth information converting means for converting and outputting the actual depth information Z of each polygon in the viewpoint coordinate system to depth information Z ′ for depth cueing according to the characteristics of each polygon ;
The color signal calculation means includes
An image synthesizing apparatus that outputs a depth signal for each pixel based on the depth information Z ′ for depth cueing, the previous color signal, and the back color signal. In an image synthesizer for projecting and transforming a three-dimensional object expressed by combining polygons in a virtual three-dimensional space onto a projection plane of a viewpoint coordinate system, calculating a previous color designation data of each pixel, and synthesizing a display image,
Depth data specifying data for depth cueing according to the characteristics of each polygon, and depth cueing information setting means for calculating depth information of each polygon in the viewpoint coordinate system;
A first color palette for outputting a color signal as a previous color signal based on the previous color designation data output for each pixel;
A second color palette for outputting a color signal as a back color signal based on the back color designation data;
Based on the depth information, the previous color signal, and the back color signal, a color signal calculation means for outputting a color signal depth-cueed for each pixel;
Depth information converting means for converting and outputting actual depth information Z of each polygon in the viewpoint coordinate system to depth information Z ′ for depth cueing according to the characteristics of each polygon ;
The color signal calculation means includes
An image synthesizing apparatus that outputs a depth signal for each pixel based on the depth information Z ′ for depth cueing, the previous color signal, and the back color signal. Player operating means operated by the player;
Based on an input signal from the player operation means and a pre-stored game program, a predetermined game calculation is performed in which a three-dimensional object represented by combining polygons appears in a virtual three-dimensional game space, The image composition device according to any one of claims 1 to 4 , wherein the three-dimensional object is perspective-projected to a projection plane of a viewpoint coordinate system, color designation data is calculated for each pixel, and a display image is synthesized.
A game apparatus that displays a game image on a display.

Images