JP2003123091A - Image composition system and video game player using the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image composition system for performing depth cueing with a simple constitution. SOLUTION: This image composition system can perform depth queuing. The system is formed to perspectively transform and project a 3-D object represented by a combination of polygons in a virtual 3-D space onto a projection plane in a view-point coordinate system and to calculate color specifying data for each pixel to display an image on a display 18. The system includes a depth information transforming unit 30 for transforming depth information Z in the view-point coordinate system of each polygon into depth information Z' for the depth queuing to output the depth information Z', a color palette 28 responsive to the color specifying data 300 outputted for each pixel for outputting a color signal as a front-color signal, a depth cueing information setting means 26 for calculating a depth cueing back-color signal 320 for depth cueing depending on a displayed scene, and a color signal calculating means 36 responsive to the depth cueing information Z' for the depth cuing, front-color signal and back-color signal for outputting a depth-cued color signal 350 for each pixel.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image synthesizing apparatus using a depth cueing method and a video game apparatus using the same.

[0002]

2. Description of the Related Art Conventionally, an image synthesizing device for synthesizing a pseudo three-dimensional image using a computer graphics technique has been known. For example, a video game, various simulators and other applications. Widely used in.

In such an image synthesizing apparatus, a method called depth cueing is used in which the brightness of each polygon is changed according to the distance from the viewpoint.

However, the conventional image synthesizing apparatus has a problem that depth queuing cannot be performed while reducing the load on the hardware.

That is, when performing image synthesis using the depth cueing method, based on the Z coordinate value representing the distance between the viewpoint and each polygon in the virtual three-dimensional space 300,
The brightness of each polygon is changed to blend the depth direction into the background.

However, in the prior art, if the luminance in the depth direction is to be changed over N steps (N is an integer) based on the Z coordinate value, it is necessary to prepare N color palette memories and write the color information. There is. For example, it is necessary to write the base color to the palette 1, write the next color to the palette 2, ... Write the color that blends into the background to the last palette N. In order to smoothly change the brightness using this method, a large number of pallets must be prepared, and the memory capacity increases accordingly, resulting in a problem that the entire apparatus becomes expensive.

Particularly, in today's image synthesizing apparatuses, a large number of basic palettes are often provided in order to display the hues carefully. In this case, assuming that the number of basic pallets is M, M × N pallets must be prepared, the memory capacity is further increased, and the load on the CPU used for calculation is correspondingly large. . Therefore, it is unavoidable that the entire apparatus becomes more expensive and complicated.

The present invention has been made in view of such conventional problems, and an object thereof is an image synthesizing apparatus capable of performing depth cueing with a simple structure and a video game apparatus using the same. To provide.

[0009]

In order to achieve the above object, the present invention projects and transforms a three-dimensional object represented by combining polygons in a virtual three-dimensional space onto a projection plane of a viewpoint coordinate system. In an image synthesizing device for synthesizing front color designation data of each pixel and synthesizing a display image, a depth color signal for depth cueing is set according to a display scene, and depth information of each polygon in the viewpoint coordinate system is set. Depth cueing information setting means for calculating
A first color palette that outputs a color signal as a previous color signal based on the previous color designation data that is output for each pixel, and a depth skew for each pixel based on the depth information, the previous color signal, and the back color signal. And a color signal calculation means for outputting the injected color signal.

The depth cueing information setting means of the apparatus of the present invention sets the depth color signal for depth cueing according to each display scene.

Further, the depth cueing information setting means outputs depth information of each polygon in the viewpoint coordinate system for each pixel.

The color palette outputs a color signal as a previous color signal based on the color designation data output for each pixel.

Then, the color signal calculating means calculates and outputs the depth cueed color signal for each pixel based on the depth information, the front color signal and the back color signal, and displays the color signal on the display.

As described above, according to the present invention, the depth-cueed color signal can be calculated by setting the depth color signal for depth cueing according to each display scene. Therefore, even when the brightness in the depth direction is changed in multiple stages, it is not necessary to prepare a large number of color palettes, and the configuration of the entire circuit can be made simple and inexpensive.

Further, according to the present invention, a three-dimensional object represented by combining polygons in a virtual three-dimensional space is
Projection conversion to the projection plane of the viewpoint coordinate system, in the image synthesizing device for synthesizing the display image by calculating the front color designation data of each pixel, while setting the depth color designation data for depth cueing according to the display scene, Depth cueing information setting means for calculating depth information of each polygon in the viewpoint coordinate system, and a first color palette for outputting a color signal as a front color signal based on the previous color designation data output for each pixel. And a second color palette that outputs a color signal as a back color signal based on the back color designation data, and a color signal depth cueed for each pixel based on the depth information, the previous color signal, and the back color signal. And a color signal calculating means for outputting.

By adopting such a configuration,
According to the present invention, even when the brightness in the depth direction is changed in multiple stages, it is not necessary to prepare a large number of color palettes, and the configuration of the entire circuit can be made simple and inexpensive.

Here, the apparatus of the present invention includes depth information converting means for converting and outputting the actual depth information Z in the viewpoint coordinate system of each polygon into depth information Z'for depth cueing, and the color signal It is preferable that the arithmetic means is formed so as to output a depth-cueed color signal for each pixel based on the depth information Z ′ for depth cueing, the front color signal, and the back color signal.

In this way, according to the present invention, the actual depth information Z in the viewpoint coordinate system of each polygon is converted into depth information for depth cueing by the depth information conversion means and output. Thereby, more effective depth cueing processing can be performed according to the display scene.

Further, the depth information converting means includes a plurality of conversion table memories in which the different conversion tables are stored, and the actual depth information Z is obtained by using one of the plurality of conversion tables according to a display object. The depth information Z ′ for depth cueing can be converted and output.

In this way, according to the present invention, a plurality of conversion table memories in which different conversion tables are stored are provided, and any one of the plurality of conversion tables is used to display the actual depth information Z according to the display object. Is converted into depth information Z'for depth cueing and output. This allows
It is possible to effectively perform depth cueing according to the display target.

Further, the depth information conversion means is the actual depth information Z in the viewpoint coordinate system of each polygon.
To the depth information Z ′ for depth cueing, a conversion table memory storing a conversion table and a table writing for rewriting the contents of the conversion table stored in the conversion table memory according to switching of display scenes. It is preferable to form the replacement means.

As described above, by rewriting the conversion table stored in the conversion table memory according to each display scene, it is possible to more effectively perform depth cuing according to the display scene. .

In the apparatus of the type that does not use the second color palette, the depth cueing information setting means sets the depth color signal as luminance signal information of each color of R, G and B, and displays it. At the time of switching, it is preferable that the luminance signal information is formed so as to gradually change toward the target value after switching according to the passage of time.

In this case, the depth cueing information setting means changes the back color signal from the target value i of the previous scene to the target value j of the next scene when the scene is switched, and the time required for the scene switching is T. , Elapsed time is t, and luminance signal information h shown in the following equation is calculated for each color of R, G, B, and h = (j−i) × (t / T) + i It is preferable to form them so that they are sequentially set.

By doing so, the depth cueing process at the time of scene switching can be smoothly performed. Further, in the apparatus of the type using the second color palette, the depth cueing information setting means displays the luminance signal information of each color of R, G, B of the back color signal with the passage of time when switching the display scene. Accordingly, it is preferable to form so as to arithmetically output the back color designation data to be read from the second color palette so as to gradually change toward the target value after switching.

In this case, the depth cueing information setting means changes the back color signal from the target value i of the previous scene to the target value j of the next scene when the scene is switched, and the time required for the scene switching is T. , The elapsed time is t, and the luminance signal information h shown in the following equation is used as the second signal for each color of R, G, and B.
It is preferable to form so as to arithmetically output the back color designation data to be read from the color palette.

H = (j-i) × (t / T) + i By doing so, the depth cueing process at the time of scene switching can be smoothly performed.

The depth cueing information setting means arithmetically outputs, for each of the polygons, processing target identification data indicating whether or not to be a target of the depth cueing process.
The color signal calculation means may be configured to determine whether or not the pixel of the polygon to be processed based on the processing target identification data, and to calculate the depth cueed color signal for the processing target pixel. .

As described above, it is determined for each display polygon whether or not the depth cuing process is to be performed, and the depth squeezing process is selectively performed on a polygon-by-polygon basis. Can be selectively set on. For example, when a night scene is displayed, the polygon representing the window of the building is not set as the depth cueing target, so that the building where the light leaks from the window can be effectively displayed.

The first color palette is formed so as to output R, G, and B color signals having N levels of brightness, and the color signal calculation means outputs the front color signal a and the back color signal b. And the color signal c depth-skewed for each pixel based on the following equation c = (b−a) × (Z ′ / N) + a
Can be configured to output.

By performing the predetermined linear interpolation calculation in this manner, the depth-cueed color signal can be easily obtained for each pixel.

Further, the video game device of the present invention, in the virtual three-dimensional game space, based on the player operating means operated by the player, the input signal from the player operating means, and the game program stored in advance, A predetermined game operation in which a three-dimensional object expressed by combining polygons appears is performed, the three-dimensional object is projected and converted on the projection plane of the viewpoint coordinate system, and color designation data is calculated for each pixel to display a display image. And the image synthesizing device of the present invention formed so as to synthesize the game image, and displaying a game image on a display.

By doing so, it is possible to obtain a video game device capable of displaying a depth-scue processed game image on a display by using an image synthesizing device having a simple structure.

[0034]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, preferred embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 2 schematically shows the outer appearance of the professional-use video game device 10 of the embodiment.

The commercial video game device 10 of the embodiment is
It is formed so that a player drives a racing car running on a circuit course and competes with a computer car operated by a computer and a racing car operated by another player for ranking and time.

Therefore, the arcade game machine 10 is
It is formed like the driver's seat of an actual racing car. Then, when a certain game fee is paid, the game is started, and the player sitting on the seat 12 operates the steering wheel 14,
While operating the shift lever 16 and other pedals,
While watching the scenery displayed on the display 18, drive a fictitious racing car and play a game.

FIG. 1 shows a block diagram of the commercial video game apparatus.

The commercial video game device 10 of the embodiment is
An operation unit 20, a game image calculation unit 22, a palette controller 24, and the display 18 are included.

The operation unit 20 includes the handle 14 shown in FIG.
It is a member operated by the player, such as the shift lever 16 and other pedals.

The game image calculation unit 22 performs various game calculations based on an input signal from the player operation unit 20 and a predetermined game program, and uses the palette controller 24 to display a driving game on the display 18. Display the game screen for. Here, the game image calculation unit 22 performs a game calculation so that a racing car moves by a player's control within a predetermined three-dimensional game space, and thus various objects and objects in the three-dimensional game space are calculated. It is formed such that the moving body is perspectively projected and converted to a predetermined projection surface to form a game screen, which is displayed on the display 18.

FIG. 3 shows a principle diagram of such an image synthesizing method.

The game image calculation section 22 of the embodiment stores in advance information about the three-dimensional game space 100 and the three-dimensional object 110 appearing in the three-dimensional game space 100. The three-dimensional object 11
The image information regarding 0 includes a plurality of polygons 112-1, 1
It is represented as a shape model consisting of 12-2, 112-3, ... And is stored in advance in the memory.

Taking a driving game as an example, the three-dimensional object 110 is a racing car that appears in the three-dimensional game space 100, and in the three-dimensional game space 100, other backgrounds such as roads and houses are displayed. Various three-dimensional objects are arranged.

When the player 200 operates the steering wheel or the like of the operation unit 20 to perform an operation such as rotation or translation, the game image calculation unit 22 operates in a racing car, a road, or a house based on the operation signal and the game program. Calculations such as rotation and translation of a certain three-dimensional object 110 are performed in real time. The three-dimensional object 110 and other three-dimensional objects are the perspective projection plane 12 of the viewpoint coordinate system.
0 is perspective-transformed and displayed as a pseudo three-dimensional image 122 on the display 18.

Therefore, the player 200 has the operation unit 2
By operating 0 and operating a racing car, 3
It is possible to virtually simulate the state of participating in the race while driving the racing car in the circuit course set in the three-dimensional game space 100.

When the computer graphics technique is used, the shape model of the three-dimensional object 110 is created using an independent body coordinate system. That is, each polygon that forms the three-dimensional object 110 is arranged on this body coordinate system, and its shape model is specified.

Further, the three-dimensional game space 100 is constructed by using the world coordinate system, and the three-dimensional object 110 represented by using the body coordinate system is arranged in the world coordinate system according to its motion model.

Then, with the position of the viewpoint 210 as the origin,
The data is converted into a viewpoint coordinate system in which the direction of the line of sight is in the positive direction of the Z axis, and the respective coordinates are perspectively projected and converted into the screen coordinate system which is the projection surface 120. Then, the color designation data 300 of the perspective-projected image is calculated for each pixel and output to the color palette memory 28 shown in FIG.

The color palette memory 28 stores R,
The three primary colors G and B are stored as data of 256 different luminances in the range of 0 to 255. Then, the R, G, and B luminances are designated by the color designation data 300, and the color signal formed by the combination thereof is the previous color signal 310.
Is output as. For example, the brightness of each of the R, G, and B primary colors is represented by a number from 0 (lowest) to 255 (highest). For example, since black has no color at all, the brightness is represented by (R, G, B) as (0, 0, 0). Pure red is (255,0,0), a mixture of red and blue is (124,0,44), and so on. A color signal including such combination information is designated for each pixel by the color designation data 300, and is output as the previous color signal 310.

As a result, the image in the visual field of the three-dimensional game space 100 seen from the viewpoint 210 is displayed on the display 18.
It will be displayed in color on the top.

In particular, the game image calculation unit 22 of the embodiment is
It is formed so that the position of the viewpoint 210 can be arbitrarily changed in the three-dimensional game space 100 configured by the world coordinate system. Commercial video game device 10 of the embodiment
Sets the viewpoint position to the driver's seat position of the racing car during the game. As a result, the scene of the racing car operated by the player as seen from the driver's seat is displayed as a game screen on the display 18, and the player 200 actually drives the racing car. You can drive as if you were there.

A feature of the present invention is that the depth cueing process of the color image displayed on the display is performed simply and effectively without increasing the memory capacity of the color palette memory 28 or the like. is there.

Therefore, the image synthesizing apparatus of the embodiment is configured to include the depth cueing information setting unit 26 and the palette controller 24.

The depth cueing information setting section 26
Is provided in the game image calculation unit 22 and is formed so as to output the back color signal 320 as luminance signal information for each of R, G, and B colors in accordance with each display scene.

In the present embodiment, four scenes of morning, daytime, evening and night are used as described later. Then, in accordance with each scene, for example, a color signal of white in the morning, blue in the day, red in the evening, and black in the evening is calculated and output as the back color signal.

It should be noted that handling a large number of color signals in the game image calculation section 22 may cause a problem in calculation efficiency. For this reason, when the calculation processing of the back color signal to be used increases, for example, in one display scene,
In the case of handling a plurality of back color signals, FIG.
It is preferable to use the palette memory 29 dedicated to the back color as shown in FIG. Then, in the palette memory 29 dedicated to the back color, all color signals used as the back color signal are stored. That is, a plurality of color signals composed of combinations of respective luminances of three primary colors of R, G and B are stored as the back color signals.

Then, the depth cueing information setting unit 26
Is configured to calculate color designation data 318 for calling a desired back color signal 320 from the back color dedicated palette memory 29 according to each display scene and output the color designation data 318 to the palette memory 29. As a result, even when there are many types of back color signals to be used, it is possible to output a desired back color signal 320 according to the display screen from the palette memory 29 without imposing a heavy load on the game image calculation unit 22.

Further, as shown in FIG. 1, the depth cueing information setting unit 26 calculates flag data 330 (processing target identification data) indicating whether or not the depth cueing process is to be performed for each polygon. Depth information Z in the viewpoint coordinate system of the polygon (Z is represented as a representative value of the polygon) and table designation data 340.
Is calculated and output. Here, the flag data 33
0, the table designation data 340, and the Z representative value Z are output as accompanying data in synchronization with the output of the color designation data 300 output for each pixel.

Here, the depth cueing information setting section 26 is formed to calculate and set the back color signal as luminance signal information for each color of R, G and B. Then, when the display scene is switched, the luminance signal information is directed to the target value after switching according to the passage of time,
It is formed to change gradually.

For example, when switching the display scenes, let T be the time required for the scene switching, and t be the elapsed time from the start of the scene switching, the brightness from the target value i of the previous scene to the target value j of the next scene. The signal change is the luminance signal information h shown in the following equation.
Is calculated for each color of R, G, and B.

H = (j−i) × (t / T) + i (1) Then, the luminance signal information of each color of R, G, and B calculated in this way is stored at the back of scene switching. The color signals are formed so as to be sequentially calculated and output. As a result, the screen can be changed naturally when the scene is switched.

As shown in FIG. 8, when the back color dedicated palette memory 29 is used, the depth color is similarly output from the palette memory 29 while gradually changing the back color signal at the time of scene switching. The ing information setting unit 26 may be formed to calculate the back color designation data 318. By doing so, also in the embodiment shown in FIG. 8, the screen at the time of scene switching can be changed naturally, as in the embodiment shown in FIG.

Further, the pallet controller 24 is
The color palette memory 28, the information conversion unit 30,
And a color signal calculation unit 36.

The information conversion section 30 is formed so as to convert the depth information Z in the viewpoint coordinate system of each polygon into depth information Z'for depth cueing and output it to the color signal calculation section 36.

In the embodiment, the information conversion unit 30
It includes a table rewriting unit 32 and a conversion table 34.

The table rewriting section 32 displays each display scene (for example, set by the game image calculating section 22).
Based on the scene setting data for each display scene (morning, noon, evening, night, etc.), a conversion table corresponding to the displayed scene is calculated and set in the conversion table 34. This conversion table is a data table for converting and outputting the depth information Z into depth information Z ′ for depth cueing. This conversion table 34
Depending on how to set, the atmosphere for each display scene can be effectively produced as described later.

The color signal calculation section 36 inputs the color signal 3 based on each data thus input.
It is determined whether or not 10 is the target of depth cueing. When it is determined that the object is a target, a predetermined depth cueing processing calculation is performed, and a depth cueed color signal 350 is output. The color signal 350 is A / D converted by an A / D converter (not shown) and displayed. To enter.

That is, the color signal calculation section 36 determines whether or not the color signal 310 of the pixel is subject to the depth cueing process based on the flag data 330 output for each pixel. If not, the color signal 310 output from the color palette memory 28 is directly output to the display 18. When it is a target of depth cueing processing, the front color signal 310 input from the color palette memory 28, the back color signal 320 input, and the depth information Z after conversion input from the conversion table 34. ′, The color signal calculation processing based on the following equation is performed. Here, a represents the front color signal 310, b represents the back color signal 320, and N represents the luminance level of the color palette memory 28 (in the embodiment, N = 255).

C = (b−a) × (Z ′ / N) + a (2) Then, the depth-cueed color signal C is obtained by the above calculation and is output to the display 18.

In this manner, the depth-cueed color signal for each polygon can be calculated and displayed on the display 18.

FIG. 4 shows a principle diagram of the depth cueing process of the embodiment. In the figure, front color 3
10 is set at the depth position of Z ′ = 0, and the back color 320 is set at the depth position of Z ′ = 255. The back color 320 has Z '= 2
The setting of 55 means that the depth cueed output color blends into the color of the back color 320 as the depth Z ′ of each pixel increases.

That is, the output color 350 of each pixel is
As described above, depth information Z'for depth cueing
Then, by using the front color a, the back color b, etc., the linear interpolation operation according to the above equation (2) is performed.

This linear interpolation operation is performed by R, which is output as the previous color signal 310 from the color palette memory 28.
This is performed for each of the three primary colors G and B. By doing so, it is possible to output the depth-cueed color signal C to / from the arbitrarily set back color 320 by using the color palette memory 28 in which basic color data is written. You can

In particular, the pallet controller 24 of the embodiment
Then, instead of performing depth cueing using the actual depth information Z of each pixel, this is converted into depth information Z'for depth cueing using a conversion table,
It is configured to perform depth cueing processing.
Therefore, when the linear interpolation calculation is performed using the actual depth information Z, the output color C becomes P1 shown in FIG. 4, whereas in the embodiment, the actual depth information Z is the depth information suitable for the display scene. It is formed so as to be converted into Z ′ and obtain the depth-cueed output color 350.

That is, in the present invention, the depth cueing process can be performed using the actual depth information Z, but as in the present embodiment, the information conversion unit 30 is used to calculate the actual depth information Z. Since it is converted into Z'suitable for edging, more effective depth cueing processing can be performed.

Further, in this embodiment, the conversion table 34
By switching the conversion table stored therein according to each display scene, the optimum depth cueing processing suitable for the display scene can be performed by calculation.

The conversion table 34 may be common to all polygons. For example, a plurality of conversion tables 34 may be prepared in accordance with the characteristics of the polygons (characteristics to be displayed). The table to be used for each may be selected by the table designation data 340. By doing so, more detailed depth cueing can be obtained, such as representing an object illuminated by a light at night or representing a tail lamp of a car in fog.

A plurality of back color signals 320 may be set for one scene. By doing this,
For example, for a scene where a tunnel illuminated by yellow lights approaches while driving on a road at night, set the tunnel part to a yellow back color signal and the other parts to a black scene that represents the night scene. It is possible to perform depth cueing processing such that the depth color signal is set and expressed. That is, it is possible to independently set the back color signals according to the display target and perform the depth cueing process rich in the effect.

FIG. 5 is a flow chart showing the depth queuing processing operation of the apparatus of the embodiment, and FIGS. 6 and 7 show specific examples of the displayed image.

First, it is assumed that the game image calculation unit 22 calculates the game screen shown in FIG. 6 and displays it on the display 18 without performing depth cueing processing. In this case, the game image calculation unit 22 outputs the flag data 330 indicating that the depth cueing process is not performed for all the pixels, and the color designation data 300 is output for each pixel.

Therefore, steps S1, S2 in FIG.
According to the flow of S3, the color signal 310 itself output from the color palette memory 28 is displayed on the display 18
Will be displayed above.

Next, the game screen displayed on the display 18 is divided into four scenes of morning → day → evening → night → morning,
It is assumed that the game image calculation unit 22 of the embodiment performs a unique depth queuing process for each scene.

In this case, in the morning scene, the back color signal 3
20 is set to white for morning mist, and blue is used for daytime scenes to represent the brightened daytime (in this case, the distant view melts into the blue sea or blue sky). Then, set red, which represents the state of the sunset, and black, which represents the darkness of the surroundings, in the night scene. At this time, switching of the back color signal 320 at the time of scene switching is gradually performed according to the following equation so that the color change does not become unnatural. Here, b is the calculated back color signal, b1 is the back color signal of the previous scene, and b2
Represents the back color signal of the next scene. However, k is 0 to 2
Up to 55, it shall change sequentially or discontinuously for each frame.

B = (b2-b1) × (k / 255) + b1 (3) Furthermore, the table rewriting unit 32 converts the conversion table 34 for each scene of morning, daytime, evening, and night. Set the table to Z '= f1
(Z), Z '= f2 (Z), z' = f3 (Z), z '=
Rewrite sequentially like f4 (Z). At this time, rewriting when switching each scene is performed so that the color change does not become unnatural. For example, when switching from the morning to the daytime scene, the conversion table is changed from f1 (Z) to f2 (Z).
It will be switched to, but at this time from f1 (Z) to f
The contents of the table are rewritten so as to gradually approach 2 (Z).

For example, if the conversion of the depth information Z is represented by a conversion formula f1 (Z) = 1.5 · Z f2 (Z) = 2.0 · Z expressed by a linear function, the setting scene Conversion table f (Z), for example, f (Z) = 1.5 · Z, f
(Z) = 1.6 · Z, f (Z) = 1.7 · Z ... f (Z)
It will be changed little by little so that == 2.0 · Z.

When performing depth cueing processing, the game image calculation section 22 calculates and outputs the color designation data 300 for each pixel forming the game screen.
In synchronization with the output of the color designation data 300, the back color signal 320, the flag data 330, the table designation data 340, and the depth information Z are output as auxiliary data for depth cueing. In the embodiment of FIG. 8, the back color signal 320 is output from the palette memory 29.

Then, based on the flag data 330 output for each pixel, it is judged whether or not the pixel is a pixel to which depth cuing is applied (step S2), and is the target of depth cuing processing. In this case, the back color signal 320 is set (step S4), the conversion table 34 to be used is further selected based on the table designation data 340, and the Z representative value of the polygon is used for depth cueing based on the selected conversion table. Depth information Z '
Converted to and output.

Then, based on each data thus obtained, the color signal 310 output from the color palette memory 28 is linearly interpolated according to the equation (2), and the depth cueing processed color signal 350 is obtained. Output (step S7).

The image synthesizing apparatus of the embodiment repeats such processing for each pixel. Especially flag data 330
The depth cueing process is selectively performed on the polygon for which the depth cueing process is designated (steps S5 to S7).

With the above configuration, for example, in the morning scene setting, the conversion table Z '= f1 (Z) for morning is set in the conversion table 34, and the back color signal 32 is set.
When white is set as 0, the game screen shown in FIG. 6 is subjected to depth cueing processing so that it becomes a screen with a mist.

At this time, in the apparatus of the embodiment, the conversion table 34 can be selected by the table designation data 34 for each display polygon. Therefore, for example, the conversion table 34 can be formed such that the polygon group 430 near the coast displayed in the center of the drawing and the land side polygon group 430 displayed on the right side of the drawing are different from each other. As a result, the game screen is configured so that, for example, palm trees and other objects displayed near the coast are displayed as objects hazeed in thick fog, and buildings and other objects displayed on the right side of the figure are displayed as objects that can be seen relatively far. it can.

When the scene is switched from morning to noon, the conversion table in the conversion table 34 is rewritten so as to gradually switch from f1 (Z) to f2 (Z), and the back color signal 320 is also changed. It is set to gradually change from white to blue.

As a result, the game screen shown in FIG. 6 is displayed as a bright daytime screen reflecting the blueness of the sky. At this time, the conversion table 34 converts the depth information Z into a value of Z ′ for depth cueing so that even a distant object can be seen clearly.

Also, when the scene is switched from daytime to evening, the conversion table of the conversion table 34 is rewritten in the same manner, and the back color signal 320 is set to red which gives an atmosphere of evening, and The game screen shown in FIG. 6 is displayed as an image of the evening when it is dyed in the sunset.

Further, when the scene is switched to night, the conversion table of the conversion table 34 is similarly rewritten, and the back color signal 320 is set to black which represents the darkness of night. At this time, the conversion table 34 needs to be image-processed so that an object that is relatively well visible on the game screen shown in FIG. 6 cannot be seen due to the darkness of the night. For this reason, the conversion table is set so that objects that are separated by a certain distance or more are almost invisible. This allows
As shown in FIG. 7, all objects that are a certain distance or more away from the viewpoint position are displayed as black that blends into the back color signal, and a night view can be rendered.

Particularly, in the image synthesizing apparatus of the embodiment, such depth cueing processing is performed for each polygon. Therefore, for the polygon representing the window 410 of the building 400, by setting the flag data 330 so as not to perform depth cueing processing, a game screen in which only the window 410 of the building looks bright in a dark scene is synthesized. Can be displayed.

As described above, it is possible to selectively set and display the object on which the depth cuing is not applied,
It is possible to represent "night lights" and the like, and effectively represent "headlights of oncoming vehicles" and the like.

In the above embodiment, the depth cueing process is used to express changes in time such as morning, daytime, evening, and night. However, the present invention is not limited to this, and various scene settings are effectively performed. It can be used, for example, when the weather changes (scenery covered with fog, clouds, gas, etc.) and other special expressions on the screen.

In the above embodiment, a plurality of conversion table memories storing different conversion tables are provided and the conversion tables stored in the respective conversion table memories are rewritten according to the display scene. The depth queuing may be performed without rewriting the conversion table stored in the conversion table memory.

In the above embodiments, the present invention has been described by taking as an example the case of synthesizing the game screen of the video game device, but the present invention is not limited to this, and various other applications such as a three-dimensional simulator and others. It can be used for a wide range of purposes.

Further, the image synthesizing apparatus of the present invention can be widely applied to the image synthesizing apparatus which outputs the color designation data 300 by using various image synthesizing methods such as texture mapping and filling processing.

[Brief description of drawings]

FIG. 1 is a block diagram of an image synthesizing apparatus for a video game to which the present invention is applied.

FIG. 2 is an external perspective view of a commercial video game device using the image compositing device shown in FIG.

FIG. 3 is an explanatory diagram of a principle of creating a pseudo three-dimensional image of the image compositing apparatus according to the embodiment.

FIG. 4 is an explanatory view of the principle of the depth cueing processing of the image synthesizing apparatus of the embodiment.

FIG. 5 is a flowchart showing the depth queuing processing operation of the image synthesizing apparatus of the embodiment.

FIG. 6 is an explanatory diagram of a game screen created by the image compositing device according to the embodiment.

FIG. 7 is an explanatory diagram showing an example of a game screen subjected to depth cueing processing for a night scene.

FIG. 8 is a block diagram showing another example of an image synthesizing device for a video game to which the present invention is applied.

[Explanation of symbols]

18 display 26 Depth Cuing Information Setting Means 28 color palettes 30 Information converter 36-color signal calculation means 300 color specification data 320 back color signal 350 color signal

─────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] July 24, 2002 (2002.7.2)
4)

[Procedure Amendment 1]

[Document name to be amended] Statement

[Name of item to be amended] Claims

[Correction method] Change

[Correction content]

[Claims]

Front page continuation (51) Int.Cl. ⁷ Identification code FI theme code (reference) G06T 17/40 G06T 17/40 EF term (reference) 2C001 AA09 BA02 BA05 BC01 BC03 BC06 CB01 CC02 5B050 BA08 BA09 BA11 CA07 EA09 EA19 EA24 EA27 EA30 FA05 5B057 CA01 CA08 CA13 CA17 CB01 CB08 CB12 CB16 CE08 CE11 CE17 5B080 AA13 FA02 GA18

Claims (12)

[Claims] 1. A three-dimensional object represented by combining polygons in a virtual three-dimensional space is projected and converted on a projection plane of a viewpoint coordinate system, and pre-color designation data of each pixel is calculated to synthesize a display image. In the image synthesizing device, a depth cueing information setting unit that sets depth color signals for depth cueing according to a display scene, calculates depth information in the viewpoint coordinate system of each polygon, and for each pixel A first color palette that outputs a color signal as a front color signal based on the output previous color designation data, and a color depth depthed for each pixel based on the depth information, the front color signal, and the back color signal. An image synthesizing apparatus comprising: a color signal calculating unit that outputs a signal. 2. A three-dimensional object represented by combining polygons in a virtual three-dimensional space is projected and converted onto a projection plane of a viewpoint coordinate system, and pre-color designation data of each pixel is calculated to synthesize a display image. In the image synthesizing device, a depth cueing information setting unit that sets depth color designation data for depth cueing according to a display scene, calculates depth information in the viewpoint coordinate system of each polygon, and for each pixel. A first color palette that outputs a color signal as a front color signal based on the previous color designation data that is output to the second color palette; and a second color palette that outputs a color signal as a back color signal based on the back color designation data. A color signal calculating means for outputting a depth-cueed color signal for each pixel based on the depth information, the previous color signal, and the back color signal. Image synthesizing apparatus characterized by. 3. The depth information conversion means according to claim 1, further comprising: depth information conversion means for converting and outputting actual depth information Z in the viewpoint coordinate system of each polygon into depth information Z ′ for depth cueing. The color signal calculation means outputs a depth-cueed color signal for each pixel based on the depth information Z ′ for depth cueing, a front color signal, and a back color signal. . 4. The depth information converting means according to claim 3, including a plurality of conversion table memories storing the different conversion tables, and using any one of the plurality of conversion tables according to a display target. An image synthesizing apparatus, which converts the depth information Z of the above into depth information Z ′ for depth cueing and outputs. 5. The depth information conversion means according to claim 3, wherein a conversion table for converting and outputting actual depth information Z in the viewpoint coordinate system of each polygon into depth information Z ′ for depth cueing is stored. An image synthesizing apparatus, comprising: a conversion table memory; and a table rewriting unit that rewrites the contents of the conversion table stored in the conversion table memory according to switching of a display scene. 6. The depth cueing information setting means according to claim 1, wherein the depth cueing information setting means sets the back color signal as luminance signal information for each color of R, G, and B, and when switching a display scene. An image synthesizing apparatus, which is formed so as to gradually change the luminance signal information toward a target value after switching according to the passage of time. 7. The depth cueing information setting means according to claim 6, wherein the change of the back color signal from the target value i of the previous scene to the target value j of the next scene at the time of scene switching is used for scene switching. The required time is T, the elapsed time is t, and luminance signal information h shown in the following equation is calculated for each color of R, G, and B, and h = (j−i) × (t / T) + i An image synthesizing device characterized in that it is sequentially set as a back color signal. 8. The depth queuing information setting means according to claim 2, wherein when the display scene is switched, the depth color signals R, G, and
It is formed so as to arithmetically output the back color designation data for reading from the second color palette so that the luminance signal information of each color B is gradually changed toward the target value after switching with the passage of time. Characteristic image synthesizer. 9. The depth queuing information setting means according to claim 8, wherein the change of the back color signal from the target value i of the previous scene to the target value j of the next scene at the time of scene switching is used for scene switching. The time required is T, the elapsed time is t, and the brightness signal information h shown in the following equation is used to arithmetically output the back color designation data for reading from the second color palette for each color of R, G, B. Image synthesizer. h = (j−i) × (t / T) + i 10. The depth queuing information setting means according to claim 1, arithmetically outputting, for each of the polygons, processing target identification data indicating whether or not to be the target of the depth cuing processing. The color signal calculation means determines whether the pixel of the polygon to be processed is based on the processing target identification data, and calculates the depth-cueed color signal for the processing target pixel. Characteristic image synthesizer. 11. The first color palette according to claim 1, wherein the first color palette is formed to output R, G, and B color signals having N levels of brightness, and the color signal calculation means Letting the previous color signal be a and the back color signal be b, the color signal c depth-skewed for each pixel based on the following equation c = (b−a) × (Z ′ / N) + a
An image synthesizing device which outputs 12. A polygon is combined and expressed in a virtual three-dimensional game space based on a player operating means operated by a player, an input signal from the player operating means, and a game program stored in advance. A predetermined game calculation in which a three-dimensional object appears is performed, the three-dimensional object is perspective-projected onto a projection plane of a viewpoint coordinate system, color designation data is calculated for each pixel, and a display image is combined. An image synthesizing device according to any one of items 1 to 11, wherein a game image is displayed on a display.