JPH0830805A - Three-dimensional graphics device - Google Patents

Abstract

PURPOSE:To fast generate a two-dimensional projection image whose projection is correctly reflected on a mirror surface included in a three-dimensional space. CONSTITUTION:An object 302a is previously put in a three-dimensional space against the virtual image of an object 302 put on the mirror surface of a mirror object 304. The data on the object 302a corresponding to the virtual image is set at a class lower than the data on the object 304. When the location of a camera is designated, it is decided whether the object 302a corresponding to the virtual image and set at the class lower than the data on the object 304 should be displayed or not based on a fact whether the camera is put on the upper side of the mirror surface. Then a two-dimensional image where the three-dimensional space is projected is generated on a two-dimensional plane decided by the location and direction of the camera by a Z buffer method. Under such conditions, a transparent mirror is used to the object 302a.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional graphics device for generating a two-dimensional image by projecting a virtual three-dimensional world onto a two-dimensional plane arranged in the three-dimensional world, and more particularly to a three-dimensional graphics. In the device, a two-dimensional image that is a projection of a virtual three-dimensional world including a mirror and a three-dimensional object reflected in the mirror is reflected in the reflection of the three-dimensional object on the mirror in the three-dimensional world. The present invention relates to a technology for high-speed generation.

[0002]

2. Description of the Related Art A realistic two-dimensional image is generated by projecting a virtual three-dimensional world containing a mirror and a three-dimensional object reflected in the mirror as a three-dimensional shape on a two-dimensional plane arranged in the three-dimensional world. In order to do so, the reflection of the three-dimensional object in the three-dimensional world on the mirror must be reflected in the two-dimensional image.

As a conventional technique capable of reflecting the reflection of a three-dimensional object on a mirror in such a three-dimensional world in a two-dimensional image, a technique called ray tracing method is known. In this technology, from each point on a two-dimensional plane that projects a three-dimensional world. Trace the trajectory of a ray emitted in the direction opposite to the projection direction to that point while considering attenuation and reflection of the light, and reflect the reflectance of the point on the trajectory where the ray hits the mirror or the point on the three-dimensional shape. The color projected on the point on the two-dimensional plane is determined according to the transmittance, the color (lightness, saturation, lightness) and the like.

However, such a ray tracing method requires a large amount of processing, and it is difficult to generate a two-dimensional image at high speed. Therefore, it is necessary to generate a two-dimensional image projecting a three-dimensional world in real time in response to a change in the three-dimensional world's arrangement of the two-dimensional plane projecting the three-dimensional world or the arrangement or texture of the three-dimensional shape. Therefore, it is not possible to construct an interactive system that accepts a user's operation in the three-dimensional world and immediately displays an image corresponding to the operation content.

Therefore, conventionally, the three-dimensional object corresponding to the virtual image of the three-dimensional object by the mirror is arranged on the opposite side of the three-dimensional shape of the mirror, which is the source of the virtual image, in the three-dimensional world, and the virtual image source is generated. And a three-dimensional shape corresponding to a mirror image are projected onto a two-dimensional plane to generate a two-dimensional image using the Z-buffer method.

Here, the Z-buffer method is a point on a three-dimensional shape on a line extending from a point on a two-dimensional plane projecting a three-dimensional world in a direction opposite to the projection direction to that point,
The color of the point on the three-dimensional shape closest to the two-dimensional plane is the color of the point on the two-dimensional plane with the perpendicular line extended.

[0007]

However, the three-dimensional object corresponding to the above-described virtual image of the three-dimensional object by the mirror is placed on the opposite side of the three-dimensional object, which is the source of the virtual image, of the mirror in the three-dimensional world. According to the arranging technology, a 2D image obtained by projecting a 3D world onto a 2D plane is changed to a 3D arrangement of a 2D plane projecting the 3D world around the world, or an arrangement of 3D shapes or materials (colors). However, there is the following problem when it is generated in real time with respect to the change of (pattern, etc.).

First, when the two-dimensional plane for projecting the three-dimensional world is set on the back side of the mirror, that is, the side on which the three-dimensional object corresponding to the virtual image is arranged, the three-dimensional image corresponding to the virtual image. Since the object is also projected on the two-dimensional plane, a correct two-dimensional image cannot be obtained.

Further, since the three-dimensional object corresponding to the virtual image and the three-dimensional object which is the source of the virtual image are treated as independent three-dimensional objects, they are arranged and material on the three-dimensional object which is the source of the virtual image. Even if you change the 3
This is not reflected in dimensional objects.

Further, according to this technique, when the mirror surface is a curved surface, it is impossible to generate a two-dimensional image that accurately reflects the reflection of the three-dimensional object in the three-dimensional world on the mirror. .

Therefore, according to the present invention, a two-dimensional image projected from the three-dimensional world is changed according to the change of the three-dimensional world arrangement of the two-dimensional plane projecting the three-dimensional world, the arrangement of the three-dimensional shape and the texture. It is an object of the present invention to provide a three-dimensional graphics device that can generate a high-speed image while accurately reflecting the reflection of a three-dimensional object on a mirror in a three-dimensional world.

In addition, according to the present invention, even when the mirror surface is a curved surface, a two-dimensional image obtained by projecting the three-dimensional world is correctly reflected on the reflection of the three-dimensional object in the mirror in the three-dimensional world. Therefore, it is an object of the present invention to provide a three-dimensional graphics device that can be generated at higher speed.

[0013]

[Means for Solving the Problems] To achieve the above object,
The present invention relates to, for example, a three-dimensional graphics device that generates a two-dimensional image obtained by shooting a virtual three-dimensional space with a virtual camera arranged in the three-dimensional space.
A virtual object placed in a three-dimensional space, a virtual mirror,
Object data defining the shape and arrangement of a virtual image object, which is an object having a shape and arrangement corresponding to the virtual image of the virtual object by the virtual mirror, and the virtual image object and a virtual image corresponding to the virtual image object. Storage means for storing relationship information relating to the generated virtual mirror; reception means for receiving setting settings of the virtual camera for photographing the three-dimensional world in the three-dimensional space; When the arrangement of the cameras received by the receiving means is on the front side of the mirror surface with respect to the virtual mirror in the three-dimensional space, the relationship is stored in the virtual mirror by the relation information stored in the storage means. When it is determined that the associated virtual image object is symmetrical in display, and the virtual object is on the front side of the mirror surface with respect to the mirror, it is associated with the virtual mirror by the relationship information stored in the storage means. As the determination means that determines that the virtual image object is not symmetrical to display, and the virtual image object that can be seen through the virtual mirror that produced the virtual image object from the camera having the arrangement received by the reception means, A two-dimensional image obtained when the virtual object, the virtual mirror, and the virtual image object determined to be displayed by the determination unit are captured by the camera is stored in the storage unit. There is provided a three-dimensional graphics device having a two-dimensional image generation means for generating based on object data and a display means for displaying the generated two-dimensional image.

[0014]

According to the three-dimensional graphics device of the present invention described above as an example, a virtual object arranged in the three-dimensional space, a virtual mirror, and the virtual object of the virtual object. Data defining the shape and arrangement of a virtual image object, which is an object having a shape and arrangement corresponding to a virtual image formed by a virtual mirror, and the virtual mirror that produces the virtual image object and a virtual image corresponding to the virtual image object. And the relational information that relates to and is stored, and a two-dimensional image is generated based on the relational information. Therefore, it is possible to generate a two-dimensional image at high speed by the Z-buffer method or the like without using the tracing method. Whether or not to display the virtual image object associated with the virtual mirror according to the arrangement of the camera received by the receiving means with respect to the virtual mirror, based on the relationship information stored in the storage means. To determine.

Therefore, when the camera is rotated to the back side of the virtual mirror, the virtual image object corresponding to the virtual image produced by this virtual mirror is excluded from the object of generating the two-dimensional image in advance. can do.

[0016]

Embodiments of the three-dimensional graphics device according to the present invention will be described below.

First, the hardware configuration of the three-dimensional graphics device according to this embodiment will be described.

The three-dimensional graphics device according to this embodiment can be realized by using, for example, an electronic computer system having a general structure as shown in FIG.

In FIG. 1, 100 is a computer main body equipped with a CPU, a main storage device, a frame memory, etc., 101 is a display for displaying a two-dimensional image or the like generated in the present three-dimensional graphics device, and 102 is various data. An external storage device 103 for storing is an input device such as a keyboard or a mouse for receiving an instruction from a user.

In the first embodiment, the configuration shown in FIG. 2 is constructed on such a computer system.

In FIG. 2, 201 is a user interface module, 202 is an event management module, and 2 is an event management module.
Reference numeral 03 is a file I / O module, 204 is a data management module, 205 is a display / non-display determination module, 2
Reference numeral 06 is a display module, 208 is a save memory, 209 is a Z buffer, and 210 is a frame memory. Also, 1
Reference numeral 02 denotes an external storage device, and 103 denotes an input device.

User interface module 201,
The event management module 202, the file I / O module 203, the data management module 204, the display / non-display determination module 205, and the display module 206 are provided on the computer main body 100 in a predetermined CPU 100. It is realized as a process embodied according to the execution of the program.

A save memory 208 and a Z buffer 209 are built in the main storage unit of the computer main body 100. The frame memory 210 is built on the main storage device on the computer main body 100. However, the computer body 100
Alternatively, these dedicated memories may be provided and used.

Now, the user interface module 2
Reference numeral 01 controls and manages the display of the user interface image on the display 101 and the acceptance of the user's operation correspondingly input using the input device 103. That is, the user interface module 201
Provides a GUI. Event management module 202
Is a file I / O module according to the operation contents of the user accepted by the user interface module 203.
The module 203, the data management module 204, the display / non-display determination module 205, and the display module 206 are activated and processing is performed. Further, the file I / O module reads various data from the external storage device 102 or writes various data to the external storage device 102 according to an instruction from the event management module 202.

The external storage device 102 stores various data representing a virtual three-dimensional space.

These data will be described below.

First, the coordinate system used in this embodiment will be described.

An example of processing a virtual three-dimensional world shown in FIG. 3 will be described.

FIG. 3 shows that four three-dimensional shapes 301, 302, 303, 304 are arranged in a three-dimensional space defined by the coordinate system all. here,
The three-dimensional shape 304 is a mirror. Now this coordinate system all
The three-dimensional space defined by is called a real space a, and the three-dimensional shape directly arranged in this real space a is called a real image object.

The shape, color, etc. of each real image object are defined on a coordinate system that is set uniquely to that real image object. Therefore, the position of each real image object in the real space a is defined by the position on the coordinate system all of the coordinate system uniquely set for the real image object.

In the present embodiment, the coordinate system mir set uniquely to the real image object mirror 304 is also used.
Three-dimensional shapes 301a, 302a, 303 corresponding to virtual images of three objects 301, 302, 303 excluding mirrors by a mirror 304 in a three-dimensional space defined by ror
Place a. Now, this three-dimensional space defined by the coordinate system mirror will be referred to as a mirror space m. Also,
A three-dimensional shape corresponding to a virtual image formed by a three-dimensional mirror will be referred to as a virtual image object. Further, when a three-dimensional shape is called without particularly distinguishing a real image object and a virtual image object, they are simply called objects.

A coordinate system is uniquely provided for each of these virtual image objects, and the shape, color, etc. of the virtual image object are determined on the coordinate system uniquely set for the virtual image object. It is defined.

Therefore, the position of the virtual image object in the mirror space m is defined by the position of the coordinate system uniquely set in the virtual image object on the coordinate system mirror uniquely set in the real image object mirror 304. It
Further, the position of each virtual image object in the real space m is the coordinate system mirr set uniquely to the mirror object 304 of the coordinate system uniquely set to the virtual image object.
It is defined by the position on or or and the position on the coordinate system all of the coordinate system mirror.

Therefore, in this embodiment, in order to manage the correspondence between the hierarchical structure of such a coordinate system and the object and the virtual image object corresponding to the virtual image of the object, the external storage device 102 is shown in FIG. In this way, the data defining each object is stored in association with each other.

In FIG. 4, the data defining each object are related by the hierarchical structure of the coordinate system unique to each object, the correspondence between the object corresponding to the virtual image and the object that is the source of the virtual image.

The solid line in the figure indicates the real image object mirror 30 in the lower layer of the coordinate system (all) that defines the real space a in FIG.
4, unique coordinate system of yuka 301, plate 303, pillar 302 (mirror, yuka, ita, hashira)
Exists, and in the lower layer of the coordinate system mirror that defines the mirror space m, the real image object yuka 301, the plate 303, and the pillar 30.
Virtual image objects 301a, 303a, 3 corresponding to 2
02a-specific coordinate system (yuka.rev, ita.re
v, hashira. rev) is present. In addition, the broken line in the drawing indicates the correspondence between the real image object and the virtual image object corresponding to the virtual image of the real image object.

In this embodiment, one virtual image object exists for one real image object, but a plurality of virtual images corresponding to a plurality of mirrors for one real image object are shown. Even when there is a virtual image object, the structure shown in FIG.
It is also possible to define the hierarchical structure of the coordinate system and the correspondence between objects.

The data defining such a relationship is actually two types of data, for example, a pointer representing a hierarchical link, a real image object, and a virtual image object corresponding to the virtual image of the real image object. It can be easily realized by a data structure that links each data defining each object by using a pointer.

The data defining the object itself includes the portion representing the shape, color, etc. of the object in the coordinate system unique to the object, and the coordinate system higher than the definition of the coordinate system unique to the object shown in FIG. It consists of the part that represents the arrangement in.

However, an object and the object corresponding to the virtual image are the shape and color of the object,
Since the part represented by the coordinate system specific to the object is common, in practice, this part may share the same data. Note that voxel data or the like is usually used for the data such as the shape and color of an object and the coordinate system unique to the object, but other formats such as data representing the shape by vector expression are used. You may use it.

According to the definition of the coordinate system specific to the object shown in FIG. 4, the arrangement in the higher coordinate system is the position of the origin of the coordinate system specific to the object in the higher coordinate system and each unit of both coordinate systems. It can be represented by the slope of the vector. The arrangement in the higher coordinate system of the coordinate system specific to the virtual image object corresponding to the virtual image of a certain real image object can be obtained from the positional relationship between the mirror object that generated the virtual image and the real image object that is the source of the virtual image. it can. That is, for example, the arrangement in the mirror space m of the coordinate system peculiar to the virtual image object plate 303a in FIG.
A plane-symmetrical arrangement is obtained for the mirror 304 of the coordinate system, and the corresponding arrangement in the mirror real space a is calculated as the virtual image object plate 3
The coordinate system peculiar to 03a may be arranged on the mirror space m. Further, whether or not the real image object that produces a virtual image can be determined by whether or not the real image object is on the mirror surface side of the mirror in the real space a. Therefore, in this way, in advance, for each mirror object, the data defining the virtual image object is automatically generated, and the generated virtual image object is associated with the hierarchy shown in FIG. 4 and the real image object. It may be performed automatically.

The operation of the three-dimensional graphics device according to this embodiment will be described below.

First, the case where the user sets or changes the arrangement of the cameras defining the two-dimensional plane for projecting the real space a via the input device 103 will be described.

In this case, via the user interface module 201 and the event management module 202,
The file I / O module 203 and the display / non-display determination module 205 are activated. File I / O module
The module 203 reads out the data shown in FIG. 4 from the external storage device 102 and displays the display / non-display module 205.
Give to.

The display / non-display determination module 205 uses these data to display / display each layer shown in FIG.
Hidden determination process "is executed.

"Display / non-display determination processing in each layer"
Performs processing based on the data described above with reference to FIG.

This processing starts with the real space a of the uppermost layer (layer 0) of the hierarchical structure of FIG. 4 as a target. In this process, first check whether there is a target lower layer.
01, if any, one of the objects in the lower layer (layer 1) of the target is targeted, and “display / non-display determination processing in each layer” is recursively performed for this target 502,
When this is completed, "display / non-display determination processing in each layer" for all objects in this lower layer (layer 1)
It is determined whether or not 503 is finished. If it is not finished, one of the remaining objects in this lower layer (layer 1) is targeted, and "display / non-display determination processing in each layer" is performed for this target. 502 recursively. If the “display / non-display determination processing in each layer” 503 has been completed for all objects in the lower layer (layer 1), the process proceeds to step 504 and subsequent steps.

As a result of the above processing, in the tree-like hierarchical structure shown in FIG.
The subsequent processing is performed. In the hierarchical structure shown in FIG. 4, for example, {(Yukano virtual image 301a, plate virtual image 30 in FIG.
3a, virtual image 302a of the pillar, mirror 304}, yuka 301,
The process from step 504 onward is performed in the order of the plate 303 and the pillar 302.

The processing after step 504 will be described.

In step 504, it is determined whether or not the target object is a mirror, and if it is not a mirror, the process ends.

On the other hand, if it is a mirror, first, the normal vector of the surface of the mirror in the real space a is obtained 505 from the data of this mirror object. The position on the mirror surface where the normal line is set may be arbitrary. Then, the direction vector toward the camera set in the real space a is obtained 506 from the position on the mirror surface where the normal line is set up. FIG. 6 shows an example of the normal vector of the mirror surface and the obtained direction vector. The plane perpendicular to the shooting direction of this camera is the two-dimensional plane P onto which the real space a is projected.

Then, the angle formed by both the obtained vectors is calculated 508, and if the angle formed is less than 90 degrees, "display" is performed for all objects existing under the mirror.
Set. If it is 90 degrees or more, "non-display" is set for all objects existing under the mirror.

With the above processing, as shown in FIG. 7, when the camera is on the front side of the mirror surface with respect to the plane including the mirror surface, it corresponds to all the coordinate systems in the lower layer of the coordinate system of this mirror object. "Display" is set to the object,
When the camera is on the back side of the mirror surface with respect to the plane including the mirror surface, "invisible" is set for all objects below this mirror object.

After the above processing is completed, the object for which the "non-display" is set is excluded from the targets of the objects projected on the two-dimensional plane P, and only the remaining objects are projected on the two-dimensional plane P. To generate.

As a result, as shown in FIG. 7, when the camera is on the front side of the mirror surface as shown in FIG. 7, the virtual image object corresponding to the virtual image by this mirror object also becomes symmetrical with respect to the display, and the camera shows the mirror image. When it is on the back side of the surface, that is, when the camera wraps around the back side of the mirror, the virtual image object corresponding to the virtual image by this mirror object is not displayed.

The process of generating the projected image will be described in detail later.

By the way, as shown in FIG. 8, when the real image object 801 is also present on the back side of the mirror, the real image object 801 is the mirror surface 80 of the mirror object.
2 or a mirror surface 801 when it is known that the camera is hidden by a wall object or the like on an extension of this plane and is never projected on the two-dimensional plane P when the camera faces in the direction opposite to the direction of the mirror surface. If a mirror object having a mirror surface 802 is virtually placed back to back and the real image object 801 on the back side of the mirror is a lower layer object of this virtual mirror object, that is, the real image object 801 on the back side of the mirror is virtual. If it is handled as a virtual image object by a simple mirror object, this object 801 can be made “non-display” and excluded from the object of the generation of the two-dimensional image in advance when the camera faces in the direction opposite to the direction of the mirror surface. it can.

Next, when the user inputs an instruction to change the movement of the real image object or the material (texture, texture, etc.) through the input device 103, the user interface module 201 and the event management module. -Le 202
The file I / O module 203 and the data management module 204 are activated via the. The file I / O module 203 reads out the various data described above from the external storage device 102 and supplies them to the data management module 204.

The data management module 204 uses these data to perform "motion material change processing" shown in FIG.

In this process, first, the process is started for an object for which a movement or a material change instruction has been made. In this process, first, it is checked whether or not the target object has an object associated with the relationship indicated by the broken line in FIG. 905, and if there is not, a motion is given to the target object or the target object is set. The object is changed 908, and the process ends.

On the other hand, if there is an object associated with the target object t, one associated object t1 is targeted, and
Perform "movement / material change processing" recursively 90
6. When this is completed, it is determined whether or not there is an object associated with the object t similarly to the currently targeted object t1 907, and if it exists, this is targeted and the target t , "Movement /
906. The material modification process "is performed recursively. On the other hand, if it does not exist, the object t is moved or the material is changed 908, and the processing is ended.

By the above-described processing, the real image object whose movement and material have been changed and all virtual image objects generated based on this change are moved and changed in accordance with the movements and the material changes given to the real image object. Can be applied.

Here, the material of the virtual image object is changed by making the same change as the material of the real image object.

On the other hand, the movement of the virtual image object is performed as follows according to the movement of the real image object.

As shown in FIG. 10, the coordinate system mirror1100 peculiar to the mirror object is set to the coordinate system al in the real space.
Consider the case where it is placed on 1000. In this example,
Coordinate system mirror1100 and coordinate system all 1000
Has the directions of the Y axis and the Z axis aligned with each other, and the X axis faces the opposite direction. In such a case, the real image object 120
When 0 moves, the virtual image object 1200a, which is a virtual image of the real image object, must be moved in a plane-symmetrical relationship. In the example shown in FIG. 10, the real image object 1
If the same change as the change of the coordinate of each axis of the coordinate system all 1000 of 200 is the change of the coordinate about the corresponding axis of the coordinate system mirror 1100 in the arrangement of the coordinate system specific to the virtual image object 1200a, this plane-symmetric relationship Is satisfied. Therefore, this change is represented by the virtual image object 120.
The coordinate of the coordinate system mirror 1100 of the coordinate system specific to 0a is changed.

In this example, in order to simplify the explanation, the coordinate system mirror 1100 is referred to as the coordinate system all.
Although the case where the same coordinate change as that of 1000 can be applied to satisfy the plane symmetry relationship has been described, even when the coordinate system mirror 1100 and the coordinate system all 1000 have an arbitrary arrangement relationship, in the real space a, a mirror surface is obtained. The same movement as the movement of the real image object is obtained in the direction parallel to, the movement opposite to the movement of the real image object is obtained in the direction perpendicular to the mirror surface, and these movements are moved to the mirror space m,
Mirror space m of the transferred movement in the coordinate system unique to the virtual image object
You can give it inside.

By the way, there are cases where objects are hierarchically defined based on their structural relationships, such as defining element objects such as a top plate and feet below the table object. In such a case, step 901 shown in FIG. 10 is added to the processing shown in FIG.
9 to 904 may be added, and when an instruction is made to change the material of an object called a table, the processing shown in FIG. 9 may be sequentially performed for each of the element objects from the lower layer.

When the mirror object itself is moved, the arrangements of all the subordinate objects of the mirror object are recalculated.

After the above processing is completed, a projection image in which the real space a is projected on the two-dimensional plane P is generated. The process of generating the projected image will be described in detail later.

Here, when the reflection in the case where the mirror is reflected in the mirror is considered, that is, 1 of the real image object is considered.
Consider a case where not only the virtual image object corresponding to the next virtual image but also the virtual image of the virtual image object, that is, the virtual image object corresponding to the virtual image of the second or higher order of the real image object is considered.

When such a case is also taken into consideration, the virtual image object is always a substructure of the object that is the source of the virtual image (data defining the subordinate virtual image object, coordinate system between subordinate objects). (Hierarchical structure) may be inherited. By doing so, even when there is a virtual image object corresponding to the virtual image of the second mirror of the first mirror that is generating the n−1th-order virtual image of the real image object, n−1 by the first mirror is present. The coordinate system of the virtual image object corresponding to the nth virtual image of the second mirror of the virtual image object corresponding to the next virtual image is defined below the coordinate system of the virtual image object corresponding to the virtual image of the second mirror of the first mirror. It However, also in this case, the virtual image object corresponding to the nth-order virtual image is associated with the n−1th-order virtual image object in the relationship of the broken line shown in FIG.

With this arrangement, the "display / non-display determination processing for each layer" shown in FIG. 5 allows the projection image to be correctly obtained even for the virtual image object virtual image object corresponding to the nth-order virtual image of the real image object. be able to.

Further, in the "movement / material changing process" shown in FIG. 9, the change in the position of the virtual image object corresponding to the primary virtual image on the coordinate system higher than the coordinate system of the virtual image object is changed by 1 If all the virtual image objects directly or indirectly associated with the virtual image object 1200a corresponding to the next virtual image are changed in position on the coordinate system of the object above the virtual image object, the real image is obtained. A virtual image object corresponding to the nth-order virtual image of the object can also be correctly given a motion. Regarding the material change, the same change as that of the real image object can be made to the virtual image object corresponding to the nth-order virtual image of the real image object by the processing shown in FIG.

Hereinafter, as described above, the "display / emergency determination processing in each layer" of the display / non-display determination module 205 and the "motion / material change processing" by the data management module 204 are completed. A process of generating a projected image performed after the above will be described.

When the display / non-display judgment module 205 and the data management module 204 complete the processing, these modules notify the event management module 202 of the completion of the processing. . The event management module 202 receives the notification and then displays the display module 20.
6 is instructed to generate a projected image.

A display module 206 that has received a generation instruction
Executes the "display process" shown in FIG.

The contents of this display process will be described.

In the hierarchical structure shown in FIG. 4, the real space a
The objects in the next lower layer are subject to this processing.

This process is basically a process for erasing the hidden surface according to the Z buffer method.

The Z buffer 209 projects the real space 2
Color data and depth data are stored for each point on the dimensional plane P. Since the points on the two-dimensional plane P correspond to the pixels of the two-dimensional image projected on the two-dimensional plane P, the points on the two-dimensional plane P are hereinafter referred to as pixels.

First, the case where a real image object that is not a mirror is the object of processing will be described. In this case, in step 1211, the distances of the points on the surface of the target object to the pixels on the two-dimensional plane onto which the points are projected are sequentially obtained, and the Z buffer 209 corresponding to the pixels. If the obtained distance is smaller than the distance indicated by the depth data, the depth data of this pixel is rewritten to the obtained distance, and the color data of this pixel is displayed on the surface of the target object. Rewrite to the dot color. Then, of the points on the surface of the target object, the above processing is completed for all the points at the positions projected on the pixels of the two-dimensional plane, and the processing is terminated.

When such processing is performed while sequentially processing a plurality of real image objects that are not mirrors, the Z buffer 209 will result in a point on the surface of the object that has been the processing object until now. Among these, the color of the point of the part which is not hidden by the other surface of the object which has been processed so far, and the distance of the point to the pixel to which the point is projected are projected. It remains in the Z buffer 209 corresponding to the pixel.

Next, the case where the mirror object is the object of processing will be described.

In this case as well, the above-described processing is similarly performed on each surface of the mirror, but different processing is performed only on the mirror surface. That is, when it is determined that the surface to be processed is a mirror surface 1201, first, all the depth data and color data of the Z buffer 209 are saved in the save memory 2
1202 to save to 08. Then, the depth data of the Z buffer 209 are all set to infinity, and the content of the color data is initialized to the color used as the mirror surface color when nothing is reflected. Then, when it is determined from the data shown in step 4 that there is an object in the lower layer of the mirror object 1204, sequentially, "display processing" is recursively performed on all objects one layer below the mirror object 1
205, 1206. However, the object for which "non-display" is set by the display / non-display determination module 205 described above is not targeted.

Now, assuming that only one layer of virtual image object exists in the lower layer of this mirror object, the "display processing" is recursively applied to all the objects one layer below the mirror object. Of the points on the surface of all virtual objects in the lower layer, the color of the part of the point that is not hidden by the other surface of the virtual object in the lower layer of the mirror object, and the point of that point is projected. The distance to the pixel will remain in the Z buffer 209, corresponding to the pixel on which that portion is projected. The projection of the lower layer object onto the two-dimensional plane is performed by moving the lower layer object to the real space a via the coordinate system of the upper layer object.

Next, it is determined again that the mirror surface is 1207, and the following processing is performed. First, clipping processing 1208 is performed. That is, among the pixels on the two-dimensional plane P, the pixels within the range where the mirror surface is projected are obtained. Then, in step 1208, the depth data stored in the Z buffer 209 is set to infinity and the color is set to black, corresponding to the pixels other than the obtained pixel. Also, only the depth data of pixels within the range where the mirror surface is projected is
The distance of the point on the mirror surface projected on the pixel to the pixel is updated. As a result, as shown in FIG. 13, among the two-dimensional images obtained by projecting the virtual image object on the two-dimensional plane P, only the two-dimensional image of the portion projected through the mirror is attached to the mirror surface. The same thing as that obtained when projected onto the two-dimensional plane P remains in the Z buffer 20.

Finally, the past contents of the Z buffer 209 saved in the save memory 208 are saved in the Z buffer 2
Return to 09. However, in this case, the two-dimensional plane P
For each pixel of, the saved depth data is compared with the current depth data of the Z buffer 209, and if the saved depth data is smaller, the saved depth data and color data are compared. If the depth data saved and saved in the Z buffer 209 is larger, the saved depth data and color data are not written in the Z buffer 209 and the current contents of the Z buffer 209 are maintained.

If the above "display processing" is applied to all the objects located one layer below the real space a, Z
The color data left in the buffer 209 is stored in the frame memory 2
Transfer to 10.

The contents transferred to the frame memory are displayed on the display 101.

In the two-dimensional image obtained as a result of such "display processing", only the portion of the real image object which is reflected in the mirror surface is correctly reflected. FIG.
Since the mirror surface processing is performed for each mirror surface, a two-dimensional image that accurately reflects the reflection can be obtained even when the mirrors are arranged close to each other as shown in FIG.

As described above, the object is
For example, the top plate under the table object,
Even when the object objects such as feet are defined in a hierarchical manner based on the structural relationship, steps 1204 to 12 in the process shown in FIG.
By the process of 07, the process shown in step 1211 is sequentially performed for each of the element objects from the lower layer, so that no problem occurs.

Further, when considering reflection in the case where a mirror is reflected in a mirror, that is, not only the virtual image object corresponding to the primary virtual image of the real image object, but also the virtual image of the virtual image object, that is, the real image object 2
Also in the case of considering virtual image objects corresponding to virtual images of the following or higher, steps 1204 to 1207
By the processing of (2), it is possible to obtain a two-dimensional image which is processed from the mirror surface of the lower layer mirror object and correctly reflects the reflection.

The embodiments of the three-dimensional graphics device according to this embodiment have been described above.

However, the above embodiment may not be able to deal with the case where the mirror surface is a curved surface.

Therefore, when the mirror surface is a curved surface, the display module 206 performs the "display processing" as shown in FIG.

In this processing, for objects that are not mirrors, the same processing as that shown in FIG. 12 is performed. However, with respect to the mirror surface of the mirror object, a process of generating a virtual image object is first performed as follows.

That is, first, the object to be reflected on the mirror surface is determined in FIG. 1505. This can be approximately calculated from the direction of the normal line to the point on the surface of the mirror where the line segment extending from the camera to the shooting direction of the camera intersects, and the arrangement and shooting direction of the camera. That is, as shown in FIG. 16, of the points on the mirror surface, the range of the real space a projected in the range projected on the two-dimensional plane P is the arrangement of the camera, the shooting direction, and the shooting direction of the camera. Since it is approximately determined by the direction of the normal line to the point on the surface of the mirror where the extended line segments intersect, the object in the range of the real space a is an object to be reflected on the mirror surface.

Next, a virtual image object corresponding to the virtual image of the mirror image of the object reflected on the mirror surface is obtained in step 1
Obtained at 506. This is a point 160 where the virtual images of the vertices of each surface forming the surface of the object reflected on the mirror surface are formed.
1 is obtained, and the shape and arrangement obtained by connecting the points 1601 are defined as the shape and arrangement of the virtual image object. Also, each point 1
The color of each surface obtained by connecting 601 is assigned to the color of the corresponding surface of the real image object.

When the virtual image object is obtained in this way, in steps 1507 to 1512, the same processing as the mirror surface processing shown in FIG. 12 is performed.

As described above, since the shape of the virtual image object corresponding to the virtual image of the mirror surface of the stage is generated based on the vertex coordinates of the object, the virtual image object can be generated at high speed even if the mirror surface is a curved surface.

[0101]

As described above, according to the present invention, the three-dimensional arrangement of the two-dimensional plane projecting the three-dimensional world, the three-dimensional arrangement of the three-dimensional shape and the three-dimensional arrangement of the texture are changed. It is possible to provide a three-dimensional graphics device capable of generating a two-dimensional image at high speed while correctly reflecting the reflection of a three-dimensional object on a mirror in the world.

Further, even when the mirror surface is a curved surface, a two-dimensional image in which the three-dimensional world is projected is generated at a higher speed while correctly reflecting the reflection of the three-dimensional object in the three-dimensional world on the mirror. It is possible to provide a three-dimensional graphics device capable of doing so.

[Brief description of drawings]

FIG. 1 is a block diagram showing a hardware configuration of a three-dimensional graphics device according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a functional configuration of a three-dimensional graphics device according to an embodiment of the present invention.

FIG. 3 is a diagram illustrating a method of generating a projected image according to an embodiment of the present invention.
It is a figure which shows the example of a dimensional space.

FIG. 4 is a diagram showing a data structure of data defining an object according to the embodiment of the present invention.

FIG. 5 is a flowchart showing a processing procedure of display / non-display determination processing in each layer performed in the embodiment of the present invention.

FIG. 6 is a diagram showing a mechanism of display / non-display determination processing in each layer performed in the embodiment of the present invention.

FIG. 7 is a diagram showing an example of a processing result of display / non-display determination processing in each layer performed in the embodiment of the present invention.

FIG. 8 is a diagram showing an application example of display / non-display determination processing in each layer of the present invention.

FIG. 9 is a flowchart showing a processing procedure example of a movement / material changing process performed in the embodiment of the present invention.

FIG. 10 is a diagram showing a mechanism of movement / material change processing performed in the embodiment of the present invention.

FIG. 11 is a flow chart showing an example of a processing procedure of movement / material change processing performed in the embodiment of the present invention.

FIG. 12 is a flowchart showing a processing procedure of display processing performed in the embodiment of the present invention.

FIG. 13 is a diagram showing a mechanism of display processing performed in the embodiment of the present invention.

FIG. 14 is a diagram showing an example of a processing result of display processing performed in the embodiment of the present invention.

FIG. 15 is a diagram showing a mechanism of display processing when the mirror surface is a curved surface, which is performed in the embodiment of the present invention.

FIG. 16 is a diagram showing an example of a processing result of display processing when the mirror surface is a curved surface, which is performed in the embodiment of the present invention.

[Explanation of symbols]

 201 user interface module 202 event management module 203 file I / O module 204 data management module 205 display / non-display determination module 206 display module 208 save memory 209 Z buffer 210 frame -It is a memory. Also, 102 external storage device 103 input device

Claims (7)

[Claims] 1. A three-dimensional graphics device for generating a two-dimensional image obtained by capturing a virtual three-dimensional space with a virtual camera arranged in the three-dimensional space, the three-dimensional graphics device being arranged in the three-dimensional space. A virtual object, a virtual mirror, and object data defining the shape and arrangement of a virtual image object that is an object having a shape and arrangement corresponding to a virtual image of the virtual object by the virtual mirror, A storage unit that stores relationship information that associates the virtual image object with the virtual mirror that has generated a virtual image corresponding to the virtual image object; and the three-dimensional space of a virtual camera that captures the three-dimensional world. When the receiving means for receiving the setting of the above arrangement and the camera arrangement received by the receiving means are on the front side of the mirror surface with respect to the virtual mirror in the three-dimensional space, the storage means stores the same. Remembered The relationship information stored in the storage means determines that the virtual image object related to the virtual mirror is displayed symmetrically based on the relationship information, and is on the front side of the mirror surface with respect to the mirror. Determination means for determining that the virtual image object associated with the virtual mirror is not symmetrical in display, and a virtual mirror in which the virtual image object produced the virtual image object from the camera arranged at the receiving means. 2 is obtained when the virtual object, the virtual mirror, and the virtual image object determined to be displayed by the determination unit are photographed by the camera as a thing that can be seen through the camera.
A three-dimensional graphics device comprising: a two-dimensional image generation unit that generates a three-dimensional image based on the object data stored in the storage unit; and a display unit that displays the generated two-dimensional image. . 2. The three-dimensional graphics device according to claim 1, wherein the two-dimensional image generation means is a virtual device in which the virtual image object produces the virtual image object from a camera arranged at the reception means. As a thing that can be seen through a mirror, a virtual mirror that produces the virtual object, the virtual mirror, and a virtual image object of the virtual image object determined to be symmetrical by the determination means. 2 obtained when the portion included in the range that can be seen through is taken by the camera.
A three-dimensional graphics device, wherein a three-dimensional image is generated based on the object data stored in the storage means. 3. A three-dimensional graphics device for displaying a two-dimensional image captured by a virtual camera arranged in the three-dimensional space, the three-dimensional graphics device being arranged in the three-dimensional space. Shape, arrangement, and color of a virtual object, a virtual mirror, and a virtual image object that is an object having a shape and an arrangement and a color or a pattern corresponding to a virtual image of the virtual object by the virtual mirror. Alternatively, a storage unit that stores object data that defines a pattern and relationship information that associates the virtual image object and the virtual object that is in a real image relationship with a virtual image corresponding to the virtual image object; Accepting means for accepting a setting for changing the color or pattern of a physical object, and the virtual object defined by the object data stored in the storing means, the accepting means accepting a setting for changing the color or pattern And means for changing the color or pattern of the virtual image object associated with the virtual object by the relationship information stored in the storage means, according to the contents of the change accepted by the acceptance means. The virtual object, the virtual mirror, and the virtual image object can be viewed from the camera through the virtual mirror that produced the virtual image object. It has a two-dimensional image generating means for generating a two-dimensional image obtained when a photograph is taken based on the object data stored in the storage means, and a display means for displaying the generated two-dimensional image. 3D graphics device. 4. A three-dimensional graphics device for displaying a two-dimensional image captured by a virtual camera arranged in the three-dimensional space, the three-dimensional graphics device being arranged in the three-dimensional space. A virtual object, a virtual mirror, and object data defining the shape and arrangement of a virtual image object, which is an object having a shape and arrangement corresponding to a virtual image of the virtual object by the virtual mirror, A storage unit that stores relationship information that associates the virtual image object and the virtual object that is in a real image relationship with a virtual image corresponding to the virtual image object, and a setting for changing the arrangement of the virtual object. The receiving means for receiving, and the arrangement of the virtual object is changed according to the change of the arrangement received by the receiving means, and the virtual object is associated with the virtual object by the relation information stored in the storage means. The virtual image object is stored in the storage means so that the set arrangement is changed and the arrangement of the mirror-symmetrical surface of the virtual mirror that produces a virtual image corresponding to the virtual image object is changed. Means for changing the placement of the virtual object and the placement of the virtual image object associated with the virtual object, defined by the object data, and the virtual image object from the camera The two-dimensional image obtained when the virtual object, the virtual mirror, and the virtual image object are photographed by the camera is stored as the object that can be seen through the created virtual mirror. A two-dimensional image generating means for generating the generated two-dimensional image based on the object data stored in the means, and a display means for displaying the generated two-dimensional image. Equipment. 5. A three-dimensional graphics device for generating a two-dimensional image captured by a virtual camera arranged in the three-dimensional space, the three-dimensional graphics device being arranged in the three-dimensional space. A storage unit that stores a virtual object and object data that defines the shape and arrangement of the virtual mirror, and the arrangement of the virtual camera that captures the three-dimensional world in the three-dimensional space. The virtual means that the virtual image is generated by the mirror according to the arrangement of the camera determined by the arrangement of the camera received by the reception means and the orientation of the virtual mirror surface of the virtual mirror. An object is obtained, and the shape of the virtual image object, which is an object corresponding to the virtual image of the virtual object obtained by the virtual mirror, according to the arrangement of the camera and the direction of the mirror surface of the virtual mirror. Request placement A virtual image object generating means, means for adding the obtained definition of the shape and arrangement of the virtual image object to the object data of the storage means, and the virtual image object from the camera of the arrangement received by the receiving means. It is obtained when the camera captures the virtual object, the virtual mirror, and a virtual image object determined to be displayed by the determination means, as a thing that can be seen through the generated virtual mirror. 2
A three-dimensional graphics device comprising: a two-dimensional image generation unit that generates a three-dimensional image based on the object data stored in the storage unit; and a display unit that displays the generated two-dimensional image. . 6. The three-dimensional graphics device according to claim 5, wherein the virtual image object generating means generates a virtual image according to the arrangement of the cameras and the direction of the mirror surface of the virtual mirror. A shape obtained by finding a point corresponding to a virtual image by the virtual mirror at each vertex of a virtual object and connecting the obtained points corresponding to the virtual image and its arrangement are the shape and the arrangement of the virtual image object. A three-dimensional graphics device characterized in that 7. An image generation method for generating a two-dimensional image by projecting a virtual three-dimensional space onto a two-dimensional plane arranged in the three-dimensional space, comprising a virtual object and a virtual mirror. Arranging, in the three-dimensional space, a virtual image object, which is an object having a shape and an arrangement corresponding to a virtual image of the virtual object by the virtual mirror, the virtual object, and the virtual object. A mirror and the virtual image object are projected onto the two-dimensional plane to generate a two-dimensional image. The step of generating the two-dimensional image includes only the virtual image object on the two-dimensional plane. Generating a projected two-dimensional image, and generating a first two-dimensional image in which only a portion of the two-dimensional image that has passed through the range of the mirror surface of the virtual mirror and is projected is effective, and The valid portion is the position of the mirror surface of the virtual mirror. It is assumed that the virtual object is projected onto the two-dimensional plane, and a second two-dimensional image is generated by projecting the virtual object onto the two-dimensional plane. When the corresponding pixel of the first two-dimensional image is a pixel not included in the validated portion, the pixel of the first two-dimensional image and the second two-dimensional image corresponding to the coordinate point Of the pixel values of the second two-dimensional image, the pixel values of the final two-dimensional image corresponding to the coordinate points are set to the first two-dimensional values corresponding to the coordinate points. If the pixel of the image is a pixel included in the valid portion, the pixel of the values of the pixel of the first two-dimensional image and the pixel of the second two-dimensional image corresponding to the coordinate point is the pixel. The position of the point projected on is defined by the coordinate point on the two-dimensional plane corresponding to the pixel. Stomach the way, the final two-dimensional image,
Image generation, which is a step of generating a final two-dimensional image in which the first two-dimensional image and the second two-dimensional image are combined by setting the value of the pixel corresponding to the coordinate point. Method.