JPH0944703A - Three-dimensional image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make the coordinate conversion unnecessary and to increase the processing speed of a three-dimensional image processor by judging an object that is designated on an image display screen based on the Z value and by making reference to a three-dimensional image data table. SOLUTION: The coordinates of an object are held by a virtual three- dimensional space data holding part 3. When a visual point is designated, a coordinate conversion means 6 converts the Z coordinates showing the depth as well as the XY coordinates obtained by applying the prespective conversion to the image of the object on a two-dimensional screen and holds these converted coordinates on a three-dimensional image data table 4. A display data production means 7 decides a display position on a display device 10 based on the XY coordinates and performs the hidden surface processing to produce the display data with addition of its attribute. The display data are shown on the device 10. When a point is designated on the screen, a retrieval means 9 refers to the table 4 to judge an object on the XY coordinates. If plural objects exist on the same XY coordinates, these objects are compared with the Z coordinates. Thus, an object having the least value is judged as the object. In such a constitution, the image processing can be carried out in real time.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image processing apparatus that executes an event in real time. A three-dimensional image processing device arranges a display object represented by combining polygons in a three-dimensional coordinate space, changes the coordinate arrangement according to the position of the viewpoint specified by the user, and displays the object displayed by the viewpoint. Is calculated in real time and displayed on the two-dimensional screen of the display device.

A three-dimensional image processing apparatus is required to not only display a three-dimensional image but also to accept the user's intention in response to an input from the user and cause some event in the virtual three-dimensional space to be displayed. For example, in the case of a house exhibition system, the movement of the viewpoint by the user is read, and the image is calculated and displayed as if the user were walking around in the virtual house. Then, clicking the displayed door knob with the mouse causes an event such as opening the door. In this way, when an event is generated in the virtual space by inputting the user's intention in some form, the user's search for the virtual space can be made more realistic, and the user's request to touch and operate something visible can be satisfied. It is intriguing.

In the event, the input from the user is an object to be operated drawn on a two-dimensional screen with a mouse, a light pen,
It can be triggered by pointing with a button. Therefore, the three-dimensional image processing apparatus needs a technique for determining in real time which object in the three-dimensional space the coordinate point on the two-dimensional screen designated by the user points to.

[0004]

2. Description of the Related Art Discrimination of a designated object in the prior art is as follows. First, after a user who specifies an object inputs coordinates on a two-dimensional screen, it is determined which three-dimensional object the input coordinate point points to. Therefore, the coordinate transformation is calculated for each basic constituent element (polygon) that composes the object arranged in the virtual three-dimensional space stored in advance, and then the depth is calculated. The polygon or pixel whose Z coordinate to represent is the most previous from the viewpoint was selected. As a result, each process takes time.

14 (a) and 14 (b) show a conventional technique. In a conventional three-dimensional image processing apparatus, hidden surface processing for displaying only the front one of front and rear overlapping objects is a method of finding the frontmost polygon based on the size of the Z coordinate in polygon units (Japanese Patent Laid-Open No. 6-58242). -162170) and the size of the Z coordinate in pixel units,
A method for finding the foremost object (Japanese Patent Laid-Open No. 6-266)
No. 821).

FIG. 14 (a) shows an outline of the above method. In FIG. 14A, reference numeral 311 denotes a three-dimensional object designation input process, which is an input process for designating an object on the three-dimensional space displayed on the two-dimensional screen on the display screen.

Reference numeral 312 denotes a coordinate conversion process, which is a virtual 3
3D coordinate of object in 3D space
This is a process of converting into dimensional coordinates. A clipping process 313 is a process of cutting out the object into a predetermined frame size.

Reference numeral 314 is a process for determining the minimum Z coordinate value, which is a process for determining the object having the smallest Z value (depth from the display surface) of the object (object in the foreground).
Reference numeral 315 is a determination process as to whether all polygons have been processed.

The hidden surface processing of FIG. 14 (a) and the method of determining an object will be described. The user performs a 3D object designation input process 311 by designating an object on the screen of the display device and clicking the mouse. As a result, previously stored graphic data (coordinates of polygons in the virtual three-dimensional space,
Coordinate conversion of the attribute is performed according to the specified viewpoint (coordinate conversion process 312). Further, the object is clipped by the pick frame (clipping process 313). Then, the Z values of the graphic data in the clip frame are compared (minimum Z coordinate value determination processing 314). Such processing is performed for all the objects in the pick, and the objects are displayed by displaying the polygon having the smallest Z coordinate value, and the objects are designated.

FIG. 14 (b) shows the above method. FIG.
In (b), reference numeral 321 denotes a process of inputting a three-dimensional object, which is an input for specifying an object in a three-dimensional space (virtual three-dimensional space) displayed on the two-dimensional screen on the two-dimensional display screen. Represents a process.

Reference numeral 322 denotes a coordinate conversion process, which is a virtual 3
3D coordinate of object in 3D space
This is a process of converting into dimensional coordinates. Reference numeral 323 is a pixel drawing process, which is a process of displaying the pixels of the object in the designated area.

Reference numeral 324 is a process for determining the minimum Z coordinate value, which is a process for comparing the Z coordinate values for each pixel to obtain the pixel having the minimum Z coordinate value. A depth buffer 326 is prepared to hold the minimum Z coordinate value, the Z coordinate values of the depth buffer 326 at the same display position for the pixels to be extracted are compared, and the smaller Z coordinate value is used for the depth buffer 32.
Hold at 6.

Reference numeral 325 is a process for determining whether all the designated polygons have been drawn. Reference numeral 326 is a depth buffer.

The user specifies an object that causes an event on the screen of the display device (3D object specification input processing 311). After the coordinate conversion is performed, the Z coordinate value of the pixel and the Z stored in the depth buffer 326 are displayed for each pixel by displaying the pixel of the object arranged in the three-dimensional space in the designated area. If the Z coordinate value of the pixel fetched later is smaller, the depth buffer 326 is updated with that value. If the Z coordinate value of the pixel fetched later is larger, the Z coordinate of the depth buffer 326 is compared. Do not update the value. When the Z coordinate value is updated, the identification information of the object of the updated pixel is also held. Such processing is performed for all polygons in the designated area, and the object having the minimum Z coordinate value is displayed. In this process, since the pixel and the identifier of the object are associated with each other, the object is determined by the identifier.

[0015]

In the conventional object determination processing, coordinate conversion is first performed by loop processing for each polygon or all pixels for each polygon, and then Z conversion is performed.
Since the coordinate value is determined, it takes time to determine the designated object. Therefore, it takes a long time to output an event such as a sound assigned to a specified object or to cause an event such as opening a door when the object is a door.

It is an object of the present invention to provide a three-dimensional image processing apparatus capable of determining a designated object at high speed, and determining the object and executing an event in real time.

[0017]

According to the present invention, each coordinate of the vertices of a three-dimensional display element constituting a display target is perspectively transformed on a two-dimensional screen based on a viewpoint, and Z representing the XY coordinate and depth is displayed.
Coordinate conversion means for converting into coordinates, a three-dimensional image data table holding Z coordinate values corresponding to the XY coordinate values converted by the coordinate conversion means, and information about an object, and display of a three-dimensional image by an input device. A 3D image data table based on the coordinate data of the 3D image data table, and 3D image display after the 3D image display. The data table is held, and the search means searches the designated object for the Z coordinate using the XY coordinates of the three-dimensional image data table as a key, and outputs information about the corresponding object. In this way, it is not necessary to recalculate the coordinates for determining the object, the object can be determined at high speed, and information about the object can be obtained. Also,
The information about the object is used as the address of the event information of the object, and when the search means outputs the address, the event information is executed so that the event can be executed at high speed.

FIG. 1 shows the basic configuration of the present invention. In FIG. 1, reference numeral 1 is a three-dimensional image processing device.

Reference numeral 2 is a storage unit. A virtual three-dimensional space data holding unit 3 holds the three-dimensional coordinates and attributes of the three-dimensional display elements (polygons) forming the object.

Reference numeral 4 is a three-dimensional image data table,
The three-dimensional coordinate values held in the virtual three-dimensional space data holding unit 3 are converted into three-dimensional coordinate values of XY coordinate values obtained by perspective transformation on a two-dimensional screen according to the viewpoint and Z coordinate values indicating the depth from the screen. It holds the three-dimensional image data including the three-dimensional coordinates and the attribute.

An event information holding unit 5 holds event information assigned to an object (such as a door opening sound and a door opening movement if the object is a door). Reference numeral 6 denotes a coordinate conversion means, which is an XY coordinate obtained by perspectively converting the coordinate value of the virtual three-dimensional space data of the object on the two-dimensional screen according to the position of the viewpoint and the Z coordinate value indicating the depth from the screen. It is to be converted into a dimensional coordinate value.

Reference numeral 7 is a display data creating means, which performs a hidden surface process for displaying the object on the screen based on the three-dimensional image data of the object held in the three-dimensional image data table 4 for each pixel. The display data of is created.

Reference numeral 8 is an event executing means for executing the event information of the designated object. 9
Is a search means for searching the three-dimensional image data table from one point designated on the display screen displaying the object in the three-dimensional space.

Reference numeral 10 denotes a display device, which is a display. Reference numeral 11 denotes another information output device, which is an information output device other than the display device such as a voice output device if the event information is voice.

Reference numeral 12 denotes an input device, which is a keyboard, a mouse, a touch panel, or the like. The operation of the basic configuration of the present invention shown in FIG. 1 will be described.

An object is represented by a polygonal display basic element (polygon), and its virtual three-dimensional space data (coordinates on the XY plane and Z coordinates in the depth direction perpendicular to the XY plane (image plane), attributes, etc.) are used. The coordinate value of is stored in the virtual three-dimensional space data storage unit. The viewpoint on the display screen is specified by the user. The coordinate conversion means 6 converts an image when the object is viewed from the viewpoint into an XY coordinate which is perspective-transformed on a two-dimensional screen and a Z coordinate indicating a depth from the screen, and the coordinate value thereof is a three-dimensional image data table. Hold at 4. The three-dimensional image data table holds the XY coordinates on the display screen, the distance Z coordinate value in the depth direction from the viewpoint, the information about the object, the attribute of the object, and the like. The display data creation means 7 determines the position to be displayed on the display device 10 on the screen by the XY coordinate values held in the three-dimensional image data table 4, and performs the hidden surface processing by the Z coordinate value. Furthermore, display data is created by adding attributes. The display device 10 displays the object based on the display data created by the display data creating means.
To be displayed.

When one point on the screen is designated, the search means 9
Refers to the 3D image data table and specifies the XY
The object at the coordinate position is determined. When there are a plurality of objects on the same XY coordinates, the Z coordinate values held in the three-dimensional image data table 4 are compared and the object having the smallest Z coordinate value is determined as the specified object. To do. Then, information about the object is output.

The event executing means 8 refers to the event information holding section 5 to take out the event information assigned to the designated object and output it to the display device 10 or another information output device 11. For example, it is assumed that the designated object is a handle of the door and the event is set so that the door is opened and music is output when the handle is designated. When the handle is designated and it is determined that the designated object is the handle, the door on the display screen is opened and music is output from the speaker.

According to the present invention, the object is determined by the three-dimensional image data table, and the Z value is used to determine the image display and the object designated on the screen. Therefore, the coordinate conversion processing of the object is unnecessary. It is possible to quickly judge a target object. Therefore, the time from the designation of the object to the execution of the event is shortened, and the image processing can be performed in real time.

[0030]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A three-dimensional image processing method of the present invention will be described with reference to FIGS.

FIG. 2A shows a floor plan. Two
1 is a floor plan. The floor plans are for A, B, C, D, and E rooms.

A1 is a piano, A2 is a flower bottle, A3 is a picture hung on a wall, and A4 is a closet. FIG. 2B is an explanatory diagram of a method of expressing a piano with a three-dimensional image processing apparatus.

22 is a piano. (one two Three) ,
(4), (5), (6), (7), (8), (9), (10), (11), (1
2) are the basic components (hereinafter referred to as polygons)
Therefore, the piano 22 is represented by 12 polygons. The coordinates of the vertices of each polygon are represented as virtual three-dimensional space data of the piano.

FIG. 3 shows an example of the virtual three-dimensional space data table of the present invention. In FIG. 3, reference numeral 31 is an address table indicating the internal data of each room.

Reference numeral 32 is an address representing the arrangement of furniture in the room. It holds a furniture name and its start address, an event flag indicating the presence or absence of an event, and an event address which is an address of a position where an event execution program is located. For the event flag, "1" indicates an event,
"0" represents no event. A1 is a piano and has an event (when the piano is designated, music is output). A2 is a flower bottle with no event. A3 is a picture on the wall, which has an event that the picture falls when specified. A4 is a chest and there is no event.

Reference numeral 33 indicates the coordinate position and attribute of each polygon of furniture A1 (piano). (1) to (12) correspond to the polygon numbers of the above-mentioned piano, and have the coordinates of the position of each vertex. The attribute of each color is black.

FIG. 4 is an explanatory diagram of a three-dimensional image processing method of the present invention. FIG. 4A shows a display portion on the display device from the viewpoint 1. 41 is a plan view of the room A.

A1 is a piano, A2 is a flower bottle, A3 is a picture,
A4 is a chest (same as in Figure 2 (a)). The area shown when the direction of the flower bin A2 is viewed from the viewpoint 1 is indicated by diagonal lines.

FIG. 4 (b) shows a display screen displayed by the viewpoint 1 of FIG. 4 (a). Reference numeral 42 denotes a display inside the room A, which is a screen display when the direction of the flower bin A2 is seen from the viewpoint of FIG.

A1 is a piano, A2 is a flower bottle, and A3 is a picture. FIG. 5 is an explanatory diagram of a three-dimensional image processing method of the present invention. FIG. 5A shows a display portion on the display device from the viewpoint 2.

Since the position of the viewpoint 2 in FIG. 5 (a) is different from that in FIG. 4 (a), detailed description thereof will be omitted. FIG. 5 (b) shows a display screen displayed by the viewpoint 2 of FIG. 5 (a).

Reference numeral 42 denotes a display inside the room A, which is shown in FIG.
It is displayed on the screen from the viewpoint (a). A1 is a piano, A2 is a flower bottle, and A3 is a picture, which is the same as in FIG. 4 (b).

In FIG. 5 (b), since the piano A1 and the flower bin A2 partially overlap on the image plane, the distances from the respective viewpoints are determined and the farther away (in the case of FIG. 5 (b), the piano A1). The overlapping part of is hidden so that it is not displayed. Further, when a flower bin is designated on the screen, it is necessary to distinguish it from the piano A1, so the distance (Z coordinate value) from the viewpoint of the piano A1 and the flower bin A2 to the three-dimensional image sort data table (described later). ), The Z-coordinate value is compared and the flower bin A2 having a smaller Z-coordinate value is set as the designated object.

Before describing the system configuration of the first embodiment of the present invention in FIG. 6, an embodiment of the three-dimensional image data table and the three-dimensional image sort data table of the present invention in FIG. 7 will be described.

FIG. 7A is a three-dimensional image data table, in which the XY coordinates and Z coordinates obtained by coordinate conversion of each coordinate of the virtual three-dimensional space data table by the coordinate conversion means,
It holds an event flag indicating the presence or absence of an event, an event start address, attributes, and the like.

The four XY coordinates correspond to each vertex (4
X) XY coordinates. The Z coordinate is a coordinate representing the depth from the display surface. The event flag is a flag indicating the presence / absence of an event, where 1 is an event and 0 is no event.

The event start address is the start address of the event execution program. FIG. 7B shows a three-dimensional image sort data table, which is obtained by sorting the three-dimensional image data table of FIG. 7A by Z coordinate values.

FIG. 6 shows the system configuration of the first embodiment of the present invention. In FIG. 6, reference numeral 51 is a three-dimensional image processing device.

A display device 54 is a display. An input device 55 includes a keyboard, a mouse,
For example, a touch panel. Reference numeral 56 'is an event output device, which is an output device for sounds and the like.

In the three-dimensional image processing apparatus 51, a processing unit 56 is provided on the memory and has various processing means. Reference numeral 61 is a coordinate conversion means.

Reference numeral 62 denotes a sorting means for sorting the three-dimensional image data held in the three-dimensional image data table 72 with respect to the Z coordinate. Reference numeral 63 denotes a distance calculation means, which determines the distance from the viewpoint based on the three-dimensional image data stored in the three-dimensional image sort data table 73.

Reference numeral 64 is a display data creating means which refers to the three-dimensional image sort data table 73 to display the display device 5
The display data of 4 is created. Reference numeral 65 denotes an event executing means, which refers to the event data 82, rewrites the virtual three-dimensional space data 81, and activates the coordinate converting means 61 to execute or execute event execution data.

Reference numeral 66 is an event output means for outputting the execution data of the event held in the event output data holding section 74 to the event output device 56. Reference numeral 67 denotes a matching means, which is a means for searching the three-dimensional image sort data table 73 to determine the designated target when the designated input of the target is made (corresponding to the search means 9 in FIG. 1). To).

Reference numeral 68 denotes an input determination means for determining whether the viewpoint position is designated and the object is designated. 6
Reference numeral 9 is a display data output means, which is a display data holding unit 7.
The display data held in 5 is output.

Reference numeral 71 denotes the storage unit 1, which is an internal memory. In the storage unit 1 (71), 72 is a three-dimensional image data table, which holds three-dimensional image data.

A three-dimensional image sort data table 73 holds three-dimensional image data sorted by Z coordinates. An event output data holding unit 74 holds event data to be output such as voice.

A display data holding unit 75 is an image memory. The storage unit 2 is an internal memory or a magnetic disk device. Reference numeral 81 is virtual three-dimensional space data.

Reference numeral 82 is event data such as a script describing an event and voice. The operation of the system configuration of the first embodiment of FIG. 6 will be described with reference to the flowchart of FIG.

The operation will be described according to the step numbers shown. The S1 and S2 input determination means 68 waits for the viewpoint movement input and the designation input of the object, and when there is an input, determines which one of them. In the case of the viewpoint movement input, the process proceeds to S3, and in the case of the designation input of the object, the process proceeds to S8.

S3 When there is a viewpoint movement, the coordinate converting means 61 perspectively converts the coordinate values of the virtual three-dimensional space data 81 into a two-dimensional screen according to the position of the viewpoint and the depth from the screen. It is converted into a three-dimensional coordinate value with the indicated Z coordinate value.

S4 A three-dimensional image data table 72 holding three-dimensional image data is created. The S5 sorting means 62 sorts the three-dimensional image data according to the Z coordinate value.

S6 is created in the three-dimensional image sort data table 73 holding the three-dimensional image sort data. S7 The display data creating means 64 refers to the three-dimensional image sort data table 73, creates the image data of the display device 54 by performing display processing in order from the one having the largest Z coordinate value of the polygon, and holds it in the display data holding unit 75. To do. The display data output means 69 takes out the display data held in the display data holding unit 75 and displays it on the display device 54.

In S8, S9 and S2, when the input judging means 68 judges the designated input of the object, the matching means 67 sets the Z-coordinate value of the three-dimensional image sort data table 73 by the XY coordinate of the designated position. Search from the smaller one.

S10 When the object having the designated XY coordinates is found, the distance calculation means 63 calculates the distance from the viewpoint of the coordinate point obtained by adding the Z coordinate value to the designated XY coordinates. S11, S11 'If the distance from the viewpoint of the object is within the reach of the object by calculation of the distance (the distance within the reach of the object is predetermined), the event flag is determined, and the distance is out of the reach of the hand. If there is, return to S1.

S12, S12 'When it is determined in S11' that the hand is within reach, the event executing means 65
Determines the event flag. If the event flag is 1, proceed to S13, and if the event flag is not 1, S1
Return to

Since the S13 event flag is 1,
The event executing means 65 creates event execution data and holds it in the event output data holding unit 74. The event output unit 66 takes out the event data held in the event output data holding unit 74 and outputs it to the event output device 56. If the event is to be displayed on the display device 54 such as opening and closing the door, the event executing means 65 rewrites the virtual three-dimensional space data and activates the coordinate converting means to create and display the display data. The data is held in the data holding unit 75, and the display data output means 69 performs display processing.

FIG. 9 shows the system configuration of the second embodiment of the present invention. FIG. 9 shows the system configuration when the present invention is embodied by the Z buffer method. In FIG. 9, reference numeral 51 is a three-dimensional image processing device.

A display device 54 is a display. An input device 55 includes a keyboard, a mouse,
For example, a touch panel. Reference numeral 56 'is an event output device, which is an output device for sounds and the like.

In the three-dimensional image processing apparatus 51, reference numeral 56 is a processing unit, which is on a memory and has various processing means. Reference numeral 61 is a coordinate conversion means.

Reference numeral 62 'is a Z coordinate judging means, which refers to the Z value of the event table 73' for each pixel, judges the magnitude of the Z coordinate value, and updates the event table 73 'with the smaller Z value. It is a thing.

Reference numeral 63 is a distance calculation means, which calculates the distance from the event table according to an instruction from the event search means. 64 is a display data creating means,
The display data to be displayed on the display device 54 is created.

Reference numeral 65 is an event execution means, which refers to the event data 82 and rewrites the virtual three-dimensional space data 81 to execute the coordinate conversion means 61 to execute or create event execution data. Is.

Reference numeral 66 is an event output means for outputting the execution data of the event held in the event output data holding section 74 to the event output device. 6
Reference numeral 7'denotes an event search means, which is means for searching the event table 73 'to determine the designated object when the designated input of the object is made.

Reference numeral 68 denotes an input determination means for determining whether the viewpoint position is designated and the object is designated. 6
Reference numeral 9 is a display data output means, which is a display data holding unit 7.
The display data held in 5 is output.

Reference numeral 71 is a storage unit 1, which is an internal memory. In the storage unit 1 (71), 72 is a three-dimensional image data table, which holds three-dimensional image data.

An event table 73 'holds a Z coordinate value, an event flag, and an event address for each pixel. An event output data holding unit 74 holds event data to be output such as voice.

A display data holding unit 75 is an image memory. The storage unit 2 is an internal memory or a magnetic disk device. Reference numeral 81 is virtual three-dimensional space data.

Reference numeral 82 is event data such as a script describing an event and voice. The operation of the system configuration of FIG. 9 will be described later. FIG. 10 shows an embodiment of the event table of the present invention.

FIG. 10A shows a pixel arrangement on the display screen. The horizontal direction of the screen is the X axis and the vertical direction is the Y axis. The maximum value of the X coordinate is MaxX and the maximum value of the Y coordinate is MaxY, and each pixel has a coordinate value.

FIG. 10B shows an embodiment of an event table, which has a Z coordinate, an event flag and an event address for each pixel. The pixel position is X in Figure 10 (a).
It is the coordinate value of the Y coordinate.

Event flag 1 indicates that there is an event, and event flag 0 indicates that there is no event.
FIG. 11 is a flowchart of the system configuration of the second embodiment of the present invention.

The operation of the system configuration of the second embodiment of FIG. 9 will be described with reference to the flowchart of FIG. The operation will be described according to the step numbers shown.

The S1 and S2 input determination means 68 waits for the viewpoint movement input and the designation input of the object, and when there is an input, determines which one of them. In the case of the viewpoint movement input, the process proceeds to S3, and in the case of the designation input of the object, the process proceeds to S10.

S3 When the viewpoint is moved, the coordinate conversion means 61 perspectively transforms the virtual three-dimensional space data 81 into a two-dimensional screen according to the position of the viewpoint and the Z coordinate indicating the depth from the screen. Convert to 3D image data with values.

The following steps S4 to S9 are repeated for all polygons. The following S4 to S8 are repeated for all the pixels of each polygon. S4, S5 Z coordinate determination means 62 'has the same XY for each pixel.
The Z coordinate value of the pixel of the coordinate held in the event table 73 'is compared, and if the Z coordinate value of the pixel to be compared is smaller than the Z coordinate value of the event table 73', the Z coordinate value in the event table is compared. Write the value, event flag, and event address.

S6, S7 The display data creating means 64 creates display data according to the attributes. The created display data is held in the display data holding unit 75. The display data output means 69 takes out the display data held in the display data holding unit 75 and displays it on the display device 54.

S8, S8 ': It is judged whether all the pixels of one polygon are finished. If not all finished, S4
The subsequent processing is repeated. If all have been completed, proceed to S9. S9, S9 'It is determined whether or not all the polygons are finished, and if they are not finished, the processes after S4 are repeated for the next Boligon. S if all polygons are finished
Return to 1.

In S10, S10 'S2, when the input judging means 68 judges the designated input of the object, the event searching means 67' searches the event table 73 'with the specified XY coordinates. If the specified XY coordinates are found, the process proceeds to S11, and if not found, the process returns to S1.

When the specified XY coordinates are found by searching the S11 event table 73 ', the distance calculation means 63 calculates the distance from the viewpoint of the coordinate point obtained by adding the Z coordinate value to the specified XY coordinates. To do.

S12, S12 'If the distance from the viewpoint of the coordinate point is within the reach of the hand (the distance within the reach of the hand is determined in advance) by calculating the distance, the process proceeds to the process S13' for determining the event flag, If it is out of the reachable range, the process returns to S1.

S13, S13 'If it is determined in S12' that the distance is within reach, the event executing means 65
Determines the event flag. If the event flag is 1, proceed to S14, and if the event flag is not 1, S1
Return to

Since the S14 event flag is 1,
The event executing means 65 creates event execution data and holds it in the event output data holding unit 74. The event output unit 66 takes out the event data held in the event output data holding unit 74 and outputs it to the event output device 56. If the event is to be displayed on the display device 54 such as opening and closing the door, the event executing means 65 rewrites the virtual three-dimensional space data and activates the coordinate converting means to create and display the display data. The data is held in the data holding unit 75, and the display data output means 69 performs display processing.

FIG. 12 is a flowchart of the third embodiment of the present invention. In the third embodiment of the present invention, hidden surface processing, determination of an object, and presence / absence of an event are performed with reference to a three-dimensional image sort data table. If the distance is out of the reach, the event flag of the object is rewritten, and if the distance is within the reach, the event flag of the object is left as it is, and the display process is performed. When the event flag is 1, the display color is changed to a predetermined color (for example, red) indicating that an event different from the original color of the object is executed, and when the event flag is 0, the original color of the object is changed. The color is displayed.

The S1 and S2 input determination means 68 waits for the viewpoint movement input and the designation input of the object, and when there is an input, determines which one of them. In the case of the viewpoint movement input, the process proceeds to S3, and in the case of the designation input of the object, the process proceeds to S14.

S3 When there is a viewpoint movement, the coordinate conversion means 61 perspectively converts the coordinate values of the virtual three-dimensional space data 81 into a two-dimensional screen according to the position of the viewpoint and the depth from the screen. It is converted into a three-dimensional image coordinate value with the indicated Z coordinate value.

S4 A three-dimensional image data table 72 holding three-dimensional image data is created. The S5 sorting means 62 sorts the three-dimensional image data according to the Z coordinate value.

S6 A three-dimensional image sort data table 73 holding the three-dimensional image sort data is created. S7
~ S9 is repeated for each polygon whose event flag is 1.

S7, S8, S9 The distance calculating means 63 calculates the distance from the viewpoint. If the distance is within the reach, the event flag is not rewritten. If the distance is out of reach, the event flag is rewritten to 0 in S9.

S10: It is judged whether all polygons of the event flag 1 have been executed. If not executed for all polygons, the processes from S7 are repeated. If all polygons have been processed, the event flag is judged in S10 '. .

Steps S10 'to S12 are repeated for each polygon. S10 ', S11, S12 If the event flag is 1, the display color of the object is displayed in red in S11. If the event flag is 0, the original color of the object is displayed in S12.

S13: It is determined whether or not each polygon has been processed. If each polygon has not been processed, the processes in and after S10 'are repeated. If so, the process returns to S1. In S14, S14 'S2, when the input determination means 68 determines the designated input of the object, the matching means 67
Searches the three-dimensional image sort data table 73 from the smaller Z coordinate value according to the XY coordinates of the designated position. If the object is found, the process proceeds to S15 to determine the event flag, and if not found, the process returns to S1.

S15, S16 The event flag is determined. If the event flag is 0, the process returns to S1. If the event flag is 1, the event execution means 65 creates execution data of the event in S16 and holds it in the event output data holding unit 74. The event output unit 66 takes out the event data held in the event output data holding unit 74 and outputs it to the event output device 56. If the event is to be displayed on the display device 54 such as opening and closing the door, the event executing means 65 rewrites the virtual three-dimensional space data and activates the coordinate converting means to create and display the display data. It is held in the data holding unit 75,
Display processing is performed by the display data output means 69.

In the third embodiment, the color displayed for each polygon is changed and the coordinate points on the two-dimensional screen where the event occurs when specified are displayed. Which polygon is which three-dimensional target object during each processing is displayed. Information that belongs to
Have it in the three-dimensional image data table, and if you specify it, the unit in which the event occurs will be the three-dimensional object,
It is also possible to change the color for each three-dimensional object.

FIG. 13 is a flowchart of the fourth embodiment of the present invention. The fourth embodiment of the present invention is a flow chart when the present invention is applied to a method of performing hidden surface processing for each pixel by the Z buffer method.
Judge the distance of the object, and if the distance is out of the reach, rewrite the event flag of the object to 0, and if the distance is within the reach, leave the event flag of the object as it is. If the event flag is 1 in the display process, the display color is changed to a predetermined color (for example, red) indicating that an event different from the original color of the object is executed, and the event flag is 0. For example, the original color of the object is displayed.

The S1 and S2 input determining means 68 waits for the viewpoint movement input and the designation input of the object, and when there is an input, determines which one of them. In the case of the viewpoint movement input, the process proceeds to S3, and in the case of the designation input of the object, the process proceeds to S14.

S3 When there is a viewpoint movement, the coordinate converting means 61 perspectively converts the coordinate values of the virtual three-dimensional space data 81 into a two-dimensional screen according to the position of the viewpoint and the depth from the screen. Convert to three-dimensional coordinates with the indicated Z coordinate value.

Steps S4 to S13 are repeated for all polygons. S4 to S12 are repeated for all pixels in one polygon. S4, S5 Z coordinate determination means 62 'has the same XY for each pixel.
If the Z coordinate value of the pixel of the coordinate is smaller than the Z coordinate value of the event table 73 ′, the Z coordinate value of the pixel of the coordinate is compared with the Z coordinate value held in the event table 73 ′. Write the value, event flag, and event address.

For a pixel whose event flag is 1, S
The processing of S6, S7 and S8 is performed. S6 The distance calculation means 63 calculates the distance from the viewpoint of the three-dimensional coordinates indicated by the XY coordinate value and the Z coordinate value.

S7, S8 It is judged whether the distance calculated as the distance is within the reach of the hand or within the reach of the hand. If it is out of reach, the event flag is rewritten to 0 in S8. If the distance is within the reach, the event flag is not rewritten.

S9, S10, S11 Event flags are determined. If the event flag is 1, the object is displayed in red in S10, and if the event flag is 0, the original color is displayed.

S12: It is determined whether or not all the pixels in one polygon are processed. If all the pixels are completed, the process proceeds to S13, and if not completed, the processes from S4 are repeated.

S13: It is judged whether or not all polygons have been processed. If not, it is S4.
If the process is repeated for all polygons, the process returns to S1. In S14, S15, S16 and S2, when the input determining means 68 determines the designated input of the object, the event searching means 67 'searches the event table 73' by the XY coordinate of the designated position and sets the event flag. judge. If the event flag is 0, the process returns to S1. If the event flag is 1, the event execution means 65 creates execution data of the event in S16 and holds it in the event output data holding unit 74. The event output unit 66 takes out the event data held in the event output data holding unit 74 and outputs it to the event output device 56. If the event is to be displayed on the display device 54 such as opening and closing the door, the event executing means 65 rewrites the virtual three-dimensional space data and activates the coordinate converting means to create and display the display data. It is held in the data holding unit 75,
Display processing is performed by the display data output means 69.

In the fourth embodiment, the displayed color is changed for each pixel,
The coordinate points on the 2D screen where an event occurs when specified are displayed. Information on which pixel belongs to which 3D object is stored in the 3D image data table during each processing. If specified, the unit in which the event occurs may be set for each three-dimensional object, and the color may be changed for each three-dimensional object.

[0114]

According to the present invention, an object in the three-dimensional space designated on the display and screen of the object is displayed by referring to a table such as a three-dimensional image data table, a three-dimensional image sort data table, and an event table. Since the determination is made, the display and the determination can be performed at high speed. In addition, since the presence or absence of an event is determined by referring to a flag or the like in the table, it is possible to select an event at high speed.

Therefore, according to the present invention, the time from the display of the object and the designation of the object to the execution of the event is shortened, and the image processing can be performed in real time. Moreover, since it is determined whether or not the event is executed depending on the distance from the viewpoint, it is possible to produce a search for a three-dimensional space that is close to reality. Further, when specified, the coordinate points on the two-dimensional screen where the event is executed are displayed in a predetermined color different from the original color, so that the user's search can be assisted.

[Brief description of drawings]

FIG. 1 is a diagram showing a basic configuration of the present invention.

FIG. 2 is an explanatory diagram of a three-dimensional image processing method of the present invention.

FIG. 3 is a diagram showing an example of a virtual three-dimensional space data table of the present invention.

FIG. 4 is an explanatory diagram of a three-dimensional image processing method of the present invention.

FIG. 5 is an explanatory diagram of a three-dimensional image processing method of the present invention.

FIG. 6 is a diagram showing a system configuration of a first embodiment of the present invention.

FIG. 7 is a diagram showing an example of a three-dimensional image data table and a three-dimensional image sort data table of the present invention.

FIG. 8 is a diagram showing a flowchart of the system configuration of the first embodiment of the present invention.

FIG. 9 is a diagram showing a system configuration of a second embodiment of the present invention.

FIG. 10 is a diagram showing an example of an event table of the present invention.

FIG. 11 is a diagram showing a flowchart of the system configuration of Example 2 of the present invention.

FIG. 12 is a diagram showing a flowchart of Embodiment 3 of the present invention.

FIG. 13 is a diagram showing a flowchart of Embodiment 4 of the present invention.

FIG. 14 is a diagram showing a conventional technique.

[Explanation of symbols]

 1: Three-dimensional image processing device 2: Storage unit 3: Virtual three-dimensional space data storage unit 4: Three-dimensional image data table 5: Event information storage unit 6: Coordinate conversion unit 7: Display data creation unit 8: Event execution unit 9 : Search means 10: display device 11: other information output device 12: input device

Claims (8)

[Claims] 1. Coordinates of respective vertices of a three-dimensional display element constituting a display target are converted into XY coordinates which are perspective-transformed on a two-dimensional screen based on a viewpoint and Z coordinates which represent a depth from the two-dimensional screen. Coordinate conversion means and X converted by the coordinate conversion means
A three-dimensional image data table that holds the Z coordinate and information about the object corresponding to the Y coordinate, and a search means that searches the three-dimensional image data table by one point specified on the display screen of the three-dimensional image. The three-dimensional image data table is displayed based on the coordinate data of the three-dimensional image data table, the three-dimensional image data table is held even after the three-dimensional image is displayed, and the search means uses the designated XY coordinate of one point as a key. The three-dimensional image data table is searched for the smallest Z coordinate, and information about the corresponding object is output.
Dimensional image processing device. 2. An event information holding unit for holding event information of a display target and an event execution unit for executing the event information, wherein information about the target in the three-dimensional image data table is stored in the event information holding unit. This is an address indicating the event information of the object, and the searching means searches the three-dimensional image data table for the Z coordinate using the XY coordinate of one point designated on the display screen of the three-dimensional image as a key,
The three-dimensional image processing apparatus according to claim 1, wherein when the corresponding address is output, the event executing means executes the event information in the event information holding unit by the address. 3. The three-dimensional image data table holds an event flag indicating the presence / absence of an event, and the presence / absence of execution of the event is determined by referring to the event flag. The three-dimensional image processing device according to item 1. 4. A distance determining means for determining whether or not the distance of the designated object from the viewpoint is within a predetermined constant value, and when the distance is larger than the constant value, the object is The event is not executed even if the event flag indicates that there is an event, and the event is executed when the event exists and the distance of the object is within a certain value. 3D image processing device. 5. In the display processing of the object, the distance from the viewpoint of the object is determined, and the event flag of the object having a certain value or more is used as a flag not to execute the event, and the object having the event is normally displayed. The three-dimensional image processing device according to claim 3, wherein the three-dimensional image processing device displays in a predetermined color different from the color. 6. A three-dimensional image sort data table, which comprises a sorting means, sorts a three-dimensional image data table by Z coordinates, and holds a sorted result, wherein the designated three-dimensional image sort data table 6. The three-dimensional image processing device according to claim 1, wherein the Z coordinate value is sequentially searched from the smaller one to the larger one and from the larger one to the smaller one when the image is displayed. 7. A three-dimensional image processing apparatus for determining a Z-coordinate value for each pixel and determining an object close to a viewpoint based on the Z-coordinate value when there is an object having a different Z-coordinate value at the same pixel position. 4. An event table holding the Z coordinate value closest to the viewpoint corresponding to the pixel, the event flag of the pixel object, and the event information is created and held at the time of displaying the image. Alternatively, the three-dimensional image processing device according to item 4. 8. A three-dimensional image processing apparatus for determining a Z-coordinate value for each pixel and determining an object close to a viewpoint based on the Z-coordinate value when there is a pixel of an object having a different Z-coordinate value at the same pixel position. In the process of displaying pixels, the distance from the viewpoint of the object is determined, and if the distance is equal to or greater than a certain value, the event flag of the object is set as no event, and if the distance is within a certain value. The three-dimensional image processing apparatus according to claim 1 or 2, wherein the display color of the object with the event is displayed in a predetermined color different from the normal display color.