JP2001175890A - System and method for forming three-dimensional image, and input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily and speedily indicate the position of a virtual viewpoint, the direction of view, a moving speed, etc., including jumping operation for the virtual viewpoint and to effectively form and provide a virtual three-dimensional image viewed from the virtual viewpoint moving according to the indication. SOLUTION: Displacing operation along the two-dimensional plane of a joy stick 11 of the input device 1 is assigned to moving operation so that the virtual view point is moved along the two-dimensional plane of the virtual three-dimensional image and the depressing operation of the joy stick 11 of the input device 11 is assigned to what is called the jumping operation as moving operation perpendicular to the two-dimensional plane of the virtual three-dimensional image. In consideration of an input indication by a user through the joy stick 11, a viewpoint position calculation part 42 of the image forming device 3 calculates the position of the virtual viewpoint in the virtual three-dimensional image space, the position of view, and the moving speed and the virtual three-dimensional image viewed from the virtual viewpoint is drawn by a render part 43 of the image forming device 3 and displayed on display elements of a display device 4.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention is applied to, for example, a game machine for playing a game called a video game or a computer game, and forms a virtual three-dimensional image viewed from a virtual viewpoint. Forming system, 3
The present invention relates to a two-dimensional image forming method and an input device.

[0002]

2. Description of the Related Art In a game called a so-called video game or computer game, a game which draws a virtual three-dimensional image viewed from a virtual viewpoint and displays it is provided. I have. This virtual 3
In a game machine that executes a game using a two-dimensional image, a virtual viewpoint is changed by changing a virtual viewpoint position, a viewing direction (direction), a moving speed, and the like according to an input instruction from a user (user). The virtual viewpoint is moved in the three-dimensional image space to form a virtual three-dimensional image viewed from the virtual viewpoint, and this is displayed on a monitor receiver or the like and provided to the user.

As described above, when a virtual three-dimensional image is used, the virtual viewpoint is moved not only in a direction of a virtual three-dimensional image, for example, along a two-dimensional plane orthogonal to the direction of gravity. By making it possible to perform a so-called jump operation of moving the three-dimensional image in a direction perpendicular to the two-dimensional plane, it is possible to form an effective virtual three-dimensional image with a sense of realism.

For this reason, a game input device (game controller) that receives an instruction input from a user has a so-called horizontal operation for moving a virtual viewpoint in a direction along a two-dimensional plane of a virtual three-dimensional image. Key and virtual 3
A so-called jump operation key for moving in a direction perpendicular to the two-dimensional plane of the two-dimensional image is provided.

[0005] Then, the user operates a horizontal operation key,
By operating each of the jump operation keys separately, the virtual viewpoint can be changed in a direction along a two-dimensional plane orthogonal to, for example, the direction of gravity in the virtual three-dimensional image space, and also in a direction perpendicular to the two-dimensional plane. To be able to move.

[0006]

In a game machine or the like that can use a virtual three-dimensional image, in order to move a virtual viewpoint in a virtual three-dimensional image space, a horizontal It is necessary to operate the operation key and the jump operation key using both hands, or to operate each operation key separately using two or more fingers. As described above, it may be troublesome to operate the two types of operation keys using both hands or two or more fingers.

[0007] Even if two kinds of operation keys are operated with only one finger, one of the horizontal operation key and the jump operation key is operated and then the other operation key is operated. For example, two types of operation keys must be operated alternately. In this case, it is considered that each of the operation keys cannot be quickly and accurately operated, and the virtual viewpoint cannot be quickly and accurately moved in the virtual three-dimensional image space as expected by the user. It is considered that there are cases.

For this reason, in the virtual three-dimensional image space, the position of the virtual viewpoint, the azimuth of the viewing, the moving speed, and the like are promptly and accurately indicated by a simple operation, and the position of the virtual viewpoint and the viewing are confirmed. There is an increasing demand for quickly changing a direction, a moving speed, and the like, and quickly forming a virtual three-dimensional image viewed from a virtual viewpoint so that the virtual three-dimensional image can be used.

In view of the above, the present invention provides a simple and quick indication of a virtual viewpoint position, a viewing direction, a moving speed, etc., including a virtual viewpoint jump operation, in a virtual three-dimensional image space. A three-dimensional image forming system, a three-dimensional image forming method, and an input device capable of effectively forming and providing a virtual three-dimensional image viewed from a virtual viewpoint that moves in accordance with the instruction. With the goal.

[0010]

According to a first aspect of the present invention, there is provided a three-dimensional image forming system, comprising: an input device for receiving an instruction input from a user; A three-dimensional image forming system, comprising: an image forming apparatus that forms a virtual three-dimensional image based on a reference; and a display device that displays a virtual three-dimensional image formed by the image forming apparatus. The image forming apparatus includes an operation unit capable of performing a displacement operation in a direction along a two-dimensional plane and a pressing operation in a direction perpendicular to the two-dimensional plane, wherein the image forming apparatus performs the displacement operation of the operation unit of the input device, The virtual viewpoint is assigned to an operation for moving the virtual three-dimensional image in a direction along the two-dimensional plane of the virtual three-dimensional image, and the pressing operation is performed on the virtual three-dimensional image of the virtual three-dimensional image perpendicular to the two-dimensional plane. Viewpoint position calculating means for calculating the position of the virtual viewpoint, the azimuth of viewing, and the moving speed, image data for drawing an image, and calculating by the viewpoint calculating means. The virtual three-dimensional image viewed from the virtual viewpoint is drawn based on the virtual position of the virtual viewpoint, the azimuth of the viewing, and the moving speed, and the drawn virtual three-dimensional image is displayed. And a display device for displaying a virtual three-dimensional image corresponding to the image signal from the drawing device of the image forming apparatus. I do.

According to the three-dimensional image information system of the first aspect, the displacement operation of the operating means of the input device in the direction along the two-dimensional plane is performed along the two-dimensional plane of the virtual three-dimensional image. The virtual viewpoint is assigned to an operation for moving the virtual viewpoint, and the pressing operation of the operation unit of the input device is assigned to a so-called jump operation, which is a movement operation for moving the virtual viewpoint in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image. . The operation for moving the virtual viewpoint along the two-dimensional plane of the virtual three-dimensional image includes the azimuth (moving direction) of viewing the virtual viewpoint.
And acceleration and deceleration of the moving speed.

The position of the virtual viewpoint in the virtual three-dimensional image space, the azimuth of viewing, and the moving speed are calculated by the viewpoint position calculating means of the image forming apparatus in consideration of the user's input instruction through the operating means. Is done. Based on the calculated information such as the position of the virtual viewpoint, the azimuth of viewing, the moving speed, and the image data for forming the three-dimensional image, the virtual three-dimensional image viewed from the virtual viewpoint by the drawing means is displayed. The image is drawn and displayed on the display element of the display device.

As described above, by the operation means of the input device,
The movement of the virtual viewpoint in the direction along the two-dimensional plane of the virtual three-dimensional image space and the movement of the virtual viewpoint in the direction perpendicular to the two-dimensional plane of the virtual three-dimensional image space can be instructed. You. Thus, the position of the virtual viewpoint, the viewing direction, and the moving speed in the virtual three-dimensional image space can be quickly changed by a simple operation on the operation means that can be performed with one finger of the user, and the virtual Can be quickly formed and displayed as a virtual three-dimensional image viewed from the viewpoint of the user.

A three-dimensional image forming system according to a second aspect of the present invention is the three-dimensional image forming system according to the first aspect, wherein a pressing operation is performed by the operating means of the input device. If repeated,
The viewpoint position calculation unit of the image forming apparatus further includes: a state in which the virtual viewpoint moves in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image; And calculating the position of the virtual viewpoint assuming that the virtual viewpoint is moved.

According to the three-dimensional image information system of the second aspect, when the pressing operation of the operating means is repeated, the virtual viewpoint is shifted in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image. Even in the moving state, the virtual three-dimensional image is further moved in a direction perpendicular to the two-dimensional plane. For example, the virtual viewpoint can perform a further jump operation while jumping in the virtual three-dimensional image space.

Thus, the virtual viewpoint can be largely moved in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image space by a simple operation of repeatedly pressing the operation means.

A three-dimensional image forming system according to a third aspect of the present invention is the three-dimensional image forming system according to the first or second aspect, wherein the operating means of the input device includes: When a pressing operation is performed, the viewpoint position calculating means of the image forming apparatus, from the virtual viewpoint, looks at a predetermined gazing point in the virtual three-dimensional image from the virtual viewpoint. A direction of the virtual three-dimensional image with respect to a direction perpendicular to the two-dimensional plane when viewing the viewing direction is determined.

According to the three-dimensional image information system of the third aspect, when the operating means is pressed, the position of the virtual viewpoint moves in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image. Is done. At this time, the direction with respect to the direction perpendicular to the two-dimensional plane of the virtual three-dimensional image when the viewing direction is viewed from the virtual viewpoint is determined so as to look at a predetermined gazing point in the virtual three-dimensional space. Can be

Thus, when the virtual viewpoint is jump-moved in the virtual three-dimensional image space in a direction perpendicular to the two-dimensional plane orthogonal to the direction of gravity, the direction of the virtual viewpoint is automatically reduced, for example, by a depression angle. The virtual three-dimensional image can be viewed downward as it is caused to occur. In this manner, a virtual three-dimensional image that can be seen from a virtual viewpoint can be effectively formed and provided.

A three-dimensional image forming system according to a fourth aspect of the present invention is the three-dimensional image forming system according to the third aspect, wherein a pressing operation is performed by the operating means of the input device. If repeated,
The viewpoint position calculation unit of the image forming apparatus may further include: moving the virtual viewpoint in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image to the two-dimensional plane of the virtual three-dimensional image. While calculating the position of the virtual viewpoint as being moved in the vertical direction,
The 2 in the virtual three-dimensional image of the virtual viewpoint
The position of the gazing point in the virtual three-dimensional image is changed according to a moving distance in a direction perpendicular to the three-dimensional plane.

According to the three-dimensional image information system of the fourth aspect, when the pressing operation of the operating means is repeated,
The virtual viewpoint can be moved farther in the direction perpendicular to the two-dimensional plane of the virtual three-dimensional image in accordance with the number of times of pressing. At this time, the position of the gazing point is changed according to the moving distance of the virtual viewpoint in the direction perpendicular to the two-dimensional plane of the virtual three-dimensional image, and the direction when the viewing direction is viewed from the virtual viewpoint. Is determined.

Thus, the virtual 3D image corresponding to the moving distance in the direction perpendicular to the 2D plane of the virtual 3D image of the virtual viewpoint is obtained.
A three-dimensional image can be formed, and a virtual three-dimensional image can be formed and provided more effectively.

A three-dimensional image forming system according to a fifth aspect of the present invention is the three-dimensional image forming system according to the third or fourth aspect, wherein the three-dimensional image forming system includes the virtual three-dimensional image. When the moving distance of the virtual viewpoint in a direction perpendicular to the two-dimensional plane is equal to or longer than a predetermined moving distance, the virtual viewpoint is viewed from the virtual viewpoint such that the gazing point is viewed from the virtual viewpoint. The direction of the virtual three-dimensional image with respect to a direction perpendicular to the two-dimensional plane when viewing the azimuth is determined.

According to the three-dimensional image information system of the fifth aspect, the moving distance of the virtual viewpoint in the direction perpendicular to the two-dimensional plane in the virtual three-dimensional image is the predetermined moving distance. Until then, the orientation of the virtual viewpoint is maintained as it was. Then, when the moving distance of the virtual viewpoint in the direction perpendicular to the two-dimensional plane in the virtual three-dimensional image becomes equal to or longer than a predetermined distance, the direction of the virtual viewpoint is changed to the direction of viewing the predetermined point of regard. Determined.

Accordingly, when the moving distance is short,
Although the direction of the virtual viewpoint does not change, if the moving distance exceeds a predetermined moving distance, for example, the direction of the virtual viewpoint, the viewing direction does not change from that before the movement, but the direction becomes, for example, the depression angle. Automatically, such as causing it to face down to cause it to occur. Therefore, it is possible to form a virtual three-dimensional image that is similar to the movement of the virtual viewpoint in the direction perpendicular to the two-dimensional plane in the virtual three-dimensional image.

According to a third aspect of the present invention, there is provided a three-dimensional image forming system according to the present invention.
6. The three-dimensional image forming system according to claim 3, wherein the operation unit of the input device is configured to maintain a pressed state. The viewpoint position calculating means is configured not to change the position of the virtual viewpoint in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image.

According to the three-dimensional image information system of the sixth aspect, when the pressing operation state of the operation means is maintained, the viewpoint position calculation means sets the virtual viewpoint in the virtual three-dimensional image space. The position in the direction perpendicular to the two-dimensional plane is maintained. Thereby, the virtual three-dimensional image viewed from the virtual viewpoint at the same position can be displayed and viewed until the pressing operation state of the operation unit is released.

A three-dimensional image forming system according to a seventh aspect of the present invention is the three-dimensional image forming system according to the sixth aspect, wherein the operating means of the input device maintains a pressed state. If so,
The drawing unit of the image forming apparatus draws a virtual three-dimensional image for displaying additional information.

According to the three-dimensional image information system of the present invention, when the pressed state of the operating means is maintained, the position of the virtual viewpoint at that time is maintained, and the position can be seen from the virtual viewpoint. Will be displayed until the pressed state of the operation means is released.
In this case, the virtual three-dimensional image to be displayed is provided to the user by adding more detailed unusable information to the virtual three-dimensional image.

For example, the virtual three-dimensional image may be map information or the like. In this case, if the pressed state of the operation means is maintained for a predetermined time or more, for example, it is determined that the displayed map is being viewed in detail, and in order to provide map information in more detail, the road name or the like is provided. Building names and the like are drawn on map information as a virtual three-dimensional image.

As a result, more detailed information can be provided through the virtual three-dimensional image.

The three-dimensional image forming system according to the eighth aspect of the present invention provides the three-dimensional image forming system according to the first, second, and third aspects.
8. The three-dimensional image forming system according to claim 3, 4, 5, 6, or 7, wherein the operation unit of the input device is pressed, and the virtual viewpoint is set to the virtual viewpoint. When the operation unit is displaced in a direction along the two-dimensional plane while moving in a direction perpendicular to the two-dimensional plane of the three-dimensional image, the viewpoint position calculation unit of the image forming apparatus Can move from a state in which the position of the virtual viewpoint has changed in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image, in a direction along the two-dimensional plane of the virtual three-dimensional image Calculating the position of the virtual viewpoint, the azimuth of viewing, and the moving speed.

According to the three-dimensional image information system of the present invention, the virtual viewpoint is moved in the direction perpendicular to the two-dimensional plane of the virtual three-dimensional image, and the virtual viewpoint is moved to the virtual three-dimensional image. Can also be moved in the direction along the two-dimensional plane. That is, in the state where the virtual viewpoint is jumping in the space of the virtual three-dimensional image, the virtual viewpoint can be moved in the direction along the two-dimensional plane of the virtual three-dimensional image. .

Thus, in the virtual three-dimensional image space, while the virtual viewpoint is jumping in the direction perpendicular to the two-dimensional plane of the virtual three-dimensional image space, the virtual viewpoint is further moved along the two-dimensional plane. The virtual three-dimensional image viewed from the virtual viewpoint moved to the target position can be formed and provided quickly and easily.

[0035]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A three-dimensional image forming system, a three-dimensional image forming method and an input device according to an embodiment of the present invention will be described below with reference to the drawings. In this embodiment, a three-dimensional image forming system according to the present invention includes a game machine system called a video game, a computer game, and the like, in which a virtual three-dimensional image is displayed on an image display device such as a television receiver to perform a game. The description will be made assuming that the three-dimensional image forming method and the input device are applied.

FIG. 1 is a block diagram for explaining an embodiment of the image forming system according to the present invention. The image forming system according to this embodiment is one to which the image forming method according to the present invention is applied. As shown in FIG. 1, the image forming system according to this embodiment includes an input device 1, a hard disk 2, an image forming device 3, and an image output device 4.

The image forming apparatus 3 includes a CPU 31, a ROM 3
2, a RAM 33, a scene tree memory 34, I / O ports (described as I / O in FIG. 1) 35 and 36, and an image processing unit 37. The input device 1 is connected to the image forming apparatus 3 through the I / O port 35.
The hard disk 2 is connected through the I / O port 36. Further, an image output device 4 is connected to the image forming device 3 through an image processing unit 37 including a video RAM and a graphics processor.

The input device 1 receives an instruction input from a user (user) and supplies the received instruction input to the image forming apparatus 3. In this embodiment,
The input device 1 includes an operation unit called a joystick that can easily give an instruction for an image. FIG.
FIG. 2 is a diagram for explaining a joystick 11 which is an operation unit provided in the input device 1.

The joystick 11 is shown in FIG.
As indicated by an up-down arrow a and a left-right arrow b, a displacement operation can be performed in a direction along a plane of the input device 1 provided with the joystick 11. 2, the joystick 11 can be pressed down in a direction perpendicular to the plane of the input device 1 on which the joystick 11 is provided, that is, in the internal direction of the input device 1, as indicated by an arrow c in FIG. It is something.

In this embodiment, by operating the joystick 11, the position of a virtual viewpoint (hereinafter, referred to as a virtual viewpoint) in a virtual three-dimensional image space is determined.
The viewing direction and moving speed can be changed. The image forming system according to the present embodiment can render a virtual three-dimensional image viewed from a virtual viewpoint set in a virtual three-dimensional image space, display the virtual three-dimensional image, and provide the virtual three-dimensional image to the user. .

The viewing direction of the virtual viewpoint is information indicating which direction the virtual viewpoint is looking. In this embodiment, the viewing direction of the virtual viewpoint is forward (forward), and the virtual viewpoint moves in a virtual three-dimensional image space in a direction along a two-dimensional plane orthogonal to the direction of gravity. It becomes the moving direction of the case.

In this embodiment, the displacement operation of the joystick 11 in the direction along the plane of the input device 1 provided with the joystick 11 is performed in a virtual three-dimensional image space by a two-dimensional orthogonal to the direction of gravity. Allocate to an operation for moving the virtual viewpoint in a direction along the plane.

A pressing operation of the joystick 11, which is an operation of pressing the joystick 11 in a direction orthogonal to the plane of the input device 1 provided with the joystick 11, is performed in a virtual three-dimensional image space perpendicular to a two-dimensional plane orthogonal to the direction of gravity. It is assigned to an operation (jump operation) for moving the virtual viewpoint in the direction.

That is, the input device 1 provided with the joystick 11 receives the above-described displacement operation of the joystick 11 as a movement operation of the virtual viewpoint in a direction along a two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space. At the same time, the above-described pressing operation of the joystick 11 can be received as a jump operation and supplied to the image forming apparatus 3.

By doing so, the joystick 11 can be moved with the finger 1 without operating a plurality of operation keys.
By simply operating the book, it is possible to input an instruction to freely and easily move the virtual viewpoint in any direction in the virtual three-dimensional image space.

The hard disk 2 stores so-called game software information such as image data for forming a game image. Then, the image forming apparatus 3
In response to instruction information from a user input through the input device 1, a virtual viewpoint is moved in a virtual three-dimensional image space, and a virtual three-dimensional image viewed from the virtual viewpoint is stored in a hard disk 2. Draw using information. Then, the image forming apparatus 3 supplies an image signal for displaying the drawn virtual three-dimensional image to the image output apparatus 4.

The image output device 4 is, for example, a television receiver or a dedicated monitor receiver. The image output device 4
An image signal for displaying the virtual three-dimensional image drawn by the image forming apparatus 3 is received through the image processing unit 37, and the virtual three-dimensional image corresponding to the image signal is displayed on the display screen of its own display element. I do. In this way, the game image is displayed on the display screen of the display element of the image output device 4 and provided to the user.

FIG. 3 is a diagram for explaining the image forming system according to this embodiment, and in particular, a diagram for explaining the functions of the image forming apparatus 3. As shown in FIG. 1, the image forming apparatus 3 includes a CPU 31, a ROM 32, an R
3 is a microcomputer including an AM 33 and a scene tree memory 34.
As shown in (1), functions as a parser unit 41, a viewpoint position calculation unit 42, and a renderer unit 43 are realized.

The parser unit 41 of the image forming apparatus 3 reads out image data for forming a game image from the hard disk 2 at the time of system initialization, converts the image data into scene tree data, and records it in the scene tree memory 34. The scene tree data includes a so-called mesh including vertex coordinates and polygon information, and data indicating the position and orientation of the mesh.

The viewpoint position calculator 42 of the image forming apparatus 3
The three parameters of the current position p of the virtual viewpoint K, the viewing direction r, and the moving speed v are stored as a three-dimensional vector. As shown in the renderer 43 of FIG. 3, the vector coordinate system has an X-axis in the horizontal direction (horizontal direction), a Y-axis in the vertical direction (vertical direction), and a longitudinal direction (depth direction) when viewed from the virtual viewpoint K. The Z axis.

The viewpoint position calculator 42 changes the three-dimensional vector held by itself at regular intervals. In this case, the position of the virtual viewpoint K in the virtual three-dimensional image space, the viewing direction, and the moving speed are calculated in consideration of the operation state of the joystick 11 of the input device 1, and the three-dimensional vector held by the self is stored. Change this to renderer 4
Supply 3

The renderer 43 of the image forming apparatus 3 receives the supply of the three-dimensional vector changed by the viewpoint position calculator 42, and from the virtual viewpoint K whose position, viewing direction and moving speed are indicated by the vector. A virtual three-dimensional image that is visible when viewed (photographed) is drawn, and the drawn virtual 3D image is drawn.
An image signal for displaying a two-dimensional image is supplied to the image display device 4.

As shown in FIG. 3, the display screen G of the display element of the image display device 4 includes a virtual screen when viewed from the virtual viewpoint K, as shown in the display screen G of the display element of the image display apparatus 4. A three-dimensional image is displayed. Then, as described above, at regular time intervals, a three-dimensional image is sequentially drawn in consideration of the state of the joystick 11, and this is displayed on the display screen G of the display element of the image display device 4.
The user can play a game using the virtual three-dimensional image.

[Regarding Change of Three-Dimensional Vector of Virtual Viewpoint] In this embodiment, the image forming apparatus 3
The change of the three-dimensional vector performed by the viewpoint position calculation unit 42 is divided into a part that depends on the operation state of the joystick 11 and a part that does not. FIG. 4 is a diagram for explaining a change in a parameter of a three-dimensional vector of a virtual viewpoint of a portion that does not depend on the operation of the joystick 11, and FIG. It is a figure for explaining change of a parameter of a vector.

First, with reference to FIG. 4, a description will be given of how to change the parameters of the three-dimensional vector of the virtual viewpoint in a portion independent of the operation state of the joystick 11. The viewpoint position calculation unit 41 of the image forming apparatus 3 according to this embodiment changes the parameters of the three-dimensional vector of the virtual viewpoint K shown in FIG. 4 every predetermined time regardless of the operation state of the joystick 11. Do.

That is, at regular intervals, the moving speed v of the virtual viewpoint K is reduced at a constant rate (FIG. 4), and acceleration due to gravity is applied to the moving speed v of the virtual viewpoint K (FIG. 4).
Here, when the Y component of the virtual viewpoint K is 0, that is, when the virtual viewpoint K is not in the air in the virtual three-dimensional image space, the Y component of the moving speed v is set to 0 (FIG. 4). Further, a speed is added to the position p of the virtual viewpoint (FIG. 4).

In FIG. 4, α is a damping rate, g is a gravitational acceleration, and dt is an update cycle. Then, the virtual viewpoint K is moving in the virtual three-dimensional image space by changing the parameters in FIG.
When neither an instruction for acceleration nor an instruction for deceleration is given, the moving speed v of the virtual viewpoint can be gradually reduced.

By changing the parameters in FIG. 4, the virtual viewpoint K moves in a direction perpendicular to the two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space, that is, the virtual viewpoint K Jumps and is in the air in the virtual three-dimensional image space, the virtual viewpoint K can be caused to fall in the virtual three-dimensional image space according to gravity.

Then, by changing the parameters in FIG. 4, the virtual viewpoint K is prevented from moving downward in the virtual three-dimensional image space. That is, a falling state is prevented. Further, by changing the parameters in FIG. 4, the virtual viewpoint K is moved in a direction along a two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space, and the virtual viewpoint K is moved according to the moving speed. Viewpoint K
Can be obtained.

As described above, the joystick 11 is operated to move the virtual viewpoint K by changing the parameters shown in FIGS. 4 to 4 at regular intervals, but the joystick 11 is not operated thereafter. Can be naturally moved in the virtual three-dimensional image space, and a virtual three-dimensional image viewed from the virtual viewpoint K can be formed and displayed on the image display device 4.

Next, with reference to FIG. 5, a description will be given of how to change the parameters of the three-dimensional vector of the virtual viewpoint in a portion depending on the operation state of the joystick 11. In the image forming apparatus 3 of this embodiment, the position of the virtual viewpoint, the azimuth of viewing, and the moving speed are calculated in consideration of the state of the joystick 11 at the above-described fixed time intervals.

In this embodiment, when the joystick 11 is displaced in the direction along the plane of the input device 1 provided with the joystick 11 and in the direction of the upward arrow shown in FIG. Means the acceleration of the moving speed v of the virtual viewpoint K, and adds a constant a to the Z component of the moving speed v of the virtual viewpoint K. As a result, the virtual viewpoint K in the direction indicated by the current viewing direction r of the virtual viewpoint K
Is accelerated.

When the joystick 11 is displaced in the direction along the plane of the input device 1 provided with the joystick 11 and in the direction of the downward arrow shown in FIG. This means deceleration of the moving speed, and a constant a is subtracted from the Z component of the moving speed v of the virtual viewpoint K. Thereby, the moving speed v of the virtual viewpoint K is reduced.

When the joystick 11 is displaced in the direction along the plane of the input device 1 provided with the joystick 11 and in the direction of the right arrow or the direction of the left arrow shown in FIG. Means that the viewing direction of the virtual viewpoint K is changed.

In this case, on the two-dimensional plane including the virtual viewpoint K in the virtual three-dimensional image space around the virtual viewpoint K, the displacement direction of the joystick 11 is changed from the viewing direction r before the change. Accordingly, the viewing direction of the virtual viewpoint K is rotated rightward or leftward by a constant b degrees.

Thus, the virtual viewpoint K on a two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional space and centered on the position p of the virtual viewpoint K is included.
Is changed.

In this embodiment, when the joystick 11 shown in FIG. 2 is pressed down inward of the input device 1, the virtual viewpoint K is orthogonal to the direction of gravity in the virtual three-dimensional image space. The moving speed v of the virtual viewpoint K is accelerated from the two-dimensional plane to the direction perpendicular to the two-dimensional plane, that is, the plus direction (upward) of the Y axis. That is, as shown in FIG. 5, a constant c is added to the Y component of the speed v, and the virtual viewpoint K is set to Y in the virtual three-dimensional image space.
A jump operation for moving in the plus direction of the axis is performed.

As described above, in this embodiment,
The joystick 11 performs a displacement operation in a direction along a plane of the input device 1 provided with the joystick 11,
The virtual viewpoint is orthogonal to the direction of gravity in the virtual 3D image space 2
It is assigned to acceleration or deceleration of the moving speed of the virtual viewpoint for moving in the direction along the three-dimensional plane, and rotation of the virtual viewpoint. Further, the operation of pressing the joystick 11 is assigned to an operation for jumping the virtual viewpoint in a direction perpendicular to a two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space.

As described above, by changing the parameters of the three-dimensional vector of the virtual viewpoint K shown in FIGS.
Is moved in the virtual three-dimensional image space so that a virtual three-dimensional image viewed from the virtual viewpoint can be drawn and displayed.

As described above, in the image forming system according to this embodiment, conventionally, the operation is performed by, for example, a button switch different from the joystick 11.
The virtual viewpoint is orthogonal to the direction of gravity in the virtual 3D image space 2
A so-called jump operation of moving in a direction perpendicular to the dimensional plane can also be performed by pressing the joystick. That is, the virtual viewpoint K can be moved in any direction in the virtual three-dimensional image space only by the joystick 11.

Further, in the image forming system according to the present embodiment, the jump operation of the virtual viewpoint K can be realized by a simple operation of pressing the joystick 11, and if the pressing operation is repeatedly performed, the virtual viewpoint K Even when K is located in the air in the virtual three-dimensional image space, the jump operation is repeated, and the virtual viewpoint K can be moved to a higher position in the virtual three-dimensional image space.

When the height of the virtual viewpoint K in the virtual three-dimensional image space is equal to or higher than a predetermined height, the direction of the virtual viewpoint K automatically causes a depression angle so as to look at the ground from the sky. To do. In this case, the viewing direction does not change, but the viewing direction is directed downward so as to generate a depression angle. Thus, for example, if map information is displayed as a virtual three-dimensional image,
Map information displayed as a virtual three-dimensional image can be viewed from above.

When the joystick 11 is pressed to cause the virtual viewpoint K to jump in the virtual three-dimensional image space and then the joystick 11 is kept pressed, the virtual viewpoint K of the virtual viewpoint K is maintained. 3
The height in the three-dimensional image space can be maintained. Thus, the virtual viewpoint K is stopped in the air in the virtual three-dimensional image space until the joystick 11 is released from the pressed state, and the ground can be viewed from the air.

As described above, when the virtual viewpoint K is made to stand still in the air of the virtual three-dimensional image space, additional information such as heading information (caption) is displayed in the viewable information. Can also. For example, when map information is displayed as a virtual three-dimensional image,
The name of the main building, the name of the area, the address, etc. are displayed as captions on the virtual three-dimensional image. As a result, various information can be provided to the user in an easy-to-understand manner using the virtual three-dimensional image corresponding to the real world.

[Operation of Image Forming System] Next, the operation of the image forming system of this embodiment will be described with reference to the flowcharts of FIGS. FIG. 6 is a flowchart for explaining a virtual three-dimensional image forming (drawing) process performed at regular intervals in the image forming system according to the present embodiment, as described above.

The CPU 31 of the image forming apparatus 3 executes the processing of the flowchart shown in FIG. 6 at regular intervals.
Then, first, the CPU 31 sends the joystick 11
It is determined whether or not is pressed (step S101). In the determination process of step S101, when it is determined that the joystick 11 is in the pressed state, a predetermined constant th1 is added to a time Tp (hereinafter, referred to as a pressed time) from the start of pressing the joystick 11 (step S102).

Then, it is determined whether or not the pressing time tp has become longer than a predetermined constant th2 (step S103). In the determination processing of step S103,
When determining that the pressing time Tp is longer than the constant th2, the CPU 31 determines that the joystick 11 has been pressed by the user and that the pressed state is maintained, and displays a caption (explanatory text). (Step S104).

The processing in step S104 is as follows.
When it is determined that the pressed state of the joystick 11 is maintained and the height of the virtual viewpoint K in the virtual three-dimensional image space is maintained, a caption is displayed on the virtual three-dimensional image. For example, when map information of a certain area is displayed as a virtual three-dimensional image,
A caption related to an image included in the virtual three-dimensional image viewed from the virtual viewpoint K, such as a name of a main building, a region name, an address, or a height of a high building, is displayed.

In the determination processing in step S103, if it is determined that the pressing time Tp is smaller than the constant th2, or after the caption is displayed in step S104, the viewpoint rotation processing is performed (step S10).
5). The viewpoint rotation processing in step S105 is for changing the viewing direction r of the virtual viewpoint K, as described later in detail.

Then, the CPU 31 of the image processing apparatus 3
In consideration of the change of the three-dimensional vector such as the viewing direction of the virtual viewpoint K which is changed in the viewpoint rotation moving process in step S105, the virtual three-dimensional image viewed from the virtual viewpoint K is drawn. (Step S106), this is supplied to the image display device 4, and the virtual three-dimensional image is displayed on the display screen of the display element of the image display device 4, and the processing shown in FIG. 6 ends.

On the other hand, when it is determined in step S101 that the joystick 11 is not in the pressed state, the CPU 31 of the image forming apparatus 3 determines that the pressed time Tp is longer than 0 and that the predetermined time t
It is determined whether it is shorter than h0 (step S107).

In this embodiment, step S10
7 is, for example, 0.
The time is about 5 seconds. Then, in the determination processing of step S107, the pressing time Tp is longer than 0 and
If it is determined that the time is shorter than the certain time th0, the CPU 31 of the image forming apparatus 3 determines that the operation is a pressing operation of the joystick 11 for instructing a jump operation, and as described above with reference to FIG. A jump process is performed in which the moving speed is accelerated upward, that is, in the plus direction of the Y-axis by a predetermined value to jump the virtual viewpoint K (step S108).

Then, in the determination processing of step S107, the pressing time Tp is longer than 0 and the predetermined time t
If it is determined that the speed is not shorter than h0, or if the acceleration processing of the moving speed of the virtual viewpoint K in the positive direction of the Y-axis in step S108 is completed, the CPU 31 of the image forming apparatus 3 The value of the pressing time Tp is set to 0 (step S109), and the viewpoint parallel movement process of step S110 is performed (step S110).

The viewpoint parallel movement process in step S110 is a process for moving the virtual viewpoint K in a direction along a two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space. In addition to performing acceleration processing, deceleration processing, and acceleration processing due to gravity, this is a processing for obtaining a new position p of the virtual viewpoint K.

Then, the CPU 31 of the image forming apparatus 3
In step S110, taking into account the three-dimensional vector of the virtual viewpoint K changed by the viewpoint translation process, a virtual three-dimensional image as viewed from the virtual viewpoint K is drawn as described above (step S106). This is supplied to the image display device 4 so that the virtual three-dimensional image is displayed on the display screen G of the display element of the image display device 4, and the processing shown in FIG. 6 ends.

[Regarding Viewpoint Rotation Processing] FIG. 7 is a flowchart for explaining the viewpoint rotation processing performed in step S105 of the flowchart shown in FIG.

In the viewpoint rotation process, first, the CPU 31 of the image forming apparatus 3 performs the displacement operation of the joystick 11 along the plane of the input device 1 provided with the joystick 11 as shown by the right arrow in FIG. Then, it is determined whether or not a displacement operation has been performed to the right (step S201).

If it is determined in step S201 that the joystick 11 has been displaced rightward, the direction of the virtual viewpoint K is rotated rightward by a predetermined angle as described above with reference to FIG. (Step S202). In the process of step S202, as described above, the viewing direction of the virtual viewpoint is shifted clockwise in the two-dimensional plane including the virtual viewpoint by a predetermined angle centering on the virtual viewpoint K, that is, clockwise. This is a process of rotating.

If it is determined in step S201 that the joystick 11 has not been displaced to the right, or if the process of rotating the azimuth of the virtual viewpoint K rightward in step S202 has been completed, It is determined whether the joystick 11 is displaced leftward in the direction along the plane of the input device 1 provided with the joystick 11, as indicated by the left arrow in FIG. 2 (step S203). .

If it is determined in step S203 that the joystick 11 has been displaced to the left, the azimuth of the virtual viewpoint is set to the left at a predetermined angle, as described above with reference to FIG. The rotation is performed by a minute (step S204). As described above, in the process of step S204, the viewing direction of the virtual viewpoint is set to the left by a predetermined angle, that is, counterclockwise around the virtual viewpoint K on the two-dimensional plane including the virtual viewpoint. This is a process for rotating the image.

If it is determined in step S203 that the joystick 11 has not been displaced leftward, or if the virtual viewpoint left rotation process in step S204 has been completed, the virtual three-dimensional image space It is determined whether or not the altitude of the virtual viewpoint at is higher than the fixed value h0 (step S205).

In this embodiment, as shown in FIG. 9, the altitude of the virtual viewpoint in the virtual three-dimensional image space is
Until it becomes higher than the fixed value h0, the direction of the virtual viewpoint is not changed. However, as shown in FIG. 9, the altitude of the virtual viewpoint K in the virtual three-dimensional image space is constant h0.
When the height becomes higher, the viewing direction of the virtual viewpoint K is not changed, and the viewing direction of the virtual viewpoint K is caused to produce a depression angle, so that the user gazes at the ground (step S20).
6).

That is, in the virtual three-dimensional image space,
The gazing point X is set on a two-dimensional plane (ground plane) having an altitude of 0 and orthogonal to the direction of gravity, and gazing at the gazing point X from a virtual viewpoint K whose altitude is equal to or greater than a predetermined value h0. In this embodiment, as shown in FIG. 9, the altitude of the virtual viewpoint K, that is, the position p0 of the virtual viewpoint when the value in the Y-axis direction is 0, is used as a reference according to the following equation (1). , The position of the gazing point X is obtained. Gaze point X = constant / (hn−h0) (1) In the expression (1), n is an integer of 1 or more,
hn indicates the height (height) of the virtual viewpoint.

Thus, as shown in FIG. 9, as the heights h1, h2, and h3 of the virtual viewpoint K increase, the viewing direction of the virtual viewpoint K automatically decreases as the height of the virtual viewpoint K increases. To face down.
Therefore, a virtual three-dimensional image that can be viewed is formed according to the height of the virtual viewpoint K.

When the altitude of the virtual viewpoint K is lower than the fixed value h0, the direction of the virtual viewpoint is not changed, so that the virtual viewpoint K in the state in which the virtual viewpoint K is jumping in the plus direction of the Y axis. The two-dimensional image can be displayed as a more realistic image along with the real world.

Then, in the determination processing of step S205, when it is determined that the height of the virtual viewpoint in the virtual three-dimensional image space is not higher than the fixed value h0, and in step S206, the virtual viewpoint is gazed at the ground. When the process of obtaining the viewing direction from K is completed, the viewpoint rotation process shown in FIG. 7 is completed, and the process returns to step S105 of the process shown in FIG.

Then, as described above, taking into account the parameters of the three-dimensional vector of the virtual viewpoint K, which is changed by the viewpoint rotation s processing shown in FIG. A two-dimensional image is drawn and displayed.

[Regarding Viewpoint Parallel Movement Processing] FIG. 8 is a flowchart for explaining the viewpoint parallel movement processing performed in step S110 of the processing shown in FIG. The viewpoint translation processing performed in step S110 is processing for moving the virtual viewpoint K in a direction along a two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space.

In the viewpoint translation process, first, the CPU 31 of the image forming apparatus 3 sets the joystick 11
As shown by the up arrow in FIG.
It is determined in the direction along the plane of the input device 1 on which the input device 1 is provided, and whether or not a displacement operation is performed upward (step S301).

If it is determined in step S301 that the joystick 11 is being displaced upward, the moving speed of the virtual viewpoint K in the current viewing direction is determined as described above with reference to FIG. Is accelerated by a predetermined acceleration (step S302).

If it is determined in step S301 that the joystick 11 has not been displaced upward, or if it is determined in step S30.
When the acceleration processing of the moving speed of the second virtual viewpoint K in the current viewing direction is completed, the CPU 31 of the image forming apparatus 3
Determines whether or not the joystick 11 is displaced downward in the direction along the plane of the input device 1 on which the joystick 11 is provided, as indicated by the downward arrow in FIG. S303).

In the determination processing of step S303, when it is determined that the joystick 11 is being displaced downward, as described above with reference to FIG. Is decelerated by a predetermined speed (step S304).

In the determination processing of step S303, when it is determined that the joystick 11 has not been displaced downward, or in step S304, the moving speed of the virtual viewpoint in the current viewing direction is reduced. After the operation, as described above with reference to FIG. 4, acceleration due to gravity of the virtual viewpoint K, which is not affected by the operation state of the joystick 11, is considered (step S30).
5).

The CPU 31 of the image forming apparatus 3
Acceleration and deceleration of the moving speed of the virtual viewpoint K in the current viewing direction, acceleration in consideration of gravity, and reduction of the moving speed, and updating of the viewpoint position p of the virtual viewpoint K Is performed (step S306). Then, the CPU 31 of the image forming apparatus 3 returns to the process of step S110 of the process shown in FIG.

Then, as described above with reference to FIG. 6, the viewpoint rotation process is performed (step S105), the drawing process (step S106) is performed, and the virtual three-dimensional image is viewed from the destination to which the virtual viewpoint has moved. Draw and display.

As described above, in the flowchart shown in FIG. 6, the caption display processing in step S104 and the drawing processing in step S106 are processings performed by the renderer unit 43 of the image forming apparatus 3, and The processing of the step is processing in the viewpoint position calculation unit 41 of the image forming apparatus 3. In this embodiment, both the renderer unit 43 and the virtual viewpoint calculation unit 41 are realized by a control unit including the CPU 31, the ROM 32, the RAM 33, and the scene tree memory 34 of the image forming apparatus 3.

Further, step S in the flowchart of FIG.
In the viewpoint translation process shown in FIG. 8, the process of step S305 and step S306 is performed regardless of the operation state of the joystick 11 described with reference to FIG. This is a process of changing vector parameters.

In the flowchart of FIG. 8, the processing from step S301 to step S304, the viewpoint rotation processing shown in FIG. 7, and the processing of step S108 in the flowchart shown in FIG. 6 are shown in FIG. This is a process of changing the parameter of the three-dimensional vector of the virtual viewpoint of a portion depending on the operation state of the joystick 11.

As described above, in the image forming system according to the present embodiment, the joystick 11 is used to virtually displace the input device 1 provided with the joystick 11 in the direction along the plane (two-dimensional plane). In addition to assigning the virtual viewpoint to an operation for moving the virtual viewpoint in a direction along a two-dimensional plane orthogonal to the direction of gravity in the three-dimensional image space, the pressing operation of the joystick 11 is
An operation (jump operation) for moving in a direction perpendicular to a two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space is assigned.

As a result, the joystick 11 can perform a jump operation of the virtual viewpoint, which conventionally required an operation button switch different from the joystick. That is, the virtual viewpoint can be moved in any direction in the virtual three-dimensional image space by a simpler operation. Therefore, a jump operation of the virtual viewpoint and a simple operation with one finger of the user can be realized, and the virtual viewpoint can be jumped in the virtual three-dimensional image space by the simple operation. Is done.

Further, the jump operation of the virtual viewpoint can be easily performed, and the altitude of the virtual viewpoint can be increased by repeatedly pressing the joystick. By maintaining the joystick pressing operation state, the height of the virtual viewpoint in the virtual three-dimensional image space can be maintained.

As described above, the simple operation of repeating the pressing operation of the joystick and maintaining the pressing operation state can be achieved by the following simple operation.
Since the height of the virtual viewpoint, that is, the position in the plus direction of the Y-axis can be made higher or the height can be maintained, the height is made higher so that the entire virtual three-dimensional image space can be seen and the virtual 3 You can view as many dimensional images as you need.

Further, in this embodiment, the joystick 11 can be displaced and moved in a direction along the plane of the input device 1 provided with the joystick 11 while being pressed. This allows
It is also possible to move the virtual viewpoint in the air, such as changing the viewing direction and moving to that direction while jumping the virtual viewpoint in the virtual three-dimensional image space.

Further, the joystick 11 is pressed once, and then the joystick 11 is displaced in the direction along the plane of the input device on which the joystick 11 is provided, whereby the jumped virtual viewpoint is displayed. While gradually falling, it can be moved in a direction along a two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space, or the viewing direction can be changed.

As described above, since the movement is possible when the virtual viewpoint is in the air, it is possible to easily realize that the virtual viewpoint jumps over an obstacle in the virtual three-dimensional image space.

[Other Examples of Setting the Gaze Point at the Time of Jumping the Virtual Viewpoint] In the above-described embodiment, as described above with reference to FIG. As the altitude of K in the virtual three-dimensional image space increases, the position of the gazing point X is changed in a direction approaching the virtual viewpoint K.

However, the method of setting the position of the gazing point X is not limited to this. For example, as shown in FIG.
When the height of the virtual viewpoint is equal to or higher than the predetermined height h0, the viewing direction of the virtual viewpoint is changed so as to see the same predetermined point of gaze regardless of the height of the virtual viewpoint. It can also be determined.

In addition to the height of the virtual viewpoint, when the virtual viewpoint jumps and moves in the virtual three-dimensional image space, a predetermined gazing point in the virtual three-dimensional image space is determined. Can be determined so as to look at the virtual viewpoint.

Further, as the height of the virtual viewpoint K in the virtual three-dimensional image space increases as the joystick 11 is repeatedly pressed, the position of the gazing point X is changed in a direction away from the virtual viewpoint K. You may.

Further, these methods of setting the gazing point may be properly used depending on the case. For example, in a virtual three-dimensional image space representing a relatively narrow indoor state, the gazing point is set at the center of the indoor,
When a relatively wide range such as map information is displayed as a virtual three-dimensional image, the position of the point of interest can be changed according to the height of the virtual viewpoint.

In the above-described embodiment, the gazing point X is set in the virtual three-dimensional image space, for example, on a two-dimensional plane (ground) orthogonal to the direction of gravity in which the value of the Y axis is zero. However, it is not limited to this. The fixation point can be set at any position in the virtual three-dimensional image space. Therefore, in the virtual three-dimensional image space, it is also possible to set a position where the value of the Y axis does not become 0, such as a position in the air.

In the example of setting the gazing point X described with reference to FIGS. 9 and 10, when the height of the virtual viewpoint is equal to or higher than the predetermined height h0 or higher than the height h0, To look at the gazing point X. In this way, the virtual three-dimensional image while the virtual viewpoint is jumping can be formed as having a more realistic sensation in the real world.

However, immediately after the virtual viewpoint jumps, the viewing direction of the virtual viewpoint is changed so as to immediately observe the gazing point X set in the virtual three-dimensional image space. Of course you can. For example, the moving speed (jump speed) in the direction perpendicular to the two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space at the time of the jump of the virtual viewpoint is set relatively high, and the height of the virtual viewpoint is relatively high. If you get high and get drunk quickly, a more natural virtual 3
A two-dimensional image can be formed. In this case, the point of regard X may be set by any of the methods described above.

In the above-described embodiment, the jump operation of the virtual viewpoint has been described as moving in the direction perpendicular to the two-dimensional plane orthogonal to the gravity of the virtual three-dimensional image space, but is limited to this. Not something. Virtual viewpoints in various two-dimensional planes in the virtual three-dimensional image space, for example, in a direction perpendicular to the two-dimensional plane parallel to the direction of gravity or in a direction perpendicular to the two-dimensional plane set to make a predetermined angle with the direction of gravity. Can be made to jump.

In the above embodiment, the image forming system has been described as drawing a three-dimensional image viewed from a virtual viewpoint in a virtual three-dimensional image space. However, it is not limited to this. For example, by moving this character as the viewpoint of a character that moves the virtual viewpoint variously in the virtual three-dimensional image space, a virtual three-dimensional image viewed from the character can be drawn.

Thus, for example, when viewing a virtual three-dimensional image space including a character from a preset virtual viewpoint,
An image for drawing a three-dimensional image and a virtual three-dimensional image when the character's viewpoint is viewed as a virtual viewpoint may be used in a mixed manner.

In the above embodiment, the image forming system according to the present invention has been described as being applied to a game machine. However, the present invention is not limited to this. For example,
The present invention can also be applied to a receiver system called an IRD (Integrated Receiver Device) or STB (Set Top Box) that receives digital satellite broadcasting, digital terrestrial broadcasting, or cable digital broadcasting.

In this case, the function of the image forming apparatus is mounted on a receiver called an IRD or STB, and an input device provided with a joystick is connected to the receiver having the function of the image forming apparatus. . This input device
It may be a remote commander of the receiver. And by connecting a television receiver to this receiver,
The image forming system according to the present invention can be configured.

In this case, for example, an online television shopping service is provided as a digital television broadcast program. For example, image data for drawing an image of a large shopping center is broadcast by digital broadcasting, and this is stored in, for example, a hard disk on the receiver side.

[0130] Scene tree data is formed based on the image data stored in the hard disk on the receiver side, and a virtual viewpoint is set in accordance with the scene tree data and, for example, the operation of a joystick provided in the receiver. By moving in a virtual three-dimensional image space and displaying a virtual three-dimensional image viewed from the virtual viewpoint on a television receiver, it is possible to perform shopping as if walking in a shopping center and shopping. be able to.

In this case, the joystick is depressed and the virtual viewpoint is jump-moved, thereby jumping over a showcase or a display shelf or repeating the joystick depressing operation, thereby moving to the counter on the upper floor. And so on. In this way, movement that is impossible in the real world becomes possible, and online shopping can be performed in a short time while confirming the target object as an image.

Therefore, in the case of online shopping using a menu-type catalog or a hyperlink-type catalog conventionally used as a user interface, the user searches for a catalog page having a target object. Or, you may not be able to place an order without remembering the page. However, when the present invention is used, such a necessity is not required, and a more convenient user interface for the user can be provided.

That is, as described above, when, for example, an object is arranged in the virtual three-dimensional image space, the user can recognize the position where the object is located in a store in the real world. It can recognize at the same intervals as, and remember the place where things are placed.

Further, in the virtual three-dimensional image space, it is possible to freely move the virtual viewpoint to find a target in a short time.

As described above, the image forming system and the image forming method according to the present invention move a virtual viewpoint in a virtual three-dimensional image space in addition to a game machine, and form a virtual three-dimensional image from the virtual viewpoint. The present invention can be applied to various types of so-called walk-through systems.

[0136]

As described above, according to the present invention, the movement of the virtual viewpoint in the direction along the two-dimensional plane of the virtual three-dimensional image space and the movement of the virtual three-dimensional image space It is possible to instruct movement of the virtual viewpoint in a direction perpendicular to the two-dimensional plane. Thus, with a simple operation that can be performed with one finger of the user, the position of the virtual viewpoint in the virtual three-dimensional image space, the azimuth of viewing, and the moving speed are quickly changed, and the virtual view from the virtual viewpoint is obtained. A three-dimensional image can be quickly formed and displayed.

Further, the simple operation of repeatedly pressing the joystick, which is the operation unit, repeats the jump operation of the virtual viewpoint, and changes the virtual viewpoint to the two-dimensional plane of the virtual three-dimensional image according to the number of times the operating means is pressed. It can be moved more in the vertical direction. Thereby, virtual 3
For example, a two-dimensional image can be provided in a new mode.

When the virtual viewpoint is jump-moved in a direction perpendicular to the two-dimensional plane orthogonal to the direction of gravity in the virtual three-dimensional image space, the direction of the virtual viewpoint is set to automatically generate a depression angle, for example. Thus, the entire virtual three-dimensional image can be seen. Therefore, a virtual three-dimensional image that can be seen from a virtual viewpoint can be effectively formed and provided.

Further, it is possible to form a virtual three-dimensional image according to the amount of movement of the virtual viewpoint in the direction perpendicular to the two-dimensional plane, and to form the virtual three-dimensional image more effectively. Can be provided.

When the moving distance in the height direction of the virtual viewpoint is small, the direction of the virtual viewpoint does not change. However, when the moving distance exceeds a predetermined moving distance, for example, the direction of the virtual viewpoint becomes Even if it is not different from before the movement, for example, the direction thereof automatically generates a depression angle.
Therefore, it is possible to form a virtual three-dimensional image corresponding to the movement in the direction perpendicular to the two-dimensional plane in the virtual three-dimensional image of the virtual viewpoint.

When the pressing operation of the operating means is maintained, the position of the virtual viewpoint in the direction perpendicular to the two-dimensional plane of the virtual three-dimensional image, that is, the height of the virtual viewpoint is maintained. Thereby, the virtual three-dimensional image viewed from the virtual viewpoint at the same position can be displayed and viewed until the pressing operation state of the operation unit is released.

When the pressed state of the operating means is maintained, the position of the virtual viewpoint at that time is maintained, and the virtual three-dimensional image which can be seen from the virtual viewpoint is released from the pressed state of the operating means. Until it is displayed.
In this case, more detailed information can be added to the formed and displayed virtual three-dimensional image and provided to the user. Thus, more detailed information can be provided through the virtual three-dimensional image.

In the virtual three-dimensional image space, when the virtual viewpoint is jumping in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image space, the virtual viewpoint is further moved in the direction along the two-dimensional plane. The virtual three-dimensional image viewed from the virtual viewpoint moved to the target position can be quickly and easily formed and provided.

[Brief description of the drawings]

FIG. 1 is a block diagram for explaining an embodiment of an image forming system according to the present invention.

FIG. 2 is a diagram illustrating a joystick as an operation unit provided in the input device.

FIG. 3 is a diagram for explaining an embodiment of an image forming system according to the present invention.

FIG. 4 is a diagram for describing a change of a parameter of a three-dimensional vector of a virtual viewpoint that is not affected by an operation state of a joystick as an operation unit.

FIG. 5 is a diagram for describing a change of a parameter of a three-dimensional vector of a virtual viewpoint according to an operation state of a joystick as an operation unit.

FIG. 6 is a flowchart illustrating a virtual viewpoint moving process and a virtual three-dimensional image drawing process viewed from the virtual viewpoint performed in the image forming system illustrated in FIG. 1;

FIG. 7 is a flowchart illustrating a viewpoint rotation process performed in the image forming system illustrated in FIG. 1;

FIG. 8 is a flowchart illustrating a viewpoint translation process performed in the image forming system illustrated in FIG. 1;

FIG. 9 is a diagram for explaining a method of setting a gazing point performed in the image forming system shown in FIG. 1;

FIG. 10 is a diagram for explaining another method of setting a gazing point performed in the image forming system shown in FIG. 1;

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Input device, 11 ... Joystick, 2 ... Hard disk, 3 ... Image forming apparatus, 31 ... CPU, 32 ... RO
M, 33: RAM, 34: Scene tree memory, 35:
I / O port, 36 ... I / O port, 37 ... Image processing unit, 41 ... Parser unit, 42 ... View point position calculation unit, 43 ... Renderer unit

 ────────────────────────────────────────────────── ─── Continued on the front page F term (reference) 2C001 BA00 BA02 BA05 BC00 BC01 BC03 CA01 CA06 CB01 CB06 CC02 CC08 5B050 BA09 CA07 EA27 EA28 FA02 5B087 AA07 BC02 5E501 AA17 AC15 AC36 BA05 CA02 CB04 FA14 FA27

Claims (17)

[Claims] An input device for receiving an instruction input from a user; an image forming device for forming a virtual three-dimensional image based on a virtual viewpoint; and a virtual three-dimensional image formed by the image forming device. A three-dimensional image forming system having a display device that performs a displacement operation in a direction along a two-dimensional plane and a pressing operation in a direction perpendicular to the two-dimensional plane. The image forming apparatus further comprises: assigning the displacement operation of the operation unit of the input device to an operation for moving the virtual viewpoint in a direction along a two-dimensional plane of the virtual three-dimensional image, and pressing the button. Assigning an operation to an operation for moving the virtual viewpoint of the virtual viewpoint in a direction perpendicular to the two-dimensional plane,
Viewpoint position calculating means for calculating the position of the virtual viewpoint, viewing orientation, and moving speed; image data for drawing an image; the position of the virtual viewpoint calculated by the viewpoint calculating means; A virtual three-dimensional image viewed from the virtual viewpoint is drawn based on the viewing direction and the moving speed, and the drawn virtual 3D image is drawn.
Drawing means for outputting an image signal for displaying a three-dimensional image, wherein the display device comprises a display element for displaying a virtual three-dimensional image corresponding to the image signal from the drawing means of the image forming apparatus. A three-dimensional image forming system, characterized in that: 2. The image forming apparatus according to claim 1, wherein said operation means of said input device repeatedly performs a pressing operation.
The position of the virtual viewpoint is calculated on the assumption that the virtual three-dimensional image is moved in the direction perpendicular to the two-dimensional plane from the state moved in the direction perpendicular to the two-dimensional plane of the three-dimensional image. The three-dimensional image forming system according to claim 1, wherein: 3. When a pressing operation is performed on the operation unit of the input device, the viewpoint position calculation unit of the image forming apparatus determines a predetermined position in the virtual three-dimensional image from the virtual viewpoint. The direction of the virtual three-dimensional image with respect to a direction perpendicular to the two-dimensional plane when viewing the azimuth of the viewing from the virtual viewpoint so as to look at a gazing point, or The three-dimensional image forming system according to claim 2. 4. When the pressing operation is repeatedly performed on the operation unit of the input device, the viewpoint position calculating unit of the image forming apparatus determines that the virtual viewpoint is the one of the virtual three-dimensional image. The position of the virtual viewpoint is calculated assuming that the virtual three-dimensional image is further moved in a direction perpendicular to the two-dimensional plane from the state moved in the direction perpendicular to the two-dimensional plane, and the virtual viewpoint is calculated. The position of the gazing point in the virtual three-dimensional image is changed according to a moving distance of a viewpoint in a direction perpendicular to the two-dimensional plane in the virtual three-dimensional image. 3D image forming system. 5. When the moving distance of the virtual viewpoint in a direction perpendicular to the two-dimensional plane in the virtual three-dimensional image is equal to or longer than a predetermined moving distance, the virtual viewpoint moves from the virtual viewpoint. The two-dimensional image of the virtual three-dimensional image when viewing the viewing direction from the virtual viewpoint so as to look at the gazing point
The three-dimensional image forming system according to claim 4, wherein an orientation with respect to a direction perpendicular to the three-dimensional plane is determined. 6. When the operation means of the input device is maintained in a pressed state, the viewpoint position calculation means of the image forming apparatus outputs the viewpoint position calculation means of the virtual three-dimensional image of the virtual viewpoint. 6. The three-dimensional image forming system according to claim 1, wherein a position in a direction perpendicular to the two-dimensional plane is not changed. 7. When the operating means of the input device is maintained in a pressed state, the drawing means of the image forming apparatus displays a virtual three-dimensional image displaying additional information. The three-dimensional image forming system according to claim 6, wherein drawing is performed. 8. When the operating means of the input device is pressed down and the virtual viewpoint moves in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image, the operating means performs When a displacement operation is performed in a direction along a two-dimensional plane, the viewpoint position calculation means of the image forming apparatus changes the position of the virtual viewpoint in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image. The position of the virtual viewpoint, the azimuth of viewing, and the moving speed are calculated assuming that the virtual three-dimensional image can move in the direction along the two-dimensional plane from the state in which the virtual three-dimensional image is moved. 1, Claim 2,
The three-dimensional image forming system according to claim 3, claim 4, claim 5, claim 6, or claim 7. 9. A three-dimensional image forming method for forming a virtual three-dimensional image based on a virtual viewpoint, comprising: a displacement operation in a direction along a two-dimensional plane; and a pressing operation in a direction perpendicular to the two-dimensional plane. Instruction information relating to the movement of the virtual viewpoint is input through operation means that can be operated, and the displacement operation of the operation means is moved in a direction along the two-dimensional plane of the virtual three-dimensional image of the virtual viewpoint. Assigned to an operation for causing the pressing operation to move in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image of the virtual viewpoint, the position of the virtual viewpoint, The azimuth and the moving speed are calculated, and the image is viewed from the virtual viewpoint based on the image data for drawing the image, the calculated position of the virtual viewpoint, the viewing orientation, and the moving speed. Virtual 3D image 3-dimensional image forming method characterized by fractionating. 10. When the depressing operation of the operation means is repeatedly performed, the virtual viewpoint is moved from a state in which the virtual viewpoint moves in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image to the virtual three-dimensional image. 10. The three-dimensional image forming method according to claim 9, wherein the position of the virtual viewpoint is calculated assuming that the virtual image moves in a direction perpendicular to the two-dimensional plane. 11. When the operating means is pressed, the azimuth of viewing is viewed from the virtual viewpoint so that a predetermined gazing point in the virtual three-dimensional image is viewed from the virtual viewpoint. The three-dimensional image forming method according to claim 9, wherein an orientation of the virtual three-dimensional image with respect to a direction perpendicular to the two-dimensional plane when the virtual image is present is determined. 12. When the pressing operation of the operating means is repeatedly performed, the virtual viewpoint is moved from a state in which the virtual viewpoint is moved in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image to the virtual three-dimensional image. The position of the virtual viewpoint is calculated as moving in the direction perpendicular to the two-dimensional plane of the two-dimensional plane, and the position of the virtual viewpoint perpendicular to the two-dimensional plane in the virtual three-dimensional image of the virtual viewpoint is calculated. 12. The three-dimensional image forming method according to claim 11, wherein a position of the gazing point in the virtual three-dimensional image is changed according to a moving distance in a direction. 13. A moving distance of the virtual viewpoint in a direction perpendicular to the two-dimensional plane in the virtual three-dimensional image,
When the moving distance becomes equal to or longer than a predetermined moving distance, the 2D image of the virtual three-dimensional image when viewing the viewing direction from the virtual viewpoint so as to see the fixation point from the virtual viewpoint.
13. The three-dimensional image forming method according to claim 12, wherein an orientation with respect to a direction perpendicular to the dimensional plane is determined. 14. When the operating means is kept pressed, the position of the virtual viewpoint in the direction perpendicular to the two-dimensional plane of the virtual three-dimensional image is not changed. Claim 9, Claim 1 characterized by the above-mentioned.
14. The three-dimensional image forming method according to claim 11, wherein the three-dimensional image is formed. 15. A virtual three-dimensional image in which additional information is displayed in a virtual three-dimensional image when said operating means is maintained in a pressed state. Item 15. The three-dimensional image forming method according to Item 14. 16. When the operation means is depressed and the virtual viewpoint moves in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image, the operation means moves to the two-dimensional plane. When the displacement operation is performed in the direction along the virtual three-dimensional image, the position of the virtual viewpoint moves along a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image along the two-dimensional plane of the virtual three-dimensional image. The position of the virtual viewpoint, the viewing azimuth, and the moving speed are calculated as being capable of moving in a different direction.
0, Claim 11, Claim 12, Claim 13, Claim 14
Alternatively, the three-dimensional image forming method according to claim 15. 17. An input device for receiving an instruction to move a virtual viewpoint in a virtual three-dimensional image space, comprising: a displacement operation in a direction along a two-dimensional plane; and a pressing operation in a direction perpendicular to the two-dimensional plane. Operating means capable of: and accepting the displacement operation of the operating means as an operation for moving the virtual viewpoint in a direction along a two-dimensional plane of the virtual three-dimensional image, and An input device, comprising: receiving means for receiving as an operation for moving a virtual viewpoint in a direction perpendicular to the two-dimensional plane of the virtual three-dimensional image.