JPH11309269A - Game device, simulation apparatus and game imade display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enjoy a game with more sense of actuality. SOLUTION: An actual model 1 can be removed and a camera 1a is mounted thereon. A game proceeding means 5 proceeds a game corresponding to a state information of the actual model 1 received from a state information obtaining means 3, a state information of a competitor received from competitor information obtaining means 4, and input signals from a control means 2. An action command is output to the actual model 1 corresponding to a proceeding state of the game, and an imaging command to an imaging means 6 is output. The imaging means 6 produces images according to the imaging command. A composition means 7 composes a picture taken from the camera 1a and a picture produced by the imaging means 6 to output to a display device 8. The display device 8 shows the picture produced by the imaging means 6.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a game device for playing various games by displaying images on a display, a simulation device for experiencing a model operation in a virtual space, and a game device adapted to the progress of the game. The present invention relates to a game image display method for displaying a screen, and particularly to a game device capable of obtaining a high physical feeling, a simulation device using a head-mounted display device, and a game image for displaying an image on the head-mounted display device. Display method.

[0002]

2. Description of the Related Art In recent years, with the development of image processing technology, game devices centered on images have become widespread. In this game device, when an image is displayed on a display and an operation is performed by a controller in accordance with the display image, the display image changes in response to the input. As a result, the user operates the character displayed on the display to play a battle game or the like.

Displaying an image on a large-screen display is effective for enhancing the sense of reality in a battle game or the like, but a large-screen display is expensive. Therefore, a head-mounted display device has been developed.

A head-mounted display device is basically composed of a ring and a display unit, and is worn as if wearing glasses just by putting the ring on the head. And computer graphics (C
G: Computer Graphics) or video input from a video device is projected onto a portion of the glasses that hits a lens. The projected image enters the user's view as a virtual image two meters away. As a result, the user is as if 50 meters 2m away.
You can feel as if you were watching a large inch powerful screen.

[0005]

However, since characters in conventional game devices are mostly images generated by computer graphics, there is a case where a character is flat and does not have a real feeling. Therefore, even if a head-mounted display device is used, there is a limit to the realism that can be obtained.

[0006] The present invention has been made in view of the above points, and it is an object of the present invention to provide a game device that allows a player to enjoy a more realistic game. Another object of the present invention is to provide a simulation apparatus that allows a user to experience a more realistic simulation.

Another object of the present invention is to provide a game image display method capable of displaying a more realistic image.

[0008]

According to the present invention, in order to solve the above-mentioned problems, in a game apparatus for displaying an image corresponding to the progress of a game, a camera is mounted, and an entity which operates in response to an operation command is provided. A model, an operation unit for inputting a command relating to an operation to the substantial model and a command necessary for game progress, a state information acquiring unit for acquiring state information of the substantial model, an input content from the operation unit, and the state Game progressing means for causing the game to progress using the information, outputting an operation command corresponding to the progress of the game to the real model, and outputting an image display command according to the progress of the game; and the game progressing means. Image generation means for generating an image based on an image display command from the camera, a video taken by the camera, and a video generated by the image generation means. Synthesizing means for forming, said synthesizing means game apparatus characterized by having a display device which displays an image synthesis is provided.

According to such a game machine, the state information of the real model is obtained by the state information obtaining means. Then, when the user inputs an operation command of the real model using the operation unit, the game is advanced by the game advancing unit based on the operation instruction and the state information. Then
In accordance with the progress of the game, an operation command to the real model is issued, and the real model is operated, and an image display command is issued in accordance with the progress of the game. An image is generated by the image generating means in response to the image display command. The generated image is combined with an image captured by a camera mounted on the real model by the combining unit, and displayed on the display device.

[0010] This allows the user to view a composite image of a three-dimensional image captured by an actual camera and an image generated in accordance with the progress of the game, so that a more realistic game can be realized. You can enjoy.

According to another aspect of the present invention, there is provided a simulation apparatus for experiencing an operation of a model in a virtual space, comprising: an operation unit for inputting an operation command for the model; A behavior calculating means for calculating a behavior when the model is a real thing and outputting an image display command according to the calculated behavior; and an image generating means for generating an image based on an image display command from the behavior control means An image display unit that displays an image generated by the image generation unit, and a function of adjusting a transmission amount of light from the front of the user's line of sight, and the image display unit displays an image from the front of the line of sight. A head-mounted display device, which superimposes on a displayed image and projects the image onto a user's field of view, is provided.

According to such a simulation device, when the user inputs an operation command using the operation means,
The behavior when the model is genuine is calculated by the behavior calculation means. Then, an image according to the behavior calculation result is generated by the image display means. The generated image is superimposed on an image from the user's line of sight and projected onto the user's field of view on the head-mounted display device.

[0013] Thus, the real image in front of the actual user,
The user can see a composite image with the image generated by the simulation, and can experience a simulation with a higher physical feeling.

According to another aspect of the present invention, there is provided a game image display method for displaying a screen according to a progress of a game. A game image display method is provided, comprising combining an image and an image generated according to the progress of a game, and displaying the combined image on a screen of a head-mounted display device. .

According to this game image display method, a user who enjoys the game displays a composite image of the image from the camera and the image generated according to the progress of the game on the screen of the head-mounted display device. It is projected on.

[0016]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram illustrating the principle of the present invention. This game device is a game device for playing a competitive game.

The real model 1 is movable, and the camera 1
a is mounted. The real model 1 operates in response to an input from the game progress unit 5. The operation unit 2 is an input device for inputting an operation command related to the movement of the real model 1 and operating a function virtually set for performing a battle. The virtually set function is, for example, a function for attacking the real model of the opponent (such as launching a missile).

The state information obtaining means 3 obtains state information of the real model 1. The state information is information relating to the position and orientation of the entity model 1. The acquired state information is passed to the game progress means 5.

The opponent information acquiring means 4 acquires the state information of the opponent sent from the opponent's game device. More specifically, the information is the position information of the real model of the opponent. The acquired information is passed to the game progress means 5.

The game progressing means 5 includes the state information obtaining means 3
The game is advanced in accordance with the status information of the real model 1 received from the player, the status information of the opponent received from the opponent information acquisition unit 4, and the input signal from the operation unit 2. Then, it outputs an operation command to the real model and an image generation command to the image generation means 6 according to the progress of the game.

The image generating means 6 generates an image based on an image generation command. The image to be generated is a part of a real image recorded in advance or an image generated by computer graphics.

The synthesizing means 7 synthesizes the image photographed by the camera 1a and the image generated by the image generating means 6 and outputs the synthesized image to the display device 8. The display device 8 displays the image generated by the image generation means 6 on a screen.

According to such a game apparatus, when the user operates the real model 1 using the operating means 2, the position information and the like of the real model 1 are obtained by the state information obtaining means 3 and transmitted to the game progressing means 5. Sent. Then, the game progressing unit 5 advances the game in accordance with the state information such as the position information of the real model of the opponent, the state information sent from the state information obtaining unit 3, and the input from the operation unit 2. Then, an image according to the progress of the game is generated by the image generating means 6 and sent to the synthesizing means 7. The image generated by the image generating means 6 is combined with the image captured by the camera 1a and sent to the display device 8. The composite image is displayed by the display device 8.

As a result, the image generated in accordance with the progress of the game is synthesized with the stereoscopic video actually captured by the camera 1a, and the user can enjoy a realistic appearance as if he / she is actually playing a battle. You can see a video full of feeling. At this time, if a head-mounted display device is used as the display device 8, the physical feeling is further increased.

Next, a case where the embodiment of the present invention is applied to a tank-to-tank battle type game system will be described as an example. FIG. 2 is an overall view of the battle game system of the present invention. As shown, the two game devices 100, 20
0 is connected by a communication bus. Each game device 100,
The tank 200 is connected to the actual tank models 110 and 210. The real models 110 and 210 are the battle space 30
It is placed at 0, and a match takes place in this space. In the battle space 300, a magnetic field in the XYZ-axis directions is formed. The tank physical models 110 and 210 can accurately recognize their positions and orientations by detecting the magnetic field. Note that the function of detecting the position of the real model using the magnetic field corresponds to the state information acquiring unit 3 in FIG.

FIG. 3 is a diagram showing the configuration of the game device. The game device 100 is mainly configured by a personal computer 120 (PC) that controls the whole. P
C120 has a real model 110, a mixer (MIX)
130, the head mounted display device 140, and the controller 150 are connected and control these. Specifically, based on a control signal from the controller 150, the movement of the real model is controlled, and a tank-to-tank battle game is advanced. Then, it generates an image such as computer graphics based on the progress of the battle game, for example, the shot of the opponent's tank, and outputs the image to the mixer 130. Note that the content of the generated CG is changed according to a signal indicating the movement of the head-mounted display device 140. The progress of the game also changes depending on the status information (position information, etc.) of the opponent, but the status information on the real model of the opponent is sent from the opponent's game device 200 via the communication bus. Similarly, the status information of its own real model 110 is transmitted to the opponent game device 200 via the communication bus.

The real model 110 operates according to a signal from the PC 120. As for the operation, it is possible to control not only forward movement and backward movement, but also the direction of the turret and the firing angle of the cannon. The real model 110 includes a monocular or stereo camera 111. The image captured by the camera 111 is sent to the mixer 130. Further, the real model 110 has a function of confirming a state such as its own position. The position information of the real model 110 is represented by three-dimensional coordinate values (x, y, z) in the battle space 300.
Position information includes turret orientation (φ), cannon vertical angle (δ)
Along with the above, it is sent to the PC 120 as state information.

The mixer 130 is provided with an image transmitted from the camera 111 mounted on the physical model 110 and a PC 120
From the head-mounted display device 14
Send to 0.

The head-mounted display device 140 has a structure that can be mounted on the head of the user. Then, the image sent from the mixer 130 is displayed on a screen provided in front of the user.

The controller 150 is the real model 110
This is for inputting the operation command. For example, a joystick is used. From the controller 150, it is possible to instruct the front-back and left-right movement of the real model 110, the rotation of the turret, the firing angle of the cannon, and the like. When a button provided on the controller 150 is pressed, a firing command for the cannon is issued.

FIG. 4 is a diagram showing the internal configuration of the PC.
The PC 120 has the following functions. Communication control unit 1
21 transmits / receives information to / from another game device.
Specifically, information transmitted from another game device is transmitted to the game progression unit 122, and information transmitted from the game progression unit 122 is transmitted to another game device.

The game progress section 122 is a section for controlling the competitive game, and includes the controller 150 and the communication control section 1.
21, entity model 110 and head-mounted display device 140
The game is advanced based on various signals sent from. The game progress result is output as an operation command to the real model 110, an image display command to the image generation unit 123, and a sound generation command to the sound generation unit 125.

The image generation unit 123 includes a game progression unit 122
And generates an image according to the game progress. CG and a real image are used for image generation.
The real image is stored in the real image holding unit in advance. When the image generation unit 123 uses a real image, a necessary image is extracted from the real image storage unit 124 and all or a part of the image is used. The real image and the CG are combined as needed.

The sound generation unit 125 generates a sound in response to a command from the game progress unit 122, and outputs a sound signal to the head-mounted display device. For example, when a shell fired toward the opponent's actual model hits, an explosion sound is output.

FIG. 5 is a schematic configuration diagram showing the configuration of the head mounted display device. Head-mounted display device 140 of the present invention
Is provided with a backlight 141, and a liquid crystal display panel (LCD: Liquid Crystal Diode) provided on each of the left and right sides.
splay) 142a, 142b are illuminated from above.
The LCDs 142a and 142b display images output from the mixer 130. L provided on the left side (right side in the figure) of the user among the LCDs 142a and 142b.
A left-eye image is displayed on the CD 142a, and a right-eye image is displayed on the LCD 142b provided on the right side (left side in the figure) for the user.

The images displayed on the LCDs 142a and 142b are reflected toward the front of the user by the half mirrors 143a and 143b. The reflected image is further enlarged and reflected by the concave half mirrors 144a and 144b, passes through the half mirrors 143a and 143b, and forms an image on the retina of the user's eye (displays a virtual image). .

In this example, the viewing angle is set to 30 °. Thus, when converted to a virtual image distance of 2 m, a 52-inch large screen is viewed. Moreover, by adopting the concave half mirrors 144a and 144b,
At the same time as the images 142a and 142b, the outside world that can be seen with ordinary eyes can be seen. A liquid crystal shutter 145 is provided ahead of the concave half mirrors 144a and 144b, and the liquid crystal shutter 145 adjusts the amount of bright and dark transmitted light.

Further, the head mounted display device 140 includes:
A position sensor 146 such as an acceleration sensor or a gyro sensor is provided to detect a three-dimensional movement of the user's head. The signal detected by the position sensor 146 is P
Sent to C120.

The head-mounted display device 140 is provided with a windable headphone (not shown), and receives a sound from the sound generator 125. When the user uses the head-mounted display device 140, headphones are inserted into the ear holes of the user to listen to the sound.

The operation of the game apparatus when a tank-to-tank battle type game having the above configuration is performed will be described below. When starting the game, the user first wears the head-mounted display device 140 on his / her head. And
A game start command is input using the controller 150. Then, the image captured by the camera 111 and the PC 12
CG by 0 or video by live action
And displayed on the user's own head-mounted display device 140. The user operates the controller 150 while looking at the screen displayed on the head-mounted display device 140 to attack the real model 210 of the opponent.

FIG. 6 is a diagram showing an example of a display screen of the head-mounted display device. On this screen 400, a part of one's own cannon 411 and the real model 412 of the opponent are visible together with the background 421. The background 421 has a C
The images of G are superimposed. Also my own cannon 4
11 and the opponent's real model 412 are images captured by the camera 111 of the real model 110.

Here, when the user operates the controller 150 to position his or her own artillery, then adjusts the strength of the cannon and fires it, the ammunition is fired at the opponent's tank.

At this time, the shell 431 is exaggerated by a CG than a normal movement. That is, PC1
At 20, graphics are generated using the coordinates of the player, the opponent, and the status. The points of the graphics part are. The player slowly displays the trajectory of the shell of the opponent (about 1 second with the opponent).

[0044] At the same time, sound effects are generated to realistically display the expression when the shell hits. For example, when the tank hits the opponent's tank, an explosion state is displayed together with an onomatopoeic sound (generated by the sound effect generating unit 125) called “Dokan”.

[0045] Display the background (part). Thereby, the trajectory of the cannonball can be seen, and the battle game can be produced in an interesting manner. In the present embodiment, the following control is performed according to information from the position sensor 146 of the head-mounted display device 140.

[0046] Control of turret orientation (alternate function of controller 150). The camera device 111 is made movable in three axes, and the control of the real model can be performed only by moving the head.
For example, by moving the direction of the turret of the tank in conjunction with the direction of the head, it is possible to save the trouble of operating the turret and concentrate on the game.

The game progression unit 122 progresses the game while performing the following control in order to make the real-life game device more realistic. First, you can select the type of ammunition (light weight, weight, etc.).
The game progression unit 122 changes the progress of the game according to the type of the shell. For example, a lightweight shell has a locus close to a straight line, and its destructive power is small unless it hits an opponent's point. For heavy ammunition, the trajectory is difficult to hit with a parabola. For that purpose, a ballistic calculator may be separately prepared. The destructive power of heavy ammunition is great.

When a shell is hit, the control of the tank is controlled so as to gradually decrease depending on the type, location and number of shots. For example, tank slowdown,
Loss of control, image clarity (resolution, brightness)
And so on. The reduction in the clarity of the image is adjusted by controlling the liquid crystal shutter 145 of the head mounted display device 140. When the shell hits the opponent's tank, the score is displayed according to the hit location, the number of shells increases, and the subsequent battle becomes advantageous.

It should be noted that the game apparatus of the present invention can be applied to not only the battle between tanks and tanks as exemplified, but also battle games such as battle hull helicopters, warships and replacement waterships, and applications to pet robots. it can. If applied to a pet robot, you can have a simulated experience from the perspective of the pet robot.

Further, in the above description, P
Although C is provided for control, it is also possible to connect a plurality of controllers and real models to one computer and control them collectively.

Further, the head mounted display used in the fighting game device of the present invention has a see-through function (such as a liquid crystal shutter). With this see-through function, you can see through your own and the other party's real model, and superimpose the virtual image displayed on the head-mounted display device. You can get the real feeling of fighting with your opponent. At this time, there is no need for a real model equipped with a camera. That is, instead of the image captured by the camera of the real model of the game device, an image incident from the front of the user by the see-through function of the head-mounted display device is used. Further, since the images are optically synthesized in the head-mounted display device, the function of the mixer 130 in FIG. 3 is unnecessary.

The game device of the present invention may have the following application examples. First, the game device of the present invention can be applied to a virtual reality experience system for experiencing virtual reality. This is a system that realizes an experience such as a theme park attraction using a liquid crystal shutter 145 provided in the head-mounted display device 140 and controlling the amount of transmitted light from the outside.

That is, the game progress section 122 controls the liquid crystal shutter 145 as follows. FIG. 7 is a flowchart showing a liquid crystal shutter control procedure for the virtual reality experience system. Hereinafter, a control procedure of the liquid crystal shutter by the game progression unit 122 will be described along the step numbers. [S1] At the start of the game. Open the LCD shutter completely. [S2] By gradually closing the liquid crystal shutter, enter the game world while gradually fading in. [S3] The liquid crystal shutter is completely closed, and an image of the game world is displayed on the LCD. [S4] By gradually opening the liquid crystal shutter, the player exits the game world while gradually fading out. [S5] The liquid crystal shutter is completely opened to show the user the real world.

By controlling the liquid crystal shutter in this way, an experience like a theme park attraction can be realized. Other operations are the same as in the case of executing the competitive game.

Further, in the fighting game device, the opponent of the fighting game can be placed in a real environment to increase the movable distance of its own real model. That is, in a conventional game device, a match could not be played in a space other than a space set in advance by a program, but in a game device according to the present invention, a substantial model is arranged at an arbitrary place and a match is played at that place. It can be carried out. Therefore, for example, if the real model is taken out of the field, the action range of the real model can be very large.

Further, the simulation function of the battle game can be applied to training. For example, when the simulation function of the present invention is applied to crane operation, a crane operation simulator + a head-mounted display device +
A position sensor for the head-mounted display device is prepared. The crane operation simulator corresponds to the PC and the controller in the game device. In the crane operation simulator, the game progress section in the PC is replaced with a behavior calculating means for calculating the behavior of the crane (including the behavior of the luggage suspended on the crane). This behavior calculation means is substantially the same as the function of the game progression unit of the game device, except that the calculation content does not include a game-like element.

On the head-mounted display device, a scene seen when the operator is sitting in the driver's seat is displayed. The display at this time can be “all CG”, “CG + actual photography”, “CG + video from a camera mounted on the model”, or the like. Then, the scene seen on the head-mounted display device is changed in accordance with the operation of the crane operation simulator by the operator. Thereby, the simulation of the crane operation can be easily performed.

In addition to this, the present invention can be applied to simulations of light aircraft, gliders, and other scenes where full-scale simulations cannot be used. In addition, these can be directly used as a game.

The contents of the processing functions executed by the PC can be described in a program recorded on a computer-readable recording medium. Then, by executing this program on a computer, the above processing is realized on the computer. Examples of the computer-readable recording medium include a magnetic recording device and a semiconductor memory. When circulating the market, CD-R
The program is stored and distributed in a portable recording medium such as an OM (Compact Disk Read Only Memory) or a floppy disk, or is stored in a storage device of a computer connected via a network, and is connected to another computer through the network. You can also transfer. When the program is executed by the computer, the program is stored in a hard disk device or the like in the computer, and is loaded into the main memory and executed.

[0060]

As described above, in the game device of the present invention, the image captured by the camera mounted on the real model that operates according to the progress of the game, the image generated according to the progress of the game, Are synthesized and displayed, so that the user of the game device can enjoy a game with a real feeling.

In the simulation apparatus of the present invention, the real image in front of the user and the image generated by the simulation are shown so as to overlap each other. You can experience a high simulation.

In the game image display method of the present invention,
The image captured by the camera mounted on the real model and the image generated according to the progress of the game are combined and displayed, so that users who view the displayed image can obtain a high sense of realism Can be.

[Brief description of the drawings]

FIG. 1 is a principle configuration diagram of the present invention.

FIG. 2 is an overall view of a competitive game system of the present invention.

FIG. 3 is a diagram showing a configuration of a game device.

FIG. 4 is a diagram showing an internal configuration of a PC.

FIG. 5 is a schematic configuration diagram illustrating a configuration of a head mounted display device.

FIG. 6 is a diagram illustrating an example of a display screen of the head-mounted display device.

FIG. 7 is a flowchart showing a liquid crystal shutter control procedure for the virtual reality experience system.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Real model, 1a ... Camera, 2 ... Operation means, 3 ... State information acquisition means, 4 ... Opponent information acquisition means, 5 ... Game progress means, 6 ... Image generation means, 7 ... Compositing means, 8 ... Display means

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification symbol FI H04N 5/64 511 H04N 5/64 511A // G06T 15/00 G06F 15/62 360

Claims (12)

[Claims] 1. A game device for displaying an image according to the progress of a game, comprising: a real model that is equipped with a camera and operates according to an operation command; Operating means for inputting a necessary command; state information obtaining means for obtaining state information of the substantial model; a game progressing using the input content from the operating means and the state information; Game progress means for outputting a corresponding operation command to the real model and outputting an image display command in accordance with the progress of the game; and an image generating means for generating an image based on the image display command from the game progress means Synthesizing means for synthesizing a video taken by the camera and a video generated by the image generating means; and an image synthesized by the synthesizing means. Game apparatus characterized by having a display device for displaying. 2. An opponent information acquiring unit for acquiring information on a state of an opponent, wherein the game progressing unit uses the information of the opponent acquired by the opponent information acquiring unit to execute a competitive game. The game device according to claim 1, wherein the game device is caused to proceed. 3. The game device according to claim 1, wherein the display device is a head-mounted display device. 4. The display device has a function of adjusting the amount of light transmitted from the front of the user's line of sight when the head is worn, and combines the image from the front of the line of sight with the image synthesized by the synthesizing unit. The game device according to claim 3, wherein the game device is superimposed and projected onto a field of view of a user. 5. The game proceeding means outputs a video switching command between the real world and the virtual world in accordance with the progress of the game, and the display device responds to the video switching command outputted by the game proceeding means. 5. The game apparatus according to claim 4, wherein the amount of light transmitted from the front of the user's line of sight is changed. 6. The game device according to claim 1, wherein the display device includes a position sensor, and inputs a signal detected by the position sensor to the game advancing unit as a part of information on an operation of the real model. Item 3. The game device according to Item 3. 7. The game proceeding means receives an input of user position information, and if the user position information is information indicating that the user has moved forward, an image is displayed such that the display image is enlarged and displayed. A display command is output, and if the user position information is information indicating that the user has moved backward, an image display command is output so as to reduce and display a display image, and the display device performs movement in space. 4. The game device according to claim 3, further comprising a position sensor for detecting, and inputting a signal detected by the position sensor to the game progression unit as the user position information. 8. The game device according to claim 1, wherein the image generating means generates a composite image of a previously recorded real image and an image generated by computer graphics. 9. The sound generating means for outputting a sound output command according to the progress of the game, and generating a sound signal based on the sound output command output from the game proceeding means. 2. The game apparatus according to claim 1, further comprising: means for converting a sound signal generated by the sound generating means into an actual sound and outputting the actual sound. 10. A game device for displaying an image according to the progress of a game, comprising: operating means for inputting a command necessary for the progress of the game; Game progressing means for outputting an image display command according to the progress, image generating means for generating an image based on an image display command from the game proceeding means, image display for displaying an image generated by the image generating means Unit, and has a function of adjusting the amount of light transmitted from the front of the user's line of sight, and superimposes an image from the front of the line of sight on the image displayed by the image display unit, and projects the image to the user's field of view.
A game device comprising: a head-mounted display device; 11. A simulation apparatus for experiencing an operation of a model in a virtual space, comprising: an operation unit for inputting an operation command for the model; and a case where the model is a real object according to the input content from the operation unit. A behavior calculation unit that calculates a behavior and outputs an image display command according to the calculated behavior; an image generation unit that generates an image based on an image display command from the behavior control unit; And an image display unit for displaying a projected image, and a function of adjusting the amount of light transmitted from the front of the user's line of sight, and using the image from the front of the line of sight on the image displayed by the image display unit. To the person's sight,
A simulation device comprising: a head-mounted display device; 12. A game image display method for displaying a screen according to the progress of a game, comprising: displaying an image from a camera mounted on a real model that operates according to the progress of the game; A game image display method comprising: synthesizing an image generated in response to the generated image; and displaying the synthesized image on a screen of a head-mounted display device.