JP2017119032A - Game device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a game device, a program, etc. capable of achieving more appropriate danger notification in a game using a head-mounted display device.SOLUTION: A game device includes an input processing part for acquiring position information on a player wearing a head-mounted display device and moving in a play area of an actual world or in a game device housing, a game processing part for executing processing of a game that the player plays in a virtual game space where a plurality of objects are arranged, and a display processing part for executing processing for displaying a game image seen from a given viewpoint in the game space in the head-mounted display device. The game processing part executes processing for switching whether to display the game image in the game space or to display a danger notification image in a model space set based on model information on the play area or model information on the game device housing according to the position of the player in the play area or in the game device housing.SELECTED DRAWING: Figure 25

Description

  The present invention relates to a game device, a program, and the like.

  2. Description of the Related Art Conventionally, there has been known an apparatus that allows a user to experience a so-called virtual reality (VR) world by mounting an HMD (head-mounted display device) on a head and allowing a player to view an image displayed on the screen of the HMD. It has been. As a conventional technique of such an apparatus, there are techniques disclosed in Patent Documents 1 and 2, for example.

JP-A-5-304646 JP 2013-164737 A

  When the HMD is worn, the user's line of sight concentrates on the HMD screen. For this reason, when the user walks with the HMD attached, there is a risk of hitting a surrounding obstacle.

  In order to avoid such a risk, the conventional technology of Patent Document 1 is equipped with a monochrome liquid crystal panel and a sensor that can pass light from the outside to the HMD stepwise from transmission to shielding. When the sensor detects a sudden movement or an impact, the monochrome liquid crystal panel is made transparent so that the outside can be seen. As a result, the user can avoid obstacles in the outside world.

  In the prior art of Patent Document 2, a photographing device that photographs the front direction of the user wearing the HMD and a distance meter that measures the distance between the object in the front direction are provided. Then, based on the measurement result of the distance meter, when it is determined that there is an obstacle in the front direction of the user, the video data captured by the imaging device is displayed on the screen of the HMD. At this time, warning information is also added to the video data. Thereby, the user can recognize the obstacle in the front by seeing the video data photographed by the photographing apparatus, and can avoid the obstacle.

  However, in these prior arts, in order to avoid the danger of hitting an obstacle, a monochrome liquid crystal panel that can pass light from transmission to shielding step by step, and an imaging device for showing the external image in the front direction to the user Will be needed. For this reason, a dedicated HMD equipped with a special device (monochrome liquid crystal panel, photographing apparatus) for avoiding danger is required, and these conventional techniques cannot be adopted in an HMD not equipped with such a device. There is a problem.

  According to some aspects of the present invention, it is possible to provide a game device, a program, and the like that can realize more appropriate danger notification in a game using a head-mounted display device.

  One embodiment of the present invention includes an input processing unit that acquires information on a position of a player who moves in a real-world play area or game device housing by wearing a head-mounted display device, and a virtual object in which a plurality of objects are arranged. A game processing unit for processing a game played by a player in a typical game space, and a display processing unit for performing processing for displaying a game image seen from a given viewpoint in the game space on the head-mounted display device The game processing unit includes any one of the game image in the game space and the danger notification image in the model space set based on the model information of the play area or the model information of the game apparatus housing. This is related to a game device that performs a process of switching according to the position of the player in the play area or the game device housing. The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

  According to one aspect of the present invention, position information of a player who moves within a play area or a game device housing is acquired. In addition, in a virtual game space in which a plurality of objects are arranged, processing of a game played by the player is performed, and a game image viewed from a given viewpoint in the game space is displayed as a head-mounted display worn by the player. Displayed on the device. Then, which of the game image in the game space and the danger notification image in the model space set based on the model information of the play area or the game device housing is displayed is determined by the player in the play area or the game device housing. It is switched according to the position. In this way, normally, while displaying the game image in the game space on the head-mounted display device, the position of the player in the play area or the game device housing is, for example, a position with a high probability of danger. In some cases, the game image can be switched to the danger notification image. Since the danger notification image is an image in a space set based on the model information of the play area or the game apparatus housing, an image suitable for the danger notification can be displayed on the head-mounted display device as the danger notification image. It becomes like this. Accordingly, it is possible to provide a game device or the like that can realize more appropriate danger notification in a game using a head-mounted display device.

  In one aspect of the present invention, the model information of the play area is model information including at least shape information of the play area, and the model information of the game apparatus housing is shape information of the game apparatus housing. May be model information including at least.

  In this way, it is possible to display a danger notification image that reflects the shape of the play area or the game apparatus housing, thereby realizing more appropriate danger notification.

  In one aspect of the present invention, the game processing unit differs in the viewpoint position or line-of-sight direction of the viewpoint in the model space that generates the danger notification image from the viewpoint in the game space that generates the game image. You may set to a viewpoint position or a gaze direction.

  In this way, it is possible to set the viewpoint in the model space to a viewpoint that is suitable for the danger notification image and generate a danger notification image, thereby realizing more effective danger notification.

  In one aspect of the present invention, the game processing unit detects the approach or arrival of a player to the boundary of an area set as a player movement range in the play area or the game apparatus housing, or When the movement of the player beyond the boundary is detected, a switching process from the game image to the danger notification image may be performed.

  In this way, when the player approaches or reaches the boundary of the area, or when the movement of the player beyond the boundary is detected, the game image is switched to the danger notification image, and the danger related to the area boundary is reduced. The player can be notified effectively.

  In the aspect of the invention, the display processing unit may perform a process of displaying the game image in which a spectator image is displayed in a place corresponding to the outside of the area on the head-mounted display device. Good.

  In this way, for example, the player has become enthusiastic about the game play and moved to a place corresponding to the outside of the real world area where the audience is in the virtual game space. Even in this case, it is possible to realize appropriate danger notification to the player.

  In the aspect of the invention, the display processing unit may perform display processing of guidance information that guides the player's movement when the game image is switched to the danger notification image.

  In this way, when the game image is switched to the danger notification image, it is possible to effectively guide the player in a direction in which the danger can be avoided using the guidance information.

  In one aspect of the present invention, the display processing unit may perform display processing of an avatar that induces a player to move when the game image is switched to the danger notification image.

  In this way, when the game image is switched to the danger notification image, the avatar can be used to effectively guide the player in a direction in which the danger can be avoided.

  In the aspect of the invention, the display processing unit may perform a process of seamlessly switching the image between the game image and the danger notification image.

  In this way, it is possible to effectively suppress a situation in which an image displayed on the player suddenly switches from a game image to a danger notification image, or suddenly switches from a danger notification image to a game image.

  In the aspect of the invention, the display processing unit may superimpose and display the danger notification image on the game image, and may perform a process of changing a display size of the danger notification image on the game image. Good.

  If it does in this way, it will become possible to change the display size of a danger information image so that it may become a display mode suitable for danger information.

  In one aspect of the present invention, the game processing unit may perform switching control from the game image to the danger notification image based on a moving speed of the player.

  In this way, for example, appropriate switching control between the game image and the danger notification image according to the moving speed of the player can be realized.

  In one aspect of the present invention, the game processing unit may perform a process of vibrating a vibrating device or a process of outputting a warning sound when the game image is switched to the danger notification image.

  In this way, in addition to switching from the game image to the danger notification image, appropriate danger notification to the player can be realized by generating a vibration for warning and outputting a warning sound.

The structural example of the game device of this embodiment. FIG. 2A and FIG. 2B are examples of the HMD used in this embodiment. 3A and 3B are other examples of the HMD used in the present embodiment. 4A and 4B are explanatory diagrams of a play area. Explanatory drawing of a game device housing. The example of the game image produced | generated by this embodiment. The example of the game image produced | generated by this embodiment. The example of the game image produced | generated by this embodiment. The figure which overlooked the concert hall in VR space. Explanatory drawing about the movement of the player on a stage. Explanatory drawing about the movement of the player on a stage. FIG. 12A to FIG. 12C are explanatory diagrams of the method of this embodiment. Explanatory drawing of the danger alerting | reporting image in model space. An example of a danger notification image. The other example of a danger alerting | reporting image. Explanatory drawing of the method of displaying a danger alerting | reporting object. FIG. 17A and FIG. 17B are explanatory diagrams of a method for setting the viewpoint setting in the model space to be different from the viewpoint setting in the game space. 18A to 18C are explanatory diagrams of a method for seamlessly switching between a game image and a danger notification image and a method based on a moving speed of a player. 19A to 19C are explanatory diagrams of a method for changing the display size of the danger notification image and a method using a wire frame model. Explanatory drawing of the method of generating a warning vibration or outputting a warning sound. FIGS. 21A and 21B are explanatory diagrams of a technique for performing the first game process of the first game based on the input information and the second game process of the second game based on the line-of-sight information. 22 (A) to 22 (C) are explanatory diagrams of a player's game play evaluation method in the first and second games. FIG. 23A to FIG. 23C are explanatory diagrams of a player's game play evaluation method in the second game using line-of-sight information. FIGS. 24A and 24B are explanatory diagrams of a player's game play evaluation method in the first game which is a music game. The flowchart which shows the detailed process example of this embodiment. The flowchart which shows the detailed process example of this embodiment.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Configuration FIG. 1 shows a configuration example of a game apparatus (image generation apparatus, game system) according to the present embodiment. Note that the game device according to the present embodiment is not limited to the configuration shown in FIG. 1, and various modifications such as omitting some of the components (parts) and adding other components are possible.

  The input device 160 is a device for the player to input various input information. The input device 160 can include a performance information input device 161 and a vibration device 164. The input device 160 may have a game controller function for the player to input game operation information. The game controller is realized by, for example, an operation button, a direction instruction key, a joystick or a lever. In this case, the game controller and the performance information input device 161 may be realized by an integral casing or may be realized by a separate casing.

  The performance information input device 161 is a device for inputting player performance information. For example, when the music game realized by this embodiment is a song performance game, the input information of the input device 160 is song (vocal) performance information. The performance information input device 161 is realized by a microphone 162 described with reference to FIG. When the music game realized by this embodiment is a musical instrument performance game, the input information of the input device 160 is musical instrument performance information. The performance information input device 161 can be realized by a musical instrument such as a stringed instrument (guitar), a percussion instrument (drum, drum), a keyboard instrument (piano, keyboard), or a device imitating the instrument.

  The vibration device 164 (vibration generating unit) is a device that generates vibration for warning or the like, and is realized by, for example, a vibration motor (vibrator). For example, the vibration motor generates vibration by rotating an eccentric weight. Specifically, eccentric weights are attached to both ends of the drive shaft so that the motor itself swings. The vibration device 164 is not limited to a vibration motor, and may be realized by, for example, a piezoelectric element.

  The storage unit 170 stores various types of information. The storage unit 170 functions as a work area such as the processing unit 100 or the communication unit 196. The game program and game data necessary for executing the game program are held in the storage unit 170. The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), HDD (hard disk drive), SDD, optical disk device, or the like. The storage unit 170 includes a spatial information storage unit 172, a music information storage unit 174, a parameter storage unit 176, and a drawing buffer 178.

  The information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and its function can be realized by an optical disk (DVD, BD, CD), HDD, semiconductor memory (ROM), or the like. . The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, in the information storage medium 180, a program for causing a computer (an apparatus including an input device, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

  The head-mounted display device 200 (hereinafter referred to as HMD as appropriate) is a device that is mounted on the player's head and displays an image in front of the player's eyes. The HMD 200 is preferably a non-transmissive type, but may be a transmissive type. The HMD 200 may be a so-called glasses-type HMD.

  The HMD 200 includes a sensor unit 210, a display unit 220, and a processing unit 240. A modification in which a light emitting element is provided in the HMD 200 is also possible. The sensor unit 210 is for realizing tracking processing such as head tracking, for example. For example, the position and direction of the HMD 200 are specified by tracking processing using the sensor unit 210. By specifying the position and direction of the HMD 200, the viewpoint position and line-of-sight direction of the player can be specified.

  Various methods can be adopted as the tracking method. In the first tracking method, which is an example of the tracking method, a plurality of light receiving elements (photodiodes and the like) are provided as the sensor unit 210, as will be described in detail with reference to FIGS. 2A and 2B described later. Then, by receiving light (laser or the like) from a light emitting element (LED or the like) provided outside by the plurality of light receiving elements, the position of the HMD 200 (player's head) in the real world three-dimensional space, In the second tracking method for specifying the direction, a plurality of light emitting elements (LEDs) are provided in the HMD 200, as will be described in detail with reference to FIGS. 3A and 3B described later. And the position and direction of HMD200 are pinpointed by imaging the light from these light emitting elements with the imaging part provided outside. In the third tracking method, a motion sensor is provided as the sensor unit 210, and the position and direction of the HMD 200 are specified using this motion sensor. The motion sensor can be realized by, for example, an acceleration sensor or a gyro sensor. For example, by using a 6-axis motion sensor using a 3-axis acceleration sensor and a 3-axis gyro sensor, the position and direction of the HMD 200 in a three-dimensional space in the real world can be specified. Note that the position and direction of the HMD 200 may be specified by a combination of the first tracking method and the second tracking method, or a combination of the first tracking method and the third tracking method.

  The display unit 220 of the HMD 200 can be realized by, for example, a liquid crystal display (LCD) or an organic EL display. For example, the HMD 200 is provided with a first display arranged in front of the player's left eye and a second display arranged in front of the right eye as the display unit 220, so that, for example, stereoscopic display is possible. ing. When performing stereoscopic display, for example, a left-eye image and a right-eye image with different parallaxes are generated, the left-eye image is displayed on the first display, and the right-eye image is displayed on the second display.

  The processing unit 240 of the HMD 200 performs various processes necessary for the HMD 200. For example, the processing unit 240 performs control processing of the sensor unit 210, display control processing of the display unit 220, and the like. In addition, the processing unit 240 performs a three-dimensional sound (stereoscopic sound) process to realize reproduction of a three-dimensional sound direction, distance, and spread. That is, a process for controlling the sound field in the three-dimensional space is performed. The sound subjected to such three-dimensional acoustic processing is output to a sound output unit 192 realized by headphones or the like via a headphone terminal provided in the HMD 200.

  The sound output unit 192 outputs the sound generated by the present embodiment, and can be realized by, for example, headphones or a speaker provided in a television or an audio device.

  The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and the function can be realized by an ASIC for I / F processing or the like. The portable information storage medium 195 is for a user to save various types of information, and is a storage device that retains storage of such information even when power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

  The communication unit 196 communicates with the outside (another apparatus) via a wired or wireless network, and functions thereof are hardware such as a communication ASIC or communication processor, or communication firmware. Can be realized.

  Note that a program (data) for causing a computer to function as each unit of the present embodiment is obtained from an information storage medium of a server (host device) via an information storage medium 180 (or storage unit 170, auxiliary storage) via a network and communication unit 196. May be distributed to the device 194). Use of an information storage medium by such a server (host device) can also be included in the scope of the present invention.

  The processing unit 100 (processor) performs game processing, game results calculation processing based on input information from the input device 160, tracking information (HMD position, direction, or viewpoint position, line-of-sight direction) in the HMD 200, a program, and the like. Display processing or sound processing.

  Each processing (each function) of this embodiment performed by each unit of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the function of each unit may be realized by individual hardware, or the function of each unit may be realized by integrated hardware. The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Processing Unit) can be used. The processor may be an ASIC hardware circuit. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD) or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and the processing (function) of each unit of the processing unit 100 is realized by executing the instructions by the processor. The instruction here may be an instruction set constituting a program, or an instruction for instructing an operation to the hardware circuit of the processor.

  The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The arithmetic processing unit 110 includes a game processing unit 111, a game result calculation unit 118, a display processing unit 120, and a sound processing unit 130. As described above, each process of the present embodiment executed by these units can be realized by a processor (or a processor and a memory). Various modifications such as omitting some of these components (each unit) or adding other components are possible.

  The input processing unit 102 performs processing for receiving input information and tracking information, processing for reading information from the storage unit 170, and processing for receiving information via the communication unit 196 as input processing. For example, the input processing unit 102 obtains input information input by the player using the input device 160, tracking information (player position information, line-of-sight information, etc.) detected by the sensor unit 210 of the HMD 200, or a read command The process of reading out the information specified in (1) from the storage unit 170 and the process of receiving information from an external device (server, other game device, etc.) of the game device via the network are performed as input processing. Here, the reception process includes a process of instructing the communication unit 196 to receive information, a process of acquiring information received by the communication unit 196, and writing the information in the storage unit 170, and the like.

  The arithmetic processing unit 110 performs various arithmetic processes. For example, arithmetic processing such as game processing, game results calculation processing, display processing, or sound processing is performed.

  The game processing unit 111 (game processing program module) performs various game processes for the player to play the game. The game processing unit 111 includes a game progress processing unit 112, an evaluation processing unit 113, a character processing unit 114, a parameter processing unit 115, an object space setting unit 116, and a virtual camera control unit 117.

  The game progress processing unit 112 performs a process of starting a game when the game start condition is satisfied, a process of progressing the game, or a process of ending the game when the game end condition is satisfied. The evaluation processing unit 113 performs a game play evaluation process for the player. For example, a player's performance in a music game and an evaluation process for game operation are performed. Music information used in the music game is stored in the music information storage unit 174.

  The character processing unit 114 performs various processes related to the character. For example, processing for moving the character in the object space (game space) or processing for moving the character is performed. For example, the process of moving the character can be realized by motion processing (motion reproduction or the like) using motion data. The parameter processing unit 115 performs calculation processing of various parameters (game parameters) used in the game. For example, a process of increasing or decreasing the parameter value is performed. The parameter information is stored in the parameter storage unit 176.

  The object space setting unit 116 performs an object space (virtual three-dimensional space) setting process in which a plurality of objects are arranged. For example, various objects (polygons, free-form surfaces, subdivision surfaces, etc.) representing display objects such as characters (people, animals, robots, etc.), maps (terrain), buildings, auditoriums, courses (roads), trees, walls, water surfaces, etc. The object is arranged and set in the object space. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects. Specifically, the spatial information storage unit 172 of the storage unit 170 stores information such as the positions and rotation angles (directions) of a plurality of objects (part objects) in the object space as spatial information. The object space setting unit 116 performs a process of updating the space information for each frame, for example.

  The virtual camera control unit 117 performs control processing of a virtual camera (viewpoint, reference virtual camera) for generating an image that can be seen from a given (arbitrary) viewpoint in the object space. Specifically, processing for controlling the position (X, Y, Z) or rotation angle (rotation angle about the X, Y, Z axis) of the virtual camera (processing for controlling the viewpoint position, the line-of-sight direction or the angle of view) I do. This virtual camera corresponds to the viewpoint of the player. In the case of stereoscopic display, a first viewpoint for the left eye (first virtual camera for the left eye) and a second viewpoint for the right eye (second virtual camera for the right eye) are set.

  The game score calculation unit 118 performs processing for calculating the game score of the player. For example, calculation processing of game results such as scores and points acquired by the game play of the player is performed.

  The display processing unit 120 performs a game image display process. For example, a drawing process is performed based on the results of various processes (game process, simulation process) performed by the processing unit 100, thereby generating an image and displaying it on the display unit 220 of the HMD 200. Specifically, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. Based on the processing result, drawing data (the position of the vertex of the primitive surface) Coordinates, texture coordinates, color data, normal vector, α value, etc.) are created. Based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is converted into image information in units of pixels such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. As a result, an image that can be seen from the virtual camera (given viewpoint, left eye and right eye first and second viewpoints) in the object space is generated. Note that the drawing processing performed by the display processing unit 120 can be realized by vertex shader processing, pixel shader processing, or the like.

  The sound processing unit 130 performs sound processing based on the results of various processes performed by the processing unit 100. Specifically, game sounds such as music (music, BGM), sound effects, or sounds are generated, and the game sounds are output to the sound output unit 192. Note that part of the sound processing of the sound processing unit 130 (for example, three-dimensional sound processing) may be realized by the processing unit 240 of the HMD 200.

  The output processing unit 140 performs various types of information output processing. For example, the output processing unit 140 performs processing for writing information in the storage unit 170 and processing for transmitting information via the communication unit 196 as output processing. For example, the output processing unit 140 writes information specified by the write command into the storage unit 170, or transmits information to an external device (server, other game device, etc.) of the game device via the network. I do. The transmission process is a process of instructing the communication unit 196 to transmit information, or instructing the communication unit 196 to transmit information.

  And the game device of this embodiment contains the input process part 102, the game process part 111, and the display process part 120, as shown in FIG. The input processing unit 102 wears the HMD 200 (head-mounted display device) and acquires position information of a player who moves in a real-world play area or game device housing. For example, when position information and direction information of the HMD 200 are detected by tracking processing, the input processing unit 102 acquires, for example, position information of the HMD 200 as position information of the player. Further, the input processing unit 102 acquires the viewpoint position information and line-of-sight information (line-of-sight direction information) of the player specified by the position information and direction information of the HMD 200.

  The game processing unit 111 performs processing of a game played by the player in a virtual game space where a plurality of objects are arranged. For example, in a game space (virtual three-dimensional space) that is an object space, a plurality of objects such as characters are arranged, and the game processing unit 111 performs various game processes ( Game progress processing, character processing, object space setting processing, virtual camera control processing, or the like). Then, the display processing unit 120 displays a game image viewed from a given viewpoint (first and second viewpoints for left eye and right eye) in the game space on the display unit 220 (first and second displays) of the HMD 200. Process to display. That is, a process of displaying a game image that can be seen from the viewpoint (virtual camera) of the player in an object space that is a game space. In this case, the player's viewpoint is set by the player's viewpoint position information and line-of-sight information (line-of-sight direction information).

  In this embodiment, the game processing unit 111 determines which of the game image in the game space and the danger notification image (model image) in the model space is to be displayed by the player in the play area or the game apparatus housing. A process of switching according to the position is performed. For example, based on the detection result of the position of the player, a process of switching from the game image to the danger notification image or switching from the danger notification image to the game image is performed.

  The play area (play field, play space) is an area defined (set) in advance as an area (field, space) in which the user plays a game. This play area is an area including a range in which, for example, the position information of the player can be tracked. The play area may be, for example, an area surrounded by walls, but may be an open space area. The inside of the game device case is a space inside the case when the game device has a case in which a player can enter. Various devices (for example, operation devices) and equipment used by the player for game play can be provided in the game device housing.

  In the present embodiment, switching processing between the game image in the game space and the danger notification image in the model space is performed according to the position of the player in such a play area or the game apparatus housing.

  Here, the danger notification image (model image) is an image in the model space set based on the model information of the play area or the model information of the game apparatus housing. For example, the danger notification image is an image that can be seen from a given viewpoint in a model space set by spatial information different from the spatial information for setting the game space. For example, the game space is a space set based on model information of an object (display object) appearing in the game. On the other hand, the model space is a space set based on the model information of the play area or the game apparatus housing. For example, the model space is a space set by model information (polygon data, attribute data such as colors and textures) of an object obtained by modeling a display object that constitutes a play area or a game apparatus housing.

  For example, in FIG. 4A and FIG. 4B described later, a box-shaped private room is a play area. The model information of the play area is model information when this private room is expressed by an object (three-dimensional object) model. For example, a model of a private room is composed of objects (one or a plurality of polygonal objects) such as walls 301 to 304, doors 306, and the like (or a simplified shape) that is substantially the same as the shape of a real room private room. It has become a model with. The space information of the model space is set based on the model information of the model of such a private room. Therefore, when the game image is switched to the danger notification image, the HMD 200 worn by the player displays an image that looks as if it is in a real room. The same applies to the model information of the game apparatus housing 320 illustrated in FIG.

  For example, the play area model information is model information including at least play area shape information. The model information of the game apparatus housing is model information including at least shape information of the game apparatus housing. Such shape information is, for example, polygon data. The polygon data is, for example, polygon data constituting an object that models a display object in a play area or a game apparatus housing.

  The model information of the play area and game device housing only needs to include at least shape information, and the color and texture (material) of the real world play area and game device housing must be faithfully reproduced (detailed). There is no. For example, the model information of the play area and the game device housing may be information obtained by omitting or simplifying information on the color and texture of the real world play area and game device housing. Further, the shape information included in the model information may also be information on a shape obtained by simplifying the real-world play area or game device housing (the number of polygons is small). For example, the model of the play area or the game apparatus housing may be a wire frame model (for example, FIG. 19C described later) configured by a single color such as white.

  For example, a game space which is an object space is based on spatial information including information such as the position and direction (rotation angle) of a plurality of objects (display objects) appearing in the game and model information (shape, color, texture) of the objects. Is set. For example, spatial information including information such as positions and directions of a plurality of objects in the world coordinate system (absolute coordinate system) and model information is stored in the spatial information storage unit 172 in FIG. 1, and the object space setting unit 116 A game space is set based on the space information. The object space setting unit 116 performs a process of updating this space information for each frame, for example. Thereby, game processing in the game space is executed. Then, the display processing unit 120 generates an image that can be seen from a given viewpoint in the game space set by the spatial information as a game image.

  On the other hand, the model space is set on the basis of information such as the position and direction of objects constituting the play area and the game apparatus housing, and space information including model information (shape, color, texture) of the objects. This spatial information is also stored in the spatial information storage unit 172 of FIG. In this case, the model space also corresponds to the object space, like the game space. And the display process part 120 produces | generates the image seen from a given viewpoint as a danger alerting | reporting image in the model space set by the space information different from game space. In this case, the viewpoint set in the game space for generating the game image and the viewpoint set in the model space for generating the dangerous image may be the same or different. . That is, the viewpoint position and line-of-sight direction of the viewpoint in the game space and the viewpoint position and line-of-sight direction of the viewpoint in the model space may be the same or different.

  Further, the game processing unit 111 sets the viewpoint position or line-of-sight direction of the viewpoint in the model space for generating the danger notification image to a viewpoint position or line-of-sight direction different from the viewpoint in the game space for generating the game image. For example, the viewpoint in the game space is set to the viewpoint position and line-of-sight direction of the virtual player. When the real-world player wearing the HMD 200 moves, swings his head, or crouches in the play area of the private room shown in FIGS. 4A and 4B, for example, the virtual player The viewpoint position and the line-of-sight direction also change. For example, when a real-world player moves, the viewpoint position of the virtual player in the game space (VR space) also moves in a direction corresponding to the movement. Further, when the player in the real world shakes his / her head, the direction of the line of sight of the virtual player in the game space also changes so as to face the direction corresponding to the direction of the player's head.

  In this case, the viewpoint position and gaze direction of the viewpoint in the model space are made different from the viewpoint position and gaze direction of the viewpoint in such a game space. For example, when an event that switches from a game image to a danger notification image occurs, for example, the viewpoint position and the line-of-sight direction that overlooks the virtual player are switched, and an image that can be viewed from the viewpoint in the model space and the viewpoint direction is displayed in the danger notification Generate as an image. In this way, it is possible to generate a danger notification image by setting a viewpoint in a viewpoint position and a line-of-sight direction suitable for the danger notification image.

  Further, the game processing unit 111 detects the player's approach or arrival to the boundary of the area set as the player's movement range in the play area or the game apparatus housing, or the movement of the player beyond the boundary is detected. In the case where the game image is detected, a process for switching from the game image to the danger notification image is performed.

  For example, in the present embodiment, an area assumed as a movement range of the player is set (defined) in the play area or the game apparatus housing. This area may be set, for example, when an operator inputs setting information (such as coordinates) of the area in the initialization setting of the game device. For example, area setting information is stored in the storage unit 170 as registration information.

  Then, the game processing unit 111 switches from the game image to the danger notification image when the approach or arrival of the player to the boundary of this area is detected. In this case, the approach or arrival of the player to the boundary of the area can be detected based on the position information of the player acquired by the input processing unit 102. For example, the approach or arrival of the player to the boundary of the area can be detected by obtaining the distance between the player's position and the boundary, or by determining the intersection between the player's position and the boundary.

  Alternatively, the game processing unit 111 switches from the game image to the danger notification image when the movement of the player across the area boundary is detected. For example, the game image may be switched to the danger notification image at the moment when the player position (representative position) exceeds the boundary of the area. Alternatively, the game image may be switched to the danger notification image when moving a predetermined distance after exceeding the boundary or after a predetermined time has elapsed.

  In addition, the display processing unit 120 performs processing for displaying, on the HMD 200, a game image in which a spectator image is displayed at a location corresponding to the outside of the area. For example, in the game space, spectator seats are set and arranged at locations corresponding to the outside of the area. When the player approaches the boundary of the area in the real world, the virtual player corresponding to the player (the player's viewpoint in the game space) approaches the spectator seat in the game space. When the player moves beyond the boundary of the area in the real world, the virtual player enters the spectator seat in the game space.

  In addition, the display processing unit 120 performs display processing of guidance information that guides the player's movement when the game image is switched to the danger notification image. As an example, an image of guidance information is displayed superimposed on the danger notification image. Or the display process part 120 performs the display process of the avatar which guides a player's movement, when it switches from a game image to a danger notification image. This avatar can be expressed by a model object composed of a three-dimensional object such as a character. The player's movement is guided by the conversation display or voice notification by the avatar.

  For example, it is assumed that an area assumed as a movement range of the player is set in the play area or the game apparatus housing. In this case, guidance information for guiding the player's movement in a guidance direction different from the direction toward the boundary of the area is displayed, or an avatar for guiding the player in the guidance direction is displayed. For example, guidance information that guides the player's movement is displayed in the guidance direction that is opposite to the direction toward the area boundary, the guidance direction that intersects the direction toward the area boundary, or the player is guided in the guidance direction. The avatar to be displayed is displayed.

  The display processing unit 120 performs a process of seamlessly switching the image between the game image and the danger notification image. For example, instead of suddenly switching from the game image to the danger notification image, the game image is gradually switched to the danger notification image. Similarly, instead of suddenly switching from the danger notification image to the game image, the danger notification image is gradually switched to the game image. This seamless switching display of images can be realized by, for example, a fade-in / fade-out process, a process of switching while synthesizing the game image and the danger notification image by translucent synthesis, or a wipe-in / wipe-out process.

  The display processing unit 120 also superimposes and displays the danger notification image on the game image and changes the display size of the danger notification image on the game image. For example, when switching from a game image to a danger notification image, processing for increasing the display size of the danger notification image on the game image is performed. In this case, for example, when displaying a normal game image, for example, a danger notification image with a small display size may be displayed (superimposed display) in a place where the corner of the screen is not conspicuous. When switching from the game image to the danger notification image, the display size of the danger notification image is increased, and for example, the danger notification image is finally displayed on the entire screen. At this time, for example, a game image with a small display size may be displayed (superimposed display) in a place where the corner of the screen of the danger notification image is not conspicuous.

  In addition, the game processing unit 111 performs switching control from the game image to the danger notification image based on the moving speed of the player. For example, the switching timing from the game image to the danger notification image is controlled based on the moving speed. For example, control is performed so that the switching timing is earlier as the moving speed of the player is higher. Further, when switching from the game image to the danger notification image when the player approaches the boundary of the area set as the play area, the determination distance determined as approaching the boundary is based on the moving speed of the player. Control. For example, the determination distance is lengthened as the moving speed of the player increases.

  Further, the game processing unit 111 performs a process of vibrating the vibrating device 164 or a process of outputting a warning sound when the danger notification image is switched from the game image. For example, when the approach or arrival of the player to the boundary of the play area or the area set in the game case is detected, the game image is switched to the danger notification image, and the vibration device 164 is vibrated or the sound output unit In 192, a warning sound is output. Alternatively, when the movement of the player beyond the boundary of the area is detected, the game image is switched to the danger notification image, the vibration device 164 is vibrated, and the sound output unit 192 outputs a warning sound. Such a vibrating device for warning may be a vibrating device provided in a device other than the input device 160. For example, the vibration device provided in HMD200 etc. may be sufficient.

2. Next, the method of this embodiment will be described in detail. In the following description, a case where the game to which the method of the present embodiment is applied is a music game (live stage game, karaoke game, etc.) for performing a song will be mainly described as an example. However, the game to which the method of the present embodiment is applied is not limited to this, for example, music that plays an instrument such as a stringed instrument (guitar, etc.), a percussion instrument (drum, drum, etc.), or a keyboard instrument (keyboard, piano). It may be a game (game that competes for rhythm and skill). The method of this embodiment can also be applied to various games such as a communication game (human relationship simulation game) with a heterosexual character, a battle game, an RPG game, a robot game, a card game, a sports game, or an action game. is there.

2.1 HMD
FIG. 2A shows an example of the HMD 200 used in the game device of this embodiment. As shown in FIG. 2A, the HMD 200 is provided with a plurality of light receiving elements 201, 202, and 203 (photodiodes). The light receiving elements 201 and 202 are provided on the front side of the HMD 200, and the light receiving element 203 is provided on the right side of the HMD 200. In addition, a light receiving element (not shown) is also provided on the left side, upper surface, and the like of the HMD.

  The player PL has input devices 160-1 and 160-2 with the left hand and the right hand. Similar to the HMD 200, the input devices 160-1 and 160-2 are provided with a plurality of light receiving elements (not shown). Further, the input device 160-1 is provided with a microphone 162 (sound input device), and the player PL sings with the mouth facing the microphone 162 in a song performance game. The input devices 160-1 and 160-2 also function as game controllers, and are provided with operation buttons, direction instruction keys, and the like (not shown). Note that the player may have one input device 160.

  Further, the HMD 200 is provided with a headband 260 and the like so that the player PL can stably wear the HMD 200 on the head with a better wearing feeling. In addition, the HMD 200 is provided with a headphone terminal (not shown). By connecting a headphone 270 (sound output unit 192) to the headphone terminal, for example, processing of three-dimensional sound (three-dimensional audio) is performed. The player PL can listen to the game sound. Then, the player PL operates the input devices 160-1 and 160-2 functioning as game controllers, performs a head movement operation and a head movement operation, and inputs operation information to enjoy game play. The whirling motion and the swing motion can be detected by the sensor unit 210 of the HMD 200 or the like.

  As shown in FIG. 2B, base stations 280 and 284 are installed in the play area of the player PL. The base station 280 is provided with light emitting elements 281 and 282, and the base station 284 is provided with light emitting elements 285 and 286. The light emitting elements 281, 282, 285, and 286 are realized by LEDs that emit laser (infrared laser or the like), for example. The base stations 280 and 284 use these light emitting elements 281, 282, 285, and 286 to emit, for example, a laser beam radially. The light receiving elements 201 to 203 and the like provided in the HMD 200 in FIG. 2A receive the laser beams from the base stations 280 and 284, thereby realizing tracking of the HMD 200 and the position and direction of the player PL head. Can be detected. The light receiving elements (not shown) provided in the input devices 160-1 and 160-2 receive lasers from the base stations 280 and 284, thereby realizing tracking of the input devices 160-1 and 160-2. The positions and directions of the input devices 160-1 and 160-2 can be detected. Thereby, for example, an image of a microphone corresponding to the input device 160-1 can be displayed on the game image.

  FIG. 3A shows another example of the HMD 200. In FIG. 3A, a plurality of light emitting elements 231 to 236 are provided for the HMD 200. These light emitting elements 231 to 236 are realized by, for example, LEDs. The light emitting elements 231 to 234 are provided on the front side of the HMD 200, and the light emitting element 235 and the light emitting element 236 (not shown) are provided on the back side. These light emitting elements 231 to 236 emit (emit) light in a visible light band, for example. Specifically, the light emitting elements 231 to 236 emit light of different colors. 3B is installed on the front side of the player PL, and the light of the light emitting elements 231 to 236 is imaged by the imaging unit 150. That is, the spot light of these light emitting elements 231 to 236 is reflected in the captured image of the imaging unit 150. Then, by performing image processing on the captured image, tracking of the head (HMD) of the player PL is realized. That is, the three-dimensional position and movement of the head of the player PL are detected.

  For example, as illustrated in FIG. 3B, the imaging unit 150 includes first and second cameras 151 and 152, and the first and second cameras 151 and 152 of the first and second cameras 151 and 152 are provided. By using the captured image, the position of the player PL in the depth direction can be detected. Further, based on the motion detection information of the motion sensor provided in the HMD 200, the rotation angle (line of sight) of the head of the player PL can also be detected. Therefore, by using such an HMD 200, the player PL corresponds to an image in a virtual three-dimensional space (corresponding to the player's viewpoint) regardless of the direction of all 360 degrees around the player PL. An image that can be seen from the virtual camera) can be displayed on the display unit 220 of the HMD 200. Note that instead of visible light, infrared LEDs may be used as the light emitting elements 231 to 236. Further, the position and movement of the player's head may be detected by other methods such as using a depth camera.

  Note that the tracking processing method for detecting the player's viewpoint information (viewpoint position, line-of-sight direction, etc.), position information, and the like is not limited to the method described with reference to FIGS. For example, the tracking process may be realized by a single unit of the HMD 200 using a motion sensor or the like provided in the HMD 200. That is, tracking processing is realized without providing external devices such as the base stations 280 and 284 in FIG. 2B and the imaging unit 150 in FIG. Alternatively, the player's viewpoint information or the like may be detected by various viewpoint tracking methods such as known eye tracking, face tracking, or head tracking. For example, in eye tracking, the position and shape of the left eye and right eye of the player are recognized. Then, the viewpoint tracking is realized by specifying the position of the left eye, the position of the right eye, the viewing direction of the left eye, the viewing direction of the right eye, and the like, and acquiring the viewpoint information of the player. This eye tracking can be realized, for example, by photographing the left eye and the right eye of the player with the imaging unit and performing image recognition processing such as a pupil on the captured image. In face tracking, the imaging unit captures the player's face and performs face image recognition processing. Then, based on the result of the image recognition process, the position and direction of the player's face are specified, and the viewpoint position and line-of-sight direction of the player are obtained, thereby realizing viewpoint tracking.

2.2 Play Area and Game Device Housing FIGS. 4A and 4B show an example of a play area in which the game of the present embodiment is realized. This play area is realized by a box-shaped soundproof private room. As shown in FIG. 4A, the box private room has walls 301, 302, 303, 304, a door 306, and ventilation equipment 307, 308. As shown in FIG. 4B, casters 310 and 312 are provided on the bottom surface of the box so as to be movable. The player PL opens the door 306 and enters the private room to play the game. This space in the private room becomes a play area (play space) for the player PL.

  Then, as shown in FIG. 4A, an area AR assumed as a movement range of the player PL is set in the play area of the box private room. In this area AR, it is possible to track the viewpoint information (viewpoint position, line-of-sight direction) and position information of the player PL using the stations 280, 284 and the like. On the other hand, reliable tracking cannot be realized at a position beyond the boundary BD of the area AR. Further, if the player PL exceeds the boundary BD of the area AR, there is a risk of hitting the walls 301, 302, 303, 304, which is not desirable in terms of safety. The area AR can be set, for example, by the initialization setting of the game device.

  FIG. 5 shows an example of the game apparatus housing 320. In FIG. 5, the game device has a large game device housing 320 so that the player can enter the game device housing 320 and play the game. Inside the game device housing 320, for example, various devices (operation devices), equipment, seats (chairs), and the like are provided. The player enters the game apparatus housing 320, wears the HMD 200 on his head, and enjoys a game in the VR (virtual reality) world.

2.3 Outline of Game Next, an outline of the game realized by the method of the present embodiment will be described. The game realized by the present embodiment is a music game in which a vocal performance is achieved by becoming a vocal of a band in a sense of reality like a real live stage. The player can obtain a strong feeling of cheering from his fans all over the body while feeling an unprecedented sense of singing in front of a large audience. With HMD and high-power surround speakers, you can feel as if you are performing on a live stage and singing with your fans.

  Audiences around the stage respond interactively to the player's vocal performances and stage actions and interactively return flashy cheers and various actions. On the live stage as if standing on the spot by HMD, in front of the crowd in front of the crowd that fills the venue, including the fans in the front row who can see the expression, Meet the audience's expectations by singing and performing live.

  Players make reservations for the entrance time and play settings in the reception space provided in the common space, and live in a secure private room with cushioning material as shown in FIGS. 4 (A) and 4 (B). Enjoy the appearance experience.

  The player selects the concert appearance mode in the play setting before the stage appearance. After that, the song to be sung is selected and the appearance stage is selected. Then, devices such as the HMD 200 and the input devices 160-1 and 160-2 described with reference to FIGS. 2A and 2B are mounted. The store operator explains precautions and assists the device mounting and adjustment of the player. The operator calibrates (initializes) the private room space, which is the play area, in advance.

  The input device 160-1 in FIG. 2A is a microphone and game controller. In the VR space, the arm or hand of the player (virtual player) is not drawn, but the position of the input device 160-1 or the like held by the player is sensed, and a microphone image is drawn at the same position. The microphone image moves accordingly.

  The player performs vocal key adjustment in the standby room of the VR space. The standby room is a waiting space below the stage. The space where the player stands in the VR space is a large lift, and rises on the stage during the performance.

  As the lift rises and the stage approaches, the cheers and shouts of the hall that were heard from a distance gradually increase, increasing the force and changing vividly. When a player appears on the stage, a spotlight of backlighting is applied from the front toward the player, and a loud cheer occurs that has reached its peak with the appearance of the player. The performance starts with the input of the start action (for example, hand action) of the player, and the live sequence is started.

  In the live performance, players enjoy singing on stage as much as they want. 6, 7, and 8 are examples of game images (images in the VR space) displayed on the HMD 200 of the player on the stage. As shown in FIGS. 6 and 7, a full audience is projected in front of the player. FIG. 6 shows a game image when the player faces the front, and FIG. 7 shows a game image when the player faces the right. When the player turns back, a game image showing a drum, an amplifier, a screen, etc. is displayed as shown in FIG. As shown in FIG. 9, the live stage is performed in a huge concert hall surrounded by a dome DOM as in the real world. A large number of spectators are visiting the concert hall in the VR space, and the cheering of the audience is at its climax due to the vocal performance of the player. Note that lyrics and intervals are displayed on a monitor installed at the foot of the player in the VR space. If necessary, the player performs a vocal performance while viewing these lyrics and pitch indications.

  As shown in FIGS. 6, 7, and 8, in the game device according to the present embodiment using the HMD 200, the world of the VR space that is the game space extends across the entire direction of the player. For example, when the player wearing the HMD 200 turns forward, the game image of FIG. 6 is displayed on the HMD 200, and when the player turns right, the game image of FIG. 7 is displayed. Further, when facing backward, the game image of FIG. 8 is displayed. Therefore, it is possible to give the player a virtual reality feeling as if a vocal performance is being performed in a huge concert hall where many spectators cheer. Therefore, the degree of immersion of the player in the game can be significantly improved as compared with the conventional game device.

  In the present embodiment, the movement or cheering of the audience changes in accordance with the inflection of the song. In addition, the movement and cheer of the audience change according to the action of the player. For example, in FIG. 6, spectators AD1 to AD7 near the stage where the player stands are represented by polygon model objects composed of many polygons, for example. The same applies to the audiences AD8 to AD11 in FIG. On the other hand, the audience at a position far from the stage is represented by an image drawn on a billboard polygon facing the player's line of sight.

  The movement of the polygon model audience (AD1 to AD11) is expressed by, for example, motion reproduction using motion data. These spectators perform basic actions (basic motion) according to the rhythm of the song. In the audience action, there is a stage for expressing the degree of excitement in the song. This stage basically goes up and down depending on the inflection of the song. In addition, the stage may be raised by the better evaluation of the player's performance.

  The audience reacts interactively according to the voice and movement of the player. For example, when a player performs an action such as “singing in a specific direction” or “waving his hand”, the tension of the audience in that direction increases, and the basic action becomes one stage, flashy or Suddenly exciting action that has nothing to do with rhythm.

  There are two evaluation processes for evaluating the game play of the player on the stage. The first evaluation process is an evaluation process as to how much performance that can excite a specific audience can be achieved. In other words, how enthusiastic the specific audience was. The second evaluation process is an evaluation process as to whether or not the player has successfully sung a song.

  The evaluation system based on the first evaluation process is a main evaluation system that can obtain feedback from the audience during the play of the player. In this evaluation system, the audience who performs some appealing action toward the player is targeted. For example, in FIG. 6, the spectator AD4 raises his right hand to perform an appealing action to the player, and this spectator AD4 is the target. In FIG. 7, the audience AD10 who is performing an appealing action is the target. In addition, you may make it target several spectators who form a crowd. For example, in FIG. 7, audiences AD3, AD4, and AD5 may be targets.

  When the player performs the first and second actions described below on the appealing audiences, the value of the thermal madness parameter (thermal madness gauge) of these spectators increases. When the enthusiasm parameter reaches the maximum value, these spectators will perform an enthusiasm action that expresses delight. This enthusiasm action is an action that is crazy regardless of the rhythm of the song.

  The first action that the player performs on the appealing audience is an action of singing with a line of sight toward the target audience. This first action is evaluated in the song part of the song part and the interlude part.

  The second action that the player performs on the appealing audience is an action (movement) in which the player raises his arm in accordance with the shout from the audience. Alternatively, in the interlude part, it is an action that the player utters in response to a call from the audience.

  Audiences that are targets of these first and second actions occur, for example, randomly in the concert hall. The number of targets in the performance of one song by the player is determined to be a predetermined number. When the enthusiasm parameter reaches the maximum value and succeeds in raising the enthusiasm for all the predetermined number of audiences as targets, the player is evaluated to the maximum, assuming that the predetermined number of targets are all cleared. For example, in the case where the number of target audiences is 10, and when the enthusiasm parameter of all these 10 audiences reaches the maximum value, it is evaluated that all targets have been cleared. In this case, the type of the last stage effect changes according to the number of target clears. For example, when all 10 targets are cleared, the most flashy effect occurs in the last stage. For example, when eight targets are cleared, a more flashy effect occurs than when five targets are cleared.

  The evaluation system based on the second evaluation process is an evaluation system based on the detection of the pitch and rhythm of the player's song, and the evaluation is performed by adding points that are not clearly shown to the player. Specifically, it is evaluated whether or not the utterance can be adapted to the rhythm. For example, when the player can speak in accordance with the designated timing of playing the bass or drum, points are added. In addition, the skill of long tone and the accuracy of rest are evaluated. Also evaluate the accuracy of the pitch. That is, the pitch of the player's song is determined, and the pitch of the song sung with the correct pitch is displayed graphically. Note that if the player's volume level is zero for a certain period of time, most of the audience will shift to a standby motion, during which time the player will not be able to earn points.

  When the performance of the player is completed and the evaluation result of the player through the live stage satisfies a certain standard, the audience asks for an encore. By responding to the encore, the player can play one more song. And at the end of the live stage, the lights become darker in the cheering that fades out, and it ends with a blackout. After that, a message such as “Thank you very much, please remove the HMD” and a guide voice are played. Then, the player removes the equipment and leaves the private room, and the game play ends.

2.4 Danger notification image As described above, according to the game device of the present embodiment, it is possible to give the player a virtual reality as if it was played live in front of an enthusiastic audience in a real live hall. it can. As shown in FIGS. 6 and 7, an audience enthusiastic about the player's performance is displayed in front of the player's eyes, so that the excited player may move toward the audience in the VR space. .

  For example, FIG. 10 is a diagram showing a state where the stage SG where the player PL stands in the VR space is seen from above. Note that the player PL in FIG. 10 is actually a virtual player in the VR space. However, in the present embodiment, the player in the real world and the virtual player are represented by the same symbol PL for the sake of simplicity of explanation.

  The stage SG is divided by the boundary BDS, and spectators acting as shown in FIGS. 6 and 7 are arranged in the audience seats SE1, SE2, and SE3 around the stage SG. The boundary BDS of the stage SG corresponds to, for example, the boundary BD of the area AR of the real-world play area shown in FIG. As an example, the boundary BDS of the stage SG in the VR space is set at a position corresponding to, for example, a predetermined distance from the boundary BD of the real world area AR in FIG.

  Then, the player PL standing on the stage SG in FIG. 10 performs a live performance surrounded by spectators (AD1 to AD11) as shown in FIGS. Therefore, as shown in FIG. 11, the player PL excited to see the enthusiastic spectators as shown in FIG. 6 moves to the outside of the stage SG as shown in FIG.

  If such a situation occurs, in the real world of FIG. 4A, the player PL may collide with the wall 301 of the room, etc., which is not desirable in terms of safety.

  Therefore, in the present embodiment, in order to avoid such a situation, a technique for displaying a danger notification image is employed. Specifically, a situation in which the player hits an obstacle such as a wall by switching whether to display a game image in the game space or a danger notification image in the model space according to the position of the player. Is effectively suppressed.

  Specifically, in FIG. 12A, it is assumed that the approach (or arrival) of the player PL to the boundary BD of the area AR set in the play area (or in the game apparatus housing) is detected. For example, when the player PL is located within a distance LB from the boundary BD of the area AR, it is determined that the player PL has approached the boundary BD. In this case, a process of switching from the game image in the game space to the danger notification image in the model space is performed. That is, the image displayed on the HMD 200 is switched from the game image to the danger notification image. Alternatively, as shown in FIG. 12B, when the movement of the player PL that exceeds the boundary BD of the area AR is detected, a process of switching from the game image in the game space to the danger notification image in the model space is performed. May be.

  FIG. 13 shows an example of the model space. This model space is set based on the model information of the play area. For example, it is set by spatial information including model information of the play area. Specifically, the spatial information of the model space shown in FIG. 13 is spatial information including the model information of the play area described with reference to FIGS. 4 (A) and 4 (B). The model space may be a space set based on the model information of the game apparatus housing 320 described with reference to FIG.

  For example, the game space is a space for generating the game images of FIG. 6, FIG. 7, and FIG. This game space is an object space in which a plurality of objects representing spectators (characters in a broad sense) appearing in the game, spectator seats, musical instruments such as stages, amplifiers, drums, or band members are arranged. 6, 7, and 8 are images that can be seen from the viewpoint of the virtual player, for example, in the game space that is the object space.

  On the other hand, the model space of FIG. 13 is a space prepared for generating a danger notification image, and is set based on the model information of the play area described in FIGS. 4 (A) and 4 (B). . For example, in FIG. 13, the model of the walls 301, 302, and 303 is a model (or simplified) that imitates the shape, color, material, and the like of the walls 301, 302, and 303 in the real world play area shown in FIG. Model) and is composed of CG three-dimensional objects. The door 306 and the station 280 are also models (simplified models) simulating the shape, color, material, and the like of the door 306 and the station 280 in the real-world play area shown in FIG. The danger notification image is an image that can be seen from a given viewpoint in such a model space. For example, similarly to the game image, an image that is visible from the viewpoint of the virtual player in the model space is generated as the danger notification image. When the model space is set based on the model information of the game apparatus housing 320 in FIG. 5, the shape, color, material, etc. of each member (device, equipment, sheet, etc.) inside the game apparatus housing 320 And a model composed of CG three-dimensional objects is prepared. Then, the model space may be set using the model information of the model.

  FIG. 14 shows an example of the danger notification image. The danger notification image in FIG. 14 is a danger notification image that is switched from the game image when the player PL approaches (or reaches) the boundary BD of the area AR of the play area, for example, as shown in FIG. For example, it is assumed that the player PL approaches the boundary BD of the area AR as shown in FIG. 12A in a state where a game image in which a spectator is projected is displayed in front of the player as shown in FIG. This corresponds to the case where the player PL (virtual player) singing on the stage SG in the VR space of FIG. 10 is excited by the audience's enthusiasm and moves toward the audience seat SE2 as shown in FIG. .

  In this case, in the present embodiment, the normal game image is switched to the danger notification image as shown in FIG. Then, the image viewed by the player PL is switched from the game image shown in FIG. 6 to the danger notification image shown in FIG.

  Thus, the player can visually recognize with certainty that the player is approaching the wall 301 of the private room shown in FIG. Therefore, it is possible to reliably notify the player of the danger, and it is possible to realize an appropriate danger notification in the game using the HMD 200.

  In FIG. 14, guidance information display processing for guiding the movement of the player when the game image is switched to the danger notification image is also performed. For example, in FIG. 14, guidance information ALMD “Dangerous. Return to the original position” is displayed. This guidance information ALMD is displayed superimposed on the danger notification image.

  For example, when the player PL approaches the boundary BD of the area AR as shown in FIG. 12A, what happens when the game image as shown in FIG. 6 is suddenly switched to the danger notification image shown in FIG. May not be recognized, and the player may be confused. That is, if the image of the wall 301 is suddenly projected in front of the player's eyes, there is a risk of confusion.

  In this regard, if the guidance information ALMD as shown in FIG. 14 is displayed, it can be easily understood that the player is about to hit the wall 301. Since this guidance information is displayed with the text “return to the original position”, it is possible to effectively guide the player in a direction different from the boundary direction, for example. Therefore, it is possible to suppress the occurrence of the player's confusion and the like while avoiding the danger of hitting the wall 301, and to realize more appropriate danger notification.

  FIG. 15 is another example of the danger notification image. In FIG. 15, when the game image is switched to the danger notification image, the display process of the avatar AVA for guiding the player's movement is performed. For example, in FIG. 15, an avatar AVA displays a conversation “Dangerous. The image of this avatar AVA and its conversation display (speech balloon) is displayed superimposed on the danger notification image.

  If the avatar AVA as shown in FIG. 15 is displayed and the player is guided using the avatar AVA, the player can be effectively guided in a direction side (back side) different from the boundary direction. Accordingly, it is possible to avoid the danger of hitting the wall 301 and guide the player in a safe direction, so that more appropriate danger notification can be realized.

  Further, in the present embodiment, when the approach (or arrival) of the player PL to the boundary BD of the area AR is detected as shown in FIG. 12A, a game in which a danger notification object OBW is displayed as shown in FIG. An image may be displayed. When the movement of the player PL exceeding the boundary BD of the area AR is detected as shown in FIG. 12B, for example, the danger in the model space as shown in FIGS. 14 and 15 from the game image of FIG. Switch to the notification image.

  In FIG. 16, a danger notification object OBW, which is a wire frame wall object (mesh-like object), is displayed superimposed on the game image. By displaying such a danger notification object OBW, it can be expected that the player gives up moving in the DR1 direction in FIG. 12A and moves in the direction opposite to the DR1 direction, for example. become. Further, since the danger notification object OBW has a mesh shape, the player can still see the image of the spectator and the like, and can prevent the sense of immersion in the game from being hindered due to the danger notification.

  However, if the player is excited by the live performance, there may be a situation in which the player does not stop moving in the DR1 direction even when such a danger notification object OBW is displayed in a superimposed manner.

  At this time, in this embodiment, when the movement of the player PL beyond the boundary BD of the area AR is detected as shown in FIG. 12B, the danger notification as shown in FIGS. Switch to the image. By displaying the danger notification images as shown in FIGS. 14 and 15, the player can visually recognize the wall 301 in front of the eyes reliably. Therefore, the player stops moving toward the DR1 direction, which is the boundary direction, and can reliably prevent a situation where the player hits the wall 301.

  Then, after switching from such a game image to a danger notification image, it is detected that the player PL has returned to the DR2 direction, which is the inner side of the boundary BD of the area AR, as shown in FIG. This time, the danger notification image is switched to the game image.

  In this way, the game image temporarily switches from the game image to the danger notification image shown in FIGS. 14 and 15 due to the movement beyond the boundary BD. However, as shown in FIG. If it turns back in a direction, it will return to a game image from a danger notification image. For this reason, after the danger notification image is displayed for a moment, the display returns to the display of the normal game image, so that it is possible to minimize the obstacles to the player's game play.

  As described above, according to the present embodiment, the game image is detected when the approach or arrival of the player to the boundary of the area set as the movement range of the player is detected or the movement beyond the boundary is detected. To the danger notification image. As a result, for example, when an obstacle or the like exists in a direction corresponding to the boundary direction in the real-world play area or the game apparatus housing, the player can more reliably avoid hitting the obstacle or the like. . As a result, it is possible to provide a game device that can realize more appropriate danger notification in a game using a head-mounted display device.

  Further, for example, instead of displaying the danger notification image of FIGS. 14 and 15, a method of switching from the display of the game image to a display in which the entire screen is completely white can be considered.

  However, when such a display with the entire screen being completely white is performed, the player may lose sight of his / her position and direction. That is, a player whose eyes are covered with the HMD 200 has no display object serving as a reference for recognizing his / her position and direction when the entire field of view is completely white. Lose sight.

  On the other hand, in the danger notification images as shown in FIGS. 14 and 15, an image of a display object such as the wall 301 constituting the private room of the play area is displayed. Therefore, by using the position of the display object as a reference, the player does not have to lose sight of his / her position and direction. Also, as shown in FIG. 12C, when the player returns to the original standing position, the danger notification image is switched to the normal game image, so that there is an advantage that the degree of immersion of the player in the game does not decrease so much.

  Further, according to the present embodiment, the setting of the viewpoint in the model space for generating the danger notification image can be set to be different from the viewpoint in the game space for generating the game image.

  For example, when generating a normal game image, as shown in FIG. 17A, the virtual camera VC, which is the viewpoint for generating the game image, is located at the position corresponding to the viewpoint of the player PL in the real world. Set to For example, the virtual camera VC is disposed at the viewpoint position of the player PL, and the direction in which the virtual camera VC faces is set to the line-of-sight direction of the player PL.

  On the other hand, when the danger notification image is generated, in FIG. 17B, the virtual camera VC that is the viewpoint for generating the danger notification image is set at a position different from the viewpoint of the player PL in the real world. Yes. For example, in FIG. 17B, a virtual camera VC is set behind and above the player PL. In this way, it is possible to display a danger notification image as if looking down at the player PL. For example, as shown in FIG. 13, a danger notification image is displayed such that many members such as the walls 301, 302, and 303, the door 306, and the station 280 in the private room enter the player's field of view. In this way, the player can avoid losing sight of his / her position and direction by grasping the positional relationship of these members.

  At this time, unlike the case of a normal first person viewpoint game image, the character corresponding to the virtual player may also be displayed in the danger notification image. That is, a three-dimensional model object of a character formed by a model imitating the player PL is arranged at a position corresponding to the position of the player PL in the model space. In this way, the player can accurately grasp the positional relationship between the character imitating himself and the members such as the walls 301, 302, 303, the door 306, and the station 280. Therefore, it is possible to more reliably avoid the situation where the player loses his or her position or direction when displaying the danger notification image.

  In the present embodiment, it is desirable to seamlessly switch the image between the game image and the danger notification image. For example, as shown in FIG. 18A, switching between the game image IMGM and the danger notification image IMDG is seamlessly switched by, for example, fade-in / fade-out processing. For example, when switching from the game image IMGM to the danger notification image IMDG, the danger notification image IMDG is faded in while the game image IMGM is faded out. On the other hand, when switching from the danger notification image IMDG to the game image IMGM, a fade-in process of the game image IMGM is performed while performing a fade-out process of the danger notification image IMDG.

  Such seamless image switching can be realized by various methods. For example, seamless image switching can be realized by translucent composition. For example, α value of the game image in the semi-transparent composition is α, and α value of the danger notification image is β. α = 1 and β = 1 mean that the game image and the danger notification image are opaque, respectively. α = 0 and β = 0 mean that the game image and the danger notification image are transparent, respectively. For example, the relationship β = 1−α is established. When switching from the game image to the danger notification image, α is gradually changed from 1 to 0, the game image is changed from opaque to transparent, and β is gradually changed from 0 to 1, so that the danger notification is performed. The image may be changed from transparent to opaque. On the other hand, when switching from the danger notification image to the game image, β may be gradually changed from 1 to 0 and α may be gradually changed from 0 to 1. In this way, seamless image switching using translucent composition can be realized. Alternatively, seamless image switching may be realized by generating a mosaic image in which the game image and the danger notification image are mixed as an intermediate image when switching between the game image and the danger notification image. Alternatively, seamless image switching may be realized by a method such as wipe-in and wipe-out.

  Thus, if the game image is seamlessly switched to the danger notification image, the image displayed in the player's field of view is suddenly switched from the game image to the danger notification image, and the player is confused, or the player's game It is possible to avoid situations such as the immersive degree being extremely lowered.

  In the present embodiment, the switching control from the game image to the danger notification image may be performed based on the moving speed of the player. For example, as shown in FIG. 18B, the moving speed VS of the player PL is detected, and the switching timing from the game image IMGM to the danger notification image IMDG is controlled based on the moving speed VS of the player PL. For example, when the moving speed VS of the player is fast, switching from the game image IMGM to the danger notification image IMDG is performed at an earlier timing. For example, in FIG. 18B, when the player PL is located within the range of the distance LB from the boundary BD, the game image IMGM is switched to the danger notification image IMDG. In this case, when the moving speed VS of the player PL is fast, the distance LB is made longer than when the moving speed VS is slow. For example, when the moving speed VS of the player PL is high, a situation in which the danger notification by the danger notification images as shown in FIGS. In this regard, for example, as the moving speed VS increases, the occurrence of such a situation can be suppressed by increasing the distance LB in FIG.

  In FIG. 18C, the game image IMGM is switched to the danger notification image IMDG by detecting the movement of the player PL beyond the boundary BD of the area AR. This switching timing is also controlled based on the moving speed VS of the player PL. For example, when the moving speed VS of the player is fast, the game image IMGM in FIG. 18C is switched to the danger notification image IMDG at an earlier timing. By doing in this way, the situation where the player PL hits a wall or the like can be more effectively suppressed.

  In the present embodiment, the danger notification image may be superimposed on the game image, and the display size of the danger notification image on the game image may be changed. For example, in FIG. 19A, the danger notification image IMDG is superimposed and displayed on the game image IMGM. For example, in FIG. 19A, a danger notification image IMDG having a small display size is superimposed and displayed at the right corner of the screen.

  Then, at the time of image switching, processing for increasing the display size of the danger notification image IMDG on the game image IMGM is performed. As shown in FIG. 19B, the danger notification image IMDG is finally displayed on the entire screen. In FIG. 19B, for example, the game image IMGM having a small display size may be superimposed and displayed at a place where the corner of the screen of the danger notification image IMDG is not conspicuous.

  By performing such display size control processing, it is possible to obtain the same effect as the seamless image switching processing of FIG.

  Various methods can be adopted as a method for generating the danger notification image in the model space. For example, the danger notification image may be generated by a wire frame model composed of a single color such as white as shown in FIG. For example, a wire frame model is used as a model of a play area or a game apparatus housing. A model space set based on the model information of the wire frame model is prepared. Then, an image that can be seen from a given viewpoint in the model space of the wire frame model is generated as a danger notification image.

  In the present embodiment, when the game image is switched to the danger notification image, a process of vibrating the vibrating device 164 or a process of outputting a warning sound may be performed.

  For example, when the approach (or arrival) of the player PL to the boundary BD of the area AR is detected as shown in FIG. 12A, as shown in FIG. 20, for example, the vibration device provided in the input device 160-2 164 is vibrated to generate a vibration for warning. For example, a warning sound is output using the headphones 270. By doing so, when the approach (or arrival) of the player PL to the boundary BD is detected as shown in FIG. 12A, a danger notification image as shown in FIGS. 14 and 15 is displayed, Generation of warning vibrations and output of warning sounds are performed, and more effective danger notification can be realized.

  Alternatively, when the movement of the player PL exceeding the boundary BD of the area AR is detected as shown in FIG. 12B, for example, as shown in FIG. 20, the vibration device 164 provided in the input device 160-2 is vibrated. Thus, a warning vibration may be generated or a warning sound may be output using the headphones 270. In this way, in the case of FIG. 12 (B), the danger notification image is displayed, the generation of warning vibration and the output of warning sound are performed, and more effective danger notification can be realized.

2.5 First and Second Game Processing Next, game processing according to this embodiment suitable for the game described with reference to FIGS. 6 to 8 will be described. In the present embodiment, two game processes, a first game process using the input information of the input device 160 and a second game process using the line-of-sight information, are performed. Based on the results of these two game processes, A method for evaluating game results is used.

  Specifically, in the present embodiment, as shown in FIG. 21A, the line-of-sight information of the player wearing the HMD 200 and the input information input by the player using the input device 160 are acquired. For example, the input processing unit 102 in FIG. 1 acquires line-of-sight information and input information of the input device 160. The line-of-sight information is information representing the line-of-sight direction of the player, and can be acquired by the tracking processing described above. For example, the line-of-sight information of the player can be specified by obtaining the direction information of the HMD 200 by tracking processing. The input information of the input device 160 is, for example, performance information (vocal performance, musical instrument performance) input by a player's performance.

  In this embodiment, as shown in FIG. 21A, based on input information from the input device 160 (for example, audio information detected by a microphone), a first game for the player to play the first game is performed. Perform game processing. Further, based on the line-of-sight information indicating the player's line-of-sight direction, the second game process for the player to play the second game is performed. Based on the result of the first game process and the result of the second game process, the game result of the player is calculated. For example, based on the evaluation results of the player's game play in the first and second game processes, the game results (total or final game result) of the player as a whole are calculated.

  In this case, the first game is a music game in which game processing is performed based on player performance information that is input information, for example. For example, in the case of a music game that the player sings, the performance information that is input information is audio information of the player's song. In the case of a music game in which the player plays an instrument, the performance information that is input information is instrument sound information generated by an instrument played by the player (or an apparatus that simulates an instrument).

  On the other hand, the second game is a game in which game processing is performed based on line-of-sight relationship information representing the relationship between the player's line of sight and the target. For example, the second game is a game in which the game play of the player is evaluated by performing a game play that matches the player's line of sight (gaze direction) with the target. Specifically, in the second game, game processing is performed based on line-of-sight relationship information representing the relationship between the player's line of sight and the target audience.

  For example, in FIG. 21B, the audience ADB is the target among the audiences ADA, ADB, and ADC. In this case, game processing is performed based on the line-of-sight information between the line of sight VLP of the player PL wearing the HMD and the target audience ADB, and the game play of the player is evaluated. Specifically, when the player PL points the line of sight VLP toward the target ADB, the player's evaluation of game play becomes high.

  Taking the above-described game of FIG. 6 as an example, the audience AD4 appealing to the player becomes the target for the player to look at. When the player sings with the line of sight toward the target audience AD4, the player's evaluation of game play becomes high.

  In this embodiment, as shown in FIG. 22A, a first evaluation process for evaluating the game play of the player in the first game and a second evaluation for evaluating the game play of the player in the second game are performed. The evaluation process is performed. Based on the result of the first evaluation process and the result of the second evaluation process, the player's game score (for example, overall or final game score) is calculated.

  That is, in the first game in which game processing is performed based on input information such as performance information from the input device 160, first evaluation processing for evaluating the game play of the player is performed. For example, in a first game that is a music game, an evaluation process for the performance of the player is performed.

  In the second game in which the game process is performed based on the player's line-of-sight information, a second evaluation process for evaluating the game play of the player is performed. For example, as shown in FIG. 21B, the player PL plays a second game in which the line of sight VLP is aligned with the target audience ADB, and a second evaluation process is performed to evaluate the game play. For example, when a vocal performance or the like is performed with the line of sight toward the audience ADB, the game play of the player is evaluated, and the evaluation of the game play of the player in the second evaluation process is increased.

  Based on the result of the first evaluation process and the result of the second evaluation process, the game result of the player is calculated. For example, the result of the first evaluation process and the result of the second evaluation process are comprehensively determined, and for example, the final game score (point, score, etc.) of the player is calculated.

  More specifically, as shown in FIG. 22B, in the second evaluation process, the line-of-sight relationship information indicating the relationship between the player's line of sight and the target, and the input status of the player's input information in the first game Based on the above, the player's game play is evaluated in the second game.

  For example, in FIG. 21B, when the player PL is in the state where the line of sight VLP is directed toward the target audience ADB, the performance information as the player input information is input. The evaluation of the game play of the player in the game of 2 is made high. For example, when it is determined that the player PL is singing with the line of sight VLP directed toward the audience ADB, the player's evaluation of the game play in the second game is highly evaluated.

  As shown in FIG. 22C, in the second evaluation process, the player's game in the second game is based on the line-of-sight relationship information indicating the relationship between the player's line of sight and the target and the player's movement information. You may evaluate play.

  For example, in FIG. 21B, when a predetermined action (action) of the player is detected from the motion information in a state where the player PL points the line of sight VLP toward the target audience ADB, The evaluation of the game play of the player in the game of 2 is made high. For example, when it is determined that the player PL is performing a predetermined action with the line of sight VLP directed toward the audience ADB, the evaluation of the player's game play in the second game is highly evaluated. Specifically, the player in the second game when it is determined that the player PL is performing a predetermined action such as raising the arm in accordance with the call from the audience ADB or the movement of the audience ADB. Make the gameplay rating high. The movement information of the player PL can be acquired by detecting the position and direction of the input device 160 (160-1 or 160-2) in FIG.

  Further, in the present embodiment, processing for changing the value of a parameter set as the target of the line of sight of the player is performed based on the game play result of the player in the second game. Then, the result of the second evaluation process is obtained based on at least one of the parameter value and the number of targets for which the parameter has reached a given value.

  For example, in FIG. 23A, the value of the target thermal madness parameter of the line of sight VLP of the player PL is changed based on the game play result of the player PL in the second game. Specifically, in FIG. 23A, the player PL performs a vocal performance with the line of sight VLP toward the spectator ADB, so the enthusiastic parameter of the spectator ADB is increased. When the enthusiastic parameter of the audience ADB reaches the maximum value (given value in a broad sense), the audience ADB is in a target clear state.

  In FIG. 23B, the player PL performs a vocal performance with the line of sight VLP toward the spectator ADA, so the madness parameter of the spectator ADA is increased. When the madness parameter of the audience ADA reaches the maximum value, the audience ADA is also in a target clear state.

  In FIG. 23C, the player PL performs a vocal performance with the line of sight VLP toward the spectator ADC, so the madness parameter of the spectator ADC is increased. When the madness parameter of the audience ADC reaches the maximum value, the audience ADC is also in a target clear state.

  Then, for all spectators ADA, ADB, and ADC in this way, when the target is cleared (reaching the maximum value), all targets are cleared, and the highest evaluation (evaluation point) is given to the player PL. On the other hand, when the number of target clears is two, the evaluation given to the player PL is lower than that for all target clears. Similarly, when the number of target clears is one, the evaluation given to the player PL is lower than when the number of target clears is two.

  In this way, in FIGS. 23A to 23C, the player's second parameter is based on the number of targets for which the thermal madness parameter (parameter in a broad sense) has reached the maximum value (given value). The result of the evaluation process is required. Note that the result of the second evaluation process may be obtained not by the number of targets that have reached such a maximum value (given value) but by the value of the target (audience) parameter itself.

  In the first evaluation process of FIG. 22A, the player's game play in the first game is evaluated based on at least one of the pitch and rhythm specified based on the player's performance information as input information. . For example, the player's game play in the first game is evaluated in the same manner as a karaoke scoring game.

  For example, in the game described with reference to FIGS. 6 to 8, as shown in FIG. 24 (A), lyrics and song pitches are displayed on the player. This pitch display is for the player to visually grasp the pitch that serves as a reference (example) for the evaluation process. In addition, this pitch display allows the player to grasp the rhythm that serves as a reference (example) for the evaluation process.

  Then, when the player performs a vocal performance, a comparison process with the pitch and rhythm reference data as shown in FIG. 24B is performed. That is, processing for extracting pitch and rhythm data of the player's song from the player's vocal performance information is performed. Then, the player's game play (vocal performance) in the first game (music game) is evaluated by comparing the extracted pitch and rhythm data of the player with the reference data of the pitch and rhythm. Do. In this way, it is possible to appropriately evaluate the skill of the player's song. It should be noted that in addition to the pitch and rhythm reference data, volume reference data is prepared as shown in FIG. 24B, and the skill (inflection) of the player's vocal volume control is evaluated. Good.

2.6 Processing Example Next, a processing example of this embodiment will be described with reference to the flowcharts of FIGS. 25 and 26.

  FIG. 25 is a flowchart of a process for switching between a game image and a danger notification image when detecting the approach (or arrival) of a player to an area boundary.

  First, the position information of the player who moves while wearing the HMD is acquired (step S1). This position information can be acquired by the tracking process described above.

  Next, a game image based on the game space information is generated (step S2). For example, game images as shown in FIGS. 6 to 8 are generated. Further, a danger notification image based on the model information is generated (step S3). For example, a danger notification image as shown in FIGS. 14 and 15 is generated.

  Next, based on the position information acquired in step S1, it is determined whether or not the approach (or arrival) of the player to the boundary of the area is detected (step S4). And when approach (or arrival) is detected, the switching process from a game image to a danger notification image is performed (step S5). That is, the image switching process described with reference to FIG.

  Next, it is determined whether or not the player has returned to the inner side of the boundary (step S6). And when it returns, the switching process from a danger notification image to a game image is performed (step S7). That is, the image switching process described with reference to FIG.

  FIG. 26 is a flowchart of the switching process between the game image and the danger notification image when the movement of the player beyond the boundary of the area is detected. The processes in steps S11 to S13 in FIG. 26 are the same as the processes in steps S1 to S3 in FIG.

  If it is detected in step S14 in FIG. 26 that the player has moved beyond the boundary of the area, a process for switching from the game image to the danger notification image is performed (step S15). That is, the image switching process described with reference to FIG.

  Next, it is determined whether or not the player has returned to the inner side of the boundary (step S16). And when returning, the switching process from a danger notification image to a game image is performed (step S17). That is, the image switching process described with reference to FIG.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term described at least once together with a different term having a broader meaning or the same meaning in the specification or the drawings can be replaced with the different term in any part of the specification or the drawings. Further, the position information and line-of-sight information acquisition processing, game processing, image switching processing, game image generation processing, danger notification image generation processing, and the like are not limited to those described in the present embodiment, and are equivalent to these. Techniques and processing are also included in the scope of the present invention. The present invention can be applied to various games. Further, the present invention can be applied to various game devices such as a business game device, a home game device, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, a system board for generating a game image, and a mobile phone. . For example, the game device may be a mobile phone or a portable information terminal in which a game program is installed and executed.

PL player, AR area, BD boundary,
IMGM game image, IMDG danger notification image, OBW danger notification object,
100 processing units, 102 input processing units, 110 arithmetic processing units, 111 game processing units,
112 game progress processing unit, 113 evaluation processing unit, 114 character processing unit,
115 parameter processing unit, 116 object space setting unit,
117 virtual camera control unit, 118 game result calculation unit, 120 display processing unit,
130 sound processing unit, 150 imaging unit, 151, 152 camera,
160 (160-1, 160-2) input device, 161 performance information input device,
162 microphone, 170 storage unit, 172 spatial information storage unit, 174 music information storage unit,
176 parameter storage unit, 178 drawing buffer, 180 information storage medium,
192 sound output unit, 194 I / F unit, 195 portable information storage medium, 196 communication unit,
200 HMD (head-mounted display device), 201-203 light receiving element, 210 sensor unit,
220 display unit, 231 to 236 light emitting element, 240 processing unit, 260 headband,
270 headphones, 280, 284 stations,
281, 282, 285, 286 Light emitting element,
301-304 Wall, 306 Door, 307, 308 Ventilation equipment,
310, 312 caster, 320 game machine housing

Claims (12)

An input processing unit that wears a head-mounted display device and acquires position information of a player who moves in a real-world play area or game device housing;
A game processing unit for processing a game played by a player in a virtual game space in which a plurality of objects are arranged;
A display processing unit that performs processing for displaying a game image seen from a given viewpoint in the game space on the head-mounted display device;
Including
The game processing unit
Which of the game image in the game space, the model information of the play area or the danger notification image in the model space set based on the model information of the game apparatus housing is displayed, the play area or the A game device that performs a process of switching according to a position of a player in a game device housing. In claim 1,
The model information of the play area is model information including at least shape information of the play area, and the model information of the game apparatus housing is model information including at least shape information of the game apparatus housing. A game device characterized by the above. In claim 1 or 2,
The game processing unit
A game characterized in that the viewpoint position or line-of-sight direction of the viewpoint in the model space for generating the danger notification image is set to a viewpoint position or line-of-sight direction different from the viewpoint in the game space for generating the game image. apparatus. In any one of Claims 1 thru | or 3,
The game processing unit
When the player's approach or arrival to the boundary of the area set as the player's movement range in the play area or the game device casing is detected, or when the player's movement beyond the boundary is detected, A game apparatus that performs a switching process from the game image to the danger notification image. In claim 4,
The display processing unit
A game device that performs processing for displaying the game image in which an image of a spectator is displayed in a place corresponding to the outside of the area on the head-mounted display device. In any one of Claims 1 thru | or 5,
The display processing unit
A game apparatus that performs a display process of guidance information for guiding a player to move when the danger image is switched from the game image. In any one of Claims 1 thru | or 6.
The display processing unit
An avatar display process for guiding a player's movement when the game image is switched to the danger notification image. In any one of Claims 1 thru | or 7,
The display processing unit
A game device characterized by performing a process of seamlessly switching an image between the game image and the danger notification image. In any one of Claims 1 thru | or 8.
The display processing unit
A game apparatus characterized by superimposing and displaying the danger notification image on the game image and changing a display size of the danger notification image on the game image. In any one of Claims 1 thru | or 9,
The game processing unit
A game apparatus, wherein switching control from the game image to the danger notification image is performed based on a moving speed of a player. In any one of Claims 1 thru | or 10.
The game processing unit
A game apparatus that performs a process of vibrating a vibration device or a process of outputting a warning sound when the game image is switched to the danger notification image. An input processing unit that wears a head-mounted display device and acquires position information of a player who moves in a real-world play area or game device housing;
A game processing unit for processing a game played by a player in a virtual game space in which a plurality of objects are arranged;
As a display processing unit that performs processing for displaying a game image seen from a given viewpoint in the game space on the head-mounted display device,
Make the computer work,
The game processing unit
Which of the game image in the game space, the model information of the play area or the danger notification image in the model space set based on the model information of the game apparatus housing is displayed, the play area or the A program characterized by performing a process of switching according to a position of a player in a game apparatus housing.

Images