JP2018171319A - Simulation system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a simulation system, a program, etc., capable of enhancing virtual reality by effectively using a gas shooting part in a system using a head-mounted type display device.SOLUTION: A simulation system includes: an information acquisition part for acquiring user information including at least one of position information, direction information and posture information of a user mounting an HMD so as to cover a visual field; a virtual space setting part for executing virtual space setting processing; a game processing part for executing game processing in the virtual space; a control part for executing control of a shooting part 50 capable of shooting gas to the user; and a display processing part for generating a display image of the HMD mounted by the user. A plurality of shooting devices CN1-CN18 are disposed in the shooting part. The control part executes processing to control the shooting part 50 according to game situation in the virtual space and the user information.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a simulation system and a program.

  2. Description of the Related Art Conventionally, there is a simulation system that allows a user to experience a so-called virtual reality (VR) world by wearing an HMD (head-mounted display device) on the head and viewing the image displayed on the screen of the HMD. Are known. As a prior art of such a simulation system, there is a technique disclosed in, for example, Patent Document 1.

JP-A-11-309269

  In the simulation system using the HMD, the user's field of view is covered with the HMD, and the field of view is blocked from the outside. On the other hand, an image of the virtual space (VR space) is displayed on the HMD, but the virtual reality of the user cannot be enhanced by the virtual space alone. For this reason, it is desirable to use a sensation apparatus that can enhance the virtual reality of the user.

  However, in the case of providing such a bodily sensation apparatus, it is necessary to consider hygiene, management, safety, and the like. Further, if the scale of the sensation device becomes too large, it is not realistic and there is a problem in terms of cost.

  According to some aspects of the present invention, in a system using a head-mounted display device, it is possible to provide a simulation system, a program, and the like that can effectively improve a virtual reality by effectively using a gas emission unit.

  One embodiment of the present invention includes an information acquisition unit that acquires user information including at least one of position information, direction information, and posture information of a user who wears a head-mounted display device so as to cover the field of view, A virtual space setting unit that performs setting processing, a game processing unit that performs game processing in the virtual space, a control unit that controls a launching unit that can emit gas to the user, and the user wearing A display processing unit that generates a display image of the head-mounted display device, wherein the launching unit includes a plurality of launching devices, and the control unit is configured to control the game situation in the virtual space and the The present invention relates to a simulation system that performs control processing of the launching unit according to user information. The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

  According to an aspect of the present invention, user information including at least one of user position information, direction information, and posture information is acquired. In addition, a virtual space setting process is performed, a game process is performed in the virtual space, a display image of the head-mounted display device worn by the user is generated, and the head-mounted display device is mounted The launcher capable of gas emission is controlled for the user who performs the operation. A plurality of launching devices are arranged in the launching unit, and control processing of the launching unit in which the plurality of launching devices are arranged in this way is performed according to the game situation and user information in the virtual space. In this way, for a user who wears a head-mounted display device so as to cover the field of view, gas is emitted by the plurality of emission devices of the emission unit so as to correspond to the game situation and user information in the virtual space. become able to. Therefore, for example, the user can be given a tactile sensation due to the gas from the launching unit hitting the body or the like so as to be linked to the image displayed on the head-mounted display device. Further, for example, it is possible to realize gas emission control of an appropriate emission unit according to the position, direction, or posture of the user. Thereby, in a system using a head-mounted display device, it is possible to provide a simulation system or the like that can effectively improve the virtual reality by effectively using the gas emission unit.

  In the aspect of the invention, the launching unit may include a plurality of the launching devices arranged in a matrix, and the control unit may perform control processing of the plurality of launching devices arranged in a matrix. .

  In this way, using a plurality of launchers arranged in a matrix, various launch controls such as launching gas at the same time with multiple launchers, or firing gas with different launch timings are realized. become able to.

  In the aspect of the invention, the control unit may be configured to select the launching device in the launching unit when the hit event that hits the hit target object corresponding to the gas occurs in the virtual space, the gas May be performed at least one of the control processing of the emission timing of the gas and the control processing of the gas emission output degree.

  In this way, when a hit event that hits the hit object corresponding to the gas occurs in the virtual space, in order to make the user effectively feel the hit event by touch, The control process and the control process of the firing output degree are performed, so that the virtual reality of the user can be improved.

  In one aspect of the present invention, the control unit is configured to select the launching device in the launching unit, the gas firing timing control process, and the gas injection timing according to the hit direction or hit vector of the hit object. You may perform at least 1 of the control processing of the gas emission output degree.

  In this way, the launch device selection process, the launch timing control process, and the launch output degree control process are performed so as to correspond to the hit direction or hit vector of the hit object. It becomes possible to make the user tactilely recognize the hit direction and the hit vector.

  In one aspect of the present invention, the plurality of launching devices include first to Nth launching devices along a first direction intersecting a vertical direction, and the control unit moves a user corresponding to the user. When the hit event in which the hit object hits the body in an oblique direction occurs, the emission is performed so that the gas is sequentially emitted from the first launching device to the Nth launching device. The unit may be controlled.

  In this way, the gas is fired sequentially from the first launching device to the Nth launching device and hits the user, so that the user has the illusion as if the hit object hits in an oblique direction. It becomes possible.

  In one aspect of the present invention, the launch unit includes a launch unit direction changing unit that changes the direction of the launch unit, and the control unit controls the launch unit direction changing unit according to the game situation. You may go.

  In this way, by controlling the launcher direction changing unit according to the game situation and changing the direction of the launcher, the gas firing direction of the launcher can be changed according to the game situation. Become.

  In one aspect of the present invention, the launching unit includes a launching device direction changing unit that changes the direction of the plurality of launching devices, and the control unit is configured to change the launching device direction changing unit according to the game situation. Control may be performed.

  In this way, by controlling the launching device direction changing unit according to the game situation and changing the direction of the launching device, the gas firing direction of the launching device can be changed according to the game situation. Become.

  In one aspect of the present invention, the virtual space setting unit may include the source object of the hit object in a hit event in which the hit object corresponding to the gas hits the virtual space. The process of arranging in the position of the virtual space corresponding to the position of may be performed.

  In this way, it becomes possible to make the position of the source object of the hit object in the virtual space correspond to the position of the launching part in the real space, and the gas emitted by the launching part hits the user It becomes possible to make the sensation by tactile sensation more appropriate.

  In one aspect of the present invention, the game processing unit may perform a game effect process in which sound, vibration, or an image is linked to the gas emission at the emission unit.

  If it does in this way, it will come to be able to perform the game production process by a sound, a vibration, or an image in connection with the bodily sensation by the tactile sensation by hitting the gas emitted by the emission part.

  In one embodiment of the present invention, the launching unit may include a processing unit that processes the gas to be fired.

  If it does in this way, it will become possible to emit the gas processed by the processing part to a user, and it will become possible to give a user various sensations by gas emission, while using the same emission part.

  In the aspect of the invention, the processing unit may perform different processing on the gas to be emitted by the first launching device and the second launching device of the plurality of launching devices.

  If it does in this way, the case where the 1st projecting device is used and the case where the 2nd projecting device is used can be emitted to the user with the gas from which the different processing was performed, and by the gas ejection A variety of experiences can be given to the user.

The block diagram which shows the structural example of the simulation system of this embodiment. FIG. 2A and FIG. 2B are examples of the HMD used in this embodiment. 3A and 3B are other examples of the HMD used in the present embodiment. The structural example of the housing of a simulation system. FIGS. 5A and 5B are configuration examples of the launching unit and launching device. Example of virtual space fields. The example of the game image produced | generated by this embodiment. The example of the game image produced | generated by this embodiment. The example of the game image produced | generated by this embodiment. The example of the game image produced | generated by this embodiment. FIG. 11A and FIG. 11B are explanatory diagrams of the control method of the launcher. FIG. 12A and FIG. 12B are explanatory diagrams of the control method of the launcher. FIG. 13A and FIG. 13B are explanatory diagrams of the control method of the launcher according to the hit direction or hit vector. Explanatory drawing of the method which discharges gas sequentially from each launching device of a some launching device. FIG. 15A and FIG. 15B are explanatory diagrams of the control method of the launcher according to the hit direction or hit vector. FIG. 16A to FIG. 16C are explanatory diagrams of an operation example of the launching unit direction changing unit. FIG. 17A to FIG. 17C are explanatory diagrams of an operation example of the launching unit direction changing unit. 18A and 18B are explanatory diagrams of an operation example of the launching device direction changing unit. FIG. 19A and FIG. 19B are explanatory diagrams of a method of arranging an enemy character that fires a bullet at a position corresponding to the position of the firing unit. 20 (A) to 20 (C) are explanatory diagrams of a method of arranging an enemy character that fires a bullet at a position corresponding to the position of the firing unit. An example of a field where a plurality of users wearing HMDs play. Explanatory drawing of the control method of the discharge part which discharges gas with respect to the user who moves a field. Explanatory drawing of the game production method which makes sound, vibration, etc. interlock | cooperate with respect to the discharge of the gas in a discharge part. Explanatory drawing of the operation example of the process part which processes the gas which a discharge part emits. Explanatory drawing of the operation example of the process part which processes the gas which a discharge part emits. The flowchart explaining the detailed process example of this embodiment.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Simulation System FIG. 1 is a block diagram showing a configuration example of a simulation system (simulator, game system) of the present embodiment. The simulation system of the present embodiment is a system that simulates virtual reality (VR), for example, a game system that provides game content, a real-time simulation system such as a sports competition simulator or a driving simulator, a system that provides an SNS service, an image The present invention can be applied to various systems such as a content providing system that provides content such as an operating system that implements remote work. Note that the simulation system of the present embodiment is not limited to the configuration shown in FIG. 1, and various modifications such as omitting some of the components (each unit) or adding other components are possible.

  The launch unit 50 is a device that can emit gas to the user. The launch unit 50 includes a plurality of launch devices CN1 to CNM. The launcher 50 includes a launcher direction changing unit 52 that changes the direction of the launcher 50 and a launcher direction changing unit 54 that changes the direction of the launchers CN1 to CNM. Moreover, the process part 56 which processes the gas injected is included.

  The operation unit 160 is for a user (player) to input various operation information (input information). The operation unit 160 can be realized by various operation devices such as an operation button, a direction instruction key, a joystick, a handle, a pedal, or a lever.

  The storage unit 170 stores various types of information. The storage unit 170 functions as a work area such as the processing unit 100 or the communication unit 196. The game program and game data necessary for executing the game program are held in the storage unit 170. The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), HDD (Hard Disk Drive), SSD, optical disk device, or the like. The storage unit 170 includes an object information storage unit 172 and a drawing buffer 178.

  The information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and its function can be realized by an optical disk (DVD, BD, CD), HDD, semiconductor memory (ROM), or the like. . The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, in the information storage medium 180, a program for causing a computer (an apparatus including an input device, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

  The HMD 200 (head-mounted display device) is a device that is mounted on the user's head and displays an image in front of the user's eyes. The HMD 200 is preferably a non-transmissive type, but may be a transmissive type. The HMD 200 may be a so-called glasses-type HMD.

  The HMD 200 includes a sensor unit 210, a display unit 220, and a processing unit 240. A modification in which a light emitting element is provided in the HMD 200 is also possible. The sensor unit 210 is for realizing tracking processing such as head tracking, for example. For example, the position and direction of the HMD 200 are specified by tracking processing using the sensor unit 210. By specifying the position and direction of the HMD 200, the user's viewpoint position and line-of-sight direction (user position and direction) can be specified.

  Various methods can be adopted as the tracking method. In the first tracking method, which is an example of the tracking method, a plurality of light receiving elements (photodiodes and the like) are provided as the sensor unit 210, as will be described in detail with reference to FIGS. 2A and 2B described later. Then, by receiving light (laser or the like) from a light emitting element (LED or the like) provided outside by the plurality of light receiving elements, the position of the HMD 200 (user's head) in the real world three-dimensional space, Identify the direction. In the second tracking method, a plurality of light emitting elements (LEDs) are provided in the HMD 200 as will be described in detail with reference to FIGS. 3A and 3B described later. And the position and direction of HMD200 are pinpointed by imaging the light from these light emitting elements with the imaging part provided outside. In the third tracking method, a motion sensor is provided as the sensor unit 210, and the position and direction of the HMD 200 are specified using this motion sensor. The motion sensor can be realized by, for example, an acceleration sensor or a gyro sensor. For example, by using a 6-axis motion sensor using a 3-axis acceleration sensor and a 3-axis gyro sensor, the position and direction of the HMD 200 in a three-dimensional space in the real world can be specified. Note that the position and direction of the HMD 200 may be specified by a combination of the first tracking method and the second tracking method, or a combination of the first tracking method and the third tracking method. Further, instead of specifying the user's viewpoint position and line-of-sight direction by specifying the position and direction of the HMD 200, a tracking process that directly specifies the user's viewpoint position and line-of-sight direction (position, direction) may be employed. .

  The display unit 220 of the HMD 200 can be realized by, for example, an organic EL display (OEL) or a liquid crystal display (LCD). For example, the display unit 220 of the HMD 200 is provided with a first display or first display area set in front of the user's left eye and a second display or second display area set in front of the right eye. 3D display is possible. When performing stereoscopic display, for example, a left-eye image and a right-eye image with different parallax are generated, the left-eye image is displayed on the first display, and the right-eye image is displayed on the second display. Alternatively, the left-eye image is displayed in the first display area of one display, and the right-eye image is displayed in the second display area. Also, the HMD 200 is provided with two eyepiece lenses (fisheye lenses) for the left eye and the right eye, thereby expressing a VR space that extends all around the user's field of view. Then, correction processing for correcting distortion generated in an optical system such as an eyepiece is performed on the left-eye image and the right-eye image. This correction process is performed by the display processing unit 120.

  The processing unit 240 of the HMD 200 performs various processes necessary for the HMD 200. For example, the processing unit 240 performs control processing of the sensor unit 210, display control processing of the display unit 220, and the like. Further, the processing unit 240 may perform a three-dimensional sound (stereoscopic sound) process to realize reproduction of a three-dimensional sound direction, distance, and spread.

  The sound output unit 192 outputs the sound generated by the present embodiment, and can be realized by, for example, a speaker or headphones.

  The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and the function can be realized by an ASIC for I / F processing or the like. The portable information storage medium 195 is for a user to save various types of information, and is a storage device that retains storage of such information even when power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

  The communication unit 196 communicates with the outside (another apparatus) via a wired or wireless network, and functions thereof are hardware such as a communication ASIC or communication processor, or communication firmware. Can be realized.

  A program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the server (host device) to the information storage medium 180 (or storage unit 170) via the network and communication unit 196. May be. Use of an information storage medium by such a server (host device) can also be included in the scope of the present invention.

  The processing unit 100 (processor) is used for operation information from the operation unit 160, tracking information in the HMD 200 (information on at least one of the position and direction of the HMD, information on at least one of the viewpoint position and the line-of-sight direction), a program, and the like. Based on this, game processing (simulation processing), virtual space setting processing, moving body processing, virtual camera control processing, display processing, sound processing, or the like is performed.

  Each processing (each function) of this embodiment performed by each unit of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the function of each unit may be realized by individual hardware, or the function of each unit may be realized by integrated hardware. For example, the processor may include hardware, and the hardware may include at least one of a circuit that processes a digital signal and a circuit that processes an analog signal. For example, the processor can be configured by one or a plurality of circuit devices (for example, ICs) mounted on a circuit board or one or a plurality of circuit elements (for example, resistors, capacitors, etc.). The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) can be used. The processor may be an ASIC hardware circuit. The processor may include an amplifier circuit, a filter circuit, and the like that process an analog signal. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD) or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and the processing (function) of each unit of the processing unit 100 is realized by executing the instructions by the processor. The instruction here may be an instruction set constituting a program, or an instruction for instructing an operation to the hardware circuit of the processor.

  The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The arithmetic processing unit 110 includes an information acquisition unit 111, a virtual space setting unit 112, a moving body processing unit 113, a virtual camera control unit 114, a game processing unit 115, a control unit 118, a display processing unit 120, and a sound processing unit 130. As described above, each process of the present embodiment executed by these units can be realized by a processor (or a processor and a memory). Various modifications such as omitting some of these components (each unit) or adding other components are possible.

  The input processing unit 102 performs processing for receiving operation information and tracking information, processing for reading information from the storage unit 170, and processing for receiving information via the communication unit 196 as input processing. For example, the input processing unit 102 stores, in the storage unit 170, processing for acquiring operation information input by the user using the operation unit 160, tracking information detected by the sensor unit 210 of the HMD 200, and the information specified by the read command. A process for reading data from a computer or a process for receiving information from an external device (such as a server) via a network is performed as an input process. Here, the reception process includes a process of instructing the communication unit 196 to receive information, a process of acquiring information received by the communication unit 196, and writing the information in the storage unit 170, and the like.

  The arithmetic processing unit 110 performs various arithmetic processes. For example, arithmetic processing such as information acquisition processing, virtual space setting processing, moving body processing, virtual camera control processing, game processing (simulation processing), control processing, display processing, or sound processing is performed.

  The information acquisition unit 111 (program module for information acquisition processing) performs various information acquisition processing. For example, the information acquisition unit 111 acquires user information (user tracking information) including at least one of user position information, direction information, and posture information.

  The virtual space setting unit 112 (program module for virtual space setting processing) performs setting processing for a virtual space (object space) in which a plurality of objects are arranged. For example, various objects representing display objects such as moving objects (people, robots, cars, trains, airplanes, ships, monsters, animals, etc.), maps (terrain), buildings, auditoriums, courses (roads), trees, walls, water surfaces, etc. A process of placing and setting an object (an object composed of a primitive surface such as a polygon, a free-form surface, or a subdivision surface) in a virtual space is performed. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects. Specifically, in the object information storage unit 172 of the storage unit 170, object information that is information such as the position, rotation angle, moving speed, and moving direction of an object (part object) in the virtual space is associated with the object number. Is remembered. The virtual space setting unit 112 performs a process of updating the object information for each frame, for example.

  The moving body processing unit 113 (moving body processing program module) performs various processes on a moving body that moves in the virtual space. For example, processing for moving the moving body in virtual space (object space, game space) and processing for moving the moving body are performed. For example, the mobile object processing unit 113 is based on operation information input by the user through the operation unit 160, acquired tracking information, a program (movement / motion algorithm), various data (motion data), and the like. Control processing for moving the model object) in the virtual space or moving the moving object (motion, animation) is performed. Specifically, a simulation for sequentially obtaining movement information (position, rotation angle, speed, or acceleration) and motion information (part object position or rotation angle) of a moving body for each frame (for example, 1/60 second). Process. A frame is a unit of time for performing a moving / movement process (simulation process) and an image generation process of a moving object. The moving body is, for example, a virtual user (virtual player, avatar) in a virtual space corresponding to a user (player) in real space, or a boarding moving body (operation moving body) on which the virtual user is boarded (operated).

  The game processing unit 115 (game processing program module) performs various game processes for the user to play a game. In other words, the game processing unit 115 (simulation processing unit) executes various simulation processes for the user to experience virtual reality (virtual reality). The game process is, for example, a process for starting a game when a game start condition is satisfied, a process for advancing the started game, a process for ending a game when a game end condition is satisfied, or calculating a game result. Processing. The game processing unit 115 includes a hit calculation processing unit 116. The hit calculation processing unit 116 executes hit calculation processing such as hit determination processing.

  The control unit 118 (control processing program module) controls the launch unit 50. Details of the control unit 118 will be described later.

  The display processing unit 120 (display processing program module) performs display processing of a game image (simulation image). For example, a drawing process is performed based on the results of various processes (game process, simulation process) performed by the processing unit 100, thereby generating an image and displaying it on the display unit 220 of the HMD 200. Specifically, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. Based on the processing result, drawing data (the position of the vertex of the primitive surface) Coordinates, texture coordinates, color data, normal vector, α value, etc.) are created. Based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is converted into image information in units of pixels such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. As a result, an image that can be seen from the virtual camera (given viewpoint, left eye and right eye first and second viewpoints) is generated in the object space (virtual space). Note that the drawing processing performed by the display processing unit 120 can be realized by vertex shader processing, pixel shader processing, or the like.

  The sound processing unit 130 (sound processing program module) performs sound processing based on the results of various processes performed by the processing unit 100. Specifically, game sounds such as music (music, BGM), sound effects, or sounds are generated, and the game sounds are output to the sound output unit 192. Note that part of the sound processing of the sound processing unit 130 (for example, three-dimensional sound processing) may be realized by the processing unit 240 of the HMD 200.

  The output processing unit 140 performs various types of information output processing. For example, the output processing unit 140 performs processing for writing information in the storage unit 170 and processing for transmitting information via the communication unit 196 as output processing. For example, the output processing unit 140 performs a process of writing information specified by a write command in the storage unit 170 or a process of transmitting information to an external apparatus (server or the like) via a network. The transmission process is a process of instructing the communication unit 196 to transmit information, or instructing the communication unit 196 to transmit information.

  The simulation system of this embodiment includes an information acquisition unit 111, a virtual space setting unit 112, a game processing unit 115, a control unit 118, and a display processing unit 120.

  The information acquisition unit 111 acquires user information including at least one of position information, direction information, and posture information of a user wearing the HMD 200 (head-mounted display device). For example, the information acquisition unit 111 acquires user information (user tracking information) including at least one of user position information, direction information, and posture information in real space based on tracking information of the HMD 200 and the like. The position information may be position information of the user's viewpoint in real space, and the direction information may be direction information of the user's line of sight in real space. When the user is located in a field (play field, simulation field, play area) in the real space (real world), the position information and direction information (the given position is used as the origin). Position coordinates in a coordinate system to be rotated, and rotation angles around each coordinate axis). Posture information is information for specifying each posture of the user (standing posture, crouching posture, sitting posture, etc.) or specifying the position and direction of each part of the user (body, head, hand, foot, etc.). is there. For example, the information acquisition unit 111 may acquire the position information and direction information of the HMD 200 as the position information and direction information of the user wearing the HMD 200.

  The virtual space setting unit 112 performs a virtual space setting process. For example, a process of setting an object such as a moving object, an obstacle, a background, or a map in the virtual space is performed. For example, when the position information and direction information of the user in real space are acquired, the position and direction of the user moving body (user character etc.) corresponding to the user are set based on the acquired position information and direction information. Then, processing for placement in the virtual space is performed. Information such as the position and direction of the user moving object that is an object is stored in the object information storage unit 172, for example. The user moving body is an object (display object) that moves in a virtual space (object space) following the movement of the user in real space, for example. Examples of the user moving body include an avatar moving body (user character, virtual user) corresponding to the user, a boarding moving body on which the avatar moving body is mounted, and an outer shell moving body worn by the avatar moving body. The outer shell moving body is arranged to overlap the avatar moving body (ghost) and moves in the virtual space. The outer shell moving body is a moving body including the avatar moving body, and is expressed as a user's body.

  The game processing unit 115 performs game processing in a virtual space. For example, a game process such as a process for starting a game, a process for advancing the game, a process for ending the game, or a process for calculating game results is performed.

  The control unit 118 controls the launch unit 50 that can emit gas to the user. For example, the control unit 118 controls the launch unit 50 itself, or controls a plurality of launch devices CN1 to CNM of the launch unit 50.

  The display processing unit 120 generates a display image based on the result of the game process. For example, a display image of the HMD 200 that the user wears so as to cover the field of view is generated. For example, an image viewed from a virtual camera in the virtual space is generated as a display image. For example, the virtual camera control unit 114 performs a virtual camera control process corresponding to the user's viewpoint. For example, the virtual camera control unit 114 controls the virtual camera set as the first-person viewpoint of the user. For example, by setting a virtual camera at a position corresponding to the viewpoint of a moving body (such as a virtual player) that moves in the virtual space, and setting the viewpoint position and line-of-sight direction of the virtual camera, the position (positional coordinates) of the virtual camera And control the attitude (rotation angle around the rotation axis). And the display process part 120 produces | generates the image seen from a virtual camera (user viewpoint) in virtual space as display images (display video), such as HMD200. For example, an image that is visible from a given viewpoint is generated in an object space that is a virtual space. The generated image is, for example, a stereoscopic image.

  In the launch unit 50, a plurality of launch devices CN1 to CNM are arranged. And the control part 118 performs the control process of the discharge part 50 according to the game condition in virtual space. Specifically, the control unit 118 performs control processing of the launching unit 50 according to the game situation in the virtual space and the user information. That is, according to the user information including at least one of the game situation, the user position information, the direction information, and the posture information, the selection of the launching devices CN1 to CNM in the launching unit 50, the gas firing timing, Control of the firing output degree, the gas firing direction, or the gas processing is performed.

  Here, the game situation includes, for example, the user's game play situation, game progress situation, game event situation, game battle situation, game battle situation, enemy attack situation appearing in the game, game hit determination Status of a moving object (such as a character or hit object) appearing in a game, status of a character or user status parameter (such as health value, level, attack power or defensive power), or status of game results There are various situations represented by, for example, game parameters. The game situation is specified by, for example, game processing in the game processing unit 115. For example, the user's game situation is specified based on information such as various game parameters used in the game process. The control process of the launch unit 50 includes, for example, a control process for selecting the launch devices CN1 to CNM in the launch unit 50, a control process for the gas firing timing, a control process for the gas firing output degree, and a direction change of the launch unit 50. Control processing, control processing for changing the direction of the launching devices CN1 to CNM, control processing for processing the gas emitted by the launching unit 50, and the like.

  In this way, the control unit 118 can play game situations such as game play status, progress status, event status, battle status, battle status, attack status, hit determination status, moving object status, status parameter status, or results status. In response to this, control processing for selecting a launching device, firing timing, firing output degree, direction change, gas processing, or the like is performed. If it does in this way, it will become possible to discharge gas by a plurality of launching devices of launching part 50 so as to correspond to the game situation of virtual space.

  Furthermore, the control unit 118 controls the launch unit 50 according to user information such as user position information, direction information, or posture information. For example, the emission unit 50 is controlled so that gas is emitted in the emission direction or the emission output level according to the position and direction of the user in the real space. Further, the gas emission direction or the emission output level in the emission unit 50 is changed according to the user's posture and the like. If it does in this way, it becomes possible to perform optimal gas emission control of the emission part 50 according to a user's position, direction, or attitude | position. For example, the control processing of the present embodiment performs game processing such as advancing the game based on the acquired user information, and controls the launch unit 50 according to the game situation based on the result of the game processing. Also good. Further, the user may be detected based on the user information, and the launch unit 50 may be controlled according to the detected game situation of the user. For example, when the game situation is such that the enemy attacks the detected user, the launch unit 50 is controlled to emit gas.

  In the launching unit 50, a plurality of launching devices CN1 to CNM are arranged in a matrix. Then, the control unit 118 controls the plurality of launchers CN1 to CNM arranged in a matrix. For example, the launchers CN1 to CNM are arranged in a two-dimensional matrix. For example, the launchers CN1 to CNM are arranged in a matrix of K rows and N columns. For example, K and N are integers of 1 or more, preferably K and N are integers of 2 or more. In this case, the launchers CN1 to CNM may be arranged in a grid pattern. However, the distance between the CN1 to CNM launchers need not be a constant distance, and may be a different distance. Further, in the matrix arrangement of K rows and N columns, N launching devices arranged in one row may be arranged linearly or may be arranged in a curved shape. Further, the K launching devices arranged in a line may be arranged in a straight line or may be arranged in a curved line.

  In addition, when a hit event occurs in which the hit object (hit) corresponding to the gas hits in the virtual space, the control unit 118 selects the launch devices CN1 to CNM in the launch unit 50, and the gas firing timing. At least one of the control process and the control process of the gas emission output degree. The hit object is an object in a virtual space corresponding to a gas in the real world, and may be an object displayed as an image in the virtual space, or a virtual object that is not displayed as an image in the virtual space. Good. Further, when the user moving object corresponding to the user moves in the virtual space, the hit event is an event in which the hit object corresponding to the gas hits the user moving object or the like. The game processing unit 115 performs hit determination processing for determining whether or not the hit object has been hit. Specifically, hit calculation processing such as hit determination processing is performed by the hit calculation processing unit 116 of the game processing unit 115. The hit calculation process includes a hit determination process for determining whether or not the hit object has been hit, a calculation process for a damage amount due to a hit, an effect process for a hit, and the like.

  The selection process of the launching devices CN1 to CNM in the launching unit 50 is a process of selecting which of the launching devices CN1 to CNM is to emit gas. The launching device selected as the launching device for firing the gas may be one launching device or a plurality of launching devices. For example, when the launching devices CN1 to CNM are arranged in a matrix of K rows and N columns, the control unit 118 performs a selection process for causing the N launching devices arranged in one row to emit gas, or in one column. You may perform the selection process which discharges gas to the K discharge devices arranged. The gas emission timing control process is a process for controlling at which timing the gas is emitted. In this case, the control unit 118 may control the emission timing when all the emission devices CN1 to CNM of the emission unit 50 simultaneously emit gas, and one or more of the emission devices CN1 to CNM. When the device emits gas, the gas emission timing of the one or more emission devices may be controlled. The gas emission output degree control process is a process for controlling the strength and speed of the emitted gas. That is, it is a process for controlling the strength and speed at which the gas is emitted. For example, when the gas emission of the emission devices CN1 to CNM is controlled based on the emission control signal, the gas emission output level can be controlled by the voltage level, current level, signal waveform, or the like of the emission control signal.

  Further, the control unit 118 selects the launching devices CN1 to CNM in the launching unit 50, controls the gas firing timing, and controls the gas firing output degree according to the hit direction or hit vector of the hit object. Do at least one of the following: The hit direction (attack direction) is the movement direction of the hit object when the hit object hits an object such as a user moving object. For example, the hit direction can be specified based on the trajectory of the hit object flying toward the object such as the user moving body. The hit vector represents the hit strength in addition to the hit direction. The hit strength when the hit object hits an object such as a user moving body is specified based on the size of the hit vector. After this, the hit direction and the hit vector are obtained based on the hit calculation processing in the game processing unit 115 (hit calculation processing unit 116). That is, the game processing unit 115 obtains hit information such as a hit direction and a hit vector based on the result of the game processing. Then, the control unit 118 selects the launching devices CN1 to CNM, launch timing control processing, or launch output degree control processing based on hit information such as the hit direction and hit vector obtained based on the game processing result. Etc.

  In addition, the plurality of launchers CN1 to CNM include first to Nth launchers along a first direction that intersects the vertical direction. When the launchers CN1 to CNM are arranged in a matrix of K rows and N columns, the first to Nth launchers are launchers arranged in one of the K rows. Then, when a hit event occurs in which the hit object hits in an oblique direction with respect to the user moving object corresponding to the user, the control unit 118 sequentially supplies gas from the first launching device to the Nth launching device. Control the launcher to be fired.

  For example, when a hit event occurs in which the hit object hits in an oblique direction, gas is fired from the first launch device, then gas is fired from the second launch device, and then from the third launch device. Gas is fired sequentially from each launching device in time series, such as firing gas, and finally the gas is fired from the Nth launching device. In this case, the launching device that sequentially fires the gas in time series may be a unit of one or a plurality of units. For example, control is performed such that gas is emitted from the first and second emission devices, then gas is emitted from the third and fourth emission devices, and then gas is emitted from the fifth and sixth gas devices. It may be.

  Also, the diagonal direction when the hit object hits the user moving body in an oblique direction may be an oblique direction with respect to the direction in which the user moving body faces, or an oblique direction that does not depend on the direction in which the user moving body faces. There may be. For example, the user moving body in the virtual space changes the position and direction in conjunction with the movement of the user in the real world. In this case, the oblique direction may be an oblique direction with respect to the direction that the user faces, or may be an oblique direction that does not depend on the direction that the user faces.

  In addition, the launch unit 50 includes a launch unit direction changing unit 52 that changes the direction of the launch unit 50. For example, the launching unit direction changing unit 52 changes the direction in which the launching unit 50 faces (the gas firing direction). When the direction of the launching unit 50 is changed in this way, the gas firing directions of the launching devices CN1 to CNM of the launching unit 50 are changed all at once. And the control part 118 controls the launching part direction change part 52 according to a game condition or user information. For example, the user's game play status, game progress status, game event status, game battle status, game battle status, enemy attack status, game hit determination status, status of mobile objects appearing in the game The launching direction changing unit 52 is controlled in accordance with the status parameter status of the character or user, the game results, etc., and the direction in which the launching unit 50 faces (the gas firing direction) is changed. The launcher direction changing unit 52 can be realized by an actuator (such as a motor) or a mechanical mechanism in order to change the direction of the launcher 50.

  The launching unit 50 includes a launching device direction changing unit 54 that changes the direction of the plurality of launching devices CN1 to CNM. The launching device direction changing unit 54 controls the direction in which each of the launching devices CN1 to CNM faces (gas firing direction). In this case, the launcher direction changing unit 54 may change the direction of the launcher in units of one by one, or may change the direction of the launcher in units of multiple. Then, the control unit 118 controls the launching device direction changing unit 54 according to the game situation and user information. For example, the user's game play status, game progress status, game event status, game battle status, game battle status, enemy attack status, game hit determination status, character status in the game, The launching device direction changing unit 54 is controlled in accordance with the status of the status parameters of the character and the user, the situation of the game results, etc., and the direction in which each launching device CN1 to CNM faces (gas firing direction) is changed. . The launching device direction changing unit 54 can be realized by an actuator (motor or the like) or a mechanical mechanism in order to change the direction of the launching devices CN1 to CNM.

  The virtual space setting unit 112 sets the hit object generation source object in the hit event in which the hit object corresponding to the gas hits in the virtual space to the position of the virtual space corresponding to the position of the launch unit 50 in the real space. Perform the placement process. For example, in a hit event, a source object (emission source object) such as an enemy character generates (fires) a hit object, and this hit object hits an object such as a user moving object. In this case, the virtual space setting unit 112 arranges the source object at a position (position or direction) in the virtual space corresponding to the position (position or direction) of the launching unit 50 in the real space. Then, the hit object from the source object arranged at such a position in the virtual space hits an object such as a user moving object. In this way, it is possible to associate the position of the source object that generates the hit object with the position of the launch unit 50 that emits the gas corresponding to the hit object. This makes it possible to realize a virtual reality as if gas was generated from the position of the source object.

  In addition, the game processing unit 115 performs a game effect process in which sound, vibration, or an image is linked to the gas emission from the emission unit 50. For example, in conjunction with gas emission at the emission unit 50, sound such as gas emission sound or hit sound is output, vibration that indicates gas emission or hit is generated, or gas emission or hit is expressed A game effect process for displaying an image is performed. Such a game effect process can be realized, for example, by performing an effect process in conjunction with the launch control signal when the launch unit 50 is controlled based on the launch control signal from the control unit 118.

  The launching unit 50 includes a processing unit 56 that processes the gas to be fired. The launching unit 50 launches the gas processed by the processing unit 56 under the control of the control unit 118.

  Here, various modes can be considered as gas processing in the processing unit 56. For example, processing such as mixing a scent into the gas to be fired may be performed. Moreover, you may perform the process which changes the temperature of the gas to discharge. For example, the temperature of the gas to be fired is increased or decreased. For example, as one aspect of the processing for lowering the temperature, the processing may be performed by mixing ice or snow with the gas and firing. Or you may perform the process which changes the humidity of the gas to discharge. For example, processing to increase the humidity of the gas to be emitted or to reduce the humidity is performed. For example, processing such as firing a mist may be performed. If gas is processed and fired in this way, the user can experience a variety of virtual reality using the processed gas. For example, in conjunction with a video scene of the HMD 200 that blows snow, processing is performed such that a gas mixed with ice and snow is emitted. In addition, processing is performed such that hot air gas is emitted in conjunction with a video scene of the HMD 200 in a hot place such as a volcano. In addition, in conjunction with video scenes such as flower gardens, processing is performed to emit gas mixed with flower scents. As a result, the virtual reality of the user can be further improved.

  Moreover, the process part 56 performs a different process with respect to the gas emitted with the 1st launching device and the 2nd launching device of the some launching devices CN1-CNM. For example, different gas processing is performed for each launching device. If it does in this way, it will become possible to discharge the gas processed variously to a user using a plurality of launching devices CN1-CNM. In addition, in the plurality of launching devices CN1 to CNM, the processing of the gas emitted by the launching device may be different in units of one, or the processing of the gas emitted by the launching device in different units may be different. May be.

  The moving body processing unit 113 performs a moving process of the user moving body that moves in the virtual space. For example, the moving body processing unit 113 selects a user moving body (avatar moving body, boarding moving body, outer shell moving body) corresponding to the user based on the user information (position information, direction information) acquired by the information acquisition unit 111. Then, the process of moving in the virtual space is performed. For example, the user moving body is moved in the virtual space so as to move following the movement of the user in the real space. For example, based on the moving speed and moving acceleration of the user moving body, a process of updating the position of the user moving body for each frame is performed to move the user moving body in the virtual space (virtual field). In addition, the moving body processing unit 113 performs processing for operating the user moving body based on the user information (posture information) acquired by the information acquisition unit 111. For example, based on the motion data, motion processing for changing the posture of the user moving body is performed.

  Further, the virtual camera control unit 114 controls the virtual camera so as to follow the change in the user's viewpoint based on the tracking information of the user's viewpoint information.

  For example, the input processing unit 102 (input reception unit) acquires tracking information of viewpoint information of the user wearing the HMD 200. For example, tracking information (viewpoint tracking information) of viewpoint information that is at least one of the user's viewpoint position and line-of-sight direction is acquired. This tracking information can be acquired by performing tracking processing of the HMD 200, for example. Note that the user's viewpoint position and line-of-sight direction may be directly acquired by tracking processing. As an example, the tracking information includes the change information of the viewpoint position from the initial viewpoint position of the user (change value of the coordinate of the viewpoint position), and the change information of the gaze direction from the initial gaze direction of the user (the rotation axis in the gaze direction). At least one of the rotation angle change values around the rotation angle). Based on the change information of the viewpoint information included in such tracking information, the user's viewpoint position and line-of-sight direction (information on the user's head position and posture) can be specified.

  Then, the virtual camera control unit 114 changes the viewpoint position and the line-of-sight direction of the virtual camera based on the acquired tracking information (information on at least one of the user's viewpoint position and the line-of-sight direction). For example, the virtual camera control unit 114 is configured so that the viewpoint position and the line-of-sight direction (position and posture) of the virtual camera change in the virtual space according to changes in the viewpoint position and the line-of-sight direction of the user in the real space. Set up the camera. By doing in this way, a virtual camera can be controlled to follow a user's viewpoint change based on tracking information of a user's viewpoint information.

  In the present embodiment, a virtual reality simulation process is performed as the game process of the game played by the user. The virtual reality simulation process is a simulation process for simulating an event in the real space in the virtual space, and is a process for causing the user to experience the event virtually. For example, a process for moving a user moving body such as an avatar moving body (virtual user) corresponding to a user in the real space or its boarding moving body in the virtual space, or causing the user to experience changes in the environment and surroundings accompanying the movement. I do.

  Note that the processing of the simulation system of this embodiment in FIG. 1 can be realized by a processing device such as a PC installed in a facility, a processing device worn by a user, or distributed processing of these processing devices. Or you may implement | achieve the process of the simulation system of this embodiment with a server system and a terminal device. For example, it may be realized by distributed processing of a server system and a terminal device.

2. Tracking Processing Next, an example of tracking processing will be described. FIG. 2A shows an example of the HMD 200 used in the simulation system of this embodiment. As shown in FIG. 2A, the HMD 200 is provided with a plurality of light receiving elements 201, 202, and 203 (photodiodes). The light receiving elements 201 and 202 are provided on the front surface portion of the HMD 200, and the light receiving element 203 is provided on the right side surface of the HMD 200. In addition, a light receiving element (not shown) is also provided on the left side, upper surface, and the like of the HMD.

  In addition, the user US wears tracking devices 251, 252, and 253 on parts such as hands and waists. These tracking devices 251, 252 and 253 are provided with a plurality of light receiving elements (not shown) as in the HMD 200. By using these light receiving elements, as in the case of the HMD 200, the position and direction of parts such as the hand and the waist can be specified, and the posture information of the user US can be acquired. The part of the user US to which the tracking device is attached is not limited to the hand and the waist, and can be attached to various parts such as the leg, the abdomen, and the chest.

  Further, the HMD 200 is provided with a headband 260 and the like so that the user US can stably wear the HMD 200 on the head with a better wearing feeling. In addition, the HMD 200 is provided with a headphone terminal (not shown). By connecting a headphone 270 (sound output unit 192) to the headphone terminal, for example, processing of three-dimensional sound (three-dimensional audio) is performed. The user US can listen to the game sound. Note that the operation information of the user US may be input by detecting the head movement or the swinging movement of the user US by the sensor unit 210 of the HMD 200 or the like.

  As shown in FIG. 2B, base stations 280 and 284 are installed around the user US. The base station 280 is provided with light emitting elements 281 and 282, and the base station 284 is provided with light emitting elements 285 and 286. The light emitting elements 281, 282, 285, and 286 are realized by LEDs that emit laser (infrared laser or the like), for example. The base stations 280 and 284 use these light emitting elements 281, 282, 285, and 286 to emit, for example, a laser beam radially. The light receiving elements 201 to 203 and the like provided in the HMD 200 in FIG. 2A receive the lasers from the base stations 280 and 284, thereby realizing the tracking of the HMD 200 and the position and direction of the head of the user US. (Viewpoint position, line-of-sight direction) can be detected.

  The light receiving elements provided in the tracking devices 251, 252, and 253 receive the laser beams from the base stations 280 and 284, so that at least one of the position and direction of each part of the user US can be detected.

  FIG. 3A shows another example of the HMD 200. In FIG. 3A, a plurality of light emitting elements 231 to 236 are provided for the HMD 200. These light emitting elements 231 to 236 are realized by, for example, LEDs. The light emitting elements 231 to 234 are provided on the front side of the HMD 200, and the light emitting element 235 and the light emitting element 236 (not shown) are provided on the back side. These light emitting elements 231 to 236 emit (emit) light in a visible light band, for example. Specifically, the light emitting elements 231 to 236 emit light of different colors. In addition, light emitting elements (not shown) are also provided in the tracking devices 251, 252, and 253 that the user US wears on parts such as hands and waists.

  The imaging unit 150 shown in FIG. 3B is installed in at least one place around the user US (for example, the front side, the front side, the rear side, or the like). ˜236 images of light. That is, the spot light of these light emitting elements 231 to 236 is reflected in the captured image of the imaging unit 150. And the tracking of the user's US head (HMD) is implement | achieved by performing the image process of this captured image. That is, the three-dimensional position of the head of the user US and the facing direction (viewpoint position, line of sight direction) are detected.

  For example, as illustrated in FIG. 3B, the imaging unit 150 includes first and second cameras 151 and 152, and the first and second cameras 151 and 152 of the first and second cameras 151 and 152 are provided. By using the captured image, the position of the head of the user US in the depth direction can be detected. Further, based on the motion detection information of the motion sensor provided in the HMD 200, the rotation angle (line of sight) of the head of the user US can also be detected. Therefore, by using such an HMD 200, when the user US faces in any direction of all 360 degrees around the image, the image (the user's virtual space in the virtual space (virtual three-dimensional space)) Image viewed from a virtual camera corresponding to the viewpoint) can be displayed on the display unit 220 of the HMD 200.

  Further, by imaging the light of the light emitting elements of the tracking devices 251, 252, and 253 by the imaging unit 150, as in the case of the HMD 200, at least one of the position and direction of each part of the user US can be detected.

  Note that instead of visible light, infrared LEDs may be used as the light emitting elements 231 to 236. Further, the position or movement of the user's head may be detected by another method such as using a depth camera.

  Further, the tracking processing method for detecting the user viewpoint position and the line-of-sight direction (user position and direction) is not limited to the method described with reference to FIGS. For example, the tracking process may be realized by a single unit of the HMD 200 using a motion sensor or the like provided in the HMD 200. That is, tracking processing is realized without providing external devices such as the base stations 280 and 284 in FIG. 2B and the imaging unit 150 in FIG. Or you may detect viewpoint information, such as a user's viewpoint position and a gaze direction, by various viewpoint tracking methods, such as well-known eye tracking, face tracking, or head tracking. Further, the detection of the position and direction of each part of the user US by the tracking devices 251, 252, and 253 may be realized by using a motion sensor provided in the tracking devices 251, 252, and 253.

3. Next, the method of this embodiment will be described in detail. In the following description, the method of the present embodiment will be described mainly using an example where the method is applied to a battle game. However, the present embodiment is not limited to this, and various games (RPG, action game, competition game, sports game, horror experience game, simulation game of vehicles such as trains and airplanes, puzzle games, communication games, or music games) Etc.) and can be applied to other than games. Hereinafter, a case where the user moving body is a user's avatar moving body (virtual user, user character) will be described as an example. However, the user moving body is a boarding moving body (for example, a robot, a tank, a battle) Machine or car). In the following description, it is assumed that the gas emitted by the emission device is air, but the present embodiment is not limited to this.

3.1 Description of Game First, a game realized by the present embodiment will be described. FIG. 4 is an example of a housing 40 used in the simulation system of this embodiment. In the present embodiment, the user wearing the HMD plays a game on the housing 40 as shown in FIG.

  The housing 40 includes a field FL (floor surface) where the user US plays a game, a launching unit 50, and a processing device 60. Areas AR1, AR2, and AR3 are set in the field FL, and vibration parts VB1, VB2, and VB3 that vibrate the floor of the field FL are provided below the areas AR1, AR2, and AR3. For example, the vibration part VB1 provided in the middle is realized by a vibration motor, and the vibration parts VB2 and VB3 provided at both ends are realized by a transducer. For example, the vibration motor generates vibration by rotating an eccentric weight. Specifically, eccentric weights are attached to both ends of the drive shaft (rotor shaft) so that the motor itself swings. The transducer converts a sound signal and corresponds to a high-power subwoofer. For example, when the control unit 118 of FIG. 1 performs a sound file reproduction process, a sound signal is input to the transducer. For example, vibration is generated based on a low frequency component of the sound signal.

  The processing device 60 performs various processes of the simulation system of the present embodiment, and corresponds to the processing unit 100, the storage unit 170, and the like of FIG. In FIG. 4, the processing device 60 is realized by a personal computer (PC).

  The launch unit 50 is supported by support units 62 and 64 provided in the field FL. The launching unit 50 is provided so that its main surface faces the user US standing in the field FL. In the launch unit 50, a plurality of launch devices CN1 to CN18 are arranged in a matrix. The launchers CN1 to CN18 launch air (gas in a broad sense, hereinafter the same) to the user US facing the launch unit 50. Blowers FN1, FN2, and FN3 are provided below launchers CN1 to CN18. The blowers FN1, FN2, and FN3 are realized by, for example, a sirocco fan. Then, air (gas) is blown to the user US facing the launching unit 50.

  FIGS. 5A and 5B are diagrams illustrating detailed examples of the launching unit 50 and the launching device 70 (CN1 to CN18). The launching unit 50 is a device that can emit air (gas) to the user, and includes launching devices CN1 to CN18 arranged in a matrix. In FIG. 5A, the launchers CN1 to CN18 are arranged in a matrix of 3 rows and 6 columns. However, the present embodiment is not limited to this and may be arranged in a matrix of K rows and N columns (K and L are integers of 2 or more). In FIG. 5A, the distances between the launching devices are equal, but the distances between the firing devices may be different. For example, the arrangement is not limited to the lattice arrangement as shown in FIG. 5A, and for example, each row and each column may be a curved arrangement instead of a linear arrangement. A one-dimensional array is also possible.

  In FIG. 5A, the launchers CN1 to CN18 launch air at a strong pressure (strong static pressure) like a so-called air cannon, whereas the blowers FN1, FN2, and FN3 are weaker by a sirocco fan or the like. Air is blown with pressure (weak static pressure).

  FIG. 5B is a configuration example of the launching device 70 (CN1 to CN18). The launching device 70 includes a speaker 72 and an air storage unit 76 (gas storage unit). The speaker 72 vibrates the diaphragm 74 based on the sound signal (low frequency signal). When the vibration plate 74 vibrates, the air (a mass of air) accumulated in the air accumulating unit 76 is launched from the launch port 78 like an air cannon. For example, it is launched as vortex air. The launching device 70 is not limited to the configuration shown in FIG. 5B, and various modifications can be made. For example, instead of the speaker 72, the vibration plate 74 may be vibrated using a vibration device such as a transducer, a vibration motor, or a solenoid to emit air.

  FIG. 6 shows an example of a field VFL (play field, game stage) set in the virtual space. In the field VFL, user characters (user moving bodies in a broad sense) corresponding to the user and user-operated characters CHE1, CHE2, and CHE3 operated by the opponent player and the computer are arranged. Here, a user character CH and enemy characters CHE1, CHE2, and CHE3 are arranged at the positions of the square corners. Then, a battle is performed between these characters by an air bullet attack.

  7 to 10 are examples of game images generated according to the present embodiment. In FIG. 7, an enemy character CHE1 (a generation source object in a broad sense) attacks a user character CH (FIG. 6) using a bullet AR (a hit object in a broad sense). For example, after the air balloon AR is fired in FIG. 7, the air balloon AR approaches the user character CH in FIGS. 8 and 9, and the air balloon AR hits the user character CH in FIG.

  In the present embodiment, when a hit event occurs in which the bullet AR (hit object) fired (generated) by the enemy character CHE1 (source object) hits the user character CH (user moving object), The firing unit 50 of FIG. 4 is used as a bodily sensation device for experiencing the hit of the air balloon AR by the sense of touch of the user. That is, when the air bullet AR is hit, the launch unit 50 emits air to the user US, so that the user US can feel a virtual reality as if the real air balloon AR was hit. That is, the user US is given a tactile sensation when the air mass fired by the launching unit 50 hits the body.

  As shown in FIG. 4, the user US is wearing an HMD so as to cover the field of view. For this reason, in conjunction with the display images (videos) of the HMD as shown in FIGS. 7 to 10, the mass of air from the launching unit 50 hits the user US like an air gun, so that the user US is genuine. You will be able to experience the virtual reality as if the bomb AR was hit. The sensation apparatus using the air emitting unit 50 is an appropriate device in terms of hygiene, safety, and operation of the simulation system, and has an advantage that the scale of the device does not increase so much. is there. For example, if only air is applied to the user US, there will be no sanitary or safety problems. Further, if the launcher 50 is provided only at a position facing the user US as shown in FIG. 4, the scale of the simulation system can be made compact.

3.2 Control of launching unit according to game situation Next, the control method of the launching unit 50 in this embodiment will be described in detail. In the present embodiment, a launching unit 50 in which a plurality of launching devices CN1 to CN18 are arranged in a matrix (two-dimensional) is used, and this launching unit 50 is turned into a virtual space game situation as shown in FIGS. It is controlled accordingly. Specifically, the launch unit 50 is controlled according to the game situation and user information (position, direction, posture, etc.). For example, the simulation system according to the present embodiment is a simulation system in a game in which a user wearing an HMD that covers a field of view is positioned at a play location in real space and the user plays, for example, by detecting the position and direction of the user. And in the simulation system of this embodiment, according to the game situation in virtual space, and user information, the launching part 50 by which multiple launching devices which can blow off gas, such as air, are arranged with respect to a user, respectively, The launcher 50 is installed in a direction facing the play place of the user in real space. According to such a simulation system, various control processes using the plurality of launchers CN1 to CN18 can be performed, and optimal air launch control according to the game situation can be realized.

  For example, in the simulation system of the present embodiment, depending on the game situation and user information, the launching unit 50 selects the launching devices CN1 to CN18, the air (gas) firing timing control process, or the air firing output degree. Perform control processing. Specifically, when a hit event as shown in FIGS. 7 to 10 occurs in which a bullet (hit object) corresponding to air (gas) hits in the virtual space (game space), the launching devices CN1 to CN18. Selection processing, firing timing control processing, or firing output degree control processing.

  For example, when a normal bullet hits the user character CH, control processing of the launching unit 50 as shown in FIGS. 11A and 11B is performed. That is, when a normal bullet is hit, the launchers CN7 to CN12 indicated by hatching in FIG. Specifically, as shown in FIG. 11 (B), air (a mass of air) emitted from the emission devices CN7 to CN12 provided in the middle stage of the emission unit 50 comes into contact with the user US. Further, in accordance with the hit of a bullet in the virtual space, the vibration parts VB1, VB2, and VB3 (vibration motors and transducers) provided on the floor of the field FL vibrate as shown in FIG.

  11A and 11B, the middle launchers CN7 to CN12 are selected from the launchers CN1 to CN18 of the launcher 50 when a hit event occurs that hits a normal bullet. The selection process is performed.

  Also, as shown in FIG. 10, the firing timing control process is performed so that the launchers CN <b> 7 to CN <b> 12 launch air according to the timing when the bullet (AR) hits in the display image of the HMD of the user US. ing. For example, the arrival time of a bullet is calculated, and the firing timing of the launching devices CN7 to CN12 is controlled so that air is fired in advance before the occurrence of a hit event that hits the bullet. This firing timing control process can be realized by controlling the output timing of the firing control signal generated by the control unit 118 of FIG.

  Also, a game effect process is performed in which vibration parts VB1, VB2, and VB3 provided on the floor of the field FL are vibrated when a balloon hit event occurs.

  It should be noted that control processing of the air emission output degree may be performed at the time of occurrence of a bullet hit event. For example, when a normal balloon hit event occurs, a control process is performed to weaken the air emission output level as compared to the case of a special bullet hit event described later. Such a control process can be realized by controlling the strength of vibration of the diaphragm 74 in FIG. 5B, for example. For example, when a normal bullet hit event occurs, the vibration of the diaphragm 74 is controlled to be weaker than when a special bullet hit event occurs. For example, when the diaphragm 74 of the speaker 72 is vibrated based on the sound signal, it is possible to realize control for weakening the vibration of the diaphragm 74 by reducing the amplitude of the sound signal.

  On the other hand, when a special bullet having a higher attack power (power) than a normal bullet hits the user character CH, the launch unit 50 as shown in FIGS. 12 (A) and 12 (B). Perform control processing. That is, at the time of hitting a special air bomb, all the launchers CN1 to CN18 indicated by hatching in FIG. That is, as shown in FIG. 12B, air (air lump) fired from the launching devices CN1 to CN18 provided in the lower, middle, and upper stages of the launching unit 50 comes to hit the user US. . Further, in accordance with the hit of the special bullet, the vibration parts VB1, VB2, and VB3 provided on the floor of the field FL vibrate as shown in FIG. In addition, after the special air bomb hits, the fans FN1 to FN3 blow air to the user US, and the user US feels the reverberation due to the hit of the special air bomb. In this case, the strength of the blower FN1 to FN3 may be changed according to the level of the attack power (power) of the special bullet. For example, the higher the level of attack power of special bullets, the stronger the air blow. Further, the vibration strength of the vibration parts VB1, VB2, and VB3 is also controlled so that the higher the attack power level of the special bullet, the stronger the vibration.

  As described above, in FIGS. 12A and 12B, the selection process of selecting all the launching devices CN1 to CN18 of the launching unit 50 at the time of occurrence of a hit event in which a special bullet is hit is performed. .

  In addition, the firing timing control process is performed so that the launchers CN1 to CN18 launch air in accordance with the timing at which the special bullets are hit in the display image of the HMD of the user US. For example, the arrival time of the special bullet is calculated, and the firing timing of the launching devices CN1 to CN18 is controlled so that air is fired in advance before the occurrence of the hit event that hits the special bullet. In addition, a game effect process is performed in which the vibration parts VB1, VB2, and VB3 provided on the floor of the field FL are vibrated when a special balloon hit event occurs.

  In this case, control processing of the degree of air emission output may be performed at the time of occurrence of a special air bullet hit event. For example, when a special balloon hit event occurs, a control process is performed to increase the degree of air emission output compared to when a normal bullet hit event occurs in FIGS. 11 (A) and 11 (B). For example, when a special balloon hit event occurs, the vibration of the diaphragm 74 in FIG. 5B is controlled to be stronger than when a normal bullet hit event occurs. For example, the amplitude of the sound signal input to the speaker 72 is increased. Moreover, you may perform the control process which strengthens the firing output degree of air, so that the level of the attack power of a special air bullet is high. For example, the amplitude of the sound signal is changed according to the level of the attack power of the special bullet. Such control for changing the amplitude or the like of the sound signal has an advantage that it can be realized by a simple process of simply switching the sound file for generating the sound signal.

  As described with reference to FIGS. 11A to 12B, in the present embodiment, the control process of the launching unit 50 is performed in accordance with the game situation in the virtual space. For example, in a game situation in which a normal bullet is hit, as shown in FIGS. 11 (A) and 11 (B), air is fired only from the middle launchers CN7 to CN12 of the launch unit 50. In addition, the air firing output level is also weaker than when a special bullet is hit. Further, the blowers FN1 to FN3 of the launch unit 50 are not blown.

  On the other hand, in a game situation where a special air bomb hits, air is fired from all of the launchers CN1 to CN18 of the launcher 50 as shown in FIGS. 12 (A) and 12 (B). In addition, the air firing output level is also weaker than when a normal bullet is hit. Further, in order for the user US to experience the reverberation of the hit of special air bullets, the fans FN1 to FN3 of the launch unit 50 are also blown.

  In this way, in this embodiment, optimal control of the launch unit 50 according to the game situation in the virtual space is realized. For example, in the present embodiment, air emission control is performed in accordance with an image of a game situation in a virtual space reflected on the HMD. For example, when the image of a game situation where a normal bullet is hit is displayed on the HMD, and when the image of a game situation where a special bullet is hit is displayed on the HMD, air emission control is different. Since the experience given to the user is also different, the virtual reality of the user can be greatly improved.

3.3 Firing Control According to Hit Direction and Hit Vector In the present embodiment, according to the hit direction or hit vector of the hit object, a firing device selection process at the firing unit 50, a gas firing timing control process, or Control processing of the gas emission output degree is performed. For example, the plurality of launchers CN1 to CN18 in FIG. 5A include launchers CN7 to CN12 (first to Nth launchers) along a first direction that intersects the vertical direction. Assume that a hit event occurs in which a bullet (hit object) hits in an oblique direction with respect to a user character (user moving body) corresponding to the user. In this case, the launching unit 50 is controlled so that air (gas) is sequentially fired from the launcher CN7 (first launcher) to the launcher CN12 (Nth launcher).

  For example, in FIG. 13A, the enemy character CHE, which is the source object, is firing a bullet AR (hit object). A hit event is generated in which the air balloon AR hits the user character CH (user moving body) in the hit direction DH (or hit vector VH). In this case, according to the hit direction DH (or hit vector VH) of the bullet, a selection process of the launching device, a firing timing control process, or a firing output degree control process is performed.

  Specifically, in FIG. 13A, a hit event has occurred in which a bullet hits the user character CH corresponding to the user US from an oblique left direction. In other words, the hit direction DH (hit vector VH) is oblique to the left with respect to the user character CH. For example, in FIG. 13A, the hit direction DH is an oblique left direction with respect to the direction of the user character CH.

  In this case, in this embodiment, as shown in FIG. 13B, air is sequentially fired from the launcher CN7 (first launcher) to the launcher CN12 (Nth launcher). The launcher 50 is controlled. Here, the launchers CN7 to CN12 (first to Nth launchers) are launchers arranged along a first direction DR1 (horizontal direction) that intersects (orthogonally) the vertical direction DRV. Specifically, as shown in FIG. 14, the launching device CN7 first launches air, and then the launching device CN8 launches air. Thereafter, the launchers CN9, CN10, and CN11 sequentially fire air in time series, and finally, the launcher CN12 launches air.

  As shown in FIG. 13B and FIG. 14, if the launching devices CN7 to CN11 sequentially fire air in time series, as if the air was fired from the launching unit arranged in the left direction of itself. It becomes possible to make the user US feel. That is, as shown in FIG. 4, in the present embodiment, the launcher 50 is arranged in the front direction of the user US. Also in this case, as shown in FIG. 13B and FIG. 14, the launching devices CN7 to CN11 sequentially fire air in time series, so that the user US is firing air from the diagonally left direction. In addition, the user US has an illusion. Therefore, for example, it is possible to realize a sensation apparatus that can provide a tactile sensation such that air strikes from an oblique left direction without providing a launching unit in the left direction of the user US. Accordingly, it is only necessary to provide the launch unit 50 in the front direction of the user US, and it is not necessary to provide the launch unit 50 in the left direction. That is, in the present embodiment, the field of view of the user US is covered with the HMD, and the air mass of the plurality of launchers CN7 to CN12 from the front direction is created by the user US because the HMD is not visible in the real space. By shifting the timing of the collision with the body, it is possible to make an illusion that it was released from an oblique direction.

  On the other hand, in FIG. 15A, a hit event has occurred in which a bullet hits the user character CH corresponding to the user US from an obliquely right direction. That is, the hit direction DH (hit vector VH) is oblique to the right with respect to the user character CH. For example, in FIG. 15A, the hit direction DH is oblique to the right with respect to the direction of the user character CH.

  In this case, in this embodiment, as shown in FIG. 15B, the launching unit 50 is controlled so that air is sequentially fired from the launching device CN12 to the launching device CN7. That is, the emission devices CN12 to CN7 sequentially emit air along a second direction DR2 (a direction opposite to DR1) intersecting (orthogonal) with the vertical direction DRV. For example, the launcher CN12 launches air, and then the launchers CN11, CN10, CN9, and CN8 sequentially launch air in time series, and finally the launcher CN7 launches air.

  If it does in this way, it will become possible to make the user US feel as if the air has fired from the launching part arranged in the right direction of itself. That is, as shown in FIG. 4, in the present embodiment, the launcher 50 is arranged in the front direction of the user US. Also in this case, as shown in FIG. 15 (B), the launchers CN12 to CN7 sequentially fire air in time series so that the user US looks as if it is firing air from the right diagonal direction of the user US. Illusion. Therefore, for example, even if a launching unit is not provided on the right side of the user US, it is possible to realize such a sensation device in which air hits from the right oblique direction, and the sensation device can be reduced in size.

  In the present embodiment, the launching device depends on whether the hit direction DH (hit vector VH) is a left diagonal direction as shown in FIG. 13 (A) or a right diagonal direction as shown in FIG. 15 (A). Selection processing, firing timing control processing, or firing output degree control processing.

  For example, when the hit direction DH is the left diagonal direction, as shown in FIG. 13B, the launching device is selected so as to fire air in the order of CN7, CN8, CN9, CN10, CN11, CN12, Air is fired at the firing timing. At this time, for example, for the launchers CN7 and CN12 that are far from the user US, the launch output degree may be stronger than the launchers CN9 and CN10 that are close to the user US.

  If the hit direction DH is diagonally rightward, as shown in FIG. 15 (B), the launcher is selected to launch air in the order of CN12, CN11, CN10, CN9, CN8, CN7. Air is fired at the firing timing. At this time, for example, for the launchers CN7 and CN12 that are far from the user US, the launch output degree may be stronger than the launchers CN9 and CN10 that are close to the user US.

  In this way, optimal air emission control according to the hit direction DH (hit vector VH) can be realized, and the virtual reality of the user can be improved.

  In FIG. 13A to FIG. 15B, air is sequentially emitted to the middle (row) middle row launching devices CN7 to CN12, but the present embodiment is not limited to this. For example, in addition to the middle launchers CN7 to CN12, the lower (lower row) launchers CN1 to CN6 and the upper (upper row) launchers CN13 to CN18 are controlled so as to sequentially fire air. Also good.

  For example, at the time of occurrence of the above-described normal air-hit hit event, air is sequentially fired to the middle stage launching devices CN7 to CN12. On the other hand, when a special balloon hit event occurs, the lower, middle, and upper launching devices CN1 to CN6, CN7 to CN12, and CN13 to CN18 are sequentially fired. For example, launchers CN1, CN7, CN13 launch air, then launchers CN2, CN8, CN14 launch air, and so on. Launchers CN6, CN12, CN18 launch air. By doing in this way, the control processing which makes the firing output degree of the launching part 50 substantially strong can be realized.

  In addition, in FIGS. 13A to 15B, the case where the hit direction DH (hit vector VH) is oblique with respect to the direction in which the user character CH (user US) faces is described. It is not limited to this. For example, the hit direction DH (hit vector VH) does not depend on the direction in which the user character CH (user US) faces, and may be an oblique direction with respect to the position of the user character CH arranged in the virtual space field. For example, in FIG. 13A, even when the user US turns to the left oblique direction instead of the front direction, and the user character CH turns to the left oblique direction in conjunction therewith, as shown in FIG. 13B to FIG. You may perform the control process of the discharge part 50. FIG. The same applies to the case where the user US turns to the right diagonal direction instead of the front direction in FIG. 15A and the user character CH turns to the right diagonal direction in conjunction therewith.

3.4 Control of Launch Direction In this embodiment, as shown in FIG. 1, launch unit 50 includes launch unit direction changing unit 52 that changes the direction of launch unit 50, and changes the launch unit direction according to the game situation. The unit 52 is controlled. Alternatively, the launching unit 50 includes a launching device direction changing unit 54 that changes the directions of a plurality of launching devices, and controls the firing device direction changing unit 54 according to the game situation.

  For example, in FIGS. 16A to 16C, the launching unit direction changing unit 52 changes the direction of the launching unit 50 according to the game situation. For example, in FIG. 16A, the direction DRA of the launch unit 50 (the direction orthogonal to the main surface of the launch unit) is set so as to launch air from the front direction of the user US. On the other hand, in FIG. 16B, the direction DRA of the launching unit 50 is changed by the launching unit direction changing unit 52 so as to launch air from the diagonally left direction of the user US. In FIG. 16C, the direction DRA of the launching unit 50 is changed by the launching unit direction changing unit 52 so that air is launched from the diagonally right direction of the user US. In this way, the direction DRA of the launching unit 50 can be controlled so that air is launched from an appropriate direction according to the game situation.

  17A to 17C, the position of the user US is detected, and the direction of the launching unit 50 is controlled by the launching unit direction changing unit 52.

  For example, in FIG. 17A, since the user US is located at the middle position on the front side of the launch unit 50, the direction DRA of the launch unit 50 is set so that air is emitted from the front direction of the user US. Yes. On the other hand, in FIG. 17B, since the user US is moving in the right direction with respect to the launching unit 50, air is appropriately fired from the front direction to the user US that has moved in the right direction. Further, the direction DRA of the launch unit 50 is changed by the launch unit direction changing unit 52. In FIG. 17C, since the user US is moving leftward with respect to the launching unit 50, air is appropriately fired from the front direction of the user US moving in the leftward direction. The direction DRA of the launch unit 50 is changed by the launch unit direction changing unit 52.

  In this way, by controlling the direction of the emitting unit 50 by the emitting unit direction changing unit 52, it becomes possible to emit air to the user US with higher accuracy. Further, even when the position of the user changes, air can be emitted to the user in a more appropriate direction.

  In FIGS. 18A and 18B, the direction of the launching devices CN7 to CN12 of the launching unit 50 is controlled by the launching device direction changing unit 54.

  For example, in FIG. 18A, the directions of the launching devices CN7, CN8, CN9, CN10, CN11, CN12 (air launching directions) are set to D7, D8, D9, D10, D11, D12, respectively. The direction is changed toward the user US. For example, the directions D7 to D12 of the launchers CN7 to CN12 are changed as if the lens is focused on the user US. By doing so, it becomes possible to fire air from the launching devices CN7 to CN12 so that the projectiles of air are concentrated at the location of the user US.

  In FIG. 18B, two users US1 and US2 play a multiplayer game. In this case, the directions D7, D8, and D9 of the launchers CN7, CN8, and CN9 are changed so as to be concentrated toward the user US1, and the directions D10, D11, and D12 of the launchers CN10, CN11, and CN12 are changed. , It is changed so as to concentrate on the user US2. By doing so, it becomes possible to control the air firing direction of the launching devices CN7 to CN12 so that the air projecting bullets are concentrated on each of the users US1 and US2, and control of the firing direction optimal for the multiplayer game. Can be realized.

3.5 Various Control Processes Various control processes of the launch unit 50 according to this embodiment will be described below.

  In the present embodiment, a process of arranging (moving) a bullet generation source object in a hit event in which a bullet hits in the virtual space at a position in the virtual space corresponding to the position of the launching unit 50 in the real space is performed. For example, an enemy character that is a balloon generation source object in a hit event is controlled in position in the virtual space and positioned in the direction of the launch unit 50 in the real space before the hit event. For example, the enemy character moves within a range that can be handled by the launching unit 50.

  For example, in FIG. 19A, the direction of the user US is directed to the left oblique direction with respect to the launching unit 50 located in the front direction in the real space. Therefore, when the launch unit 50 emits air in this state, the air hits the right side portion such as the right shoulder of the user US. In FIG. 19B, the enemy character CHE attacks the user character CH corresponding to the user US in the virtual space. In this case, the enemy character CHE in FIG. 19B moves to a position in the virtual space corresponding to the position of the launching unit 50 in the real space shown in FIG. That is, the enemy character CHE located in the direction facing the user character CH is moving in an obliquely right direction with respect to the direction facing the user character CH. Then, the enemy character CHE fires a balloon AR in such a positional relationship, and when the balloon AR hits, the launching unit 50 fires air to the user US in the positional relationship shown in FIG.

  In this way, when the enemy character CHE located in the right diagonal direction of the user character CH in the virtual space of FIG. 19B fires a bullet AR and hits the right side portion of the user character CH, accordingly. Even in the real space of FIG. 19A, the air from the launching unit 50 hits the right portion of the user US. Therefore, an event in the virtual space (an event in which a bullet hits from the right diagonal direction) and an event in the real space (an event in which air hits from the right diagonal direction) coincide with each other. Can be improved.

  In FIG. 20A, the direction of the user US faces the front direction with respect to the launching unit 50 located in the front direction in the real space. In this case, the enemy character CHE moves to the left of the user character CH as shown in FIG. 20 (B), and the launching devices CN7 to CN12 are fired sequentially in time series as shown in FIG. 20 (C). Control may be performed. That is, the launchers CN7 to CN12 sequentially fire air along the first direction DR1 that intersects the vertical direction DRV. By controlling the air emission in this way, as described with reference to FIGS. 13A to 14, it is possible to give the user US a sensation as if the air emitted from the left diagonal direction of the user US was hit. it can. Therefore, when the enemy character CHE moves in the diagonally left direction of the user character CH as shown in FIG. 20B and fires a bullet AR from the diagonally left direction, as shown in FIG. By performing 50 launch control, the event in the virtual space and the event in the real space coincide with each other, and the virtual reality of the user US can be improved.

  Further, in the present embodiment, user information (user tracking information) including at least one of position information, direction information, and posture information of the user wearing the HMD is acquired, and control of the launch unit 50 according to the acquired user information is performed. Do.

  For example, FIG. 21 shows an example of a gun shooting game (FPS) played by a plurality of users US1 to US4 in the field FL. The users US1 to US4 wear HMD1 to HMD4 and have gun type controllers GN1 to GN4. These users US1 to US4 form a team (group) for a team battle game, for example. A video in the virtual space is displayed on the HMD1 to HMD4, and the users US1 to US4 play a gun shooting game while watching the video.

  In FIG. 22, the user US1 is moving as indicated by A1 and A2 in the field FL. In addition, launch sections 50A to 50F are arranged in the field FL. In this case, the launchers 50A to 50F are controlled based on the acquired position information of the user US1. For example, when it is detected based on the position information of the user US1 that the user US1 is near the launch unit 50A, the launch unit 50A launches air to the user US1. When it is detected based on the position information that the user US1 is near the launch unit 50D, the launch unit 50D launches air. When it is detected based on the position information that the user US1 is near the launch unit 50E, the launch unit 50E launches air. In this way, it is possible to realize appropriate air emission control according to the position of the user US1. In this case, the air fired by the launchers 50A to 50F may be based on an attack from an enemy in the virtual space in the place. Alternatively, in order to inform the user US1 of the boundary of the field FL, air may be emitted by the emission units 50A to 50F.

  Further, the launching unit may be controlled based on the acquired user direction information. For example, when a plurality of projecting units are arranged in a real space field, a projecting unit that is positioned in front of the user is preferentially selected, and air is emitted from the selected projecting unit. May be. In this way, it is possible to realize appropriate air emission control according to the direction in which the user faces.

  Further, the launching unit may be controlled based on the acquired user posture information. For example, when the user is in a posture lying on the ground, control is performed so that the lower launching devices CN1 to CN6 in FIG. When the user is in a squatting posture, control is performed to cause the middle stage launching devices CN7 to CN12 to emit air. When the user is in a standing posture, control is performed so that the upper launch devices CN13 to CN18 emit air. In this way, it is possible to realize appropriate air emission control according to the user's posture.

  Further, in the present embodiment, a game effect process is performed in which sound, vibration, or an image is interlocked with the emission of air (gas) in the emission unit 50.

  For example, as shown in FIG. 23, the vibration parts VB1, VB2, and VB3 are provided in the areas AR1, AR2, and AR3 of the field FL where the user US plays. Then, as described with reference to FIGS. 11A to 12B, the vibration units VB1, VB2, and VB3 vibrate in conjunction with the air emission from the emission unit 50. For example, the vibration parts VB1, VB2, and VB3 vibrate at the timing when the air is emitted or when the air is expected to hit the user US. The vibration part VB1 is realized by, for example, a vibration motor, and a relatively vigorous vibration game effect can be achieved. The vibration parts VB2 and VB3 are realized by transducers, and for example, a game effect by flexible vibration control using sound signals becomes possible.

  Moreover, you may perform the game production | presentation process which makes a sound interlock | cooperate with the discharge of the air in the discharge part 50. For example, in FIG. 23, speakers SP1 to SP5 that realize stereophonic sound are arranged and set. These speakers SP1 to SP5 may be real speakers or virtual speakers realized by headphones or the like. Then, a stereophonic game effect process called surround or pseudo-surround is performed using these speakers SP1 to SP5. Then, for example, as shown in FIG. 13A, when a bullet is blown from the left diagonal direction with respect to the user character CH, the surround effect that sounds like a bullet is blown from the left diagonal direction is given by the speaker SP1. Implemented using ~ SP5. At this time, for example, a game effect by an image such as adding an effect image may be performed on an image of a bullet. That is, a game effect process is performed in which the effect image is linked to the air emission from the emission unit 50. Furthermore, as shown in FIG. 23, game effect processing using the fans FN1 to FN3 provided in the launching unit 50 may be performed. For example, as described above, when a special balloon hits the user character CH, in order to realize the reverberation of the hit, the fans US are blown from the fans FN1 to FN3 after the hit. In this case, you may perform the game production | presentation process which controls the ventilation time and the intensity | strength of ventilation of the air blowers FN1-FN3 according to the power (attack power) of a special air bullet.

  In the present embodiment, as shown in FIG. 1, the launch unit 50 includes a processing unit 56, and the processing unit 56 processes the air (gas) emitted by the launch unit 50. For example, the process part 56 performs the process which changes the temperature of the air to discharge | emit, or performs the process which gives a scent to the air to discharge | release. Moreover, the process which changes the humidity of the air to discharge | release may be performed and the process which mixes water, snow, etc. with air may be performed, or air like a mist may be discharged. Moreover, the process part 56 may process with respect to the air which the discharge devices CN1-CN18 discharge, and may process with respect to the air which the air blowers FN1-FN3 blow.

  In this case, in the present embodiment, it is desirable to perform different processing on the air (gas) to be fired between the first launching device and the second launching device of the plurality of launching devices.

  For example, in FIG. 24, among the launching devices CN1 to CN18 of the launching unit 50, processing X is performed on the air fired by the lower launching devices CN1 to CN6, and the air fired by the middle launching devices CN7 to CN12 is performed. Then, processing Y is performed, and processing Z is performed on the air emitted by the upper launching devices CN13 to CN18. Processes X, Y, and Z are different processes. For example, when performing processes that change the temperature and humidity of the air, the processes X, Y, and Z are processes that change the air to temperatures and humidity that are different from each other. . Further, when processing that adds scent to air is performed, the processing X, Y, and Z are processing that give different scents.

  In FIG. 25, as described with reference to FIG. 22, the user US1 moves the field FL as indicated by A1 and A2. In this case, for example, processing X is performed on air emitted from the launch units 50A and 50B, processing Y is performed on air emitted from the launch units 50C and 50D, and fired from the launch units 50E and 50F. Machining Z is performed on the air. If it does in this way, according to the area where user US1 is located, the air in which different processing was performed will be launched to user US1. For example, when the user US1 is located in the area of the launch units 50A and 50B, the air of the first temperature or the first humidity is fired or the air of the first scent is fired. When the user US1 is located in the area of the launch units 50C and 50D, air of the second temperature or second humidity is fired or air of the second scent is fired. When the user US1 is located in the area of the launch units 50E and 50F, the air of the third temperature or the third humidity is fired or the air of the third scent is fired.

  If it does in this way, according to the area where user US1 is located, the air of different temperature or humidity, or the air of a different fragrance will be discharged with respect to a user, and it is more diverse and has high game production effect. Air emission control can be realized.

4). Detailed Processing Next, a detailed processing example of this embodiment will be described with reference to the flowchart of FIG.

  First, it is determined whether or not a bullet has been fired (step S1). For example, in the virtual space, it is determined whether the enemy character that is the source object has fired a bullet. If a bullet is fired, it is determined whether the fired bullet has hit the user character (step S2). For example, hit determination processing such as intersection determination between the trajectory of the bullet and the hit volume of the user character is performed to determine whether the bullet hits the user character. When a bullet is hit, the hit direction or hit vector of the bullet is acquired (step S3). For example, the hit direction and hit vector are obtained based on the movement direction and movement speed of the bullet when the bullet hits the user character. Then, a launching device selection process, a firing timing control process, and a firing output degree control process corresponding to the hit direction or hit vector of the air bullet are performed to fire the air (step S4).

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, in the specification or drawings, terms (air, air bombs, enemy characters, user characters) described at least once together with different terms (gas, hit object, source object, user moving object, etc.) having a broader meaning or the same meaning Etc.) may be replaced by the different terms anywhere in the specification or drawings. The virtual space setting process, game process, launcher control process, launcher control process, display process, user information acquisition process, moving object move process, hit calculation process, and the like have also been described in this embodiment. The present invention is not limited to these, and techniques, processes, and configurations equivalent to these are also included in the scope of the present invention. The present invention can be applied to various games. Further, the present invention can be applied to various simulation systems such as a business game device, a home game device, or a large attraction system in which a large number of users participate.

CN1-CNM launcher, FN1-FN3 blower, FL, VFL field,
AR1 to AR3 region, VB1 to VB3 vibration part,
CH User character, AR bullet (object hit),
CHE, CHE1 to CHE3 Enemy character (source object),
HMD, HMD1 to HMD4 head-mounted display device, SP1 to SP4 speaker,
US, US1-US4 user, GN1-GN4 gun type controller,
DH hit direction, VH hit vector, DR1, DR2 first and second directions,
DRV vertical direction, DRA, D7-D12 direction,
40 housing, 50, 50A to 50F launching unit, 52 launching unit direction changing unit,
54 launching device direction changing unit, 60 processing device, 62, 64 support unit, 70 launching device,
72 Speaker, 74 Diaphragm, 76 Air accumulator, 78 Launch port,
100 processing units, 102 input processing units, 110 arithmetic processing units, 111 information acquisition units,
112 virtual space setting unit, 113 moving body processing unit, 114 virtual camera control unit,
115 game processing unit, 116 hit calculation processing unit, 118 control unit,
120 display processing unit, 130 sound processing unit, 140 output processing unit,
150 imaging unit, 151, 152 camera, 160 operation unit,
170 storage unit, 172 object information storage unit, 178 drawing buffer,
180 Information storage medium, 192 sound output unit, 194 I / F unit,
195 portable information storage medium, 196 communication unit,
200 HMD (head-mounted display device), 201-203 light receiving element, 210 sensor unit,
220 display unit, 231 to 236 light emitting element, 240 processing unit,
251, 252, 253 tracking device, 260 headband,
270 headphones, 280, 284 base station,
281, 282, 285, 286 Light emitting element

Claims (12)

An information acquisition unit that acquires user information including at least one of position information, direction information, and posture information of a user who wears the head-mounted display device so as to cover the field of view;
A virtual space setting unit for performing virtual space setting processing;
A game processing unit for processing a game in the virtual space;
A control unit for controlling a launching unit capable of emitting a gas to the user;
A display processing unit that generates a display image of the head-mounted display device worn by the user;
Including
In the launch unit, a plurality of launch devices are arranged,
The controller is
The simulation system characterized by performing the control process of the said emission part according to the game condition and the said user information in the said virtual space. In claim 1,
In the launch unit, a plurality of the launch devices are arranged in a matrix,
The controller is
A simulation system that performs control processing of a plurality of the launching devices arranged in a matrix. In claim 1 or 2,
The controller is
When a hit event that hits the hit object corresponding to the gas occurs in the virtual space, the launching device selection process in the launching unit, the gas firing timing control process, and the gas firing output A simulation system characterized by performing at least one of degree control processing. In claim 3,
The controller is
Depending on the hit direction or hit vector of the hit object, at least one of the selection process of the launching device in the launching unit, the control process of the gas firing timing, and the control process of the gas firing output degree is performed. A simulation system characterized by performing. In claim 3 or 4,
The plurality of launchers include first to Nth launchers along a first direction intersecting a vertical direction,
The controller is
When the hit event occurs in which the hit object hits in an oblique direction with respect to the user moving object corresponding to the user, the gas is sequentially supplied from the first launching device to the Nth launching device. A simulation system, characterized in that the launching unit is controlled to be fired. In any one of Claims 1 thru | or 5,
The launcher includes a launcher direction changer that changes the direction of the launcher,
The controller is
A simulation system that controls the launching unit direction changing unit according to the game situation. In any one of Claims 1 thru | or 6.
The launcher includes a launcher direction changing unit that changes the direction of the plurality of launchers,
The controller is
A simulation system that controls the launching device direction changing unit according to the game situation. In any one of Claims 1 thru | or 7,
The virtual space setting unit
A process of placing the generation object of the hit object in a hit event where the hit object corresponding to the gas hits in the virtual space at a position in the virtual space corresponding to the position of the launching unit in real space is performed. A simulation system characterized by that. In any one of Claims 1 thru | or 8.
The game processing unit
A simulation system characterized by performing a game effect process in which sound, vibration, or an image is linked to the gas emission at the emission unit. In any one of Claims 1 thru | or 9,
The simulation system, wherein the launching unit includes a processing unit that processes the gas to be fired. In claim 10,
The processed portion is
A simulation system characterized in that different processing is performed on the gas to be emitted by the first launching device and the second launching device of the plurality of launching devices. An information acquisition unit that acquires user information including at least one of position information, direction information, and posture information of a user who wears the head-mounted display device so as to cover the field of view;
A virtual space setting unit for performing virtual space setting processing;
A game processing unit for processing a game in the virtual space;
A control unit for controlling a launching unit capable of emitting a gas to the user;
As a display processing unit that generates a display image of the head-mounted display device worn by the user,
Make the computer work,
In the launch unit, a plurality of launch devices are arranged,
The controller is
The program which performs the control process of the said emission part according to the game situation in the said virtual space, and the said user information.