JP2019176934A - Simulation system - Google Patents

Abstract

To provide a simulation system, etc. capable of appropriately notifying a user of an occurrence of an attack event.SOLUTION: A simulation system includes a plurality of launching devices LC1-LC6 provided in the periphery of a play area AR of a user US for launching a substance that provides a tactile stimulus to the user US, and a control part for controlling the launching of the substance by the plurality of launching devices LC1-LC6 according to a status of a game that the user US plays. In a notification event EVI that notifies the user US of an occurrence of an attack event beforehand, the control part executes control to cause the launching device corresponding to the notification event of the plurality of launching devices LC1-LC6 to launch the substance to provide a tactile stimulus.SELECTED DRAWING: Figure 16

Description

  The present invention relates to a simulation system and the like.

  2. Description of the Related Art Conventionally, simulation systems that generate images that can be viewed from a virtual camera in a virtual space are known. For example, as a prior art of a simulation system that realizes virtual reality (VR) by displaying an image seen from a virtual camera on an HMD (head-mounted display device), there is a technique disclosed in Patent Document 1. Further, as a conventional technique of a system that provides an actuator in a game controller and performs tactile feedback by vibration, there is a technique disclosed in Patent Document 2.

JP-A-11-309269 Japanese Patent Laid-Open No. 2003-199974

  In the prior art disclosed in Patent Document 2, haptic feedback is performed to give a haptic stimulus by vibration of an actuator provided in a game controller or the like.

  However, in the conventional method, for example, the impact when a gun is shot during a game, the vibration transmitted to the handle in a drive game, and the like are made to feel to the user by tactile feedback. For example, there has been no proposal for a technique that uses tactile stimulation to notify in advance of the occurrence of an attack event.

  According to some aspects of the present invention, it is possible to provide a simulation system or the like that can appropriately notify a user that an attack event has occurred.

  According to one aspect of the present invention, a plurality of launch devices that are provided around a user's play area and that fire a substance that gives a tactile stimulus to the user, and the plurality of launch devices according to a situation of a game played by the user. A control unit that controls the emission of the substance of the launching device, wherein the control unit is a notification event that notifies the user in advance that an attack event occurs, The present invention relates to a simulation system that performs control for causing the emission device corresponding to the notification event to emit the substance that gives tactile stimulation.

  According to one aspect of the present invention, a plurality of launching devices that launch a substance that gives tactile stimulation to the user are provided around the user's play area, and a plurality of launching devices are provided according to the situation of the game played by the user. The launch of the launcher's material is controlled. Then, the launching device corresponding to the notification event among the plurality of launching devices fires a substance that gives a tactile stimulus, thereby informing the user in advance that an attack event occurs. In this way, before the occurrence of the attack event, the user can know in advance that the attack event will occur due to the tactile stimulus by the substance emitted from the launching device. Therefore, it is possible to provide a simulation system or the like that can appropriately notify the user that an attack event has occurred.

  In one aspect of the present invention, a virtual space setting unit that performs virtual space setting processing, a game processing unit that performs processing of the game in the virtual space, and at least the position information, direction information, and posture information of the user Including user information including one and an information acquisition unit that acquires game situation information, wherein the control unit controls the launching device based on at least one of the user information and the game situation information. Also good.

  By doing in this way, the launch control of the substance by the launch device reflecting the user information and the game situation information can be realized.

  In one embodiment of the present invention, at least one of the user's vision and hearing may be in an occluded state.

  In this way, when the user's vision and hearing are in an obstructed state, it becomes difficult for the user to grasp the surrounding situation by vision and hearing. Even in such a case, by using a tactile stimulus by the substance by launching the substance with the launching device, an attack event is generated in advance for a user whose vision or hearing is blocked. Can be notified.

  In one aspect of the present invention, a display processing unit that generates a display image of a head-mounted display device that the user wears so as to cover the field of view may be included based on a result of the game process.

  By using the head-mounted display device in this way, while expressing the VR space spreading in the user's field of view, it is possible in advance for the user to generate an attack event due to a tactile stimulus by a substance emitted from the emission device. Can be notified.

  Moreover, in one aspect of the present invention, a rocking mechanism that rocks the play area of the user may be included.

  In this way, when an attack event occurs after the occurrence of the notification event, the user's play area is swung by the rocking mechanism, and the user can feel that the attack event has occurred by rocking the play area. It becomes possible to make it.

  In the aspect of the invention, the swing mechanism may include at least one air spring portion, and the play area may be swung by the air spring portion.

  In this way, the play area can be swung with a simple configuration using at least one air spring, and the user can feel that an attack event has occurred by swinging the play area. Become.

  In the aspect of the invention, the swing mechanism may swing the play area when the attack event occurs after the notification event occurs.

  In this way, in the notification event, the launch device fires a substance that gives a tactile stimulus, thereby informing the user in advance that an attack event will occur, and in the attack event, the play area is shaken. By moving it, it is possible to let the user experience the occurrence of an attack.

  In one aspect of the present invention, the swing mechanism swings the play area with a different swing amount when the attack event occurs within the visual field range of the user and when the attack event occurs outside the visual field range. It may be moved.

  In this way, depending on whether an attack event occurs within the field of view or outside the field of view, the degree of bodily sensation given to the user by the swing of the swing mechanism varies. Experience control is possible.

  Moreover, in one aspect of the present invention, the notification event may be an event that occurs when an attacker that attacks the user in the attack event moves.

  In this way, when an attacking body that moves toward the user in an attack event attacks, the notification event notifies the user in advance that the attacking body will attack. Is possible.

  Further, according to one aspect of the present invention, it may include a play area restriction mechanism that restricts the play area that the user can rotate to a given range.

  In this way, the movement range of the user who moves freely in the play area can be restricted using the play area restriction mechanism.

  Further, according to one aspect of the present invention, a plurality of launching devices that are provided around a user's play area and launch a substance that gives tactile stimulation to the user, and the game played by the user, A control unit that controls the launch of the substance of a plurality of launch devices; and a play area limiting mechanism that limits the play area that the user can rotate to a given range, the control unit comprising: Further, the present invention relates to a simulation system that performs control to cause the emission device corresponding to the notification event, among the plurality of emission devices, to emit the substance that gives a tactile stimulus when the notification event occurs around the user.

  According to one aspect of the present invention, a plurality of launching devices that launch a substance that gives tactile stimulation to the user are provided around the user's play area. And according to the situation of the game which a user plays, while the discharge of the substance of a plurality of launchers is controlled, the play area which a user can move freely is restricted to a given range by a play area restriction mechanism. The In this way, the range of movement of the user who moves freely in the play area can be restricted using the play area restriction mechanism, and the simulation system can be performed by the user performing improper or inadvertent actions. Can prevent troubles in the operation of the system.

  In the aspect of the invention, the play area restriction mechanism may include a restriction member provided so as to surround the user.

  In this way, it is possible to prevent the user from performing inappropriate or inadvertent operations by limiting the play area in which the user can rotate freely to a given range by using the limiting member. become.

  In one aspect of the present invention, the play area limiting mechanism may include a moving unit that is attached to the user and rotates on the limiting member as the user rotates.

  If it does in this way, it will become possible to restrict the play area which a user can move freely to a given range using a restricting member and a moving part attached to a user and moving on a restricting member.

  In one aspect of the present invention, the control unit may include the substance on a launching device provided outside the visual field range among the multiple launching devices when the notification event occurs outside the visual field range of the user. You may perform control which fires.

  By doing in this way, when an attack event occurs in a place that is out of the visual field range and cannot be seen by the user, it is possible to notify the user in advance that the attack event occurs.

  In one embodiment of the present invention, the projecting device may eject gas as the substance that provides tactile stimulation.

  Thus, by using gas as a substance that gives tactile stimulation, it is possible to realize a launching device suitable for hygiene and management of the simulation system.

The block diagram which shows the structural example of the simulation system of this embodiment. 2A and 2B are explanatory diagrams of an example of tracking processing of the HMD. 3A and 3B are explanatory diagrams of another example of the HMD tracking process. The perspective view which shows the specific structural example of the simulation system of this embodiment. The side view which shows the specific structural example of the simulation system of this embodiment. The example of the game image produced | generated by this embodiment. The example of the game image produced | generated by this embodiment. Explanatory drawing of the game implement | achieved by this embodiment. Explanatory drawing of the game implement | achieved by this embodiment. Explanatory drawing of the game implement | achieved by this embodiment. Explanatory drawing of the game implement | achieved by this embodiment. Explanatory drawing of the game implement | achieved by this embodiment. Explanatory drawing of the game implement | achieved by this embodiment. Explanatory drawing of the game implement | achieved by this embodiment. FIGS. 15A and 15B are explanatory views of the arrangement of the launching device and the attacking body. FIG. 16A and FIG. 16B are explanatory diagrams of the notification method of the present embodiment. FIG. 17A and FIG. 17B are explanatory diagrams of the notification method of the present embodiment. Explanatory drawing of the rocking method of the play area by a rocking mechanism. 19A and 19B are explanatory diagrams of a swing amount control method according to the visual field range. FIG. 20A and FIG. 20B are explanatory diagrams of a play area restriction method by a play area restriction mechanism. The flowchart explaining the detailed process example of this embodiment. The flowchart explaining the detailed process example of this embodiment.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Simulation System FIG. 1 is a block diagram showing a configuration example of a simulation system (simulator, game system, image generation system) of the present embodiment. The simulation system of this embodiment is a system that simulates virtual reality (VR), for example, a game system that provides game content, a real-time simulation system such as a driving simulator and a sports competition simulator, a system that provides SNS services, and video The present invention can be applied to various systems such as a content providing system that provides content such as an operating system that implements remote work. Note that the simulation system of the present embodiment is not limited to the configuration shown in FIG. 1, and various modifications such as omitting some of the components (each unit) or adding other components are possible.

  The reaction force generation device 10 is a device having a reaction force generation mechanism and generates, for example, a reaction force acting on the opposite side (opposite direction side) to the swing direction of the user's swing motion. The launchers LC1 to LCN are devices that launch a substance that gives tactile stimulation to the user. Details of the launchers LC1 to LCN and the reaction force generator 10 will be described later.

  The movable housing 60 (a housing in a broad sense) is a housing that changes the play position (play area) of the user. The movable housing 60 is called, for example, an arcade housing. The movable casing 60 may be a ride casing that a user rides, a cockpit casing (sensory casing) in a car game, a robot game, an airplane game, or the like, or a casing of another form. It may be a body. The movable housing 60 is a main part of the simulation system, and is provided with various devices and structures for realizing the simulation system. At least a play position (play area) is set in the movable housing 60. A detailed example of the movable housing 60 will be described later.

  The operation unit 160 is for a user (player) to input various operation information (input information). The operation unit 160 can be realized by various operation devices such as a grasped object 40 (game controller) gripped by the user, a lever, an operation button, a direction instruction key, or a voice input device, for example.

  The storage unit 170 stores various types of information. The storage unit 170 functions as a work area such as the processing unit 100 or the communication unit 196. The game program and game data necessary for executing the game program are held in the storage unit 170. The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), HDD (Hard Disk Drive), SSD, optical disk device, or the like. The storage unit 170 includes an object information storage unit 172 and a drawing buffer 178.

  The information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and its function can be realized by an optical disk (DVD, BD, CD), HDD, semiconductor memory (ROM), or the like. . The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, in the information storage medium 180, a program for causing a computer (an apparatus including an input device, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

  The HMD 200 (head-mounted display device) is a device that is mounted on the user's head and displays an image in front of the user's eyes. The HMD 200 is preferably a non-transmissive type, but may be a transmissive type. The HMD 200 may be a so-called glasses-type HMD.

  The HMD 200 includes a sensor unit 210, a display unit 220, and a processing unit 240. A modification in which a light emitting element is provided in the HMD 200 is also possible. The sensor unit 210 is for realizing tracking processing such as head tracking, for example. For example, the position and direction of the HMD 200 are specified by tracking processing using the sensor unit 210. By specifying the position and direction of the HMD 200, the user's viewpoint position and line-of-sight direction can be specified.

  Various methods can be adopted as the tracking method. In the first tracking method, which is an example of the tracking method, a plurality of light receiving elements (photodiodes and the like) are provided as the sensor unit 210, as will be described in detail with reference to FIGS. 2A and 2B described later. Then, by receiving light (laser or the like) from a light emitting element (LED or the like) provided outside by the plurality of light receiving elements, the position of the HMD 200 (user's head) in the real world three-dimensional space, Identify the direction. In the second tracking method, a plurality of light emitting elements (LEDs) are provided in the HMD 200 as will be described in detail with reference to FIGS. 3A and 3B described later. And the position and direction of HMD200 are pinpointed by imaging the light from these light emitting elements with the imaging part provided outside. In the third tracking method, a motion sensor is provided as the sensor unit 210, and the position and direction of the HMD 200 are specified using this motion sensor. The motion sensor can be realized by, for example, an acceleration sensor or a gyro sensor. For example, by using a 6-axis motion sensor using a 3-axis acceleration sensor and a 3-axis gyro sensor, the position and direction of the HMD 200 in a three-dimensional space in the real world can be specified. Note that the position and direction of the HMD 200 may be specified by a combination of the first tracking method and the second tracking method, or a combination of the first tracking method and the third tracking method. Further, instead of specifying the user's viewpoint position and line-of-sight direction by specifying the position and direction of the HMD 200, tracking processing that directly specifies the user's viewpoint position and line-of-sight direction may be employed.

  The display unit 220 of the HMD 200 can be realized by, for example, an organic EL display (OEL) or a liquid crystal display (LCD). For example, the display unit 220 of the HMD 200 includes a first display or first display area set in front of the user's left eye and a second display or second display area set in front of the right eye. It is provided and stereoscopic display is possible. When performing stereoscopic display, for example, a left-eye image and a right-eye image with different parallax are generated, a left-eye image is displayed on the first display, and a right-eye image is displayed on the second display. To do. Alternatively, the left-eye image is displayed in the first display area of one display, and the right-eye image is displayed in the second display area. The HMD 200 is provided with two eyepiece lenses (fisheye lenses) for the left eye and the right eye, thereby expressing a VR space that extends over the entire perimeter of the user's field of view. Then, correction processing for correcting distortion generated in an optical system such as an eyepiece is performed on the left-eye image and the right-eye image. This correction process is performed by the display processing unit 120.

  The processing unit 240 of the HMD 200 performs various processes necessary for the HMD 200. For example, the processing unit 240 performs control processing of the sensor unit 210, display control processing of the display unit 220, and the like. Further, the processing unit 240 may perform a three-dimensional sound (stereoscopic sound) process to realize reproduction of a three-dimensional sound direction, distance, and spread.

  The sound output unit 192 outputs the sound generated by the present embodiment, and can be realized by, for example, a speaker or headphones.

  The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and the function can be realized by an ASIC for I / F processing or the like. The portable information storage medium 195 is for a user to save various types of information, and is a storage device that retains storage of such information even when power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

  The communication unit 196 communicates with the outside (another apparatus) via a wired or wireless network, and functions thereof are hardware such as a communication ASIC or communication processor, or communication firmware. Can be realized.

  A program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the server (host device) to the information storage medium 180 (or storage unit 170) via the network and communication unit 196. May be. Use of an information storage medium by such a server (host device) can also be included in the scope of the present invention.

  The processing unit 100 (processor) is used for operation information from the operation unit 160, tracking information in the HMD 200 (information on at least one of the position and direction of the HMD, information on at least one of the viewpoint position and the line-of-sight direction), a program, and the like. Based on this, game processing (simulation processing), virtual space setting processing, moving body processing, virtual camera control processing, display processing, sound processing, or the like is performed.

  Each processing (each function) of this embodiment performed by each unit of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the function of each unit may be realized by individual hardware, or the function of each unit may be realized by integrated hardware. For example, the processor may include hardware, and the hardware may include at least one of a circuit that processes a digital signal and a circuit that processes an analog signal. For example, the processor can be configured by one or a plurality of circuit devices (for example, ICs) mounted on a circuit board or one or a plurality of circuit elements (for example, resistors, capacitors, etc.). The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) can be used. The processor may be an ASIC hardware circuit. The processor may include an amplifier circuit, a filter circuit, and the like that process an analog signal. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD) or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and the processing (function) of each unit of the processing unit 100 is realized by executing the instructions by the processor. The instruction here may be an instruction set constituting a program, or an instruction for instructing an operation to the hardware circuit of the processor.

  The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The arithmetic processing unit 110 includes an information acquisition unit 111, a virtual space setting unit 112, a moving body processing unit 113, a virtual camera control unit 114, a game processing unit 115, a control unit 117, a display processing unit 120, and a sound processing unit 130. As described above, each process of the present embodiment executed by these units can be realized by a processor (or a processor and a memory). Various modifications such as omitting some of these components (each unit) or adding other components are possible.

  The input processing unit 102 performs processing for receiving operation information and tracking information, processing for reading information from the storage unit 170, and processing for receiving information via the communication unit 196 as input processing. For example, the input processing unit 102 stores, in the storage unit 170, processing for acquiring operation information input by the user using the operation unit 160, tracking information detected by the sensor unit 210 of the HMD 200, and the information specified by the read command. A process for reading data from a computer or a process for receiving information from an external device (such as a server) via a network is performed as an input process. Here, the reception process includes a process of instructing the communication unit 196 to receive information, a process of acquiring information received by the communication unit 196, and writing the information in the storage unit 170, and the like.

  The arithmetic processing unit 110 performs various arithmetic processes. For example, arithmetic processing such as information acquisition processing, virtual space setting processing, moving body processing, virtual camera control processing, game processing (simulation processing), control processing, display processing, or sound processing is performed.

  The information acquisition unit 111 (program module for information acquisition processing) performs various information acquisition processing. For example, the information acquisition unit 111 acquires position information of the user wearing the HMD 200 and the like. The information acquisition unit 111 may acquire user direction information, posture information, movement information, and the like.

  The virtual space setting unit 112 (program module for virtual space setting processing) performs setting processing for a virtual space (object space) in which an object is placed. For example, moving objects (people, cars, robots, trains, airplanes, ships, monsters, animals, etc.), maps (terrain), buildings, spectator seats, courses (roads), items, trees, walls, water surfaces, etc. Various objects to be represented (objects composed of primitive surfaces such as polygons, free-form surfaces, or subdivision surfaces) are arranged and set in the virtual space. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Place the object. Specifically, in the object information storage unit 172 of the storage unit 170, object information that is information such as the position, rotation angle, moving speed, and moving direction of an object (part object) in the virtual space is associated with the object number. Is memorized. The virtual space setting unit 112 performs a process of updating the object information for each frame, for example.

  The moving body processing unit 113 (moving body processing program module) performs various processes on a moving body that moves in the virtual space. For example, processing for moving the moving body in virtual space (object space, game space) and processing for moving the moving body are performed. For example, the mobile object processing unit 113 is based on operation information input by the user through the operation unit 160, acquired tracking information, a program (movement / motion algorithm), various data (motion data), and the like. Control processing for moving the model object) in the virtual space or moving the moving object (motion, animation) is performed. Specifically, a simulation for sequentially obtaining movement information (position, rotation angle, speed, or acceleration) and motion information (part object position or rotation angle) of a moving body for each frame (for example, 1/60 second). Process. A frame is a unit of time for performing a moving / movement process (simulation process) and an image generation process of a moving object. The moving body is, for example, a user moving body corresponding to a user (player) in real space. For example, the moving body is a user character (avatar, player character) in a virtual space corresponding to a user in real space, or a moving body (boarding moving body, operation moving body) on which the user character is boarded (operated).

  The virtual camera control unit 114 (virtual camera control processing program module) controls the virtual camera. For example, a process for controlling the virtual camera is performed based on user operation information, tracking information, and the like input by the operation unit 160.

  For example, the virtual camera control unit 114 controls the virtual camera set as the first-person viewpoint or the third-person viewpoint of the user. For example, by setting a virtual camera at a position corresponding to the viewpoint (first-person viewpoint) of a user moving body moving in the virtual space, and setting the viewpoint position and line-of-sight direction of the virtual camera, the position (positional coordinates) of the virtual camera And control the attitude (rotation angle around the rotation axis). Alternatively, by setting a virtual camera at the position of the viewpoint (third-person viewpoint) following the moving body (user character, boarding moving body), and setting the viewpoint position and line-of-sight direction of the virtual camera, Control attitude.

  For example, the virtual camera control unit 114 controls the virtual camera so as to follow the change of the user's viewpoint based on the tracking information of the user's viewpoint information acquired by the viewpoint tracking. For example, in the present embodiment, tracking information (viewpoint tracking information) of viewpoint information that is at least one of the user's viewpoint position and line-of-sight direction is acquired. This tracking information can be acquired by performing tracking processing of the HMD 200, for example. The virtual camera control unit 114 changes the viewpoint position and line-of-sight direction of the virtual camera based on the acquired tracking information (information on at least one of the user's viewpoint position and line-of-sight direction). For example, the virtual camera control unit 114 is configured so that the viewpoint position and the line-of-sight direction (position, posture) of the virtual camera in the virtual space change according to changes in the viewpoint position and the line-of-sight direction of the user in the real space. Set up the camera. By doing in this way, a virtual camera can be controlled to follow a user's viewpoint change based on tracking information of a user's viewpoint information.

  The game processing unit 115 (game processing program module) performs various game processes for the user to play a game. In other words, the game processing unit 115 (simulation processing unit) executes various simulation processes for the user to experience virtual reality (virtual reality). The game process is, for example, a process for starting a game when a game start condition is satisfied, a process for advancing the started game, a process for ending a game when a game end condition is satisfied, or calculating a game result. Processing.

  The control unit 117 (control processing program module) performs control processing of the reaction force generator 10, the movable casing 60, and the launchers LC1 to LCN. For example, the control unit 117 controls the generation of the reaction force by the reaction force generator 10, performs control for changing the play position (play area) of the user by the movable housing 60, or uses the launchers LC <b> 1 to LCN. Processing to control the generation of substances.

  The display processing unit 120 (display processing program module) performs display processing of a game image (simulation image). For example, a drawing process is performed based on the results of various processes (game process, simulation process) performed by the processing unit 100, thereby generating an image and displaying it on the display unit 220. Specifically, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. Based on the processing result, drawing data (the position of the vertex of the primitive surface) Coordinates, texture coordinates, color data, normal vector, α value, etc.) are created. Based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is converted into image information in units of pixels such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. As a result, an image that can be seen from the virtual camera (given viewpoint, left eye and right eye first and second viewpoints) is generated in the virtual space (three-dimensional virtual space). Note that the drawing processing performed by the display processing unit 120 can be realized by vertex shader processing, pixel shader processing, or the like.

  The sound processing unit 130 (sound processing program module) performs sound processing based on the results of various processes performed by the processing unit 100. Specifically, game sounds such as music (music, BGM), sound effects, or sounds are generated, and the game sounds are output to the sound output unit 192. Note that part of the sound processing of the sound processing unit 130 (for example, three-dimensional sound processing) may be realized by the processing unit 240 of the HMD 200.

  The output processing unit 140 performs various types of information output processing. For example, the output processing unit 140 performs processing for writing information in the storage unit 170 and processing for transmitting information via the communication unit 196 as output processing. For example, the output processing unit 140 performs a process of writing information specified by a write command in the storage unit 170 or a process of transmitting information to an external apparatus (server or the like) via a network. The transmission process is a process of instructing the communication unit 196 to transmit information, or instructing the communication unit 196 to transmit information.

  The simulation system of FIG. 1 includes a plurality of launchers LC1 to LCN and a control unit 117. Launching devices LC1 to LCN (N is an integer of 2 or more) are provided around the user's play area, and fire a substance that gives tactile stimulation to the user. The control unit 117 controls the emission of the materials of the emission devices LC1 to LCN according to the situation of the game played by the user. The substances emitted by the emission devices LC1 to LCN are substances (gas, liquid, or solid) that cause the user's tactile sensation to be stimulated by touching the user's skin or the like, for example. For example, the launchers LC1 to LCN launch a gas (air bullet) as a substance that gives tactile stimulation. However, the emission of the substance by the emission devices LC1 to LCN is not limited to the emission of gas, and may be, for example, emission of liquid, water vapor, scented gas, BB bullet or telescopic rod. In addition, the launchers LC1 to LCN do not have to be arranged around the entire periphery of the user, and it is sufficient that a plurality of launchers are arranged at least within the visual field range of the user. The game situation includes, for example, the occurrence of various events (notification event, attack event, etc.) in the game, the progress of the game, the degree of achievement of the game (map clearing situation, acquisition points), and the like. For example, in a game using a character (moving body), the game situation is the situation of the character in the game, the situation specified based on the status parameter of the character, the situation of various events that occur for the character, etc. .

  And the control part 117 performs control which makes the selected launching device among launching devices LC1-LCN launch the substance which gives a tactile stimulus in an alerting | reporting event. For example, in a notification event that notifies a user in advance that an attack event will occur, among the plurality of launchers LC1 to LCN, a launcher corresponding to the alert event (one or a plurality of launches corresponding to the location where the alert event occurs) The device is controlled to fire a substance that gives tactile stimulation. For example, control is performed to cause the launching device to fire a substance for notifying the occurrence of a notification event toward a user who is the target of an attack event.

  In this way, before the occurrence of the attack event, the user can know in advance that the attack event will occur due to the tactile stimulus by the substance emitted from the launching device. Here, the attack event is an event in which an attacking body (attack element, attack object, notification element) attacks a user or a character (user character, avatar) corresponding to the user. The attacking object may be an attacking object such as an enemy character or bullet in the game space (virtual space), or may be an object that attacks the user in the real space. The notification event is an event that notifies the user in advance of the occurrence of this attack event. For example, when a notification event occurs in a game space (virtual space), the launching device corresponding to the notification event is located in a real space location (including a nearby location) corresponding to the location where the notification event occurs in the game space. A launcher or the like. When a notification event occurs in the real space, it is a launching device or the like in a location (including a nearby location) in the real space corresponding to the location where the notification event occurs in the real space.

  Note that the method of this embodiment may be applied to a system such as an electromechanical system in which there is no video of the game space. Further, the method of the present embodiment may be applied to a system that does not use the HMD 200.

  Further, the simulation system of the present embodiment includes a swing mechanism 66 that swings the play area of the user. For example, the swing mechanism 66 performs swing control that changes the posture of a unit or member in which a play area is set. For example, the swing mechanism 66 is controlled by the control unit 117. Specifically, the swing mechanism 66 is controlled based on the control signal generated by the control process of the control unit 117. For example, the simulation system of this embodiment includes a movable housing 60, and the movable housing 60 can include a swing mechanism 66. The play area is an area of a given size including the play position of the user, and is a field where the user plays the game. For example, when the simulation system includes the ride unit 62 as shown in FIGS. 4 and 5 described later, the play area is an area on the ride unit 62, for example. Then, the swing mechanism 66 swings the ride unit 62 where the play area is set. For example, the swing mechanism 66 changes the posture of the ride unit 62 (play area) such as pitching, rolling, or yawing. In this way, when an attack event occurs after the notification event, the user's play area is swung by the rocking mechanism 66. Therefore, the occurrence of an attack event can be experienced by the user by swinging the play area by the swing mechanism 66, and the virtual reality of the user can be improved.

  The swing mechanism 66 includes at least one air spring portion (63, 64, 65), and swings the play area by the air spring portion, as will be described later with reference to FIGS. The air spring portion (actuator in a broad sense) is a unit that expands and contracts when air is supplied or discharged using, for example, an air compressor or a bubble. For example, the swing mechanism 66 includes a plurality of air spring portions, and the swing of the play area of the user is controlled by controlling the amount of expansion / contraction of the plurality of air spring portions. In this way, the play area can be rocked with a simple configuration using at least one air spring, and the occurrence of an attack event is notified to the user by the rocking of the play area by the rocking mechanism 66. It will be possible to experience.

  The swing mechanism 66 swings the play area when an attack event occurs after the notification event occurs. For example, in the present embodiment, one or a plurality of launchers among the launchers LC1 to LCN launch a substance in a notification event that informs in advance that an attack event will occur. When an attack event occurs after the material is fired by the launching device, the rocking mechanism 66 rocks the user's play area. In this way, in the notification event, the launch device fires a substance that gives a tactile stimulus, thereby informing the user in advance that an attack event will occur, and in the attack event, the play area is shaken. By moving it, it is possible to let the user experience the occurrence of an attack.

  Note that the manner of swinging of the swing mechanism 66 (the direction of change in posture) may be changed according to the direction in which the attack is performed in the attack event. Further, after the notification event has occurred, for example, when the user performs an attack (counterattack) on the attacking body (attack object), the occurrence of the attack event may be canceled.

  The swing mechanism 66 swings the play area with a different swing amount depending on whether the attack event occurs within the visual field range of the user or outside the visual field range. As an example, if the attack event occurs within the visual field range of the user, the swing amount is increased, and if the attack event occurs outside the visual field range, the swing amount is decreased. In this way, depending on whether the attack event occurs within the field of view or outside the field of view, the degree of bodily sensation given to the user by the swinging of the swinging mechanism 66 varies. Control is possible. Note that the manner of swinging (direction of posture change) may be varied depending on whether it is within or outside the visual field range. The viewing range is, for example, a viewing angle range of a human being who is a user. For example, the viewing angle is about 200 degrees in the left-right direction (horizontal direction) and about 130 degrees in the up-down direction. Alternatively, the viewing field range may be a viewing angle range (for example, 90 degrees to 120 degrees) of the HMD 200 worn by the user.

  The notification event is an event that occurs when the attacking body (moving body) that attacks the user in the attack event moves. The attacking body is a subject that performs an attack, and is, for example, an attack object in a game space or an attack object in a real space. In the attack event, for example, when the attacking object moves so as to approach the user, the notification event is generated at the timing of starting the movement of the attacking object or at the timing when a given period has elapsed after starting the movement. To inform the user in advance that an attack event will occur. In this way, when an attacking body that moves toward the user in an attack event performs an attack, the notification event notifies the user in advance that the attacking body will attack. It becomes possible.

  The simulation system of this embodiment includes a play area restriction mechanism 76. For example, the movable housing 60 has a play area limiting mechanism 76. The play area restriction mechanism 76 is a mechanism for restricting a play area in which the user can freely rotate to a given range. For example, the user can rotate and move freely in the play area, but the translation movement in the play area is limited to a given range (movement range) by the play area restriction mechanism 76. For example, the user can rotate and rotate in the play area, for example, along a rotation axis along the vertical direction, but the movement in the play area in the horizontal direction, for example, is restricted to a given range by the play area restriction mechanism 76.

  In addition, the simulation system of the present embodiment includes a plurality of launchers LC1 to LCN provided around the user's play area, a control unit 117 that controls the launch of the materials of the launchers LC1 to LCN, and a play area limiting mechanism 76. Including. The play area restriction mechanism 76 restricts a play area in which the user can freely move to a given range. Then, when a notification event occurs around the user, the control unit 117 gives a tactile stimulus to the launching device corresponding to the notification event (the launching device corresponding to the location where the notification event occurs) among the launching devices LC1 to LCN. Control to fire the substance. If it does in this way, it will become possible to restrict | limit the moving range of the user who moves freely in a play area using the play area restriction | limiting mechanism 76, and a user performs a simulation by improper operation | movement or inadvertent operation | movement. It is possible to prevent troubles in system operation.

  The play area restriction mechanism 76 includes a restriction member 70 provided so as to surround the user as will be described later with reference to FIGS. 4, 5, 20 (A), 20 (B), and the like. For example, the restricting member 70 has a hole that the user can enter during game play, and the user plays a game surrounded by the peripheral edge of the hole. Then, translational movement (movement in the horizontal direction) in the play area of the user is limited to the range of the hole by the limiting member 70. In this way, by using the restricting member 70, it is possible to restrict the play area in which the user can freely move to a given range, thereby preventing the user from performing inappropriate or inadvertent operations. It becomes like this. In addition, when a hole part is formed in the limitation member 70, the shape of a hole part is not limited to circular shape, A various shape is employable.

  The play area restriction mechanism 76 is attached to the user as described later with reference to FIGS. 4, 5, 20 (A), 20 (B), and the like, and on the restriction member 70 as the user rotates. A moving unit 72 that rotates is included. For example, when the user rotates, the moving unit 72 also rotates on the restricting member 70 so as to follow the user's rotational movement. For example, the moving part 72 is provided with roller parts 73 (73-1, 73-2), and the moving part 72 moves while rotating on the restricting member 70, so that the moving part 72 becomes the restricting member 70. Rotate and move up. In this way, it is possible to limit the play area in which the user can rotate freely to a given range by using the limiting member 70 and the moving unit 72 attached to the user and moving on the limiting member 70. become.

  In addition, when a notification event occurs outside the visual field range of the user, the control unit 117 causes the launching device provided outside the visual field range among the plurality of launching devices LC1 to LCN to fire the substance. For example, in the present embodiment, the launching devices LC1 to LCN are provided around the user, and the launching device is arranged not only within the visual field range of the user but also outside the visual field range. For example, when the user is on the ride unit 62 described in FIGS. 4, 5, etc. at the reference ride position and the reference ride direction, not only within the visual field range that is the forward direction range of the user but also behind the user The launching device is arranged on the direction side (for example, right rear direction, left rear direction, or right rear direction). And when the notification event occurs in the rear direction of the user, among the launching devices arranged in the rear direction, the launching device corresponding to the notification event (launching device corresponding to the location where the notification event occurs) Fire a substance that provides tactile stimulation. By doing in this way, when an attack event occurs in a place that is out of the visual field range and cannot be seen by the user, it is possible to notify the user in advance that the attack event occurs.

  In addition, the emission devices LC1 to LCN emit gas as a substance that gives tactile stimulation. For example, by emitting a gas compressed by a compressor or the like, a tactile stimulus using a high static pressure gas can be realized. By using gas (air or the like) as a substance that gives tactile stimulation in this way, it becomes possible to realize a launching device suitable for hygiene and operation of the simulation system.

  Further, as shown in FIG. 1, the simulation system according to the present embodiment includes a virtual space setting unit 112 that performs a virtual space setting process, a game processing unit 115 that performs a game process in the virtual space, and user position information and directions. User information including at least one of information and posture information, and an information acquisition unit 111 that acquires game situation information are included. And the control part 117 controls launching device LC1-LCN based on at least 1 of user information and game status information. For example, the control unit 117 controls the launch devices LC1 to LCN by reflecting the user's position information, direction information, or posture information. Alternatively, the control unit 117 causes the launching device to fire a substance when it is determined that a notification event occurs based on the game situation or when an occurrence of an attack event is predicted. In this case, the occurrence of the notification event (prediction of the occurrence of the attack event) may be performed based on the user information. For example, the position information, the direction information, or the posture information of the user is determined, the occurrence of the notification event (prediction of the occurrence of the attack event) is determined, and the launching device is caused to fire the substance. Alternatively, the occurrence of a notification event is determined using both user information and game situation information, and the launching device is caused to fire the substance. By doing in this way, it is possible to realize the control for determining the occurrence of the notification event using the user information, the game situation information, etc. and causing the launching device to launch the substance.

  In addition, the information acquisition unit 111 is based on tracking information from the HMD 200, tracking information from a tracking device attached to a part such as a user's hand or foot, and the like. User information (user tracking information) including at least one piece of information is acquired. The position information may be position information of the user's viewpoint in real space, and the direction information may be direction information of the user's line of sight in real space. When the user plays in the play space in the real space (real world), the position information and the direction information are the position information and direction information in the play area (ride section, play field) (the given position is the origin). Position coordinates in the coordinate system, rotation angle around each coordinate axis). Posture information is information for specifying each posture of the user (standing posture, crouching posture, sitting posture, etc.) or specifying the position and direction of each part of the user (body, head, hand, foot, etc.). is there. The posture information may be information specified by tracking information from a tracking device attached to a predetermined part of the user, or may be information specified by motion tracking such as Kinect (registered trademark). Good. The information acquisition unit 111 may acquire position information and direction information of the HMD 200 as position information and direction information of the user wearing the HMD 200.

  Moreover, in this embodiment, at least one of a user's vision and hearing is obstruct | occluded. For example, the user's vision is closed from the outside world, and the user cannot visually recognize the surrounding situation. Alternatively, the user's hearing is closed from the outside world, and the user is in a state where the surrounding situation cannot be recognized audibly. For example, the visual occlusion state can be realized by a display unit arranged to cover the user's field of view. Specifically, this can be realized by the HMD 200 that is mounted so as to cover the user's field of view. The hearing occlusion state can be realized by a sound output device such as a headphone or an earphone worn by the user, for example. For example, it can be realized by a headphone that is a type of sound output device worn on the head, an earphone that is a type of sound output device worn on the ear, or the like. The headphones and earphones may be of a wired type or of a wireless type. For example, the earphone may be of a type that is directly attached to an ear hole. Then, for example, the sound output from the headphones or earphones is silenced (muted), thereby realizing a closed state of hearing. And when a user's vision and hearing are obstruct | occluded in this way, it becomes difficult for a user to grasp | ascertain the surrounding condition by vision and hearing, or it becomes impossible to grasp. Even in such a case, according to the present embodiment, by using the tactile stimulation by the substance by launching the substance by the launch devices LC1 to LCN, the user who is in a blocked state of vision and hearing Thus, it is possible to notify in advance that an attack event occurs. That is, even when the visual and auditory senses are blocked, it is possible to notify in advance of the occurrence of an attack event using a tactile stimulus caused by a substance hitting the user.

  In the present embodiment, the display processing unit 120 generates a display image of the HMD 200 that the user wears so as to cover the field of view based on the result of the game process. As described above, when the user wears the HMD 200 so as to cover the field of view, a tactile sensation device that emits a substance by the launching device is effective for improving the virtual reality of the user.

  However, the display processing unit 120 may generate a display image of a display unit other than the HMD 200. For example, the display processing unit 120 may generate a display image that is a projection image (projection mapping) onto a three-dimensional screen such as a dome screen. Alternatively, a display image such as a television in a home game device, a monitor (display) in a personal computer, or an arcade game device may be generated.

  In addition, the simulation system of the present embodiment includes a gripping object 40 gripped by the user, a connection member to which the gripping object 40 is connected to one end, a reaction force generating device 10 that generates a reaction force, and a situation of a game played by the user The control part 117 which controls the reaction force generator 10 according to is included. Here, the connection member to which the grasped object 40 is connected to one end can be realized by, for example, a wire 50 in FIG. That is, the connection member can be realized by the wire 50 having one end connected to the gripping object 40 and the other end connected to the reaction force generator 10. However, the connection member is not limited to this, and can be realized by various members such as an articulated arm (robot arm) and a rod-shaped member (member to which a rod is coupled).

  Then, the control unit 117 causes the reaction force generating device 10 to generate a reaction force that works in the direction opposite to the swing direction of the swing motion when the user swings the gripping object in the game. For example, when a hit event (collision event) occurs between the grasped object 40 and a target (attack body) such as a target object in the virtual space, the reaction force generator 10 generates a reaction force. For example, a reaction force acting in the direction opposite to the swing direction is generated at a timing when it is determined that the grasped object 40 has hit the target. For example, a control signal generated by the control process of the control unit 117 is input to the reaction force generator 10, and the reaction force generator 10 generates a reaction force based on the control signal. Here, the reverse direction side does not have to be completely reverse to the swing direction, and may be substantially reverse. For example, when the swing direction side of the swing motion is the first or second quadrant side, the reverse direction side of the swing direction side may be the third or fourth quadrant side. For example, the first and second quadrants and the third and fourth quadrants are quadrants defined by predetermined coordinate axes.

  In addition, the control unit 117 causes the reaction force generation device 10 to generate a reaction force that stops the swing motion at the connection portion CP between the grasped object 40 and the connection member. For example, the gripping object 40 and the connection member such as the wire 50 in FIG. 4 are connected (coupled) at the connection portion CP. For example, the connection part CP is connected by a fixture. Then, the control unit 117 causes the reaction force generation device 10 to generate the reaction force so that the reaction force that stops the user's swing motion acts on the connection unit CP. The reaction force in this case does not need to be a reaction force that completely stops the user's swing motion, but may be any reaction force that decelerates so that the user's swing motion stops. By stopping the swinging motion of the gripping object 40 that the user swings in this way, the user can virtually experience a collision feeling as if he or she hit a real target.

  The reaction force generator 10 generates a reaction force and a winding force for winding the wire 50. For example, the reaction force generator 10 generates a winding force that prevents the wire 50 from being loosened. By doing in this way, generation | occurrence | production of the situation where the wire 50 loosens and it becomes entangled in parts, such as a user's hand and a neck, can be prevented. The winding force may be generated by a winding force generation mechanism (winding unit) provided in the reaction force generator 10, or the reaction force and winding force are provided in the reaction force generator 10. It may be generated by a single force generation mechanism.

  The display processing unit 120 performs processing for generating an image in the virtual space as a display image to be displayed to the user. For example, an image visible from a virtual camera in the virtual space is generated as a display image to be displayed to the user. Specifically, the display processing unit 120 generates an image in the virtual space as a display image of the HMD 200 worn by the user so as to cover the field of view. For example, the virtual camera control unit 114 performs a virtual camera control process corresponding to the viewpoint of the user wearing the HMD 200. For example, the virtual camera control unit 114 controls the virtual camera set as the first-person viewpoint of the user. For example, by setting a virtual camera at a position corresponding to the viewpoint of the user character in the virtual space, and setting the viewpoint position and line-of-sight direction of the virtual camera, the position (positional coordinates) and posture (around the rotation axis) of the virtual camera The rotation angle). And the display process part 120 produces | generates the image seen from a virtual camera (user viewpoint) in virtual space as display images (display video), such as HMD200. For example, an image that is visible from a given viewpoint is generated in an object space that is a virtual space. The generated image is, for example, a stereoscopic image. By doing in this way, the image of the virtual space (VR space) which spreads over the perimeter of a visual field comes to be displayed on HMD200.

  In the present embodiment, a virtual reality simulation process is performed as the game process of the game played by the user. The virtual reality simulation process is a simulation process for simulating an event in the real space in the virtual space, and is a process for causing the user to experience the event virtually. For example, a user character corresponding to a user in the real space or a moving body such as a boarding moving body is moved in the virtual space, or a process for causing the user to experience changes in the environment and surroundings associated with the movement is performed.

  The processing of the simulation system of this embodiment shown in FIG. 1 includes processing devices such as arcade game devices and home game devices, processing devices such as PCs installed in facilities, and processing devices (back Pack PC) or distributed processing of these processing devices. Or you may implement | achieve the process of the simulation system of this embodiment with a server system and a terminal device. For example, it may be realized by distributed processing of a server system and a terminal device.

2. Tracking Processing Next, an example of tracking processing will be described. FIG. 2A shows an example of the HMD 200 used in the simulation system of this embodiment. As shown in FIG. 2A, the HMD 200 is provided with a plurality of light receiving elements 201, 202, and 203 (photodiodes). The light receiving elements 201 and 202 are provided on the front side of the HMD 200, and the light receiving element 203 is provided on the right side of the HMD 200. In addition, a light receiving element (not shown) is also provided on the left side, upper surface, and the like of the HMD.

  Further, the user US is holding the grasped object 40. The gripping object 40 is, for example, a rod-shaped member, and is a member that simulates a hammer or a sword. The grasped object 40 has a handle part 42 (handle part), and the user US grasps the grasped object 40 by grasping the handle part 42 with his / her hand. Note that the gripping object 40 may be in a bar shape at least at the handle portion 42, for example. The gripping object 40 is provided with a tracking device 44. As the tracking device 44, for example, a controller having a function of detecting position information and direction information can be used. Specifically, the tracking device 44 is provided with a light receiving element (not shown) similarly to the HMD 200, and position information and direction information of the tracking device 44 are obtained by tracking processing using the light receiving elements (a plurality of light receiving elements). Is detected. By detecting the position information and the direction information of the tracking device 44, the grasped object information that is at least one of the position information and the direction information of the grasped object 40 can be acquired. In addition, a fixture 46 of a wire 50 (a connecting member in a broad sense) is provided at, for example, a distal end portion of the grasped object 40. This attachment 46 becomes a connection portion CP between the gripping object 40 and the wire 50.

  As shown in FIG. 2B, the user US is riding in a standing posture on the ride portion 62 of the movable housing 60. Base stations 280 and 284 are installed around the user US riding the ride unit 62. The base station 280 is provided with light emitting elements 281 and 282, and the base station 284 is provided with light emitting elements 285 and 286. The light emitting elements 281, 282, 285, and 286 are realized by LEDs that emit laser (infrared laser or the like), for example. The base stations 280 and 284 use these light emitting elements 281, 282, 285, and 286 to emit, for example, a laser beam radially. Then, the light receiving elements 201 to 203 and the like provided in the HMD 200 in FIG. 2A receive the lasers from the base stations 280 and 284, thereby realizing the tracking process of the HMD 200 and facing the head position of the user US. The direction (viewpoint position, line-of-sight direction) can be detected. For example, position information and posture information (direction information) of the user US can be detected.

  In addition, a plurality of light receiving elements (not shown) provided in the tracking device 44 of the grasped object 40 receive laser beams from the base stations 280 and 284, thereby grasping at least one of position information and direction information of the grasped object 40. Object information can be detected.

  FIG. 3A shows another example of the HMD 200. In FIG. 3A, a plurality of light emitting elements 231 to 236 are provided for the HMD 200. These light emitting elements 231 to 236 are realized by, for example, LEDs. The light emitting elements 231 to 234 are provided on the front side of the HMD 200, and the light emitting element 235 and the light emitting element 236 (not shown) are provided on the back side. These light emitting elements 231 to 236 emit (emit) light in a visible light band, for example. Specifically, the light emitting elements 231 to 236 emit light of different colors. The tracking device 44 of the grasped object 40 held by the user US is also provided with a light emitting element (not shown). For example, a plurality of light emitting elements are provided.

  The imaging unit 150 shown in FIG. 3B is installed in at least one place around the user US (for example, the front side, the front side, the rear side, or the like). Image ˜236 light. That is, the spot light of these light emitting elements 231 to 236 is reflected in the captured image of the imaging unit 150. And the tracking of the user's US head (HMD) is implement | achieved by performing the image process of this captured image. That is, the three-dimensional position of the head of the user US and the facing direction (viewpoint position, line of sight direction) are detected.

  For example, as illustrated in FIG. 3B, the imaging unit 150 includes first and second cameras 151 and 152, and the first and second cameras 151 and 152 of the first and second cameras 151 and 152 are provided. By using the captured image, the position of the head of the user US in the depth direction can be detected. Further, based on the motion detection information of the motion sensor provided in the HMD 200, the rotation angle (line of sight) of the head of the user US can also be detected. Therefore, by using such an HMD 200, when the user US faces in any direction of all 360 degrees around the image, the image (the user's virtual space in the virtual space (virtual three-dimensional space)) Image viewed from a virtual camera corresponding to the viewpoint) can be displayed on the display unit 220 of the HMD 200.

  In addition, by imaging the light of a plurality of light emitting elements (not shown) provided in the tracking device 44 of the grasped object 40 by the image capturing unit 150, as in the case of the HMD 200, the position information and the direction information of the grasped object 40 are stored. At least one grasped object information can be detected.

  Note that instead of visible light, infrared LEDs may be used as the light emitting elements 231 to 236. Further, the position or movement of the user's head or hand (predetermined part) may be detected by another method such as using a depth camera.

  A tracking processing method for detecting user information that is at least one of position information, direction information, and posture information of the user US and gripping object information of the gripping object 40 is illustrated in FIGS. 2A to 3B. It is not limited to the method demonstrated by (1). For example, the tracking information of the HMD 200 and the tracking device 44 may be performed using a motion sensor or the like provided in the HMD 200 or the tracking device 44 to detect position information, direction information, and posture information. That is, tracking processing is realized without providing external devices such as the base stations 280 and 284 in FIG. 2B and the imaging unit 150 in FIG. Alternatively, various viewpoint tracking methods such as known eye tracking, face tracking, or head tracking may be used. Or you may use the method of the motion tracking which detects and identifies a user's motion (motion data). For example, user information or grasped object information may be acquired by performing tracking processing of a part such as a user's hand or motion tracking processing.

3. Specific Example of Simulation System Next, a specific configuration example of the simulation system of this embodiment will be described. FIG. 4 is a perspective view showing an appearance of a specific configuration example of the simulation system, and FIG. 5 is a side view.

  As shown in FIGS. 4 and 5, the movable housing 60 includes a base portion 61, a ride portion 62, and air spring portions 63, 64, 65 (broadly defined) provided between the base portion 61 and the ride portion 62. A telescopic part, an actuator). A swing mechanism 66 that swings the play area AR of the user US is realized by the base portion 61, the ride portion 62, and the air spring portions 63, 64, and 65.

  For example, the air spring part 63 is provided at the lower part on the front side of the ride part 62, and the air spring parts 64 and 65 are provided on the right side and the left side of the lower part on the rear side of the ride part 62. These air spring parts 63, 64, and 65 expand and contract in the Y-axis direction of FIGS. 4 and 5 by supplying and discharging air using an air compressor and bubbles. Here, the coordinate axis along the vertical direction is set as the Y axis, the coordinate axis in the left and right direction (horizontal direction) is set as the X axis, and the coordinate axis in the front and rear direction is set as the Z axis based on the user US of the basic posture.

  For example, when all the air spring portions 63, 64, 65 are extended or contracted, the ride portion 62 can be moved upward or downward in the Y-axis direction. Further, the air spring portion 63 on the front side extends while the air spring portions 64 and 65 on the rear side contract, or the air spring portion 63 on the rear side contracts while the air spring portions 64 and 65 on the rear side extend. It can be pitched around the X axis. Also, the right air spring part 64 extends while the left air spring part 65 contracts, or the right air spring part 64 contracts while the left air spring part 65 extends, thereby allowing the ride part 62 to roll around the Z axis. it can. In this way, by controlling the expansion and contraction of the air spring portions 63, 64, 65 by the control unit 117 of FIG. 1, for example, the swing mechanism 66 that swings the play area AR (ride portion 62) of the user US is realized.

  One end side of the support portions 67, 68, 69 is attached to the ride portion 62, and the limiting member 70 is attached to the other end side of the support portions 67, 68, 69. The support portions 67, 68, and 69 are realized by rod-shaped members whose longitudinal direction is the Y-axis direction (vertical direction). The restricting member 70 is a member for restricting the play area AR of the user US to a given range. For example, a hole is formed in the center. Then, the user US enters the hole of the restriction member 70 and plays the game. That is, the play area AR of the user US is limited to the range of the hole portion of the limiting member 70. Further, on the limiting member 70, a moving part 72 having a roller part 73 is provided as shown in FIG. As the roller unit 73 rotates, the moving unit 72 rotates and moves freely at the peripheral portion around the hole of the limiting member 70. The user US wears a waist belt 80, and the moving unit 72 is attached to a plate-like attachment member 74 attached to the back side of the waist belt 80. Therefore, when the user US rotates around the Y axis in the play area AR, the moving unit 72 attached to the waist belt 80 via the attachment member 74 rotates at the peripheral portion around the hole of the limiting member 70. Will move. The play area restriction mechanism 76 that restricts the play area AR, to which the user US can freely rotate, to a given range is realized by the restriction member 70, the moving unit 72, and the like.

  A skeleton part 2 is provided around the user US. A play room can be formed by attaching a wall member or the like to the skeleton 2. A plate-like member 4 is provided on the ceiling of the skeleton part 2, and a reaction force generator 10 is installed on the plate-like member 4. As shown in FIG. 5, the fixed point FP on the other end side of the wire 50 (connection member) is set at a position higher than the height of the head at the time of game play of the user US. Specifically, the fixed point FP of the wire 50 is set above the play area AR of the user US. Then, one end side of the wire 50 to which the fixed point FP above the user US is connected to the other end side is connected to the connection portion CP of the grasped object 40 grasped by the user US. This makes it possible to generate a reaction force that acts upward on the grasped object 40.

  As shown in FIGS. 4 and 5, the simulation system of the present embodiment is provided around the play area AR of the user US, and emits a plurality of gases (air) that are substances that give tactile stimulation to the user US. Launchers LC1 to LC6 (LC1 to LCN). For example, in FIGS. 4 and 5, the launchers LC1 to LC6 are provided on the right side, the front side, and the left side of the user US. That is, the launch devices LC1 to LC6 are provided in a peripheral range that includes the view range of the user US. A launching device can also be provided on the rear side (back side) of the user US.

  The launch devices LC1 to LC6 are supplied with gas (compressed air) from a compressor (not shown), and launch the gas toward the direction of the user US. For example, the launchers LC1 and LC2 launch gas from the right side of the user US, the launchers LC3 and LC4 launch gas from the front side of the user US, and the launchers LC5 and LC6 from the left side of the user US. Fire gas. For example, the control unit 117 in FIG. 1 gives a tactile stimulus to the launching device corresponding to the notification event among the plurality of launching devices LC1 to LC6 in the notification event that notifies the user US in advance that an attack event occurs. Fires a gas that is a given substance. As described above, in the notification event before the occurrence of the attack event, the gas is emitted to the user US, so that the user US can predict in advance that the attack event will occur. Then, for example, it is possible to take various actions such as counterattacking an attacking body (target, target object) trying to attack in an attack event before the attack.

4). Next, the method of this embodiment will be described. In the following, a case where the method of the present embodiment is applied to a game in which a user counterattacks an attacking body attacking from the surroundings will be mainly described. However, the game to which the method of the present embodiment is applied is not limited to such a game, and various games (a battle game with a sword, a fighting game, an RPG, an action game, a robot game, an FPS (First Person shooter), The present invention can be applied to a vehicle simulation game, a virtual experience game, a sports game, a horror experience game, a music game, or the like. For example, the method of the present embodiment can be suitably applied to a game in which a plurality of characters (attacking bodies) attack a character corresponding to a user from the surroundings, such as a multiplayer fighting game. Further, the method of the present embodiment can be applied not only to a VR space game, but also to an electromechanical device having no game space image, a normal video game device using a display other than the HMD, and the like.

4.1 Description of Game FIGS. 6 and 7 show examples of game images generated by the simulation system of the present embodiment. Gates G1, G2, G3, etc. are provided on the game stage, and crocodiles CR1, CR2, CR3, etc., which are attacking bodies (attack objects, target objects), appear from the gates G1, G2, G3, etc. The character (avatar) in the game space corresponding to the user rides on the barrel ship BW floating on the water surface and countersits the crocodile CR2 attacking from the gate G2 using the hammer HM as shown in FIG. . The crocodile CR2 that has received the counterattack returns to the gate G2 side. The game images shown in FIGS. 6 and 7 are actually displayed on the HMD 200 with a very wide viewing angle. Thereby, the user can enjoy the action game which fights crocodiles CR1, CR2, CR3 etc. which are attackers in VR space which spreads over the perimeter of a visual field.

  8 to 14 are explanatory diagrams of a game realized by this embodiment. In FIG. 8, a character CH1 corresponding to the first user and a character CH2 corresponding to the second user appear in the game. The characters CH1 and CH2 have a game setting in which they get on the barrel boats BW1 and BW2 floating on the water surface and get lost in the nest of crocodiles. Characters CH1 and CH2 surrounded by crocodiles are eliminated by hitting crocodiles with hammers HM1 and HM2 while paying attention to all directions so that barrel ships BW1 and BW2 do not sink. In order to get rid of the crocodile, it is necessary to hit the tip of the nose, which is a weak point of the crocodile, from the top. The game ends when all the crocodiles have been exterminated, or when one of the barrel ships BW1 and BW2 has sunk. Each user enjoys a game in which the user grasps the gripping object 40 corresponding to the hammer from above and hits a crocodile in the game space while watching the game images displayed on the HMD 200 as shown in FIGS. .

  In FIG. 9, the crocodiles CR1 and CR2 are attacking from behind the user US1 (first user) who operates the character CH1. In FIG. 9, the crocodiles CR1 and CR2 are actually display objects in the game space, and are drawn with dotted lines. The same applies to other drawings.

  When the crocodile CR1, CR2 attacks from outside the field of view as shown in FIG. 9, the images of these crocodile CR1, CR2 are not reflected in the HMD 200, so the user US1 visually recognizes the presence of the crocodile CR1, CR2. Can not. For this reason, the situation where the user US1 is confused by suddenly being attacked from behind occurs. So, in this embodiment, gas BR1 and BR2 are discharged with respect to user US1 according to appearance of crocodiles CR1 and CR2. That is, the gas BR1 and BR2 are emitted toward the user US1 as a notification event that notifies in advance of the occurrence of an attack event by the crocodiles CR1 and CR2. These gases BR1 and BR2 represent the nasal breath of the crocodiles CR1 and CR2. When such gases BR1 and BR2 are fired, the user US1 can know in advance that an attack event by the crocodiles CR1 and CR2 has occurred due to tactile stimulation caused by the gas BR1 and BR2 hitting the body. For example, the user US1 rotates the body in the ride unit 62 to face the crocodile CR1 and swings the grasped object 40 toward the crocodile CR1. As a result, as shown in FIG. 10, a game image in which the character CH1 corresponding to the user US1 swings down the hammer HM1 and hits the crocodile CR1 is displayed.

  In FIG. 11, the crocodile CR3 is attacking the barrel ship BW1 on which the character CH1 rides. In this way, when the crocodile CR3 attacks the barrel ship BW1, the barrel ship BW1 is damaged. Since the barrel ship BW1 sinks when the damage becomes large, the user US1 fights against the crocodiles CR3 and CR4 attacking from the surrounding area so that the barrel ship BW1 does not sink.

  Then, when the crocodile CR3 attacks the barrel ship BW1 and pokes as shown in FIG. 11, in order to make the user US1 experience this attack, as shown in FIG. 12, the swing mechanism 66 causes the ride that is the play area AR of the user US1. The part 62 is swung. For example, in FIG. 12, the front air spring portion 63 contracts and the rear air spring portions 64 and 65 extend, so that the ride portion 62 (play area AR) swings so that the user US1 can pick up the front. Thereby, when the crocodile CR3 attacked from the rear side hits the barrel ship BW1 by an attack, it is possible to give the user US1 a sense of shaking his / her feet and improve the virtual reality.

  Defeat the crocodiles attacking one after another from the surroundings and repel all the crocodiles. Thereafter, the swing mechanism 66 produces an effect that the floor swings, and a giant crocodile CRBS appears from the wall of the game stage as shown in FIGS. Since the giant crocodile CRBS attacks while turning around the barrel ship BW1 on which the character CH1 rides, the user US1 fights back while rotating the body on the ride unit 62 so that the giant crocodile CRBS is not attacked from behind. Become. Since the image of the VR space that extends over the entire periphery of the field of view is displayed on the HMD 200 of the user US1, virtual reality can be greatly improved by displaying a powerful battle image with the giant crocodile CRBS.

4.2 Notification of Attack Event by Tactile Stimulus In the game described with reference to FIGS. 8 to 14, a crocodile that is an attacking body attacks from behind or the like outside the visual field range of the user. For this reason, a sudden attack from the outside of the visual field range by the attacking body causes a situation in which the user is confused or surprised. In particular, in a game using an HMD, an image from the first-person viewpoint in the VR space is displayed on the HMD, and the user can enjoy a virtual reality as if the user actually exists in the VR space world. For example, in a normal pseudo three-dimensional image game, only an image in the user's visual field range is displayed on the display, but in a game using the HMD, the VR space world exists outside the user's visual field range, If the back side that is out of the field of view is turned around, an image that can be seen behind the range is displayed on the HMD. Therefore, if the user turns away from the field of view, such as behind, he can see the attacking object attacking from outside the field of view, but if the attacking object attacks without making any attack by the attacking object known The user may be confused or surprised, and smooth game progression or the like cannot be realized.

  Therefore, in the present embodiment, a mechanism is provided for notifying the user of the attack start timing of an enemy attacking from a position (a blind spot) where the user cannot see by tactile stimulation. For example, when a notification element (crocodile attack, weapon firing, etc.) occurs in a game that is performed in a state where the play area (play position) in which the user plays the game is substantially fixed except for rotation (Y-axis rotation) , A simulation system (game system) that performs notification in response to the user's tactile sensation by material firing to the user by a plurality of launching devices (air cannon, BB bullet, telescopic rod, etc.) installed around the play position (play area) ). For example, when a notification element is generated in a direction other than the user's field of view (a blind spot) in the periphery of the user's play area (play position), a substance is released to the user by a launching device installed in the vicinity of the direction. Do.

  Specifically, in the simulation system of the present embodiment, as shown in FIG. 15A, a plurality of launching devices LC1 to LC6 that launch a substance that gives a tactile stimulus to the user US include the play area AR of the user US. It is provided around. And according to the situation of the game which user US plays, discharge of the substance of launching devices LC1-LC6 is controlled. For example, in FIG. 15A, a ride unit 62 is provided for the movable housing 60, and this ride unit 62 becomes the play area AR for the user US. The user US attacks the enemy by shaking the grasped object 40 on the ride unit 62. Air spring portions 63, 64, 65 are provided below the ride portion 62, thereby realizing a swing mechanism 66 that swings the play area AR.

  On the other hand, in the game space, as shown in FIG. 15B, the character CH (user character, avatar) corresponding to the user US rides on the barrel ship BW corresponding to the ride section 62 in the real space, and An attack is performed with the hammer HM corresponding to the grasped object 40. Then, an attacking body AT1 to AT11 such as a crocodile appears around the character CH. The launchers LC1 to LC6 in FIG. 15A are installed at positions corresponding to the appearance locations of these attacking objects AT1 to AT11.

  In the present embodiment, in the notification event for informing in advance that an attack event occurs to the user US, among the plurality of emission devices LC1 to LC6, the emission device corresponding to the occurrence location of the notification event (one or a plurality of emission) The device is fired with a substance that provides tactile stimulation. For example, a gas (compressed air or the like) is fired as a substance that provides tactile stimulation.

  For example, in FIG. 16 (A), the attacking object AT1 attempts to attack the user US. In this case, a gas BR1 (air) that is a substance that gives a tactile stimulus to the launcher LC1 corresponding to the position of the attacker AT1 (where the event is generated) is used as the notification event EVI that notifies the attack by the attacker AT1 in advance. Fire a gun).

  For example, in FIG. 16A, the attacking object AT1 attempts to attack the user US1 outside the range of view of the user US. In this case, the user US cannot visually recognize the attack of the attacker AT1. For this reason, as the attack event EVA of the attacking object AT1 occurs, as shown in FIG. 16B, the attacking by the attacking object AT1 is received without any counterattack. Therefore, a situation in which the user US1 is confused due to unexpected attack from the outside of the visual field range.

  In this regard, in this embodiment, as shown in FIG. 16A, in the notification event EVI that notifies the user US in advance that the attack event EVA occurs, the gas BR1 is given to the user US by the launcher LC1. Is firing. By firing such a gas BR1, this gas BR1 hits the body of the user US, and the user US knows in advance that an attack event EVA by the attacking body AT1 occurs due to a tactile stimulus by the gas BR1. It becomes possible. Thereby, as shown in FIG. 17A, for example, the user US rotates his / her body so as to face the gas BR1 in the emission direction, and before the attack by the attacking object AT1 hits, for example, the user US attacks It becomes possible to counterattack against the body AT1. As a result, an attack by the attacking object AT1 can be avoided. For example, a situation in which an attack by the attacking body AT1 hits the barrel ship BW in the game space and the barrel ship BW is damaged can be avoided.

  As described above, according to the method of the present embodiment, even when an attacking object is attacked, for example, outside the visual field range of the user, the attack by the attacking object can be recognized in advance by the occurrence of a notification event that emits gas. Therefore, it is possible to prevent the user from being confused by a sudden sudden attack. Thereby, smoother and more appropriate game progress can be realized.

  In the present embodiment, the number of attacking bodies and the number of launching devices do not need to match. For example, in FIGS. 15A and 15B, the number of launching devices is smaller than the number of attacking bodies. Then, for example, as shown in FIG. 17B, it is assumed that the attacking body AT2 at a location corresponding to the position between the launchers LC1 and LC2 has attacked. In this case, gas BR1 and BR2 may be fired by the launching devices LC1 and LC2 as a notification event EVI for notifying the attack of the attacking object AT2 in advance. In this way, when the launchers LC1 and LC2 launch the gases BR1 and BR2, the user US recognizes the attacking object AT2 from the location between the launchers LC1 and LC2 by tactile stimulation. It becomes possible to counterattack against the attacker AT2.

  In the present embodiment, a notification event is generated when an attacker that attacks the user in the attack event moves. For example, in FIG. 16 (A) and FIG. 16 (B), the attacker AT1 moves toward the user US in order to attack the user US. For example, the attacking object AT1 starts moving from the place of the game space corresponding to the launching device LC1, and moves toward the ride unit 62 of the user US. For example, in the game space, the game moves from the gate where the attacking object AT1 appears toward the barrel ship BW on which the character CH corresponding to the user US rides. In the present embodiment, when the attacker AT1 that attacks the user US moves as described above, the notification event EVI is generated as shown in FIG. The gas BR1 is fired toward the user US and informs the user US that an attack event will occur. For example, the notification event EVI is generated at the timing when the attacking body AT1 starts or when a given period has elapsed after the start of movement, and the gas BR1 is emitted toward the user US. In this way, in a game in which the attacking body moves toward the user and attacks, the attack can be predicted by the user by tactile stimulation by the emission of a substance such as gas before the attack. It becomes possible. Therefore, for example, it is possible to realize notification processing suitable for a game in which an attacking body approaches the user and attacks one after another.

  Further, in the present embodiment, when a notification event occurs outside the user's visual field range, a substance such as a gas is fired by a launching device provided outside the visual field range among the multiple launching devices. For example, in FIG. 16A, the launcher LC1 is located outside the visual field range of the user US. Then, when a notification event EVI occurs outside the visual field range of the user US, the gas BR1 is fired by the launching device LC1 provided outside the visual field range to notify the user US that an attack by the attacking object AT1 occurs. . In this way, it is possible to allow a game development in which an attacking body attacks from outside the visual field range of the user, and an unprecedented game can be realized. For example, in a game where there are many enemies around the user, such as a multiplayer fighting game, if an attack from an enemy outside the user's field of view is allowed, the user will be attacked unexpectedly, May not hold true. In this regard, according to the method of the present embodiment, even if an attack from an enemy outside the visual field range is allowed, the attack of the enemy can be notified in advance by a tactile stimulus by the emission of a substance such as a gas. Accordingly, in a game where there are many enemies around the user, it becomes possible to allow an enemy attack from outside the field of view, and an unprecedented game can be realized.

  In the present embodiment, display processing for generating a display image of the HMD 200 worn by the user so as to cover the field of view is performed based on the result of the game processing. Thus, by mounting the HMD 200 on the user, it is possible to realize a VR space that extends all around the user's field of view. Thereby, a virtual experience as if it actually exists in the world realized in the VR space becomes possible, and the virtual reality of the user can be greatly improved. In a game where such a vast VR space is realized, a situation in which the enemy attacks not only within the user's field of view but also from outside the field of view can cause the virtual reality of the user. Further improvement can be achieved. However, if an enemy outside the field of view attacks without informing the user of any attack, the user will be surprised or confused. In this regard, in the present embodiment, a method is employed in which a substance such as a gas is emitted to the user in a notification event, and an enemy attack is notified to the user in advance using a tactile stimulus. As a result, by realizing a game in a vast VR space, the user is surprised or confused by attacks from enemies outside the field of view while enhancing the virtual reality of the user. It will be possible to solve this, and it will be possible to realize a virtual experience game that has never existed before.

4.3 Swing Mechanism The simulation system of the present embodiment includes a swing mechanism 66 that swings the play area AR of the user US. For example, in FIG. 18, the attacker AT is attacking from the rear side of the user US. When such an attack event EVA of the attacker AT occurs, the play area AR is rocked by rocking the ride unit 62 by the rocking mechanism 66. For example, in FIG. 18, since the attacking AT has attacked from the rear side, the swing control is performed such that the rear side is higher than the front side of the user US. As a result, the user US can experience realistically that his / her foot is shaken by the swing mechanism 66 that the attack has been received from the rear side by the attacking body AT. For example, it is possible to give the user US a feeling as if the barrel ship BW in the game space is shaken by being struck by the attacking body AT, thereby improving the virtual reality.

  The swing mechanism 66 includes at least one air spring portion, and swings the play area AR by the air spring portion. For example, in FIG. 18, the swing mechanism 66 has air spring portions 63, 64, 65 provided between the ride portion 62 and the base portion 61. Then, when the attacking body AT attacks from the rear side as shown in FIG. 18, the front side air spring portion 63 is contracted and the rear side air spring portions 64 and 65 are extended. In this way, it is possible to control the swinging of the ride unit 62, which is the play area AR, for example, about the X axis, and the user US feels as if it has been struck by the attacking AT from the rear side. Can be given.

  In the present embodiment, the swing mechanism 66 swings the play area AR when an attack event occurs after the occurrence of the notification event. For example, as shown in FIG. 16A, after the occurrence of the notification event EVI due to the emission of gas, the play area AR is rocked by the rocking mechanism 66 when the attack event EVA occurs as shown in FIG. In this way, the occurrence of the notification event is notified to the user US by a tactile stimulus by the emission of a substance such as gas, while the occurrence of the attack is caused to be experienced by the user US by the swinging of the swinging mechanism 66. Can be realized, and a bodily sensation mechanism suitable for a VR space game or the like can be realized. Note that after the attack notification event occurs, for example, when the attacking object AT is extinguished or retreats due to a counterattack or the like of the user US, no attack event occurs, and the swinging mechanism 66 swings the play area AR. It will not be broken.

  Further, in the present embodiment, the play area may be rocked by different rocking amounts depending on whether the attack event occurs within the user's visual field range or when it occurs outside the visual field range. For example, in FIGS. 19A and 19B, FV represents an example of the visual field range of the user US. In FIG. 19A, an attack event in which the attacking body AT attacks the user US occurs within the visual field range FV of the user US. In this case, for example, the swing amount of the play area AR is increased. For example, since the attacking body AT is attacking from the front side of the user US, the swinging mechanism 66 is moved to the play area AR so that the extension amount of the air spring portion 63 on the front side is increased and the front side of the play area AR rises high. (Ride part 62) is swung. On the other hand, in FIG. 19B, an attack event in which the attacking body AT attacks the user US is generated outside the visual field range FV of the user US. In this case, for example, the swing amount of the play area AR is reduced. For example, since the attacker AT is attacking from the right rear direction side of the user US, control is performed to extend the air spring portion 64 on the left rear direction side, but the extension amount is reduced and the right rear direction side of the play area AR is low. The swing mechanism 66 swings the play area AR so as to rise.

  For example, as shown in FIG. 19A, when the attack event occurs within the visual field range FV, by increasing the swing amount, it is possible to give the user US a sense of large swing, and the attack of the attacking body AT can be prevented. It becomes possible for the user to experience it realistically. On the other hand, as shown in FIG. 19B, when an attack event occurs outside the visual field range FV, if the swinging amount is too large, the user may be confused by unexpected swinging. Such a situation can be prevented by reducing the swing amount. As described above, according to the method shown in FIGS. 19A and 19B, the swing mechanism depends on whether the attack event has occurred within the visual field range FV or outside the visual field range FV of the user US. It is possible to vary the degree of bodily sensation given to the user US by the swing of 66, and various and appropriate bodily sensation controls can be realized.

4.4 Play Area Restriction Mechanism In this embodiment, a play area restriction mechanism 76 that restricts the play area of the user is provided. In other words, when a notification event occurs around the user, the launch area corresponding to the notification event is controlled to fire a substance that gives a tactile stimulus, and the play area that the user can move freely is a play area. The restriction mechanism 76 restricts to a given range.

  For example, FIGS. 20A and 20B are diagrams illustrating an example of the play area restriction mechanism 76 of the present embodiment. The play area limiting mechanism 76 includes a limiting member 70 provided so as to surround the user US. The play area restriction mechanism 76 includes a moving unit 72 that is attached to the user US and rotates on the restriction member 70 as the user US rotates.

  For example, the limiting member 70 has a hole 71 at the center thereof, and the user US enters the hole 71 of the limiting member 70 and plays a game. By providing the hole 71 in this way, the limiting member 70 is provided so as to surround the user US at the time of game play. The play area AR of the user US is limited to the range RG of the hole 71 of the limiting member 70.

  Then, the user US rotates and moves freely within a range RG limited by the limiting member 70 as shown in FIGS. 20 (A) and 20 (B). Specifically, the moving part 72 is attached to the user US by an attachment member 74 provided on the back surface thereof. For example, as shown in FIG. 5, a plate-like attachment member 74 is provided on the back side of the waist belt 80 worn by the user US, and the moving portion 72 is attached to the attachment member 74. The moving unit 72 is provided with roller units 73-1 and 73-2 at positions on the right side and the left side of the user US. When the user US rotates within the range RG in which the translation movement is restricted by the restriction member 70, the roller parts 73-1 and 72-2 of the movement part 72 are rotated at the peripheral edge of the hole 71 of the restriction member 70. Move while. Thereby, the moving part 72 comes to rotate on the limiting member 70 with the rotation movement of the user US.

  By doing so, the user US can rotate and move freely in the range RG while limiting the range of the play area AR in which the user US can move in translation to the given range RG. Therefore, for example, as shown in FIGS. 16A and 16B, even when the attacking object AT1 attacks from outside the field of view, the user US rotates and moves within the limited range RG, It is possible to counterattack by facing the attacker AT1.

  In particular, in the present embodiment, as shown in FIG. 16A, when the attacker AT1 tries to attack from outside the field of view, the attack of the attacker AT1 is made to the user US by the notification event EVI that emits the gas BR1. Informs in advance. For this reason, the user US can know in advance that the attacking body AT1 attacks by the tactile stimulation caused by the gas BR1 hitting the body. Accordingly, as shown in FIGS. 20 (A) and 20 (B), it rotates within the range RG and faces the attacking object AT1, and with respect to the attacking object AT1 as shown in FIG. 17 (A). It becomes possible to add a counterattack. Therefore, an optimal notification system can be realized in a game in which a plurality of attackers attack from around the user US. Further, the play area restriction mechanism 76 restricts the range in which the user US can move to the range RG. Therefore, it is possible to prevent a situation in which the user US moves carelessly and troubles the operation of the simulation system. For example, in a game in which the user US shakes the gripping object 40 and defeats the enemy, if the range in which the user US can move is not limited, the gripping object 40 hits a surrounding object or the user US himself gets excited There is a possibility that a situation such as hitting an object may occur. In this regard, in the present embodiment, since the range in which the user US can move is limited to the range RG, occurrence of such a situation can also be prevented.

4.5 Detailed Processing Next, a processing example of this embodiment will be described with reference to the flowcharts of FIGS. In FIG. 21, first, user information including at least one of user position information, direction information, and posture information is acquired (step S1). For example, this user information can be acquired by tracking processing as described with reference to FIGS. 2A to 3B or motion tracking processing. And the process of the game which a user plays is performed (step S2). For example, the game is advanced, or various game parameters are calculated. Based on at least one of the user information and game situation information acquired in step S1, the launchers LC1 to LCN are controlled (step S3).

  As described above, in this embodiment, the virtual space setting process is performed, the game process is performed in the virtual space, the user information including at least one of the user position information, the direction information, and the posture information, and the game situation Get information. For example, user information is acquired in step S1 of FIG. 21, and game situation information is acquired by execution of the game process of step S2. Based on at least one of the user information and the game situation information, the launchers LC1 to LCN are controlled. For example, the launchers LC1 to LCN reflecting the user's position, direction, or posture are controlled. Alternatively, the launchers LC1 to LCN are controlled based on game situation information such as a notification event or an attack event. By doing in this way, according to a user's position, direction or posture, and a game situation, substances, such as gas, are fired to launching device LC1-LCN, a tactile stimulus is given to a user, and an occurrence of an attack is beforehand given to a user. It is possible to implement processing such as informing the user.

  FIG. 22 is a flowchart showing a more detailed processing example of this embodiment. For example, in FIG. 22, it is determined whether or not a notification event that notifies in advance that an attack event occurs has occurred (step S <b> 11). And when a notification event occurs, gas is emitted to the emission device corresponding to the generation location of the notification event among the emission devices LC1 to LCN (step S12). For example, in FIG. 16A, it is determined that an attack notification event EVI by the attacking object AT1 has occurred, and the gas BR1 is fired to the launching device LC1 corresponding to the location where the notification event EVI has occurred. Thereby, it can be notified to the user that an attack event of the attacking object AT1 occurs.

  Next, it is determined whether or not an attack event has occurred (step S13). When an attack event occurs, the play area is rocked by the rocking mechanism 66 (step S14). For example, in FIG. 18, an attack event EVA is generated by the attacker AT. In this case, the play area AR is swung by performing control such as extending the air spring portions 64 and 65 of the swing mechanism 66, for example. By doing in this way, it becomes possible to let a user feel that it was attacked by the attacking body AT by swinging the play area AR, and it is possible to improve the virtual reality of the user.

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, in the specification or drawings, terms (wires, air springs, movable housings, etc.) that are described at least once together with different terms (extended parts / actuators, housings, etc.) in a broader sense or the same meaning are used in the specification or drawings. Can be replaced by the different terms at any point. Also, the configuration of the simulation system, the configuration of the launching device, the configuration of the swing mechanism, the configuration of the play area restriction mechanism, the control process of the control unit, the virtual space setting process, the game process, the acquisition process of user information and game situation information, the image The display processing, notification processing, and the like are not limited to those described in the present embodiment, and techniques, processing, and configurations equivalent to these are also included in the scope of the present invention. The present invention can be applied to various games. Further, the present invention can be applied to various simulation systems such as a business game device, a home game device, or a large attraction system in which a large number of users participate.

US, US1 user, LC1-LCN launcher, AR play area,
RG range, AT, AT1-AT11 Attack, BR1, BR2 gas,
EVI notification event, EVA attack event, FV field of view,
HM, HM1, HM2 hammer, CH, CH1, CH2 characters,
CR1-CR7, CRBS crocodile, G1-G6 gate,
CP connection, FP fixed point, BW, BW1, BW2 barrel ship,
2 skeleton parts, 4 plate members, 10 reaction force generators,
40 gripping object, 42 handle part, 44 tracking device, 46 fitting,
50 wires, 60 movable housing, 61 base part, 62 ride part,
63, 64, 65 Air spring part, 66 Oscillating mechanism, 67, 68, 69 Support part,
70 restricting member, 71 hole portion, 72 moving portion, 73, 73-1, 72-2 roller portion,
74 mounting member, 76 play area limiting mechanism, 80 waist belt,
100 processing units, 102 input processing units, 110 arithmetic processing units, 111 information acquisition units,
112 virtual space setting unit, 113 moving body processing unit, 114 virtual camera control unit,
115 game processing unit, 117 control unit, 120 display processing unit,
130 sound processing unit, 140 output processing unit, 150 imaging unit, 151, 152 camera,
160 operation unit, 170 storage unit, 172 object information storage unit,
178 Drawing buffer, 180 information storage medium, 192 sound output unit, 194 I / F unit,
195 portable information storage medium, 196 communication unit,
200 HMD (head-mounted display device), 201 to 203 light receiving element, 210 sensor unit,
220 display unit, 231 to 236 light emitting element, 240 processing unit,
280, 284 Base station, 281, 282, 285, 286 Light emitting element

Claims (15)

A plurality of launch devices that are disposed around a user's play area and that fire a substance that provides tactile stimulation to the user;
In accordance with the situation of the game played by the user, a control unit for controlling the launch of the substance of the plurality of launch devices,
Including
The controller is
In a notification event for informing in advance that an attack event will occur to the user, control is performed to cause the launching device corresponding to the notification event among the plurality of launching devices to fire the substance that provides tactile stimulation. A simulation system characterized by In claim 1,
A virtual space setting unit for performing virtual space setting processing;
A game processing unit for processing the game in the virtual space;
User information including at least one of the user position information, direction information and posture information; and an information acquisition unit for acquiring game situation information;
Including
The controller is
The simulation system characterized in that the launching device is controlled based on at least one of the user information and the game situation information. In claim 1 or 2,
A simulation system, wherein at least one of the user's visual sense and auditory sense is closed. In any one of Claims 1 thru | or 3,
The simulation system characterized by including the display process part which produces | generates the display image of the head mounted display apparatus with which the said user wears so that a visual field may be covered based on the result of the process of the said game. In any one of Claims 1 thru | or 4,
A simulation system comprising a rocking mechanism for rocking the play area of the user. In claim 5,
The swing mechanism is
A simulation system comprising at least one air spring portion, wherein the play area is swung by the air spring portion. In claim 5 or 6,
The swing mechanism is
A simulation system characterized by swinging the play area when the attack event occurs after the notification event occurs. In any of claims 5 to 7,
The simulation is characterized in that the rocking mechanism rocks the play area with a different rocking amount when the attack event occurs within the visual field range of the user and when the attack event occurs outside the visual field range. system. In any one of Claims 1 thru | or 8.
The said notification event is an event which generate | occur | produces in the case of the movement of the attack body which attacks the said user in the said attack event, The simulation system characterized by the above-mentioned. In any one of Claims 1 thru | or 9,
The simulation system characterized by including the play area restriction | limiting mechanism which restrict | limits the said play area which the said user can rotate freely to a given range. A plurality of launch devices that are disposed around a user's play area and that fire a substance that provides tactile stimulation to the user;
In accordance with the situation of the game played by the user, a control unit for controlling the launch of the substance of the plurality of launch devices,
A play area restriction mechanism for restricting the play area that the user can freely rotate to a given range;
Including
The controller is
When a notification event occurs in the vicinity of the user, a simulation system is provided that performs control to cause the emission device corresponding to the notification event to emit the substance that provides tactile stimulation among the plurality of emission devices. In claim 10 or 11,
The play area restriction mechanism is
The simulation system characterized by including the limiting member provided so that the circumference | surroundings of the said user may be enclosed. In claim 12,
The play area restriction mechanism is
The simulation system characterized by including the moving part attached to the said user and rotating on the said limitation member with the said user's rotational movement. In any one of Claims 1 thru | or 13.
The controller is
A simulation system, wherein when the notification event occurs outside the user's visual field range, control is performed to cause the launching device provided outside the visual field range among the plurality of launching devices to fire the substance. . In any one of Claims 1 thru | or 14.
The simulation system, wherein the emission device emits a gas as the substance that gives tactile stimulation.