JP6935218B2 - Simulation system and program - Google Patents

Description

The present invention relates to a simulation system, a program, and the like.

Conventionally, a simulation system that allows the user to experience the world of so-called virtual reality (VR) by wearing the HMD (head-mounted display device) on the head and viewing the image displayed on the screen of the HMD. Are known. As a conventional technique of such a simulation system, for example, there is a technique disclosed in Patent Document 1 and the like.

Japanese Unexamined Patent Publication No. 11-309269

In the simulation system using the HMD, the user's field of view is covered by the HMD, and the field of view is blocked from the outside world. On the other hand, although the image of the virtual space (VR space) is displayed on the HMD, the virtual reality of the user cannot be enhanced only by the image of the virtual space. Therefore, it is desirable to use a sensory device that can enhance the virtual reality of the user.

However, when providing such a sensory device, it is necessary to consider hygiene, operation, safety, and the like. Further, if the scale of the sensory device becomes too large, it is not realistic and there is a problem in terms of cost and the like.

According to some aspects of the present invention, in a system using a head-mounted display device, it is possible to provide a simulation system and a program that can effectively utilize a gas emitting unit to improve virtual reality.

One aspect of the present invention includes an information acquisition unit that acquires user information including at least one of position information, direction information, and attitude information of a user who wears a head-mounted display device so as to cover the field of view, and a virtual space. A virtual space setting unit that performs setting processing, a game processing unit that processes a game in the virtual space, a control unit that controls a launching unit capable of emitting gas to the user, and a control unit worn by the user. A display processing unit that generates a display image of the head-mounted display device is included, and a plurality of launching devices are arranged in the launching unit, and the control unit is used for a game situation in the virtual space and the above. It relates to a simulation system that performs control processing of the launching unit according to user information. The present invention also relates to a program that causes a computer to function as each of the above parts, or a computer-readable information storage medium that stores the program.

According to one aspect of the present invention, user information including at least one of the user's position information, direction information, and posture information is acquired. In addition, the virtual space setting process is performed, the game process in the virtual space is performed, the display image of the head-mounted display device worn by the user is generated, and the head-mounted display device is mounted. The launching unit capable of emitting gas is controlled for the user. Then, a plurality of launching devices are arranged in the launching unit, and the control processing of the launching unit in which the plurality of launching devices are arranged is performed according to the game situation and the user information in the virtual space. In this way, the user who wears the head-mounted display device so as to cover the field of view emits gas by a plurality of launching devices of the launching unit so as to correspond to the game situation and user information in the virtual space. become able to. Therefore, for example, the user can be given a tactile sensation due to the gas from the launching portion hitting the body or the like so as to be linked to the image displayed on the head-mounted display device. Further, for example, it is possible to realize appropriate gas emission control of the launching unit according to the position, direction or posture of the user. As a result, in a system using a head-mounted display device, it is possible to provide a simulation system or the like that can effectively utilize the gas emitting unit to improve the virtual reality.

Further, in one aspect of the present invention, a plurality of the launching devices may be arranged in a matrix in the launching unit, and the control unit may perform control processing of the plurality of launching devices arranged in the matrix. ..

In this way, various launch controls such as launching gas all at once by multiple launchers or launching gas at different launch timings using multiple launchers arranged in a matrix are realized. become able to.

Further, in one aspect of the present invention, when a hit event in which a hit object corresponding to the gas hits occurs in the virtual space, the control unit performs a process of selecting the launching device in the launching unit, the gas. At least one of the control process of the firing timing of the gas and the control process of the firing output degree of the gas may be performed.

In this way, when a hit event in which the hit object corresponding to the gas hits occurs in the virtual space, the selection process of the launching device and the firing timing are performed so that the user can effectively experience the hit event by tactile sensation. Control processing and control processing of the degree of firing output will be performed, and the virtual reality of the user can be improved.

Further, in one aspect of the present invention, the control unit performs a process of selecting the launcher at the launch unit, a process of controlling the launch timing of the gas, and the process of controlling the launch timing of the gas according to the hit direction or the hit vector of the hit object. At least one of the control processes of the degree of emission output of the gas may be performed.

In this way, the launch device selection process, the launch timing control process, and the launch output degree control process are performed so as to correspond to the hit direction or hit vector of the hit object, and the hit object can be hit. It is possible to make the user tactilely recognize the hit direction and the hit vector.

Further, in one aspect of the present invention, the plurality of launchers include first to Nth launchers along a first direction intersecting in the vertical direction, and the control unit moves the user corresponding to the user. When the hit event occurs in which the hit object hits the body in an oblique direction, the gas is fired sequentially from the first launching device to the Nth launching device. The unit may be controlled.

In this way, the gas is sequentially emitted from the first launching device to the Nth launching device and hits the user, thereby giving the user the illusion that the hit object is hit in an oblique direction. Will be possible.

Further, in one aspect of the present invention, the launching unit includes a launching unit direction changing unit that changes the direction of the launching unit, and the control unit controls the launching unit direction changing unit according to the game situation. You may go.

In this way, the launch direction of the gas in the launch section can be changed according to the game situation by controlling the launch section direction change section and changing the direction of the launch section according to the game situation. Become.

Further, in one aspect of the present invention, the launching unit includes a plurality of launching device direction changing units that change the direction of the launching device, and the control unit is a launching device direction changing unit according to the game situation. Control may be performed.

In this way, by controlling the launcher direction changing unit according to the game situation and changing the direction of the launcher, the launch direction of the gas of the launcher can be changed according to the game situation. Become.

Further, in one aspect of the present invention, the virtual space setting unit sets the source object of the hit object in the hit event in which the hit object corresponding to the gas hits in the virtual space, and the launching unit in the real space. The process of arranging the object at the position of the virtual space corresponding to the position of may be performed.

In this way, it is possible to make the position of the source object of the hit object in the virtual space correspond to the position of the launching part in the real space, and the gas emitted by the launching part hits the user. It is possible to make the tactile sensation of the object more appropriate.

Further, in one aspect of the present invention, the game processing unit may perform game effect processing in which sound, vibration, or an image is linked to the emission of the gas by the launching unit.

In this way, it becomes possible to execute the game effect processing by sound, vibration, or image in conjunction with the tactile sensation caused by the gas emitted by the launching unit.

Further, in one aspect of the present invention, the launching portion may include a processing portion for processing the gas to be launched.

In this way, the gas processed by the processing unit can be emitted to the user, and it is possible to give the user various sensations due to the emission of the gas while using the same emission unit.

Further, in one aspect of the present invention, the processing unit may perform different processing on the gas to be launched by the first launching device and the second launching device of the plurality of launching devices.

In this way, it becomes possible to launch a gas that has been processed differently to the user depending on whether the first launching device is used or the second launching device is used. It is possible to give users a variety of experiences.

The block diagram which shows the configuration example of the simulation system of this embodiment. 2 (A) and 2 (B) are examples of the HMD used in this embodiment. 3 (A) and 3 (B) are other examples of the HMD used in this embodiment. Configuration example of the housing of the simulation system. 5 (A) and 5 (B) are configuration examples of the launching unit and the launching device. An example of a field in virtual space. An example of a game image generated by this embodiment. An example of a game image generated by this embodiment. An example of a game image generated by this embodiment. An example of a game image generated by this embodiment. 11 (A) and 11 (B) are explanatory views of a control method for the launching unit. 12 (A) and 12 (B) are explanatory views of a control method for the launching unit. 13 (A) and 13 (B) are explanatory views of a launching unit control method according to a hit direction or a hit vector. Explanatory drawing of the method of sequentially firing gas from each launcher of a plurality of launchers. 15 (A) and 15 (B) are explanatory views of a launching unit control method according to a hit direction or a hit vector. 16 (A) to 16 (C) are explanatory views of an operation example of the launching portion direction changing portion. 17 (A) to 17 (C) are explanatory views of an operation example of the launching portion direction changing portion. 18 (A) and 18 (B) are explanatory views of an operation example of the launcher direction changing unit. 19 (A) and 19 (B) are explanatory views of a method of arranging an enemy character that fires an air bullet at a position corresponding to the position of the launching portion. 20 (A) to 20 (C) are explanatory views of a method of arranging an enemy character that fires an air bullet at a position corresponding to the position of the launching portion. An example of a field played by multiple users wearing an HMD. Explanatory drawing of the control method of a launching part which emits a gas to a user moving in a field. An explanatory diagram of a game production method in which sound, vibration, etc. are linked to the emission of gas at the launching unit. Explanatory drawing of the operation example of the processing part which processes the gas emitted by the launching part. Explanatory drawing of the operation example of the processing part which processes the gas emitted by the launching part. The flowchart explaining the detailed processing example of this embodiment.

Hereinafter, this embodiment will be described. The present embodiment described below does not unreasonably limit the content of the present invention described in the claims. Moreover, not all of the configurations described in the present embodiment are essential constituent requirements of the present invention.

1. 1. Simulation system FIG. 1 is a block diagram showing a configuration example of a simulation system (simulator, game system) of the present embodiment. The simulation system of this embodiment is, for example, a system that simulates virtual reality (VR), a game system that provides game content, a real-time simulation system such as a sports competition simulator or a driving simulator, a system that provides SNS services, and an image. It can be applied to various systems such as a content providing system that provides such contents or an operating system that realizes remote work. The simulation system of the present embodiment is not limited to the configuration shown in FIG. 1, and various modifications such as omitting a part of its constituent elements (each part) or adding other constituent elements can be performed.

The launching unit 50 is a device capable of firing gas to the user. The launching unit 50 has a plurality of launching devices CN1 to CNM. The launching unit 50 includes a launching unit direction changing unit 52 that changes the direction of the launching unit 50, and a launching device direction changing unit 54 that changes the direction of the launching devices CN1 to CNM. It also includes a processing unit 56 that processes the emitted gas.

The operation unit 160 is for the user (player) to input various operation information (input information). The operation unit 160 can be realized by various operation devices such as operation buttons, turn signal keys, joysticks, handles, pedals or levers.

The storage unit 170 stores various types of information. The storage unit 170 functions as a work area for the processing unit 100, the communication unit 196, and the like. The game program and game data necessary for executing the game program are stored in the storage unit 170. The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), an HDD (hard disk drive), an SSD, an optical disk device, or the like. The storage unit 170 includes an object information storage unit 172 and a drawing buffer 178.

The information storage medium 180 (a medium that can be read by a computer) stores programs, data, and the like, and its function can be realized by an optical disk (DVD, BD, CD), an HDD, a semiconductor memory (ROM), or the like. .. The processing unit 100 performs various processes of the present embodiment based on the program (data) stored in the information storage medium 180. That is, the information storage medium 180 is a program for causing a computer (a device including an input device, a processing unit, a storage unit, and an output unit) to function as each part of the present embodiment (a program for causing the computer to execute the processing of each part). Is remembered.

The HMD200 (head-mounted display device) is a device that is worn on the user's head and displays an image in front of the user's eyes. The HMD 200 is preferably a non-transparent type, but may be a transparent type. Further, the HMD 200 may be a so-called eyeglass type HMD.

The HMD 200 includes a sensor unit 210, a display unit 220, and a processing unit 240. It is also possible to modify the HMD 200 by providing a light emitting element. The sensor unit 210 is for realizing tracking processing such as head tracking. For example, the position and direction of the HMD 200 are specified by a tracking process using the sensor unit 210. By specifying the position and direction of the HMD 200, the user's viewpoint position and line-of-sight direction (user's position and direction) can be specified.

Various methods can be adopted as the tracking method. In the first tracking method, which is an example of the tracking method, a plurality of light receiving elements (photodiodes, etc.) are provided as the sensor unit 210, as will be described in detail in FIGS. 2 (A) and 2 (B) described later. Then, by receiving light (laser, etc.) from an externally provided light emitting element (LED, etc.) by these plurality of light receiving elements, the position of the HMD200 (user's head) in the three-dimensional space in the real world, Specify the direction. In the second tracking method, a plurality of light emitting elements (LEDs) are provided in the HMD 200 as described in detail in FIGS. 3 (A) and 3 (B) described later. Then, the position and direction of the HMD 200 are specified by capturing the light from these plurality of light emitting elements with an imaging unit provided outside. In the third tracking method, a motion sensor is provided as the sensor unit 210, and the position and direction of the HMD 200 are specified using this motion sensor. The motion sensor can be realized by, for example, an acceleration sensor or a gyro sensor. For example, by using a 6-axis motion sensor using a 3-axis acceleration sensor and a 3-axis gyro sensor, the position and direction of the HMD200 in a three-dimensional space in the real world can be specified. The position and direction of the HMD 200 may be specified by a combination of the first tracking method and the second tracking method, or a combination of the first tracking method and the third tracking method. Further, instead of specifying the user's viewpoint position and line-of-sight direction by specifying the position and direction of the HMD 200, a tracking process that directly specifies the user's viewpoint position and line-of-sight direction (position, direction) may be adopted. ..

The display unit 220 of the HMD 200 can be realized by, for example, an organic EL display (OEL) or a liquid crystal display (LCD). For example, the display unit 220 of the HMD 200 is provided with a first display or a first display area set in front of the user's left eye and a second display or a second display area set in front of the right eye. It is possible to display stereoscopically. In the case of stereoscopic display, for example, an image for the left eye and an image for the right eye having different parallax are generated, the image for the left eye is displayed on the first display, and the image for the right eye is displayed on the second display. Alternatively, the image for the left eye is displayed in the first display area of one display, and the image for the right eye is displayed in the second display area. Further, the HMD 200 is provided with two eyepieces (fisheye lenses) for the left eye and the right eye, thereby expressing a VR space that extends over the entire circumference of the user's field of view. Then, a correction process for correcting distortion generated in an optical system such as an eyepiece is performed on the left eye image and the right eye image. This correction process is performed by the display processing unit 120.

The processing unit 240 of the HMD 200 performs various processes necessary for the HMD 200. For example, the processing unit 240 performs control processing of the sensor unit 210, display control processing of the display unit 220, and the like. Further, the processing unit 240 may perform three-dimensional sound (stereophonic sound) processing to reproduce the three-dimensional sound direction, distance, and spread.

The sound output unit 192 outputs the sound generated by the present embodiment, and can be realized by, for example, a speaker or headphones.

The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and the function can be realized by an ASIC or the like for I / F processing. The portable information storage medium 195 is for the user to store various kinds of information, and is a storage device that holds the storage of such information even when the power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

The communication unit 196 communicates with an external device (another device) via a wired or wireless network, and its functions include hardware such as a communication ASIC or a communication processor, and communication firmware. Can be realized by.

The program (data) for operating the computer as each part of the present embodiment is distributed from the information storage medium of the server (host device) to the information storage medium 180 (or storage unit 170) via the network and the communication unit 196. You may. The use of information storage media by such a server (host device) can also be included within the scope of the present invention.

The processing unit 100 (processor) provides operation information from the operation unit 160, tracking information in the HMD 200 (information on at least one of the position and direction of the HMD, information on at least one of the viewpoint position and the line-of-sight direction), a program, and the like. Based on this, game processing (simulation processing), virtual space setting processing, moving object processing, virtual camera control processing, display processing, sound processing, and the like are performed.

Each process (each function) of the present embodiment performed by each unit of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the functions of each part may be realized by individual hardware, or the functions of each part may be realized by integrated hardware. For example, a processor includes hardware, which hardware can include at least one of a circuit that processes a digital signal and a circuit that processes an analog signal. For example, the processor may be composed of one or more circuit devices (for example, ICs, etc.) mounted on a circuit board, or one or more circuit elements (for example, resistors, capacitors, etc.). The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) can be used. Further, the processor may be a hardware circuit by ASIC. Further, the processor may include an amplifier circuit, a filter circuit, and the like for processing an analog signal. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD), or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and when the instructions are executed by the processor, the processing (function) of each part of the processing unit 100 is realized. The instruction here may be an instruction set that constitutes a program, or may be an instruction that instructs the hardware circuit of the processor to operate.

The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The arithmetic processing unit 110 includes an information acquisition unit 111, a virtual space setting unit 112, a mobile body processing unit 113, a virtual camera control unit 114, a game processing unit 115, a control unit 118, a display processing unit 120, and a sound processing unit 130. As described above, each process of the present embodiment executed by each of these parts can be realized by a processor (or a processor and a memory). It is possible to carry out various modifications such as omitting a part of these components (each part) or adding other components.

The input processing unit 102 performs a process of receiving operation information and tracking information, a process of reading information from the storage unit 170, and a process of receiving information via the communication unit 196 as input processes. For example, the input processing unit 102 stores the operation information input by the user using the operation unit 160, the processing of acquiring the tracking information detected by the sensor unit 210 of the HMD 200, and the information specified by the read command in the storage unit 170. The process of reading from the computer and the process of receiving information from an external device (server, etc.) via the network are performed as input processes. Here, the reception process is a process of instructing the communication unit 196 to receive information, a process of acquiring the received information by the communication unit 196 and writing it to the storage unit 170, and the like.

The arithmetic processing unit 110 performs various arithmetic processes. For example, arithmetic processing such as information acquisition processing, virtual space setting processing, moving object processing, virtual camera control processing, game processing (simulation processing), control processing, display processing, or sound processing is performed.

The information acquisition unit 111 (program module for information acquisition processing) performs various information acquisition processing. For example, the information acquisition unit 111 acquires user information (user tracking information) including at least one of the user's position information, direction information, and posture information.

The virtual space setting unit 112 (program module for virtual space setting processing) performs setting processing for a virtual space (object space) in which a plurality of objects are arranged. For example, various objects that represent moving objects (people, robots, cars, trains, airplanes, ships, monsters, animals, etc.), maps (topography), buildings, spectators' seats, courses (roads), trees, walls, water surfaces, etc. Performs a process of arranging and setting an object (an object composed of primitive surfaces such as polygons, free curved surfaces, or subdivision surfaces) in a virtual space. That is, the position and rotation angle (synonymous with direction and direction) of the object in the world coordinate system are determined, and the rotation angle (rotation angle around the X, Y, Z axis) is used for the position (X, Y, Z). Place the object. Specifically, in the object information storage unit 172 of the storage unit 170, object information, which is information such as the position, rotation angle, movement speed, and movement direction of an object (part object) in the virtual space, is associated with the object number. Is remembered. The virtual space setting unit 112 performs, for example, a process of updating this object information for each frame.

The moving body processing unit 113 (program module for moving body processing) performs various processing on the moving body moving in the virtual space. For example, a process of moving a moving body in a virtual space (object space, game space) or a process of operating a moving body is performed. For example, the mobile body processing unit 113 is based on the operation information input by the user by the operation unit 160, the tracking information acquired, the program (movement / motion algorithm), various data (motion data), and the like. Performs control processing to move the model object) in the virtual space and to move the moving body (motion, animation). Specifically, a simulation in which movement information (position, rotation angle, velocity, or acceleration) and motion information (position or rotation angle of a part object) of a moving body are sequentially obtained for each frame (for example, 1/60 second). Perform processing. A frame is a unit of time for performing movement / motion processing (simulation processing) and image generation processing of a moving body. The moving body is, for example, a virtual user (virtual player, avatar) in a virtual space corresponding to a user (player) in the real space, or a boarding moving body (operating moving body) on which the virtual user is boarding (operating).

The game processing unit 115 (game processing program module) performs various game processing for the user to play the game. In other words, the game processing unit 115 (simulation processing unit) executes various simulation processes for the user to experience virtual reality (virtual reality). The game process calculates, for example, a process of starting a game when the game start condition is satisfied, a process of advancing the started game, a process of ending the game when the game end condition is satisfied, or a game result. Processing etc. The game processing unit 115 includes a hit calculation processing unit 116. The hit calculation processing unit 116 executes a hit calculation process such as a hit determination process.

The control unit 118 (program module for control processing) controls the launch unit 50. The details of the control unit 118 will be described later.

The display processing unit 120 (display processing program module) performs display processing of a game image (simulation image). For example, drawing processing is performed based on the results of various processing (game processing, simulation processing) performed by the processing unit 100, an image is generated by this, and the image is displayed on the display unit 220 of the HMD 200. Specifically, geometry processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective conversion, or light source processing is performed, and drawing data (positions of vertices on the primitive surface) is performed based on the processing results. Coordinates, texture coordinates, color data, normal vector or α value, etc.) are created. Then, based on this drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is subjected to image information in pixel units such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a memorable buffer). As a result, an image that can be seen from a virtual camera (given viewpoint. First and second viewpoints for the left eye and the right eye) is generated in the object space (virtual space). The drawing process performed by the display processing unit 120 can be realized by a vertex shader process, a pixel shader process, or the like.

The sound processing unit 130 (sound processing program module) performs sound processing based on the results of various processing performed by the processing unit 100. Specifically, a game sound such as a musical piece (music, BGM), a sound effect, or a voice is generated, and the game sound is output to the sound output unit 192. A part of the sound processing of the sound processing unit 130 (for example, three-dimensional sound processing) may be realized by the processing unit 240 of the HMD 200.

The output processing unit 140 performs output processing of various information. For example, the output processing unit 140 performs a process of writing information to the storage unit 170 and a process of transmitting information via the communication unit 196 as an output process. For example, the output processing unit 140 performs a process of writing the information specified by the write instruction to the storage unit 170 and a process of transmitting the information to an external device (server or the like) via the network. The transmission process is a process of instructing the communication unit 196 to transmit information, instructing the communication unit 196 to transmit information, and the like.

The simulation system of the present embodiment includes an information acquisition unit 111, a virtual space setting unit 112, a game processing unit 115, a control unit 118, and a display processing unit 120.

The information acquisition unit 111 acquires user information including at least one of position information, direction information, and posture information of the user who wears the HMD200 (head-mounted display device). For example, the information acquisition unit 111 acquires user information (user tracking information) including at least one of the user's position information, direction information, and posture information in the real space based on the tracking information of the HMD 200 and the like. The position information may be the position information of the user's viewpoint in the real space, and the direction information may be the direction information of the user's line of sight in the real space. When the user is located in a field (play field, simulation field, play area) in the real space (real world), the position information and the direction information are the position information and the direction information (with a given position as the origin) in the field. It may be the position coordinates in the coordinate system to be used, the rotation angle around each coordinate axis). Posture information is information for specifying each posture of the user (standing posture, crouching posture, sitting posture, etc.), or specifying the position and direction of each part of the user (torso, head, hands, feet, etc.). be. For example, the information acquisition unit 111 may acquire the position information and direction information of the HMD 200 as the position information and direction information of the user who wears the HMD 200.

The virtual space setting unit 112 performs the virtual space setting process. For example, a process of arranging and setting an object such as a moving object, an obstacle, a background, or a map in a virtual space is performed. For example, when the user's position information and direction information in real space are acquired, the position and direction of the user moving body (user character, etc.) corresponding to the user are set based on the acquired position information and direction information. Then, the process of arranging in the virtual space is performed. Information such as the position and direction of the user moving object, which is an object, is stored in, for example, the object information storage unit 172. The user moving body is, for example, an object (display object) that moves in a virtual space (object space) following the movement of the user in the real space. Examples of the user moving body include an avatar moving body (user character, virtual user) corresponding to the user, a boarding moving body on which the avatar moving body is boarded, an outer shell moving body worn by the avatar moving body, and the like. The outer shell moving body is arranged so as to overlap the avatar moving body (ghost) and moves in the virtual space. The outer shell mobile is a mobile that includes an avatar mobile, and is expressed as a user's prosthetic body.

The game processing unit 115 processes the game in the virtual space. For example, a game process such as a process of starting a game, a process of advancing a game, a process of ending a game, or a process of calculating a game result is performed.

The control unit 118 controls the launch unit 50 capable of emitting gas to the user. For example, the control unit 118 controls the launching unit 50 itself, or controls a plurality of launching devices CN1 to CNM of the launching unit 50.

The display processing unit 120 generates a display image based on the result of the game processing. For example, a display image of the HMD 200 worn by the user so as to cover the field of view is generated. For example, an image that can be seen from a virtual camera in a virtual space is generated as a display image. For example, the virtual camera control unit 114 performs control processing of the virtual camera corresponding to the user's viewpoint. For example, the virtual camera control unit 114 controls the virtual camera set as the user's first-person view. For example, by setting a virtual camera at a position corresponding to the viewpoint of a moving object (virtual player, etc.) moving in the virtual space and setting the viewpoint position and line-of-sight direction of the virtual camera, the position (position coordinates) of the virtual camera can be set. And posture (rotation angle around the rotation axis). Then, the display processing unit 120 generates an image that can be seen from a virtual camera (user's viewpoint) in the virtual space as a display image (display image) of the HMD200 or the like. For example, an image that can be seen from a given viewpoint is generated in an object space that is a virtual space. The generated image is, for example, an image for stereoscopic viewing.

A plurality of launchers CN1 to CNM are arranged in the launch unit 50. Then, the control unit 118 performs control processing of the launch unit 50 according to the game situation in the virtual space. Specifically, the control unit 118 performs control processing of the launch unit 50 according to the game situation in the virtual space and the user information. That is, according to the game situation and the user information including at least one of the user's position information, direction information, and attitude information, the launching unit 50 selects the launching devices CN1 to CNM, the gas launch timing, and the gas. It controls the degree of firing output, the firing direction of gas, and the processing of gas.

Here, the game status is, for example, the user's gameplay status, game progress status, game event status, game battle status, game battle status, enemy attack status appearing in the game, and hit determination in the game. In the situation of moving objects (characters or hit objects, etc.) appearing in the game, the status parameters of characters and users (physical strength value, level, offensive power or defensive power, etc.), or the status of game results, etc. There are, for example, various situations represented by game parameters and the like. The game situation is specified by, for example, game processing in the game processing unit 115. For example, the game situation of the user is specified based on information such as various game parameters used in the game processing. Further, the control process of the launching unit 50 includes, for example, a control process of selecting the launching devices CN1 to CNM in the launching unit 50, a control process of the gas launch timing, a control process of the gas launch output degree, and a direction change of the launch unit 50. Control processing, control processing for changing the direction of the launching devices CN1 to CNM, control processing for processing the gas emitted by the launching unit 50, and the like.

In this way, the control unit 118 uses the game status such as the game play status, progress status, event status, battle status, battle status, attack status, hit judgment status, mobile status, status parameter status, or performance status. Depending on the situation, control processing is performed for selection of the launching device, launch timing, launch output degree, direction change, gas processing, and the like. In this way, the gas can be launched by the plurality of launching devices of the launching unit 50 so as to correspond to the game situation in the virtual space.

Further, the control unit 118 controls the launch unit 50 according to the user information such as the user's position information, direction information, or attitude information. For example, the launching unit 50 is controlled so that the gas is launched in the firing direction or the degree of firing output according to the position and direction of the user in the real space. Further, the firing direction of the gas at the launching unit 50, the firing output degree, and the like are changed according to the posture of the user and the like. In this way, it is possible to perform optimum gas emission control of the launching unit 50 according to the position, direction or posture of the user. For example, the control process of the present embodiment performs game processing such as advancing the game based on the acquired user information, and controls the launching unit 50 according to the game situation based on the result of the game processing. May be good. Further, the user may be detected based on the user information, and the launching unit 50 may be controlled according to the game situation of the detected user. For example, when the game situation is such that an enemy attacks the detected user, the launching unit 50 is controlled to emit gas.

Further, a plurality of launching devices CN1 to CNM are arranged in a matrix in the launching unit 50. Then, the control unit 118 controls a plurality of launchers CN1 to CNM arranged in a matrix. For example, launchers CN1 to CNM are arranged in a two-dimensional matrix. For example, launchers CN1 to CNM are arranged in a matrix of rows K and columns N. For example, K and N are integers of 1 or more, and preferably K and N are integers of 2 or more. In this case, the launchers CN1 to CNM may be arranged in a grid pattern. However, the distance between the launchers of CN1 to CNM does not have to be a constant distance, and may be different distances. Further, in the matrix-like arrangement of K rows and N columns, the N launchers arranged in one row may be arranged linearly or curvedly. Further, the K launchers arranged in a row may be arranged in a straight line or in a curved line.

Further, the control unit 118 selects the launchers CN1 to CNM in the launch unit 50 and the gas launch timing when a hit event in which the hit object (hit object) corresponding to the gas hits occurs in the virtual space. At least one of the control process of the above and the control process of the degree of emission output of the gas is performed. The hit object is an object in the virtual space corresponding to the gas in the real world, and may be an object displayed as an image in the virtual space or a virtual object hidden as an image in the virtual space. good. Further, when the user moving object corresponding to the user moves in the virtual space, the hit event is an event in which the hit object corresponding to the gas hits the user moving object or the like. The game processing unit 115 performs a hit determination process of whether or not the hit object is hit. Specifically, the hit calculation processing unit 116 of the game processing unit 115 performs hit calculation processing such as hit determination processing. The hit calculation process includes a hit determination process for determining whether or not a hit object has been hit, a calculation process for the amount of damage caused by a hit, an effect process for a hit, and the like.

The process of selecting the launching devices CN1 to CNM in the launching unit 50 is, for example, a process of selecting from which launching device of the launching devices CN1 to CNM the gas is to be launched. The launching device selected as the launching device for launching the gas may be one launching device or a plurality of launching devices. For example, when the launchers CN1 to CNM are arranged in a matrix of rows K and columns N, the control unit 118 performs a selection process for emitting gas to N launchers lined up in one row, or arranges them in one column. A selection process may be performed in which the K launchers lined up are fired with gas. The gas emission timing control process is a process of controlling at which timing the gas is emitted. In this case, the control unit 118 may control the firing timing when all the launching devices CN1 to CNM of the launching unit 50 simultaneously launch the gas, and launches one or more of the launching devices CN1 to CNM. When the device launches a gas, the gas launch timing of the one or more launchers may be controlled. The process of controlling the degree of emission output of gas is a process of controlling the strength and speed of the emitted gas. That is, it is a process of controlling the strength and speed at which the gas is emitted. For example, when the gas emission of the launching devices CN1 to CNM is controlled based on the launch control signal, the degree of gas launch output can be controlled by the voltage level, current level, signal waveform, or the like of the launch control signal.

Further, the control unit 118 selects the launchers CN1 to CNM in the launch unit 50, controls the gas launch timing, and controls the gas launch output degree according to the hit direction or the hit vector of the hit object. Do at least one of. The hit direction (attack direction) is the movement direction of the hit object when the hit object hits an object such as a user moving object. For example, the hit direction can be specified based on the trajectory of the hit object flying toward an object such as a user moving object. The hit vector represents the strength of the hit in addition to the hit direction. The strength of a hit when a hit object hits an object such as a user moving object is specified based on the magnitude of the hit vector. From this, the hit direction and the hit vector are obtained based on the hit calculation process in the game processing section 115 (hit calculation processing section 116). That is, the game processing unit 115 obtains hit information such as a hit direction and a hit vector based on the result of the game processing. Then, the control unit 118 selects the launching devices CN1 to CNM, controls the firing timing, or controls the firing output degree based on the hit information such as the hit direction and the hit vector obtained based on the result of the game processing. And so on.

Further, the plurality of launchers CN1 to CNM include first to first launchers along a first direction intersecting in the vertical direction. When the launchers CN1 to CNM are arranged in a matrix of rows K and columns N, the first to Nth launchers are launchers arranged in one row of rows K. Then, when a hit event occurs in which the hit object hits the hit object diagonally with respect to the user moving body corresponding to the user, the control unit 118 sequentially releases gas from the first launching device to the Nth launching device. Control the launcher so that it is fired.

For example, when a hit event occurs in which the hit object hits in an oblique direction, gas is emitted from the first launching device, then gas is launched from the second launching device, and then the gas is launched from the third launching device. Gas is fired from each launcher in chronological order, such as firing gas, and finally gas is fired from the Nth launcher. In this case, the launching device that sequentially launches the gas in chronological order may be a unit of one unit or a unit of a plurality of units. For example, control such that gas is launched from the first and second launchers, then gas is launched from the third and fourth launchers, and then gas is launched from the fifth and sixth gas devices. It may be.

Further, the diagonal direction when the hit object hits the user moving body in an oblique direction may be a diagonal direction with respect to the direction in which the user moving body faces, or a diagonal direction not depending on the direction in which the user moving body faces. There may be. For example, a user moving body in a virtual space changes its position and direction in conjunction with the movement of a user in the real world. In this case, the oblique direction may be an oblique direction with respect to the direction in which the user faces, or may be an oblique direction that does not depend on the direction in which the user faces.

Further, the launching unit 50 includes a launching unit direction changing unit 52 that changes the direction of the launching unit 50. For example, the launching unit direction changing unit 52 changes the direction (gas launching direction) of the launching unit 50 itself. When the direction of the launching unit 50 is changed in this way, the firing direction of the gas of the launching devices CN1 to CNM of the launching unit 50 is changed all at once. Then, the control unit 118 controls the launch unit direction changing unit 52 according to the game situation and the user information. For example, the user's gameplay status, game progress, game event status, game battle status, game battle status, enemy attack status, game hit judgment status, status of moving objects appearing in the game. , The status of the status parameter of the character or the user, the status of the result of the game, or the like, the launching unit direction changing unit 52 is controlled, and the direction in which the launching unit 50 faces (the gas firing direction) is changed. The launching unit direction changing unit 52 can be realized by an actuator (motor or the like) or a mechanical mechanism for changing the direction of the launching unit 50.

Further, the launching unit 50 includes a launching device direction changing unit 54 that changes the direction of the plurality of launching devices CN1 to CNM. The launcher direction changing unit 54 controls the direction (gas launch direction) of each launcher of CN1 to CNM. In this case, the launcher direction changing unit 54 may change the direction of the launcher in units of one, or may change the direction of the launcher in units of a plurality of units. Then, the control unit 118 controls the launching device direction changing unit 54 according to the game situation and the user information. For example, the user's gameplay status, game progress, game event status, game battle status, game battle status, enemy attack status, game hit judgment status, game character status, etc. The launcher direction changing unit 54 is controlled according to the status of the status parameters of the character or the user, the status of the game results, etc., and the direction (gas launch direction) of each launcher of CN1 to CNM is changed. .. The launcher direction changing unit 54 can be realized by an actuator (motor or the like) or a mechanical mechanism for changing the directions of the launchers CN1 to CNM.

Further, the virtual space setting unit 112 sets the source object of the hit object in the hit event in which the hit object corresponding to the gas hits in the virtual space to the position of the virtual space corresponding to the position of the launching unit 50 in the real space. Perform the process of arranging. For example, in a hit event, a source object (launch source object) such as an enemy character generates (fires) a hit object, and this hit object hits an object such as a user moving object. In this case, the virtual space setting unit 112 arranges the source object at a position (position or direction) in the virtual space corresponding to the position (position or direction) of the launching unit 50 in the real space. Then, the hit object from the source object arranged at such a position in the virtual space hits an object such as a user moving object. In this way, it is possible to make the position of the source object that generates the hit object correspond to the position of the launching unit 50 that emits the gas corresponding to the hit object. This makes it possible to realize a virtual reality as if gas was generated from the position of the source object.

Further, the game processing unit 115 performs a game production process in which sound, vibration, or an image is linked to the emission of gas by the launching unit 50. For example, in conjunction with the launch of gas at the launching unit 50, sounds such as gas launch sounds and hit sounds and outputs, vibrations representing gas launches and hits are generated, and effects representing gas launches and hits are generated. Performs game production processing to display an image. Such a game effect processing can be realized, for example, when the launch unit 50 is controlled based on the launch control signal from the control unit 118, the effect process linked to the launch control signal is performed.

Further, the launching unit 50 includes a processing unit 56 that processes the gas to be emitted. Then, the launching unit 50 launches the gas processed by the processing unit 56 under the control of the control unit 118.

Here, various modes can be considered as the gas processing in the processing unit 56. For example, it may be processed to mix the scent with the emitted gas. Further, processing may be performed so as to change the temperature of the emitted gas. For example, processing is performed to raise the temperature of the emitted gas or lower the temperature. For example, as one mode of processing for lowering the temperature, processing such as mixing ice or snow with gas may be performed and then fired. Alternatively, processing may be performed to change the humidity of the emitted gas. For example, processing is performed to raise the humidity of the emitted gas or lower the humidity. For example, processing such as firing mist may be performed. If the gas is processed and fired in this way, the processed gas can be used to allow the user to experience a wide variety of virtual reality. For example, in conjunction with the video scene of the HMD200 where a snowstorm blows, processing is performed such that a gas mixed with ice or snow is emitted. In addition, processing is performed so as to emit hot air gas in conjunction with the video scene of the HMD200 in a hot place such as a volcano. In addition, in conjunction with video scenes such as flower fields, processing is performed to emit gas mixed with the scent of flowers. This makes it possible to further improve the virtual reality of the user.

Further, the processing unit 56 performs different processing on the gas to be emitted by the first launching device and the second launching device of the plurality of launching devices CN1 to CNM. For example, different gas processing is performed for each launcher. In this way, it becomes possible to launch variously processed gases to the user by using the plurality of launchers CN1 to CNM. In the plurality of launchers CN1 to CNM, the processing of the gas emitted by the launcher may be different in units of one, or the processing of the gas emitted by the launcher may be different in units of a plurality of launchers. You may.

The moving body processing unit 113 performs a moving process of the user moving body moving in the virtual space. For example, the moving body processing unit 113 uses the user moving body (avatar moving body, boarding moving body, outer shell moving body) corresponding to the user based on the user information (position information, direction information) acquired by the information acquisition unit 111. Then, the process of moving in the virtual space is performed. For example, the user moving body is moved in the virtual space so as to follow the movement of the user in the real space. For example, the position of the user moving body is updated for each frame based on the moving speed and the moving acceleration of the user moving body, and the user moving body is moved in the virtual space (virtual field). Further, the mobile body processing unit 113 performs a process of operating the user mobile body based on the user information (posture information) acquired by the information acquisition unit 111. For example, based on the motion data, motion processing for changing the posture of the user moving body or the like is performed.

Further, the virtual camera control unit 114 controls the virtual camera so as to follow the change in the viewpoint of the user based on the tracking information of the viewpoint information of the user.

For example, the input processing unit 102 (input receiving unit) acquires tracking information of the viewpoint information of the user who wears the HMD 200. For example, the tracking information (viewpoint tracking information) of the viewpoint information which is at least one of the user's viewpoint position and line-of-sight direction is acquired. This tracking information can be obtained, for example, by performing tracking processing of HMD200. The user's viewpoint position and line-of-sight direction may be directly acquired by the tracking process. As an example, the tracking information includes change information of the viewpoint position from the initial viewpoint position of the user (change value of the coordinates of the viewpoint position) and change information of the line-of-sight direction from the initial line-of-sight direction of the user (rotation axis in the line-of-sight direction). It can include at least one of (changes in rotation angle around). The user's viewpoint position and line-of-sight direction (information on the position of the user's head and posture) can be specified based on the change information of the viewpoint information included in such tracking information.

Then, the virtual camera control unit 114 changes the viewpoint position and the line-of-sight direction of the virtual camera based on the acquired tracking information (information on at least one of the user's viewpoint position and the line-of-sight direction). For example, the virtual camera control unit 114 virtually changes the viewpoint position and line-of-sight direction (position, posture) of the virtual camera in the virtual space according to changes in the user's viewpoint position and line-of-sight direction in the real space. Set the camera. By doing so, it is possible to control the virtual camera so as to follow the change in the viewpoint of the user based on the tracking information of the viewpoint information of the user.

Further, in the present embodiment, virtual reality simulation processing is performed as game processing of the game played by the user. The virtual reality simulation process is a simulation process for simulating an event in a real space in a virtual space, and is a process for allowing a user to experience the event virtually. For example, processing for moving a user moving body such as an avatar moving body (virtual user) corresponding to a user in the real space or its boarding moving body in the virtual space, and for the user to experience changes in the environment and surroundings due to the movement. I do.

The processing of the simulation system of the present embodiment of FIG. 1 can be realized by a processing device such as a PC installed in a facility, a processing device worn by a user, or distributed processing of these processing devices. Alternatively, the processing of the simulation system of the present embodiment may be realized by the server system and the terminal device. For example, it may be realized by distributed processing of the server system and the terminal device.

2. Tracking process Next, an example of tracking process will be described. FIG. 2A shows an example of the HMD200 used in the simulation system of the present embodiment. As shown in FIG. 2A, the HMD 200 is provided with a plurality of light receiving elements 201, 202, 203 (photodiodes). The light receiving elements 201 and 202 are provided on the front surface of the HMD 200, and the light receiving elements 203 are provided on the right side surface of the HMD 200. Further, a light receiving element (not shown) is also provided on the left side surface, the upper surface, and the like of the HMD.

Further, the user US wears tracking devices 251, 252, and 253 on parts such as hands and hips. Similar to the HMD200, these tracking devices 251, 252, and 253 are provided with a plurality of light receiving elements (not shown). By using these light receiving elements, the positions and directions of parts such as hands and hips can be specified and the posture information of the user US can be acquired as in the case of the HMD200. The part of the user US to which the tracking device is attached is not limited to the hands and hips, and can be attached to various parts such as the legs, abdomen, and chest.

Further, the HMD200 is provided with a headband 260 and the like so that the user US can stably attach the HMD200 to the head with a better wearing feeling. Further, the HMD 200 is provided with a headphone terminal (not shown), and by connecting the headphone 270 (sound output unit 192) to the headphone terminal, for example, 3D sound (3D audio) processing is performed. The user US can listen to the game sound. The operation information of the user US may be input by detecting the nodding motion and the swinging motion of the head of the user US by the sensor unit 210 or the like of the HMD 200.

As shown in FIG. 2B, base stations 280 and 284 are installed around the user US. The base station 280 is provided with light emitting elements 281 and 282, and the base station 284 is provided with light emitting elements 285 and 286. The light emitting elements 281, 282, 285, and 286 are realized by, for example, an LED that emits a laser (infrared laser or the like). The base stations 280 and 284 use these light emitting elements 281, 282, 285 and 286 to emit, for example, a laser radially. Then, the light receiving elements 201 to 203 and the like provided in the HMD200 of FIG. 2A receive the laser from the base stations 280 and 284, so that the tracking of the HMD200 is realized, and the position of the head of the user US and the direction in which it faces are realized. (Viewpoint position, line-of-sight direction) can be detected.

Further, the light receiving elements provided in the tracking devices 251, 252, and 253 can detect at least one of the positions and directions of each part of the user US by receiving the laser from the base stations 280 and 284.

FIG. 3A shows another example of the HMD200. In FIG. 3A, a plurality of light emitting elements 231 to 236 are provided for the HMD 200. These light emitting elements 231 to 236 are realized by, for example, LEDs. The light emitting elements 231 to 234 are provided on the front surface of the HMD 200, and the light emitting element 235 and the light emitting element 236 (not shown) are provided on the back side. These light emitting elements 231 to 236 emit (emit) light in the visible light band, for example. Specifically, the light emitting elements 231 to 236 emit light of different colors from each other. In addition, light emitting elements (not shown) are also provided in tracking devices 251, 252, and 253 that the user US wears on parts such as hands and hips.

Then, the image pickup unit 150 shown in FIG. 3B is installed at at least one place (for example, the front side, the front side, the rear side, etc.) around the user US, and the light emitting element 231 of the HMD 200 is provided by the image pickup unit 150. ~ 236 light is imaged. That is, the spot light of these light emitting elements 231 to 236 is reflected in the image captured by the imaging unit 150. Then, by performing image processing of this captured image, tracking of the head (HMD) of the user US is realized. That is, the three-dimensional position and the direction (viewpoint position, line-of-sight direction) of the head of the user US are detected.

For example, as shown in FIG. 3B, the imaging unit 150 is provided with the first and second cameras 151 and 152, and the first and second cameras 151 and 152 of these first and second cameras 151 and 152 are provided. By using the captured image, the position of the head of the user US in the depth direction can be detected. Further, the rotation angle (line of sight) of the head of the user US can be detected based on the motion detection information of the motion sensor provided in the HMD 200. Therefore, by using such an HMD200, no matter which direction the user US faces in all directions of 360 degrees around it, the image (user's) in the corresponding virtual space (virtual three-dimensional space) is used. The image seen from the virtual camera corresponding to the viewpoint) can be displayed on the display unit 220 of the HMD 200.

Further, by capturing the light of the light emitting elements of the tracking devices 251, 252, and 253 by the imaging unit 150, at least one of the positions and directions of each portion of the user US can be detected as in the case of the HMD 200.

Infrared LEDs may be used as the light emitting elements 231 to 236 instead of visible light. Further, the position and movement of the user's head may be detected by another method such as using a depth camera or the like.

Further, the tracking processing method for detecting the user's viewpoint position and line-of-sight direction (user's position and direction) is not limited to the methods described in FIGS. 2A to 3B. For example, the tracking process may be realized by the HMD 200 alone by using a motion sensor or the like provided in the HMD 200. That is, the tracking process is realized without providing an external device such as the base station 280 and 284 of FIG. 2 (B) and the image pickup unit 150 of FIG. 3 (B). Alternatively, the viewpoint information such as the user's viewpoint position and line-of-sight direction may be detected by various viewpoint tracking methods such as known eye tracking, face tracking or head tracking. Further, the tracking devices 251, 252, and 253 may detect the position and direction of each part of the user US by using the motion sensors provided in the tracking devices 251, 252, and 253.

3. 3. Method of this Embodiment Next, the method of this embodiment will be described in detail. In the following, the case where the method of this embodiment is applied to a competitive game will be mainly described as an example. However, this embodiment is not limited to this, and various games (RPG, action game, competition game, sports game, horror experience game, simulation game of vehicle such as train and airplane, puzzle game, communication game, or music game Etc.), and can be applied to other than games. Further, in the following, the case where the user moving body is a user's avatar moving body (virtual user, user character) will be described as an example, but the user moving body is a boarding moving body (for example, a robot, a tank, a battle) on which the user is boarded. It may be a machine, a car, etc.). Further, in the following description, it will be mainly described that the gas emitted by the launching device is air, but the present embodiment is not limited to this.

3.1 Description of the game First, the game realized by the present embodiment will be described. FIG. 4 is an example of the housing 40 used in the simulation system of the present embodiment. In the present embodiment, the user wearing the HMD plays the game on the housing 40 as shown in FIG.

The housing 40 includes a field FL (floor surface) on which the user US plays a game, a launching unit 50, and a processing device 60. Areas AR1, AR2, and AR3 are set in the field FL, and vibration units VB1, VB2, and VB3 that vibrate the floor of the field FL are provided below the areas AR1, AR2, and AR3. For example, the vibrating portion VB1 provided in the center is realized by a vibrating motor, and the vibrating portions VB2 and VB3 provided at both ends are realized by a transducer. The vibration motor generates vibration by rotating an eccentric weight, for example. Specifically, eccentric weights are attached to both ends of the drive shaft (rotor shaft) so that the motor itself swings. The transducer converts a sound signal and is equivalent to a high-power subwoofer. For example, when the control unit 118 of FIG. 1 performs a sound file reproduction process, the resulting sound signal is input to the transducer. Then, for example, vibration is generated based on the low frequency component of the sound signal.

The processing device 60 performs various processes of the simulation system of the present embodiment, and corresponds to the processing unit 100, the storage unit 170, and the like in FIG. In FIG. 4, the processing device 60 is realized by a personal computer (PC).

The launching portion 50 is supported by supporting portions 62 and 64 provided in the field FL. The launch unit 50 is provided so that its main surface faces the user US standing in the field FL. A plurality of launching devices CN1 to CN18 are arranged in a matrix in the launching unit 50. The launchers CN1 to CN18 launch air (in a broad sense, gas; the same applies hereinafter) to the user US facing the launching unit 50. Blowers FN1, FN2, and FN3 are provided below the launchers CN1 to CN18. The blowers FN1, FN2, and FN3 are realized by, for example, a sirocco fan or the like. Then, air (gas) is blown to the user US facing the launching unit 50.

5 (A) and 5 (B) are views for explaining detailed examples of the launching unit 50 and the launching devices 70 (CN1 to CN18). The launching unit 50 is a device capable of firing air (gas) to the user, and has launching devices CN1 to CN18 arranged in a matrix. In FIG. 5A, the launchers CN1 to CN18 are arranged in a matrix of 3 rows and 6 columns. However, this embodiment is not limited to this, and may be arranged in a matrix of K rows and N columns (K and L are integers of 2 or more). Further, in FIG. 5A, the distances between the launchers are evenly spaced, but the distances between the launchers may be different. For example, the arrangement is not limited to the grid pattern as shown in FIG. 5 (A), and for example, each row and each column may be a curved array instead of a linear array. A one-dimensional array is also possible.

Further, in FIG. 5A, the launchers CN1 to CN18 launch air with a strong pressure (strong static pressure) like a so-called air cannon, whereas the blowers FN1, FN2, and FN3 are weaker due to a sirocco fan or the like. Blow air with pressure (weak static pressure).

FIG. 5B is a configuration example of the launching device 70 (CN1 to CN18). The launcher 70 has a speaker 72 and an air storage unit 76 (gas storage unit). The speaker 72 vibrates the diaphragm 74 based on the sound signal (low frequency signal). When the diaphragm 74 vibrates, the air (mass of air) accumulated in the air storage unit 76 is emitted from the launch port 78 like an air cannon. For example, it is emitted as spiral air. The launching device 70 is not limited to the configuration shown in FIG. 5B, and various modifications can be performed. For example, instead of the speaker 72, a vibration device such as a transducer, a vibration motor, or a solenoid may be used to vibrate the diaphragm 74 to emit air.

FIG. 6 is an example of a field VFL (play field, game stage) set in the virtual space. In the field VFL, a user character (in a broad sense, a user moving body) corresponding to the user and operated by the user, and enemy characters CHE1, CHE2, and CHE3 operated by the opponent player or the computer are arranged. Here, the user character CH, the enemy characters CHE1, CHE2, and CHE3 are arranged at the positions of each corner of the quadrangle. Then, a battle is performed between these characters by attacking an air bullet.

7 to 10 are examples of game images generated by the present embodiment. In FIG. 7, the enemy character CHE1 (source object in a broad sense) attacks the user character CH (FIG. 6) using the air bullet AR (hit object in a broad sense). For example, after the bullet AR is fired in FIG. 7, the bullet AR is approaching the user character CH in FIGS. 8 and 9, and the bullet AR hits the user character CH in FIG.

In the present embodiment, when a hit event occurs in which the air bullet AR (hit object) fired (generated) by the enemy character CHE1 (source object) hits the user character CH (user moving object) in this way. The launching unit 50 of FIG. 4 is used as an experience device for experiencing the hit of the air bullet AR by the user's tactile sense. That is, when the air bullet AR hits, the launching unit 50 emits air to the user US, and the user US is made to experience the virtual reality as if the real air bullet AR was hit. That is, the user US is given a tactile sensation when the air mass emitted by the launching unit 50 hits the body.

As shown in FIG. 4, the user US wears the HMD so as to cover the field of view. Therefore, in conjunction with the display image (video) of the HMD as shown in FIGS. 7 to 10, the air mass from the launching unit 50 hits the user US like an air cannon, so that the user US is real. You will be able to experience the virtual reality as if the air bullet AR was a hit. An experience device using such an air launching unit 50 is an appropriate device in terms of hygiene, safety, and operation of the simulation system, and has the advantage that the scale of the device is not so large. be. For example, if only air is applied to the user US, there will be no hygiene or safety problems. Further, if the launching unit 50 is provided only at a position facing the user US as shown in FIG. 4, the scale of the simulation system can be made compact.

3.2 Control of the launching unit according to the game situation Next, the control method of the launching unit 50 in the present embodiment will be described in detail. In the present embodiment, the launching units 50 in which a plurality of launching devices CN1 to CN18 are arranged in a matrix (two-dimensional) are used, and the launching units 50 are set to a game situation in a virtual space as shown in FIGS. 7 to 10. It is controlled accordingly. Specifically, the launching unit 50 is controlled according to the game situation and user information (position, direction, posture, etc.). For example, the simulation system of the present embodiment is a simulation system in a game in which a user wearing an HMD that covers the field of view is located at a play location in real space and detects, for example, the position or direction of the user to play. Then, in the simulation system of the present embodiment, there is a launching unit 50 in which a plurality of launching devices capable of blowing out a gas such as air to the user are arranged according to the game situation in the virtual space and the user information, respectively. It has a control unit 118 for controlling the launch of the above, and the launch unit 50 is installed in a direction facing the user's play place in the real space. According to such a simulation system, various control processes using a plurality of launching devices CN1 to CN18 become possible, and optimum air launch control according to the game situation can be realized.

For example, in the simulation system of the present embodiment, depending on the game situation and user information, the launching unit 50 selects launching devices CN1 to CN18, controls the firing timing of air (gas), or determines the degree of firing output of air. Perform control processing. Specifically, when a hit event as shown in FIGS. 7 to 10 occurs when a bullet (hit object) corresponding to air (gas) hits in a virtual space (game space), the launchers CN1 to CN18 Selection process, launch timing control process, or launch output degree control process.

For example, when a normal air bullet hits the user character CH, the launching unit 50 is controlled as shown in FIGS. 11A and 11B. That is, at the time of hitting a normal air bullet, the launchers CN7 to CN12 shown by the diagonal lines in FIG. 11 (A) launch air. Specifically, as shown in FIG. 11B, the air (air mass) emitted from the launchers CN7 to CN12 provided in the middle stage of the launch unit 50 comes into contact with the user US. Further, as shown in FIG. 4, the vibrating portions VB1, VB2, and VB3 (vibration motor, transducer) provided on the floor of the field FL vibrate in accordance with the hit of the air bullet in the virtual space.

As described above, in FIGS. 11A and 11B, when a hit event in which a normal air bullet hits occurs, the middle-stage launchers CN7 to CN12 are selected from the launchers CN1 to CN18 of the launching unit 50. The selection process is being carried out.

Further, as shown in FIG. 10, a firing timing control process is performed so that the launching devices CN7 to CN12 launch air according to the timing at which the air bullet (AR) hits in the HMD display image of the user US. ing. For example, the arrival time of the air bullet is calculated, and the firing timing of the launching devices CN7 to CN12 is controlled so as to launch air in advance before the hit event in which the air bullet hits occurs. This firing timing control process can be realized by controlling the output timing of the firing control signal generated by the control unit 118 of FIG.

Further, when a hit event of a bullet occurs, a game effect process of vibrating the vibrating portions VB1, VB2, and VB3 provided on the floor of the field FL is also performed.

When a hit event of the air bullet occurs, the degree of air emission output may be controlled. For example, when a hit event of a normal air bullet occurs, a control process is performed to weaken the degree of air emission output as compared with the case of a hit event of a special air bullet described later. Such a control process can be realized, for example, by controlling the vibration intensity of the diaphragm 74 of FIG. 5 (B). For example, when a hit event of a normal air bullet occurs, the vibration of the diaphragm 74 is controlled to be weaker than when a hit event of a special air bullet occurs. For example, when the diaphragm 74 of the speaker 72 is vibrated based on the sound signal, the vibration of the diaphragm 74 can be weakened by reducing the amplitude of the sound signal.

On the other hand, when a special air bullet having a higher attack power (power) than a normal air bullet hits the user character CH, the launching unit 50 as shown in FIGS. 12 (A) and 12 (B) Perform control processing. That is, when the special air bullet hits, all the launchers CN1 to CN18 shown by the diagonal lines in FIG. 12 (A) emit air. That is, as shown in FIG. 12B, the air (air mass) emitted from the launchers CN1 to CN18 provided in the lower, middle, and upper stages of the launch unit 50 comes into contact with the user US. .. Further, as shown in FIG. 4, the vibrating portions VB1, VB2, and VB3 provided on the floor of the field FL vibrate in accordance with the hit of the special air bullet. Further, after the special air bullet hits, the blowers FN1 to FN3 blow air to the user US, and the user US is made to experience the afterglow caused by the hit of the special air bullet. In this case, the blowing strength of the blowers FN1 to FN3 may be changed according to the level of the attack power (power) of the special air bullet. For example, the higher the attack power level of the special air bullet, the stronger the blast. Further, the strength of vibration of the vibrating parts VB1, VB2, and VB3 is also controlled so that the higher the level of the attack power of the special air bullet, the stronger the vibration.

As described above, in FIGS. 12A and 12B, a selection process is performed in which all the launchers CN1 to CN18 of the launching unit 50 are selected when a hit event in which a special air bullet hits occurs. ..

Further, the firing timing control process is performed so that the launching devices CN1 to CN18 launch air according to the timing when the special air bullet hits in the HMD display image of the user US. For example, the arrival time of the special air bullet is calculated, and the firing timing of the launching devices CN1 to CN18 is controlled so that air is fired in advance before the hit event in which the special air bullet hits occurs. Further, when a hit event of a special air bullet occurs, a game effect process of vibrating the vibrating portions VB1, VB2, and VB3 provided on the floor of the field FL is also performed.

In this case, when a hit event of a special air bullet occurs, the degree of air emission output may be controlled. For example, when a hit event of a special air bullet occurs, a control process is performed to increase the degree of air emission output as compared with the case of a hit event of a normal air bullet shown in FIGS. 11 (A) and 11 (B). For example, when a hit event of a special air bullet occurs, the vibration of the diaphragm 74 of FIG. 5 (B) is controlled to be stronger than when a hit event of a normal air bullet occurs. For example, the amplitude of the sound signal input to the speaker 72 is increased. Further, the higher the level of the attack power of the special air bullet, the stronger the control process for increasing the degree of air emission output may be performed. For example, the amplitude of the sound signal is changed according to the level of the attack power of the special air bullet. Such control for changing the amplitude of the sound signal has an advantage that it can be realized by a simple process of simply switching the sound file for generating the sound signal.

As described with reference to FIGS. 11A to 12B, in the present embodiment, the launching unit 50 is controlled according to the game situation in the virtual space. For example, in a game situation where a normal air bullet hits, as shown in FIGS. 11A and 11B, air is emitted only from the launchers CN7 to CN12 in the middle stage of the launching unit 50. Also, the degree of air emission output is weaker than when a special air bullet hits. Further, the blowers FN1 to FN3 of the launching unit 50 are not blown.

On the other hand, in the game situation where the special air bullet hits, as shown in FIGS. 12A and 12B, air is emitted from all the launching devices CN1 to CN18 of the launching unit 50. Also, the degree of air emission output is weaker than when a normal air bullet hits. Further, in order to let the user US experience the afterglow of the hit of the special air bullet, the blowers FN1 to FN3 of the launching unit 50 are also blown.

By doing so, in the present embodiment, the optimum control of the launching unit 50 according to the game situation in the virtual space is realized. For example, in the present embodiment, air emission control is performed according to an image of the game situation in the virtual space reflected on the HMD. For example, the air emission control will be different depending on whether the image of the game situation where the normal air bullet hits is displayed on the HMD or the image of the game situation where the special air bullet hits is displayed on the HMD. Since the experience given to the user will be different, the virtual reality of the user can be greatly improved.

3.3 Launch control according to hit direction and hit vector In this embodiment, depending on the hit direction or hit vector of the hit object, the launcher 50 selects a launcher, controls the gas launch timing, or Control processing is performed for the degree of emission output of gas. For example, the plurality of launchers CN1 to CN18 in FIG. 5A have launchers CN7 to CN12 (first to Nth launchers) along a first direction intersecting in the vertical direction. Then, it is assumed that a hit event occurs in which the air bullet (hit object) hits the user character (user moving object) corresponding to the user in the diagonal direction. In this case, the launching unit 50 is controlled so that air (gas) is sequentially launched from the launching device CN7 (first launching device) to the launching device CN12 (Nth launching device).

For example, in FIG. 13 (A), the enemy character CHE, which is the source object, fires a bullet AR (hit object). Then, a hit event occurs in which the bullet AR hits the user character CH (user moving body) in the hit direction DH (or hit vector VH). In this case, the launch device selection process, the launch timing control process, or the launch output degree control process is performed according to the hit direction DH (or hit vector VH) of the air bullet.

Specifically, in FIG. 13A, a hit event occurs in which the air bullet hits the user character CH corresponding to the user US from the diagonally left direction. That is, the hit direction DH (hit vector VH) is diagonally to the left with respect to the user character CH. For example, in FIG. 13A, the hit direction DH is diagonally to the left with respect to the direction in which the user character CH faces.

In this case, in the present embodiment, as shown in FIG. 13B, air is sequentially emitted from the launching device CN7 (first launching device) to the launching device CN12 (Nth launching device). The launching unit 50 is controlled. Here, the launchers CN7 to CN12 (first to Nth launchers) are launchers arranged along the first direction DR1 (horizontal direction) intersecting (orthogonal) with the vertical DRV. Specifically, as shown in FIG. 14, the launcher CN7 first launches air, and then the launcher CN8 launches air. After that, the launchers CN9, CN10, and CN11 sequentially launch air in chronological order, and finally the launcher CN12 launches air.

As shown in FIGS. 13B and 14, if the launchers CN7 to CN11 sequentially eject air in chronological order, it is as if the air was emitted from the launching portion arranged in the left direction of the launcher. It is possible to make the user US feel. That is, as shown in FIG. 4, in the present embodiment, the launching unit 50 is arranged in the front direction of the user US. Also in this case, as shown in FIGS. 13 (B) and 14, the launchers CN7 to CN11 sequentially eject air in chronological order, as if the user US is ejecting air from an oblique direction to the left. In addition, the user US has an illusion. Therefore, for example, it is possible to realize a bodily sensation device capable of giving a tactile sensation as if air hits from an oblique left direction without providing a launching portion in the left side direction of the user US. Therefore, it is only necessary to provide the launching unit 50 in the front direction of the user US, and it is not necessary to provide the launching unit 50 in the left side direction, so that the experience device can be downsized. That is, in the present embodiment, the field of view of the user US is covered with the HMD, and the air masses of the plurality of launchers CN7 to CN12 from the front direction are generated by the user US because the HMD is mounted in which the real space situation cannot be seen. By shifting the timing of collision with the body, it is possible to make the illusion that it was released from an oblique direction.

On the other hand, in FIG. 15A, a hit event occurs in which the air bullet hits the user character CH corresponding to the user US from the diagonally right direction. That is, the hit direction DH (hit vector VH) is diagonally to the right with respect to the user character CH. For example, in FIG. 15A, the hit direction DH is diagonally to the right with respect to the direction in which the user character CH faces.

In this case, in the present embodiment, as shown in FIG. 15B, the launching unit 50 is controlled so that air is sequentially launched from the launching device CN12 to the launching device CN7. That is, the launchers CN12 to CN7 sequentially launch air along the second direction DR2 (opposite direction of DR1) that intersects (orthogonally) the vertical DRV. For example, the launcher CN12 launches air, then the launchers CN11, CN10, CN9, and CN8 sequentially launch air, and finally the launcher CN7 launches air.

In this way, it is possible to make the user US feel as if the air was emitted from the launching portion arranged on the right side of the user. That is, as shown in FIG. 4, in the present embodiment, the launching unit 50 is arranged in the front direction of the user US. Also in this case, as shown in FIG. 15B, the launchers CN12 to CN7 sequentially eject air in chronological order, so that the user US is ejecting air from the diagonally right direction of the user US. Is an illusion. Therefore, for example, even if the launching portion is not provided on the right side of the user US, it is possible to realize such a sensory device that the air hits from the diagonally right direction, and the scale of the sensory device can be reduced.

Then, in the present embodiment, the launching device depends on whether the hit direction DH (hit vector VH) is diagonally to the left as shown in FIG. 13 (A) or diagonally to the right as shown in FIG. 15 (A). Selection process, launch timing control process, or launch output degree control process.

For example, when the hit direction DH is diagonally to the left, as shown in FIG. 13B, a launching device is selected so as to launch air in the order of CN7, CN8, CN9, CN10, CN11, and CN12, and each of them is selected. Air is fired at the timing of the fire. At this time, for example, the launchers CN7 and CN12 that are far from the user US may have a higher firing output degree than the launchers CN9 and CN10 that are close to the user US.

When the hit direction DH is diagonally to the right, as shown in FIG. 15B, a launching device is selected so as to launch air in the order of CN12, CN11, CN10, CN9, CN8, and CN7, and each of them is selected. Air is fired at the timing of the fire. At this time, for example, the launchers CN7 and CN12 that are far from the user US may have a higher firing output degree than the launchers CN9 and CN10 that are close to the user US.

In this way, the optimum air emission control according to the hit direction DH (hit vector VH) can be realized, and the virtual reality of the user can be improved.

In FIGS. 13 (A) to 15 (B), air is sequentially emitted to the launchers CN7 to CN12 in the middle stage (row in the middle stage), but the present embodiment is not limited to this. For example, in addition to the middle-stage launchers CN7 to CN12, the lower-stage (lower row) launchers CN1 to CN6 and the upper-stage (upper row) launchers CN13 to CN18 are also controlled to sequentially emit air. May be good.

For example, when the above-mentioned hit event of a normal air bullet occurs, air is sequentially emitted to the launchers CN7 to CN12 in the middle stage. On the other hand, when a hit event of a special air bullet occurs, air is sequentially emitted to the lower, middle, and upper launchers CN1 to CN6, CN7 to CN12, and CN13 to CN18. For example, launchers CN1, CN7, CN13 fire air, then launchers CN2, CN8, CN14 fire air, and so on, each row of launchers fires air in chronological order, and finally. Launchers CN6, CN12, and CN18 launch air. By doing so, it becomes possible to realize a control process that substantially increases the degree of launch output of the launch unit 50.

Further, in FIGS. 13 (A) to 15 (B), a case where the hit direction DH (hit vector VH) is oblique with respect to the direction in which the user character CH (user US) is directed has been described. Not limited to this. For example, the hit direction DH (hit vector VH) does not depend on the direction in which the user character CH (user US) faces, and may be diagonal to the position of the user character CH arranged in the field of the virtual space. For example, in FIG. 13 (A), even when the user US faces the left diagonal direction instead of the front direction and the user character CH faces the left diagonal direction in conjunction with the user US, as shown in FIGS. 13 (B) to 14. Control processing of the launching unit 50 may be performed. The same applies to the case where the user US faces the diagonally right direction instead of the front direction in FIG. 15A, and the user character CH faces the diagonal right direction in conjunction with the direction.

3.4 Control of launching direction As shown in FIG. 1 in the present embodiment, the launching unit 50 includes a launching unit direction changing unit 52 that changes the direction of the launching unit 50, and changes the launching unit direction according to the game situation. The unit 52 is controlled. Alternatively, the launching unit 50 includes a launching device direction changing unit 54 that changes the direction of the plurality of launching devices, and controls the launching device direction changing unit 54 according to the game situation.

For example, in FIGS. 16A to 16C, the launching unit direction changing unit 52 changes the direction of the launching unit 50 according to the game situation. For example, in FIG. 16A, the direction DRA of the launching unit 50 (direction orthogonal to the main surface of the launching unit) is set so that air is emitted from the front direction of the user US. On the other hand, in FIG. 16B, the direction DRA of the launching unit 50 is changed by the launching unit direction changing unit 52 so that air is emitted from the diagonally left direction of the user US. Further, in FIG. 16C, the direction DRA of the launching unit 50 is changed by the launching unit direction changing unit 52 so that air is emitted from the diagonally right direction of the user US. In this way, the direction DRA of the launching unit 50 can be controlled so that the air is ejected from an appropriate direction according to the game situation.

Further, in FIGS. 17A to 17C, the position of the user US is detected, and the direction of the launching unit 50 is controlled by the launching unit direction changing unit 52.

For example, in FIG. 17A, since the user US is located in the center of the front side of the launching unit 50, the direction DRA of the launching unit 50 is set so as to emit air from the front direction of the user US. There is. On the other hand, in FIG. 17B, since the user US is moving to the right with respect to the launching portion 50, air is appropriately emitted from the front direction to the user US moving to the right. In addition, the direction DRA of the launching unit 50 is changed by the launching unit direction changing unit 52. Further, in FIG. 17C, since the user US is moving to the left with respect to the launching portion 50, air is appropriately emitted from the front direction to the user US moving to the left. , The direction DRA of the launching unit 50 is changed by the launching unit direction changing unit 52.

By controlling the direction of the launching unit 50 by the launching unit direction changing unit 52 in this way, it becomes possible to launch air to the user US with higher accuracy. In addition, even if the position of the user changes, air can be emitted to the user in a more appropriate direction.

Further, in FIGS. 18A and 18B, the launcher direction changing unit 54 controls the directions of the launchers CN7 to CN12 of the launcher 50.

For example, in FIG. 18A, the directions of the launching devices CN7, CN8, CN9, CN10, CN11, and CN12 (air launching directions) are set to D7, D8, D9, D10, D11, and D12, respectively. It has been changed to face the user US. For example, the directions D7 to D12 of the launchers CN7 to CN12 are changed as if the lens was focused on the user US. By doing so, it becomes possible to launch air from the launchers CN7 to CN12 so that the air launch bullets are concentrated at the location of the user US.

Further, in FIG. 18B, two users, US1 and US2, are playing a multiplayer game. In this case, the directions D7, D8, and D9 of the launchers CN7, CN8, and CN9 are changed so as to concentrate on the user US1, and the directions D10, D11, and D12 of the launchers CN10, CN11, and CN12 are changed. , It is changed to concentrate on the user US2. By doing so, it becomes possible to control the air firing direction of the launching devices CN7 to CN12 so that the air firing bullets are concentrated for each of the users US1 and US2, and the optimum firing direction control for the multiplayer game. Will be able to be realized.

3.5 Various control processes Various control processes of the launching unit 50 of the next embodiment will be described.

In the present embodiment, the process of arranging (moving) the source object of the air bullet in the hit event in which the air bullet hits in the virtual space is performed at the position of the virtual space corresponding to the position of the launching unit 50 in the real space. For example, in a hit event, the enemy character, which is the source object of the air bullet, is controlled in position in the virtual space before the hit event, and is positioned in the direction of the launching unit 50 in the real space. For example, the enemy character moves to a range that the launching unit 50 can handle.

For example, in FIG. 19A, the user US is oriented diagonally to the left with respect to the launching unit 50 located in the front direction in the real space. Therefore, when the launching unit 50 launches air in this state, the air hits the right side portion such as the right shoulder of the user US. Then, in FIG. 19B, in the virtual space, the enemy character CHE attacks the user character CH corresponding to the user US by firing a bullet AR. In this case, the enemy character CHE of FIG. 19 (B) moves to the position of the virtual space corresponding to the position of the launching unit 50 in the real space shown in FIG. 19 (A). That is, the enemy character CHE, which was located in the direction in which the user character CH faces, is moving diagonally to the right with respect to the direction in which the user character CH faces. Then, the enemy character CHE fires the air bullet AR in such a positional relationship, and when the air bullet AR hits, the launching unit 50 shoots air to the user US in the positional relationship shown in FIG. 19 (A).

In this way, when the enemy character CHE located diagonally to the right of the user character CH in the virtual space of FIG. 19B fires the air bullet AR and hits the right part of the user character CH, the enemy character CH responds accordingly. Even in the real space of FIG. 19A, the air from the launching unit 50 hits the right side portion of the user US. Therefore, the event in the virtual space (the event that the air bullet hits from the diagonal right direction) and the event in the real space (the event that the air hits from the diagonal right direction) come to match, and the virtual reality of the user US is felt. You will be able to improve.

Further, in FIG. 20A, the user US faces the front direction with respect to the launching portion 50 located in the front direction in the real space. In this case, the enemy character CHE moves to the left side of the user character CH as shown in FIG. 20 (B), and the launchers CN7 to CN12 sequentially emit air in chronological order as shown in FIG. 20 (C). Control may be performed. That is, the launchers CN7 to CN12 sequentially launch air along the first direction DR1 intersecting the vertical DRV. By controlling the emission of air in this way, as described with reference to FIGS. 13 (A) to 14, it is possible to give the user US the feeling of being hit by the air emitted from the diagonal direction to the left of the user US. can. Therefore, when the enemy character CHE moves in the diagonally left direction of the user character CH and fires the air bullet AR from the diagonally left direction as shown in FIG. 20 (B), the launching unit is as shown in FIG. 20 (C). By performing the launch control of 50, the event in the virtual space and the event in the real space come to match, and the virtual reality feeling of the user US can be improved.

Further, in the present embodiment, user information (user tracking information) including at least one of position information, direction information, and attitude information of the user wearing the HMD is acquired, and the launching unit 50 is controlled according to the acquired user information. conduct.

For example, FIG. 21 is an example of a gun shooting game (FPS) played by a plurality of users US1 to US4 in the field FL. Users US1 to US4 are equipped with HMD1 to HMD4 and possess gun-type controllers GN1 to GN4. These users US1 to US4 form a team (group) for, for example, a team battle game. An image in a virtual space is projected on HMD1 to HMD4, and users US1 to US4 play a gun shooting game while watching this image.

Then, in FIG. 22, the user US1 is moving in the field FL as shown in A1 and A2. Further, launching units 50A to 50F are arranged in the field FL. In this case, the launching units 50A to 50F are controlled based on the acquired position information of the user US1. For example, when it is detected based on the position information of the user US1 that the user US1 is near the launching unit 50A, the launching unit 50A emits air to the user US1. When it is detected based on the position information that the user US1 is near the launching unit 50D, the launching unit 50D launches air. When it is detected based on the position information that the user US1 is near the launching unit 50E, the launching unit 50E launches air. In this way, it is possible to realize appropriate air emission control according to the position of the user US1. In this case, the air emitted by the launching units 50A to 50F may be based on an attack from an enemy in the virtual space at that location. Alternatively, air may be emitted by the launching units 50A to 50F in order to inform the user US1 of the boundary of the field FL and the like.

Further, the launching unit may be controlled based on the acquired direction information of the user. For example, when multiple launchers are placed in a real-space field, the launcher located facing the user's direction is preferentially selected and air is launched from the selected launcher. You may. In this way, it becomes possible to realize appropriate air emission control according to the direction in which the user is facing.

Further, the launching unit may be controlled based on the acquired posture information of the user. For example, when the user is in a posture of lying down on the ground, the launchers CN1 to CN6 in the lower stage of FIG. 5A are controlled to launch air. When the user is in the crouching posture, the launchers CN7 to CN12 in the middle stage are controlled to launch air. When the user is in a standing posture, the upper launchers CN13 to CN18 are controlled to launch air. In this way, it becomes possible to realize appropriate air emission control according to the posture of the user.

Further, in the present embodiment, a game effect process in which sound, vibration, or an image is linked to the emission of air (gas) by the launching unit 50 is performed.

For example, as shown in FIG. 23, vibration units VB1, VB2, and VB3 are provided in the areas AR1, AR2, and AR3 of the field FL played by the user US. Then, as described with reference to FIGS. 11 (A) to 12 (B), the vibrating units VB1, VB2, and VB3 vibrate in conjunction with the emission of air by the launching unit 50. For example, the vibrating units VB1, VB2, and VB3 vibrate at the timing when the air is released or when the air is expected to hit the user US. The vibrating unit VB1 is realized by, for example, a vibrating motor, and can produce a game of relatively violent vibration. The vibrating units VB2 and VB3 are realized by a transducer, and for example, a game can be produced by flexible vibration control using a sound signal.

Further, a game effect process in which the sound is linked to the emission of air by the launching unit 50 may be performed. For example, in FIG. 23, speakers SP1 to SP5 that realize stereophonic sound are arranged and set. These speakers SP1 to SP5 may be real speakers or virtual speakers realized by headphones or the like. Then, using these speakers SP1 to SP5, a stereophonic game effect process called surround or pseudo surround is performed. Then, for example, when an air bullet flies from the diagonal left direction with respect to the user character CH as shown in FIG. 13 (A), the surround effect that sounds like the air bullet flies from the diagonal left direction is produced by the speaker SP1. It is realized by using ~ SP5. At this time, for example, a game effect may be performed by adding an effect image to the image of the air bullet. That is, a game effect process is performed in which the effect image is linked to the emission of air by the launching unit 50. Further, as shown in FIG. 23, the game effect processing may be performed using the blowers FN1 to FN3 provided in the launching unit 50. For example, as described above, when a special air bullet hits the user character CH, the blowers FN1 to FN3 blow air to the user US after the hit in order to realize the afterglow of the hit. In this case, a game effect process may be performed to control the blowing time and the blowing strength of the blowers FN1 to FN3 according to the power (attack power) of the special air bullet.

Further, in the present embodiment, as shown in FIG. 1, the launching unit 50 has a processing unit 56, and the processing unit 56 processes the air (gas) emitted by the launching unit 50. For example, the processing unit 56 performs processing such as changing the temperature of the emitted air, or processing such as adding a scent to the emitted air. Further, a process of changing the humidity of the air to be emitted may be performed to emit air such as mist, or a process of mixing water, snow, or the like with the air may be performed. Further, the processing unit 56 may process the air emitted by the launchers CN1 to CN18, or may process the air blown by the blowers FN1 to FN3.

In this case, in the present embodiment, it is desirable that the first launcher and the second launcher of the plurality of launchers perform different processing on the air (gas) to be launched.

For example, in FIG. 24, among the launchers CN1 to CN18 of the launching unit 50, the air emitted by the lower launchers CN1 to CN6 is processed X, and the air emitted by the middle launchers CN7 to CN12 is subjected to processing X. Processing Y is performed, and processing Z is performed on the air emitted by the upper launchers CN13 to CN18. Processings X, Y, and Z are different processing. For example, when processing that changes the temperature and humidity of air is performed, processing X, Y, and Z are processing that creates air having different temperatures and humidity. .. Further, when processing to add a scent to the air, the processes X, Y, and Z are processes to add different scents to each other.

Further, in FIG. 25, as described with reference to FIG. 22, the user US1 is moving the field FL as shown in A1 and A2. In this case, for example, processing X is performed on the air emitted from the launching units 50A and 50B, processing Y is performed on the air emitted from the launching units 50C and 50D, and the air is launched from the launching units 50E and 50F. Processing Z is performed on the air. In this way, differently processed air is emitted to the user US1 depending on the area where the user US1 is located. For example, when the user US1 is located in the area of the launching portions 50A and 50B, the air having the first temperature or the first humidity is fired, or the air having the first scent is fired. When the user US1 is located in the area of the launching units 50C and 50D, air having a second temperature or a second humidity is fired, or air having a second scent is fired. When the user US1 is located in the area of the launching portions 50E and 50F, air having a third temperature or a third humidity is emitted, or air having a third scent is emitted.

By doing so, air having a different temperature or humidity or air having a different scent is emitted to the user depending on the area where the user US1 is located, which is more diverse and has a high game effect. It will be possible to realize air emission control.

4. Detailed processing Next, a detailed processing example of the present embodiment will be described with reference to the flowchart of FIG.

First, it is determined whether or not the air bullet has been fired (step S1). For example, in a virtual space, it is determined whether or not an enemy character, which is a source object, has fired a bullet. Then, when the air bullet is fired, it is determined whether or not the fired air bullet hits the user character (step S2). For example, a hit determination process such as determining the intersection of the trajectory of the air bullet and the hit volume of the user character is performed to determine whether or not the air bullet hits the user character. Then, when the air bullet hits, the hit direction or the hit vector of the air bullet is acquired (step S3). For example, the hit direction and the hit vector are obtained based on the movement direction and movement speed of the air bullet when the air bullet hits the user character. Then, air is launched by performing a launch device selection process, a launch timing control process, and a launch output degree control process according to the hit direction or hit vector of the air bullet (step S4).

Although the present embodiment has been described in detail as described above, those skilled in the art will easily understand that many modifications that do not substantially deviate from the novel matters and effects of the present invention are possible. Therefore, all such modifications are included in the scope of the present invention. For example, terms (air, air bullets, enemy characters, user characters, etc.) that have been described at least once in the specification or drawings with different terms (gas, hit object, source object, user moving object, etc.) that are broader or synonymous. Etc.) can be replaced with the different terms anywhere in the specification or drawings. In addition, virtual space setting processing, game processing, launching unit control processing, launching device control processing, display processing, user information acquisition processing, moving object movement processing, hit calculation processing, and the like have also been described in this embodiment. The scope of the present invention also includes methods, processes, and configurations equivalent to these, not limited to those. The present invention can also be applied to various games. Further, the present invention can be applied to various simulation systems such as a commercial game device, a home game device, or a large attraction system in which a large number of users participate.

CN1-CNM launcher, FN1-FN3 blower, FL, VFL field,
AR1 to AR3 region, VB1 to VB3 vibrating part,
CH user character, AR bullet (hit object),
CHE, CHE1-CHE3 Enemy character (source object),
HMD, HMD1 to HMD4 head-mounted display, SP1 to SP4 speakers,
US, US1-US4 users, GN1-GN4 gun type controller,
DH hit direction, VH hit vector, DR1, DR2 1st, 2nd direction,
DRV vertical direction, DRA, D7 to D12 direction,
40 housing, 50, 50A-50F launching part, 52 launching part direction changing part,
54 Launcher direction changer, 60 Processing device, 62, 64 Support, 70 Launcher,
72 Speaker, 74 Diaphragm, 76 Air Storage, 78 Launch Port,
100 processing unit, 102 input processing unit, 110 arithmetic processing unit, 111 information acquisition unit,
112 Virtual space setting unit, 113 Mobile processing unit, 114 Virtual camera control unit,
115 game processing unit, 116 hit calculation processing unit, 118 control unit,
120 display processing unit, 130 sound processing unit, 140 output processing unit,
150 image pickup unit, 151, 152 camera, 160 operation unit,
170 storage, 172 object information storage, 178 drawing buffer,
180 Information storage medium, 192 sound output section, 194 I / F section,
195 Portable information storage medium, 196 Communication unit,
200 HMD (Head-mounted display), 201-203 light receiving element, 210 sensor unit,
220 display unit, 231 to 236 light emitting element, 240 processing unit,
251, 252, 253 tracking device, 260 headband,
270 headphones, 280, 284 base stations,
281, 282, 285, 286 light emitting elements

Claims (13)

An information acquisition section for acquiring user information including location information of the user, at least one of direction information and orientation information for mounting the head portion mounted display,
A virtual space setting unit that performs virtual space setting processing, and
A game processing unit that processes games in the virtual space,
A control unit that controls a launch unit capable of emitting gas to the user, and a control unit.
A display processing unit for generating a display image before Symbol head-mounted display device,
Including
A plurality of launching devices are arranged in the launching portion, and a plurality of launching devices are arranged.
The plurality of launchers include first to Nth launchers along a first direction that intersects vertically.
The control unit
In the virtual space, when a hit event occurs in which the hit object corresponding to the gas hits the user moving object corresponding to the user in an oblique direction, the Nth N. A simulation system characterized in that the launching unit is controlled so that the gas is sequentially launched into the launching device. An information acquisition section for acquiring user information including location information of the user, at least one of direction information and orientation information for mounting the head portion mounted display,
A virtual space setting unit that performs virtual space setting processing, and
A game processing unit that processes games in the virtual space,
A control unit that controls a launch unit capable of emitting gas to the user, and a control unit.
A display processing unit for generating a display image before Symbol head-mounted display device,
Including
A plurality of launching devices are arranged in the launching portion, and a plurality of launching devices are arranged.
The control unit
Wherein depending on the game situation and the user information in the virtual space, it has row control process of the firing unit,
The launching part
Includes a processing part that processes the gas to be emitted.
The processed part
A simulation system characterized in that a first launching device and a second launching device of a plurality of the launching devices perform different processing on the gas to be launched. An information acquisition section for acquiring user information including location information of the user, at least one of direction information and orientation information for mounting the head portion mounted display,
A virtual space setting unit that performs virtual space setting processing, and
A game processing unit that processes games in the virtual space,
A control unit that controls a launch unit capable of emitting gas to the user, and a control unit.
A display processing unit for generating a display image before Symbol head-mounted display device,
Including
A plurality of launching devices are arranged in the launching portion, and a plurality of launching devices are arranged.
The control unit
In the virtual space, when the first hit event in which the first air bullet hits the user moving body corresponding to the user occurs, the first selection from the plurality of launching devices is performed. The gas was launched into the launching device selected by the process, and a second hit event was generated in which the user moving body was hit by a second bullet having a higher attack power than the first bullet. In the case, the gas may be launched to the launcher selected by the second selection process for selecting a larger number of the launchers than the first selection process from the plurality of launchers. Characterized simulation system. In claim 3,
The control unit
When the first hit event occurs, as the first selection process, the launchers lined up in one line are selected, the selected launchers are made to launch the gas, and the second hit. A simulation system characterized in that when an event occurs, as the second selection process, the launchers arranged in a plurality of lines are selected, and the gas is launched into the selected launchers. In claim 3 or 4,
The control unit
When the first hit event occurs, the gas is fired all at once to the launchers selected by the first selection process, and when the second hit event occurs, the first hit event occurs. A simulation system characterized in that the gas is simultaneously launched to the launching devices selected by the selection process of 2. In claim 3 or 4 ,
The plurality of launchers include first to Nth launchers along a first direction that intersects vertically.
The control unit
If the first hit event or the second hit event the first gas bombs or the second gas bombs to the User chromatography The mobile hits occurs, the first launcher A simulation system characterized in that the launching unit is controlled so that the gas is sequentially launched from the Nth launching device. In any of claims 1 to 6,
A plurality of the launching devices are arranged in a matrix in the launching portion.
The control unit
A simulation system characterized by performing control processing of a plurality of the launching devices arranged in a matrix. In any of claims 1 to 7,
The launching portion includes a launching portion direction changing portion that changes the direction of the launching portion.
The control unit
A simulation system characterized in that the launching unit direction changing unit is controlled according to the game situation. In any of claims 1 to 8,
The launching unit includes a plurality of launching device direction changing units that change the direction of the launching device.
The control unit
A simulation system characterized in that the launcher direction changing unit is controlled according to a game situation. In any of claims 1 to 9,
The game processing unit
A simulation system characterized in that a game effect process in which sound, vibration, or an image is linked to the emission of the gas at the launching unit is performed. An information acquisition section for acquiring user information including location information of the user, at least one of direction information and orientation information for mounting the head portion mounted display,
A virtual space setting unit that performs virtual space setting processing, and
A game processing unit that processes games in the virtual space,
A control unit that controls a launch unit capable of emitting gas to the user, and a control unit.
A display processing unit for generating a display image before Symbol head-mounted display device,
Make your computer work
A plurality of launching devices are arranged in the launching portion, and a plurality of launching devices are arranged.
The plurality of launchers include first to Nth launchers along a first direction that intersects vertically.
The control unit
In the virtual space, when a hit event occurs in which the hit object corresponding to the gas hits the user moving body corresponding to the user in an oblique direction, the Nth N. A program characterized by controlling the launching unit so that the gas is sequentially launched into the launching device. An information acquisition section for acquiring user information including location information of the user, at least one of direction information and orientation information for mounting the head portion mounted display,
A virtual space setting unit that performs virtual space setting processing, and
A game processing unit that processes games in the virtual space,
A control unit that controls a launch unit capable of emitting gas to the user, and a control unit.
A display processing unit for generating a display image before Symbol head-mounted display device,
Make your computer work
A plurality of launching devices are arranged in the launching portion, and a plurality of launching devices are arranged.
The control unit
Wherein depending on the game situation and the user information in the virtual space, it has row control process of the firing unit,
The launching part
Includes a processing part that processes the gas to be emitted.
The processed part
A program characterized in that a first launching device and a second launching device of a plurality of the launching devices perform different processing on the gas to be launched. An information acquisition section for acquiring user information including location information of the user, at least one of direction information and orientation information for mounting the head portion mounted display,
A virtual space setting unit that performs virtual space setting processing, and
A game processing unit that processes games in the virtual space,
A control unit that controls a launch unit capable of emitting gas to the user, and a control unit.
A display processing unit for generating a display image before Symbol head-mounted display device,
Make your computer work
A plurality of launching devices are arranged in the launching portion, and a plurality of launching devices are arranged.
The control unit
In the virtual space, when the first hit event in which the first air bullet hits the user moving body corresponding to the user occurs, the first selection from the plurality of launching devices is performed. The gas was launched into the launching device selected by the process, and a second hit event was generated in which the user moving body was hit by a second bullet having a higher attack power than the first bullet. In the case, the gas may be launched to the launcher selected by the second selection process for selecting a larger number of the launchers than the first selection process from the plurality of launchers. Characterized program.

Images