JP2018171320A - Simulation system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a simulation system capable of achieving vibration control of a vibration part of an installation body in which hit information or the like in a hit event is reflected.SOLUTION: A simulation system comprises: a virtual space setting part; a movable body processing part; a game processing part; a display processing part; and a control part. At least one front surface side vibration part is provided on a front surface part of an installation body which a user installs to his/her body, and at least one rear surface side vibration part is provided on a rear surface part of the installation body. The game processing part performs hit calculation processing of a user movable body and other object, and determines hit information including at least one of the hit direction and the hit position. When the hit event of the user movable body and other object occurs, the control part vibrates the first vibration part which is one vibration part out of the front surface side vibration part and the rear surface side vibration part, based on the hit information, then, vibrates the second vibration part which is the other vibration part out of the front surface side vibration part and the rear surface side vibration part.SELECTED DRAWING: Figure 19

Description

  The present invention relates to a simulation system and a program.

  Conventionally, a technique for realizing an intuitive man-machine interface using a user's sense of touch is known. For example, Patent Document 1 discloses a sensor circuit including a contact detector and a motion detector, a haptic textile, and an operation surface configured to generate haptic feedback based on an operation signal from the sensor circuit. An apparatus is disclosed. In the prior art of this patent document 1, a technique for realizing a haptic feedback garment using a haptic textile has been proposed.

Special table 2012-511781 gazette

  However, Patent Document 1 has not proposed a method for reflecting hit information obtained by hit calculation processing when another object hits the user moving body in vibration control of the wearing body worn by the user. In addition, an appropriate vibration control method for the vibration part on the front side and the vibration part on the rear side of the wearing body has not been proposed.

  According to some aspects of the present invention, it is possible to provide a simulation system, a program, and the like that can realize vibration control of the vibration part of the wearing body reflecting hit information in a hit event.

  One aspect of the present invention includes a virtual space setting unit that performs a setting process of a virtual space, a moving body processing unit that performs a moving process of a user moving body that moves in the virtual space, and a user wearing a mounting body on the body A game processing unit that performs a game process of a game to be played; a display processing unit that generates a display image based on a result of the game process; and a control unit; A side vibration unit is provided, and at least one rear surface vibration unit is provided on a rear surface portion of the wearing body, and the game processing unit performs hit calculation processing between the user moving body and another object, and hits The control unit obtains hit information including at least one of a direction and a hit position, and when the hit event between the user moving object and the other object occurs, the control unit is based on the hit information. After vibrating the first vibration part which is one of the front-side vibration part and the rear-side vibration part, the second vibration part is the other vibration part of the front-side vibration part and the rear-side vibration part. The present invention relates to a simulation system that performs vibration control to vibrate the vibration part of the. The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

  According to one aspect of the present invention, a movement process for moving a user moving body in a virtual space is performed, and a game process for a game in which a user wears a mounting body on the body and plays is performed. Based on this, a display image is generated. Moreover, the mounting body which a user wears is provided with a front-side vibration part on the front part and a rear-side vibration part on the rear part. In addition, hit calculation processing between the user moving body and another object is performed, and hit information including at least one of the hit direction and the hit position is obtained. When a hit event occurs between the user moving body and another object, the first vibration unit, which is one of the front-side vibration unit and the rear-side vibration unit, is vibrated based on the hit information, Vibration control is performed to vibrate the second vibration part which is the vibration part. In this way, when a hit event occurs, based on the hit information, after the first vibrating part that is one of the front-side vibrating part and the rear-side vibrating part vibrates, the second vibrating part that is the other is It comes to vibrate. Therefore, it is possible to allow the user to experience virtual reality as if another object has penetrated the body, and to realize vibration control of the vibration part of the wearing body reflecting hit information in a hit event. become.

  In one aspect of the present invention, the control unit selects a vibration unit to vibrate from the plurality of first vibration units when a plurality of first vibration units are provided as the first vibration unit. The processing to be performed may be performed based on the hit information.

  In this way, when a hit event occurs, the vibration unit corresponding to the hit information is selected from the plurality of first vibration units that are one of the front-side vibration unit and the rear-side vibration unit of the wearing body. It becomes possible to realize vibration control reflecting the hit information.

  In one embodiment of the present invention, the control unit selects a vibration unit to vibrate from the plurality of second vibration units when a plurality of second vibration units are provided as the second vibration unit. The processing to be performed may be performed based on the hit information.

  In this way, when a hit event occurs, the vibration unit corresponding to the hit information is selected from the plurality of second vibration units that are the other of the front-side vibration unit and the rear-side vibration unit of the wearing body. It becomes possible to realize vibration control reflecting the hit information.

  In one embodiment of the present invention, the control unit changes a length of a vibration interval from a first timing at which the first vibration unit is vibrated to a second timing at which the second vibration unit is vibrated. You may let them.

  In this way, the length of the vibration interval from the first timing at which the first vibrating section vibrates to the second timing at which the second vibrating section vibrates changes variously, and the user's virtual It is possible to realize vibration control that can improve the reality.

  In the aspect of the invention, the hit information may include a hit speed, and the control unit may change the length of the vibration interval based on the hit speed.

  In this way, the length of the vibration interval from the first timing at which the first vibrating section vibrates to the second timing at which the second vibrating section vibrates can be set based on the hit speed of the hit information. Thus, the vibration interval reflecting the hit speed can be controlled.

  In one embodiment of the present invention, a game processing unit that performs a game process of a game in which a user wears a mounting body on a body and plays, and a display that generates an image to be displayed to the user based on a result of the game process The mounting unit includes a plurality of vibration units, and the control unit includes a first timing for vibrating the first vibration unit among the plurality of vibration units. The present invention relates to a simulation system that changes the length of a vibration interval up to a second timing for vibrating a second vibration part among a plurality of vibration parts according to the type or content of a vibration event that occurs in the game. . The present invention also relates to a program that causes a computer to function as each of the above-described units, or a computer-readable information storage medium that stores the program.

  According to one aspect of the present invention, a movement process for moving a user moving body in a virtual space is performed, and a game process for a game in which a user wears a mounting body on the body and plays is performed. Based on this, a display image is generated. When the vibration event occurs, the length of the vibration interval from the first timing for vibrating the first vibrating portion of the user's wearing body to the second timing for vibrating the second vibrating portion is the vibration event. The length corresponding to the type or content is set, and vibration control that can further improve the virtual reality of the user can be realized.

  In the aspect of the invention, the display processing unit may generate a display image of a head-mounted display device that the user wears so as to cover the field of view.

  Thus, when the user's field of view is covered by the head-mounted display device, the virtual reality at the vibration event or hit event is effectively improved by vibrating the vibration part of the user's wearing body. become able to.

  In the aspect of the invention, the control unit may perform an effect process according to the vibration control of the wearing body.

  In this way, it is possible to perform an effect process in conjunction with the vibration control of the wearing body, and the virtual reality given to the user can be further improved.

The block diagram which shows the structural example of the simulation system of this embodiment. FIG. 2A and FIG. 2B are examples of the HMD used in this embodiment. 3A and 3B are other examples of the HMD used in the present embodiment. Explanatory drawing of the field used with a simulation system. FIG. 5A and FIG. 5B are explanatory diagrams of a real space user and a moving object corresponding to the user. The example of the game image displayed on HMD. Explanatory drawing of the game using a sword-type controller. The example of the game image displayed on HMD. 9A and 9B are explanatory diagrams of a jacket which is a mounting body provided with a plurality of vibrating portions. The structural example of the vibration part using a solenoid. FIG. 11A and FIG. 11B are explanatory diagrams of movement processing of the user moving body in the virtual space according to the movement of the user in the real space. 12A and 12B are explanatory diagrams of a vibration control method at the time of a bullet hit. FIGS. 13A and 13B are explanatory diagrams of the vibration control method of the vibration unit based on the hit information. 14A and 14B are explanatory diagrams of a vibration control method of the vibration unit based on the hit information. FIG. 15A and FIG. 15B are explanatory diagrams of a method for selecting a vibration part based on the hit position of hit information. FIGS. 16A to 16C are explanatory diagrams of a method for setting a vibration interval according to the hit speed of hit information, the type of hit event, and the content. 17A to 17D are explanatory diagrams of various examples of hit events and vibration events. The flowchart explaining the detailed process example of this embodiment. The flowchart explaining the detailed process example of this embodiment.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Simulation System FIG. 1 is a block diagram showing a configuration example of a simulation system (simulator, game system) of the present embodiment. The simulation system of the present embodiment is a system that simulates virtual reality (VR), for example, a game system that provides game content, a real-time simulation system such as a sports competition simulator or a driving simulator, a system that provides an SNS service, an image The present invention can be applied to various systems such as a content providing system that provides content such as an operating system that implements remote work. Note that the simulation system of the present embodiment is not limited to the configuration shown in FIG. 1, and various modifications such as omitting some of the components (each unit) or adding other components are possible.

  The wearing body 50 is worn by the user on the body. The body is, for example, a part below the user's neck (body, waist, legs, arms, etc.). The mounting body 50 is provided with a plurality of vibration parts V1 to VN. The vibration parts V1 to VN are attached to the mounting body 50 with a fixture.

  The operation unit 160 is for a user (player) to input various operation information (input information). The operation unit 160 can be realized by various operation devices such as an operation button, a direction instruction key, a joystick, a handle, a pedal, or a lever. The operation unit 160 can be realized by a controller such as a gun-type controller or a sword-type controller, which is a user's equipment.

  The storage unit 170 stores various types of information. The storage unit 170 functions as a work area such as the processing unit 100 or the communication unit 196. The game program and game data necessary for executing the game program are held in the storage unit 170. The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), HDD (Hard Disk Drive), SSD, optical disk device, or the like. The storage unit 170 includes an object information storage unit 172 and a drawing buffer 178.

  The information storage medium 180 (a computer-readable medium) stores programs, data, and the like, and its function can be realized by an optical disk (DVD, BD, CD), HDD, semiconductor memory (ROM), or the like. . The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, in the information storage medium 180, a program for causing a computer (an apparatus including an input device, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

  The HMD 200 (head-mounted display device) is a device that is mounted on the user's head and displays an image in front of the user's eyes. The HMD 200 is preferably a non-transmissive type, but may be a transmissive type. The HMD 200 may be a so-called glasses-type HMD.

  The HMD 200 includes a sensor unit 210, a display unit 220, and a processing unit 240. A modification in which a light emitting element is provided in the HMD 200 is also possible. The sensor unit 210 is for realizing tracking processing such as head tracking, for example. For example, the position and direction of the HMD 200 are specified by tracking processing using the sensor unit 210. By specifying the position and direction of the HMD 200, the user's viewpoint position and line-of-sight direction (user position and direction) can be specified.

  Various methods can be adopted as the tracking method. In the first tracking method, which is an example of the tracking method, a plurality of light receiving elements (photodiodes and the like) are provided as the sensor unit 210, as will be described in detail with reference to FIGS. 2A and 2B described later. Then, by receiving light (laser or the like) from a light emitting element (LED or the like) provided outside by the plurality of light receiving elements, the position of the HMD 200 (user's head) in the real world three-dimensional space, Identify the direction. In the second tracking method, a plurality of light emitting elements (LEDs) are provided in the HMD 200 as will be described in detail with reference to FIGS. 3A and 3B described later. And the position and direction of HMD200 are pinpointed by imaging the light from these light emitting elements with the imaging part provided outside. In the third tracking method, a motion sensor is provided as the sensor unit 210, and the position and direction of the HMD 200 are specified using this motion sensor. The motion sensor can be realized by, for example, an acceleration sensor or a gyro sensor. For example, by using a 6-axis motion sensor using a 3-axis acceleration sensor and a 3-axis gyro sensor, the position and direction of the HMD 200 in a three-dimensional space in the real world can be specified. Note that the position and direction of the HMD 200 may be specified by a combination of the first tracking method and the second tracking method, or a combination of the first tracking method and the third tracking method. Further, instead of specifying the user's viewpoint position and line-of-sight direction by specifying the position and direction of the HMD 200, a tracking process that directly specifies the user's viewpoint position and line-of-sight direction (position, direction) may be employed. .

  The display unit 220 of the HMD 200 can be realized by, for example, an organic EL display (OEL) or a liquid crystal display (LCD). For example, the display unit 220 of the HMD 200 is provided with a first display or first display area set in front of the user's left eye and a second display or second display area set in front of the right eye. 3D display is possible. When performing stereoscopic display, for example, a left-eye image and a right-eye image with different parallax are generated, the left-eye image is displayed on the first display, and the right-eye image is displayed on the second display. Alternatively, the left-eye image is displayed in the first display area of one display, and the right-eye image is displayed in the second display area. Also, the HMD 200 is provided with two eyepiece lenses (fisheye lenses) for the left eye and the right eye, thereby expressing a VR space that extends all around the user's field of view. Then, correction processing for correcting distortion generated in an optical system such as an eyepiece is performed on the left-eye image and the right-eye image. This correction process is performed by the display processing unit 120.

  The processing unit 240 of the HMD 200 performs various processes necessary for the HMD 200. For example, the processing unit 240 performs control processing of the sensor unit 210, display control processing of the display unit 220, and the like. Further, the processing unit 240 may perform a three-dimensional sound (stereoscopic sound) process to realize reproduction of a three-dimensional sound direction, distance, and spread.

  The sound output unit 192 outputs the sound generated by the present embodiment, and can be realized by, for example, a speaker or headphones.

  The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and the function can be realized by an ASIC for I / F processing or the like. The portable information storage medium 195 is for a user to save various types of information, and is a storage device that retains storage of such information even when power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

  The communication unit 196 communicates with the outside (another apparatus) via a wired or wireless network, and functions thereof are hardware such as a communication ASIC or communication processor, or communication firmware. Can be realized.

  A program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the server (host device) to the information storage medium 180 (or storage unit 170) via the network and communication unit 196. May be. Use of an information storage medium by such a server (host device) can also be included in the scope of the present invention.

  The processing unit 100 (processor) is used for operation information from the operation unit 160, tracking information in the HMD 200 (information on at least one of the position and direction of the HMD, information on at least one of the viewpoint position and the line-of-sight direction), a program, and the like. Based on this, game processing (simulation processing), virtual space setting processing, moving body processing, virtual camera control processing, display processing, sound processing, or the like is performed.

  Each processing (each function) of this embodiment performed by each unit of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the function of each unit may be realized by individual hardware, or the function of each unit may be realized by integrated hardware. For example, the processor may include hardware, and the hardware may include at least one of a circuit that processes a digital signal and a circuit that processes an analog signal. For example, the processor can be configured by one or a plurality of circuit devices (for example, ICs) mounted on a circuit board or one or a plurality of circuit elements (for example, resistors, capacitors, etc.). The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) can be used. The processor may be an ASIC hardware circuit. The processor may include an amplifier circuit, a filter circuit, and the like that process an analog signal. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD) or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and the processing (function) of each unit of the processing unit 100 is realized by executing the instructions by the processor. The instruction here may be an instruction set constituting a program, or an instruction for instructing an operation to the hardware circuit of the processor.

  The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The arithmetic processing unit 110 includes an information acquisition unit 111, a virtual space setting unit 112, a moving body processing unit 113, a virtual camera control unit 114, a game processing unit 115, a control unit 118, a display processing unit 120, and a sound processing unit 130. As described above, each process of the present embodiment executed by these units can be realized by a processor (or a processor and a memory). Various modifications such as omitting some of these components (each unit) or adding other components are possible.

  The input processing unit 102 performs processing for receiving operation information and tracking information, processing for reading information from the storage unit 170, and processing for receiving information via the communication unit 196 as input processing. For example, the input processing unit 102 stores, in the storage unit 170, processing for acquiring operation information input by the user using the operation unit 160, tracking information detected by the sensor unit 210 of the HMD 200, and the information specified by the read command. A process for reading data from a computer or a process for receiving information from an external device (such as a server) via a network is performed as an input process. Here, the reception process includes a process of instructing the communication unit 196 to receive information, a process of acquiring information received by the communication unit 196, and writing the information in the storage unit 170, and the like.

  The arithmetic processing unit 110 performs various arithmetic processes. For example, arithmetic processing such as information acquisition processing, virtual space setting processing, moving body processing, virtual camera control processing, game processing (simulation processing), control processing, display processing, or sound processing is performed.

  The information acquisition unit 111 (program module for information acquisition processing) performs various information acquisition processing. For example, the information acquisition unit 111 acquires user information (user tracking information) including at least one of user position information, direction information, and posture information.

  The virtual space setting unit 112 (program module for virtual space setting processing) performs setting processing for a virtual space (object space) in which a plurality of objects are arranged. For example, various objects representing display objects such as moving objects (people, robots, cars, trains, airplanes, ships, monsters, animals, etc.), maps (terrain), buildings, auditoriums, courses (roads), trees, walls, water surfaces, etc. A process of placing and setting an object (an object composed of a primitive surface such as a polygon, a free-form surface, or a subdivision surface) in a virtual space is performed. In other words, the position and rotation angle of the object in the world coordinate system (synonymous with direction and direction) are determined, and the rotation angle (rotation angle around the X, Y, and Z axes) is determined at that position (X, Y, Z). Arrange objects. Specifically, in the object information storage unit 172 of the storage unit 170, object information that is information such as the position, rotation angle, moving speed, and moving direction of an object (part object) in the virtual space is associated with the object number. Is remembered. The virtual space setting unit 112 performs a process of updating the object information for each frame, for example.

  The moving body processing unit 113 (moving body processing program module) performs various processes on a moving body that moves in the virtual space. For example, processing for moving the moving body in virtual space (object space, game space) and processing for moving the moving body are performed. For example, the mobile object processing unit 113 is based on operation information input by the user through the operation unit 160, acquired tracking information, a program (movement / motion algorithm), various data (motion data), and the like. Control processing for moving the model object) in the virtual space or moving the moving object (motion, animation) is performed. Specifically, a simulation for sequentially obtaining movement information (position, rotation angle, speed, or acceleration) and motion information (part object position or rotation angle) of a moving body for each frame (for example, 1/60 second). Process. A frame is a unit of time for performing a moving / movement process (simulation process) and an image generation process of a moving object. The moving body is, for example, a virtual user (virtual player, avatar) in a virtual space corresponding to a user (player) in real space, or a boarding moving body (operation moving body) on which the virtual user is boarded (operated).

  The game processing unit 115 (game processing program module) performs various game processes for the user to play a game. In other words, the game processing unit 115 (simulation processing unit) executes various simulation processes for the user to experience virtual reality (virtual reality). The game process is, for example, a process for starting a game when a game start condition is satisfied, a process for advancing the started game, a process for ending a game when a game end condition is satisfied, or calculating a game result. Processing. The game processing unit 115 includes a hit calculation processing unit 116. The hit calculation processing unit 116 executes hit calculation processing such as hit determination processing.

  The control unit 118 (program module for control processing) performs control processing for the plurality of vibration units V1 to VN of the mounting body 50. Details of the control unit 118 will be described later.

  The display processing unit 120 (display processing program module) performs display processing of a game image (simulation image). For example, a drawing process is performed based on the results of various processes (game process, simulation process) performed by the processing unit 100, thereby generating an image and displaying it on the display unit 220 of the HMD 200. Specifically, geometric processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping processing, perspective transformation, or light source processing is performed. Based on the processing result, drawing data (the position of the vertex of the primitive surface) Coordinates, texture coordinates, color data, normal vector, α value, etc.) are created. Based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is converted into image information in units of pixels such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. As a result, an image that can be seen from the virtual camera (given viewpoint, left eye and right eye first and second viewpoints) is generated in the object space (virtual space). Note that the drawing processing performed by the display processing unit 120 can be realized by vertex shader processing, pixel shader processing, or the like.

  The sound processing unit 130 (sound processing program module) performs sound processing based on the results of various processes performed by the processing unit 100. Specifically, game sounds such as music (music, BGM), sound effects, or sounds are generated, and the game sounds are output to the sound output unit 192. Note that part of the sound processing of the sound processing unit 130 (for example, three-dimensional sound processing) may be realized by the processing unit 240 of the HMD 200.

  The output processing unit 140 performs various types of information output processing. For example, the output processing unit 140 performs processing for writing information in the storage unit 170 and processing for transmitting information via the communication unit 196 as output processing. For example, the output processing unit 140 performs a process of writing information specified by a write command in the storage unit 170 or a process of transmitting information to an external apparatus (server or the like) via a network. The transmission process is a process of instructing the communication unit 196 to transmit information, or instructing the communication unit 196 to transmit information.

  The simulation system according to the present embodiment includes a game processing unit 115, a control unit 118, and a display processing unit 120. Further, a virtual space setting unit 112 and a moving body processing unit 113 can be further included.

  The virtual space setting unit 112 performs a virtual space setting process. For example, a process of arranging and setting a moving object, an obstacle, a background, or a map object in the virtual space is performed. For example, when the position information and direction information of the user in real space are acquired, the position and direction of the user moving body (user character etc.) corresponding to the user are set based on the acquired position information and direction information. Then, processing for placement in the virtual space is performed. Information such as the position and direction of the user moving object that is an object is stored in the object information storage unit 172, for example. The user moving body is an object (display object) that moves in a virtual space (object space) following the movement of the user in real space, for example. Examples of the user moving body include an avatar moving body (user character, virtual user) corresponding to the user, a boarding moving body on which the avatar moving body is mounted, and an outer shell moving body worn by the avatar moving body. The outer shell moving body is arranged to overlap the avatar moving body (ghost) and moves in the virtual space. The outer shell moving body is a moving body including the avatar moving body, and is expressed as a user's body.

  When the HMD 200 is not used as a display unit on which an image based on game processing is displayed, the user moving body moves in a game space (virtual space) based on operation information from the operation unit 160. Also good. For example, a user in the real world plays a game by operating the operation unit 160 while viewing an image on the display unit. Then, the user moving body moves in the game space according to the operation of the operation unit 160.

  The moving body processing unit 113 performs a moving process of the user moving body that moves in the virtual space. For example, the moving body processing unit 113 selects a user moving body (avatar moving body, boarding moving body, outer shell moving body) corresponding to the user based on the user information (position information, direction information) acquired by the information acquisition unit 111. Then, the process of moving in the virtual space is performed. For example, the user moving body is moved in the virtual space so as to move following the movement of the user in the real space. For example, based on the moving speed and moving acceleration of the user moving body, a process of updating the position of the user moving body for each frame is performed to move the user moving body in the virtual space (virtual field). In addition, the moving body processing unit 113 performs processing for operating the user moving body based on the user information (posture information) acquired by the information acquisition unit 111. For example, based on the motion data, motion processing for changing the posture of the user moving body is performed.

  The game processing unit 115 performs a game process of a game that is played by the user wearing the mounting body 50 on the body. For example, the game processing unit 115 performs a game process in the virtual space. For example, a game process such as a process for starting a game, a process for advancing the game, a process for ending the game, or a process for calculating game results is performed.

  The display processing unit 120 generates a display image based on the result of the game process. For example, a display image of the HMD 200 worn by the user is generated. For example, an image viewed from a virtual camera in the virtual space is generated as a display image. For example, the virtual camera control unit 114 performs a virtual camera control process corresponding to the user's viewpoint. For example, the virtual camera control unit 114 controls the virtual camera set as the first-person viewpoint of the user. For example, by setting a virtual camera at a position corresponding to the viewpoint of a moving body (such as a virtual player) that moves in the virtual space, and setting the viewpoint position and line-of-sight direction of the virtual camera, the position (positional coordinates) of the virtual camera And control the attitude (rotation angle around the rotation axis). And the display process part 120 produces | generates the image seen from a virtual camera (user viewpoint) in virtual space as display images (display video), such as HMD200. For example, an image that is visible from a given viewpoint is generated in an object space that is a virtual space. The generated image is, for example, a stereoscopic image.

  In the present embodiment, the mounting body 50 that the user wears on the body (body, etc.) is provided with a plurality of vibration parts V1 to VN. The wearing body 50 is worn by a user on a body (for example, a body below the neck). Specifically, it is a jacket (vest) or a jacket such as a jumper, which will be described later, or clothes such as pants. However, the wearing body may be an armor in a sword game, or a body equipment in a nature experience game.

  And the control part 118 performs vibration control of the some vibration parts V1-VN of the mounting body 50. FIG. For example, the game processing unit 115 performs game processing, and the control unit 118 performs vibration control of the plurality of vibration units V1 to VN of the mounting body 50 according to the game situation.

  Specifically, in the present embodiment, at least one front-side vibration unit is provided on the front surface of the mounting body 50, and at least one rear-side vibration unit is provided on the rear surface of the mounting body 50. The front portion is, for example, the front side of the user who wears the mounting body 50, and the rear surface portion is, for example, the back side of the user who wears the mounting body 50.

  Then, the game processing unit 115 performs hit calculation processing between the user moving body and another object. Then, hit information including at least one of the hit direction and the hit position is obtained by hit calculation processing. The hit calculation processing unit 116 executes this hit calculation processing.

  Here, the other object is a hit object that hits the user moving body, and may be an object displayed in the virtual space or a non-displayed virtual object in the virtual space. Other objects may be attack objects such as bullets and swords, may be objects such as falling rocks in natural experience simulations, and are placed objects such as obstacles and walls placed in virtual space. It may be.

  The hit direction (hit vector, attack direction, attack vector) is the moving direction of another object when another object hits the user moving body, for example. For example, the hit direction can be specified based on the trajectory of another object flying toward the user moving body. The hit position is a position where another object has hit the user moving body (a hit position or a collision position). For example, the hit position can be specified based on the intersection position in the intersection determination process in the hit determination process. In addition to the hit direction and hit position, the hit information can include information such as hit speed, hit strength, or hit attribute.

  Then, when a hit event occurs between the user moving body and another object, the control unit 118 performs vibration control of the vibration unit of the mounting body 50 based on the hit information. That is, the game processing unit 115 (hit calculation processing unit 116) obtains hit information including at least one of the hit direction and the hit position of another object, and the control unit 118 vibrates the wearing body 50 based on the hit information. Control vibration of the part. In this way, vibration control reflecting hit information (hit direction, hit position, etc.) in hit calculation processing can be realized.

  The hit information may be obtained after a hit event occurs, and vibration control may be performed based on the obtained hit information. Alternatively, the hit information (predicted hit information) is obtained in advance before the hit event occurs, and when the hit event occurs, vibration is performed based on the hit information (predicted hit information) obtained in advance. Control may be performed.

  Then, when a hit event occurs, the control unit 118, based on the hit information including at least one of the hit direction and the hit position, the first vibration that is one of the front-side vibration unit and the rear-side vibration unit. After the part is vibrated, vibration control is performed to vibrate the second vibration part that is the other vibration part of the front-side vibration part and the rear-side vibration part.

  For example, when another object hits the front part of the user moving body (wearing body), the front-side vibration part becomes the first vibration part, and the rear-side vibration part becomes the second vibration part. On the other hand, when another object hits the rear surface portion of the user moving body (wearing body), the rear surface side vibration portion becomes the first vibration portion, and the front surface side vibration portion becomes the second vibration portion.

  When the control unit 118 determines that another object has hit the front surface of the user moving body (attached body) based on the hit information, the control unit 118 vibrates the first vibration unit that is the front-side vibration unit. Then, after the lapse of a given vibration interval, the second vibration part that is the rear surface side vibration part is vibrated. On the other hand, if the control unit 118 determines that another object has hit the rear surface part of the user moving body (wearing body) based on the hit information, the control unit 118 vibrates the first vibration unit that is the rear side vibration unit. Then, after the lapse of a given vibration interval, the second vibration part that is the front-side vibration part is vibrated. This makes it possible to give the user a virtual reality as if other objects such as bullets and swords have penetrated the user's body.

  In addition, when a plurality of first vibration units are provided as the first vibration unit, the control unit 118 performs processing for selecting a vibration unit to vibrate from the plurality of first vibration units based on the hit information. Do. In addition, when a plurality of second vibration units are provided as the second vibration unit, the control unit 118 selects a vibration unit to vibrate from the plurality of second vibration units based on the hit information. Do. For example, based on hit information such as a hit direction or a hit position, the vibration unit selected from the plurality of first vibration units is vibrated. Further, based on the hit information such as the hit direction or the hit position, the vibration unit selected from the plurality of second vibration units is vibrated.

  For example, when another object hits the front part of the user moving body, the front-side vibration part becomes the first vibration part, and the rear-side vibration part becomes the second vibration part. Therefore, in this case, the vibration unit selected from the plurality of first vibration units which are the plurality of front-side vibration units based on the hit information is vibrated. Then, after the passage of a given vibration interval, the vibration unit selected based on the hit information from the plurality of second vibration units that are the plurality of rear-surface vibration units is vibrated.

  For example, when another object hits the rear surface portion of the user moving body, the rear surface side vibration portion becomes the first vibration portion, and the front surface side vibration portion becomes the second vibration portion. Therefore, in this case, the vibration unit selected based on the hit information from the first vibration units as the plurality of rear surface side vibration units is vibrated. Then, after the passage of a given vibration interval, the vibration unit selected based on the hit information is vibrated from the plurality of second vibration units which are the front-side vibration units.

  In this way, it is possible to give the user a virtual reality as if it had penetrated the user's body, and vibration control reflecting hit information (hit direction, hit position) in the hit calculation process is performed. Can be realized.

  Further, the control unit 118 changes the length of the vibration interval from the first timing for vibrating the first vibrating unit to the second timing for vibrating the second vibrating unit. The first vibration unit is a vibration unit that vibrates first, and is one of the front-side vibration unit and the rear-side vibration unit. The second vibrating portion is a vibrating portion that is vibrated later, and is the other vibrating portion of the front-side vibrating portion and the rear-side vibrating portion. For example, the control unit 118 changes the length of the vibration interval according to the type or content of the hit event (vibration event in a broad sense). For example, hit event categories are grouped, such as pistol bullet hit events, rifle bullet hit events, bazooka bullet hit events, missile hit events, and sword hit events. In this case, the category of which category belongs to the type of hit event. The content of the hit event is represented by a hit calculation parameter such as a hit strength parameter, a hit attack parameter, a hit speed parameter, or a hit attribute parameter. For example, even if hit events (pistol, rifle, bazooka, missile, sword) of the same type (category group), the content of the hit event will be different if the parameters of the hit calculation process are different.

  The hit information includes the hit speed, and the control unit 118 changes the length of the vibration interval based on the hit speed. For example, the length of the vibration interval is increased or decreased according to the hit speed. The hit speed is a hit speed parameter, for example, the speed of a bullet or missile. For example, the control unit 118 shortens the vibration interval when the speed of a hit bullet, missile, or the like is high, and increases the vibration interval when the speed is low. In this way, a more realistic penetration expression can be realized.

  In the above, the case where the vibration event is a hit event between the user moving body and another object has been described. However, the present embodiment is not limited to this, and the vibration event may be an event other than the hit event. Good. The vibration event is not only an event in which another object hits the user moving body, but also, for example, an explosion event that occurs in a place away from the user moving body, a state of the user moving body (for example, tremor, body destruction, etc. ) Can be envisaged. Then, the control unit 118 sets the length of the period from the first timing for vibrating the first vibrating unit to the second timing for vibrating the second vibrating unit, and the type or content of the vibration event that occurs in the game. You may change according to.

  In the present embodiment, the display processing unit 120 generates a display image of the HMD 200 that the user wears so as to cover the field of view. Thus, when the user wears the HMD 200 so as to cover the field of view, a bodily sensation device that vibrates the vibration part of the wearing body is effective for improving the virtual reality of the user.

  However, the display processing unit 120 may generate a display image of a display unit other than the HMD 200. For example, a display image of a display unit such as a television in a home game device, a monitor display in a personal computer, or an arcade game device may be generated.

  Further, the control unit 118 performs an effect process according to the vibration control of the mounting body 50. For example, in conjunction with the vibration control of the vibration part of the mounting body 50, the effect processing of the sound effect with the game sound is performed or the processing of generating the effect image with the game image is performed. For example, sound effects are output or effect images are displayed in accordance with the number of vibrating parts to be vibrated, the range of vibrating parts to be vibrated, or the timing of vibrations. For example, as the number of vibration parts increases or the range of the vibration parts increases, the volume of the sound effect output accompanying the vibration is increased, or an effect image with a higher effect is displayed. In addition, after the first vibrating section is vibrated at the first timing, the corresponding sound effects are output at the first and second timings when the second vibrating section is vibrated at the second timing. Or display an effect image. For example, sound effects and effect images are associated with each vibration control of the vibration unit and stored in the storage unit 170, and the control unit 118 outputs sound effects associated with each vibration control or effects image. Control to display. By doing in this way, the output of the sound effect linked with the vibration control of the vibration unit and the display of the effect image can be performed, and the vibration control with a higher effect can be realized.

  In the present embodiment, the information acquisition unit 111 acquires user information including at least one of position information, direction information, and posture information of a user who wears the HMD 200 so as to cover the field of view, for example. For example, the information acquisition unit 111 acquires user information (user tracking information) including at least one of user position information, direction information, and posture information in real space based on tracking information of the HMD 200 and the like. The position information may be position information of the user's viewpoint in real space, and the direction information may be direction information of the user's line of sight in real space. When the user is located in a field (play field, simulation field, play area) in the real space (real world), the position information and direction information (the given position is used as the origin). Position coordinates in a coordinate system to be rotated, and rotation angles around each coordinate axis). Posture information is information for specifying each posture of the user (standing posture, crouching posture, sitting posture, etc.) or specifying the position and direction of each part of the user (body, head, hand, foot, etc.). is there. For example, the information acquisition unit 111 may acquire the position information and direction information of the HMD 200 as the position information and direction information of the user wearing the HMD 200.

  Further, the virtual camera control unit 114 controls the virtual camera so as to follow the change in the user's viewpoint based on the tracking information of the user's viewpoint information.

  For example, the input processing unit 102 (input reception unit) acquires tracking information of viewpoint information of the user wearing the HMD 200. For example, tracking information (viewpoint tracking information) of viewpoint information that is at least one of the user's viewpoint position and line-of-sight direction is acquired. This tracking information can be acquired by performing tracking processing of the HMD 200, for example. Note that the user's viewpoint position and line-of-sight direction may be directly acquired by tracking processing. As an example, the tracking information includes the change information of the viewpoint position from the initial viewpoint position of the user (change value of the coordinate of the viewpoint position), and the change information of the gaze direction from the initial gaze direction of the user (the rotation axis in the gaze direction). At least one of the rotation angle change values around the rotation angle). Based on the change information of the viewpoint information included in such tracking information, the user's viewpoint position and line-of-sight direction (information on the user's head position and posture) can be specified.

  Then, the virtual camera control unit 114 changes the viewpoint position and the line-of-sight direction of the virtual camera based on the acquired tracking information (information on at least one of the user's viewpoint position and the line-of-sight direction). For example, the virtual camera control unit 114 is configured so that the viewpoint position and the line-of-sight direction (position and posture) of the virtual camera change in the virtual space according to changes in the viewpoint position and the line-of-sight direction of the user in the real space. Set up the camera. By doing in this way, a virtual camera can be controlled to follow a user's viewpoint change based on tracking information of a user's viewpoint information.

  In the present embodiment, a virtual reality simulation process is performed as the game process of the game played by the user. The virtual reality simulation process is a simulation process for simulating an event in the real space in the virtual space, and is a process for causing the user to experience the event virtually. For example, a process for moving a user moving body such as an avatar moving body (virtual user) corresponding to a user in the real space or its boarding moving body in the virtual space, or causing the user to experience changes in the environment and surroundings accompanying the movement. I do.

  Note that the processing of the simulation system of this embodiment in FIG. 1 can be realized by a processing device such as a PC installed in a facility, a processing device worn by a user, or distributed processing of these processing devices. Or you may implement | achieve the process of the simulation system of this embodiment with a server system and a terminal device. For example, it may be realized by distributed processing of a server system and a terminal device.

2. Tracking Processing Next, an example of tracking processing will be described. FIG. 2A shows an example of the HMD 200 used in the simulation system of this embodiment. As shown in FIG. 2A, the HMD 200 is provided with a plurality of light receiving elements 201, 202, and 203 (photodiodes). The light receiving elements 201 and 202 are provided on the front side of the HMD 200, and the light receiving element 203 is provided on the left side of the HMD 200. In addition, a light receiving element (not shown) is also provided on the right side surface and the upper surface of the HMD.

  The user US has a gun-type controller 290 that imitates a real-world gun, and the gun-type controller 290 is also provided with light receiving elements 204 and 205 (photodiodes). By using these light receiving elements 204 and 205, the position and direction of the gun-type controller 290 can be specified. The gun-type controller 290 is provided with a switch for triggering a gun. By operating this switch, a moving body in the virtual space fires a gun. The gun-type controller 290 may be provided with at least one light receiving element.

  Further, the HMD 200 is provided with a headband 260 and the like so that the user US can stably wear the HMD 200 on the head with a better wearing feeling. In addition, the HMD 200 is provided with a headphone terminal (not shown). By connecting a headphone 270 (sound output unit 192) to the headphone terminal, for example, processing of three-dimensional sound (three-dimensional audio) is performed. The user US can listen to the game sound. Note that the operation information of the user US may be input by detecting the head movement or the swinging movement of the user US by the sensor unit 210 of the HMD 200 or the like.

  Further, the user US wears the processing device 250 on, for example, the back. For example, the user US wears a jacket (vest), and the processing device 250 is attached to the back side of the jacket. The processing device 250 is realized by an information processing device such as a notebook PC. The processing device 250 and the HMD 200 are connected by a cable 252. For example, the processing device 250 performs processing for generating an image (game image or the like) displayed on the HMD 200, and the generated image data is sent to the HMD 200 via the cable 252 and displayed on the HMD 200. In addition to the image generation process, the processing device 250 is configured to perform each process (information acquisition process, virtual space setting process, moving body process, virtual camera control process, game process, control process, display process) of the present embodiment. Alternatively, sound processing or the like can be performed. Note that each processing of the present embodiment may be realized by a processing device (not shown) such as a PC installed in a facility, or may be realized by distributed processing of the processing device and the processing device 250 worn by the user US. Good.

  As shown in FIG. 2B, base stations 280 and 284 are installed around the user US. The base station 280 is provided with light emitting elements 281 and 282, and the base station 284 is provided with light emitting elements 285 and 286. The light emitting elements 281, 282, 285, and 286 are realized by LEDs that emit laser (infrared laser or the like), for example. The base stations 280 and 284 use these light emitting elements 281, 282, 285, and 286 to emit, for example, a laser beam radially. The light receiving elements 201 to 203 and the like provided in the HMD 200 in FIG. 2A receive the lasers from the base stations 280 and 284, thereby realizing the tracking of the HMD 200 and the position and direction of the head of the user US. (Viewpoint position, line-of-sight direction) can be detected. The light receiving elements 204 and 205 provided in the gun-type controller 290 receive lasers from the base stations 280 and 284, so that at least one of the position and direction of the gun-type controller 290 can be detected.

  FIG. 3A shows another example of the HMD 200. In FIG. 3A, a plurality of light emitting elements 231 to 236 are provided for the HMD 200. These light emitting elements 231 to 236 are realized by, for example, LEDs. The light emitting elements 231 to 234 are provided on the front side of the HMD 200, and the light emitting element 235 and the light emitting element 236 (not shown) are provided on the back side. These light emitting elements 231 to 236 emit (emit) light in a visible light band, for example. Specifically, the light emitting elements 231 to 236 emit light of different colors. The gun-type controller 290 possessed by the user US is also provided with light emitting elements 237 and 238 (LEDs). The gun controller 290 only needs to be provided with at least one light emitting element.

  The imaging unit 150 shown in FIG. 3B is installed in at least one place around the user US (for example, the front side, the front side, the rear side, or the like). ˜236 images of light. That is, the spot light of these light emitting elements 231 to 236 is reflected in the captured image of the imaging unit 150. And the tracking of the user's US head (HMD) is implement | achieved by performing the image process of this captured image. That is, the three-dimensional position of the head of the user US and the facing direction (viewpoint position, line of sight direction) are detected.

  For example, as illustrated in FIG. 3B, the imaging unit 150 includes first and second cameras 151 and 152, and the first and second cameras 151 and 152 of the first and second cameras 151 and 152 are provided. By using the captured image, the position of the head of the user US in the depth direction can be detected. Further, based on the motion detection information of the motion sensor provided in the HMD 200, the rotation angle (line of sight) of the head of the user US can also be detected. Therefore, by using such an HMD 200, when the user US faces in any direction of all 360 degrees around the image, the image (the user's virtual space in the virtual space (virtual three-dimensional space)) Image viewed from a virtual camera corresponding to the viewpoint) can be displayed on the display unit 220 of the HMD 200.

  Further, the imaging unit 150 images light from the light emitting elements 237 and 238 of the gun-type controller 290. That is, spot images of the light emitting elements 237 and 238 appear in the captured image of the imaging unit 150, and by performing image processing on the captured image, at least the position and direction of the gun-type controller 290 are the same as in the case of the HMD 200. One can be detected.

  Note that instead of visible light, infrared LEDs may be used as the light emitting elements 231 to 238. Further, the position or movement of the user's head may be detected by another method such as using a depth camera.

  Further, the tracking processing method for detecting the user viewpoint position and the line-of-sight direction (user position and direction) is not limited to the method described with reference to FIGS. For example, the tracking process may be realized by a single unit of the HMD 200 using a motion sensor or the like provided in the HMD 200. That is, tracking processing is realized without providing external devices such as the base stations 280 and 284 in FIG. 2B and the imaging unit 150 in FIG. Or you may detect viewpoint information, such as a user's viewpoint position and a gaze direction, by various viewpoint tracking methods, such as well-known eye tracking, face tracking, or head tracking. The detection of the position and direction of the gun-type controller 290 may be realized by using a motion sensor provided in the gun-type controller 290.

  2A and 3A, the user US wears a jacket 52 that is an example of the wearing body 50 of FIG. 1 on the body. As shown in FIGS. 9A and 9B described later, the jacket 52 (a mounting body in a broad sense) is provided with a plurality of vibration portions (VF1 to VF9, VB1 to VB9).

3. Next, the method of this embodiment will be described in detail. In the following description, the method of the present embodiment will be described mainly using an example where the method is applied to a battle game. However, the present embodiment is not limited to this, and various games (RPG, action game, competition game, sports game, horror experience game, simulation game of vehicles such as trains and airplanes, puzzle games, communication games, or music games) Etc.) and can be applied to other than games. Hereinafter, a case where the user moving body is a user's avatar moving body (virtual user, user character) will be described as an example. However, the user moving body is a boarding moving body (for example, a robot, a tank, a battle) Machine or car).

3.1 Description of Game First, a game realized by the present embodiment will be described. 4 to 6 are explanatory diagrams of a gun shooting game (FPS game) realized by this embodiment.

  FIG. 4 is an explanatory diagram of fields used in the simulation system of this embodiment. In this simulation system, a field FL (play field, play area, play space) is prepared in a real world facility or the like, and the users US1 to US4 move in the field FL. The field FL is provided with a partition WL realized by a wall or the like.

  The users US1 to US4 wear HMD1 to HMD4 and possess gun type controllers GN1 to GN4 (controllers in a broad sense). In addition, the users US1 to US4 wear the processing device 250 (not shown) described in FIG. These users US1 to US4 form a team (group in a broad sense) for a team battle game, for example. A video in the virtual space is displayed on the HMD1 to HMD4, and the users US1 to US4 play a game such as a battle game while watching the video. For example, when the HMD1 to HMD4 are non-transmissive HMDs, the field of view of the users US1 to US4 is covered with the HMD1 to HMD4, so that it is difficult to see the state of the real world. For this reason, for example, the problem that the user US2 located behind the user US1 hits the user US1 occurs.

  Prior to the start of the game play, the user selects a user moving body (avatar) that will be his or herself. For example, FIG. 5A shows users US1 and US2 in real space (real world), and the users US1 and US2 wear the HMD1 and HMD2 and possess gun type controllers GN1 and GN2.

  Further, the users US1 and US2 wear a jacket 52 (wearing body) as shown in FIGS. 9A and 9B described later on their bodies.

  On the other hand, in the virtual space, user mobile bodies MV1 and MV2 which are the alternate users US1 and US2 appear. These user moving bodies MV1 and MV2 are equipped with game character equipment and clothing. For example, it is equipped with a shell moving body called a prosthetic body. The user moving bodies MV1 and MV2 have guns GV1 and GV2 (gun display objects) corresponding to the gun-type controllers GN1 and GN2 in the real space. When the real space users US1 and US2 move the gun-type controllers GN1 and GN2 up and down and left and right, the user moving bodies MV1 and MV2 in the virtual space (virtual world) move the guns GV1 and GV2 up and down and left and right.

  FIG. 6 shows an example of a game image generated according to this embodiment. This game image is displayed on the HMD worn by each user. For example, FIG. 6 is an example of a game image displayed on the HMD 1 of the user US1 in FIG. 5A, and the hand of the user moving body MV1 of the user US1 and the gun GV1 (gun object) possessed by the user US1 are displayed. In addition, user moving bodies MV2 and MV3 corresponding to the users US2 and US3 of the teammates, and enemy moving bodies MB1, MB2 and MB3 corresponding to the users of the enemy team are displayed. The user mobiles MV1, MV2, and MV3 of the ally team attack the enemy side with the possessed guns GV1, GV2, and GV3, and the enemy mobiles MB1, MB2, and MB3 of the enemy team possess the guns GB1, GB2 , Attack with GB3.

  7 and 8 are explanatory diagrams of the sword game realized by this embodiment. As shown in FIG. 7, the user US wears the HMD 200 so as to cover the field of view. For example, the sword-shaped controller 10 is held with the right hand and the controller 80 is held with the left hand. Specifically, the user US has the sword-type controller 10 like a sword by holding the grip 20 (the handle) with the right hand.

  The sword-type controller 10 is provided with a generating mechanism 30 that generates at least one of reaction and vibration between the tip portion and the grip portion 20. A generation mechanism 60 that generates vibration is provided between the rear end portion and the grip portion 20. A controller 70 for detecting position information and posture information of the sword-type controller 10 is attached to the tip of the sword-type controller 10.

  The generation mechanism 30 includes a weight 32 and a receiving part 34. The generating mechanism 30 generates a reaction (reaction force) by causing the weight 32 to collide with the receiving portion 34. In addition, vibration can also be generated along with the reaction. The reaction is, for example, pushed back by the reaction when another force or action is applied. For example, in the present embodiment, the user holds the sword-type controller 10 in real space and performs an operation of shaking with a sword. When a sword object corresponding to the sword hits another object such as an enemy moving body in the virtual space, a virtual reaction with respect to the hit is realized by the generation mechanism 30. For example, the generating mechanism 30 generates a reaction that can be felt by the user as if a reaction force in a direction opposite to the direction in which the sword hits. As a result, the user can feel as if a reaction force has occurred, and a virtual reaction caused by a sword hit can be realized.

  The generation mechanism 60 that generates vibration has a transducer, and the generation mechanism 60 generates vibration with a time delay from the occurrence of the reaction of the generation mechanism 30. Further, the position information and posture information of the sword-type controller 10 and the controller 80 are acquired by the tracking processing described with reference to FIGS. 2A to 3B and the like. Further, the user US wears a jacket 52 (wearing body) as will be described later with reference to FIGS. 9A and 9B.

  FIG. 8 shows an example of a game image displayed on the HMD 200. In the game image, an object such as an enemy moving object OBE (enemy character), a sword SWE, a shield SLE, and a background possessed by the enemy moving object OBE are displayed. Also, objects such as the right hand HR, the left hand HL, the sword SW of the right hand HR, and the shield SL of the left hand HL of the user moving body (user character, avatar) corresponding to the user US are also displayed. Has been.

  For example, when the user US moves the sword-type controller 10 held by the right hand in the real space of FIG. 7, the right hand HR and the sword SW in the virtual space of FIG. 8 also move in conjunction with the movement. Become. When the user US moves the controller 80 held by the left hand in the real space of FIG. 7, the left hand HL and the shield SL in the virtual space of FIG. 8 also move in conjunction with the movement. That is, the real space sword-type controller 10 corresponds to the virtual space sword SW, and the real space controller 80 corresponds to the virtual space shield SL.

  FIG. 8 is a first-person viewpoint game image in which an image from the viewpoint of a user moving body (user character) in the virtual space corresponding to the user US in the real space is displayed. In practice, the HMD 200 displays an image of the VR space that extends over the entire periphery of the field of view to the user US.

3.2 Vibration Jacket, Vibration Unit In the simulation system according to the present embodiment, the user wears the mounting body 50 on the body and plays a game. In FIG. 5A and FIG. 7, a jacket 52 is worn as the mounting body 50. In the following, the case where the mounting body 50 is the jacket 52 will be described as an example. However, the mounting body 50 is not limited to the jacket 52, and a jacket such as a jumper other than the jacket, pants, armor, Various body wearing items such as a belt to be worn on the chest, waist, arm, etc. can be considered.

  The jacket 52 is provided with a plurality of vibrating portions. In FIG. 9A, vibrating portions VF1 to VF9 are provided as the front-side vibrating portions of the jacket 52, and vibrating portions VB1 to VB9 are provided as the rear-side vibrating portions. The number of vibrating parts is arbitrary. For example, 1 to 8 or 10 or more vibrating parts are provided as the front-side vibrating part, or 1 to 8 or 10 or more vibrating parts are provided as the rear-side vibrating part. Also good. In addition, a plurality of vibration portions may be provided only on one of the front surface portion and the rear surface portion of the jacket 52, or one or more vibration portions may be provided on a side surface such as the right side surface or the left side surface of the jacket 52. 9A and 9B, a plurality of vibrating portions are arranged in a lattice shape, but the arrangement of the vibrating portions is not limited to this, and the arrangement is not a lattice shape but a two-dimensional matrix shape. Various arrangement modes such as a one-dimensional matrix arrangement can be assumed.

  FIG. 10 is an example of an implementation configuration of the vibration units (VF1 to VF9, VB1 to VB9). The vibrating part in FIG. 10 is realized by a solenoid 90. One end of a spring 94 is attached to one end side of the solenoid 90, and the solenoid 90 is pulled toward the direction DR1 by the spring 94 in a normal state. The other end PJ of the spring 94 is fixed to the back side surface of the jacket 52, for example. The solenoid 90 is attached to the jacket 52 by a fixture 96.

  When a drive signal is input to the solenoid 90 and energization is performed, the plunger 92 of the solenoid 90 moves toward the direction DR2 and hits the user's body 98. This allows the user to experience vibrations when a bullet or sword hits.

  In addition to the solenoid, the vibration unit can be realized by various vibration devices such as a transducer, a vibration motor, a spring & vibration motor, a pneumatic or electric cylinder, and a linear motor.

  The transducer converts a sound signal and corresponds to a high-power subwoofer. For example, when the control unit 118 of FIG. 1 performs a sound file reproduction process, a sound signal is input to the transducer. For example, vibration is generated based on a low frequency component of the sound signal. For example, the vibration motor generates vibration by rotating an eccentric weight. Specifically, eccentric weights are attached to both ends of the drive shaft (rotor shaft) so that the motor itself swings. In the combination of spring and vibration motor, the motor is used for unlocking to generate vibration. In the cylinder, the rod portion of the cylinder is linearly moved along the directions DR1 and DR2 in FIG. Even with a linear motor, linear motion is performed along the directions DR1 and DR2 in FIG.

  In the present embodiment, a technique is adopted in which a vibration part is attached to a jacket (wearing body) and vibration control of the vibration part is performed according to a game situation (hit event, vibration event). Various realization modes can be assumed as this vibration control method.

  For example, when one vibration part is attached only to the front part of the jacket (vest) and a hit event in the game (vibration event in a broad sense) occurs (when a bullet signal is received from the control part), the vibration part Vibrate.

  Alternatively, a plurality of vibration units are attached to, for example, the front surface of the jacket, and when a hit event occurs in the game, the vibration unit selected from the plurality of vibration units is vibrated. For example, based on the information on the hit position (the position where the attack was received), which vibration part of the plurality of vibration parts is to be vibrated is selected and vibrated.

  Alternatively, when a single hit part is attached to each of the front part and the rear part of the jacket and a hit event occurs (when an impact signal is received from the control part), the vibration of the front part and the rear part are vibrated. The part is vibrated with a time difference to give the user a feeling that the bullet has penetrated.

  Alternatively, by attaching a plurality of vibration parts to each of the front part and the rear part of the jacket, based on the information on the hit position (attack position) and the information on the hit direction (attack direction), , Which to vibrate is determined, and subsequently, which of the rear vibrating parts is to be vibrated is determined. In addition, it is determined according to the hit speed (attack speed) how often the generation interval (vibration interval) between the vibration of the front vibration portion and the vibration of the vibration portion of the rear surface portion is set. For example, if the attack is a bullet, the hit speed is fast, and if the attack is a sword, the hit speed is slow. Further, in the case of a sword attack or the like, it is possible to realize an attack expression in which the sword tip is moved circularly after being stabbed. Specifically, the vibration part to be vibrated at the front part is kept the same, and the vibration part to be vibrated at the rear part is selected according to the circular motion of the sword tip. As described above, various embodiments can be considered as a vibration control method using the vibration part provided in the mounting body.

3.3 Specific Example of Vibration Control Next, a specific example of the vibration control method of this embodiment will be described. FIG. 11A and FIG. 11B are diagrams showing the relationship between the user US moving in the real space and the user moving body MV moving in the virtual space.

  In FIG. 11A, the user US is moving as indicated by A1 in the real space. The user US wears the HMD 200 so as to cover the field of view, and has a gun-type controller GN in his hand. Then, the field FL in the real space as shown in FIG. 4 is moved. Then, the position information of the user US moving in the real space is acquired, and the user moving body MV moves in the virtual space based on the acquired position information, as indicated by A2 in FIG. In addition, the direction information of the user US in the real space is acquired, and the user moving body MV in the virtual space also faces the direction corresponding to the direction information. Also, the posture information of the user US in the real space is acquired, and the user moving body MV in the virtual space also takes a posture corresponding to the posture information. For example, when the user US moves his / her hand or foot in the real space, the user moving body MV in the virtual space also moves his / her hand or foot accordingly.

  As described above, in FIGS. 11A and 11B, the position, direction, and posture of the user moving body in the virtual space corresponding to the user also change according to the change in the position, direction, and posture of the user. Become. In the system using the HMD, since an image in which a vast VR space spreads over the entire perimeter of the user's field of view is displayed on the HMD, the virtual reality of the user can be significantly improved.

  On the other hand, in the gun shooting game, as shown in FIG. 6, a hit event (shot event) in which an attack from an enemy hits the user moving body occurs. In this case, it is difficult for the user to experience such a hit event realistically only with the display image of the HMD and the output sound to the headphones. That is, if an image that hits a bullet is displayed on the HMD, or if a sound effect that represents a bullet hit is output from the headphones, there is no sense of vibration or the like due to the bullet hit, Reality cannot be given to the user sufficiently.

  Therefore, in the present embodiment, a method of vibrating the vibrating portion provided in the mounting body is adopted according to the game situation such as a hit event (vibration event) such as a bullet.

  For example, in FIG. 12A, a hit event in which a bullet SH (another object in a broad sense) from an enemy hits the user moving body MV occurs in the virtual space. When such a hit event occurs, as shown in FIG. 12B, the vibration unit VF of the jacket 52 worn by the user US is vibrated in the real space.

  Specifically, in the present embodiment, virtual space setting processing is performed, and as described with reference to FIGS. 11A and 11B, movement processing of the user moving body MV that moves in the virtual space is performed. . Further, a game process of a game that is played by the user US wearing the jacket 52 (attachment body) on the body is performed, and a display image is generated based on the result of the game process as shown in FIGS. . For example, in the present embodiment, this display image is displayed on the HMD.

  And in this embodiment, as shown to FIG. 9 (A) and FIG. 9 (B), the jacket 52 which is a mounting body is provided with several vibration parts (VF1-VF9, VB1-VB9). Further, as shown in FIG. 12A, hit calculation processing is performed on the user moving body MV and the bullet SH which is another object. Then, when a hit event occurs between the user moving body MV and the bullet SH, which is another object, vibration control is performed on the plurality of vibrating portions of the jacket 52, which is a wearing body. For example, vibration control is performed to vibrate a vibration part selected from a plurality of vibration parts according to the hit direction or hit position of the bullet SH.

  By doing in this way, when an event in which the bullet SH hits the user moving body MV corresponding to the user US occurs in the virtual space displayed on the HMD, the user US generates a real world according to the hit event. In the jacket 52 worn by itself, the vibrating portion corresponding to the hit direction or hit position vibrates. Therefore, in addition to the virtual reality by the real image of the HMD, it is possible to give the user a bodily sensation by the vibration of the vibrating portion of the jacket 52, and the virtual reality of the user can be significantly improved.

  In the present embodiment, the images as shown in FIGS. 6 and 8 are not displayed on the HMD, but are displayed on a display unit such as a television in a home game device, a monitor display in a personal computer, or an arcade game device. An embodiment that displays may be used. In this case, a game process of a game that is played by the user US wearing the mounted body on the body is performed, and a display image is generated and displayed on the display unit based on the result of the game process. In this case, an image from the first person viewpoint of the user may be displayed on the display unit, or an image from the third person viewpoint of the user moving body (user character) viewed from behind may be displayed. Then, when the user operates the game controller (operation unit), the user moving body moves in the game space.

  FIGS. 13A and 13B are explanatory diagrams of the vibration control method of the vibration unit based on the hit information. In this embodiment, based on hit information including at least one of the hit direction and the hit position, a process of selecting a vibration unit to vibrate from among a plurality of vibration units is performed.

  In this way, vibration control of the vibration part reflecting the hit information obtained by hit calculation processing can be realized, and real vibration control corresponding to the game situation in the virtual space can be realized. .

  Specifically, in FIGS. 13A to 14B, front-side vibrating portions VF1 to VF9 are provided on the front surface portion of the jacket 52 (mounting body), and the rear surface portion of the jacket 52 is connected to the rear surface side. Vibrating portions VB1 to VB9 are provided. At this time, in the present embodiment, when a hit event (vibration event) occurs, based on the hit information, the first vibration part that is one of the vibration part on the front surface side and the vibration part on the rear surface side is changed. After the vibration, the vibration control is performed to vibrate the second vibration part which is the other vibration part of the vibration part on the front surface side and the vibration part on the rear surface side. Here, the hit information is information including at least one of the hit direction and the hit position.

  That is, in this embodiment, by providing a time difference between the vibration intervals of the two vibration parts, a virtual reality as if a bullet penetrated its own body is given to the user. In this embodiment, in the vibration having such a time difference, the first vibration part is the first vibration part, and the second vibration part is the second vibration part.

  In FIGS. 13A and 13B, the first vibrating portion that vibrates first is the front vibrating portion, and the second vibrating portion that vibrates later is the rear vibrating portion. This is an example. For example, in FIG. 13A, after vibrating the front-side vibrating portion VF6 that is the first vibrating portion, the rear-side vibrating portion VB4 that is the second vibrating portion is vibrated. In FIG. 13B, after vibrating the front vibration part VF2 which is the first vibration part, the rear vibration part VB5 which is the second vibration part is vibrated.

  On the other hand, in FIGS. 14A and 14B, the first vibrating portion that vibrates first is the rear vibrating portion, and the second vibrating portion that vibrates later is the front vibrating portion. It is an example in some cases. For example, in FIG. 14A, after vibrating the rear vibration part VB4 which is the first vibration part, the front vibration part VF6 which is the second vibration part is vibrated. In FIG. 14B, after vibrating the rear vibration part VB5 which is the first vibration part, the front vibration part VF2 which is the second vibration part is vibrated.

  As described above, in the present embodiment, it is as if by performing vibration control that provides a time difference between the vibration intervals of the two vibrating portions, such as vibrating the second vibrating portion after vibrating the first vibrating portion. Virtual reality is given to the user as if the bullet had penetrated his body. Thereby, it is possible to greatly improve the virtual reality given to the user when a hit event such as a bullet occurs.

  In order to perform such vibration control, first, the bullet SH hits the front surface of the user moving body MV in FIG. 12A or the bullet SH hits the rear surface of the user moving body MV. It is necessary to determine whether or not.

  When the bullet SH hits the front surface of the user moving body MV, as shown in FIGS. 13A and 13B, the front vibration parts VF6 and VF2 which are the first vibration parts are vibrated. Then, the rear vibration parts VB4 and VB5, which are the second vibration parts, may be vibrated.

  On the other hand, when the bullet SH hits the rear surface portion of the user moving body MV, as shown in FIGS. 14A and 14B, the vibration portions VB4 and VB5 on the rear surface side which are the first vibration portions. Then, the front-side vibrating portions VF6 and VF2 that are the second vibrating portions may be vibrated.

  Then, in determining whether the bullet SH hits the front surface of the user moving body MV or the bullet SH hits the rear surface of the user moving body MV, the hit including at least one of the hit direction DHT and the hit position PHT is used. Information can be used.

  For example, in FIG. 13A and FIG. 13B, it can be determined that the bullet SH flies from the front side of the user moving body MV based on the hit direction DHT. Alternatively, based on the hit position PHT, it can be determined that the bullet SH has hit the front surface of the user moving body MV. Accordingly, in this case, as shown in FIGS. 13A and 13B, the vibration control for vibrating the vibration parts VB4 and VB5 on the rear surface side after vibrating the vibration parts VF6 and VF2 on the front surface side is performed. I do.

  On the other hand, in FIG. 14 (A) and FIG. 14 (B), it can be determined that the bullet SH flies from the rear side of the user moving body MV based on the hit direction DHT. Alternatively, based on the hit position PHT, it can be determined that the bullet SH has hit the rear surface of the user moving body MV. Therefore, in this case, as shown in FIGS. 14A and 14B, the vibration control for vibrating the vibration portions VF6 and VF2 on the front side after vibrating the vibration portions VB4 and VB5 on the rear surface side is performed. I do.

  Further, as shown in FIGS. 13A to 14B, when there are a plurality of vibration parts on the front side or the rear side, it is necessary to select a vibration part to be vibrated from among the plurality of vibration parts. Become. Therefore, in the present embodiment, a process of selecting a vibration part to be vibrated from a plurality of vibration parts is performed based on hit information.

  Specifically, in the present embodiment, when a plurality of first vibration units are provided as the first vibration unit to be vibrated first, a vibration unit to be vibrated is selected from the plurality of first vibration units. Processing is performed based on the hit information. Alternatively, when a plurality of second vibration units are provided as the second vibration unit to be vibrated later, a process of selecting a vibration unit to be vibrated from among the plurality of second vibration units is performed based on the hit information. Do.

  For example, in FIG. 13A and FIG. 13B, the plurality of first vibration parts to be vibrated first are the vibration parts VF1 to VF9 on the front side, and the plurality of second vibration parts to be vibrated later are This is an example in the case of the vibration parts VB1 to VB9 on the rear surface side. In this case, a process of selecting a vibration part to be vibrated from among the plurality of front-side vibration parts VF1 to VF9 (a plurality of first vibration parts) and a plurality of rear-surface vibration parts VB1 to VB9 (a plurality of first vibration parts) The process of selecting the vibration part to be vibrated from among the two vibration parts) is performed based on the hit direction DHT which is hit information.

  For example, in FIG. 13 (A), the hit direction DHT of the bullet SH in FIG. 12 (A) is the direction from the left front side to the right rear side of the user moving body MV. In this case, the vibration unit VF6 on the front side and the vibration unit VB4 on the rear side along the trajectory in the hit direction DHT are selected and vibrated. For example, after vibrating the vibration part VF6 on the front surface side, the vibration part VB4 on the rear surface side is vibrated after a given vibration interval has elapsed. As a result, the user can feel a virtual reality as if a real bullet had penetrated from the left front side to the right rear side of his / her body.

  In FIG. 13B, the hit direction DHT of the bullet SH is a direction from the lower front side to the upper rear side of the user moving body MV. In this case, the vibration unit VF2 on the front side and the vibration unit VB5 on the rear side along the trajectory in the hit direction DHT are selected and vibrated. For example, after vibrating the vibration part VF2 on the front surface side, the vibration part VB5 on the rear surface side is vibrated after the passage of a given vibration interval. Thus, the user can feel a virtual reality as if a real bullet had penetrated from the lower front side to the upper rear side of his / her body.

  On the other hand, in FIG. 14A and FIG. 14B, the plurality of first vibration parts that vibrate first are the vibration parts VB1 to VB9 on the rear surface side, and the plurality of second vibration parts that vibrate later are shown. This is an example in the case of the vibration parts VF1 to VF9 on the front side. In this case, a process of selecting a vibrating part to be vibrated from among the plurality of rear-side vibrating parts VB1 to VB9 (a plurality of first vibrating parts) and a plurality of front-side vibrating parts VF1 to VF9 (a plurality of first vibrating parts) 2), the process is performed based on the process of selecting the vibration part to be vibrated from the two vibration parts) and the hit direction DHT which is hit information.

  For example, in FIG. 14A, the hit direction DHT of the bullet SH is a direction from the right rear side to the left front side of the user moving body MV. In this case, the rear vibration part VB4 and the front vibration part VF6 along the trajectory in the hit direction DHT are selected and vibrated. For example, after vibrating the vibration part VB4 on the rear surface side, the vibration part VF6 on the front surface side is vibrated after a given vibration interval has elapsed. Thus, the user can feel a virtual reality as if a real bullet had penetrated from the right rear side to the left front side of his / her body.

  In FIG. 14B, the hit direction DHT of the bullet SH is a direction from the upper rear side to the lower front side of the user moving body MV. In this case, the rear vibration portion VB5 and the front vibration portion VF2 along the trajectory in the hit direction DHT are selected and vibrated. For example, after vibrating the rear vibration portion VB5, the front vibration portion VF2 is vibrated after a given vibration interval. Thus, the user can feel a virtual reality as if a real bullet had penetrated from the upper rear side to the lower front side of his / her body.

  As described above, in FIGS. 13A to 14B, a predetermined number (for example, 9) of vibration parts are arranged in a lattice pattern on each of the front part and the rear part of the user, and appropriate values based on hit information are obtained. The vibration part is selected and vibrates. Accordingly, it is possible to give the user a suitable virtual reality that reflects hit information such as the hit direction.

  In FIGS. 13A to 14B, the selection process of the vibration part is performed based on the hit direction DHT, but the selection process of the vibration part may be performed based on the hit position PHT.

  For example, in FIG. 12A, it is assumed that it is determined that the bullet SH hits the center of the body of the user moving body MV. In this case, as shown in FIG. 15A, vibration control is performed to vibrate the front vibration portion VF5 and the rear vibration portion VB5 corresponding to the hit position PHT at the center of the body. As a result, the user can feel a virtual reality as if a real bullet had penetrated from the front central part of the body to the rear central part.

  On the other hand, suppose that it is determined that the bullet SH has hit the lower side of the center of the user moving body MV. In this case, as shown in FIG. 15B, vibration control is performed to vibrate the front vibration portion VF2 and the rear vibration portion VB2 corresponding to the lower hit position PHT at the center of the body. As a result, the user can feel a virtual reality as if a real bullet had penetrated from the lower center part on the front side to the lower center part on the rear side. The same vibration control can be performed when the bullet hit position PHT is on the right side, the left side, the upper side, the diagonal side, or the like of the central portion. Further, vibration control for vibrating the front vibration portion and the rear vibration portion may be performed using both the hit direction DHT and the hit position PHT of the hit information. In this way, it is possible to perform vibration control that more accurately realizes virtual reality bodily sensation processing in which a bullet penetrates the body.

  Also, hit information such as the bullet hit direction DHT and the hit position PHT can be specified by performing calculation processing such as the attack direction of an enemy attacking the user moving body MV. For example, the position information and direction information of the gun-type controller possessed by the enemy user are acquired by the tracking method described in FIGS. 2A to 3B, and an attack is performed based on the position information and direction information. A hit calculation process for obtaining the direction is performed, and the hit direction DHT and the hit position PHT are specified. In this case, for example, the hit direction DHT and the hit position PHT may be specified by reflecting the relative positional relationship and directional relationship between the user moving body and the enemy moving body.

  In the present embodiment, the length of the vibration interval from the first timing for vibrating the first vibrating portion to the second timing for vibrating the second vibrating portion is set as the type of hit event (vibration event) or Change according to the content. Specifically, the length of the vibration interval is changed based on the hit speed included in the hit information.

  Here, the first vibration part is a vibration part that vibrates first, and the second vibration part is a vibration part that vibrates later. As described above, in FIGS. 13A and 13B, the front-side vibrating portions (VF1 to VF9) are the first vibrating portions, and the rear-side vibrating portions (VB1 to VB9) are the second vibrating portions. It becomes a vibration part. On the other hand, in FIG. 14 (A) and FIG. 14 (B), the rear vibration parts (VB1 to VB9) are the first vibration parts, and the front vibration parts (VF1 to VF9) are the second vibration parts. become.

  For example, in FIG. 16A, the front-side vibrating portion VF that is the first vibrating portion vibrates at timing T1 (first timing). Then, at the timing T2 (second timing) after the passage of the vibration interval TV from the timing T1, the rear vibrating portion VB which is the second vibrating portion vibrates. By providing such a time difference of vibration due to the vibration interval TV, it is possible to realize a virtual reality feeling as if a bullet has penetrated. As described above, the first vibration part may be a rear vibration part, and the second vibration part may be a front vibration part.

  In FIG. 16B, since the hit speed of the bullet is slow, the vibration interval TV from the timing T1 for vibrating the vibrating portion VF to the timing T2 for vibrating the vibrating portion VB is lengthened. On the other hand, in FIG. 16C, since the hit speed of the bullet is fast, the vibration interval TV from the timing T1 for vibrating the vibrating portion VF to the timing T2 for vibrating the vibrating portion VB is shortened. In this way, for a bullet with a low speed, the vibration interval TV becomes long, so that a virtual reality feeling that the bullet penetrates the body at a long time interval can be given to the user. On the other hand, for a bullet with a high speed, the vibration interval TV is shortened, so that the user can give a virtual reality feeling that the bullet penetrates the body at a short time interval. Accordingly, bullet penetration expression reflecting the bullet hit speed can be realized, and the virtual reality of the user can be further improved.

  Thus, in the present embodiment, the length of the vibration interval TV is changed based on the hit speed. In other words, the length of the vibration interval TV is changed according to the type and content of the hit event (vibration event). For example, in the first type of event in which a weapon attack with a high hit speed is performed, the vibration interval TV is shortened. On the other hand, in the second type event where a weapon attack with a slow hit speed is performed, the vibration interval TV is lengthened. That is, the length of the vibration interval TV is changed according to the type of hit event. Alternatively, in the same type of event using the same weapon, for example, when the attack speed parameter of the enemy is increased and the hit speed of the attack by the weapon is increased, the vibration interval TV is shortened. Further, when the attack speed parameter of the enemy is lowered and the hit speed of the attack with the weapon is lowered, the vibration interval TV is lengthened. That is, the length of the vibration interval TV is changed according to the contents of the hit event.

  By doing so, the vibration part vibrates at a vibration interval with a length corresponding to the type and content of the hit event, so that vibration control reflecting the type and content of the hit event can be realized. become.

  As described above, in the present embodiment, a plurality of vibration units are provided for the mounting body such as the jacket 52, and an image based on the game process is displayed on the display unit. The vibration control of the vibration part is performed. In this way, vibration control of the vibration unit linked to the game image displayed on the display unit can be performed, and a display image based on the result of the game processing is generated while reflecting the situation of the game played by the user. Vibration control of the vibration part of the mounted body can be realized.

  In particular, when the HMD is used as the display unit, the user's field of view is covered with the HMD, and therefore vibration control using the plurality of vibration units of the wearing body is effective for improving the virtual reality of the user. For example, when the field of view is covered by the HMD, the user can feel the vibration of the plurality of vibration parts on the wearing body as if a real bullet hit the user, and the virtual reality of the game The feeling can be greatly improved. For example, as shown in FIGS. 13 (A) to 15 (B), if vibration control reflecting hit information such as the hit direction and hit position is performed, bullets and the like are actually hit in the hit direction and hit position. It is possible to give virtual reality to the user as if it were. Also, as shown in FIGS. 16A to 16C, by providing a time difference of vibration depending on the vibration interval, it is possible to realize a virtual reality that feels as if a hit bullet or the like has penetrated its own body.

  As a hit event in the present embodiment, an event in which an attack object such as a bullet SH as shown in FIG. 17A hits the user moving body MV can be considered. However, as shown in FIG. It may be an event in which a weapon such as a sword SWE of a moving object OBE hits a user moving object. In this way, in the sword game as shown in FIG. 7 and FIG. 8, the feeling that the user has cut the enemy is realized by the reaction mechanism 30 of the sword-type controller 10 while being cut from the enemy. The feeling of impact due to this can be realized by vibration control of the vibration part of the mounting body such as the jacket 52.

  Further, the object that hits the user moving body MV in the hit event is not limited to an attacking object such as a bullet SH as shown in FIGS. 17A and 17B and a weapon such as a sword SWE. For example, in FIG. 17C, an object of a rock RK due to the collapse of a rocky mountain or the like has hit the user moving body MV, and the vibration of the mounting body is also sensed for the sense of impact when such a rock RK hits. This can be realized by vibration control of the part. That is, the method of the present embodiment can be applied not only to a battle game using bullets and weapons, but also to a simulation game for a natural experience in which an object such as a rock hits.

  The method of the present embodiment can also be applied to vibration events other than hit events that hit other objects. For example, in FIG. 17D, when an explosion EXP has occurred near the user moving body MV and a vibration event has occurred due to the explosion EXP, vibration control is performed to vibrate the vibration portion of the user's wearing body. Also good. In this way, it is possible to make the user feel the blast caused by the explosion EXP, and to give the user a virtual reality feeling as if the explosion really occurred.

  Moreover, in this embodiment, you may perform the effect process according to the vibration control of a vibration part. For example, in conjunction with vibration control of the vibration unit, a process for producing a sound effect output to the user is performed, or a process for creating a production image with a game image is performed. For example, when a bullet SH or sword SWE is hit in FIGS. 17A and 17B, a sound effect linked to the hit is output or an effect image is generated. Further, in the event that the rock RK hits as shown in FIG. 17C, a sound effect and an effect image when the rock collapses are generated. Also, as shown in FIG. 17D, when an explosion EXP vibration event occurs, a sound effect and an effect image corresponding to the explosion EXP are generated. Then, for example, a sound effect is output or an effect image is displayed in accordance with the number and range of vibration parts to be vibrated or the timing of vibration. By doing so, it is possible to output sound effects and display effect images in conjunction with vibration control of the vibration unit, and it is possible to further enhance the virtual reality of the user.

4). Detailed Processing Next, a detailed processing example of this embodiment will be described with reference to the flowcharts of FIGS.

  FIG. 18 is a flowchart showing an example of the overall processing of this embodiment. First, user information including at least one of user position information, direction information, and posture information is acquired (step S1). For example, by acquiring the HMD position information and direction information, the user position information and direction information can be acquired. And the movement process of the user moving body corresponding to a user is performed (step S2). For example, a process of moving the user moving object in the virtual space is performed based on the acquired position information and direction information of the user in the real space. In addition, when user posture information is acquired, motion processing for operating the user moving body is performed based on the acquired posture information.

  Next, game processing such as hit calculation processing is executed (step S3). For example, a hit calculation process for determining whether or not another object hits the user moving body, a game progress process for advancing the game, and the like are executed. And the vibration control process of the vibration part of a mounting body is performed (step S4). For example, the vibration control process of the vibration unit corresponding to the game situation is performed based on the result of the hit calculation process or the like. Based on the result of the game process, an HMD display image is generated and displayed on the HMD (step S5).

  FIG. 19 is a flowchart of vibration control processing based on hit information. First, it is determined whether or not an object such as a bullet has hit the user moving body (step S11). This hit determination process can be realized by, for example, an intersection determination process between a hit volume of a user moving object and an object such as a bullet or a trajectory.

  When an object such as a bullet hits the user moving body, hit information including at least one of the hit direction, hit position, and hit speed is acquired (step S12). For example, the moving direction, moving position, and moving speed of the object when the object hits the user moving body can be acquired as the hit direction, hit position, and hit speed, respectively. Then, based on the hit direction and hit position of the hit information, the first vibration part which is one vibration part of the vibration part on the front surface side and the vibration part on the rear surface side, and the second vibration part which is the other vibration part. Select (step S13). The first vibration part is a vibration part that vibrates first, and is one of the vibration part on the front side and the vibration part on the rear side. The second vibration part is a vibration part that is vibrated later, and is the other vibration part of the vibration part on the front surface side and the vibration part on the rear surface side. And by the method demonstrated in FIG. 13 (A)-FIG. 15 (B), the process which selects the vibration part made to vibrate from among several 1st vibration parts, and vibrates from among several 2nd vibration parts A process of selecting the vibration unit is performed. The selection process of these vibration parts is performed based on the hit direction and hit position of the hit information.

  Next, based on the hit speed of the hit information, the vibration interval between the first vibration part and the second vibration part is set (step S14). For example, as described with reference to FIGS. 16A to 16C, the vibration interval between the first vibrating portion and the second vibrating portion is lengthened or shortened according to the hit speed. And a 1st vibration part and a 2nd vibration part are vibrated by the set vibration space | interval (step S15). That is, the first vibration part (one of the front-side vibration part and the rear-side vibration part) and the second vibration part (front-side vibration part, rear-side vibration part) selected in FIG. 13 (A) to FIG. 15 (B). Is vibrated at a vibration interval as shown in FIGS. 16 (A) to 16 (C).

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, in the specification or drawings, terms (jackets, bullets / swords, hit events, etc.) described at least once together with different terms (equipment, other objects, vibration events, etc.) in a broader sense or synonymous Alternatively, the different terms can be used in any place in the drawings. Further, user information acquisition processing, virtual space setting processing, moving body movement processing, game processing, hit calculation processing, vibration control processing, display processing, and the like are not limited to those described in the present embodiment, and are equivalent thereto. Various methods, processes, and configurations are also included in the scope of the present invention. The present invention can be applied to various games. Further, the present invention can be applied to various simulation systems such as a business game device, a home game device, or a large attraction system in which a large number of users participate.

V1 to VN vibration part, VF, VF1 to VF9 vibration part on the front side,
VB, VB1 to VB9 The vibration part on the rear side,
DHT hit direction, PHT hit position, TV vibration interval,
US, US1-US4 User, GN, GN1-GN4 Gun type controller,
HMD, HMD1 to HMD4 head-mounted display device,
MV, MV1-MV3, MB1-MB3 user mobile, FL field,
GV1-GV3, GB1-GB3 guns,
SH bullet, SWE sword, RK rock, EXP explosion,
10 sword-type controller, 20 gripping part, 30 generating mechanism, 32 spindles,
34 receiving part, 50 wearing body, 52 jacket,
60 generating mechanism, 70, 80 controller,
90 solenoids, 92 plungers, 94 springs, 96 fittings, 98 bodies,
100 processing units, 102 input processing units, 110 arithmetic processing units, 111 information acquisition units,
112 virtual space setting unit, 113 moving body processing unit, 114 virtual camera control unit,
115 game processing unit, 116 hit calculation processing unit, 118 control unit,
118 control unit, 120 display processing unit, 130 sound processing unit, 140 output processing unit,
150 imaging unit, 151, 152 camera, 160 operation unit,
170 storage unit, 172 object information storage unit, 178 drawing buffer,
180 Information storage medium, 192 sound output unit, 194 I / F unit,
195 portable information storage medium, 196 communication unit,
200 HMD (head-mounted display device), 201-203 light receiving element, 210 sensor unit,
220 display unit, 231 to 236 light emitting element, 240 processing unit,
280, 284 Base station, 281, 282, 285, 286 Light emitting element

Claims (10)

A virtual space setting unit for performing virtual space setting processing;
A moving body processing unit that performs a moving process of a user moving body that moves in the virtual space;
A game processing unit that performs a game process of a game in which a user plays a wearing body on the body;
A display processing unit for generating a display image based on the result of the game processing;
Including a control unit,
At least one front-side vibration part is provided on the front part of the mounting body, and at least one rear-side vibration part is provided on the rear surface part of the mounting body,
The game processing unit
Perform hit calculation processing of the user moving object and other objects to obtain hit information including at least one of hit direction and hit position,
The controller is
When a hit event occurs between the user moving body and the other object, based on the hit information, a first vibration unit that is one of the front-side vibration unit and the rear-side vibration unit is A vibration system that performs vibration control to vibrate a second vibration part that is the other vibration part of the front-side vibration part and the rear-side vibration part after being vibrated. In claim 1,
The controller is
When a plurality of first vibration units are provided as the first vibration unit, a process of selecting a vibration unit to vibrate from the plurality of first vibration units is performed based on the hit information. A featured simulation system. In claim 1 or 2,
The controller is
When a plurality of second vibration parts are provided as the second vibration part, a process of selecting a vibration part to vibrate from the plurality of second vibration parts is performed based on the hit information. A featured simulation system. In any one of Claims 1 thru | or 3,
The controller is
A simulation system, wherein a length of a vibration interval from a first timing for vibrating the first vibrating section to a second timing for vibrating the second vibrating section is changed. In claim 4,
The hit information includes a hit speed,
The controller is
A simulation system, wherein the length of the vibration interval is changed based on the hit speed. A game processing unit that performs a game process of a game in which a user plays a wearing body on the body;
A display processing unit that generates an image to be displayed to the user based on the result of the game process;
Including a control unit,
The mounting body is provided with a plurality of vibration parts,
The controller is
The length of the vibration interval from the first timing for vibrating the first vibrating portion of the plurality of vibrating portions to the second timing for vibrating the second vibrating portion of the plurality of vibrating portions. A simulation system characterized by changing according to the type or content of a vibration event occurring in the game. In any one of Claims 1 thru | or 6.
The display processing unit
A simulation system for generating a display image of a head-mounted display device worn by the user so as to cover a field of view. In any one of Claims 1 thru | or 7,
The controller is
A simulation system that performs an effect process according to the vibration control of the wearing body. A virtual space setting unit for performing virtual space setting processing;
A moving body processing unit that performs a moving process of a user moving body that moves in the virtual space;
A game processing unit that performs a game process of a game in which a user plays a wearing body on the body;
A display processing unit for generating a display image based on the result of the game processing;
As a control unit,
Make the computer work,
At least one front-side vibration part is provided on the front part of the mounting body, and at least one rear-side vibration part is provided on the rear surface part of the mounting body,
The game processing unit
Perform hit calculation processing of the user moving object and other objects to obtain hit information including at least one of hit direction and hit position,
The controller is
When a hit event occurs between the user moving body and the other object, based on the hit information, a first vibration unit that is one of the front-side vibration unit and the rear-side vibration unit is A program for performing vibration control to vibrate a second vibration part which is the other vibration part of the front-side vibration part and the rear-side vibration part after being vibrated. A game processing unit that performs a game process of a game in which a user plays a wearing body on the body;
A display processing unit that generates an image to be displayed to the user based on the result of the game process;
As a control unit,
Make the computer work,
The mounting body is provided with a plurality of vibration parts,
The controller is
The length of the vibration interval from the first timing for vibrating the first vibrating portion of the plurality of vibrating portions to the second timing for vibrating the second vibrating portion of the plurality of vibrating portions. A program that changes according to the type or content of a vibration event that occurs in the game.