JP7071823B2 - Simulation system and program - Google Patents

Description

The present invention relates to a simulation system, a program, and the like.

Conventionally, a technique for realizing an intuitive man-machine interface using the user's tactile sensation has been known. For example, Patent Document 1 describes a sensor circuit including a contact detector and a motion detector, a haptic textile, and an operating surface configured to generate tactile feedback based on an operating signal from the sensor circuit. The device having the above is disclosed. In the prior art of Patent Document 1, a method of realizing garments with tactile feedback by using tactile textiles is proposed.

Special Table 2012-511781A Gazette

However, Patent Document 1 has not proposed a method of reflecting the situation of a vibration event generated in a game in the vibration control of a wearer worn by a user. Further, if the vibrating part of the wearer always vibrates in the same vibration mode when a vibration event occurs, the user becomes accustomed to the vibration mode, and the improvement of the user's virtual reality is insufficient. found.

According to some aspects of the present invention, it is possible to provide a simulation system and a program capable of realizing vibration control of a vibrating portion of an attached body in various vibration modes reflecting the types and contents of vibration events.

One aspect of the present invention includes a game processing unit that performs game processing for a game in which a user wears a wearable body on a body and plays a game, and a control unit that controls the wearable body provided with a plurality of vibration units. The control unit is a simulation system that controls to change the number of vibration units to be vibrated or the vibration range which is the range of the vibration units to be vibrated according to the type or content of the vibration event generated in the game. Related to. The present invention also relates to a program that causes a computer to function as each of the above parts, or a computer-readable information storage medium that stores the program.

According to one aspect of the present invention, a game in which a user wears a wearable body on a body and plays the game is processed, and a plurality of vibrating portions provided on the wearable body are controlled. When a vibration event occurs in the game, control is performed to change the number of vibrating parts or the vibration range according to the type or content of the vibration event. Therefore, if the type and content of the vibration event are different, the number of vibrations and the vibration range of the vibration part will also change, and the vibration part of the mounting body in various vibration modes reflecting the type and content of the vibration event. Vibration control can be realized.

Further, in one aspect of the present invention, the vibration event is a hit event between the user or a user moving body corresponding to the user and a hit object, and the control unit determines the type or content of the hit event. , The number of the vibrating parts to be vibrated or the vibration range may be changed.

By doing so, for example, when a hit event occurs in which the hit object hits the user in the real space or the hit object hits the user moving object corresponding to the user in the virtual space, the generated hit event is generated. Depending on the type or content, the number of vibrations and the vibration range of the vibrating part will change, and vibration control of various vibration modes can be realized.

Further, in one aspect of the present invention, the control unit may perform control to change the number of vibration units to be vibrated or the vibration range according to the type of the hit object or the content of the attack.

In this way, when a hit event occurs in which the hit object hits the user or the user moving object, the number of vibrations and the vibration range of the vibrating portion change according to the type of the hit object and the attack content thereof. Therefore, vibration control that reflects the hit object can be realized.

Further, in one aspect of the present invention, the control unit has an attack content in which the type of the hit object is a type of hit object having a high attack capability, or the attack of the hit object has a high attack power. The larger the number, the larger the number of the vibrating portions to be vibrated, or the wider the vibration range may be.

In this way, if the hit object has a high attack capability or has a high attack content, the number of vibrations of the vibrating part will increase and the vibration range will be widened accordingly, so that the hit object will be hit. It is possible to realize vibration control that reflects the attack ability and attack content of.

Further, in one aspect of the present invention, the control unit vibrates the first vibrating unit among the plurality of vibrating units at the hit timing of the hit object, and a given time elapses from the hit timing. After that, the second vibrating portion around the first vibrating portion may be vibrated.

By doing so, it is possible to realize vibration control in which the vibration range expands from the first vibrating portion to its surroundings with the passage of time, and the number of vibrations of the vibrating portion increases with the passage of time.

Further, in one aspect of the present invention, the control unit vibrates the first vibrating unit among the plurality of vibrating units at the hit timing of the hit object, and then the first vibrating unit of the first vibrating unit. The surrounding second vibrating portion may be vibrated.

By doing so, it is possible to realize vibration control in which vibration is sequentially performed from the first vibrating portion to the second vibrating portion around the first vibrating portion.

Further, in one aspect of the present invention, the control unit may randomly select a vibration unit to vibrate from the plurality of vibration units when the vibration event occurs.

In this way, when a vibration event occurs, the vibrating portion randomly selected from the plurality of vibrating portions vibrates. Therefore, it is possible to prevent the user's body from becoming accustomed to vibration and to realize vibration control in various vibration modes.

Further, one aspect of the present invention includes a game processing unit that performs game processing for a game in which a user wears a wearable body on a body and plays a game, and a control unit that controls the wearable body provided with a plurality of vibration units. , The control unit relates to a simulation system that randomly selects a vibration unit to be vibrated from a plurality of the vibration units when the vibration event occurs. The present invention also relates to a program that causes a computer to function as each of the above parts, or a computer-readable information storage medium that stores the program.

According to one aspect of the present invention, a game in which a user wears a wearable body on a body and plays the game is processed, and a plurality of vibrating portions provided on the wearable body are controlled. Then, when a vibration event occurs in the game, a vibration unit randomly selected from a plurality of vibration units vibrates. Therefore, it is possible to prevent the occurrence of a situation in which the same vibrating portion always vibrates when a vibration event occurs and the user's body becomes accustomed to the vibration, and it is possible to realize vibration control in various vibration modes.

Further, in one aspect of the present invention, the control unit vibrates the first vibration unit among the plurality of vibration units when the vibration event occurs, and then when the vibration event occurs, the control unit vibrates. A second vibrating portion different from the first vibrating portion may be randomly selected and vibrated from the plurality of vibrating portions.

In this way, when the first vibrating part vibrates due to the occurrence of the vibration event and then the next vibration event occurs, the second vibrating part different from the first vibrating part is randomly selected and vibrates. Therefore, vibration control in various vibration modes can be realized.

Further, in one aspect of the present invention, the vibration event is a hit event between the user or a user moving body corresponding to the user and a hit object, and the game processing unit is the user or the user moving body and the user moving body. Hit calculation processing with the hit object is performed to obtain hit information including at least one of the hit direction and the hit position, and when the hit event occurs, the control unit has a plurality of hit information according to the hit information. The vibrating portion to be vibrated may be selected from the vibrating portions.

By doing so, when a hit event occurs, the vibrating portion corresponding to the hit information is selected and vibrates, so that vibration control that reflects the hit information can be realized.

Further, in one aspect of the present invention, at least one front side vibrating portion is provided on the front surface portion of the mounting body, and at least one rear surface side vibrating portion is provided on the rear surface portion of the mounting body. When the hit event occurs, the front side vibrating portion and the rear surface side vibrating portion are vibrated after vibrating one of the front side vibrating portion and the rear surface side vibrating portion based on the hit information. Vibration control may be performed to vibrate the other vibrating portion of the.

By doing so, when a hit event occurs, one vibrating portion of the front side vibrating portion and the rear side vibrating portion vibrates and then the other vibrating portion vibrates based on the hit information. Therefore, the user can experience the virtual reality as if the hit object penetrated the body, and the vibration control of the vibrating part of the wearer reflecting the hit information at the hit event can be realized. become.

Further, in one aspect of the present invention, a virtual space setting unit that performs virtual space setting processing, a moving body processing unit that performs movement processing of a user moving body that moves in the virtual space, and a game processing result are used. A display processing unit that generates an image to be displayed to the user may be included.

By doing so, the movement process of moving the user moving body in the virtual space is performed, and the game processing in which the user wears the wearing body on the body and plays the game is performed, and the display image is displayed based on the result of the game processing. Is generated. Then, when a vibration event occurs in the game, vibration control of the vibration part of the wearer according to the vibration event is performed, and vibration control in various vibration modes according to the game played in the virtual space is performed. It will be possible.

Further, in one aspect of the present invention, the display processing unit may generate a display image of a head-mounted display device worn by the user so as to cover the field of view.

When the user's view is covered by the head-mounted display device in this way, the vibration part of the user's wearer is vibrated to effectively improve the virtual reality in a vibration event or a hit event. become able to.

The block diagram which shows the configuration example of the simulation system of this embodiment. 2 (A) and 2 (B) are examples of the HMD used in this embodiment. 3 (A) and 3 (B) are other examples of the HMD used in this embodiment. Explanatory diagram of the field used in the simulation system. 5 (A) and 5 (B) are explanatory views of a user in real space and a moving body corresponding to the user. An example of a game image displayed on the HMD. An explanatory diagram of a game using a sword-shaped controller. An example of a game image displayed on the HMD. 9 (A) and 9 (B) are explanatory views of a jacket which is a mounting body provided with a plurality of vibrating portions. Configuration example of the vibrating part using a solenoid. 11 (A) and 11 (B) are explanatory views of the movement process of the user moving body in the virtual space according to the movement of the user in the real space. 12 (A) and 12 (B) are explanatory views of the vibration control method at the time of hitting a bullet. 13 (A) to 13 (C) are explanatory views of a vibration control method of a vibration unit according to the type of vibration event. 14 (A) to 14 (C) are explanatory views of a vibration control method of a vibration unit according to the content of a vibration event. 15 (A) to 15 (C) are explanatory views of a vibration control method of a vibrating portion according to the passage of time in a vibration event. 16 (A) to 16 (C) are explanatory views of a vibration control method in which a vibrating portion to be vibrated is randomly selected from a plurality of vibrating portions. 17 (A) and 17 (B) are explanatory views of a vibration control method of a vibrating portion according to hit information. 18 (A) and 18 (B) are explanatory views of a vibration control method of a vibrating portion according to hit information. 19 (A) and 19 (B) are explanatory views of a vibration control method of a vibrating portion according to hit information. 20 (A) to 20 (C) are explanatory diagrams of a vibration interval setting method according to the hit speed of hit information, the type of hit event, and the content. 21 (A) to 21 (D) are explanatory views of various examples of a hit event and a vibration event. Explanatory drawing of another example of the simulation system. The flowchart explaining the detailed processing example of this embodiment. The flowchart explaining the detailed processing example of this embodiment. The flowchart explaining the detailed processing example of this embodiment. The flowchart explaining the detailed processing example of this embodiment.

Hereinafter, this embodiment will be described. The embodiments described below do not unreasonably limit the content of the present invention described in the claims. Moreover, not all of the configurations described in the present embodiment are essential constituent requirements of the present invention.

1. 1. Simulation system FIG. 1 is a block diagram showing a configuration example of a simulation system (simulator, game system) of the present embodiment. The simulation system of this embodiment is, for example, a system that simulates virtual reality (VR), a game system that provides game content, a real-time simulation system such as a sports competition simulator or a driving simulator, a system that provides SNS services, and an image. It can be applied to various systems such as a content providing system that provides such contents or an operating system that realizes remote work. The simulation system of the present embodiment is not limited to the configuration shown in FIG. 1, and a part of its constituent elements (each part) (for example, a virtual space setting unit, a moving body processing unit, a virtual camera control unit, a display processing unit, etc.) may be used. Various modifications can be implemented, such as omitting or adding other components.

The wearing body 50 is worn by the user on the body. The body is, for example, a portion below the user's neck (torso, hips, legs, arms, etc.). The mounting body 50 is provided with a plurality of vibrating portions V1 to VN. The vibrating portions V1 to VN are attached to the mounting body 50 by a mounting tool.

The operation unit 160 is for the user (player) to input various operation information (input information). The operation unit 160 can be realized by various operation devices such as an operation button, a direction indicator key, a joystick, a handle, a pedal or a lever. The operation unit 160 can be realized by, for example, a controller such as a gun-type controller or a sword-type controller, which is a user's equipment.

The storage unit 170 stores various types of information. The storage unit 170 functions as a work area for the processing unit 100, the communication unit 196, and the like. The game program and game data necessary for executing the game program are stored in the storage unit 170. The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), an HDD (hard disk drive), an SSD, an optical disk device, or the like. The storage unit 170 includes an object information storage unit 172 and a drawing buffer 178.

The information storage medium 180 (a medium readable by a computer) stores programs, data, and the like, and its function can be realized by an optical disk (DVD, BD, CD), an HDD, a semiconductor memory (ROM), or the like. .. The processing unit 100 performs various processes of the present embodiment based on the program (data) stored in the information storage medium 180. That is, the information storage medium 180 is a program for making a computer (a device including an input device, a processing unit, a storage unit, and an output unit) function as each part of the present embodiment (a program for causing the computer to execute the processing of each part). Is remembered.

The HMD200 (head-mounted display device) is a device that is attached to the user's head and displays an image in front of the user's eyes. The HMD 200 is preferably a non-transparent type, but may be a transmissive type. Further, the HMD 200 may be a so-called glasses type HMD.

The HMD 200 includes a sensor unit 210, a display unit 220, and a processing unit 240. It is also possible to modify the HMD 200 by providing a light emitting element. The sensor unit 210 is for realizing tracking processing such as head tracking. For example, the position and direction of the HMD 200 are specified by the tracking process using the sensor unit 210. By specifying the position and direction of the HMD 200, the user's viewpoint position and line-of-sight direction (user's position and direction) can be specified.

Various methods can be adopted as the tracking method. In the first tracking method, which is an example of the tracking method, a plurality of light receiving elements (photodiodes and the like) are provided as the sensor unit 210 as described in detail in FIGS. 2 (A) and 2 (B) described later. Then, by receiving the light (laser, etc.) from the light emitting element (LED, etc.) provided outside by these multiple light receiving elements, the position of the HMD200 (user's head) in the three-dimensional space in the real world, Specify the direction. In the second tracking method, a plurality of light emitting elements (LEDs) are provided in the HMD 200 as described in detail in FIGS. 3 (A) and 3 (B) described later. Then, the position and direction of the HMD 200 are specified by capturing the light from these plurality of light emitting elements with an image pickup unit provided outside. In the third tracking method, a motion sensor is provided as the sensor unit 210, and the position and direction of the HMD 200 are specified using this motion sensor. The motion sensor can be realized by, for example, an acceleration sensor or a gyro sensor. For example, by using a 6-axis motion sensor using a 3-axis acceleration sensor and a 3-axis gyro sensor, the position and direction of the HMD200 in the three-dimensional space of the real world can be specified. The position and direction of the HMD 200 may be specified by a combination of the first tracking method and the second tracking method, or a combination of the first tracking method and the third tracking method. Further, instead of specifying the user's viewpoint position and line-of-sight direction by specifying the position and direction of the HMD 200, a tracking process that directly specifies the user's viewpoint position and line-of-sight direction (position, direction) may be adopted. ..

The display unit 220 of the HMD 200 can be realized by, for example, an organic EL display (OEL) or a liquid crystal display (LCD). For example, the display unit 220 of the HMD 200 is provided with a first display or a first display area set in front of the user's left eye and a second display or a second display area set in front of the right eye. It is possible to display stereoscopically. In the case of stereoscopic display, for example, an image for the left eye and an image for the right eye having different parallax are generated, the image for the left eye is displayed on the first display, and the image for the right eye is displayed on the second display. Alternatively, the image for the left eye is displayed in the first display area of one display, and the image for the right eye is displayed in the second display area. Further, the HMD 200 is provided with two eyepieces (fisheye lenses) for the left eye and the right eye, thereby expressing a VR space that extends over the entire circumference of the user's field of view. Then, a correction process for correcting the distortion generated in the optical system such as the eyepiece is performed on the image for the left eye and the image for the right eye. This correction process is performed by the display processing unit 120.

The processing unit 240 of the HMD 200 performs various processes necessary for the HMD 200. For example, the processing unit 240 performs control processing of the sensor unit 210, display control processing of the display unit 220, and the like. Further, the processing unit 240 may perform three-dimensional sound (stereophonic sound) processing to reproduce the three-dimensional sound direction, distance, and spread.

The sound output unit 192 outputs the sound generated by the present embodiment, and can be realized by, for example, a speaker or headphones.

The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and the function can be realized by an ASIC or the like for I / F processing. The portable information storage medium 195 is for the user to store various information, and is a storage device that retains the storage of such information even when the power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

The communication unit 196 (communication interface) communicates with an external device (other device) via a wired or wireless network, and its function is hardware such as a communication ASIC or a communication processor. , Can be realized by communication firmware.

The program (data) for operating the computer as each part of the present embodiment is distributed from the information storage medium of the server (host device) to the information storage medium 180 (or the storage unit 170) via the network and the communication unit 196. You may. The use of information storage media by such a server (host device) can also be included within the scope of the present invention.

The processing unit 100 (processor) can be used for operation information from the operation unit 160, tracking information in the HMD 200 (information on at least one of the position and direction of the HMD, information on at least one of the viewpoint position and the line-of-sight direction), a program, and the like. Based on this, game processing (simulation processing), virtual space setting processing, moving object processing, virtual camera control processing, display processing, sound processing, and the like are performed.

Each process (each function) of the present embodiment performed by each unit of the processing unit 100 can be realized by a processor (processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the functions of each part may be realized by individual hardware, or the functions of each part may be realized by integrated hardware. For example, the processor includes hardware, which hardware can include at least one of a circuit that processes a digital signal and a circuit that processes an analog signal. For example, the processor may be composed of one or more circuit devices (eg, ICs, etc.) mounted on a circuit board, or one or more circuit elements (eg, resistors, capacitors, etc.). The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) can be used. Further, the processor may be a hardware circuit by ASIC. Further, the processor may include an amplifier circuit, a filter circuit, and the like for processing an analog signal. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD), or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and when the instructions are executed by the processor, the processing (function) of each part of the processing unit 100 is realized. The instruction here may be an instruction set constituting the program, or may be an instruction instructing the hardware circuit of the processor to operate.

The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The arithmetic processing unit 110 includes an information acquisition unit 111, a virtual space setting unit 112, a moving body processing unit 113, a virtual camera control unit 114, a game processing unit 115, a control unit 118, a display processing unit 120, and a sound processing unit 130. As described above, each process of the present embodiment executed by each of these parts can be realized by a processor (or a processor and a memory). It is possible to carry out various modifications such as omitting a part of these components (each part) or adding other components.

The input processing unit 102 performs processing for receiving operation information and tracking information, processing for reading information from the storage unit 170, and processing for receiving information via the communication unit 196 as input processing. For example, the input processing unit 102 stores the operation information input by the user using the operation unit 160, the processing for acquiring the tracking information detected by the sensor unit 210 of the HMD 200, and the information specified by the read command in the storage unit 170. The process of reading from the computer and the process of receiving information from an external device (server, etc.) via the network are performed as input processes. Here, the reception process is a process of instructing the communication unit 196 to receive information, a process of acquiring the received information by the communication unit 196 and writing it to the storage unit 170, and the like.

The arithmetic processing unit 110 performs various arithmetic processing. For example, arithmetic processing such as information acquisition processing, virtual space setting processing, moving object processing, virtual camera control processing, game processing (simulation processing), control processing, display processing, or sound processing is performed.

The information acquisition unit 111 (program module for information acquisition processing) performs various information acquisition processing. For example, the information acquisition unit 111 acquires user information (user tracking information) including at least one of the user's position information, direction information, and posture information.

The virtual space setting unit 112 (program module for virtual space setting processing) performs setting processing for a virtual space (object space) in which a plurality of objects are arranged. For example, various display objects such as moving objects (people, robots, cars, trains, airplanes, ships, monsters or animals), maps (topography), buildings, spectator seats, courses (roads), trees, walls, water surfaces, etc. Performs a process of arranging and setting an object (an object composed of primitive surfaces such as polygons, free curved surfaces, or subdivision surfaces) in a virtual space. That is, the position and rotation angle (synonymous with direction and direction) of the object in the world coordinate system are determined, and the rotation angle (rotation angle around the X, Y, Z axis) is used at the position (X, Y, Z). Place the object. Specifically, in the object information storage unit 172 of the storage unit 170, object information which is information such as the position, rotation angle, movement speed, and movement direction of the object (part object) in the virtual space is associated with the object number. Is remembered. The virtual space setting unit 112 performs, for example, a process of updating this object information for each frame.

The moving body processing unit 113 (program module for moving body processing) performs various processing on the moving body moving in the virtual space. For example, it performs a process of moving a moving body in a virtual space (object space, a game space) and a process of operating a moving body. For example, the moving object processing unit 113 is based on the operation information input by the user by the operation unit 160, the tracking information acquired, the program (movement / motion algorithm), various data (motion data), and the like. Performs control processing to move a model object) in a virtual space or to move a moving object (motion, animation). Specifically, a simulation in which movement information (position, rotation angle, velocity, or acceleration) and motion information (position or rotation angle of a part object) of a moving body are sequentially obtained for each frame (for example, 1/60 second). Perform processing. A frame is a unit of time for performing movement / motion processing (simulation processing) and image generation processing of a moving object. The moving body is, for example, a virtual user (virtual player, avatar) in a virtual space corresponding to a user (player) in the real space, or a boarding moving body (operation moving body) on which the virtual user is boarded (operated).

The game processing unit 115 (game processing program module) performs various game processing for the user to play a game. In other words, the game processing unit 115 (simulation processing unit) executes various simulation processes for the user to experience virtual reality (virtual reality). The game process calculates, for example, a process of starting a game when the game start condition is satisfied, a process of advancing the started game, a process of ending the game when the game end condition is satisfied, or a game result. Processing etc. The game processing unit 115 includes a hit calculation processing unit 116. The hit calculation processing unit 116 executes a hit calculation process such as a hit determination process.

The control unit 118 (program module for control processing) performs control processing for a plurality of vibration units V1 to VN of the mounting body 50. The details of the control unit 118 will be described later.

The display processing unit 120 (display processing program module) performs display processing of a game image (simulation image). For example, drawing processing is performed based on the results of various processing (game processing, simulation processing) performed by the processing unit 100, and an image is generated by this, and is displayed on the display unit 220 of the HMD 200. Specifically, geometry processing such as coordinate conversion (world coordinate conversion, camera coordinate conversion), clipping processing, fluoroscopic conversion, or light source processing is performed, and drawing data (positions of vertices on the primitive surface) are performed based on the processing results. Coordinates, texture coordinates, color data, normal vector or α value, etc.) are created. Then, based on this drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after fluoroscopic transformation (after geometry processing) is subjected to image information in pixel units such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a memorable buffer). As a result, an image seen from a virtual camera (given viewpoint. First and second viewpoints for the left eye and the right eye) is generated in the object space (virtual space). The drawing process performed by the display processing unit 120 can be realized by a vertex shader process, a pixel shader process, or the like.

The sound processing unit 130 (sound processing program module) performs sound processing based on the results of various processing performed by the processing unit 100. Specifically, a game sound such as a musical piece (music, BGM), a sound effect, or a voice is generated, and the game sound is output to the sound output unit 192. A part of the sound processing of the sound processing unit 130 (for example, three-dimensional sound processing) may be realized by the processing unit 240 of the HMD 200.

The output processing unit 140 performs output processing of various information. For example, the output processing unit 140 performs a process of writing information to the storage unit 170 and a process of transmitting information via the communication unit 196 as an output process. For example, the output processing unit 140 performs a process of writing the information specified by the write command to the storage unit 170 and a process of transmitting the information to an external device (server or the like) via the network. The transmission process is a process of instructing the communication unit 196 to transmit information, instructing the communication unit 196 to transmit information, and the like.

The simulation system of the present embodiment includes a game processing unit 115 and a control unit 118 as shown in FIG.

The game processing unit 115 performs game processing for a game in which the user wears the wearing body 50 on the body and plays the game. The game processing unit 115 performs game processing such as a process of starting a game, a process of advancing a game, a process of ending a game, or a process of calculating a game result. For example, the game processing unit 115 can perform a process of determining whether or not a vibration event has occurred, a process of instructing the control unit 118 to control the vibration of the mounting body 50 when the vibration event occurs, and the like. For example, in a simulation system for displaying a game image to a user, the game processing unit 115 performs game processing for displaying the game image on the display unit 220. For example, processing a game in a virtual space. However, the simulation system of the present embodiment may be a system that does not display the game image to the user. In this case, the game processing unit 115 will, for example, calculate the game results of the user and perform various game control processes for starting, progressing, or ending the game.

Further, in the present embodiment, the wearable body 50 to be worn by the user on the body (body or the like) is provided with a plurality of vibrating portions V1 to VN. The wearing body 50 is worn by the user on a body (for example, a body below the neck). Specifically, it is a jacket (vest), a jacket such as a jumper, or clothing such as trousers, which will be described later. However, the wearing body may be something like armor in a sword game, or may be a body equipment in a nature experience game.

Then, the control unit 118 controls the vibration of the plurality of vibration units V1 to VN of the mounting body 50. For example, the game processing unit 115 performs game processing, and the control unit 118 performs vibration control of a plurality of vibration units V1 to VN of the mounting body 50 according to the game situation.

Specifically, the control unit 118 controls to change the number of vibrating parts or the vibration range which is the range of the vibrating parts according to the type or content of the vibration event generated in the game. For example, a vibration event when the hit object hits the user or a user moving object, a vibration event when the hit object is an object such as a rock, a vibration event when the hit object is an object such as a bullet, or an explosion. When the categories of vibration events are grouped, such as vibration events due to occurrence, the type of vibration event is which category the group belongs to. The content of the vibration event is represented by vibration event processing parameters such as a vibration intensity parameter, a vibration speed parameter, or a vibration attribute parameter. For example, even if the vibration events are of the same type (category group), if the parameters of the vibration event processing are different, the contents of the vibration event will be different.

The content of the vibration event may be the elapsed time in the vibration event. In this case, the parameter of the vibration event processing becomes the parameter of the elapsed time (for example, the elapsed time from the occurrence of the event) in the vibration event processing. Further, information on the type of vibration event and information representing the content of the vibration event (vibration processing parameter) are stored in the storage unit 170 in association with each vibration event, for example. The control unit 118 will perform vibration control processing of the vibration units V1 to VN of the mounting body 50 based on these information stored in the storage unit 170.

Then, the control unit 118 controls to change the number or the vibration range of the vibrating units to be vibrated according to the type or content of the vibration event. For example, when the type of the vibration event is the first type, or when the content of the vibration event is the first content, the first number of vibration units or the first vibration among the vibration units V1 to VN Controls to vibrate the vibrating part in the range. When the type of the vibration event is the second type, or when the content of the vibration event is the second content, the second number of vibration units or the second vibration among the vibration units V1 to VN Controls to vibrate the vibrating part in the range. For example, when a vibration event of a type or content that vibrates a small number of vibrating parts or vibrates a vibrating part in a narrow vibration range occurs, the control unit 118 has a small number of first vibrating parts or a narrow vibration part. Control is performed to vibrate the vibrating portion in the first vibration range. On the other hand, when a vibration event of a type or content that vibrates a large number of vibrating parts or vibrates a vibrating part having a wide vibration range occurs, the control unit 118 has a second number larger than that of the first number. Control is performed to vibrate the number of vibrating parts or the vibrating parts having a second vibrating range wider than the first vibrating range. For example, when a vibration event occurs that makes the user feel strong vibration or vibration in a wide area, the second number of vibration parts or the first vibration is larger than the first number. Control is performed to vibrate the vibrating portion of the second vibration range wider than the range. By doing so, it becomes possible to realize vibration control of the vibration portion of the mounting body 50 that reflects the type and content of the vibration event.

Further, the vibration event is, for example, a hit event between a user or a user moving body corresponding to the user and a hit object. In this case, the control unit 118 controls to change the number or the vibration range of the vibrating units to be vibrated according to the type or content of the hit event. For example, in a simulation system that does not display a game image to the user, the vibration event is a hit event between the user and the hit object in the real space. The hit object (object in real space) in this case may be, for example, a bullet fired by a gun or the like, or a light ray (infrared ray or the like). Alternatively, the hit object may be a weapon such as a sword, a spear, or a throwing stone, or an attacking object. On the other hand, in a simulation system that displays a game image to a user, a vibration event is a hit event between a user moving object and another object in a virtual space (game space). The user moving body is a moving body that moves in response to the user in a virtual space (game space), and is called, for example, a character or an avatar. The other object may be, for example, an object that imitates a bullet or a light beam fired by a gun or the like, or an object that imitates a weapon or an attacking object such as a sword, a spear, or a throwing stone. The object is, for example, a three-dimensional object in a three-dimensional image game, but may be a two-dimensional object in a two-dimensional image game. Further, the game processing unit 115 performs the hit determination processing between the user or the user moving body and the hit object. Specifically, the hit calculation processing unit 116 of the game processing unit 115 performs the operation.

Then, the control unit 118 controls to change the number or the vibration range of the vibrating units to be vibrated according to the type or content of the hit event. For example, hit event categories are grouped into pistol bullet hit events, rifle bullet hit events, bazooka bullet hit events, missile hit events, sword hit events, and so on. In this case, the type of hit event depends on which category the group belongs to. Further, the content of the hit event is represented by the parameters of the hit calculation process such as the hit strength parameter, the hit attack power parameter, the hit speed parameter, or the hit attribute parameter. For example, even for hit events (pistol, rifle, bazooka, missile, sword) of the same type (category group), if the parameters of the hit calculation process are different, the contents of the hit event will be different.

Then, the control unit 118 reduces the number of vibrations of the vibrating unit or narrows the vibration range in the event where the pistol bullet hits. The number of vibrations is the number of vibrating parts to be vibrated. On the other hand, in an event where a bazooka or a missile hits, the number of vibrations of the vibrating part is increased or the vibration range is widened. That is, the number of vibrations or the vibration range of the vibrating portion is changed according to the type of hit event. In a hit event where the hit strength parameter, attack power parameter, and speed parameter are low, the number of vibrations of the vibrating part is reduced or the vibration range is narrowed. On the other hand, in a hit event where the hit strength parameter, attack power parameter, and speed parameter are high, the number of vibrations of the vibrating part is increased or the vibration range is widened. That is, the number of vibrating parts or the vibration range to be vibrated is changed according to the content of the hit event.

Further, the control unit 118 controls to change the number of vibrating units or the vibration range to be vibrated according to the type of the hit object or the content of the attack. For example, the control unit 118 changes the number or vibration range of the vibrating unit to vibrate depending on whether the hit object is a pistol bullet, a rifle bullet, a bazooka bullet, or a missile. Further, the control unit 118 vibrates the number of vibrating units or the number of vibrating units depending on whether the attack content is a weak attack power attack, a medium attack power attack, or a strong attack power attack. Change the vibration range. By doing so, it becomes possible to realize vibration control of the vibrating portion of the mounting body 50 that reflects the type of the hit object and the content of the attack.

For example, the control unit 118 vibrates as the type of the hit object is the type of the hit object having a high attack ability, or the attack of the hit object is the attack content having a high attack power. Increase the number or widen the vibration range. For example, in the case of a hit object such as a bazooka or a missile having a high attack capability, the number of vibrations of the vibrating part is increased or the vibration range is widened. Alternatively, even if the hit object is the same, if the attack by the hit object has a high attack power, the number of vibrations of the vibrating portion is increased or the vibration range is widened. For example, when the hit strength parameter, the attack force parameter, or the hit speed parameter is high, the number of vibrations of the vibrating portion is increased or the vibration range is widened. By doing this, a larger number of vibrating parts will vibrate, and the vibrating parts will vibrate in a wider vibration range. It is possible to let the user experience a virtual experience that the hit object is hit by the content, and it is possible to improve the virtual reality of the user.

Further, the control unit 118 vibrates the first vibrating unit among the plurality of vibrating units V1 to VN at the hit timing of the hit object, and after a given time has elapsed from the hit timing, the first vibrating unit The second vibrating part around the is vibrated. By doing so, after a given time elapses after the first vibrating portion vibrates, the second vibrating portion and the like around the vibrating portion will vibrate. This enables vibration control in which the vibration range expands with the passage of time from the first vibrating portion to its surroundings. For example, it becomes possible to control the vibration so that the number of vibrations of the vibrating part increases with the passage of time. The number of the first vibrating part may be one or a plurality, and the number of the second vibrating parts around the first vibrating part may be one or a plurality. There may be. Further, the periphery of the first vibrating portion may be the periphery of the first vibrating portion in the upward direction, the downward direction, the left direction, the right direction, or the like, or may be the circumference in at least one of these directions. May be good. In addition, the passage of time can be timed by counting processing using a timer.

Further, the control unit 118 vibrates the first vibrating unit among the plurality of vibrating units V1 to VN at the hit timing of the hit object, and then vibrates the second vibrating unit around the first vibrating unit. Vibrate. That is, after vibrating the first vibrating portion, the second vibrating portion around the first vibrating portion is vibrated in the following order. For example, only the order of the vibrating parts to be vibrated is set and the vibrating parts are vibrated in the set order without performing the time-lapse timekeeping processing by the counting processing using the timer. By doing so, it is possible to control the vibration so that the vibration range expands from the first vibrating part to the surroundings, and the number of vibrating parts increases with the passage of time. become. Also in this case, the number of the first and second vibrating portions may be one or a plurality, and the periphery of the first vibrating portion is upward and downward of the first vibrating portion. It may be around in at least one direction, a direction, a left direction, and a right direction.

Further, the simulation system of the present embodiment controls the game processing unit 115 that performs game processing for a game in which the user wears the wearable body on the body and plays the game, and the wearable body 50 provided with a plurality of vibration units V1 to VN. The control unit 118 randomly selects a vibration unit to be vibrated from a plurality of vibration units V1 to VN when a vibration event occurs. For example, a vibrating unit that generates random number information and vibrates from a plurality of vibrating units V1 to VN is selected based on the random number information and the like. Random selection of vibrating parts is a selection process that prevents the same vibrating parts from being selected. For example, in random selection, when a vibration event occurs, a vibration unit different from the previous one is vibrated in order to prevent the user's body from becoming accustomed to the vibration. For example, when the first vibrating portion vibrates due to a vibration event and then a vibration event of the same type or content occurs, the second vibrating portion different from the first vibrating portion is vibrated. The selection of the vibrating part to be vibrated does not have to be a completely random selection, but may be random to some extent.

For example, the control unit 118 vibrates the first vibration unit among the plurality of vibration units V1 to VN when a vibration event occurs. Then, when a vibration event occurs next, a second vibrating portion different from the first vibrating portion among the plurality of vibrating portions V1 to VN is randomly selected and vibrated. That is, when a vibration event occurs to vibrate the first vibrating portion and then a vibration event of the same type or content occurs, a second vibrating portion different from the first vibrating portion is generated. Random selection of the vibrating part is performed so that it is selected. By doing so, even if the vibration event has the same type or content, different vibration portions will vibrate according to the timing of occurrence or the like. This makes it possible to prevent the user's body from becoming accustomed to the vibration and reducing the virtual reality realized by the vibration of the vibrating portion.

Here, the vibration event is a hit event between the user or the user moving body corresponding to the user and the hit object. Then, the game processing unit 115 performs hit calculation processing between the user or the user moving body and the hit object, and obtains hit information including at least one of the hit direction and the hit position. For example, the hit calculation processing unit 116 performs hit calculation processing to obtain hit information. Then, when a hit event occurs, the control unit 118 selects a vibrating unit to vibrate from the plurality of vibrating units V1 to VN according to the hit information. Then, the number or vibration range of the vibrating parts to be vibrated is changed according to the type or content of the vibration event. For example, the control unit 118 selects the first vibration unit based on the hit information, and the first vibration unit changes the number or vibration range of the vibration units to be vibrated according to the type or content of the vibration event. Select a second vibrating part around. Further, the control unit 118 selects a candidate for a vibrating unit to vibrate based on the hit information. Then, for example, the vibrating part to be vibrated is randomly selected from, for example, the candidate vibrating parts. The selection from the candidates for the vibrating portion may be the selection for the first vibrating portion or the selection for the second vibrating portion to be vibrated next to the first vibrating portion.

For example, the game processing unit 115 performs hit calculation processing between a user or a user moving body and a hit object. Then, the hit information including at least one of the hit direction and the hit position is obtained by the hit calculation process. This hit calculation process is executed by the hit calculation processing unit 116. The hit object may be a hit object (bullet, ray, etc.) in real space. Alternatively, the hit object may be an object displayed in the virtual space, or may be a virtual object hidden in the virtual space. The hit object may be a hit object for attack such as a bullet or a sword, or may be a hit object such as a rock fall in a nature experience simulation. Further, the hit object may be an obstacle arranged in the real space, an arrangement such as a wall, or an arrangement object such as an obstacle or a wall arranged in the virtual space.

Further, the hit direction (hit vector, attack direction, attack vector) is, for example, the movement direction of the hit object when the hit object (another object) hits the user or the user moving object. For example, the hit direction can be specified based on the trajectory of the hit object flying toward the user or the user moving object. The hit position is a position (hit position, collision position) at which the hit object hits the user or the user moving object. For example, the hit position can be specified based on the intersection position in the intersection determination process in the hit determination process. In addition to the hit direction and hit position, the hit information can include information such as a hit speed, a hit strength, or a hit attribute.

Then, when a hit event occurs between the user or the user moving body and the hit object, the control unit 118 controls the vibration of the vibrating unit of the mounting body 50 based on the hit information. That is, the game processing unit 115 (hit calculation processing unit 116) obtains hit information including at least one of the hit direction and the hit position of the hit object, and the control unit 118 vibrates the mounting body 50 based on this hit information. Controls the vibration of the unit. For example, a vibrating part (candidate for a vibrating part, etc.) to be vibrated is determined from a plurality of vibrating parts V1 to VN according to the hit information. By doing so, it becomes possible to realize vibration control that reflects the hit information (hit direction, hit position, etc.) in the hit calculation process.

The hit information may be obtained after the hit event has occurred, and vibration control may be performed based on the obtained hit information. Alternatively, hit information (predicted hit information) is obtained in advance before a hit event occurs, and when a hit event occurs, vibration is performed based on the hit information (predicted hit information) obtained in advance. Control may be performed.

Further, in the present embodiment, at least one front side vibrating portion is provided on the front surface portion of the mounting body 50, and at least one rear surface side vibrating portion is provided on the rear surface portion of the mounting body 50. The front surface portion is, for example, the front side of the user who wears the wearing body 50, and the rear surface portion is, for example, the back side of the user who wears the mounting body 50.

Then, when a hit event occurs, the control unit 118 vibrates one of the front side vibrating part and the rear side vibrating part based on the hit information, and then the front side vibrating part and the rear side vibrating part. Vibration control is performed to vibrate the other vibrating part.

Specifically, when the control unit 118 determines that the hit object has hit the front portion of the user or the user moving body (mounting body) based on the hit information, the control unit 118 vibrates the front side vibrating portion. After the period of the given vibration interval elapses, the rear side vibrating part is vibrated. On the other hand, when the control unit 118 determines that the hit object has hit the rear surface portion of the user or the user moving body (wearing body) based on the hit information, the control unit 118 vibrates the rear surface side vibrating unit to give a given object. After the period of the vibration interval elapses, the front side vibrating part is vibrated. In this way, it is possible to give the user a virtual reality feeling as if other objects such as bullets and swords penetrated the user's body.

Further, as shown in FIG. 1, the simulation system of the present embodiment can further include a virtual space setting unit 112 and a moving body processing unit 113.

The virtual space setting unit 112 performs a virtual space setting process. For example, a process of arranging and setting a moving object, an obstacle, a background, or a map object in a virtual space is performed. For example, when the user's position information and direction information in real space are acquired, the position and direction of the user moving body (user character, etc.) corresponding to the user are set based on the acquired position information and direction information. Then, the process of arranging in the virtual space is performed. Information such as the position and direction of the user moving object, which is an object, is stored in, for example, the object information storage unit 172. The user moving object is, for example, an object (display object) that moves in a virtual space (object space) following the movement of the user in the real space. Examples of the user moving body include an avatar moving body (user character, virtual user) corresponding to the user, a boarding moving body on which the avatar moving body is boarded, an outer shell moving body worn by the avatar moving body, and the like. The outer shell moving body is arranged so as to overlap the avatar moving body (ghost) and moves in the virtual space. The outer shell moving body is a moving body including an avatar moving body, and is expressed as a user's artificial body.

When the HMD200 is not used as the display unit on which the image based on the game processing is displayed, the user moving body moves in the game space (virtual space) based on the operation information from the operation unit 160. May be good. For example, a user in the real world operates the operation unit 160 while looking at an image of the display unit to play a game. Then, the user moving body moves in the game space according to the operation of the operation unit 160.

The moving body processing unit 113 performs moving processing of the user moving body moving in the virtual space. For example, the moving body processing unit 113 bases the user moving body (avatar moving body, boarding moving body, outer shell moving body) corresponding to the user based on the user information (position information, direction information) acquired by the information acquisition unit 111. Then, the process of moving in the virtual space is performed. For example, the user moving body is moved in the virtual space so as to follow the movement of the user in the real space. For example, the position of the user moving body is updated for each frame based on the moving speed and the moving acceleration of the user moving body, and the user moving body is moved in the virtual space (virtual field). Further, the moving body processing unit 113 performs a process of operating the user moving body based on the user information (posture information) acquired by the information acquisition unit 111. For example, based on the motion data, motion processing for changing the posture of the user moving body or the like is performed.

The display processing unit 120 generates a display image based on the result of the game processing. For example, a display image of the HMD 200 worn by the user is generated. For example, an image seen from a virtual camera in a virtual space is generated as a display image. For example, the virtual camera control unit 114 performs control processing of the virtual camera corresponding to the user's viewpoint. For example, the virtual camera control unit 114 controls the virtual camera set as the user's first-person viewpoint. For example, by setting a virtual camera at a position corresponding to the viewpoint of a moving object (virtual player, etc.) moving in a virtual space, and setting the viewpoint position and line-of-sight direction of the virtual camera, the position (position coordinates) of the virtual camera can be set. And posture (rotation angle around the axis of rotation). Then, the display processing unit 120 generates an image that can be seen from a virtual camera (user's viewpoint) in the virtual space as a display image (display image) of the HMD 200 or the like. For example, it generates an image that can be seen from a given viewpoint in an object space that is a virtual space. The generated image is, for example, an image for stereoscopic viewing.

In the above, the case where the vibration event is a hit event between the user or the user moving object and the hit object (another object) has been described, but the present embodiment is not limited to this, and the vibration event is a hit event. It may be an event other than. The vibration event is not only an event in which the hit object hits the user or the user moving body, but also an explosion event occurring at a place away from the user or the user moving body, and a physical condition of the user or the user moving body (for example, trembling). Various events such as events that occur from (such as the destruction of the body) can be assumed.

Further, in the present embodiment, the display processing unit 120 generates a display image of the HMD 200 that the user wears so as to cover the field of view. As described above, when the user wears the HMD 200 so as to cover the field of view, a sensory device that vibrates the vibrating portion of the wearer is effective for improving the virtual reality of the user.

However, the display processing unit 120 may generate a display image of a display unit other than the HMD 200. For example, a display image of a display unit such as a television in a home-use game device, a monitor display in a personal computer or an arcade game machine may be generated.

Further, the control unit 118 performs an effect process according to the vibration control of the mounting body 50. For example, in conjunction with the vibration control of the vibrating portion of the mounting body 50, the effect sound effect processing of the game sound is performed, or the effect image generation process of the game image is performed. For example, a sound effect is output or an effect image is displayed according to the number of vibrating parts to be vibrated, the range of vibrating parts to be vibrated, or the timing of vibration. For example, the larger the number of vibrating portions or the wider the range of vibrating portions, the louder the volume of the sound effect output due to the vibration, or the higher the staging effect is displayed. Further, when the first vibrating portion is vibrated at the first timing and then the second vibrating portion is vibrated at the second timing, the corresponding sound effects are output at these first and second timings. Or display a sound effect image. For example, a sound effect and an effect image are associated with each vibration control of the vibration unit and stored in the storage unit 170, and the control unit 118 outputs a sound effect associated with each vibration control or an effect image. To control the display of. By doing so, it becomes possible to output a sound effect linked to the vibration control of the vibrating portion and display a staging image, and it becomes possible to realize a vibration control having a higher staging effect.

Further, in the present embodiment, the information acquisition unit 111 acquires user information including at least one of position information, direction information, and posture information of a user who wears the HMD 200 so as to cover the field of view, for example. For example, the information acquisition unit 111 acquires user information (user tracking information) including at least one of the user's position information, direction information, and posture information in the real space based on the tracking information of the HMD 200 and the like. The position information may be the position information of the user's viewpoint in the real space, and the direction information may be the direction information of the user's line of sight in the real space. When the user is located in a field (play field, simulation field, play area) in the real space (real world), the position information and the direction information are the position information and the direction information (with the given position as the origin) in the field. It may be the position coordinates in the coordinate system to be used, the rotation angle around each coordinate axis). Posture information is information for specifying each posture of the user (standing posture, crouching posture, sitting posture, etc.), or specifying the position and direction of each part (torso, head, hands, feet, etc.) of the user. be. For example, the information acquisition unit 111 may acquire the position information and direction information of the HMD 200 as the position information and direction information of the user who wears the HMD 200.

Further, the virtual camera control unit 114 controls the virtual camera so as to follow the change in the viewpoint of the user based on the tracking information of the viewpoint information of the user.

For example, the input processing unit 102 (input receiving unit) acquires tracking information of the viewpoint information of the user who wears the HMD 200. For example, the tracking information (viewpoint tracking information) of the viewpoint information which is at least one of the viewpoint position and the line-of-sight direction of the user is acquired. This tracking information can be acquired, for example, by performing tracking processing of the HMD200. It should be noted that the user's viewpoint position and line-of-sight direction may be directly acquired by the tracking process. As an example, the tracking information includes change information of the viewpoint position from the initial viewpoint position of the user (change value of the coordinates of the viewpoint position) and change information of the line-of-sight direction from the initial line-of-sight direction of the user (rotation axis in the line-of-sight direction). It can include at least one of (changes in rotation angle around). The user's viewpoint position and line-of-sight direction (information on the position of the user's head and posture) can be specified based on the change information of the viewpoint information included in such tracking information.

Then, the virtual camera control unit 114 changes the viewpoint position and the line-of-sight direction of the virtual camera based on the acquired tracking information (information on at least one of the user's viewpoint position and the line-of-sight direction). For example, the virtual camera control unit 114 virtually changes the viewpoint position and the line-of-sight direction (position, posture) of the virtual camera in the virtual space according to the change in the viewpoint position and the line-of-sight direction of the user in the real space. Set the camera. By doing so, it is possible to control the virtual camera so as to follow the change in the viewpoint of the user based on the tracking information of the viewpoint information of the user.

Further, in the present embodiment, virtual reality simulation processing is performed as game processing of the game played by the user. The virtual reality simulation process is a simulation process for simulating an event in a real space in a virtual space, and is a process for allowing a user to experience the event virtually. For example, a process for moving a user moving body such as an avatar moving body (virtual user) corresponding to a user in the real space or a boarding moving body in the virtual space, and for the user to experience changes in the environment and surroundings due to the movement. I do.

The processing of the simulation system of the present embodiment of FIG. 1 can be realized by a processing device such as a PC installed in a facility, a processing device worn by a user, or distributed processing of these processing devices. Alternatively, the processing of the simulation system of the present embodiment may be realized by the server system and the terminal device. For example, it may be realized by distributed processing of a server system and a terminal device.

2. 2. Tracking process Next, an example of tracking process will be described. FIG. 2A shows an example of the HMD200 used in the simulation system of the present embodiment. As shown in FIG. 2A, the HMD 200 is provided with a plurality of light receiving elements 201, 202, 203 (photodiodes). The light receiving elements 201 and 202 are provided on the front surface of the HMD 200, and the light receiving elements 203 are provided on the left side surface of the HMD 200. Further, a light receiving element (not shown) is also provided on the right side surface, the upper surface, and the like of the HMD.

Further, the user US possesses a gun-type controller 290 that imitates a gun in the real world, and the gun-type controller 290 is also provided with light receiving elements 204 and 205 (photodiodes). By using these light receiving elements 204 and 205, the position and direction of the gun type controller 290 can be specified. Further, the gun type controller 290 is provided with a switch for triggering a gun, and by operating this switch, a moving body in a virtual space fires a gun. The gun type controller 290 may be provided with at least one light receiving element.

Further, the HMD200 is provided with a headband 260 and the like so that the user US can stably attach the HMD200 to the head with a better wearing feeling. Further, the HMD 200 is provided with a headphone terminal (not shown), and by connecting the headphone 270 (sound output unit 192) to the headphone terminal, for example, 3D sound (3D audio) processing is performed. The user US can listen to the game sound. It should be noted that the operation information of the user US may be input by detecting the nodding motion and the swinging motion of the head of the user US by the sensor unit 210 or the like of the HMD 200.

The user US also wears the processing device 250, for example, on his back. For example, the user US wears a jacket (vest), and a processing device 250 is attached to the back side of the jacket. The processing device 250 is realized by an information processing device such as a notebook PC. The processing device 250 and the HMD 200 are connected by a cable 252. For example, the processing device 250 performs a generation process of an image (game image or the like) displayed on the HMD 200, and the data of the generated image is sent to the HMD 200 via the cable 252 and displayed on the HMD 200. In addition to such image generation processing, the processing device 250 has each processing (information acquisition processing, virtual space setting processing, moving object processing, virtual camera control processing, game processing, control processing, display processing) of the present embodiment. Or sound processing, etc.) can be performed. Even if each process of the present embodiment is realized by a processing device (not shown) such as a PC installed in the facility, or by distributed processing of the processing device and the processing device 250 mounted by the user US. good.

As shown in FIG. 2B, base stations 280 and 284 are installed around the user US. The base station 280 is provided with light emitting elements 281 and 282, and the base station 284 is provided with light emitting elements 285 and 286. The light emitting elements 281, 282, 285, and 286 are realized by, for example, an LED that emits a laser (infrared laser or the like). The base stations 280 and 284 use these light emitting elements 281, 282, 285, and 286 to emit, for example, a laser radially. Then, the light receiving elements 201 to 203 and the like provided in the HMD200 of FIG. 2A receive the laser from the base stations 280 and 284, thereby realizing the tracking of the HMD200, and the position and the direction of the head of the user US. (Viewpoint position, line-of-sight direction) can be detected. Further, the light receiving elements 204 and 205 provided in the gun type controller 290 can detect at least one of the position and the direction of the gun type controller 290 by receiving the laser from the base stations 280 and 284.

FIG. 3A shows another example of the HMD200. In FIG. 3A, a plurality of light emitting elements 231 to 236 are provided for the HMD 200. These light emitting elements 231 to 236 are realized by, for example, LEDs. The light emitting elements 231 to 234 are provided on the front surface of the HMD 200, and the light emitting element 235 and the light emitting element 236 (not shown) are provided on the back surface side. These light emitting elements 231 to 236 emit (emit) light in the visible light band, for example. Specifically, the light emitting elements 231 to 236 emit light of different colors from each other. Further, the gun type controller 290 owned by the user US is also provided with light emitting elements 237 and 238 (LED). The gun type controller 290 may be provided with at least one light emitting element.

Then, the image pickup unit 150 shown in FIG. 3B is installed at at least one place around the user US (for example, the front side or the front side and the rear side), and the light emitting element 231 of the HMD 200 is provided by the image pickup unit 150. The light of ~ 236 is imaged. That is, the spot light of these light emitting elements 231 to 236 is reflected in the image captured by the image pickup unit 150. Then, by performing image processing of this captured image, tracking of the head (HMD) of the user US is realized. That is, the three-dimensional position and the facing direction (viewpoint position, line-of-sight direction) of the head of the user US are detected.

For example, as shown in FIG. 3B, the image pickup unit 150 is provided with the first and second cameras 151 and 152, and the first and second cameras 151 and 152 of these first and second cameras 151 and 152 are provided. By using the captured image, the position of the head of the user US in the depth direction and the like can be detected. Further, the rotation angle (line of sight) of the head of the user US can be detected based on the motion detection information of the motion sensor provided in the HMD 200. Therefore, by using such an HMD200, no matter which direction the user US faces in all directions of 360 degrees around it, an image (of the user) in the corresponding virtual space (virtual three-dimensional space) is used. The image seen from the virtual camera corresponding to the viewpoint) can be displayed on the display unit 220 of the HMD 200.

Further, the image pickup unit 150 captures the light of the light emitting elements 237 and 238 of the gun type controller 290. That is, the spot light of the light emitting element 237 and 238 is reflected in the image captured by the image pickup unit 150, and by performing the image processing of this image, at least the position and direction of the gun type controller 290 are as in the case of the HMD 200. One can be detected.

Infrared LEDs may be used as the light emitting elements 231 to 238 instead of visible light. Further, the position and movement of the user's head may be detected by another method such as using a depth camera or the like.

Further, the tracking processing method for detecting the user's viewpoint position and line-of-sight direction (user's position and direction) is not limited to the methods described in FIGS. 2A to 3B. For example, the tracking process may be realized by the HMD 200 alone by using a motion sensor or the like provided in the HMD 200. That is, the tracking process is realized without providing an external device such as the base station 280 and 284 of FIG. 2 (B) and the image pickup unit 150 of FIG. 3 (B). Alternatively, viewpoint information such as the user's viewpoint position and line-of-sight direction may be detected by various viewpoint tracking methods such as known eye tracking, face tracking, or head tracking. Further, the position and direction of the gun type controller 290 may be detected by using the motion sensor provided in the gun type controller 290.

Further, in FIGS. 2A and 3A, the user US wears the jacket 52, which is an example of the wearing body 50 of FIG. 1, on the body. As shown in FIGS. 9 (A) and 9 (B) described later, the jacket 52 (mounted body in a broad sense) is provided with a plurality of vibrating portions (VF1 to VF9, VB1 to VB9).

3. 3. The method of the present embodiment Next, the method of the present embodiment will be described in detail. In the following, the case where the method of this embodiment is applied to a battle game will be mainly described as an example. However, this embodiment is not limited to this, and various games (RPG, action game, competition game, sports game, horror experience game, vehicle simulation game such as train and airplane, puzzle game, communication game, or music game. Etc.), and can be applied to other than games. Further, in the following, the case where the method of the present embodiment is applied to the simulation system in which the game image is displayed on the HMD will be mainly described as an example, but for the simulation system in which the game image is displayed on the display unit other than the HMD. The method of this embodiment is applicable. Further, as shown in FIG. 22 described later, the method of the present embodiment can be applied to a simulation system of a type that does not display a game image to a user. For example, in the following, a case where a hit object hits a user moving object in a virtual space (game space) will be described, but as shown in FIG. 22, a hit object such as a bullet hits a user in the real space. The method of this embodiment can be applied to such a game. Further, in the following, the case where the user moving body is a user's avatar moving body (virtual user, user character) will be described as an example, but the user moving body is a boarding moving body (for example, a robot, a tank, a battle) on which the user is boarded. It may be a machine, a car, etc.).

3.1 Description of the game First, the game realized by the present embodiment will be described. 4 to 6 are explanatory views of a gun shooting game (FPS game) realized by the present embodiment.

FIG. 4 is an explanatory diagram of a field used in the simulation system of the present embodiment. In this simulation system, a field FL (play field, play area, play space) is prepared in a facility or the like in the real world, and users US1 to US4 move in this field FL. The field FL is provided with a partition WL realized by a wall or the like.

Users US1 to US4 are equipped with HMD1 to HMD4 and possess gun-type controllers GN1 to GN4 (controllers in a broad sense). Further, the users US1 to US4 are equipped with a processing device 250 (not shown) as described with reference to FIG. 2A, for example, on their backs. These users US1 to US4 form a team (group in a broad sense) for, for example, a team battle game. An image in a virtual space is projected on HMD1 to HMD4, and users US1 to US4 play a game such as a battle game while watching this image. For example, when the HMD1 to HMD4 are opaque HMDs, the field of view of the users US1 to US4 is covered by the HMD1 to HMD4, which makes it difficult to see the state of the real world. For this reason, there arises a problem that, for example, the user US2 located behind the user US1 collides with the user US1.

Prior to the start of gameplay, the user selects a user moving object (avatar) to be his or her alter ego. For example, FIG. 5A shows users US1 and US2 in real space (real world), and users US1 and US2 are equipped with HMD1 and HMD2 and possess gun type controllers GN1 and GN2.

Further, the users US1 and US2 wear a jacket 52 (wearing body) as shown in FIGS. 9A and 9B described later on their bodies.

On the other hand, in the virtual space, the user moving bodies MV1 and MV2, which are the alter ego of the users US1 and US2, appear. These user moving objects MV1 and MV2 are equipped with equipment and clothes of the character of the game. For example, it is equipped with an outer shell moving body called a prosthetic body. Further, the user moving objects MV1 and MV2 possess guns GV1 and GV2 (gun displays) corresponding to the gun type controllers GN1 and GN2 in the real space. When the users US1 and US2 in the real space move the gun type controllers GN1 and GN2 up and down and left and right, the user moving bodies MV1 and MV2 in the virtual space (virtual world) move the guns GV1 and GV2 up and down and left and right.

FIG. 6 is an example of a game image generated by this embodiment. This game image is displayed on the HMD worn by each user. For example, FIG. 6 is an example of a game image displayed on the HMD1 of the user US1 of FIG. 5A, and the hand of the user mobile body MV1 of the user US1 and the gun GV1 (gun object) possessed by the user US1 are displayed. Further, the user moving bodies MV2 and MV3 corresponding to the users US2 and US3 of the ally team and the enemy moving bodies MB1, MB2 and MB3 corresponding to the users of the enemy team are displayed. The user mobile bodies MV1, MV2, MV3 of the ally team attack the enemy side with the possessed guns GV1, GV2, GV3, and the enemy mobile bodies MB1, MB2, MB3 of the enemy team possess the guns GB1, GB2. , Attack with GB3.

7 and 8 are explanatory views of the sword game realized by the present embodiment. As shown in FIG. 7, the user US wears the HMD 200 so as to cover the field of view. Then, for example, the sword-shaped controller 10 is held in the right hand and the controller 80 is held in the left hand. Specifically, the user US holds the sword-shaped controller 10 like a sword by holding the grip portion 20 (handle) with the right hand.

The sword-shaped controller 10 is provided with a generation mechanism 30 that generates at least one of recoil and vibration between the tip portion and the grip portion 20. Further, a generation mechanism 60 for generating vibration is provided between the rear end portion and the grip portion 20. Further, a controller 70 for detecting the position information and the posture information of the sword-shaped controller 10 is attached to the tip of the sword-shaped controller 10.

The generation mechanism 30 includes a weight 32 and a receiving portion 34. Then, the generation mechanism 30 generates a reaction (reaction force) by colliding the weight 32 with the receiving portion 34. In addition, vibration can be generated along with the occurrence of this reaction. Reaction is, for example, being pushed back by the reaction when another force or action is applied. For example, in the present embodiment, the user holds the sword-shaped controller 10 in a real space and swings it with a sword. Then, in the virtual space, when the object of the sword corresponding to the sword hits another object such as an enemy moving object, a virtual recoil about the hit is realized by the generation mechanism 30. For example, the generation mechanism 30 generates a reaction that the user can feel as if a reaction force in the direction opposite to the direction in which the sword hits is applied. As a result, the user can feel as if the reaction force was generated, and the virtual reaction generated by the hit of the sword can be realized.

The generation mechanism 60 that generates vibration has a transducer, and vibration by the generation mechanism 60 is generated with a time delay from the generation of the reaction of the generation mechanism 30. Further, the position information and the posture information of the sword-shaped controller 10 and the controller 80 are acquired by the tracking process described with reference to FIGS. 2 (A) to 3 (B) and the like. Further, the user US wears a jacket 52 (wearing body) as described with reference to FIGS. 9 (A) and 9 (B) described later on the body.

FIG. 8 is an example of a displayed game image of the HMD200. Objects such as the enemy moving object OBE (enemy character), the sword SWE, the shield SLE, and the background of the enemy moving object OBE are displayed in the game image. In addition, objects such as the right hand HR and left hand HL of the user moving object (user character, avatar) corresponding to the user US, the sword SW of the right hand HR, and the shield SL of the left hand HL are also displayed. Has been done.

For example, when the user US moves the sword-shaped controller 10 held by the right hand in the real space of FIG. 7, the right hand HR and the sword SW in the virtual space of FIG. 8 also move in conjunction with the movement. Become. Further, when the user US moves the controller 80 held by the left hand in the real space of FIG. 7, the left hand HL and the shield SL in the virtual space of FIG. 8 also move in conjunction with the movement. That is, the sword-shaped controller 10 in the real space corresponds to the sword SW in the virtual space, and the controller 80 in the real space corresponds to the shield SL in the virtual space.

FIG. 8 is a game image from a first-person viewpoint, and an image from the viewpoint of a user moving body (user character) in a virtual space corresponding to a user US in the real space is displayed. In reality, the HMD 200 displays an image of the VR space that extends over the entire circumference of the field of view to the user US.

3.2 Vibration jacket, vibration unit In the simulation system of the present embodiment, the user wears the wearing body 50 on the body and plays a game. In FIGS. 5A and 7, the jacket 52 is worn as the wearing body 50. In the following, the case where the wearing body 50 is the jacket 52 will be described as an example, but the wearing body 50 is not limited to the jacket 52, and the wearing body 50 is not limited to the jacket 52, and is a jacket such as a jumper other than the jacket, trousers, armor, or. Various body wears such as belts to be worn on the chest, waist, arms, etc. can be considered.

The jacket 52 is provided with a plurality of vibrating portions. In FIG. 9A, the vibrating portions VF1 to VF9 are provided as the front side vibrating portion of the jacket 52, and the vibrating portions VB1 to VB9 are provided as the rear surface side vibrating portion. The number of vibrating parts is arbitrary. For example, 1 to 8 or 10 or more vibrating parts are provided as the front side vibrating part, or 1 to 8 or 10 or more vibrating parts are provided as the rear side vibrating part. May be good. Further, a plurality of vibrating portions may be provided only on one of the front surface portion and the rear surface portion of the jacket 52, or one or a plurality of vibrating portions may be provided on the side surfaces such as the right side surface and the left side surface of the jacket 52. Further, in FIGS. 9 (A) and 9 (B), a plurality of vibrating portions are arranged in a grid pattern, but the arrangement mode of the vibrating portions is not limited to this, and the arrangement is not a grid pattern but a two-dimensional matrix. And various arrangement modes such as one-dimensional matrix arrangement can be assumed.

FIG. 10 is an example of the realized configuration of the vibrating unit (VF1 to VF9, VB1 to VB9). The vibrating portion of FIG. 10 is realized by the solenoid 90. One end of the spring 94 is attached to one end side of the solenoid 90, and the solenoid 90 is pulled toward the direction DR1 side in a normal state by the spring 94. The other end PJ of the spring 94 is fixed to, for example, the back side surface of the jacket 52. Further, the solenoid 90 is attached to the jacket 52 by the attachment 96.

Then, when a drive signal is input to the solenoid 90 and energization is performed, the plunger 92 of the solenoid 90 moves to the direction DR2 side and hits the user's body 98. This allows the user to experience the vibration when a bullet or sword hits.

The vibrating unit can be realized by various vibrating devices such as a transducer, a vibrating motor, a spring & vibrating motor, a pneumatic or electric cylinder, and a linear motor, in addition to the solenoid.

The transducer converts a sound signal and is equivalent to a high-power subwoofer. For example, when the control unit 118 of FIG. 1 performs a sound file reproduction process, the sound signal generated by the sound file is input to the transducer. Then, for example, vibration is generated based on the low frequency component of the sound signal. The vibration motor generates vibration by rotating an eccentric weight, for example. Specifically, eccentric weights are attached to both ends of the drive shaft (rotor shaft) so that the motor itself swings. In the spring & vibration motor combination, the motor is used to unlock and generate vibration. In the cylinder, the rod portion of the cylinder is linearly moved along the directions DR1 and DR2 in FIG. 10 by pneumatic pressure or electric power. Even with a linear motor, linear motion is performed along the directions DR1 and DR2 in FIG.

In this embodiment, a method is adopted in which a vibrating portion is attached to a jacket (mounting body) and vibration control of the vibrating portion is performed according to a game situation (hit event, vibration event). Various implementation modes can be assumed as this vibration control method.

For example, if one vibrating part is attached only to the front part of the jacket (vest) and a hit event (vibration event in a broad sense) occurs in the game (when a hit signal is received from the control part), the vibrating part is concerned. To vibrate.

Alternatively, a plurality of vibrating parts are attached to, for example, the front portion of the jacket, and when a hit event in the game occurs, the vibrating part selected from the plurality of vibrating parts is vibrated. For example, based on the information of the hit position (the position where the attack is received), which of the plurality of vibrating parts is vibrated is selected and vibrated.

Alternatively, one vibrating part is attached to each of the front part and the rear part of the jacket, and when a hit event occurs (when a hit signal is received from the control part), the vibration part of the front part and the vibration part of the rear part are vibrated. The part is vibrated with a time lag to give the user the feeling that the bullet has penetrated.

Alternatively, a plurality of vibrating parts are attached to each of the front part and the rear part of the jacket, and based on the information of the hit position (attack position) and the information of the hit direction (attack direction), first of the vibrating parts of the front part. , Which is to be vibrated, and then which of the vibrating parts of the rear surface is to be vibrated. In addition, the interval (vibration interval) between the vibration of the vibrating part on the front surface and the vibration of the vibrating part on the rear surface is determined according to the hit speed (attack speed). For example, a bullet attack has a high hit speed, and a sword-piercing attack has a slow hit speed. Further, in the case of a sword attack, an attack expression such as piercing the sword and then moving the tip of the sword in a circular motion may be realized. Specifically, the vibrating part vibrating in the front part is left the same, and the vibrating part vibrating in the rear part is selected according to the circular motion of the sword tip. As described above, various embodiments can be considered as a vibration control method using the vibration unit provided on the mounting body.

11 (A) and 11 (B) are diagrams showing the relationship between the user US moving in the real space and the user moving body MV moving in the virtual space.

In FIG. 11A, the user US is moving as shown in A1 in the real space. The user US wears the HMD200 so as to cover the field of view, and holds a gun-type controller GN in his hand. Then, the field FL in the real space as shown in FIG. 4 is moved. Then, the position information of the user US moving in the real space is acquired, and based on the acquired position information, the user moving body MV moves in the virtual space as shown in A2 of FIG. 11B. Further, the direction information of the user US in the real space is acquired, and the user moving body MV in the virtual space also faces the direction corresponding to the direction information. Further, the posture information of the user US in the real space is acquired, and the user moving body MV in the virtual space also takes a posture corresponding to the posture information. For example, if the user US moves his / her hand or foot in the real space, the user moving body MV in the virtual space also moves his / her hand or foot accordingly.

As described above, in FIGS. 11A and 11B, the position, direction, and posture of the user moving body in the virtual space corresponding to the user also change according to the change in the position, direction, and posture of the user. Become. In a system using an HMD, an image in which a vast VR space spreads over the entire circumference of the user's field of view is displayed on the HMD, so that the virtual reality of the user can be significantly improved.

On the other hand, in a gun shooting game, as shown in FIG. 6, a hit event (shot event) occurs in which an attack from an enemy hits a user moving object. In this case, it is difficult for the user to experience such a hit event realistically only by the display image of the HMD and the output sound to the headphones. That is, even if an image that hits the bullet is displayed on the HMD or a sound effect that indicates the hit of the bullet is output from the headphones, if there is no experience such as vibration due to the hit of the bullet, it is a virtual that the bullet hit. It is not possible to give a sufficient sense of reality to the user.

Therefore, in the present embodiment, a method of vibrating a vibrating portion provided on the mounting body is adopted according to a game situation such as a hit event (vibration event) such as a bullet.

For example, in FIG. 12A, a hit event occurs in the virtual space where a bullet SH (in a broad sense, another object) from an enemy hits a user moving object MV. When such a hit event occurs, as shown in FIG. 12B, the vibrating portion VF of the jacket 52 worn by the user US is vibrated in the real space.

Specifically, in the present embodiment, the virtual space setting process is performed, and as described with reference to FIGS. 11A and 11B, the user moving body MV moving in the virtual space is moved. .. Further, a game process of a game in which the user US wears the jacket 52 (wearing body) on the body is performed, and as shown in FIGS. 6 and 8, a display image is generated based on the result of the game processing. .. For example, in this embodiment, this display image is displayed on the HMD.

In the present embodiment, as shown in FIGS. 9A and 9B, the jacket 52, which is a mounting body, is provided with a plurality of vibrating portions (VF1 to VF9, VB1 to VB9). Further, as shown in FIG. 12A, a hit calculation process between the user moving body MV and the bullet SH, which is another object, is performed. Then, when a hit event occurs between the user moving body MV and the bullet SH, which is another object, vibration control of a plurality of vibrating portions of the jacket 52, which is a mounting body, is performed. For example, vibration control is performed to vibrate a vibrating portion selected from a plurality of vibrating portions according to the hit direction and hit position of the bullet SH.

By doing so, when an event in which the bullet SH hits the user moving object MV corresponding to the user US occurs in the virtual space displayed on the HMD, the user US responds to the hit event in the real world. In the jacket 52 that he / she wears, the vibrating portion corresponding to the hit direction and the hit position vibrates. Therefore, in addition to the virtual reality of the HMD's realistic image, it is possible to give the user a feeling of vibration due to the vibration of the vibrating portion of the jacket 52, and it is possible to significantly improve the virtual reality of the user.

In this embodiment, the images shown in FIGS. 6 and 8 are not displayed on the HMD, but on a display unit such as a television in a home-use game device or a monitor display in a personal computer or an arcade game machine. An embodiment as displayed may be used. In this case, a game process of a game in which the user US wears the wearable body on the body and plays the game is performed, and a display image is generated and displayed on the display unit based on the result of the game process. In this case, the display unit may display an image from the first-person viewpoint of the user, or may display an image from the third-person viewpoint when the user moving body (user character) is viewed from the rear. Then, when the user operates the controller (operation unit) of the game, the user moving body moves in the game space.

3.3 Vibration control according to the type and content of vibration event Next, a specific example of the vibration control method of the present embodiment will be described. In the present embodiment, game processing is performed for a game in which the user wears the wearable body 50 on the body and is played, and control is performed for the wearable body 50 provided with a plurality of vibrating portions. In this case, the number of vibrating parts or the vibration range, which is the range of the vibrating parts, is changed according to the type or content of the vibration event generated in the game. Specifically, the vibration event is a hit event between the user or the user moving body corresponding to the user and the hit object, and the number or vibration range of the vibrating part to be vibrated is changed according to the type or content of the hit event. ..

For example, in FIG. 13A, a hit event (vibration event in a broad sense) due to a pistol attack from an enemy has occurred. For example, a pistol bullet (a hit object or another object in a broad sense) from an enemy hits a user moving object described with reference to FIGS. 5 (A) to 6 (A). The hit event may be a hit event in which a hit object such as a bullet from an enemy hits a user in the real space in FIG. 22, which will be described later. The same applies to the following description.

In the case of such a hit event by a pistol bullet (a first type of hit event), one vibrating portion VF5 of the jacket (mounting body) vibrates as shown in FIG. 13 (A). For example, the vibration range AR, which is the range of the vibrating portion to be vibrated, is a narrow range. On the other hand, in the case of a hit event by an iron ball (a second type of hit event), the five vibrating portions VF2, VF4 to VF6, and VF8 of the jacket vibrate as shown in FIG. 13 (B). For example, the vibration range AR of the vibrating portion is wider than that in FIG. 13 (A). Further, in the case of a hit event by a bazooka (a third type of hit event), the nine vibrating portions VF1 to VF9 of the jacket vibrate as shown in FIG. 13 (C). For example, the vibration range AR of the vibrating portion has a wider range than those in FIGS. 13 (A) and 13 (B).

As described above, in FIGS. 13 (A) to 13 (C), the number of vibrating portions and the vibrating range are changed according to the type of hit event. Specifically, the number of vibrating parts or the vibrating range is changed according to the type of the hit object (pistol, iron ball, bazooka, etc.). For example, the more the type of the hit object is the type of the hit object having a high attack ability, the larger the number of vibrations of the vibrating part and the wider the vibration range. For example, the bazooka bullet in the hit event of FIG. 13 (C) has a higher attack ability than the pistol bullet and the iron ball in the hit event of FIGS. 13 (A) and 13 (B). Since it is a hit product, the number of vibrations of the vibrating part is large and the vibration range is wide. By doing so, the number of vibrations of the vibrating portion may be reduced or increased, or the vibration range may be narrowed or widened, depending on the type of hit event. Therefore, the user can recognize what kind of hit event has occurred by experiencing the number of vibrations of the vibrating portion and the width of the vibration range by tactile sensation. In addition, since the type of hit event corresponds to the number of vibrations and the vibration range of the vibrating part, the virtual reality of the user can be improved. For example, when a pistol bullet hits, a small number of vibrating parts vibrate and the vibration range becomes narrow, while when a bazooka hits, a large number of vibrating parts vibrate and the vibration range becomes wide. .. Therefore, when a large number of vibrating parts vibrate or the vibration range is wide, the user can recognize that an attack such as a bazooka has hit. Also, when an attack like a bazooka hits, a large number of vibrating parts vibrate and the vibration range becomes wider, so it is possible to give the user a virtual reality as if it was hit by a real bazooka. Therefore, it is possible to improve the virtual reality of the user.

Further, in FIG. 14 (A), a hit event having a low attack power has occurred, in FIG. 14 (B), a hit event having a medium attack power has occurred, and in FIG. 14 (C), an attack power has occurred. There is a high hit event. For example, the types of hit events are the same, but the attack power in the hit event is different, and the content of the hit event is different. Specifically, even if the attack is made by the same pistol, iron ball or bazooka, the attack power is different.

Then, in the case of a hit event having a low attack power (a hit event having the first content), one vibrating portion VF5 of the jacket vibrates as shown in FIG. 14 (A). For example, the vibration range AR is a narrow range. On the other hand, in the case of a hit event with a medium attack power (a hit event with the second content), the five vibrating parts VF2, VF4 to VF6, and VF8 of the jacket vibrate as shown in FIG. 14 (B). .. For example, the vibration range AR is wider than that in FIG. 14 (A). Further, in the case of a hit event having a high attack power (a hit event having a third content), the nine vibrating portions VF1 to VF9 of the jacket vibrate as shown in FIG. 14 (C). For example, the vibration range AR has a wider range than those in FIGS. 14 (A) and 14 (B).

As described above, in FIGS. 14A to 14C, the number of vibrating portions and the vibration range are changed according to the content of the hit event. Specifically, the number of vibrating parts or the vibrating range is changed according to the attack content (low, medium, high) of the hit object. For example, the higher the attack power of the attack of the hit object, the larger the number of vibrating parts and the wider the vibration range. For example, the attack in the hit event shown in FIG. 14 (C) has a higher attack power than the attack in the hit event shown in FIGS. 14 (A) and 14 (B). The number of vibrations has increased, and the vibration range has become wider. By doing so, the number of vibrations of the vibrating portion may be reduced or increased, or the vibration range may be narrowed or widened, depending on the content of the hit event. Therefore, the user can recognize what the content of the generated hit event is by tactilely experiencing the number of vibrations and the vibration range of the vibrating unit. In addition, since the content of the hit event corresponds to the number of vibrations and the vibration range of the vibrating part, the virtual reality of the user can be improved. For example, in the case of a hit event with a low attack power, a small number of vibrating parts vibrate and the vibration range becomes narrow, while in the case of a hit event with a high attack power, a large number of vibrating parts vibrate and vibrate. The range is also widened. Therefore, when a large number of vibrating parts vibrate or the vibration range is wide, the user can recognize that the hit event has a high attack power. Also, in a hit event with high attack power, a large number of vibrating parts vibrate and the vibration range becomes wide, so it is possible to give the user a virtual reality feeling as if they were attacked with really high attack power. , The user's virtual reality can be improved.

Further, the content of the hit event may be the content regarding the passage of time in the hit event (vibration event). For example, the vibrating part of the jacket (wearing body) is vibrated according to the passage of time in a hit event. Specifically, at the hit timing of the hit object, the first vibrating portion of the plurality of vibrating portions is vibrated. Then, after a given time has elapsed from the hit timing, the second vibrating portion around the first vibrating portion is vibrated.

For example, in FIG. 15A, the vibrating portion VF5 (first vibrating portion) vibrates at the hit timing when a hit object such as a bullet hits. Then, as shown in FIG. 15B, after a given time has elapsed from this hit timing, the vibrating portions VF4 and VF6 (second vibrating portions) around the vibrating portion VF5 vibrate. Further, as shown in FIG. 15 (C), after a given time has elapsed from FIG. 15 (B), the vibrating portions VF2 and VF8 (third vibrating portion) around the vibrating portion VF5 further vibrate. For example, with the passage of time, the number of vibrations of the vibrating portion increases, and the vibration range AR becomes wider. Therefore, after the hit object is hit, it is possible to produce an effect in which the vibration gradually spreads from the position where the hit object hits toward the surrounding direction. This makes it possible to give the user a virtual reality feeling as if a real hit object hits the user, and it is possible to improve the virtual reality feeling of the user.

Vibration control according to the passage of time can be realized by counting processing using a timer or the like. However, instead of controlling the vibration by the passage of time by such a timer or the like, for example, at the hit timing of the hit object, the first vibrating portion of the plurality of vibrating portions is vibrated, and then the first vibrating portion is used. A method of controlling the order of the vibrating parts, such as vibrating the surrounding second vibrating part, may be adopted.

3.4 Random selection of vibrating part In this embodiment, vibration control is performed in which a vibrating part to be vibrated is randomly selected from a plurality of vibrating parts when a vibration event such as a hit event occurs. Specifically, when a vibration event occurs, the first vibration part of the plurality of vibration parts is vibrated, and when the vibration event occurs next, the first vibration of the plurality of vibration parts is vibrated. A second vibrating part different from the part is randomly selected and vibrated.

For example, in FIG. 16A, when a hit event (vibration event) in which the hit object hits occurs, the vibration unit VF5 (first vibration unit) among the plurality of vibration units VF1 to VF9 is selected. It is vibrating. The process of selecting the vibrating unit VF5 as the vibrating unit to be vibrated can be performed based on hit information including at least one of the hit direction and the hit position, which will be described later, for example. Then, when a hit event occurs next time, as shown in FIG. 16B, the vibrating portion VF6 (second vibrating portion) among the plurality of vibrating portions VF1 to VF9 is randomly selected and vibrated. Let me. Further, when a hit event occurs next time, as shown in FIG. 16C, the vibrating portion VF8 (third vibrating portion) among the plurality of vibrating portions VF1 to VF9 is randomly selected. Vibrate. Here, the hit events in FIGS. 16 (A), 16 (B), and 16 (C) are, for example, hit events having the same type and content. For example, in FIG. 16A, a hit event in which a pistol bullet hits occurs, and in FIGS. 16B and 16C, a hit event in which a pistol bullet hits occurs. Further, for example, in FIG. 16A, a hit event with an attack content having a low attack power occurs, and in FIGS. 16B and 16C, a hit event with an attack content having a low attack power occurs. There is.

For example, when a hit event occurs and the vibrating portion at the same position always vibrates, there is a problem that the user's body becomes accustomed to the vibration of the vibrating portion. For example, in the present embodiment, when a hit event in which a bullet hits occurs, the vibrating portion corresponding to the hit position of the bullet is vibrated to give the user a virtual reality as if a real bullet hit. You have succeeded in giving. However, if a vibration stimulus is applied only to the same body part when a hit event occurs, the vibration stimulus is paralyzed, and the virtual reality that the vibration of the vibrating part gives to the user is reduced. The problem of getting rid of it occurs.

In this respect, in the present embodiment, when a hit event occurs, a method of randomly selecting a vibrating portion to vibrate from a plurality of vibrating portions is adopted. For example, when a hit event in which a bullet hits occurs, the vibrating section VF5 vibrates in FIG. 16A, the vibrating section VF6 vibrates in FIG. 16C, and the vibrating section VF8 vibrates in FIG. 16C. As such, the vibrating vibrating part changes randomly. Therefore, it is possible to prevent the occurrence of a situation in which the user becomes accustomed to the stimulus due to the vibration because only the vibrating portion (for example, VF5) of the same body part constantly vibrates. For example, even when the same hit event occurs, the stimulation by vibration is given to different body parts of the user, so that it is possible to avoid the situation where the user becomes accustomed to the stimulation by vibration. Therefore, it becomes possible to prevent the virtual reality feeling given to the user by the vibration of the vibrating part from being lowered, and to give the user a virtual reality feeling as if a hit object such as a real bullet was hit. Will be possible.

3.5 Selection of vibrating part according to hit information In this embodiment, the vibrating part is selected based on the hit information. Specifically, the hit calculation process of the user or the user moving body and the hit object is performed to obtain hit information including at least one of the hit direction and the hit position. Then, when a hit event occurs, a vibrating part to be vibrated is selected from a plurality of vibrating parts according to the hit information. For example, as shown in FIGS. 13 (A) to 14 (C), when the number or range of vibrating parts to be vibrated is changed according to the type or content of the hit event, the selection of the vibrating part VF5 which is the center of the vibration range is selected. Is performed based on the hit information. Further, as shown in FIGS. 15A to 15C, when the number of vibrating parts and the vibration range to be vibrated are changed according to the passage of time in the hit event, the vibrating part VF5 (first) to vibrate first. The vibration part) is selected based on the hit information. Further, as shown in FIGS. 16A to 16C, when a vibrating part to be vibrated is randomly selected from a plurality of vibrating parts when a hit event occurs, the vibrating part VF5 (No. 1) to be selected first. 1) is selected based on the hit information. Alternatively, the candidate of the vibrating part to be vibrated is determined based on the hit information, and the vibrating part to be vibrated is randomly selected from the determined candidates.

17 (A) to 18 (B) are explanatory views of the vibration control method of the vibrating portion based on the hit information. In the present embodiment, a process of selecting a vibrating portion to vibrate from a plurality of vibrating portions is performed based on hit information including at least one of a hit direction and a hit position. By doing so, it becomes possible to realize the vibration control of the vibrating part that reflects the hit information obtained by the hit calculation process, and it becomes possible to realize the realistic vibration control corresponding to the game situation.

Specifically, in FIGS. 17A to 18B, vibration portions VF1 to VF9 on the front side are provided on the front portion of the jacket 52 (mounting body), and vibration portions VF1 to VF9 on the front side are provided on the rear surface portion of the jacket 52 on the rear surface side. Vibration units VB1 to VB9 are provided. At this time, in the present embodiment, when a hit event (vibration event) occurs, the first vibrating portion, which is one of the vibrating portion on the front side and the vibrating portion on the rear surface side, is generated based on the hit information. After vibrating, vibration control is performed to vibrate the second vibrating portion, which is the other vibrating portion of the vibrating portion on the front surface side and the vibrating portion on the rear surface side. Here, the hit information is information including at least one of the hit direction and the hit position.

That is, in the present embodiment, by providing a time difference between the vibration intervals of the two vibrating portions, a virtual reality is given to the user as if the bullet penetrated his / her own body. In the present embodiment, in the vibration provided with the time difference as described above, the vibrating portion that vibrates first is referred to as the first vibrating portion, and the vibrating portion that vibrates later is referred to as the second vibrating portion.

In FIGS. 17A and 17B, the first vibrating portion that vibrates first is the vibrating portion on the front surface side, and the second vibrating portion that vibrates later is the vibrating portion on the rear surface side. This is an example of the case. For example, in FIG. 17A, the vibration unit VF6 on the front surface side, which is the first vibration unit, is vibrated, and then the vibration unit VB4 on the rear surface side, which is the second vibration unit, is vibrated. In FIG. 17B, the vibration unit VF2 on the front surface side, which is the first vibration unit, is vibrated, and then the vibration unit VB5 on the rear surface side, which is the second vibration unit, is vibrated.

On the other hand, in FIGS. 18A and 18B, the first vibrating portion that vibrates first is the vibrating portion on the rear surface side, and the second vibrating portion that vibrates later is the vibrating portion on the front surface side. This is an example of a certain case. For example, in FIG. 18A, the vibrating portion VB4 on the rear surface side, which is the first vibrating portion, is vibrated, and then the vibrating portion VF6 on the front surface side, which is the second vibrating portion, is vibrated. In FIG. 18B, the vibrating portion VB5 on the rear surface side, which is the first vibrating portion, is vibrated, and then the vibrating portion VF2 on the front surface side, which is the second vibrating portion, is vibrated.

As described above, in the present embodiment, vibration control is performed to set a time difference between the vibrations of the two vibrating parts, such as vibrating the first vibrating part and then vibrating the second vibrating part, as if it were. It gives the user a virtual reality as if the bullet had penetrated its body. This makes it possible to greatly improve the virtual reality given to the user when a hit event such as a bullet occurs.

Then, in order to perform such vibration control, first, the bullet SH hits the front portion of the user moving body MV in FIG. 12A, or the bullet SH hits the rear portion of the user moving body MV. It is necessary to judge whether it is.

When the bullet SH hits the front portion of the user moving body MV, as shown in FIGS. 17 (A) and 17 (B), the vibration portions VF6 and VF2 on the front side, which are the first vibrating portions, are vibrated. After that, the vibrating portions VB4 and VB5 on the rear surface side, which are the second vibrating portions, may be vibrated.

On the other hand, when the bullet SH hits the rear surface portion of the user moving body MV, as shown in FIGS. 18 (A) and 18 (B), the vibrating portions VB4 and VB5 on the rear surface side, which are the first vibrating portions. After vibrating, the second vibrating portion, the vibrating portions VF6 and VF2 on the front side, may be vibrated.

Then, in determining whether the bullet SH hits the front portion of the user moving body MV or the bullet SH hits the rear portion of the user moving body MV, a hit including at least one of the hit direction DHT and the hit position PHT is determined. Information can be used.

For example, in FIGS. 17A and 17B, it can be determined that the bullet SH has flown from the front side of the user moving body MV based on the hit direction DHT. Alternatively, it can be determined that the bullet SH has hit the front portion of the user moving body MV based on the hit position PHT. Therefore, in this case, as shown in FIGS. 17 (A) and 17 (B), vibration control that vibrates the vibrating portions VF6 and VF2 on the front surface side and then vibrates the vibrating portions VB4 and VB5 on the rear surface side. I do.

On the other hand, in FIGS. 18A and 18B, it can be determined that the bullet SH has flown from the rear side of the user moving body MV based on the hit direction DHT. Alternatively, it can be determined that the bullet SH has hit the rear surface portion of the user moving body MV based on the hit position PHT. Therefore, in this case, as shown in FIGS. 18A and 18B, vibration control for vibrating the vibrating portions VB4 and VB5 on the rear surface side and then vibrating the vibrating portions VF6 and VF2 on the front surface side. I do.

Further, as shown in FIGS. 17A to 18B, when there are a plurality of vibrating parts on the front side or the rear side, it is necessary to select a vibrating part from the plurality of vibrating parts. Become. Therefore, in the present embodiment, the process of selecting the vibrating portion to be vibrated from the plurality of vibrating portions is performed based on the hit information.

Specifically, in the present embodiment, when a plurality of first vibrating portions are provided as the first vibrating portion to be vibrated first, the vibrating portion to be vibrated is selected from the plurality of first vibrating portions. The process is performed based on the hit information. Alternatively, when a plurality of second vibrating parts are provided as the second vibrating part to be vibrated later, a process of selecting a vibrating part from the plurality of second vibrating parts is performed based on the hit information. conduct.

For example, in FIGS. 17 (A) and 17 (B), the plurality of first vibrating parts to be vibrated first are the front side vibrating parts VF1 to VF9, and the plurality of second vibrating parts to be vibrated later are the front side vibrating parts VF1 to VF9. This is an example of the case where the vibrating portions VB1 to VB9 on the rear surface side. In this case, a process of selecting a vibrating portion to vibrate from a plurality of front-side vibrating portions VF1 to VF9 (plural first vibrating portions) and a plurality of rear-side vibrating portions VB1 to VB9 (plural first vibrating portions). The process of selecting the vibrating part to be vibrated from the vibrating part of 2) is performed based on the hit direction DHT which is the hit information.

For example, in FIG. 17A, the hit direction DHT of the bullet SH in FIG. 12A is from the left front side to the right rear side of the user moving body MV. In this case, the vibration unit VF6 on the front surface side and the vibration unit VB4 on the rear surface side along the trajectory of the hit direction DHT are selected and vibrated. For example, after vibrating the vibrating portion VF6 on the front surface side, the vibrating portion VB4 on the rear surface side is vibrated after a period of a given vibration interval elapses. This allows the user to feel the virtual reality as if a real bullet penetrated from the left front side to the right rear side of his body.

In FIG. 17B, the hit direction DHT of the bullet SH is in the direction from the lower front side to the upper rear side of the user moving body MV. In this case, the vibration unit VF2 on the front surface side and the vibration unit VB5 on the rear surface side along the trajectory of the hit direction DHT are selected and vibrated. For example, after vibrating the vibrating portion VF2 on the front surface side, the vibrating portion VB5 on the rear surface side is vibrated after a period of a given vibration interval elapses. This allows the user to feel the virtual reality as if a real bullet penetrated from the lower front side to the upper back side of his body.

On the other hand, in FIGS. 18A and 18B, the plurality of first vibrating portions to be vibrated first are the vibrating portions VB1 to VB9 on the rear surface side, and the plurality of second vibrating portions to be vibrated later are. This is an example of the case where the vibrating portions VF1 to VF9 on the front side are used. In this case, the process of selecting the vibrating portion to be vibrated from the plurality of vibrating portions VB1 to VB9 (plural first vibrating portions) on the rear surface side, and the processing of selecting the vibrating portions VF1 to VF9 (plural first vibrating portions) on the front surface side. It is performed based on the process of selecting the vibrating part to be vibrated from the vibrating part of 2) and the hit direction DHT which is the hit information.

For example, in FIG. 18A, the hit direction DHT of the bullet SH is in the direction from the right rear side to the left front side of the user moving body MV. In this case, the vibrating portion VB4 on the rear surface side and the vibrating portion VF6 on the front surface side along the trajectory of the hit direction DHT are selected and vibrated. For example, after vibrating the vibrating portion VB4 on the rear surface side, the vibrating portion VF6 on the front surface side is vibrated after a period of a given vibration interval elapses. This allows the user to feel the virtual reality as if a real bullet penetrated from the right rear side to the left front side of his body.

In FIG. 18B, the hit direction DHT of the bullet SH is in the direction from the upper rear side to the lower front side of the user moving body MV. In this case, the vibrating portion VB5 on the rear surface side and the vibrating portion VF2 on the front surface side along the trajectory of the hit direction DHT are selected and vibrated. For example, after vibrating the vibrating portion VB5 on the rear surface side, the vibrating portion VF2 on the front surface side is vibrated after a period of a given vibration interval elapses. This allows the user to feel the virtual reality as if a real bullet penetrated from the upper back side to the lower front side of his body.

As described above, in FIGS. 17A to 18B, a predetermined number (for example, 9) of vibrating portions are arranged in a grid pattern on each of the front surface portion and the rear surface portion of the user, which is appropriate based on the hit information. The vibrating part is selected and vibrates. Therefore, it is possible to give the user a suitable virtual reality feeling that reflects the hit information such as the hit direction.

In FIGS. 17A to 18B, the vibrating portion is selected based on the hit direction DHT, but the vibrating portion may be selected based on the hit position PHT.

For example, in FIG. 12A, it is assumed that the bullet SH is determined to hit the central part of the body of the user moving body MV. In this case, as shown in FIG. 19A, vibration control is performed to vibrate the front vibrating portion VF5 and the rear vibrating portion VB5 corresponding to the hit position PHT in the central portion of the body. This allows the user to feel the virtual reality as if a real bullet penetrated from the front central part of his body to the rear central part.

On the other hand, it is assumed that the bullet SH is determined to hit the lower side of the central part of the body of the user moving body MV. In this case, as shown in FIG. 19B, vibration control is performed to vibrate the front vibrating portion VF2 and the rear vibrating portion VB2 corresponding to the lower hit position PHT of the central portion of the body. This allows the user to feel the virtual reality as if a real bullet had penetrated from the lower center of the front of his body to the lower center of the back of his body. Similar vibration control can be performed even when the hit position PHT of the bullet is on the right side, left side, upper side, diagonal side, etc. of the central portion. Further, vibration control may be performed to vibrate the vibrating portion on the front surface side and the vibrating portion on the rear surface side by using both the hit direction DHT and the hit position PHT of the hit information. In this way, vibration control that more accurately realizes the virtual reality experience processing in which the bullet penetrates the body becomes possible.

Further, the hit information such as the hit direction DHT and the hit position PHT of the bullet can be specified by performing arithmetic processing such as the attack direction of the enemy who attacks the user moving body MV as a target. For example, by the tracking method described in FIGS. 2 (A) to 3 (B), the position information and direction information of the gun type controller possessed by the enemy user are acquired, and an attack is made based on these position information and direction information. The hit calculation process for determining the direction is performed, and the hit direction DHT and the hit position PHT are specified. In this case, for example, the hit direction DHT and the hit position PHT may be specified by reflecting the relative positional relationship and the directional relationship between the user moving body and the enemy moving body.

Further, in the present embodiment, the length of the vibration interval from the first timing for vibrating the first vibrating portion to the second timing for vibrating the second vibrating portion is determined by the type of hit event (vibration event) or. Change according to the content. Specifically, the length of the vibration interval is changed based on the hit speed included in the hit information.

Here, the first vibrating portion is the vibrating portion that vibrates first, and the second vibrating portion is the vibrating portion that vibrates later. As described above, in FIGS. 17A and 17B, the front vibrating portion (VF1 to VF9) becomes the first vibrating portion, and the rear vibrating portion (VB1 to VB9) becomes the second vibrating portion. It becomes a vibrating part. On the other hand, in FIGS. 18A and 18B, the vibrating portions (VB1 to VB9) on the rear surface side are the first vibrating portions, and the vibrating portions (VF1 to VF9) on the front surface side are the second vibrating portions. become.

For example, in FIG. 20A, the vibration unit VF on the front side, which is the first vibration unit, vibrates at the timing T1 (first timing). Then, at the timing T2 (second timing) after the period of the vibration interval TV elapses from the timing T1, the vibration portion VB on the rear surface side, which is the second vibration portion, vibrates. By providing such a vibration interval TV with a time difference of vibration, it is possible to realize a virtual reality feeling as if a bullet penetrates. As described above, the first vibrating portion may be the vibrating portion on the rear surface side, and the second vibrating portion may be the vibrating portion on the front surface side.

Then, in FIG. 20B, since the hit speed of the bullet is slow, the vibration interval TV from the timing T1 for vibrating the vibrating portion VF to the timing T2 for vibrating the vibrating portion VB is lengthened. On the other hand, in FIG. 20C, since the hit speed of the bullet is high, the vibration interval TV from the timing T1 for vibrating the vibrating portion VF to the timing T2 for vibrating the vibrating portion VB is shortened. By doing so, for a bullet with a slow speed, the vibration interval TV becomes long, so that the user can be given a virtual reality feeling that the bullet penetrates the body at a long time interval. On the other hand, for a bullet having a high speed, the vibration interval TV is shortened, so that the user can give a virtual reality feeling that the bullet penetrates the body at a short time interval. Therefore, it is possible to realize a bullet penetration expression that reflects the hit speed of the bullet, and it is possible to further improve the virtual reality of the user.

As described above, in the present embodiment, the length of the vibration interval TV is changed based on the hit speed. In other words, the length of the vibration interval TV is changed according to the type and content of the hit event (vibration event). For example, in the first type of event where a weapon with a high hit speed is attacked, the vibration interval TV is shortened. On the other hand, in the second type of event where a weapon with a slow hit speed is attacked, the vibration interval TV is lengthened. That is, the length of the vibration interval TV is changed according to the type of hit event. Alternatively, in the same type of event using the same weapon, for example, when the parameter of the enemy's attack speed is increased and the hit speed of the attack by the weapon is increased, the vibration interval TV is shortened. In addition, when the hit speed of the attack by the weapon becomes slow due to the lowering of the parameter of the attack speed of the enemy, the vibration interval TV is lengthened. That is, the length of the vibration interval TV is changed according to the content of the hit event.

By doing the above, the vibrating part will vibrate at the vibration interval of the length according to the type and content of the hit event, so it is possible to realize vibration control that reflects the type and content of the hit event. become.

As described above, in the present embodiment, a plurality of vibration units are provided for the wearing body such as the jacket 52, an image based on the game processing is displayed on the display unit, and the plurality of wearing bodies are displayed according to the game situation. The vibration of the vibrating part of is controlled. By doing so, it becomes possible to control the vibration of the vibrating part linked to the game image displayed on the display part, and while generating the display image based on the result of the game processing, the situation of the game played by the user is reflected. It is possible to realize the vibration control of the vibrating part of the mounted body.

In particular, when the HMD is used as the display unit, the user's field of view is covered by the HMD, so that vibration control using a plurality of vibration units of the wearer is effective for improving the virtual reality of the user. For example, by covering the field of view with the HMD, the user can feel the vibration of multiple vibrating parts in the wearing body as if a real bullet hits himself, and the virtual reality of the game. The feeling can be greatly improved. For example, as shown in FIGS. 17 (A) to 19 (B), if vibration control is performed that reflects hit information such as the hit direction and the hit position, the bullet or the like actually hits in the hit direction or the hit position. It is possible to give the user a feeling of virtual reality as if it were done. Further, by providing a vibration time difference due to the vibration interval as shown in FIGS. 20 (A) to 20 (C), it is possible to realize a virtual reality feeling as if a hit bullet or the like has penetrated its own body.

As a hit event in this embodiment, an event in which an attacking object such as a bullet SH as shown in FIG. 21 (A) hits the user moving object MV can be considered, but as shown in FIG. 21 (B), an enemy. It may be an event in which a weapon such as the sword SWE of the moving body OBE hits the user moving body. In this way, in the sword game as shown in FIGS. 7 and 8, the feeling that the user has slashed the enemy is realized by the reaction generation mechanism 30 of the sword-shaped controller 10 and is slashed by the enemy. As a result, the feeling of impact can be realized by controlling the vibration of the vibrating portion of the mounting body such as the jacket 52.

Further, the object that hits the user moving object MV in the hit event is not limited to an attacking object such as a bullet SH as shown in FIGS. 21 (A) and 21 (B) and a weapon such as a sword SWE. For example, in FIG. 21 (C), the object of the rock RK due to the collapse of a rocky mountain or the like hits the user moving body MV, and the vibration of the wearing body also regarding the feeling of impact at the time of such a hit of the rock RK. This can be achieved by controlling the vibration of the unit. That is, the method of this embodiment can be applied not only to a battle game using bullets and weapons, but also to a simulation game of nature experience in which an object such as a rock collides.

Further, the method of the present embodiment can be applied to a vibration event other than a hit event in which another object hits. For example, in FIG. 21D, an explosion EXP is generated near the user moving body MV, and when a vibration event due to this explosion EXP occurs, vibration control is performed to vibrate the vibrating portion of the user's wearing body. May be good. By doing so, the user can experience the blast caused by the explosion EXP, and the user can be given a virtual reality as if an explosion really occurred.

Further, in the present embodiment, the effect processing may be performed according to the vibration control of the vibrating portion. For example, in conjunction with the vibration control of the vibrating unit, the effect sound output to the user is produced, or the effect image is generated in the game image. For example, when the bullet SH or the sword SWE hits in FIGS. 21 (A) and 21 (B), a sound effect linked to the hit is output or an effect image is generated. Further, in the event where the rock RK hits as shown in FIG. 21C, a sound effect or an effect image when the rock collapses is generated. Further, as shown in FIG. 21 (D), when a vibration event of the explosion EXP occurs, a sound effect or an effect image corresponding to the explosion EXP is generated. Then, for example, a sound effect is output or an effect image is displayed according to the number and range of vibrating parts to be vibrated or the timing of vibration. By doing so, it becomes possible to output a sound effect linked to the vibration control of the vibrating portion and display an effect image, and it is possible to further enhance the virtual reality of the user.

Further, although the case where the method of this embodiment is applied to a simulation system of a type that displays a game image on a display unit such as an HMD has been mainly described above, the present embodiment is not limited to this. For example, in FIG. 22, in real space, the user US1 wears a jacket 52-1 (wearing body) provided with a plurality of vibrating parts, and holds a gun 53-1 in his hand. Further, the user US2 wears a jacket 52-2 provided with a plurality of vibrating parts and holds a gun 53-2 in his / her hand. Then, the users US1 and US2 play a gun game such as a survival game using guns 53-1 and 53-2 in a real space game field. The guns 53-1 and 53-2 are, for example, electric guns (airsoft guns) and fire bullets such as BB bullets. However, the guns 53-1 and 53-2 may emit bullets by light rays such as infrared rays. In the simulation system (game system) of FIG. 22, for example, a calculation process of a score of each user or a hit determination process of determining whether or not a bullet hits an opponent user is performed as a game process. Then, when a hit object such as a bullet hits the other user, the vibrating portion of the jacket of the other user vibrates. In this case, the number or vibration range of the vibrating parts to be vibrated changes according to the type or content of the hit event (vibration event). Further, when an event in which a hit object hits occurs, a vibrating portion to be vibrated is randomly selected from a plurality of vibrating portions. Further, a vibrating portion to be vibrated is selected from a plurality of vibrating portions according to hit information such as a hit direction and a hit position obtained by a hit calculation process. Note that FIG. 22 shows a case where the vibration control method of the present embodiment is applied to a gun game in a real space. For example, when an explosion event occurs as shown in FIG. 21 (D) in an attraction game or the like. The method of this embodiment may be applied to the vibration control of the vibrating part.

4. Detailed processing Next, a detailed processing example of the present embodiment will be described with reference to the flowcharts of FIGS. 23 to 26.

FIG. 23 is a flowchart showing a processing example of vibration control according to the type or content of the hit event. First, it is determined whether or not a hit object such as a bullet hits the user or the user moving object (step S1). For example, in FIG. 22, a hit determination process between a user and a bullet in real space is performed. Further, in FIGS. 5A to 6 and the like, hit determination processing is performed between the user moving object and an object such as a bullet in the virtual space. This hit determination process can be realized, for example, by an intersection determination process between a hit volume of a user moving object and an object such as a bullet or a trajectory.

When a hit event in which the hit object hits the user or the user moving body occurs, the type or content of the generated hit event is determined (step S2). For example, the type of hit event is determined by the type of hit object hit in the hit event, and the content of the hit event is determined by the hit strength parameter, attack power parameter, speed parameter, and the like. Then, the number of vibrating parts or the vibrating range to be vibrated is set based on the judgment result about the type or content of the hit event (step S3). Then, the vibrating portions of the set number or vibration range are vibrated (step S4). This makes it possible to realize vibration control according to the type and content of the hit event as shown in FIGS. 13 (A) to 14 (C).

FIG. 24 is a flowchart showing a processing example of vibration control according to the passage of time in a hit event. First, it is determined whether or not a hit object such as a bullet hits the user or the user moving object (step S11). Then, when the hit object hits and a hit event occurs, the first vibrating portion of the plurality of vibrating portions is vibrated (step S12). For example, the vibrating unit VF5 is vibrated as shown in FIG. 15 (A). Next, it is determined whether or not a given time has elapsed (step S13), and if a given time has elapsed, the second vibrating portion around the first vibrating portion is vibrated (step S14). ). For example, as shown in FIG. 15B, the vibrating portions VF4 and VF6 around the vibrating portion VF5 are vibrated. After a given time has elapsed, the vibrating units VF2 and VF8 are vibrated. By doing so, it becomes possible to realize vibration control in which the number of vibrations of the vibrating portion increases or the vibration range expands with the passage of time.

FIG. 25 is a flowchart showing an overall processing example in a simulation system in which a user moving object moves in a virtual space. First, user information including at least one of the user's position information, direction information, and posture information is acquired (step S21). For example, by acquiring the position information and direction information of the HMD, the user's position information, direction information, and the like can be acquired. Then, the movement process of the user moving body corresponding to the user is performed (step S22). For example, a process of moving a user moving body in a virtual space is performed based on the acquired position information and direction information of the user in the real space. When the user's posture information is acquired, motion processing for operating the user moving body is performed based on the acquired posture information.

Next, game processing such as hit calculation processing is executed (step S23). For example, a hit calculation process for determining whether or not another object has hit the user moving object, a game progress process for advancing the game, and the like are executed. Then, the vibration control process of the vibrating portion of the mounted body is performed (step S24). For example, based on the result of the hit calculation process or the like, the vibration control process of the vibrating unit is performed according to the game situation. Then, a display image of the HMD is generated based on the result of the game processing and displayed on the HMD (step S25).

FIG. 26 is a flowchart showing a processing example of vibration control based on hit information and random selection of a vibration unit. First, it is determined whether or not the bullet object hits the user moving object (step S31). Then, when the bullet object hits the user moving object and a hit event occurs, hit information including at least one of the hit direction, the hit position, and the hit speed is acquired (step S32). For example, the moving direction, moving position, and moving speed of the bullet object when the object hits the user moving object can be acquired as the hit direction, hit position, and hit speed, respectively. Next, a candidate for the vibrating portion to be vibrated is determined from the plurality of vibrating portions according to the hit information (step S33). Then, the vibrating portion randomly selected from the determined candidates is vibrated (step S34). For example, when it is determined that the bullet object hits the front side of the user moving body based on the hit information, the vibrating part randomly selected from the candidate front side vibrating parts is vibrated. On the other hand, when it is determined that the bullet object hits the rear surface side of the user moving object based on the hit information, the vibrating portion randomly selected from the candidate rear surface side vibrating portions is vibrated. .. Alternatively, on the front side or the rear side, a vibrating part within a given range including the hit position is determined as a candidate vibrating part, and a vibrating part to be vibrated is randomly selected from these candidate vibrating parts. good. Then, in the same manner, next, when a hit event occurs due to a bullet object hitting the user moving object, hit information is acquired and randomly selected from the candidates determined based on the hit information. The vibrating part is vibrated (steps S31 to S34). By doing so, when a hit event occurs, it becomes possible to realize vibration control in which a vibrating part to be vibrated is randomly selected from a plurality of vibrating parts.

Although the present embodiment has been described in detail as described above, those skilled in the art will easily understand that many modifications that do not substantially deviate from the novel matters and effects of the present invention are possible. Therefore, all such modifications are included in the scope of the present invention. For example, in a specification or drawing, a term (jacket, hit event, object, etc.) described at least once with a different term (attachment, vibration event, hit object, etc.) in a broader sense or synonymous is a specification or drawing. Can be replaced with the different term anywhere in. Further, game processing, vibration control processing, hit calculation processing, user information acquisition processing, virtual space setting processing, moving body movement processing, display processing, etc. are not limited to those described in the present embodiment, and are equivalent to these. Methods, processes, and configurations are also included in the scope of the present invention. The present invention can also be applied to various games. Further, the present invention can be applied to various simulation systems such as a commercial game device, a home game device, or a large attraction system in which a large number of users participate.

V1 to VN vibrating part, VF, VF1 to VF9 front side vibrating part,
VB, VB1 to VB9 Vibrating part on the rear surface side,
AR vibration range, DHT hit direction, PHT hit position, TV vibration interval,
US, US1 to US4 users, GN, GN1 to GN4 gun type controllers,
HMD, HMD1 to HMD4 Head-mounted display device,
MV, MV1 to MV3, user moving body, MB1 to MB3 enemy moving body,
FL field, GV1 to GV3, GB1 to GB3 guns,
SH bullets, SWE swords, RK rocks, EXP explosions,
10 sword-shaped controller, 20 grip, 30 generator, 32 weight,
34 receiving part, 50 mounting body, 52, 52-1, 52-2 jacket,
53-1, 53-2 gun, 60 generator, 70, 80 controller,
90 solenoid, 92 plunger, 94 spring, 96 fixture, 98 body,
100 processing unit, 102 input processing unit, 110 arithmetic processing unit, 111 information acquisition unit,
112 virtual space setting unit, 113 moving object processing unit, 114 virtual camera control unit,
115 game processing unit, 116 hit calculation processing unit, 118 control unit,
118 control unit, 120 display processing unit, 130 sound processing unit, 140 output processing unit,
150 image pickup unit, 151, 152 camera, 160 operation unit,
170 storage unit, 172 object information storage unit, 178 drawing buffer,
180 Information storage medium, 192 sound output section, 194 I / F section,
195 Portable information storage medium, 196 Communication unit,
200 HMD (head-mounted display device), 201-203 light receiving element, 210 sensor unit,
220 Display unit, 231 to 236 light emitting element, 240 processing unit, 250 processing device,
252 cables, 260 headbands, 270 headphones,
280, 284 base stations, 281, 282, 285, 286 light emitting elements,
290 gun type controller

Claims (8)

A game processing unit that performs game processing for a game that the user wears on the body and plays.
A control unit that controls the mounting body provided with a plurality of vibration units, and a control unit that controls the mounting body.
Including
The control unit
Control is performed to change the number of the vibrating parts to be vibrated or the vibration range which is the range of the vibrating parts to be vibrated according to the type or content of the vibration event generated in the game.
The vibration event is a hit event between the user or a user moving body corresponding to the user and a hit object.
A front side vibrating portion is provided on the front surface portion of the mounting body, and a rear surface side vibrating portion is provided on the rear surface portion of the mounting body.
The game processing unit
The hit calculation process of the user or the user moving body and the hit object is performed to obtain hit information including the hit direction.
The control unit
When the hit event between the user or the user moving body and the hit object occurs, the first vibration unit is one of the front side vibration unit and the rear surface side vibration unit based on the hit information. After vibrating the vibrating portion of the above, vibration control is performed to vibrate the second vibrating portion, which is the other vibrating portion of the front side vibrating portion and the rear surface side vibrating portion.
The control unit
When a plurality of first vibrating parts are provided as the first vibrating part and a plurality of second vibrating parts are provided as the second vibrating part, among the plurality of first vibrating parts, A process of selecting a vibrating portion along the trajectory in the hit direction is performed as the vibrating portion to vibrate, and vibration along the trajectory in the hit direction is performed as the vibrating portion to vibrate from the plurality of second vibrating portions. A simulation system characterized by performing a process of selecting a part . In claim 1,
The control unit
A simulation system characterized in that control is performed to change the number of vibrating portions or the vibration range to be vibrated according to the type or content of the hit event. In claim 2,
The control unit
A simulation system characterized in that control is performed to change the number of vibrating portions or the vibration range to be vibrated according to the type of the hit object or the content of an attack. In claim 3,
The control unit
The more the type of the hit object is the type of hit object having a high attack ability, or the more the attack content of the hit object is the attack content with a high attack power, the more the number of the vibrating portions to vibrate. A simulation system characterized by increasing or widening the vibration range. In claim 3 or 4,
The control unit
A simulation system characterized in that the first vibrating portion is vibrated at the hit timing of the hit object, and the second vibrating portion is vibrated after a given time has elapsed from the hit timing. In any of claims 1 to 5 ,
A virtual space setting unit that performs virtual space setting processing, and
A moving body processing unit that performs moving processing of the user moving body that moves in the virtual space,
A display processing unit that generates an image to be displayed to the user based on the result of the game processing.
A simulation system characterized by including. In claim 6 ,
The display processing unit is
A simulation system characterized by generating a display image of a head-mounted display device worn by the user so as to cover the field of view. A game processing unit that performs game processing for a game that the user wears on the body and plays.
As a control unit that controls the mounting body provided with a plurality of vibration units,
Make your computer work
The control unit
Control is performed to change the number of the vibrating parts to be vibrated or the vibration range which is the range of the vibrating parts to be vibrated according to the type or content of the vibration event generated in the game.
The vibration event is a hit event between the user or a user moving body corresponding to the user and a hit object.
A front side vibrating portion is provided on the front surface portion of the mounting body, and a rear surface side vibrating portion is provided on the rear surface portion of the mounting body.
The game processing unit
The hit calculation process of the user or the user moving body and the hit object is performed to obtain hit information including the hit direction.
The control unit
When the hit event between the user or the user moving body and the hit object occurs, the first vibration unit is one of the front side vibration unit and the rear surface side vibration unit based on the hit information. After vibrating the vibrating portion of the above, vibration control is performed to vibrate the second vibrating portion, which is the other vibrating portion of the front side vibrating portion and the rear surface side vibrating portion.
The control unit
When a plurality of first vibrating parts are provided as the first vibrating part and a plurality of second vibrating parts are provided as the second vibrating part, among the plurality of first vibrating parts, A process of selecting a vibrating portion along the trajectory in the hit direction is performed as the vibrating portion to vibrate, and vibration along the trajectory in the hit direction is performed as the vibrating portion to vibrate from the plurality of second vibrating portions. A program characterized by performing a process of selecting a part .

Images