JP7104539B2 - Simulation system and program - Google Patents

Description

The present invention relates to a simulation system, a program, and the like.

Conventionally, a simulation system that generates an image that can be seen from a virtual camera in a virtual space has been known. For example, as a conventional technique of a simulation system that realizes virtual reality (VR) by displaying an image seen from a virtual camera on an HMD (head-mounted display device), there is a technique disclosed in Patent Document 1 and the like.

Japanese Unexamined Patent Publication No. 11-309269

In such a simulation system, in order to make the user feel the virtual reality as if he / she entered the world of the virtual space, a user moving body corresponding to the user in the real space appears in the virtual space. Specifically, a virtual camera corresponding to the viewpoint of the user in the real space is set in the virtual space, and the image seen from the virtual camera is displayed on the HMD. This virtual camera corresponds to the viewpoint of the user moving body in the virtual space. In the conventional simulation system, the viewpoint of the user in the real space and the viewpoint of the user moving body in the virtual space (virtual camera) correspond to each other. For example, the image in the same viewpoint state as the real space is HMD. Is displayed in. Therefore, the image that can be seen in the virtual space is only an image that looks the same as the real space, and it is not possible to display the image of the virtual space that reflects the change in the state of the user moving body.

According to some aspects of the present invention, it is possible to provide a simulation system and a program that can reflect a change in the state of a user moving body due to the occurrence of an event in an image of a virtual space.

One aspect of the present invention is a process of moving a virtual space setting unit that performs a virtual space setting process and a user moving body of the virtual space corresponding to the user in a real space that the user can move in the virtual space. A moving body processing unit to perform the operation, an event processing unit to process the event, and a display image of the head-mounted display device worn by the user so as to cover the field of view are generated as an image seen from the virtual camera in the virtual space. The event processing unit includes a display processing unit, the event processing unit determines whether or not an event has occurred in which the state of the user moving body changes to a given state, and the virtual space setting unit determines whether or not the event has occurred. It relates to a simulation system that performs a switching process for switching the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space when it is determined to occur. The present invention also relates to a program that causes a computer to function as each of the above parts, or a computer-readable information storage medium that stores the program.

According to one aspect of the present invention, a virtual space is set, and an image seen from the virtual camera in the virtual space in which the user moving body moves is generated as a display image of the head-mounted display device. Then, when it is determined that an event that changes the state of the user moving body to a given state occurs, a process of switching the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space is executed. .. In this way, it is possible to reflect the change in the state of the user moving body due to the occurrence of the event in the display image of the head-mounted display device by the process of switching the correspondence of the coordinate scales. .. Therefore, it is possible to provide a simulation system or the like that can reflect the change in the state of the user moving body due to the occurrence of the event in the image of the virtual space.

Further, in one aspect of the present invention, when it is determined that the event occurs, the virtual space setting unit is reduced when the coordinates are converted from the local coordinate system of the user moving body to the world coordinate system of the virtual space. Alternatively, scale conversion of enlargement may be performed.

In this way, the change in the state of the user moving body due to the occurrence of an event can be detected by the head-mounted display device by a simple process of reducing or enlarging the scale when converting the coordinates to the world coordinate system. It can be reflected in the display image.

Further, in one aspect of the present invention, when it is determined that the event occurs, the virtual space setting unit moves the virtual space to which the user moving body moves from the first virtual space to the first virtual space. You may switch to a second virtual space whose coordinate axis scale is different from that of space.

In this way, by switching the virtual space in which the user moving body moves from the first virtual space to the second virtual space, the change in the state of the user moving body due to the occurrence of an event can be displayed on the head-mounted display device. It becomes possible to reflect it in the display image of.

Further, in one aspect of the present invention, the virtual space setting unit may perform the switching process when an event for changing the size of the user moving body occurs as the event.

In this way, it becomes possible for the user to experience the virtual reality in which the size of the user moving body becomes smaller or larger.

Further, in one aspect of the present invention, the event processing unit determines whether or not the event has occurred based on at least one of the behavior information of the user, the behavior information of another user, and the game situation. May be good.

In this way, an event that changes the user moving body to a given state is generated according to the user's behavior, the behavior of another user, or the game situation, and the state of the user moving body due to the occurrence of the event is generated. It is possible to let the user experience the change virtually.

Further, in one aspect of the present invention, the event processing unit causes a deviation between the position of the user moving body in the virtual space and the corresponding position of the user in the real space due to the occurrence of the event. When it is determined, the state of the user moving body may be changed to the given state while modifying the position of the user moving body in the virtual space.

In this way, even if a situation occurs in which the position of the user and the position of the user moving body are deviated due to the occurrence of an event, the position of the user moving body can be corrected to cause such a situation. Can be prevented.

Further, in one aspect of the present invention, the display processing unit may perform a process of changing the display image when correcting the position of the user moving body.

In this way, it is possible to prevent the occurrence of a situation in which the user feels unnatural with respect to the movement of the user moving body due to the position correction.

Further, in one aspect of the present invention, the display processing unit may perform a process of fading out the display image as a process of changing the display image.

In this way, the displayed image fades out when the position of the user moving body is corrected, and the user feels unnatural about the movement of the user moving body due to the position correction. Can be prevented.

Further, in one aspect of the present invention, the display processing unit may perform a process of displaying an object in the virtual space at a position covering the virtual camera as a process of changing the display image.

In this way, when the position of the user moving body is corrected, an image whose field of view is covered by the object is displayed, and the user feels unnatural with respect to the movement of the user moving body due to the position correction. It will be possible to prevent the occurrence of situations such as feeling.

Further, in one aspect of the present invention, an information acquisition unit that acquires tracking information of the user's viewpoint information in the real space is included (a computer functions as an information acquisition unit), and the display processing unit is the viewpoint information. An image seen from the virtual camera, which is controlled to follow a change in the viewpoint of the user based on the tracking information, may be generated as a display image of the head-mounted display device.

In this way, it is possible to control the virtual camera that reflects the change in the user's viewpoint in the real space, and it is possible to give the user a virtual reality feeling as if he / she has entered the world of the virtual space.

The block diagram which shows the configuration example of the simulation system of this embodiment. 2 (A) and 2 (B) are examples of the HMD used in this embodiment. 3 (A) and 3 (B) are other examples of the HMD used in this embodiment. A perspective view illustrating a playfield of a simulation system. An example of a virtual space image generated by this embodiment. Explanatory drawing of the size change event of a user character. Explanatory drawing of the size change event of a user character. Explanatory drawing of the size change event of a user character. An example of an image displayed on the HMD when an event occurs. An example of an image displayed on the HMD when an event occurs. An example of an image displayed on the HMD when an event occurs. Explanatory drawing of the coordinate scale switching process. Explanatory drawing of the coordinate scale switching process. Explanatory drawing of the coordinate scale switching process. Explanatory drawing of another example of the coordinate scale switching process. 16 (A) and 16 (B) are explanatory views of a process of generating an event based on a user's behavior or another user's behavior. 17 (A) to 17 (C) are explanatory views of a process of correcting the position of the user character when an event occurs. 18 (A) and 18 (B) are explanatory views of a process of changing the display image when the position of the user character is corrected. 19 (A) and 19 (B) are explanatory views of a process of covering the field of view with an object when the position of the user character is corrected. The flowchart which shows the detailed processing example of this embodiment.

Hereinafter, this embodiment will be described. The present embodiment described below does not unreasonably limit the content of the present invention described in the claims. Moreover, not all of the configurations described in the present embodiment are essential constituent requirements of the present invention.

1. 1. Simulation system FIG. 1 is a block diagram showing a configuration example of a simulation system (simulator, game system, image generation system) of the present embodiment. The simulation system of this embodiment is, for example, a system that simulates virtual reality (VR), a game system that provides game content, a real-time simulation system such as a sports competition simulator or a driving simulator, a system that provides SNS services, and an image. It can be applied to various systems such as a content providing system that provides such contents or an operating system that realizes remote work. The simulation system of the present embodiment is not limited to the configuration shown in FIG. 1, and various modifications such as omitting a part of its constituent elements (each part) or adding other constituent elements are possible.

The operation unit 160 is for the user (player) to input various operation information (input information). The operation unit 160 can be realized by various operation devices such as an operation button, a direction instruction key, a joystick, a handle, a pedal, a lever, or a voice input device.

The storage unit 170 stores various types of information. The storage unit 170 functions as a work area such as the processing unit 100 and the communication unit 196. The game program and game data necessary for executing the game program are stored in the storage unit 170. The function of the storage unit 170 can be realized by a semiconductor memory (DRAM, VRAM), an HDD (hard disk drive), an SSD, an optical disk device, or the like. The storage unit 170 includes an object information storage unit 172 and a drawing buffer 178.

The information storage medium 180 (a medium that can be read by a computer) stores programs, data, and the like, and its function can be realized by an optical disk (DVD, BD, CD), an HDD, a semiconductor memory (ROM), or the like. .. The processing unit 100 performs various processes of the present embodiment based on the program (data) stored in the information storage medium 180. That is, the information storage medium 180 is a program for causing a computer (a device including an input device, a processing unit, a storage unit, and an output unit) to function as each part of the present embodiment (a program for causing the computer to execute the processing of each part). Is memorized.

The HMD200 (head-mounted display device) is a device that is worn on the user's head and displays an image in front of the user's eyes. The HMD 200 is preferably a non-transparent type, but may be a transparent type. Further, the HMD 200 may be a so-called eyeglass type HMD.

The HMD 200 includes a sensor unit 210, a display unit 220, and a processing unit 240. It is also possible to modify the HMD 200 by providing a light emitting element. The sensor unit 210 is for realizing tracking processing such as head tracking. For example, the position and direction of the HMD 200 are specified by a tracking process using the sensor unit 210. By specifying the position and direction of the HMD 200, the user's viewpoint position and line-of-sight direction can be specified.

Various methods can be adopted as the tracking method. In the first tracking method, which is an example of the tracking method, a plurality of light receiving elements (photodiodes, etc.) are provided as the sensor unit 210, as will be described in detail in FIGS. 2 (A) and 2 (B) described later. Then, by receiving the light (laser, etc.) from the light emitting element (LED, etc.) provided outside by these plurality of light receiving elements, the position of the HMD200 (user's head) in the three-dimensional space in the real world, Specify the direction. In the second tracking method, a plurality of light emitting elements (LEDs) are provided in the HMD 200 as described in detail in FIGS. 3 (A) and 3 (B) described later. Then, the position and direction of the HMD 200 are specified by capturing the light from these plurality of light emitting elements with an imaging unit provided outside. In the third method, a motion sensor is provided as the sensor unit 210, and the position and direction of the HMD 200 are specified using this motion sensor. The motion sensor can be realized by, for example, an acceleration sensor or a gyro sensor. For example, by using a 6-axis motion sensor using a 3-axis acceleration sensor and a 3-axis gyro sensor, the position and direction of the HMD200 in a three-dimensional space in the real world can be specified. The position and direction of the HMD 200 may be specified by a combination of the first tracking method and the second tracking method, or a combination of the first tracking method and the third tracking method. Further, instead of specifying the user's viewpoint position and line-of-sight direction by specifying the position and direction of the HMD 200, a tracking process that directly specifies the user's viewpoint position and line-of-sight direction may be adopted.

The display unit 220 of the HMD 200 can be realized by, for example, an organic EL display (OEL) or a liquid crystal display (LCD). For example, the display unit 220 of the HMD 200 includes a first display or a first display area set in front of the left eye of the user and a second display or a second display area set in front of the right eye. It is provided so that a stereoscopic display is possible. In the case of stereoscopic display, for example, an image for the left eye and an image for the right eye having different parallax are generated, the image for the left eye is displayed on the first display, and the image for the right eye is displayed on the second display. do. Alternatively, the image for the left eye is displayed in the first display area of one display, and the image for the right eye is displayed in the second display area. Further, the HMD 200 is provided with two eyepieces (fisheye lens) for the left eye and the right eye, thereby expressing a VR space that extends over the entire circumference of the user's field of view. Then, a correction process for correcting the distortion generated in the optical system such as the eyepiece is performed on the left eye image and the right eye image. This correction process is performed by the display processing unit 120.

The processing unit 240 of the HMD 200 performs various processes necessary for the HMD 200. For example, the processing unit 240 performs control processing of the sensor unit 210, display control processing of the display unit 220, and the like. Further, the processing unit 240 may perform three-dimensional sound (stereophonic sound) processing to reproduce the three-dimensional sound direction, distance, and spread.

The sound output unit 192 outputs the sound generated by the present embodiment, and can be realized by, for example, a speaker or headphones.

The I / F (interface) unit 194 performs interface processing with the portable information storage medium 195, and the function can be realized by an ASIC or the like for I / F processing. The portable information storage medium 195 is for the user to store various types of information, and is a storage device that retains the storage of such information even when the power is not supplied. The portable information storage medium 195 can be realized by an IC card (memory card), a USB memory, a magnetic card, or the like.

The communication unit 196 communicates with an external device (another device) via a wired or wireless network, and its functions include hardware such as a communication ASIC or a communication processor, and communication firmware. Can be realized by.

The program (data) for operating the computer as each part of the present embodiment is distributed from the information storage medium of the server (host device) to the information storage medium 180 (or storage unit 170) via the network and the communication unit 196. You may. The use of information storage media by such a server (host device) can also be included within the scope of the present invention.

The processing unit 100 (processor) provides operation information from the operation unit 160, tracking information in the HMD 200 (information on at least one of the position and direction of the HMD, information on at least one of the viewpoint position and the line-of-sight direction), a program, and the like. Based on this, game processing (simulation processing), virtual space setting processing, moving object processing, virtual camera control processing, display processing, sound processing, and the like are performed.

Each process (each function) of the present embodiment performed by each unit of the processing unit 100 can be realized by a processor (a processor including hardware). For example, each process of the present embodiment can be realized by a processor that operates based on information such as a program and a memory that stores information such as a program. In the processor, for example, the functions of each part may be realized by individual hardware, or the functions of each part may be realized by integrated hardware. For example, a processor includes hardware, which hardware can include at least one of a circuit that processes a digital signal and a circuit that processes an analog signal. For example, the processor may be composed of one or more circuit devices (for example, ICs, etc.) mounted on a circuit board, or one or more circuit elements (for example, resistors, capacitors, etc.). The processor may be, for example, a CPU (Central Processing Unit). However, the processor is not limited to the CPU, and various processors such as GPU (Graphics Processing Unit) and DSP (Digital Signal Processor) can be used. Further, the processor may be a hardware circuit by ASIC. Further, the processor may include an amplifier circuit, a filter circuit, and the like for processing an analog signal. The memory (storage unit 170) may be a semiconductor memory such as SRAM or DRAM, or may be a register. Alternatively, it may be a magnetic storage device such as a hard disk device (HDD), or an optical storage device such as an optical disk device. For example, the memory stores instructions that can be read by a computer, and when the instructions are executed by the processor, the processing (function) of each part of the processing unit 100 is realized. The instruction here may be an instruction set that constitutes a program, or may be an instruction that instructs the hardware circuit of the processor to operate.

The processing unit 100 includes an input processing unit 102, an arithmetic processing unit 110, and an output processing unit 140. The arithmetic processing unit 110 includes an information acquisition unit 111, a virtual space setting unit 112, a moving body processing unit 113, a virtual camera control unit 114, a game processing unit 115, an event processing unit 116, a notification processing unit 117, a display processing unit 120, and a sound. The processing unit 130 is included. As described above, each process of the present embodiment executed by each of these parts can be realized by a processor (or a processor and a memory). It is possible to carry out various modifications such as omitting a part of these components (each part) or adding other components.

The input processing unit 102 performs a process of receiving operation information and tracking information, a process of reading information from the storage unit 170, and a process of receiving information via the communication unit 196 as input processing. For example, the input processing unit 102 stores the operation information input by the user using the operation unit 160, the processing of acquiring the tracking information detected by the sensor unit 210 of the HMD 200, and the information specified by the read command in the storage unit 170. The process of reading from the computer and the process of receiving information from an external device (server, etc.) via the network are performed as input processes. Here, the reception process is a process of instructing the communication unit 196 to receive information, a process of acquiring the received information by the communication unit 196 and writing it to the storage unit 170, and the like.

The arithmetic processing unit 110 performs various arithmetic processing. For example, arithmetic processing such as information acquisition processing, virtual space setting processing, moving object processing, virtual camera control processing, game processing (simulation processing), event processing, notification processing, display processing, or sound processing is performed.

The information acquisition unit 111 (program module for information acquisition processing) performs various information acquisition processing. For example, the information acquisition unit 111 acquires the position information of the user who wears the HMD 200. The information acquisition unit 111 may acquire user's direction information and the like.

The virtual space setting unit 112 (program module of the virtual space setting process) performs the setting process of the virtual space (object space) in which the object is arranged. For example, various display objects such as moving objects (people, robots, cars, trains, airplanes, ships, monsters or animals), maps (topography), buildings, spectator seats, courses (roads), trees, walls, water surfaces, etc. Performs a process of arranging and setting an object (an object composed of primitive surfaces such as polygons, free curved surfaces, or subdivision surfaces) in a virtual space. That is, the position and rotation angle (synonymous with direction and direction) of the object in the world coordinate system are determined, and the rotation angle (rotation angle around the X, Y, Z axis) is used for the position (X, Y, Z). Place the object. Specifically, in the object information storage unit 172 of the storage unit 170, object information, which is information such as the position, rotation angle, movement speed, and movement direction of an object (part object) in the virtual space, is associated with the object number. Is remembered. The virtual space setting unit 112 performs, for example, a process of updating this object information for each frame.

The moving body processing unit 113 (program module for moving body processing) performs various processing on the moving body moving in the virtual space. For example, a process of moving a moving body or a process of operating a moving body is performed in a virtual space (object space, game space). For example, the moving body processing unit 113 is based on the operation information input by the user by the operation unit 160, the tracking information acquired, the program (movement / motion algorithm), various data (motion data), and the like. Performs control processing to move a model object) in a virtual space or to move a moving body (motion, animation). Specifically, a simulation in which movement information (position, rotation angle, velocity, or acceleration) and motion information (position or rotation angle of a part object) of a moving body are sequentially obtained for each frame (for example, 1/60 second). Perform processing. A frame is a unit of time for performing movement / motion processing (simulation processing) and image generation processing of a moving body. The moving body is, for example, a user moving body corresponding to a user (player) in the real space. The user moving body is a virtual user (virtual player, avatar) in the virtual space, or a boarding moving body (operating moving body) on which the virtual user is boarding (operating).

The virtual camera control unit 114 (program module for virtual camera control processing) controls the virtual camera. For example, the process of controlling the virtual camera is performed based on the user's operation information, tracking information, and the like input by the operation unit 160.

For example, the virtual camera control unit 114 controls the virtual camera set as the user's first-person viewpoint or third-person viewpoint. For example, by setting a virtual camera at a position corresponding to the viewpoint (first-person viewpoint) of a moving user moving body in a virtual space and setting the viewpoint position and line-of-sight direction of the virtual camera, the position (position coordinates) of the virtual camera can be set. And posture (rotation angle around the rotation axis). Alternatively, the position and orientation of the virtual camera are controlled by setting the virtual camera at the position of the viewpoint (third person viewpoint) following the moving body of the user and setting the viewpoint position and the line-of-sight direction of the virtual camera.

For example, the virtual camera control unit 114 controls the virtual camera so as to follow the change in the user's viewpoint based on the tracking information of the user's viewpoint information acquired by the viewpoint tracking. For example, in the present embodiment, tracking information (viewpoint tracking information) of viewpoint information that is at least one of the user's viewpoint position and line-of-sight direction is acquired. This tracking information can be obtained, for example, by performing tracking processing of HMD200. Then, the virtual camera control unit 114 changes the viewpoint position and the line-of-sight direction of the virtual camera based on the acquired tracking information (information on at least one of the user's viewpoint position and the line-of-sight direction). For example, the virtual camera control unit 114 virtually changes the viewpoint position and line-of-sight direction (position, posture) of the virtual camera in the virtual space according to changes in the user's viewpoint position and line-of-sight direction in the real space. Set the camera. By doing so, the virtual camera can be controlled so as to follow the change in the viewpoint of the user based on the tracking information of the viewpoint information of the user.

The game processing unit 115 (game processing program module) performs various game processing for the user to play the game. In other words, the game processing unit 115 (simulation processing unit) executes various simulation processes for the user to experience virtual reality (virtual reality). The game process calculates, for example, a process of starting a game when the game start condition is satisfied, a process of advancing the started game, a process of ending the game when the game end condition is satisfied, or a game result. Processing etc.

The event processing unit 116 (event processing program module) performs various processes related to the event. The notification processing unit 117 (program module for notification processing) performs various notification processes. For example, it performs warning processing for the user. The notification process may be, for example, a notification process using an image or sound, or may be a notification process using a vibration device or a sensory device such as a sound or an air cannon.

The display processing unit 120 (display processing program module) performs display processing of a game image (simulation image). For example, drawing processing is performed based on the results of various processing (game processing, simulation processing) performed by the processing unit 100, an image is generated by this, and the image is displayed on the display unit 220. Specifically, geometry processing such as coordinate conversion (world coordinate conversion, camera coordinate conversion), clipping processing, perspective conversion, or light source processing is performed, and drawing data (positions of vertices on the primitive surface) is performed based on the processing results. Coordinates, texture coordinates, color data, normal vector or α value, etc.) are created. Then, based on this drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after perspective transformation (after geometry processing) is subjected to image information in pixel units such as a drawing buffer 178 (frame buffer, work buffer, etc.). Draw in a memorable buffer). As a result, an image seen from a virtual camera (given viewpoint. First and second viewpoints for the left eye and the right eye) is generated in the virtual space. The drawing process performed by the display processing unit 120 can be realized by a vertex shader process, a pixel shader process, or the like.

The sound processing unit 130 (sound processing program module) performs sound processing based on the results of various processing performed by the processing unit 100. Specifically, a game sound such as a musical piece (music, BGM), a sound effect, or a voice is generated, and the game sound is output to the sound output unit 192. A part of the sound processing of the sound processing unit 130 (for example, three-dimensional sound processing) may be realized by the processing unit 240 of the HMD 200.

The output processing unit 140 performs output processing of various information. For example, the output processing unit 140 performs a process of writing information to the storage unit 170 and a process of transmitting information via the communication unit 196 as an output process. For example, the output processing unit 140 performs a process of writing the information specified by the write command to the storage unit 170 and a process of transmitting the information to an external device (server or the like) via the network. The transmission process is a process of instructing the communication unit 196 to transmit information, instructing the communication unit 196 to transmit information, and the like.

As shown in FIG. 1, the simulation system of the present embodiment includes a virtual space setting unit 112, a moving body processing unit 113, an event processing unit 116, and a display processing unit 120.

The virtual space setting unit 112 performs the virtual space setting process. For example, a process is performed in which an object of a user moving body corresponding to a user, an object of an opponent's moving body such as an enemy, and an object constituting a map or a background are arranged and set in a virtual space. The user moving body corresponding to the user is, for example, a moving body operated by the user by the operation unit 160 or a moving body that moves in the virtual space following the movement of the user in the real space. This user moving body is called, for example, a character or an avatar. The user moving body may be a boarding moving body such as a robot on which the user is boarding. Further, the user moving body may be a display object on which the image is displayed, or a virtual object on which the image is not displayed. For example, when the image of the first person viewpoint is displayed as the image of the virtual space, the user moving body may be hidden, or only a part of the user moving body (for example, hand, chest, face, etc.). May be displayed.

The moving body processing unit 113 performs a process of moving a user moving body (virtual camera) in the virtual space corresponding to the user in the real space in which the user can move in the virtual space. For example, the user moving body is moved in the virtual space based on the operation information input by the user by the operation unit 160. Alternatively, when the information acquisition unit 111 acquires the user's position information in the real space, the moving body processing unit 113 uses the acquired position information (viewpoint tracking information) to obtain the user moving object in the virtual space. Performs the process of moving. For example, the user moving body is moved in the virtual space so as to follow the movement of the user in the real space. For example, the position of the user moving body is updated for each frame based on the moving speed and the moving acceleration of the user moving body, and the user moving body is moved in the virtual space (virtual field).

The event processing unit 116 processes the event. For example, it processes various events that occur in a user moving body in a virtual space corresponding to a user.

The display processing unit 120 (drawing processing unit) performs drawing processing of an image (object) in the virtual space. For example, the display processing unit 120 generates a display image of the HMD 200 that the user wears so as to cover the field of view as an image that can be seen from a virtual camera (given viewpoint) in the virtual space. For example, the drawing process of the image seen from the virtual camera set to the viewpoint (first person viewpoint) of the user moving body such as the user character (avatar) is performed. Alternatively, the drawing process of the image seen from the virtual camera set to the viewpoint (third person viewpoint) following the moving body of the user is performed. It is desirable that the generated image is an image for stereoscopic viewing such as an image for the left eye and an image for the right eye.

Then, the event processing unit 116 determines whether or not an event has occurred in which the state of the user moving body changes to a given state. The state of the user moving body is, for example, the state of the size of the user moving body, in other words, the state of the viewpoint (viewpoint position, line-of-sight direction) of the user moving body. In this case, the event that occurs is a size change event (viewpoint state change event) in which the size of the user moving body changes to a given size. For example, an event is an event in which the size of a user moving body becomes smaller or larger. The event may be an event in which the shape or appearance of the user moving body changes, or an event in which the environmental condition around the user moving body changes.

Then, when it is determined that an event occurs, the virtual space setting unit 112 performs a switching process for switching the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space. For example, when associating the coordinate system of the real space with the coordinate system of the virtual space, the scale conversion of reduction or enlargement is performed. Specifically, when it is determined that an event occurs, the virtual space setting unit 112 switches the correspondence between the scale for the position coordinates in the real space and the scale for the position coordinates in the virtual space. Alternatively, the correspondence between the scale of the axis in the real space and the scale of the axis in the virtual space is switched. The coordinate scale represents, for example, a scale (scale) of a length (positional coordinate or coordinate axis) in a coordinate space (real space, virtual space). The correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space is, for example, the relationship between the length of 1 m in the real space and the length in the virtual space. For example, in the first correspondence (normal correspondence) of the coordinate scale, the length of 1 m in the real space becomes 1 m (approximately 1 m) in the virtual space. On the other hand, in the second correspondence of the coordinate scales, the length of 1 m in the real space is shorter than 1 m in the virtual space (for example, 10 cm). In the third correspondence of the coordinate scales, the length of 1 m in real space is longer than 1 m in virtual space (eg 10 m). When an event occurs in which the state of the user moving body changes to a given state, the virtual space setting unit 112 sets the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space, for example, first. The correspondence is switched from the second correspondence to the second correspondence, the first correspondence is switched to the third correspondence, and the second correspondence is switched to the third correspondence.

Specifically, when it is determined that an event occurs, the virtual space setting unit 112 performs scale conversion of reduction or enlargement at the time of coordinate conversion from the local coordinate system of the user moving body to the world coordinate system of the virtual space. .. For example, when the local coordinate system of the user moving body is associated with the world coordinate system of the virtual space, the scale conversion of reduction or enlargement is performed. This makes it possible to perform scale conversion for reducing or enlarging the object (character object, HMD object) corresponding to the user moving object, or performing scale conversion for reducing or enlarging the moving distance of the object. By performing coordinate conversion (modeling conversion) from the local coordinate system to the world coordinate system, the position coordinates of the object corresponding to the user moving object can be converted from the position coordinates of the local coordinate system to the position coordinates to the world coordinate system. The scale conversion is, for example, a conversion process in which the position coordinates are multiplied by the scale coefficient.

For example, the virtual space setting unit 112 arranges and sets a virtual camera for the left eye corresponding to the viewpoint of the user's left eye and a virtual camera for the right eye corresponding to the viewpoint of the user's right eye in the virtual space. The HMD object in the virtual space corresponding to the HMD 200 in the real space is an object composed of the virtual camera for the left eye and the virtual camera for the right eye. This HMD object is an object corresponding to the above-mentioned user moving body. The virtual space setting unit 112 performs a scaling conversion that reduces or enlarges the HMD object. As a result, the user wearing the HMD200 can experience virtual reality as if his / her own size became smaller or larger. For example, the virtual space setting unit 112 uses the scale conversion described above to scale the position coordinates of the viewpoints of the user's left eye and right eye in the real space, and the position coordinates of the virtual cameras for the left eye and the right eye in the virtual space. Switch the correspondence with the scale. For example, in the first correspondence, which is a normal correspondence, the scale of the position coordinates of the viewpoints of the user's left eye and right eye and the scale of the position coordinates of the virtual cameras for the left eye and the right eye are the same. There is. Then, when an event occurs, the virtual space setting unit 112 lowers the positions of the virtual cameras for the left eye and the right eye due to this first correspondence, and the distance between the virtual cameras for the left eye and the right eye. Switch to the second correspondence that shortens. By doing so, an image that can be seen when the size of the user moving body is reduced can be generated as a display image of the HMD 200. Alternatively, when an event occurs, the virtual space setting unit 112 raises the positions of the virtual cameras for the left eye and the right eye due to this first correspondence relationship, and the virtual cameras for the left eye and the right eye are located between the virtual cameras. Switch to the third correspondence, which increases the distance. By doing so, an image that can be seen when the size of the user moving body is increased can be generated as a display image of the HMD 200.

Alternatively, when the virtual space setting unit 112 determines that an event occurs, the virtual space in which the user moving body moves is moved from the first virtual space to a second virtual space whose coordinate axis scale is different from that of the first virtual space. Switch to virtual space. The first virtual space is, for example, a coordinate space having the same size as the real space. On the other hand, the second virtual space is a coordinate space wider than the real space or a coordinate space narrower than the real space. For example, when it is determined that an event occurs, the virtual space setting unit 112 switches from the first virtual space to the second virtual space, which is a coordinate space wider than the real space. At this time, the size of the user moving body is not changed. By doing so, the relative size of the user moving body with respect to the second virtual space becomes small, so that an image that can be seen when the size of the user moving body becomes small can be generated as a display image of the HMD 200. Alternatively, when it is determined that an event occurs, the virtual space setting unit 112 switches from the first virtual space to the second virtual space, which is a coordinate space narrower than the real space. At this time, the size of the user moving body is not changed. By doing so, the relative size of the user moving body with respect to the second virtual space becomes large, so that an image that can be seen when the size of the user moving body becomes large can be generated as a display image of the HMD 200.

Further, the virtual space setting unit 112 performs the above switching process when an event that changes the size of the user moving body occurs as an event. For example, the virtual space setting unit 112 performs a process of switching the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space when an event that changes the size of the user moving body to a small size occurs. .. For example, the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space is switched from the above-mentioned first correspondence to the second correspondence. Alternatively, the virtual space setting unit 112 performs a process of switching the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space when an event that changes the size of the user moving body to a large size occurs. .. For example, the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space is switched from the above-mentioned first correspondence to the third correspondence.

The event in which the state of the user moving body changes to a given state includes a changing event of the size of the user moving body, a transformation event of the user moving body, a changing event (transformation) to a different type of moving body, or a user. There are events such as changing the viewpoint and line of sight of moving objects.

Further, the event processing unit 116 determines whether or not an event has occurred based on at least one of the user's behavior information, the behavior information of another user, and the situation of the game. The behavior information of the user or another user is acquired based on, for example, the operation information when the user or another user operates the operation unit 160, or the detection information from the sensor which detects the movement of the user or another user's part. can. For example, in the event processing unit 116, the user points a part such as a game controller or a hand, which is an operation unit 160, toward himself, or another user points a part such as a game controller or a hand toward the user. If it is detected, it is determined that an event has occurred. Alternatively, the event processing unit 116 determines whether or not an event has occurred based on the game situation. The game status is, for example, the behavior of the user moving body, the environment of the user moving body (the situation of the map on which the user moving body moves, the situation around the user moving body, or the situation of time information such as time), or The progress of the game, etc. For example, the event processing unit 116 changes the size of the user moving body from the first size to the second size, and then between the user's position in the real space and the corresponding position of the user moving body in the virtual space. When it is determined that the deviation occurs, an event is generated to return the size of the user moving body from the second size to the original first size.

Further, when the event processing unit 116 determines that the position of the user moving body in the virtual space and the corresponding position of the user in the real space are deviated due to the occurrence of the event, the user moving in the virtual space The state of the user moving body is changed to a given state while modifying the position of the body. The corresponding position of the user in the real space is a position corresponding to the position of the user moving body in the virtual space (a position corresponding to one-to-one). For example, when an event that changes the size of the user moving body is generated, a deviation may occur between the position of the user moving body in the virtual space and the corresponding position of the user in the real space. When it is determined that such a deviation occurs, the event processing unit 116 corrects the position of the user moving body in the virtual space. For example, the position of the user moving body is modified so that the position of the user moving body matches the corresponding position of the user in the real space. For example, when the deviation is equal to or greater than a predetermined threshold value, the position of the user moving body is corrected. Then, the position of the user moving body is corrected in this way to change the state of the user moving body to a given state. For example, the size of the user moving body is changed.

Further, the display processing unit 120 performs a process of changing the display image when correcting the position of the user moving body. For example, when the position of the user moving body is corrected, a special image is displayed as a display image of the HMD 200. This special image is an image prepared for position correction, and is an image displayed in place of the image in the virtual space.

Specifically, the display processing unit 120 performs a process of fading out the display image as a process of changing the display image. The fade-out process is a process of changing an image in virtual space, which is a display image, into an image of a predetermined color. For example, when the position of the moving body of the user is corrected, the image in the virtual space is gradually changed to a fade-out image of a predetermined color. Specifically, the display processing unit 120 performs a process of whitening out the displayed image, and changes the image in the virtual space into a whiteout image. An image of another color such as a blackout image may be used as the fade-out image. Further, when the original display image is restored and displayed after the display image is faded out, it is desirable to perform the fade-in process of the display image.

Further, the display processing unit 120 may perform a process of displaying an object in the virtual space at a position covering the virtual camera as a process of changing the display image. For example, an object prepared for position correction is arranged and displayed at a position covering the virtual camera corresponding to the viewpoint of the user moving object (user). Then, instead of the image in the virtual space, the image of the object is displayed on the HMD 200. This object may cover the field of view at least in the forward direction of the virtual camera. The object may be, for example, a translucent object. For example, when modifying the position of the user moving object, the object may be changed from a transparent object to a semi-transparent object or an opaque object by gradually increasing the translucency from the transparent object.

Further, as shown in FIG. 1, the simulation system of the present embodiment includes the information acquisition unit 111. The information acquisition unit 111 acquires tracking information of the user's viewpoint information (viewpoint position and line-of-sight direction) in the real space. Then, the display processing unit 120 generates an image that can be seen from the virtual camera that is controlled to follow the change of the viewpoint of the user based on the tracking information of the viewpoint information as the display image of the HMD 200. For example, the information acquisition unit 111 acquires tracking information (viewpoint tracking information) of viewpoint information that is at least one of the user's viewpoint position and line-of-sight direction. This tracking information can be obtained, for example, by performing tracking processing of HMD200. The user's viewpoint position and line-of-sight direction may be directly acquired by the tracking process. As an example, the tracking information includes change information of the viewpoint position from the initial viewpoint position of the user (change value of the coordinates of the viewpoint position) and change information of the line-of-sight direction from the initial line-of-sight direction of the user (rotation axis in the line-of-sight direction). It can include at least one of (changes in rotation angle around). The user's viewpoint position and line-of-sight direction (information on the position of the user's head and posture) can be specified based on the change information of the viewpoint information included in such tracking information.

Then, the virtual camera control unit 114 controls the virtual camera based on the tracking information of the acquired viewpoint information. That is, the virtual camera control unit 114 controls the virtual camera so as to follow the change in the viewpoint of the user based on the tracking information of the viewpoint information of the user. Then, the display processing unit 120 generates an image that can be seen from the virtual camera controlled based on the tracking information of the viewpoint information as a display image of the HMD 200. Then, as described above, when it is determined that an event occurs, the virtual space setting unit 112 scales the position coordinates of the user's viewpoint in the real space and the position of the virtual camera corresponding to the viewpoint of the user moving body in the virtual space. Performs the process of switching the correspondence with the scale of the coordinates. Then, in this switching process, the position coordinates of the user's viewpoint in the real space obtained based on the tracking information of the viewpoint information are converted, and the position coordinates of the virtual camera are obtained. For example, the position coordinates of the virtual camera are obtained by performing a conversion process of reducing or increasing the position coordinates of the user's viewpoint in the real space.

Further, in the present embodiment, virtual reality simulation processing is performed as game processing of the game played by the user. The virtual reality simulation process is a simulation process for simulating an event in a real space in a virtual space, and is a process for allowing a user to experience the event virtually. For example, a virtual user corresponding to a user in the real space and a user moving body such as a boarding moving body thereof are moved in the virtual space, and processing is performed to allow the user to experience changes in the environment and surroundings due to the movement.

The processing of the simulation system of the present embodiment of FIG. 1 can be realized by a processing device such as a PC installed in a facility, a processing device (PC) worn by a user, or distributed processing of these processing devices. Alternatively, the processing of the simulation system of the present embodiment may be realized by the server system and the terminal device. For example, it may be realized by distributed processing of the server system and the terminal device.

2. Tracking process Next, an example of tracking process will be described. FIG. 2A shows an example of the HMD200 used in the simulation system of the present embodiment. As shown in FIG. 2A, the HMD 200 is provided with a plurality of light receiving elements 201, 202, 203 (photodiodes). The light receiving elements 201 and 202 are provided on the front surface side of the HMD 200, and the light receiving elements 203 are provided on the right side surface of the HMD 200. Further, a light receiving element (not shown) is also provided on the left side surface, the upper surface, and the like of the HMD.

Further, the user US possesses a game controller 290, and the game controller 290 is also provided with light receiving elements 204, 205, 206 (photodiodes). By using these light receiving elements 204, 205, 206, the position and direction of the game controller 290 can be specified. The movement of the hand or finger of the user US may be detected by a process called so-called leap motion. For example, a controller (not shown) is attached to the HMD200 or the like, and based on this controller, a process of detecting the movement of a hand or a finger is realized. This controller has, for example, a light emitting unit such as an LED that irradiates infrared rays, and a plurality of infrared cameras that photograph hands and fingers illuminated by infrared rays. Then, the movement of the hand or finger is detected based on the image analysis result of the image taken by the infrared camera.

Further, the HMD 200 is provided with a headband 260 for mounting the HMD 200 and a headphone terminal for connecting the headphone 270. As a result, the user US can listen to, for example, a game sound processed by three-dimensional sound (three-dimensional audio). The operation information of the user US may be input by detecting the nodding motion and the swinging motion of the head of the user US by the sensor unit 210 or the like of the HMD 200.

Further, the user US wears a processing device (backpack PC) (not shown) on the back, for example. For example, the user US wears a jacket, and a processing device is attached to the back side of the jacket. The processing device is realized by an information processing device such as a notebook PC. The processing device and the HMD 200 are connected by a cable (not shown). For example, the processing device performs a process of generating an image (game image, etc.) to be displayed on the HMD 200, and the data of the generated image is sent to the HMD 200 via a cable and displayed on the HMD 200. In addition to such image generation processing, this processing device includes various processing (information acquisition processing, virtual space setting processing, moving object processing, virtual camera control processing, game processing, event processing, notification processing, etc.) of the present embodiment. Display processing, sound processing, etc.) can be performed. Each process of the present embodiment may be realized by a processing device (not shown) such as a PC installed in the facility, or may be realized by distributed processing of the processing device and the processing device worn by the user US. ..

As shown in FIG. 2B, base stations 280 and 284 are installed around the simulation system. The base station 280 is provided with light emitting elements 281 and 282, and the base station 284 is provided with light emitting elements 285 and 286. The light emitting elements 281, 282, 285, and 286 are realized by, for example, an LED that emits a laser (infrared laser or the like). The base stations 280 and 284 use these light emitting elements 281, 282, 285 and 286 to emit, for example, a laser radially. Then, the light receiving elements 201, 202, and 203 provided in the HMD 200 of FIG. 2A receive the laser from the base stations 280 and 284, so that the tracking of the HMD 200 is realized and the head position and the head of the user US are oriented. The direction (viewpoint position, line-of-sight direction) can be detected. Further, the light receiving elements 204, 205, and 206 provided in the game controller 290 receive the laser from the base stations 280 and 284, so that the tracking of the game controller 290 is realized and the position and the direction in which the game controller 290 is facing can be detected. Will be.

FIG. 3A shows another example of the HMD200. In FIG. 3A, a plurality of light emitting elements 231 to 236 are provided for the HMD 200. These light emitting elements 231 to 236 are realized by, for example, LEDs. The light emitting elements 231 to 234 are provided on the front side of the HMD 200, and the light emitting element 235 and the light emitting element 236 (not shown) are provided on the back side. These light emitting elements 231 to 236 emit (emit) light in the visible light band, for example. Specifically, the light emitting elements 231 to 236 emit light of different colors from each other.

Then, the image pickup unit 150 shown in FIG. 3B is installed at at least one place (for example, the front side, the front side, the rear side, etc.) around the user US, and the light emitting element 231 of the HMD 200 is provided by the image pickup unit 150. The light of ~ 236 is imaged. That is, the spot light of these light emitting elements 231 to 236 is reflected in the image captured by the imaging unit 150. Then, by performing image processing of this captured image, tracking of the head (HMD) of the user US is realized. That is, the three-dimensional position and the direction (viewpoint position, line-of-sight direction) of the head of the user US are detected.

For example, as shown in FIG. 3B, the imaging unit 150 is provided with the first and second cameras 151 and 152, and the first and second cameras 151 and 152 of these first and second cameras 151 and 152 are provided. By using the captured image, the position of the head of the user US in the depth direction can be detected. Further, the rotation angle (line of sight) of the head of the user US can be detected based on the motion detection information of the motion sensor provided in the HMD 200. Therefore, by using such an HMD200, no matter which direction the user US faces in all directions of 360 degrees around it, the image (user's) in the corresponding virtual space (virtual three-dimensional space) is used. The image seen from the virtual camera corresponding to the viewpoint) can be displayed on the display unit 220 of the HMD 200.

Infrared LEDs may be used as the light emitting elements 231 to 236 instead of visible light. Further, the position and movement of the user's head may be detected by another method such as using a depth camera or the like.

Further, the tracking processing method for detecting the user's viewpoint position and line-of-sight direction (user's position and direction) is not limited to the methods described in FIGS. 2A to 3B. For example, the tracking process may be realized by the HMD 200 alone by using a motion sensor or the like provided in the HMD 200. That is, the tracking process is realized without providing an external device such as the base station 280 and 284 of FIG. 2 (B) and the image pickup unit 150 of FIG. 3 (B). Alternatively, the viewpoint information such as the user's viewpoint position and line-of-sight direction may be detected by various viewpoint tracking methods such as known eye tracking, face tracking, and head tracking.

Further, as the HMD200, a type of so-called smartphone VR or VR goggles may be used. In this type of HMD200, the smartphone is housed in the goggles portion of the HMD200 so that the display portion of the smartphone faces the user's eyes. Inside the goggles portion (VR goggles), an eyepiece for the left eye and an eyepiece for the right eye are built. The user appreciates the VR stereoscopic image by viewing the left eye image and the right eye image displayed on the display unit of the smartphone through the left eye eyepiece and the right eye eyepiece, respectively. be able to. The tracking process for specifying the user's viewpoint position and line-of-sight direction can be realized based on a motion sensor (accelerometer, gyro sensor) or the like built in the smartphone.

3. 3. Method of this Embodiment Next, the method of this embodiment will be described in detail. In the following, the user moving body corresponding to the user will be described as a user character. Further, the methods of the present embodiment include various games (virtual experience games, battle games, RPGs, action games, competition games, sports games, horror experience games, vehicle simulation games such as trains and airplanes, puzzle games, communication games, etc. Alternatively, it can be applied to music games, etc.), and can be applied to other than games.

3.1 Description of the game First, a VR (virtual reality) game realized by the present embodiment will be described. This game is a virtual reality experience game that allows you to move in a virtual space (virtual world). FIG. 4 is an explanatory diagram of a play field FL of a room used in the simulation system of the present embodiment.

A door DR, a desk DK, a bookshelf BS, and the like are arranged in a play field FL (play area, play space) that imitates a room, and windows WD1 and WD2 are provided on the wall. The bookshelf BS, windows WD1, WD2, etc. may be expressed by printing an image of the bookshelf or window on the wall, for example. The user enters the play field FL that imitates this room and enjoys the VR game. In FIG. 4, a plurality of users US1 and US2 are in the room, and these two users US1 and US2 can enjoy the VR game.

Each user US1 and US2 wears, for example, a processing device (backpack PC) on their backs, and the image generated by this processing device is displayed on the HMD1 and HMD2 (head-mounted display device). Specifically, users US1 and US2 are wearing a jacket, and a processing device (backpack PC) is attached to the jacket. Further, a management processing device (not shown) is arranged in the play field FL, and the management processing device performs data synchronization processing (communication processing) between the processing devices worn by the users US1 and US2. Will be done. For example, a synchronization process for displaying a user character (in a broad sense, a user moving body) corresponding to the user US2 on the HMD1 of the user US1 and displaying the user character corresponding to the user US1 on the HMD2 of the user US2 is performed. In addition, an operator is waiting in the room to operate a processing device for management, help users US1 and US2 to attach HMD1, HMD2 and jackets, and perform operation work and guidance work for game progress.

Further, in the room of the play field FL, the base stations 280 and 284 described with reference to FIG. 2 (B) are installed, and the position information (viewpoint position information) of the users US1 and US2 is used by using these base stations 280 and 284. ) And direction information (line-of-sight direction information) can be acquired.

The door DR in FIG. 3 is a door leading to another world. For example, when the door DR is opened, another world (a world different from the scenery of the room) spreads beyond the door DR. Then, the user can experience the virtual reality that can go through the door DR to the other world.

For example, in FIG. 4, the images of the virtual space corresponding to the room are displayed on the HMD1 and HMD2 of the users US1 and US2. Specifically, the object corresponding to the object arranged / installed in the room is arranged in the virtual space corresponding to the room. For example, objects corresponding to the door DR, the desk DK, the bookshelf BS, the windows WD1 and WD2 are arranged. Then, in the virtual space of this room, an image that can be seen from the virtual cameras (first and second virtual cameras) corresponding to the viewpoints (first and second viewpoints) of the users US1 and US2 is generated, and the HMD1 and HMD2 are generated. It is displayed on (first and second display units). In this way, the users US1 and US2 who move while wearing the HMD1 and HMD2 can experience the virtual reality as if they were walking around in a real room.

Then, when the user (US1, US2) opens the door DR for the first time, the other side of the door DR remains a room, and the area of the door DR (the area corresponding to the singular point) is the area of the room. The image is displayed. Then, when the user closes the door DR and then opens the door DR again, the other side of the door DR changes to an ice country. That is, as shown in FIG. 5, an image of the virtual space (VS2) of the ice country is displayed in the area of the door DR (door opening area). At this time, as shown in FIG. 5, an image of a virtual space (VS1) of a room such as a bookshelf BS, windows WD1 and WD2 is displayed around the door DR.

Then, for example, when the user passes through the door DR (passes through the place corresponding to the singular point) and moves to the other side of the door DR, the user character (user moving body) corresponding to the user moves from the virtual space of the room. , Will move to the virtual space of the land of ice. Here, the user character is a character (display object) that moves in the virtual space as the user moves in the real space, and is also called an avatar.

In the present embodiment, since the vast VR space spreads over the entire circumference of the field of view of the user who wears the HMD, the virtual reality of the user can be remarkably improved. That is, the user can feel the virtual reality as if he / she is in a room in the real world or in an ice country. Then, the user character corresponding to the user can freely roam the room or the land of ice, which is a virtual space.

In the present embodiment, a case where the position information of the user in the real space is acquired and the user character is moved in the virtual space based on the acquired position information will be mainly described, but the present embodiment is limited to this. Not done. For example, the user character may be moved in the virtual space based on the operation information or the like from the operation unit 160 (game controller or the like) of FIG. Further, the movement of the user's hand or finger is detected by, for example, a leap motion process. Then, based on this detection result, motion processing for moving the hand or finger parts (part objects) of the user character corresponding to the user is performed. As a result, the user can visually recognize the movement of his / her hand or finger when opening the door DR, for example, by observing the movement of the part of the hand or finger of the user character.

Then, in the present embodiment, one user points the game controller 290 at the other user and performs a predetermined operation to reduce the size of the user character in the virtual space corresponding to the other user, like a dwarf. It is possible to. For example, in FIG. 6, the user US2 points the tip of the game controller 290 toward the user US1 and presses an operation button (not shown) of the game controller 290. As a result, the size of the user character UC1 (FIGS. 12 to 15) in the virtual space corresponding to the user US1 is reduced.

FIG. 9 is an example of an image displayed on the HMD1 of the user US1 before the size of the user character UC1 becomes smaller. The HMD1 of the user US1 displays the user character UC2 corresponding to the user US2 and the door DR behind the user character UC2. For the sake of simplification of the explanation, the door in the real space and the door in the virtual space are referred to as door DR by the same code. The user character UC2 has a light LT corresponding to the game controller 290 in his hand, and the light RY is emitted from the light LT. The game is set so that the size becomes smaller when exposed to this light RY.

FIG. 10 is an example of an image displayed on the HMD1 of the user US1 after the size of the user character UC1 is reduced. In FIG. 10, the user character UC2 and the door DR are displayed larger than those in FIG. For example, an image of the user character UC2 viewed from the viewpoint of the reduced user character UC1 is displayed on the HMD1 of the user US1. As a result, an image in which the user character UC2, which looks like a giant, is approaching can be displayed on the HMD1 of the user US1. Then, the user US1 will be able to enjoy the mystery that he / she becomes smaller and the interaction with the other party of different sizes.

For example, FIG. 7 is a diagram showing the behavior of the user US1 after the size of the user character UC1 is reduced. The user US1 has a line of sight looking up at the huge user character UC2 approaching from the upper side of his / her viewpoint, and raises his / her hand upward as if avoiding it. In this way, according to the present embodiment, the user can experience a powerful virtual reality.

In FIGS. 8 and 11, the user character UC2 corresponding to the user US2 holds the hamburger PA in the virtual space in his hand and protrudes toward the user character UC1. As shown in the image of FIG. 11, the appearance of the giant-like user character UC2 protruding the large hamburger PA toward the user US1 is displayed on the HMD1 of the user US1. For example, this hamburger PA can also be reduced by irradiating the light RY of the light LT. As described above, according to the simulation system of the present embodiment, the users US1 and US2 enjoy unprecedented play such that one user becomes smaller and the other user makes various mischief against it. Will be possible.

3.2 Coordinate scale switching process In this embodiment, in a game in which a user wearing an HMD moves a field in the real space (real world), a virtual space corresponding to the field in the real space is set. Then, when an event (trigger) that changes the state (environmental state) of the user character (avatar) in the virtual space to a given state (smaller, larger) is activated, the scale of the coordinates of the virtual space ( Realize a system to switch the coordinate scale (coordinate scale, coordinate scale). This makes it possible to provide a system that allows you to experience the world view of things becoming smaller and larger using items such as lights in an easy-to-understand manner without failure.

Specifically, in the present embodiment, the virtual space as shown in FIGS. 5 and 9 to 11 is set, and the virtual space corresponding to the user (US1 and US2) in the real space shown in FIGS. 4 and 6 to 8 is set. The user characters (UC1, UC2) are moved in the virtual space. Further, as an image that can be seen from the virtual cameras (virtual cameras for the left eye and the right eye) in this virtual space, a display image of the HMD that the user wears so as to cover the field of view is generated. Then, it is determined whether or not an event has occurred in which the state of the user character (user moving body) changes to a given state. Then, when it is determined that an event (trigger to change to a given state) occurs, a process of switching the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space is performed. For example, in the virtual space, the scale of the coordinates of 1 m in the real space is switched to the scale of the coordinates smaller than 1 m, or the scale of the coordinates larger than 1 m is switched.

In this way, changes in the state of the user character such as the viewpoint state (changes in the viewpoint position, etc.) due to the occurrence of an event can be realized by a simple process of switching the correspondence of the coordinate scales. Then, as shown in FIGS. 10 and 11, a display image reflecting the change in the state such as the size of the user character can be displayed on the HMD. Therefore, it is possible to provide a simulation system that can reflect the change in the state of the user character due to the occurrence of an event in the image of the virtual space.

Various processes can be considered as the process of switching the correspondence between the scales of the coordinates. For example, in FIGS. 12 to 14, when it is determined that an event that changes the state of the user character occurs, the scale of reduction or expansion is performed when the coordinates are converted from the local coordinate system of the user character to the world coordinate system of the virtual space. The conversion is being performed. For example, the correspondence between the scale of the position coordinates of the user's viewpoint in the real space and the scale of the position coordinates of the virtual camera is switched.

In FIG. 12, the user US1 in the real space is wearing the HMD1, and the viewpoint of the left eye is VPL and the viewpoint of the right eye is VPR. Further, the virtual camera for the left eye corresponding to the viewpoint of the left eye of the user character UC1 in the virtual space is referred to as a VCL, and the virtual camera for the right eye corresponding to the viewpoint of the right eye is referred to as a VCR. The object HMDV is an HMD object (HMD component object) in a virtual space corresponding to HMD1 in the real space. The object HMDV is an object composed of a virtual camera VCL for the left eye and a virtual camera VCR for the right eye, and is an object corresponding to the user character UC1. In the present embodiment, by arranging the object HMDV corresponding to the HMD1 in the real space in the virtual space, an image of the virtual space seen from the virtual cameras VCL and VCR is generated.

In FIG. 12, the position coordinates of the virtual cameras VCL and VCR in the virtual space correspond to the position coordinates of the viewpoint VPL and VPR in the real space, and both have the same coordinates, for example. Further, when the user US1 in the real space moves by the distance LD, the user character UC1 in the virtual space also moves by the corresponding distance LDV, for example, LDV = LD. It should be noted that the position coordinates of the viewpoint VPL and VPR and the position coordinates of the virtual cameras VCL and VCR do not necessarily have to completely match, and there is a slight difference (for example, about 10%) between the position coordinates of the two within the adjustment range of the game settings. Difference). That is, the position coordinates of both may be substantially the same.

On the other hand, in FIG. 13, an event occurs in which the size of the user character UC1 becomes smaller. When such an event occurs, in the present embodiment, the coordinate conversion of the user character UC1 from the local coordinate system (XL, YL, ZL) to the virtual space world coordinate system (XW, YW, ZW) is reduced. Perform scale conversion. As a result, the scale conversion of reduction is performed on the object HMDV, which is an object corresponding to the user character UC1. That is, in FIG. 13, the position of the object HMDV is lower (the Y coordinate is smaller) and the distance between the virtual cameras VCL and VCR constituting the object HMDV (distance between cameras) is also shorter than in FIG. By lowering the position of the object HMDV (VCR, VCL), as shown in FIG. 10, an image as if the user character UC2 is viewed from a lower viewpoint is displayed on the HMD1 of the user US1. Further, by shortening the distance between the virtual cameras VCL and VCR, a sense of depth different from that in the real space is obtained, and a sense of depth that can be seen from the small-sized user character UC1 is obtained. Further, by performing such scale conversion, when the user US1 in the real space moves by the distance LD, the user character UC1 in the virtual space moves by the distance LDV shorter than the distance LD, and LDV <LD. Become. That is, by performing the reduction scale conversion, the movement distance LDV of the user character UC1 (object HMDV) is also reduced and shortened.

In FIG. 14, an event occurs in which the size of the user character UC1 becomes large. When such an event occurs, in the present embodiment, the coordinate conversion of the user character UC1 from the local coordinate system (XL, YL, ZL) to the virtual space world coordinate system (XW, YW, ZW) is expanded. Perform scale conversion. As a result, the scale conversion of the enlargement is performed on the object HMDV. That is, in FIG. 14, the position of the object HMDV is higher (the Y coordinate is larger) and the distance between the virtual cameras VCL and VCR constituting the object HMDV is longer than that in FIG. By raising the position of the object HMDV (VCR, VCL), an image as if the user character UC2 is viewed from an upper viewpoint is displayed on the HMD1 of the user US1. Further, by increasing the distance between the virtual cameras VCL and VCR, a sense of depth different from that in the real space is obtained, and a sense of depth that can be seen from the large-sized user character UC1 is obtained. Further, by performing such scale conversion, when the user US1 in the real space moves by the distance LD, the user character UC1 in the virtual space moves by the distance LDV longer than the distance LD, and LDV> LD. Become. That is, by performing the scale conversion of the expansion, the movement distance LDV of the user character UC1 (object HMDV) is also expanded and lengthened.

As described above, in the present embodiment, when an event occurs in which the size of the user character UC1 becomes small, the scale conversion of reduction is performed at the time of coordinate conversion to the world coordinate system. For example, the correspondence between the scale of the position coordinates of the viewpoint VPL and VPR and the scale of the scale of the position coordinates of the virtual camera VCL and VCR is switched from the correspondence of FIG. 12 to the correspondence of FIG. On the other hand, when an event occurs in which the size of the user character UC1 becomes large, the scale conversion of expansion is performed at the time of coordinate conversion to the world coordinate system. For example, the correspondence between the scale of the position coordinates of the viewpoint VPL and VPR and the scale of the scale of the position coordinates of the virtual camera VCL and VCR is switched from the correspondence of FIG. 12 to the correspondence of FIG. By doing so, the process of switching the correspondence between the scales of the coordinates is realized by a simple process of performing scale conversion of reduction or enlargement, and the user can virtually experience the change in the state of the user character due to the occurrence of an event. It becomes possible to make it.

FIG. 15 is an explanatory diagram of another example of the coordinate scale switching process. In FIG. 15, when it is determined that an event that changes the state of the user character occurs, the virtual space in which the user character moves is changed from the first virtual space to a third virtual space whose coordinate axis scale is different from that of the first virtual space. Switching to 2 virtual spaces.

Specifically, in FIG. 15, when an event occurs, the first virtual space VSP1 is switched to the second virtual space VSP2 whose coordinate axis scale is different from that of the first virtual space VSP1. The first virtual space VSP1 is a virtual space corresponding to the real space RSP, the scale of the coordinate axes of the first virtual space VSP1 corresponds to the scale of the coordinate axes of the real space RSP, and the scales of both coordinate axes are For example, they are the same. On the other hand, the scale of the coordinate axes of the second virtual space VSP2 is different from the scale of the coordinate axes of the real space RSP and the first virtual space VSP1, and the second virtual space VSP2 is more than the first virtual space VSP1. Is also a large virtual space. For example, the scales of the XV1, YV1, and ZV1 axes of the first virtual space VSP1 are the same as the scales of the X-axis, Y-axis, and Z-axis of the real space RSP. On the other hand, the scales of the XV2 axis, YV2 axis, and ZV2 axis of the second virtual space VSP2 are different from the scales of the X-axis, Y-axis, and Z-axis of the real space RSP, and define a wider coordinate space. It is a scale of coordinates to be used. For example, the scale of 1 m at each coordinate axis of the second virtual space VSP2 is longer than the scale of 1 m at each coordinate axis of the first virtual space VSP1. The size of the object other than the user character UC1 arranged in the second virtual space VSS2 is larger than the size of the object other than the user character UC1 arranged in the first virtual space VSS1, for example. On the other hand, the size of the user character UC1 is the same in the first virtual space VSP1 and the second virtual space VSP2. By making the second virtual space VSP2 a wide virtual space in this way, the size of the user character UC2 with respect to the virtual space becomes relatively small, and it becomes possible to realize an event in which the size of the user character UC2 is reduced.

When an event that increases the size of the user character UC2 occurs, the first virtual space VSP1 may be switched to the second virtual space VSP2 that is narrower than the first virtual space VSP1. For example, the scale of 1 m at each coordinate axis of the second virtual space VSP2 is made shorter than the scale of 1 m at each coordinate axis of the first virtual space VSP1. Further, in the second virtual space VSP2, the size of the user character UC2 is the same as that of the first virtual space VSP1, but the size of other objects is reduced.

In this way, the process of switching the correspondence of the coordinate scales can be realized by switching the width of the virtual space, and the user can virtually experience the change in the state of the user character due to the occurrence of an event. ..

Further, in the present embodiment, when an event that changes the size of the user character occurs, the processing of switching the correspondence between the scales of the coordinates as shown in FIGS. 12 to 15 is performed. This makes it possible for the user to experience the virtual reality in which the size of the user character becomes smaller or larger. However, various events can be considered as events for switching the correspondence between the scales of the coordinates. For example, it may be an event in which a human user character transforms into a character such as a superhuman having a different appearance by performing a transformation operation. Alternatively, the event may be such that the robot character, which is a user moving body, is transformed into a robot character having a different shape. Alternatively, the event may be such that the user's line of sight becomes the robot's line of sight when the virtual user boarded the boarding moving body such as a robot. Various events can be assumed as events in which the state of the user moving body changes to a given state in this way.

Further, in the present embodiment, it is determined whether or not an event has occurred based on the behavior information of the user, the behavior information of another user, the game situation, and the like.

For example, in FIG. 16A, the user US1 points the game controller 290 toward himself and presses an operation button for reducing the size. When the user US1 performs such an operation, an event in which the size of the user character UC1 corresponding to the user US1 changes occurs. That is, in FIG. 16A, it is determined whether or not an event has occurred based on the behavior information of the user US1. Further, in FIG. 16B, another user US2 points the game controller 290 at the user US1 and presses an operation button for reducing the size. When another user US2 performs such an operation, an event in which the size of the user character UC1 corresponding to the user US1 changes occurs. That is, in FIG. 16B, it is determined whether or not an event has occurred based on the behavior information of another user US2.

The actions of the user and other users who generate the event are not limited to the operations using the game controller 290 as shown in FIGS. 16A and 16B. For example, a site detection sensor detects that a user or another user has performed an action to move a part such as a hand, face, or foot, and generates an event. Alternatively, the posture detection sensor detects that the user or another user has performed an action to change the posture, and an event is generated. Alternatively, an event is generated by detecting with the microphone that the user or another user has performed an utterance action.

Further, in the present embodiment, it may be determined whether or not an event has occurred based on the behavioral status of the user character, the environmental status of the user character, or the game status such as the progress status of the game. For example, when the user character performs a predetermined action such as transformation, or when the user character comes to a predetermined place on the map of the game, an event is generated. Alternatively, an event is generated when the surroundings of the user character are in a predetermined situation, or when the progress of the game is in a predetermined situation (for example, in a boss battle). In this way, the trigger of the event that changes the user character to a given state may be by the user himself or herself, or automatically based on the behavior of another user or the game situation (effect in the progress of the game). It may be a thing.

In this way, an event that changes the user character to a given state is generated according to the behavior of the user or another user or the game situation, and the change in the state of the user character due to the occurrence of the event is notified to the user. It will be possible to have a virtual experience.

3.3 Position correction processing In addition, in the present embodiment, when it is determined that a deviation occurs between the position of the user character in the virtual space and the corresponding position of the user in the real space due to the occurrence of an event, it is virtual. Correct the position of the user character in space. Then, for example, while modifying the position of the user character, the state of the user character is changed to a given state.

For example, in FIG. 17 (A), the user US1 in the real space is moving toward the door DR. That is, the user US1 is moving from the position P1 to the position P2 by the distance LD. In this case, an event occurs in which the size of the user character UC1 in the virtual space corresponding to the user US1 changes, and the user character UC1 changes to a small size. Then, as shown in FIG. 17B, as the user US1 in the real space moves, the user character UC1 in the virtual space also moves from the position PV1 to the position PV2E by the distance LDV. However, when an event occurs in which the size of the user character UC1 becomes smaller, as described with reference to FIG. 13, the movement of the user character UC1 in the virtual space is compared with the distance LD of the movement of the user US1 in the real space. Distance LDV becomes shorter. Then, it is assumed that an event occurs in which the user character UC1 moves by a short distance LDV and is located at the position PV2E, and the user character UC1 returns to the original size. Then, the position PV2E of the user character UC1 in the virtual space of FIG. 17B does not correspond to the position P2 of the user US1 in the real space, and the positions of the two are displaced from each other. That is, the user US1 in the real space moves by the distance LD, but the user character UC1 in the virtual space, which has become smaller in size, moves only the distance LDV shorter than the distance LD. It ends up.

Therefore, in the present embodiment, when it is determined that a deviation occurs between the position PV2E of the user character UC1 in the virtual space and the corresponding position P2 of the user US1 in the real space, as shown in FIG. 17 (C). In addition, the position PV2E of the user character UC1 in the virtual space is modified. Specifically, the position where the user character UC1 is present is corrected by moving the user character UC1 from the position PV2E to the position PV2 corresponding to the position P2 in the real space.

By doing so, even if a situation occurs in which the position of the user and the position of the user character are deviated due to the occurrence of an event, such an unnatural situation can be caused by correcting the position of the user character. It will be possible to prevent it from occurring.

In particular, when the user US1 in the real space is approaching an object such as a door DR as shown in FIG. 17A, such a position correction process is important. That is, even if the user US1 moves a long distance LD and approaches the door DR in the real space as shown in FIG. 17 (A), the user character UC1 is a short distance LDV in the virtual space as shown in FIG. 17 (B). Only moving. Therefore, the user US1 who is viewing the display image of the HMD1 may not notice that the door DR is immediately in front of the user and may hit the door DR. In this regard, if the position correction process as shown in FIG. 17C is performed, when the user character UC1 returns to its original size, the user US1 can be appropriately notified that the door DR is in the immediate vicinity. Become.

By the way, when such a position correction process is performed, an image that momentarily moves from the position PV2E to the position PV2 is displayed on the HMD1 of the user US1 when the event that the user character UC1 returns to the original size occurs. It ends up. Therefore, the user US1 may feel unnatural in such a momentary movement, and in some cases, the user US1 may cause 3D sickness. For example, the difference in the three-dimensional appearance and appearance between the real space and the virtual space makes you feel something like motion sickness.

Therefore, in the present embodiment, when the position of the user character UC1 is corrected as shown in FIG. 18A, a process of changing the displayed image is performed as shown in FIG. 18B. For example, a special image for position correction is displayed on the HMD1 of the user US1. Specifically, as a process of changing the displayed image, a process of fading out the displayed image is performed. For example, as a fade-out process of the display image, a white-out process is performed in which the colors of all the pixels of the display image are gradually brought closer to white. Specifically, at the start timing of the position correction process, a normal virtual space image is displayed on the HMD1, and after a predetermined number of frames (1 frame is 1/60 second), a whiteout process (in a broad sense, the display image is changed). Process to make) start. Then, for example, the entire screen is whitened out before the user character UC1 moves to the position PV2. Then, after the user character UC1 moves to the position PV2, the whiteout is canceled and a normal virtual space image is displayed on the HMD1. That is, the normal virtual space image is faded in and displayed on the HMD1.

By doing so, it is possible to prevent the user US1 from feeling unnatural for momentary movement or causing 3D sickness. For example, by displaying a normal virtual space image at the start timing of the position correction process, it is possible to notify the user US1 to some extent that the position has moved. Then, by whitening out the displayed image after that, it is possible to prevent the user US1 from feeling the momentary movement at a high speed, and it becomes possible to prevent the occurrence of 3D sickness or the like.

The process of changing the displayed image at the time of position correction is not limited to the fade-out process such as the whiteout process. For example, a process of gradually blurring the displayed image or a process of gradually changing the displayed image to a translucent image may be performed. Alternatively, a process of gradually reducing the brightness of the displayed image may be performed.

Further, as a process of changing the displayed image, a process of displaying an object in the virtual space at a position covering the virtual camera may be performed. For example, when the position of the user character UC1 is corrected as shown in FIG. 19A, the object OBS is placed at a position covering the virtual cameras VCL and VCR corresponding to the viewpoint of the user character UC1 as shown in FIG. 19B. Is placed and displayed. For example, an object such as the shape of a robot's hand appears and is placed at a position that covers the field of view of the user character UC1. By doing so, when the position of the user character UC1 is corrected, the HMD1 of the user US1 in the real space will display an image as if it is covered with the object OBS. Therefore, it is possible to suppress the display of an image in which the user character UC1 moves momentarily, and it is possible to prevent the user US1 from feeling unnatural or causing 3D sickness.

As the object to be arranged so as to cover the field of view, an object may be selected and made to appear so that the user US1 does not feel unnatural in the game setting or the game progress. However, the objects arranged so as to cover the field of view are not limited to such objects. Further, instead of a completely opaque object, a translucent object may be placed at a position that covers the field of view of the user character.

The change processing of the display image as described above may be performed, for example, when the difference between the positions PV2E and PV2 in the position correction processing of FIGS. 18A and 19A exceeds a given threshold value. good. For example, even when the difference between the positions PV2E and PV2 is small, if the display image change processing such as whiteout processing is performed, such display image change processing is frequently performed, and the user feels unnatural. Such a situation occurs. In this respect, the occurrence of such a situation can be prevented by performing the display image change processing only when the difference between the positions PV2E and PV2 exceeds a given threshold value.

4. Detailed processing Next, a detailed processing example of the present embodiment will be described with reference to the flowchart of FIG.

First, the virtual space setting process is performed (step S1). Then, in the set virtual space, a process of moving the user character is performed (step S2). For example, the user character in the virtual space is moved so as to be linked to the movement of the user in the real space.

Next, it is determined whether or not an event that changes the state of the user character occurs (step S3). For example, it is determined whether or not an event that changes the size of the user character occurs. Then, when an event occurs (when an event trigger occurs), it is determined whether or not a deviation occurs between the position of the user character and the corresponding position of the user in the real space (step S4). For example, it is determined whether or not the deviation between the position of the user character and the corresponding position of the user in the real space exceeds a given threshold value. Then, when it is determined that the deviation occurs, the position of the user character is corrected (step S5). For example, as shown in FIG. 17C, the process of correcting the position of the user character is started. Then, the coordinate scale switching process is performed (step S6). For example, the coordinate scale switching process for returning the size of the user character to the original size is executed. This makes it possible to prevent the user from feeling unnatural or causing 3D sickness during the process of correcting the position of the user character.

Although the present embodiment has been described in detail as described above, those skilled in the art will easily understand that many modifications that do not substantially deviate from the novel matters and effects of the present invention are possible. Therefore, all such modifications are included in the scope of the present invention. For example, in the specification or drawings, terms (user character, fade-out processing, white-out processing, etc.) described at least once together with different terms (user moving body, display image change processing, etc.) in a broader sense or synonymous are described in the specification. It can be replaced with the different term anywhere in the book or drawing. Further, the position information acquisition process, the virtual space setting process, the moving body movement process, the event process, the display process, the game process, the notification process, the correspondence relationship switching process, and the like are not limited to those described in the present embodiment. , The methods, processes, and configurations equivalent to these are also included in the scope of the present invention. The present invention can also be applied to various games. The present invention can also be applied to various simulation systems such as arcade game machines, home game machines, and large-scale attraction systems in which a large number of users participate.

US1, US2, US user, UC1, UC2 user character (user moving body),
VPL, VPR viewpoint, VCL, VCR virtual camera,
RSP real space, VSP1 first virtual space, VSP2 second virtual space,
FL playfield, DR door, DK desk, BS bookshelf, WD1, WD2 window,
LT light, RY ray, LD, LDV distance, OBS object,
P1, P2, PV1, PV2E, PV2 position,
100 processing unit, 102 input processing unit, 110 arithmetic processing unit, 111 information acquisition unit,
112 virtual space setting unit, 113 moving object processing unit, 114 virtual camera control unit,
115 game processing unit, 116 event processing unit, 117 notification processing unit,
120 display processing unit, 130 sound processing unit, 140 output processing unit,
150 image pickup unit, 151 first camera, 152 second camera, 160 operation unit,
170 storage, 172 object information storage, 178 drawing buffer,
180 Information storage medium, 192 sound output section, 194 I / F section,
195 Portable information storage medium, 196 Communication unit,
200 HMD (Head-mounted display), 201-206 light receiving element, 210 sensor unit,
220 display unit, 231 to 236 light emitting element, 240 processing unit,
260 headbands, 270 headphones, 280, 284 base stations,
281, 282, 285, 286 light emitting elements, 290 game controllers

Claims (10)

A virtual space setting unit that performs virtual space setting processing, and
A moving body processing unit that performs a process of moving a user moving body in the virtual space corresponding to the user in the real space in which the user can move in the virtual space.
The event processing unit that processes events and
A display processing unit that generates a display image that can be seen from a virtual camera in the virtual space,
Including
The event processing unit
It is determined whether or not an event has occurred in which the state of the user moving body changes to a given state.
The virtual space setting unit
When it is determined that the event occurs, a switching process is performed to switch the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space.
The event processing unit
When the user moves from the position P1 to the position P2 in the real space, the event occurs in a state where the user moving body moves from the position PV1 to the position PV2E in the virtual space. When it is determined that a deviation occurs between the position P2 of the user in the space and the position PV2E of the user moving body in the virtual space, the position of the user moving body in the virtual space is moved from the position PV2E. A simulation system characterized in that the state of the user moving body is changed to the given state while being modified to the position PV2 . In claim 1,
The virtual space setting unit
A simulation system characterized in that when it is determined that the event occurs, scale conversion of reduction or enlargement is performed at the time of coordinate conversion from the local coordinate system of the user moving body to the world coordinate system of the virtual space. In claim 1,
The virtual space setting unit
When it is determined that the event occurs, the virtual space in which the user moving body moves is switched from the first virtual space to the second virtual space whose coordinate axis scale is different from that of the first virtual space. A simulation system characterized by this. In any of claims 1 to 3,
The virtual space setting unit
A simulation system characterized in that the switching process is performed when an event that changes the size of the user moving body occurs as the event. In any of claims 1 to 4,
The event processing unit
A simulation system for determining whether or not an event has occurred based on at least one of the user's behavior information, another user's behavior information, and a game situation. In any of claims 1 to 5 ,
The display processing unit
A simulation system characterized in that a process of changing the displayed image is performed when the position of the user moving body is corrected. In claim 6 ,
The display processing unit
A simulation system characterized in that, as a process of changing the displayed image, a process of fading out the displayed image is performed. In claim 6 ,
The display processing unit
A simulation system characterized in that, as a process of changing the displayed image, a process of displaying an object in the virtual space at a position covering the virtual camera is performed. In any of claims 1 to 8 ,
Includes an information acquisition unit that acquires tracking information of the user's viewpoint information in the real space.
The display processing unit
A simulation system characterized in that an image seen from the virtual camera, which is controlled to follow a change in the viewpoint of the user based on the tracking information of the viewpoint information, is generated as the display image. A virtual space setting unit that performs virtual space setting processing, and
A moving body processing unit that performs a process of moving a user moving body in the virtual space corresponding to the user in the real space in which the user can move in the virtual space.
The event processing unit that processes events and
As a display processing unit that generates a display image of a head-mounted display device worn by the user so as to cover the field of view as an image that can be seen from a virtual camera in the virtual space.
Make your computer work
The event processing unit
It is determined whether or not an event has occurred in which the state of the user moving body changes to a given state.
The virtual space setting unit
When it is determined that the event occurs, a switching process is performed to switch the correspondence between the coordinate scale in the real space and the coordinate scale in the virtual space.
The event processing unit
When the user moves from the position P1 to the position P2 in the real space, the event occurs in a state where the user moving body moves from the position PV1 to the position PV2E in the virtual space. When it is determined that a deviation occurs between the position P2 of the user in the space and the position PV2E of the user moving body in the virtual space, the position of the user moving body in the virtual space is moved from the position PV2E. A program characterized by changing the state of the user moving body to the given state while modifying the position PV2 .

Images