JP6672508B2 - Virtual space experience system - Google Patents

Description

  The present invention relates to a virtual space experience system for recognizing that a player himself is present in a virtual space displayed by a 3D model.

  BACKGROUND ART Conventionally, a virtual space sensation system has been known in which a virtual space is generated, an image of the virtual space is recognized by a player on a head-mounted display or the like, and the player itself is recognized as being present in the virtual space.

  As a virtual space sensation system of this kind, there is a virtual space sensation system in which a motion of a player in a real space is detected by a motion capture device or the like, and an avatar corresponding to the player is operated in a virtual space according to the detected motion (for example, see Patent Reference 1).

JP 2010-257461 A

  By the way, in the conventional virtual space sensation system described in Patent Literature 1, in order to more reliably recognize that the player himself is present in the virtual space, the amount of movement of the coordinates of the player in the real space is required. It is preferable that the movement amount of the coordinates of the avatar in the virtual space be as close as possible.

  However, if the movement amount of the coordinates of the player and the avatar is brought closer to each other, there is a problem that the size of the virtual space is limited by the size of the real space.

  As a method of solving this problem, there is a method of connecting a plurality of virtual spaces generated corresponding to each of a plurality of real spaces within the virtual space. For example, there is a method in which two virtual spaces are generated, and the two virtual spaces are connected by steps that exist only in the virtual space.

  However, if the virtual space is expanded by such a method, there is a problem that a player strongly feels a deviation from the real space at a connection portion of the virtual space, and causes the player to feel a strong sense of discomfort. Was.

  For example, if the virtual space is connected by the stairs as described above, when moving from one virtual space to the other virtual space, the stairs may go up and down on a flat ground in the real space. Such an operation has to be performed, and the recognition in the virtual space is deviated from the sense in the real space, which causes a problem that the player feels strong discomfort.

  The present invention has been made in view of the above points, and it is an object of the present invention to provide a virtual space sensation system that enables a player to recognize a virtual space that is extended from a real space while suppressing a sense of incongruity that the player can remember. Aim.

In order to achieve the above object, the virtual space sensation system of the present invention includes:
A virtual space generation unit that generates a virtual space corresponding to a real space in which the first player and the second player exist;
In one virtual space, a first avatar that operates in the virtual space in response to the operation of the first player, and a second avatar that operates in the virtual space in response to the operation of the second player An avatar generator that generates an avatar of
A player coordinate detector that detects coordinates of the first player and the second player;
An avatar coordinate determination unit that determines the coordinates of the first avatar based on the detected coordinates of the first player, and determines the coordinates of the second avatar based on the coordinates of the second player. When,
A virtual space image determining unit that determines an image of the virtual space to be recognized by the first player and the second player based on the coordinates of the first avatar and the coordinates of the second avatar;
A virtual space image display for causing the first player and the second player to recognize an image of the determined virtual space,
The virtual space image determining unit, when the coordinates of the first avatar are corrected so as to cause a deviation in the correspondence between the coordinates of the first player and the coordinates of the first avatar, the The image of the first avatar to be recognized by the second player is changed based on a change in relative coordinates between the first avatar and the second avatar.

  Here, the “image of the virtual space” includes, in addition to the image of the background of the virtual space, an image of another avatar, an image of an object existing only in the virtual space, and an image of an object existing in the virtual space corresponding to the real space. An image, such as an image, that allows the player to infer the coordinates of the avatar corresponding to the player in the virtual space.

  In addition, here, `` correction '' that causes a deviation in the correspondence between the coordinates of the player and the coordinates of the avatar is not only moving the coordinates of the avatar itself without relating to the movement of the coordinates of the player, but also moving the coordinates of the player. This refers to changing the movement amount of the coordinates of the avatar with respect to the movement amount of the coordinates.

  When the first avatar corresponding to the first player and the second avatar corresponding to the second player exist in one virtual space, an image of the avatar corresponding to the other player for one player Is one criterion for recognizing the size of the virtual space.

  Therefore, in the virtual space sensation system of the present invention, when the coordinates of the first avatar are corrected, the virtual avatar corresponds to the second avatar based on a change in relative coordinates between the first avatar and the second avatar. The image of the first avatar recognized by the second player is changed.

  Thereby, in this virtual space experience system, the second player changes the image of the first avatar, which serves as a reference for the size of the virtual space, so that the second player is provided with a virtual space extended from the real space. Recognition can be performed while suppressing the sense of incongruity that makes the space memorable.

In the virtual reality experience system of the present invention,
A virtual space sound determination unit that determines a sound to be recognized by the first player and the second player based on the coordinates of the first avatar and the coordinates of the second avatar;
Preferably, a virtual space sound generator for causing the first player and the second player to recognize the determined sound is provided.

  As described above, when the player is made to recognize not only an image corresponding to the coordinates of the avatar but also a voice (for example, a voice of another player heard from a position corresponding to the coordinates), when the coordinates of the avatar are corrected, However, the voice recognized by the player also changes. Thereby, the player can accept the deviation of the correspondence between the coordinates of the player and the coordinates of the avatar without further discomfort.

FIG. 1 is a schematic diagram showing a schematic configuration of a virtual space sensation system according to an embodiment. FIG. 2 is a block diagram showing the configuration of the virtual space sensation system in FIG. 1. 2 is a flowchart showing processing executed by the virtual space sensation system of FIG. 1 at a stage at the start of a game and at a stage where a trigger event is not recognized. FIG. 4A is a perspective view showing a state at the start of the game, FIG. 4A is a view showing a player state, and FIG. 4B is a view showing an avatar state. 3 is a flowchart showing a process executed by the virtual space sensation system of FIG. 1 in a first stage of the game. FIG. 6A is a perspective view showing a state at the start of the first stage of the game, FIG. 6A is a view showing a player state, and FIG. 6B is a view showing an avatar state. FIG. 7A is a perspective view showing a state during the first stage of the game, FIG. 7A is a view showing a player state, and FIG. 7B is a view showing an avatar state. FIG. 8A is a perspective view showing a state when the first stage of the game is completed, FIG. 8A is a view showing a state of a real space, and FIG. 8B is a view showing a state of a virtual space. 3 is a flowchart showing processing executed by the virtual space sensation system in FIG. 1 in a second stage of the game. FIG. 10A is a perspective view showing a state at the start of the second stage of the game, FIG. 10A is a view showing a state of a real space, and FIG. 10B is a view showing a state of a virtual space. FIG. 11A is a perspective view showing a state at the time of progressing to the second stage of the game. FIG. 11A is a view showing a state of a real space, and FIG. 11B is a view showing a state of a virtual space. FIG. 12A is a perspective view showing a state at the time of completion of the second stage of the game, FIG. 12A is a view showing a state of a real space, and FIG. 12B is a view showing a state of a virtual space. 5 is a flowchart showing a process executed by the virtual space sensation system in FIG. 1 in a third stage of the game. FIG. 14A is a perspective view showing a state at the start of the third stage of the game, FIG. 14A is a view showing a state of a real space, and FIG. 14B is a view showing a state of a virtual space. FIG. 15A is a perspective view showing a state at the time of proceeding to the third stage of the game, FIG. 15A is a view showing a state of a real space, and FIG. 15B is a view showing a state of a virtual space. FIG. 16A is a perspective view showing a state at the time of completion of the third stage of the game, FIG. 16A is a view showing a state of a real space, and FIG. 16B is a view showing a state of a virtual space.

  Hereinafter, a virtual space sensation system S according to an embodiment will be described with reference to the drawings.

  First, a schematic configuration of the virtual space sensation system S will be described with reference to FIG.

  As shown in FIG. 1, the virtual space sensation system S includes a plurality of signs 1 attached to a player P existing in the real space RS, a camera 2 for photographing the player P (that is, the sign 1), and a virtual space VS ( The server 3 includes a server 3 for determining images and sounds of FIG. 4B and the like, and a head-mounted display (hereinafter, referred to as “HMD4”) that allows a player to recognize the determined images and sounds. The camera 2, the server 3, and the HMD 4 can mutually transmit and receive information wirelessly.

  The plurality of markers 1 are attached to the head, both hands, and both feet of the player P via the HMD 4, gloves, and shoes worn by the player P.

  A plurality of cameras 2 are installed so that a range in which the player P can move in the real space RS where the player P exists can be photographed from multiple directions.

  The server 3 detects the sign 1 from the plurality of images taken by the camera 2, recognizes the coordinates and the posture of the player P based on the position of the detected sign 1 in the real space RS, and recognizes the coordinates and the posture. Based on this, an image and a sound to be recognized by the player P are determined.

  The HMD 4 is mounted on the head of the player P. The HMD 4 includes a monitor 41 (virtual space image display) for allowing the player P to recognize the image of the virtual space determined by the server 3 by the player P, and a sound of the virtual space determined by the server 3 by the player P And a microphone (not shown) for collecting the voice of the player P (see FIG. 2).

  When playing a game or the like using the virtual space sensation system S, the player P recognizes only images and sounds in the virtual space and recognizes that the player P itself exists in the virtual space.

  The virtual space sensation system S includes a so-called motion capture device configured by the sign 1, the camera 2, and the server 3 as a system for recognizing the coordinates of the player P in the real space. However, the virtual space experience system of the present invention is not limited to such a configuration.

  For example, when a motion capture device is used, in addition to the above-described configuration, a camera and a server in which a camera and a server are connected by wire may be used, and the numbers of signs and cameras are different from the above-described configuration (for example, , One for each). Further, instead of the motion capture device, a device that detects only the coordinates of the player may be used.

  Next, the configuration of the server 3 will be described in detail with reference to FIG.

  The server 3 includes one or a plurality of electronic circuit units including a CPU, a RAM, a ROM, an interface circuit, and the like. As shown in FIG. 2, the server 3 includes a display image generating unit 31, a player information detecting unit 32, a trigger event recognizing unit 33, and an avatar coordinate determining unit. A unit 34, a virtual space image determination unit 35, and a virtual space sound determination unit 36 are provided.

  The display image generation unit 31 generates an image to be recognized by the player P via the monitor 41 of the HMD 4. The display image generation unit 31 includes a virtual space generation unit 31a, an avatar generation unit 31b, and a moving object generation unit 31c.

  The virtual space generation unit 31a generates an image serving as a background of the virtual space and an image of an object existing in the virtual space.

  The avatar generation unit 31b generates an avatar that operates in response to the operation of the player P in the virtual space. When there are a plurality of players P, the avatar generation unit 31b generates a plurality of avatars so as to correspond to each of the players P. The avatar moves in the virtual space in response to the movement of the corresponding player P in the real space (that is, the movement of the coordinates and the change of the posture).

  The moving object generation unit 31c generates a moving object that has no corresponding object in the real space RS in the virtual space and can be connected to the avatar in the virtual space.

  Here, the “moving object” is one that makes the player predict whether or not the avatar moves differently from the actual movement of the player P when the avatar is connected (regardless of whether or not conscious). Should be fine. For example, in addition to those used for movement in a real space such as an elevator, a log flowing through a river that can jump on, a floor that is likely to collapse when standing on it, a jumping stand, a wing to assist jumping, and the like are applicable.

  Here, the “connection” between the avatar and the moving object means that the player can predict that movement of the moving object, change in the shape of the moving object, etc., will affect the coordinates of the avatar. . For example, the avatar gets into the elevator, the avatar rides on a log flowing through the river, stands on a floor where the avatar is likely to collapse, stands on a jumping stand, and the avatar attaches wings to assist jumping.

  Image data of the player P including the marker 1 captured by the camera 2 is input to the player information detection unit 32. The player information detection unit 32 has a player posture detection unit 32a and a player coordinate detection unit 32b.

  The player posture detection unit 32a extracts the marker 1 from the input image data of the player P, and detects the posture of the player P based on the extraction result.

  The player coordinate detector 32b extracts the marker 1 from the input image data of the player P, and detects the coordinates of the player P based on the extraction result.

  When the player P performs a predetermined operation in the real space (that is, when the avatar corresponding to the player P performs a predetermined operation in the virtual space), the trigger event recognition unit 33 performs a trigger event based on the operation. Recognizes that an error has occurred. The trigger event is an event that occurs in response to the movement of the player P, such as when the player P moves to a predetermined coordinate, or the player P takes a predetermined posture, and the player P does not recognize the occurrence. There may be.

  The avatar coordinate determination unit 34 determines the coordinates of the avatar corresponding to the player P in the virtual space based on the coordinates of the player P in the real space RS detected by the player coordinate detection unit 32b.

  In addition, when the trigger event recognition unit 33 recognizes the trigger event, the avatar coordinate determination unit 34 determines, in a predetermined period or a predetermined range, or in a predetermined period and a predetermined range, depending on the type of the recognized trigger event. The coordinates of the avatar are corrected so as to cause a shift in the correspondence between the coordinates of the player and the coordinates of the avatar.

  In addition, here, `` correction '' that causes a deviation in the correspondence between the coordinates of the player and the coordinates of the avatar is not only moving the coordinates of the avatar itself without relating to the movement of the coordinates of the player, but also moving the coordinates of the player. This refers to changing the movement amount of the coordinates of the avatar with respect to the movement amount of the coordinates.

  The virtual space image determination unit 35 determines an image of the virtual space to be recognized by the player P corresponding to the avatar via the monitor 41 of the HMD 4 based on the coordinates of the avatar.

  Here, the “image of the virtual space” includes, in addition to the image of the background of the virtual space, an image of another avatar, an image of an object existing only in the virtual space, and an image of an object existing in the virtual space corresponding to the real space. An image, such as an image, that allows the player to infer the coordinates of the avatar corresponding to the player in the virtual space.

  The virtual space sound determination unit 36 determines the sound to be recognized by the player P corresponding to the avatar via the speaker 42 of the HMD 4 based on the coordinates of the avatar.

  Next, with reference to FIGS. 2 to 16, a process executed by the virtual space sensation system S when playing a game using the virtual space sensation system S will be described. FIGS. 3, 5, 9, and 13 are flowcharts showing the processing performed by the virtual space sensation system S at each stage of the game. Here, the game performed in the present embodiment is a game in which two players move in cooperation and aim at each goal point from each start point.

  First, with reference to FIG. 2, FIG. 3, and FIG. 4, a process executed by the virtual space sensation system S at a stage at the start of a game and at a stage where a trigger event is not recognized will be described.

  When the signal instructing the start of the game is recognized, first, the display image generation unit 31 of the server 3 generates the virtual space VS, the first avatar A1 and the second avatar A2, and the moving object (FIG. 3 / STEP01). ).

  Specifically, the virtual space generation unit 31a of the display image generation unit 31 generates a virtual space VS and various objects existing in the virtual space VS. The avatar generation unit 31b of the display image generation unit 31 determines whether the first avatar A1 (first avatar) corresponding to the first player P1 (first player) and the second avatar P2 (second player) corresponding to the second player P2 (second player). Generate 2 avatars A2 (second avatars). The moving object generating unit 31c of the display image generating unit 31 generates a moving object such as an elevator VS1 described later.

  As shown in FIG. 4B, the virtual space VS generated by the processing of STEP01 includes a first avatar A1 and a second avatar A2, an elevator VS1, a floor VS2, a jump VS3, and a jump stand VS3, as well as a real space RS. The object related to the trigger event, such as the button VS4 generated at the position corresponding to the whiteboard RS1 (see FIG. 4A) installed at, is installed.

  Next, the player information detecting unit 32 of the server 3 acquires image data captured by the camera 2 and, based on the image data, a first player P1 and a second player P2 (hereinafter collectively referred to as “players”). P ”) in the physical space RS (see FIG. 4A) (FIG. 3 / STEP 02).

  Next, the avatar coordinate determination unit 34 of the server 3 determines the coordinates of the first avatar A1 in the virtual space VS based on the coordinates of the first player P1 in the real space RS detected by the player information detection unit 32, The coordinates of the second avatar A2 in the virtual space VS are determined based on the coordinates of the two players P2 in the real space RS (FIG. 3 / STEP03).

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine the image and the sound to be recognized by the player P based on the coordinates and the posture of the first avatar A1 and the second avatar A2 in the virtual space VS. (FIG. 3 / STEP 04).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41 and generates sound on the speaker 42 (FIG. 3 / STEP05).

  Next, the player information detection unit 32 of the server 3 determines whether the movement of the coordinate or the change in the posture of the first player P1 or the second player P2 in the real space RS is detected (FIG. 3 / STEP06).

  When the movement of the coordinates or the change in the posture of the first player P1 or the second player P2 in the real space RS is detected (YES in STEP06), the process returns to STEP03, and the processes after STEP03 are executed again.

  If the movement of the coordinates or the change in the posture of the first player P1 or the second player P2 in the real space RS is not detected (NO in STEP06), the server 3 recognizes a signal instructing the end of the game. It is determined whether or not the process has been performed (FIG. 3 / STEP07).

  If the signal instructing the end of the game has not been recognized (NO in STEP07), the process returns to STEP06, and the processing after STEP06 is executed again. If the signal instructing the end of the game is recognized (YES in STEP07), the virtual space sensation system S ends the current process.

  With the above processing, after the game is started, the first avatar A1 corresponding to the first player P1, the second avatar A2 corresponding to the second player P2, and the elevator VS1, which is a moving object, are placed in the virtual space VS. A plurality of objects including a floor VS2 and a jump platform VS3 are installed.

  Then, the first player P1 and the second player P2 are themselves virtual via the first avatar A1 and the second avatar A2 respectively corresponding to the image displayed on the HMD 4 attached thereto and the generated sound. It recognizes that it exists in the space VS and can operate freely.

  Next, with reference to FIG. 2, FIG. 5 to FIG. 8, the processing executed by the virtual space sensation system S in the first stage of the game will be described. In the first stage, the state of the virtual space VS becoming the state shown in FIG. 6B (that is, the movement of the first avatar A1 on the mark VS1a of the elevator VS1) corresponds to the occurrence of the trigger event.

  In the first stage, first, it is determined whether or not the trigger event recognition unit 33 of the server 3 has recognized the occurrence of the trigger event based on the operation of the first player P1 (FIG. 5 / STEP 11).

  Specifically, the trigger event recognition unit 33 uses the virtual space VS to move the first avatar A1 corresponding to the first player P1 over the mark VS1a of the elevator VS1 (see FIG. 6B). It is determined whether the first player P1 has moved in the Y-axis direction (see FIG. 6A).

  Then, when the coordinates of the first player P1 are located at the predetermined positions, the trigger event recognition unit 33 recognizes that a trigger event has occurred.

  At this time, since the elevator VS1 is a moving object, the first player P1 and the second player P2 recognize that the first avatar A1 corresponding to the first player has been connected to the moving object.

  When the occurrence of the trigger event is recognized (YES in STEP11), the avatar coordinate determination unit 34 of the server 3 causes the first avatar riding on the elevator VS1 to move along with the movement of the elevator VS1 that is the moving body. The coordinates of A1 are moved (FIG. 5 / STEP 12).

  Specifically, the avatar coordinate determination unit 34 sets the coordinates of the first avatar A1 in a predetermined direction in accordance with the movement of the elevator VS1, which is triggered by the occurrence of the trigger event. Move a fixed amount.

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine an image and a sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after the movement (FIG. 5 / STEP13).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41 and generates sound on the speaker 42 (FIG. 5 / STEP 14).

  After executing the processing in STEP 14 or when the occurrence of the trigger event is not recognized (NO in STEP 11), the virtual space sensation system S ends the current processing.

  During the processing in STEPs 12 to 14, in the real space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are at the start of the first stage (FIG. 6A), at the time of the first stage progress (FIG. 7A), and at the first stage. At the end of one stage (FIG. 8A), it has not moved.

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 are at the start of the first stage (FIG. 6B), when the first stage is progressing (FIG. 7B), and at the end of the first stage (FIG. 8B). In), along with the movement of the elevator VS1, which is a moving body, it moves in a direction away from the second avatar A2 in the X-axis direction and moves upward in the Z-axis direction. Here, the moving speed of the coordinates of the first avatar A1 is slower in the Z-axis direction than in the X-axis direction.

  That is, by the processing of STEP12 to STEP14, the coordinates of the first avatar A1 move independently of the movement of the coordinates of the first player P1, and the coordinates of the first player P1 in the real space RS and the virtual space of the first avatar A1. A deviation occurs in the correspondence relationship with the coordinates in the VS.

  Then, the image of the virtual space VS recognized by the player P changes according to the shift of the correspondence.

  Specifically, in the image of the virtual space VS recognized by the first player P1, the image of the second avatar A2 has a size and an angle based on a change in the relative coordinates of the first avatar A1 and the second avatar A2. , Posture and the like change. The size, angle, and the like of the images other than the second avatar A2 change based on the movement of the coordinates of the first avatar A1.

  In the image of the virtual space VS recognized by the second player P2, the size, angle, and the like of the image of the elevator VS1, which is a moving object, change based on the movement of the elevator VS1. The size, angle, posture, and the like of the image of the first avatar A1 change based on the change in the relative coordinates of the first avatar A1 and the second avatar A2 accompanying the movement of the elevator VS1. In addition, images other than the elevator VS1 and the first avatar A1 do not change.

  Also, the voice of the virtual space VS (for example, the voice of the avatar determined based on the voice of another player or the sound generated from the moving object) is also transmitted to the first avatar A1 by the elevator in the same manner as the image of the virtual space VS. It changes according to the movement together with VS1.

  Then, the player P recognizes the virtual space VS which is extended more than the real space RS by recognizing the deviation of the correspondence through the change of the image and the sound of the virtual space VS. More specifically, the player P moves the virtual space VS in the X-axis direction and the Z-axis direction as the first avatar A1 moves in the X-axis direction and the Z-axis direction as the first avatar A1 moves in the X-axis direction and the Z-axis direction. Is recognized as being extended beyond the real space RS.

  Further, in the trigger event in the first stage, the first player P1 moves so that the first avatar A1 stands on the mark VS1a in a state where the first avatar A1 and the elevator VS1 as the moving body are connected (connected). It is supposed to.

  That is, the movement of the coordinates of the first avatar A1 for causing a shift in the correspondence relationship is performed in a state in which the player P can predict that the movement of the elevator VS1, which is a moving object, affects the coordinates of the first avatar A1. Occur.

  With this prediction, the player P can accept the deviation of the correspondence between the coordinates of the first player P1 in the real space RS and the coordinates of the first avatar A1 in the virtual space VS without any discomfort.

  By the way, as described above, the moving speed of the coordinates of the first avatar A1 caused by the movement of the elevator VS1 is slower in the Z-axis direction than in the X-axis direction.

  As a result, the deviation of the correspondence is large in the X-axis direction and small in the Z-axis direction. As a result, the player P greatly expands in the X-axis direction in the direction away from the second avatar A2 with respect to the real space RS, and in the Z-axis direction, the degree of expansion in the X-axis direction is larger than that in the X-axis direction. Recognize the virtual space VS that has been expanded to a small size.

  Further, the movement of the coordinates of the first avatar A1 in the X direction and the movement in the Z axis direction for causing a shift in the correspondence are performed simultaneously. As a result, the time during the process of causing a shift in the correspondence (that is, the time during which the player P easily feels uncomfortable) is concentrated. As a result, the player P does not often feel uncomfortable.

  Next, with reference to FIG. 2 and FIGS. 9 to 12, a process executed by the virtual space sensation system S in the second stage of the game will be described. In the second stage, the state of the virtual space VS becoming the state shown in FIG. 11B (that is, the second avatar A2 performs the operation of pressing the button VS4) corresponds to the generation of the trigger event.

  In the second stage, first, the avatar coordinate determination unit 34 of the server 3 determines whether or not the first avatar A1 is connected to the moving body (FIG. 9 / STEP 21).

  Specifically, the avatar coordinate determination unit 34 moves the coordinates of the first avatar A1 corresponding to the first player P1 onto the collapsed floor VS2 which is a moving object in the virtual space VS (FIG. 10B). It is determined whether the coordinates of the first player P1 have moved in the Y-axis direction in the real space RS (see FIG. 10A).

  In the second stage, since the floor VS2 is a moving body, the first player P1 and the second player P2 move the first avatar A1 by recognizing that the first avatar A1 has moved onto the floor VS2. You will recognize that you are connected to your body.

  The determination in STEP 21 is repeated at a predetermined cycle until it is determined that the first avatar A1 has connected to the moving object (moved on the floor VS2) (every time a negative determination is made in STEP 21).

  When the first avatar A1 is connected to the moving body (in the case of YES in STEP21), it is determined whether or not the trigger event recognition unit 33 of the server 3 has recognized the occurrence of the trigger event based on the operation of the second player P2. It is determined (FIG. 9 / STEP 22).

  Specifically, the trigger event recognition unit 33 causes the second avatar A2 corresponding to the second player P2 to take a posture in which the second avatar A2 corresponding to the second player P2 touches the button VS4 at a position near the button VS4 in the virtual space VS (see FIG. 10B). Then, it is determined whether or not the second player P2 has moved in the Y-axis direction to a predetermined posture in the physical space RS (see FIG. 10A).

  Then, when the coordinates of the second player P2 move to the predetermined position and the posture of the second player P2 becomes the predetermined posture, the trigger event recognition unit 33 performs the trigger event based on the operation of the second player P2. Recognizes that an error has occurred.

  When the occurrence of the trigger event is recognized (YES in STEP 22), the avatar coordinate determination unit 34 of the server 3 stands on the floor VS2 with the collapse of the floor VS2 (that is, the movement of the moving body). The coordinates of the first avatar A1 are moved (FIG. 9 / STEP 23).

  Specifically, the avatar coordinate determination unit 34 moves only the coordinates of the first avatar A1 by a predetermined amount in a predetermined direction, triggered by the occurrence of a trigger event based on the operation of the second player P2.

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine an image and a sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after the movement (FIG. 9 / STEP 24).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41 and generates sound on the speaker 42 (FIG. 9 / STEP 25).

  After executing the processing of STEP 25, or when the occurrence of the trigger event is not recognized (NO in STEP 22), the virtual space sensation system S ends the current processing.

  During the processing in STEP23 to STEP25, in the physical space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are at the start of the second stage (FIG. 10A), at the time of progressing the second stage (FIG. 11A), and At the end of the two stages (FIG. 12A), it has not moved.

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 are at the start of the second stage (FIG. 10B), when the second stage is advanced (FIG. 11B), and at the end of the second stage (FIG. 12B). ), It moves downward in the Z-axis direction along with the collapse of the floor VS2 that is the moving body.

  That is, by the processing of STEP23 to STEP25, the coordinates of the first avatar A1 move independently of the movement of the coordinates of the first player P1, and the coordinates of the first player P1 in the real space RS and the virtual space of the first avatar A1. A deviation occurs in the correspondence relationship with the coordinates in the VS.

  At this time, the image of the virtual space VS recognized by the player P changes in the same manner as in the process (STEP 12 to STEP 14) when the correspondence has shifted in the first stage.

  Then, the player P recognizes that the virtual space VS is extended more than the real space RS by recognizing a shift in the correspondence between the images and sounds in the virtual space VS through changes. Specifically, the player P moves the virtual space VS downward in the Z-axis direction more than the real space RS as the first avatar A1 can move in such a manner as the first avatar A1 moves downward in the Z-axis direction. Recognize that it has been extended.

  The second-stage trigger event (the operation of the second avatar A2 pressing the button VS4; the processing in STEP22) is a state in which the first avatar A1 is standing (connected) on the collapsed floor VS2, which is a moving object. (The processing of STEP 21).

  In other words, the player P predicts that the movement of the coordinates of the first avatar A1 for causing a shift in the correspondence will cause the collapse (change) of the floor VS2b, which is the moving body, to affect the coordinates of the first avatar A1. Occurs in a gained state.

  With this prediction, the player P can accept the deviation of the correspondence between the coordinates of the first player P1 in the real space RS and the coordinates of the first avatar A1 in the virtual space VS without any discomfort.

  By the way, the trigger event in the second stage is not that the moving first avatar A1 has moved on the floor VS2, but that the second avatar A2 performs an operation of pressing the button VS4. That is, the avatar whose coordinates move to cause a shift in the correspondence does not match the avatar that generates the trigger event.

  However, even in such a case where they do not match, both the first player P1 and the second player P2 can recognize the virtual space VS extended more than the real space RS.

  Next, with reference to FIG. 2 and FIGS. 13 to 16, a process executed by the virtual space sensation system S in the third stage of the game will be described. In the third stage, the state of the virtual space VS becoming the state shown in FIG. 14B (that is, the movement of the first avatar A1 on the jump platform VS3) corresponds to the generation of the trigger event.

  In the third stage, first, it is determined whether or not the trigger event recognition unit 33 of the server 3 has recognized the occurrence of the trigger event based on the operation of the first player P1 (FIG. 13 / STEP 31).

  Specifically, the trigger event recognition unit 33 determines whether the first avatar A1 corresponding to the first player P1 moves on the jumping platform VS3 in the virtual space VS (see FIG. 14B). It is determined whether the first player P1 has moved in the Y-axis direction (see FIG. 14A).

  Then, when the coordinates of the first player P1 are located at the predetermined positions, the trigger event recognition unit 33 recognizes that a trigger event has occurred.

  At this time, since the jump base VS3 is a moving body, the first player P1 and the second player P2 recognize that the first avatar A1 corresponding to the first player has been connected to the moving body.

  When the occurrence of the trigger event is recognized (YES in STEP31), the avatar coordinate determination unit 34 of the server 3 determines the moving speed of the coordinates of the first avatar A1 to be moved by the moving body in the predetermined direction. , Within a predetermined range (FIG. 13 / STEP 32).

  Specifically, the avatar coordinate determination unit 34 increases the moving speed of the coordinates of the first avatar A1 with respect to the moving speed of the coordinates of the first player P1 only in the range above the jumping stand VS3, only in the upward direction in the Z-axis direction. Change to become.

  Next, with the movement of the coordinates of the first player P1, the coordinates of the first avatar A1 are moved (FIG. 13 / STEP 33).

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine an image and a sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after the movement (FIG. 13 / STEP34).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41 and generates sound on the speaker 42 (FIG. 13 / STEP 35).

  After executing the processing of STEP 35, or when the occurrence of the trigger event is not recognized (NO in STEP 31), the virtual space sensation system S ends the current processing.

  During the processing in STEP32 to STEP35 described above, in the physical space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are determined from the start of the third stage (FIG. 14A) to the progress of the third stage (FIG. 15A). It moves forward in the Y-axis direction and upward in the Z-axis direction, and moves forward in the Y-axis direction and downward in the Z-axis direction from the time when the third step is advanced (FIG. 15A) to the time when the third step is finished (FIG. 16A).

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 also move forward in the Y-axis direction and Z-axis from the start of the third stage (FIG. 14B) to the progress of the third stage (FIG. 15B). In the third stage (FIG. 15B) to the end of the third stage (FIG. 16B), it moves forward in the Y-axis direction and downward in the Z-axis direction.

  However, the coordinates of the first avatar A1 from the start of the third stage (FIG. 14B) to the progress of the third stage (FIG. 15B) are the jump table in the range in which the moving speed is changed (the range to be processed in STEP32). Since the range is above VS3, only the upward movement in the Z-axis direction is larger than the movement in the other direction (that is, the movement of the coordinates of the first avatar A1 with respect to the movement amount of the coordinates of the first player P1). The amount is changed.)

  As a result, at the time of landing (at the end of the third stage (FIG. 16B)), the correspondence between the coordinates of the first player P1 in the real space and the coordinates of the first avatar A1 in the virtual space is displaced in the Z-axis direction. Will occur. Specifically, in the real space RS, the first player P1 merely jumps forward on the flat ground, but in the virtual space VS, the first avatar A1 corresponding to the first player P1 is moved from a low position to a high position. You jumped over the step.

  At this time, the image of the virtual space VS recognized by the player P changes in the same manner as in the processing (STEP12 to STEP14, STEP23 to STEP25) when the correspondence is shifted in the first stage and the second stage.

  Then, the player P recognizes the virtual space VS which is extended more than the real space RS by recognizing the deviation of the correspondence through the change of the image and the sound of the virtual space VS. Specifically, the player P moves the virtual space VS downward in the Z-axis direction within a predetermined range (the range where the jump platform VS3 exists) by moving the first avatar A1 so as to jump over the step. It recognizes that it is extended more than the space RS.

  Further, the trigger event in the third stage is that the first player P1 moves so as to stand on the first avatar A1 and the jumping stand VS3 as the moving body.

  In other words, the movement of the coordinates of the first avatar A1 to cause a shift in the correspondence occurs in a state where the player P can predict that the jumping stand VS3, which is a moving object, will affect the coordinates of the first avatar A1. I do.

  With this prediction, the player P can accept the deviation of the correspondence between the coordinates of the first player P1 in the real space RS and the coordinates of the first avatar A1 in the virtual space VS without any discomfort.

  By the way, in the third stage, the movement of the coordinates of the first avatar A1 for causing a shift in the correspondence is a jump (that is, a reciprocating movement including an ascent and a descent immediately after the ascent).

  As a result, the time during the process of causing a shift in the correspondence (that is, the time during which the player P easily feels uncomfortable) is concentrated. As a result, the player P does not often feel uncomfortable. Further, since the correspondence is shifted through the reciprocating motion, it is difficult for the player P to recognize the process in which the shift has occurred.

  As described above, according to the virtual space sensation system S, the correction for shifting the correspondence between the coordinates of the first player P1 in the real space RS and the coordinates of the first avatar A1 in the virtual space VS is performed by the first player. Since the P1 and the second player P2 can make predictions, it is possible to make the player recognize a virtual space that is larger than the real space while suppressing the sense of incongruity that the first player P1 and the second player P2 learn.

  Although the illustrated embodiment has been described above, the present invention is not limited to such an embodiment.

  For example, in the above embodiment, the first player P1 and the second player P2 exist in the real space RS, and the second avatar A1 and the second avatar A2 corresponding to the second player P2 corresponding to the first player P1 exist in the virtual space VS. Avatar A2 is present. However, the virtual space recognition system of the present invention does not support only two players, and the number of players may be three or more.

  In the above embodiment, the sound generated by the speaker 42 of the HMD 4 that is a virtual space sound generator is determined by the virtual space sound determination unit 36 of the server 3. However, in the virtual space sensation system of the present invention, the processing on the sound may be omitted by omitting the virtual space sound determination unit and the virtual space sound generator.

  Further, in the above embodiment, the virtual space VS is extended in the X-axis direction and the Z-axis direction more than the real space RS. However, the virtual space in the virtual space sensation system of the present invention is not limited to this, and may be expanded in any direction than the real space.

  In the above embodiment, the movement of the first avatar A1 to a predetermined position and the predetermined operation of the second avatar A2 at a predetermined position are set as trigger events. However, the trigger event in the virtual space sensation system of the present invention is not limited to such.

  For example, in a virtual space, when an avatar jumps over a log flowing through a river and the avatar moves with the log, causing a shift in the correspondence, the operation of jumping over the log flowing through the river is an operation of the avatar and the moving body. This is an operation for recognizing the occurrence of the connection and the trigger event.

  In the above-described embodiment, as the correction of the coordinates of the avatar for causing a deviation in the correspondence, in the first stage, the elevator VS1 as the moving body is moved upward in the X-axis direction and the Z-axis direction for a predetermined period. I have. In the second stage, the first avatar A1 is moved downward in the Z-axis direction until it reaches a predetermined position (lower floor) in the Z-axis direction. In the third stage, in the third stage, the movement amount is corrected only in the range above the jump table VS3 which is the moving body.

  However, the correction of the coordinates of the avatar of the virtual space sensation system of the present invention is not limited to such a period and range, and the correspondence between the coordinates of the player in the real space and the coordinates of the avatar in the virtual space is shifted. The correction may be any correction that causes Therefore, the range and period of the correction may be appropriately changed according to the direction in which the virtual space is expanded and the amount of expansion.

REFERENCE SIGNS LIST 1 sign, 2 camera, 3 server, 4 HMD, 31 display image generator, 31a virtual space generator, 31b avatar generator, 31c mobile object generator, 32 player information detector 32a: player attitude detection unit, 32b: player coordinate detection unit, 33: trigger event recognition unit, 34: avatar coordinate determination unit, 35: virtual space image determination unit, 36: virtual space sound determination unit, 41: monitor (virtual space) Image display), 42 speaker (virtual space sound generator), A1 first avatar (first avatar), A2 second avatar (second avatar), P player, P1 first player ( 1st player), P2 2nd player (2nd player), RS ... real space, RS1 ... whiteboard, S ... virtual space experience system, VS ... virtual space, S1 ... elevator (mobile), VS1a ... mark, VS2 ... floor (mobile), VS3 ... jump, VS4 ... button.

Claims (2)

A virtual space generation unit that generates a virtual space corresponding to a real space in which the first player and the second player exist;
In one virtual space, a first avatar that operates in the virtual space in response to the operation of the first player, and a second avatar that operates in the virtual space in response to the operation of the second player An avatar generator that generates an avatar of
A player coordinate detector that detects coordinates of the first player and the second player;
An avatar coordinate determination unit that determines the coordinates of the first avatar based on the detected coordinates of the first player, and determines the coordinates of the second avatar based on the coordinates of the second player. When,
A virtual space image determining unit that determines an image of the virtual space to be recognized by the first player and the second player based on the coordinates of the first avatar and the coordinates of the second avatar;
A virtual space image display for causing the first player and the second player to recognize an image of the determined virtual space,
The virtual space image determining unit, when the coordinates of the first avatar are corrected so as to cause a deviation in the correspondence between the coordinates of the first player and the coordinates of the first avatar, the A virtual space configured to change an image of the first avatar to be recognized by the second player based on a change in relative coordinates between the first avatar and the second avatar. Experience system. The virtual space sensation system according to claim 1,
A virtual space sound determination unit that determines a sound to be recognized by the first player and the second player based on the coordinates of the first avatar and the coordinates of the second avatar;
A virtual space sensation system, comprising: a virtual space sound generator for causing the first player and the second player to recognize the determined sound.

Images