JP6538012B2 - Virtual Space Experience System - Google Patents

Description

  The present invention relates to a virtual space experience system for causing a player to be recognized as existing in a virtual space displayed by a 3D model.

  Conventionally, a virtual space experience system is known that generates a virtual space, causes a player to recognize an image of the virtual space on a head mount display or the like, and recognizes that the player is present in the virtual space.

  As this type of virtual space sensation system, there is one in which a motion capture device or the like detects the motion of the player in the real space, and the avatar corresponding to the player is operated in the virtual space according to the detected motion (for example, Reference 1).

Unexamined-Japanese-Patent No. 2010-257461

  By the way, in the conventional virtual space experience system described in Patent Document 1, in order to make it more certain that the player is present in the virtual space, the amount of movement of the coordinates of the player in the real space It is preferable that the amount of movement of coordinates of the avatar in the virtual space be as close as possible.

  However, when trying to move the amount of movement of the coordinates of the player and avatar like that, there is a problem that the size of the virtual space is limited by the size of the real space.

  As a method of solving this problem, there is a method of connecting a plurality of virtual spaces generated corresponding to each of a plurality of real spaces inside the virtual space. For example, there is a method of generating two virtual spaces and connecting the two virtual spaces by steps existing only in the virtual space.

  However, when the virtual space is expanded by such a method, there is a problem that the player strongly feels a gap with the real space at the connection portion of the virtual space, causing the player to feel a strong sense of discomfort. The

  For example, when the virtual space is connected by the stairs as described above, when moving from one virtual space to the other virtual space, the stairs move up and down at a place that is a flat ground in the real space. It is necessary to perform such an operation, and there is a problem that the recognition in the virtual space and the sense in the real space deviate, and the player feels a strong sense of discomfort.

  The present invention has been made in view of the above points, and it is an object of the present invention to provide a virtual space experience system capable of causing a player to recognize a virtual space expanded more than a real space while suppressing a sense of incongruity felt by the player. To aim.

  In order to achieve the above object, the virtual space experience system of the present invention operates in the virtual space corresponding to the operation of the player and a virtual space generation unit that generates a virtual space corresponding to the real space where the player exists. An avatar generation unit for generating an avatar, a player coordinate detection unit for detecting the coordinates of the player, an avatar coordinate determination unit for determining coordinates of the avatar based on the detected coordinates of the player, and A virtual space image determination unit that determines an image of the virtual space to be recognized by the player based on coordinates, a virtual space image display that causes the player to recognize the determined image of the virtual space, and the virtual space A mobile object generation unit for generating a mobile object connectable to the avatar, and a state in which the avatar and the mobile object are connected And a trigger event recognition unit that recognizes that a trigger event has occurred when the player has performed a predetermined action, and the avatar coordinate determination unit determines the coordinates of the avatar when the trigger event is recognized. Is corrected so as to cause a deviation in the correspondence between the player's coordinates and the avatar's coordinates.

  Here, “image of virtual space” refers to images of background of virtual space, images of other avatars when a plurality of avatars exist, images of objects existing only in virtual space, real space The image is an image such as an image of an object existing in the virtual space corresponding to プ レ イ ヤ ー, which allows the player to recognize coordinates in the virtual space of the avatar corresponding to the player.

  Also, here, “moving object” means that when the avatar is connected, the player predicts the movement of the avatar different from the movement of the player's reality (whether conscious or not) What is necessary. For example, in addition to those used for moving in a real space such as an elevator, a log flowing through a river that can be jumped on, a floor likely to collapse when standing up, a jumping platform, wings for assisting jumping, etc. correspond.

  Also, here, “connection” between the avatar and the moving object means that the player can predict that the movement of the moving object, the change in the shape of the moving object, etc. affect the coordinates of the avatar. . For example, avatars board elevators, avatars ride on a log through the river, avatars stand on a floor that is likely to collapse, stand on a jumping platform, avatars attach wings that assist jumping, and so on.

  Also, here, “correction” that causes a shift in the correspondence relationship between the player's coordinates and the avatar's coordinates means moving the avatar's coordinates themselves without being related to the movement of the player's coordinates, and It means changing the moving amount of the avatar's coordinate with respect to the moving amount of the coordinate.

  Thus, in the virtual space sensation system of the present invention, when occurrence of a trigger event is recognized, the coordinates of the avatar are deviated in the correspondence between the coordinates of the player corresponding to the avatar and the coordinates of the avatar. To correct. By this correction, the player is made to recognize the virtual space expanded more than the real space.

  In a trigger event that is a trigger that causes a deviation in the correspondence relationship, the player performs a predetermined operation in a state where the avatar and the moving body are connected. That is, the correction occurs in such a state that the player can predict that the movement of the moving object, the change of the shape, and the like affect the coordinates of the avatar. As a result, the player can accept the deviation of the correspondence without a sense of discomfort.

  Therefore, according to the virtual space sensation system of the present invention, the correction for causing the virtual space to be recognized is generated in the state predicted by the player, so that the player feels strange while being suppressed. A player can be made to recognize a virtual space expanded more than a space.

  Further, in the virtual reality system according to the present invention, the avatar generation unit is configured to: a first avatar operating in response to an operation of a first player; and a second avatar in one virtual space. When the second avatar that operates in response to the player's motion is generated, the virtual space image determination unit determines that the first avatar has coordinates of the first player and coordinates of the first avatar. And the second player is made to recognize the second player based on a change in relative coordinates between the first avatar and the second avatar when corrected so as to cause deviation in the correspondence relationship with the Preferably, it is configured to change the image of the avatar.

  When there is a first avatar corresponding to the first player and a second avatar corresponding to the second player in one virtual space, an image of an avatar corresponding to the other player for one player Is one of the criteria for recognizing the size of the virtual space.

  Therefore, when the coordinates of the first avatar are corrected, the first player is made to recognize the second player corresponding to the second avatar based on the change of the relative coordinates of the first avatar and the second avatar. When the image of the avatar of is changed, the image of the first avatar, which is the reference of the size of the virtual space for the second player, is expanded to the second player more than the real space. Can be recognized.

  In the virtual reality system according to the present invention, a virtual space sound determination unit that determines a sound to be recognized by the player based on the coordinates of the avatar, and a virtual space sound that causes the player to recognize the determined sound. Preferably, a generator is provided.

  In this way, if the player is made to recognize not only the image corresponding to the coordinates of the avatar but also the voice (for example, the voice of the other player heard from the position corresponding to the coordinates), the coordinates of the avatar are corrected. Also, the voice recognized by the player will change. As a result, the player can further accept the deviation in the correspondence between the player's coordinates and the avatar's coordinates without a sense of discomfort.

The schematic diagram which shows schematic structure of the virtual space sensation system which concerns on embodiment. FIG. 2 is a block diagram showing a virtual space experience system configuration of FIG. 1; The flowchart which shows the process which the virtual space experience system of FIG. 1 performs at the stage at the time of the start of a game, and the stage where a trigger event is not recognized. FIG. 4A is a perspective view showing a state of a player, and FIG. 4B is a view showing a state of an avatar. The flowchart which shows the process which the virtual space experience system of FIG. 1 performs in the 1st step of a game. FIG. 6A is a view showing the state of the player, and FIG. 6B is a view showing the state of the avatar. FIG. 7A is a perspective view showing the state of the player, and FIG. 7B is a view showing the state of the avatar. FIG. 8A is a perspective view showing the state of the real space, and FIG. 8B is a view showing the state of the virtual space. The flowchart which shows the process which the virtual space experience system of FIG. 1 performs in the 2nd step of a game. FIG. 10A is a view showing a state of the real space, and FIG. 10B is a view showing a state of the virtual space. FIG. 11A is a view showing a state of a real space, and FIG. 11B is a view showing a state of a virtual space. FIG. 12A is a view showing the state of the real space, and FIG. 12B is a view showing the state of the virtual space when the second stage of the game is completed. The flowchart which shows the process which the virtual space experience system of FIG. 1 performs in the 3rd step of a game. FIG. 14A is a perspective view showing the state of the real space, and FIG. 14B is a view showing the state of the virtual space. FIG. 15A is a perspective view showing the state of the real space, and FIG. 15B is a view showing the state of the virtual space. FIG. 16A is a perspective view showing the state of the real space, and FIG. 16B is a view showing the state of the virtual space.

  Hereinafter, a virtual space sensation system S according to an embodiment will be described with reference to the drawings.

  First, a schematic configuration of a virtual space experience system S will be described with reference to FIG.

  As shown in FIG. 1, the virtual space sensation system S includes a plurality of markers 1 attached to the player P existing in the real space RS, a camera 2 for photographing the player P (that is, the markers 1), and a virtual space VS ( The server 3 which determines the image and sound of FIG. 4B etc.) and the head mounted display (henceforth "HMD4") which makes a player recognize the determined image and sound. The camera 2, the server 3 and the HMD 4 can mutually transmit and receive information wirelessly.

  The plurality of signs 1 are attached to each of the head, both hands, and both legs of the player P via the HMD 4 worn by the player P, gloves, and shoes.

  A plurality of cameras 2 are installed so that the range in which the player P in the real space RS in which the player P exists can move can be photographed from multiple directions.

  The server 3 detects the marker 1 from a plurality of images captured by the camera 2, recognizes the coordinates and posture of the player P based on the detected position of the marker 1 in the real space RS, and uses the coordinates and posture as Based on the image and sound to be recognized by the player P is determined.

  The HMD 4 is attached to the head of the player P. The HMD 4 has a monitor 41 (virtual space image display) for causing the player P to recognize the image of the virtual space determined by the server 3 and the sound of the virtual space determined by the server 3 to the player P. The speaker 42 (virtual space sound generator) for making it recognize, and the microphone (not shown) for collecting the voice of the player P are provided (refer FIG. 2).

  When playing a game or the like using this virtual space sensation system S, the player P recognizes only the image and sound of the virtual space, and recognizes that the player P is present in the virtual space.

  The virtual space experience system S is provided with a so-called motion capture device constituted by the marker 1, the camera 2 and the server 3 as a system for recognizing the coordinates of the player P in the real space. However, the virtual space experience system of the present invention is not limited to such a configuration.

  For example, when using a motion capture device, in addition to the above configuration, a camera and a server may be connected by wire, and the number of signs and cameras may be different from the above configuration (for example, , One each) may be used. Also, instead of the motion capture device, a device that detects only the coordinates of the player may be used.

  Next, the configuration of the server 3 will be described in detail using FIG.

  The server 3 is configured of one or more electronic circuit units including a CPU, a RAM, a ROM, an interface circuit, and the like. The server 3 determines the display image generation unit 31, the player information detection unit 32, the trigger event recognition unit 33, and avatar coordinate determination as shown in FIG. 2 as functions implemented by the implemented hardware configuration or program. A unit 34, a virtual space image determination unit 35, and a virtual space sound determination unit 36 are provided.

  The display image generation unit 31 generates an image to be recognized by the player P via the monitor 41 of the HMD 4. The display image generation unit 31 includes a virtual space generation unit 31a, an avatar generation unit 31b, and a moving body generation unit 31c.

  The virtual space generation unit 31a generates an image serving as the background of the virtual space and an image of an object present in the virtual space.

  The avatar generation unit 31 b generates an avatar operating in response to the motion of the player P in the virtual space. When a plurality of players P exist, the avatar generation unit 31 b generates a plurality of avatars in a manner corresponding to each player P. The avatar operates in the virtual space in response to the motion (that is, movement of coordinates and change in posture) of the corresponding player P in the real space.

  The moving object generation unit 31c generates a moving object that can be connected to the avatar in the virtual space, and there is no corresponding object in the real space RS in the virtual space.

  Here, the “moving object” means that when the avatar is connected, the player predicts the movement of the avatar different from the movement of the player P (whether conscious or not) If it is For example, in addition to those used for moving in a real space such as an elevator, a log flowing through a river that can be jumped on, a floor likely to collapse when standing up, a jumping platform, wings for assisting jumping, etc. correspond.

  Also, here, “connection” between the avatar and the moving object means that the player can predict that the movement of the moving object, the change in the shape of the moving object, etc. affect the coordinates of the avatar. . For example, avatars board elevators, avatars ride on a log through the river, avatars stand on a floor that is likely to collapse, stand on a jumping platform, avatars attach wings that assist jumping, and so on.

  The player information detection unit 32 receives image data of the player P including the sign 1 captured by the camera 2. The player information detection unit 32 includes a player posture detection unit 32a and a player coordinate detection unit 32b.

  The player posture detection unit 32a extracts the marker 1 from the input image data of the player P, and detects the posture of the player P based on the extraction result.

  The player coordinate detection unit 32 b extracts the marker 1 from the input image data of the player P, and detects the coordinates of the player P based on the extraction result.

  When the player P performs a predetermined action in the real space (that is, when an avatar corresponding to the player P performs a predetermined action in the virtual space), the trigger event recognition unit 33 generates a trigger event based on the action. To recognize that In the trigger event, if the player P moves to a predetermined coordinate, the player P takes a predetermined posture, etc. and the event occurs according to the operation of the player P, the player P does not recognize the occurrence. It may be.

  The avatar coordinate determination unit 34 determines the coordinates in the virtual space of the avatar corresponding to the player P, based on the coordinates in the real space RS of the player P detected by the player coordinate detection unit 32b.

  In addition, when the trigger event recognition unit 33 recognizes a trigger event, the avatar coordinate determination unit 34 determines a predetermined period or a predetermined range, or in a predetermined period and a predetermined range according to the type of the recognized trigger event. The avatar's coordinates are corrected so that the correspondence between the player's coordinates and the avatar's coordinates deviates.

  Also, here, “correction” that causes a shift in the correspondence relationship between the player's coordinates and the avatar's coordinates means moving the avatar's coordinates themselves without being related to the movement of the player's coordinates, and It means changing the moving amount of the avatar's coordinate with respect to the moving amount of the coordinate.

  The virtual space image determination unit 35 determines an image of a virtual space to be recognized by the player P corresponding to the avatar via the monitor 40 of the HMD 4 based on the coordinates of the avatar.

  Here, “image of virtual space” refers to images of background of virtual space, images of other avatars when a plurality of avatars exist, images of objects existing only in virtual space, real space The image is an image such as an image of an object existing in the virtual space corresponding to プ レ イ ヤ ー, which allows the player to recognize coordinates in the virtual space of the avatar corresponding to the player.

  The virtual space sound determination unit 36 determines a sound to be recognized by the player P corresponding to the avatar via the speaker 42 of the HMD 4 based on the coordinates of the avatar.

  Next, processing performed by the virtual space experience system S when playing a game using the virtual space experience system S will be described with reference to FIGS. FIG.3, FIG.5, FIG.9 and FIG. 13 are flowcharts which show the process performed by virtual space sensation system S in each step of a game. Here, the game performed in the present embodiment is a game in which two players cooperate to move and aim at each goal point from each start point.

  First, with reference to FIG. 2, FIG. 3 and FIG. 4, the process executed by the virtual space experience system S at the stage of start of the game and at the stage where the trigger event is not recognized will be described.

  When the signal instructing the start of the game is recognized, the display image generation unit 31 of the server 3 first generates the virtual space VS, the first avatar A1 and the second avatar A2, and the moving object (FIG. 3 / STEP 01) ).

  Specifically, the virtual space generation unit 31a of the display image generation unit 31 generates various objects existing in the virtual space VS and the virtual space VS. The avatar generation unit 31b of the display image generation unit 31 generates a first avatar A1 corresponding to the first player P1 and a second avatar A2 corresponding to the second player P2. A moving body generation unit 31c of the display image generation unit 31 generates a moving body such as an elevator VS1 described later.

  In the virtual space VS generated by the processing of STEP 01, as shown in FIG. 4B, in addition to the first avatar A1 and the second avatar A2, the elevator VS1 which is a moving object, the floor VS2 and the jumping platform VS3, the real space RS An object related to a trigger event such as a button VS4 generated at a position corresponding to the whiteboard RS1 (see FIG. 4A) installed at the is installed.

  Next, the player information detection unit 32 of the server 3 acquires the image data captured by the camera 2, and based on the image data, the first player P1 and the second player P2 (hereinafter collectively referred to as “players Coordinates and attitude (refer to FIG. 4A) in the real space RS of “P”.

  Next, the avatar coordinate determination unit 34 of the server 3 determines the coordinates of the first avatar A1 in the virtual space VS based on the coordinates of the first player P1 detected by the player information detection unit 32 in the real space RS. The coordinates in the virtual space VS of the second avatar A2 are determined based on the coordinates in the real space RS of the two players P2 (FIG. 3 / STEP 03).

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 cause the image and sound to be recognized by the player P based on the coordinates and posture of the first avatar A1 and the second avatar A2 in the virtual space VS. Decision (Fig. 3 / STEP 04).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41, and generates sound on the speaker 42 (FIG. 3 / STEP 05).

  Next, the player information detection unit 32 of the server 3 determines whether movement of coordinates or change in posture of the first player P1 or the second player P2 in the real space RS is detected (FIG. 3 / STEP 06).

  If movement of the coordinates or change in posture of the first player P1 or the second player P2 in the real space RS is detected (in the case of YES in STEP 06), the process returns to STEP 03 and executes the processing of STEP 03 and later.

  When movement of the coordinates or change in posture of the first player P1 or the second player P2 in the real space RS is not detected (in the case of NO at STEP 06), the server 3 recognizes a signal instructing the end of the game. It is determined whether or not it has been done (FIG. 3 / STEP 07).

  If the signal instructing the end of the game can not be recognized (in the case of NO at STEP 07), the process returns to STEP 06, and the processing after STEP 06 is executed again. When the signal instructing the end of the game is recognized (in the case of YES in STEP 07), the virtual space experience system S ends the current process.

  After the game is started by the above process, in the virtual space VS, the first avatar A1 corresponding to the first player P1 and the second avatar A2 corresponding to the second player P2, and the elevator VS1 which is a moving object, A plurality of objects including a floor VS2 and a jumping platform VS3 are installed.

  Then, the first player P1 and the second player P2 themselves are virtual via the first avatar A1 and the second avatar A2 respectively corresponding to the image displayed on the HMD 4 worn by the player and the generated voice. It exists in space VS and comes to recognize that it can operate freely.

  Next, with reference to FIG. 2 and FIG. 5 to FIG. 8, the processing executed by the virtual space experience system S at the first stage of the game will be described. In this first stage, the state of the virtual space VS being in the state shown in FIG. 6B (that is, the first avatar A1 moving on the mark VS1a of the elevator VS1) corresponds to the occurrence of the trigger event.

  In the first stage, first, the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of a trigger event based on the operation of the first player P1 is recognized (FIG. 5 / STEP 11).

  Specifically, in the virtual space VS, the trigger event recognition unit 33 moves the first avatar A1 corresponding to the first player P1 onto the mark VS1a of the elevator VS1 (see FIG. 6B), in the real space RS It is determined whether the first player P1 has moved in the Y-axis direction (see FIG. 6A).

  Then, when the coordinate of the first player P1 is located at a predetermined position, the trigger event recognition unit 33 recognizes that a trigger event has occurred.

  At this time, since the elevator VS1 is a moving body, the first player P1 and the second player P2 recognize that the first avatar A1 corresponding to the first player is connected to the moving body.

  When the occurrence of the trigger event is recognized (in the case of YES in STEP 11), the avatar coordinate determination unit 34 of the server 3 is the first avatar riding on the elevator VS1 along with the movement of the elevator VS1, which is a mobile object. Move the coordinates of A1 (FIG. 5 / STEP 12).

  Specifically, the avatar coordinate determination unit 34 triggers the occurrence of a trigger event, and the avatar coordinate determination unit 34 sets the coordinates of the first avatar A1 in a predetermined direction along with the movement of the elevator VS1, which is a moving object. Move it quantitatively.

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine the image and sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after movement (see FIG. 5 / STEP 13).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41, and generates sound on the speaker 42 (FIG. 5 / STEP 14).

  After executing the processing of STEP14 or when the occurrence of a trigger event is not recognized (in the case of NO in STEP11), the virtual space experience system S ends the present processing.

  During the processing of STEP12 to STEP14, in the real space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are at the start of the first stage (FIG. 6A), at the time of the first stage progression (FIG. 7A) and At the end of one step (FIG. 8A), it has not moved.

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 are at the start of the first stage (FIG. 6B), at the progress of the first stage (FIG. 7B) and at the end of the first stage (FIG. 8B). ) Moving in the direction away from the second avatar A2 in the X-axis direction and moving upward in the Z-axis direction along with the movement of the elevator VS1 which is a moving body. Here, the moving speed of the coordinates of the first avatar A1 is slower in the Z-axis direction than in the X-axis direction.

  That is, the coordinates of the first avatar A1 move independently of the movement of the coordinates of the first player P1 by the processing of STEP12 to STEP14, and the coordinates of the first player P1 in the real space RS and the virtual space of the first avatar A1 Misalignment occurs in the correspondence relationship with the coordinates in VS.

  Then, the image of the virtual space VS recognized by the player P changes in accordance with the deviation of the correspondence relationship.

  Specifically, in the image of the virtual space VS recognized by the first player P1, the image of the second avatar A2 has a size and an angle based on a change in relative coordinates of the first avatar A1 and the second avatar A2. , Attitude changes. Moreover, the magnitude | size, angle, etc. change images other than 2nd avatar A2 based on the movement of the coordinate of 1st avatar A1.

  Further, in the image of the virtual space VS recognized by the second player P2, the size, angle, etc. of the image of the elevator VS1, which is a moving object, changes based on the movement of the elevator VS1. Further, the size, angle, posture, and the like of the image of the first avatar A1 change based on the change in relative coordinates of the first avatar A1 and the second avatar A2 accompanying the movement of the elevator VS1. Further, the images other than the elevator VS1 and the first avatar A1 do not change.

  In addition, the voice of the virtual space VS (for example, the voice of an avatar determined based on the voice of another player, the sound generated from a moving object) is also the same as the image of the virtual space VS, the first avatar A1 is an elevator It changes with movement with VS1.

  And the player P recognizes the virtual space VS expanded rather than real space RS by recognizing the shift | offset | difference of the correspondence through the change of the image of the virtual space VS, and an audio | voice. Specifically, as the player P moves the first avatar A1 in the X-axis direction and the Z-axis direction, the virtual space VS can move in the X-axis direction and the Z-axis direction so that the first avatar A1 can move as such. To be more extended than the real space RS.

  In the first stage, the first player P1 moves so that the first avatar A1 stands on the mark VS1a in a state where the first avatar A1 and the elevator VS1 which is a moving object get into (connected) the trigger event. It is supposed to

  That is, the movement of the coordinates of the first avatar A1 for causing a shift in the correspondence relationship can be predicted in such a manner that the player P can predict that the movement of the elevator VS1, which is a moving object, affects the coordinates of the first avatar A1. Occur.

  By this prediction, the player P can accept without any discomfort the displacement of the correspondence relationship between the coordinates of the first player P1 in the real space RS and the coordinates of the first avatar A1 in the virtual space VS.

  By the way, as described above, the moving speed of the coordinates of the first avatar A1 generated with the movement of the elevator VS1 is slower in the Z-axis direction than in the X-axis direction.

  Thereby, the deviation of the correspondence relationship is large in the X-axis direction and small in the Z-axis direction. As a result, the player P expands with respect to the real space RS in the X axis direction in the direction in which the first avatar A1 separates from the second avatar A2 in the X axis direction, and in the Z axis direction Recognize the virtual space VS that has been expanded slightly.

  Further, the movement of the coordinates of the first avatar A1 in the X direction and the movement in the Z axis direction are simultaneously performed for causing a shift in the correspondence relationship. As a result, the time of the process of causing a deviation in the correspondence (that is, the time in which the player P can easily feel uncomfortable) is concentrated. As a result, the player P does not often feel uncomfortable.

  Next, with reference to FIG. 2 and FIG. 9 to FIG. 12, the processing executed by the virtual space experience system S in the second stage of the game will be described. At this second stage, the state of the virtual space VS being in the state shown in FIG. 11B (that is, the action of the second avatar A2 to press the button VS4) corresponds to the occurrence of the trigger event.

  In the second stage, first, the avatar coordinate determination unit 34 of the server 3 determines whether or not the first avatar A1 is connected to the mobile body (FIG. 9 / STEP 21).

  Specifically, the avatar coordinate determination unit 34 moves the coordinate of the first avatar A1 corresponding to the first player P1 on the floor VS2, which is likely to be a moving object, in the virtual space VS (FIG. 10B Reference), It is determined whether the coordinate of the first player P1 has moved in the Y-axis direction in the real space RS (see FIG. 10A).

  In the second stage, since the floor VS2 is a moving object, the first player P1 and the second player P2 move the first avatar A1 by recognizing that the first avatar A1 has moved onto the floor VS2. It will be recognized as connected with the body.

  The determination in STEP21 is repeated at a predetermined cycle until it is determined that the first avatar A1 is connected to the moving object (moved to the floor VS2) (every time NO in STEP21).

  When the first avatar A1 is connected to the moving object (in the case of YES in STEP 21), whether or not the trigger event recognition unit 33 of the server 3 recognizes the occurrence of the trigger event based on the operation of the second player P2 It is determined (FIG. 9 / STEP 22).

  Specifically, the trigger event recognition unit 33 causes the second avatar A2 corresponding to the second player P2 to touch the button VS4 at a position near the button VS4 in the virtual space VS (see FIG. 10B). It is determined whether or not the second player P2 has moved in the Y-axis direction to a predetermined posture (see FIG. 10A) in the real space RS.

  Then, when the coordinates of the second player P2 move to a predetermined position and the posture of the second player P2 becomes a predetermined posture, the trigger event recognition unit 33 generates a trigger event based on the operation of the second player P2 To recognize that

  When the occurrence of the trigger event is recognized (in the case of YES in STEP 22), the avatar coordinate determination unit 34 of the server 3 stands on the floor VS2 as the floor VS2 falls (that is, the movement of the moving object). The coordinates of the first avatar A1 are moved (FIG. 9 / STEP 23).

  Specifically, the avatar coordinate determination unit 34 moves only the coordinates of the first avatar A1 by a predetermined amount in a predetermined direction, triggered by the occurrence of a trigger event based on the operation of the second player P2.

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine the image and sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after movement (see FIG. 9 / STEP 24).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41, and generates sound on the speaker 42 (FIG. 9 / STEP 25).

  After executing the processing of STEP 25 or when the occurrence of the trigger event is not recognized (in the case of NO in STEP 22), the virtual space experience system S ends the current processing.

  During the processing of STEP23 to STEP25, in the real space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are at the start of the second stage (FIG. 10A), at the time of the second stage progression (FIG. 11A) and At the end of the two steps (FIG. 12A), it has not moved.

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 are at the start of the second stage (FIG. 10B), at the progress of the second stage (FIG. 11B) and at the end of the second stage (FIG. 12B). , Move downward in the Z-axis direction along with the fall of the floor VS2 which is a moving body.

  That is, the coordinates of the first avatar A1 are moved independently of the movement of the coordinates of the first player P1 by the processing of STEP23 to STEP25, and the coordinates of the first player P1 in the real space RS and the virtual space of the first avatar A1 Misalignment occurs in the correspondence relationship with the coordinates in VS.

  At this time, the image of the virtual space VS recognized by the player P changes in the same manner as the processing (STEP 12 to STEP 14) when there is a shift in the correspondence in the first stage.

  Then, the player P recognizes that the virtual space VS is expanded more than the real space RS by recognizing the deviation of the correspondence through the change of the image and sound of the virtual space VS. Specifically, as the player P moves the first avatar A1 downward in the Z-axis direction, the virtual space VS moves downward in the Z-axis direction more than the real space RS, as the first avatar A1 can move so. Recognize that it is expanded.

  In the second stage trigger event (the action of the second avatar A2 pressing the button VS4; processing of STEP 22), the first avatar A1 stands (connected) on the floor VS2, which is likely to be a mobile object. (Processing of STEP 21) is premised.

  That is, the player P predicts that the movement of the coordinates of the first avatar A1 for causing a shift in the correspondence relationship affects the collapse (change) of the floor VS2b, which is a moving object, to the coordinates of the first avatar A1. It occurs in the gaining state.

  By this prediction, the player P can accept without any discomfort the displacement of the correspondence relationship between the coordinates of the first player P1 in the real space RS and the coordinates of the first avatar A1 in the virtual space VS.

  By the way, the trigger event in the second stage is not that the moving first avatar A1 moves on the floor VS2, but the second avatar A2 performs an operation of pushing the button VS4. That is, the avatar whose coordinates move to cause a shift in the correspondence does not match the avatar that generates the trigger event.

  However, even if they do not match as such, it is possible for both the first player P1 and the second player P2 to recognize the virtual space VS expanded more than the real space RS.

  Next, with reference to FIG. 2 and FIG. 13 to FIG. 16, the processing executed by the virtual space experience system S at the third stage of the game will be described. At this third stage, the state of the virtual space VS being in the state shown in FIG. 14B (ie, the movement of the first avatar A1 onto the jumping platform VS3) corresponds to the occurrence of the trigger event.

  In the third stage, first, the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of a trigger event based on the operation of the first player P1 is recognized (FIG. 13 / STEP 31).

  Specifically, in the virtual space VS, the trigger event recognition unit 33 moves the first avatar A1 corresponding to the first player P1 onto the jump stand VS3 (see FIG. 14B), in the real space RS, It is determined whether the first player P1 has moved in the Y-axis direction (see FIG. 14A).

  Then, when the coordinate of the first player P1 is located at a predetermined position, the trigger event recognition unit 33 recognizes that a trigger event has occurred.

  At this time, since the jump stand VS3 is a moving object, the first player P1 and the second player P2 recognize that the first avatar A1 corresponding to the first player is connected to the moving object.

  When the occurrence of the trigger event is recognized (in the case of YES in STEP 31), the avatar coordinate determination unit 34 of the server 3 determines the moving speed of the coordinate of the first avatar A1 to be moved by the moving object in a predetermined direction. , In a predetermined range (FIG. 13 / STEP 32).

  Specifically, the avatar coordinate determination unit 34 makes the moving speed of the coordinates of the first avatar A1 with respect to the moving speed of the coordinates of the first player P1 large only in the upward direction in the Z axis direction only in the range above the jumping platform VS3. Change to become

  Next, along with the movement of the coordinates of the first player P1, the coordinates of the first avatar A1 are moved (FIG. 13 / STEP 33).

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine the image and sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after movement (see FIG. 13 / STEP 34).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41, and generates sound on the speaker 42 (FIG. 13 / STEP 35).

  After executing the processing of STEP 35 or when the occurrence of a trigger event is not recognized (in the case of NO in STEP 31), the virtual space experience system S ends the current processing.

  During the processing of STEP 32 to STEP 35, in the real space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are from the start of the third step (FIG. 14A) to the third step progress (FIG. 15A) It moves forward in the Y-axis direction and upward in the Z-axis direction, and moves forward in the Y-axis direction and downward in the Z-axis direction from the third stage (FIG. 15A) to the end of the third stage (FIG. 16A).

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 are also forward in the Y-axis direction and Z-axis from the start of the third step (FIG. 14B) to the third step (FIG. 15B) It moves upward in the direction, and moves forward in the Y-axis direction and downward in the Z-axis direction at the third stage progress (FIG. 15B) to the end of the third stage (FIG. 16B).

  However, the coordinate of the first avatar A1 at the start of the third stage (FIG. 14B) to the progress of the third stage (FIG. 15B) is a jump stand which is a range for changing the moving speed (a range to be subjected to the process of STEP 32). Since it is a range above VS3, only the upward movement in the Z-axis direction is larger than the movement in the other direction (that is, the movement of the coordinates of the first avatar A1 with respect to the movement amount of the coordinates of the first player P1 The amount is changing.).

  As a result, when landing (at the end of the third step (FIG. 16B)), in the Z-axis direction, the correspondence between the coordinates of the first player P1 in the real space and the coordinates of the first avatar A1 in the virtual space deviates Will occur. Specifically, in the real space RS, the first player P1 only jumps forward on a flat ground, but in the virtual space VS, the first avatar A1 corresponding to the first player P1 is high from a low position It will be jumping on the step.

  At this time, the image of the virtual space VS recognized by the player P changes in the same manner as the processing (STEP 12 to STEP 14 and STEP 23 to STEP 25) when there is a shift in the correspondence in the first and second stages.

  And the player P recognizes the virtual space VS expanded rather than real space RS by recognizing the shift | offset | difference of the correspondence through the change of the image of the virtual space VS, and an audio | voice. Specifically, the player P moves the first avatar A1 so as to jump over the step, so that the virtual space VS is actually downward in the Z-axis direction in a predetermined range (a range in which the jumping platform VS3 exists). It recognizes that it is expanded more than space RS.

  Further, in the trigger event in the third stage, the first player P1 is moved so as to stand on the first avatar A1 and the jumping platform VS3 which is a moving object.

  That is, the movement of the coordinates of the first avatar A1 for causing a shift in the correspondence relationship occurs in a state where the player P can predict that the jumping platform VS3 which is a moving object affects the coordinates of the first avatar A1. Do.

  By this prediction, the player P can accept without any discomfort the displacement of the correspondence relationship between the coordinates of the first player P1 in the real space RS and the coordinates of the first avatar A1 in the virtual space VS.

  By the way, in the third stage, the movement of the coordinates of the first avatar A1 for causing a shift in the correspondence relationship is a jump (that is, a reciprocating motion including an increase and a decrease immediately after the increase).

  As a result, the time of the process of causing a deviation in the correspondence (that is, the time in which the player P can easily feel uncomfortable) is concentrated. As a result, the player P does not frequently feel uncomfortable. Further, since the correspondence relationship is deviated through the reciprocation, it is difficult for the player P to recognize the process in which the deviation occurs.

  As described above, according to the virtual space sensation system S, the correction for shifting the correspondence between the coordinates of the first player P1 in the real space RS and the coordinates of the first avatar A1 in the virtual space VS is the first player Since it is possible to make the player P1 and the second player P2 make predictions, it is possible to make the player recognize the virtual space expanded more than the real space while suppressing the discomfort felt by the first player P1 and the second player P2.

  As mentioned above, although embodiment of illustration was described, this invention is not limited to such a form.

  For example, in the above embodiment, the first player P1 and the second player P2 exist in the real space RS, and the second avatar A1 and the second player P2 corresponding to the first player P1 exist in the virtual space VS. Avatar A2 is present. However, the virtual space recognition system of the present invention does not correspond to only two players, and the number of players may be one or three or more.

  Further, in the above embodiment, the sound generated by the speaker 42 of the HMD 4 which is a virtual space sound generator is determined by the virtual space sound determination unit 36 of the server 3. However, in the virtual space experience system of the present invention, the virtual space sound determination unit and the virtual space sound generator may be omitted, and the processing for sound may be omitted.

  In the above embodiment, the virtual space VS is expanded in the X-axis direction and the Z-axis direction more than the real space RS. However, the virtual space in the virtual space sensation system of the present invention is not limited to such a thing, and may be expanded more than real space in any direction.

  Further, in the above embodiment, the movement of the first avatar A1 to the predetermined position and the predetermined motion at the predetermined position of the second avatar A2 are used as trigger events. However, the trigger event in the virtual space sensation system of the present invention is not limited to such.

  For example, in the case where an avatar is jumped on a log flowing in a river in a virtual space and the avatar is moved along with the log to shift the correspondence, the action of jumping on the log flowing in the river is the avatar and the moving object. It becomes an operation for recognizing the occurrence of connection and trigger events.

  Further, in the above embodiment, as the correction of the avatar's coordinates for causing a deviation in the correspondence relationship, in the first stage, the elevator VS1, which is a moving object, is moved upward in the X axis direction and Z axis direction for a predetermined period. There is. In the second stage, the first avatar A1 is moved downward in the Z-axis direction until it reaches a predetermined position (floor that is lowered) in the Z-axis direction. In the third stage, in the third stage, the movement amount is corrected only in the range above the movable platform VS3.

  However, the correction of the coordinates of the avatar of the virtual space experience system of the present invention is not limited to such a period and range, and the correspondence between the coordinates of the player in the real space and the coordinates of the avatar in the virtual space deviates. It is sufficient if it is a correction that causes Therefore, the range and period of the correction may be changed as appropriate according to the direction in which the virtual space is expanded and the amount of expansion.

DESCRIPTION OF SYMBOLS 1 ... Label | marker 2 ... Camera 3 ... Server 4 ... HMD, 31 ... Display image generation part, 31a ... Virtual space generation part, 31b ... Avatar generation part, 31c ... Moving body generation part, 32 ... Player information detection part, 32a: player attitude detection unit, 32b: player coordinate detection unit, 33: trigger event recognition unit, 34: avatar coordinate determination unit, 35: virtual space image determination unit, 36: virtual space sound determination unit, 41: monitor (virtual space Image display device), 42: speaker (virtual space sound generator), A1: first avatar, A2: second avatar, P: player, P1: first player, P2: second player, RS: real space, RS1 ... Whiteboard, S ... Virtual space sensation system, VS ... Virtual space, VS 1 ... Elevator (mobile), VS 1a ... mark, VS 2 ... Floor (mobile), VS 3 Jumping, VS4 ... button.

Claims (3)

A virtual space generation unit that generates a virtual space corresponding to the real space in which the player exists;
An avatar generation unit that generates an avatar operating in the virtual space in response to the action of the player;
A player coordinate detection unit that detects the coordinates of the player;
An avatar coordinate determination unit that determines coordinates of the avatar based on the detected coordinates of the player;
A virtual space image determination unit that determines an image of the virtual space to be recognized by the player based on coordinates of the avatar;
A virtual space image display that causes the player to recognize the determined image of the virtual space;
A moving body generation unit that generates a moving body connectable to the avatar in the virtual space;
And a trigger event recognition unit that recognizes that a trigger event has occurred when the player performs a predetermined operation in a state where the avatar and the moving body are connected.
The avatar coordinate determination unit is configured to correct the coordinates of the avatar so as to cause a shift in the correspondence between the coordinates of the player and the coordinates of the avatar when the trigger event is recognized. Virtual space experience system characterized by having In the virtual space experience system according to claim 1,
The avatar generation unit is configured to perform, in one of the virtual spaces, a first avatar operating in response to an operation of the first player and a second avatar operating in response to an operation of the second player. Generate the avatar,
The virtual space image determination unit is configured to perform the first process when the first avatar is corrected to cause a shift in the correspondence between the coordinates of the first player and the coordinates of the first avatar. A virtual space sensation system configured to change an image of a first avatar to be recognized by a second player based on a change in relative coordinates of an avatar and the second avatar. . In the virtual space experience system according to claim 1 or 2,
A virtual space sound determination unit that determines a sound to be recognized by the player based on the coordinates of the avatar;
A virtual space sensation system comprising a virtual space sound generator for causing the player to recognize the determined sound.