JP2019192263A - Virtual space simulation system - Google Patents

Abstract

To provide a virtual space simulation system capable of having a player recognize a virtual space which is more augmented than a real space while minimizing uneasiness felt by the player.SOLUTION: A virtual space simulation system S is provided, comprising a virtual space image determination unit 35 configured to respond to a correction made to coordinates of a first avatar to cause a shift in correspondence between coordinates of a first player and the coordinates of the first avatar by modifying an image of the first avatar to be recognized by a second player on the basis of the change in relative coordinates of the first avatar and a second avatar.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a virtual space experience system for recognizing that a player himself / herself exists in a virtual space displayed by a 3D model.

  2. Description of the Related Art Conventionally, there is known a virtual space experience system that generates a virtual space, causes a player to recognize an image of the virtual space using a head mounted display or the like, and recognizes that the player itself exists in the virtual space.

  As this type of virtual space experience system, there is a system that detects a motion of a player in a real space using a motion capture device or the like and operates an avatar corresponding to the player in the virtual space according to the detected motion (for example, patent Reference 1).

JP 2010-257461 A

  By the way, in the conventional virtual space experience system described in Patent Document 1, in order to more surely recognize that the player himself / herself exists in the virtual space, It is preferable that the amount of movement of coordinates in the virtual space of the avatar be as close as possible.

  However, if the movement amount of the coordinates of the player and the avatar is made close to each other, there is a problem that the size of the virtual space is limited by the size of the real space.

  As a method of solving this problem, there is a method of connecting a plurality of virtual spaces generated corresponding to each of a plurality of real spaces inside the virtual space. For example, there is a method of generating two virtual spaces and connecting the two virtual spaces with stairs that exist only in the virtual space.

  However, when the virtual space is expanded by such a method, the player feels a strong deviation from the real space at the connection part of the virtual space, which causes the player to feel a strong sense of incongruity. It was.

  For example, when the virtual space is connected by stairs as described above, when moving from one virtual space to the other virtual space, the stairs will rise and fall in a place that is flat on the real space. There is a problem in that the recognition in the virtual space and the sense in the real space are deviated and the player feels a strong sense of discomfort.

  The present invention has been made in view of the above points, and provides a virtual space experience system that allows a player to recognize a virtual space expanded from the real space while suppressing a sense of incongruity that the player learns. Objective.

In order to achieve the above object, the virtual space experience system of the present invention includes:
A virtual space generation unit that generates a virtual space corresponding to the real space in which the first player and the second player exist;
In one virtual space, a first avatar that operates in the virtual space corresponding to the motion of the first player, and a second that operates in the virtual space corresponding to the motion of the second player An avatar generator for generating an avatar of
A player coordinate detection unit for detecting coordinates of the first player and the second player;
An avatar coordinate determination unit that determines the coordinates of the first avatar based on the detected coordinates of the first player and determines the coordinates of the second avatar based on the coordinates of the second player. When,
A virtual space image determination unit that determines an image of the virtual space to be recognized by the first player and the second player based on the coordinates of the first avatar and the coordinates of the second avatar;
A virtual space image display for causing the first player and the second player to recognize the determined image of the virtual space;
The virtual space image determination unit is configured such that when the coordinates of the first avatar are corrected so as to cause a shift in the correspondence between the coordinates of the first player and the coordinates of the first avatar, Based on a change in relative coordinates between one avatar and the second avatar, the image of the first avatar to be recognized by the second player is changed.

  Here, the “virtual space image” refers to an image of the background of the virtual space, another avatar image, an image of an object that exists only in the virtual space, or an object that exists in the virtual space corresponding to the real space. An image such as an image where the player can infer the coordinates of the avatar corresponding to the player in the virtual space.

  Here, “correction” that causes a shift in the correspondence between the player's coordinates and the avatar's coordinates is to move the avatar's coordinates without relating to the movement of the player's coordinates. For example, changing the amount of movement of the avatar's coordinates relative to the amount of movement of the coordinates.

  When the first avatar corresponding to the first player and the second avatar corresponding to the second player exist in one virtual space, the image of the avatar corresponding to the other player for one player Is one criterion for recognizing the size of the virtual space.

  Therefore, in the virtual space experience system of the present invention, when the coordinates of the first avatar are corrected, the second avatar is handled based on the change in the relative coordinates of the first avatar and the second avatar. The image of the first avatar to be recognized by the second player is changed.

  As a result, in this virtual space experience system, the virtual image expanded to the second player than the real space is given to the second player by changing the image of the first avatar that becomes the reference of the size of the virtual space for the second player. It can be recognized while suppressing the uncomfortable feeling of remembering the space.

In the virtual reality experience system of the present invention,
Based on the coordinates of the first avatar and the coordinates of the second avatar, a virtual space audio determination unit that determines audio to be recognized by the first player and the second player;
It is preferable that the first player and the second player include a virtual space sound generator that allows the determined sound to be recognized.

  In this way, if the player recognizes not only the image corresponding to the coordinates of the avatar but also the voice (for example, the voice of another player that can be heard from the position corresponding to the coordinates), when the coordinates of the avatar are corrected, The sound recognized by the player will also change. Thereby, the player can accept the deviation of the correspondence between the player's coordinates and the avatar's coordinates without further discomfort.

The schematic diagram which shows schematic structure of the virtual space experience system which concerns on embodiment. The block diagram which shows the virtual space experience system structure of FIG. The flowchart which shows the process which the virtual space experience system of FIG. 1 performs in the step at the time of the start of a game, and the step where the trigger event is not recognized. It is a perspective view which shows the state at the time of a game start, FIG. 4A is a figure which shows the state of a player, FIG. 4B is a figure which shows the state of an avatar. The flowchart which shows the process which the virtual space experience system of FIG. 1 performs in the 1st step of a game. It is a perspective view which shows the state at the time of the 1st step start of a game, FIG. 6A is a figure which shows a player's state, and FIG. 6B is a figure which shows the state of an avatar. It is a perspective view which shows the state at the time of 1st step progress of a game, FIG. 7A is a figure which shows the state of a player, FIG. 7B is a figure which shows the state of an avatar. It is a perspective view which shows the state at the time of completion of the 1st step of a game, FIG. 8A is a figure which shows the state of real space, FIG. 8B is a figure which shows the state of virtual space. The flowchart which shows the process which the virtual space experience system of FIG. 1 performs in the 2nd step of a game. FIG. 10A is a perspective view showing a state at the start of the second stage of the game, FIG. 10A is a view showing the state of the real space, and FIG. 10B is a view showing the state of the virtual space. FIG. 11A is a perspective view showing a state when the game is progressing in the second stage, FIG. 11A is a view showing a state of a real space, and FIG. 11B is a view showing a state of a virtual space. FIG. 12A is a perspective view showing a state at the time of completion of the second stage of the game, FIG. 12A is a view showing the state of the real space, and FIG. 12B is a view showing the state of the virtual space. The flowchart which shows the process which the virtual space experience system of FIG. 1 performs in the 3rd step of a game. FIG. 14A is a perspective view showing a state at the start of the third stage of the game, FIG. 14A is a view showing the state of the real space, and FIG. 14B is a view showing the state of the virtual space. FIG. 15A is a perspective view showing a state at the time of progress of the third stage of the game, FIG. 15A is a view showing a state of a real space, and FIG. 15B is a view showing a state of a virtual space. FIG. 16A is a perspective view showing a state at the time of completion of the third stage of the game, FIG. 16A is a view showing a state of a real space, and FIG. 16B is a view showing a state of a virtual space.

  Hereinafter, a virtual space experience system S according to an embodiment will be described with reference to the drawings.

  First, a schematic configuration of the virtual space experience system S will be described with reference to FIG.

  As shown in FIG. 1, the virtual space experience system S includes a plurality of signs 1 attached to a player P existing in the real space RS, a camera 2 that photographs the player P (that is, the sign 1), and a virtual space VS ( 4 and the like, and a head mounted display (hereinafter referred to as “HMD4”) that allows the player to recognize the determined image and sound. The camera 2, the server 3, and the HMD 4 can transmit and receive information to and from each other wirelessly.

  The plurality of signs 1 are attached to the head, both hands, and both feet of the player P through the HMD 4, gloves, and shoes worn by the player P.

  A plurality of cameras 2 are installed so that the range in which the player P in the real space RS where the player P exists can move is photographed from multiple directions.

  The server 3 detects the sign 1 from a plurality of images taken by the camera 2, recognizes the coordinates and posture of the player P based on the position of the detected sign 1 in the real space RS, and sets the coordinates and posture. Based on this, the image and sound to be recognized by the player P are determined.

  The HMD 4 is attached to the head of the player P. The HMD 4 has a monitor 41 (virtual space image display) for allowing the player P to recognize the image of the virtual space determined by the server 3 and the sound of the virtual space determined by the server 3 in the player P. Are provided with a speaker 42 (virtual space sound generator) for causing the player P to recognize and a microphone (not shown) for collecting the voice of the player P (see FIG. 2).

  When a game or the like is performed using the virtual space experience system S, the player P recognizes only the image and sound in the virtual space and recognizes that the player P is present in the virtual space.

  Note that the virtual space experience system S includes a so-called motion capture device configured by the sign 1, the camera 2, and the server 3 as a system for recognizing the coordinates of the player P in the real space. However, the virtual space experience system of the present invention is not limited to such a configuration.

  For example, when using a motion capture device, in addition to the above configuration, a camera and a server connected by a wire may be used, and the number of signs and cameras is different from the above configuration (for example, , One each) may be used. Moreover, you may use the apparatus which detects only a player's coordinate instead of a motion capture apparatus.

  Next, the configuration of the server 3 will be described in detail with reference to FIG.

  The server 3 is composed of one or a plurality of electronic circuit units including a CPU, a RAM, a ROM, an interface circuit, and the like. As shown in FIG. 2, the server 3 includes a display image generation unit 31, a player information detection unit 32, a trigger event recognition unit 33, and avatar coordinate determination as functions implemented by the implemented hardware configuration or program. Unit 34, virtual space image determination unit 35, and virtual space audio determination unit 36.

  The display image generation unit 31 generates an image to be recognized by the player P via the monitor 41 of the HMD 4. The display image generation unit 31 includes a virtual space generation unit 31a, an avatar generation unit 31b, and a moving body generation unit 31c.

  The virtual space generation unit 31a generates an image as a background of the virtual space and an image of an object existing in the virtual space.

  The avatar production | generation part 31b produces | generates the avatar which operate | moves corresponding to the operation | movement of the player P in virtual space. When there are a plurality of players P, the avatar generation unit 31b generates a plurality of avatars so as to correspond to the respective players P. The avatar operates in the virtual space in response to the movement of the corresponding player P in the real space (that is, movement of coordinates and change in posture).

  The moving object generation unit 31c generates a moving object that can be connected to an avatar in the virtual space without a corresponding object in the real space RS in the virtual space.

  Here, “moving body” means that when the avatar is connected, the player predicts the movement of the avatar that is different from the actual movement of the player P (whether conscious or not). If it is. For example, in addition to what is used for movement in an actual space such as an elevator, logs that flow through rivers that can be jumped on, floors that are likely to collapse when standing on top, jump stands, wings that assist jumping, and the like are applicable.

  Here, the “connection” between the avatar and the moving body means that the player can predict that the movement of the moving body, the change in the shape of the moving body, etc. will affect the coordinates of the avatar. . For example, an avatar gets into an elevator, an avatar rides on a log flowing through a river, an avatar stands on a floor where the avatar is likely to collapse, stands on a jumping table, and an avatar wears wings that assist jumping.

  The player information detection unit 32 receives the image data of the player P including the sign 1 photographed by the camera 2. The player information detection unit 32 includes a player attitude detection unit 32a and a player coordinate detection unit 32b.

  The player attitude detection unit 32a extracts the marker 1 from the input image data of the player P, and detects the attitude of the player P based on the extraction result.

  The player coordinate detection unit 32b extracts the marker 1 from the input image data of the player P, and detects the coordinates of the player P based on the extraction result.

  When the player P performs a predetermined motion in the real space (that is, when an avatar corresponding to the player P performs a predetermined motion in the virtual space), the trigger event recognition unit 33 triggers based on the motion Recognize that occurred. If the trigger event occurs according to the action of the player P, such as the player P moving to a predetermined coordinate or the player P taking a predetermined posture, the player P is not aware of the occurrence. There may be.

  The avatar coordinate determination unit 34 determines the coordinates of the avatar corresponding to the player P in the virtual space based on the coordinates in the real space RS of the player P detected by the player coordinate detection unit 32b.

  In addition, when the trigger event recognizing unit 33 recognizes the trigger event, the avatar coordinate determining unit 34, in a predetermined period or a predetermined range, or a predetermined period and a predetermined range, according to the type of the recognized trigger event, The avatar coordinates are corrected so as to cause a shift in the correspondence between the player coordinates and the avatar coordinates.

  Here, “correction” that causes a shift in the correspondence between the player's coordinates and the avatar's coordinates is to move the avatar's coordinates without relating to the movement of the player's coordinates. For example, changing the amount of movement of the avatar's coordinates relative to the amount of movement of the coordinates.

  Based on the coordinates of the avatar, the virtual space image determination unit 35 determines an image of the virtual space to be recognized by the player P corresponding to the avatar via the monitor 41 of the HMD 4.

  Here, the “virtual space image” refers to an image of the background of the virtual space, another avatar image, an image of an object that exists only in the virtual space, or an object that exists in the virtual space corresponding to the real space. An image such as an image where the player can infer the coordinates of the avatar corresponding to the player in the virtual space.

  The virtual space sound determination unit 36 determines sound to be recognized by the player P corresponding to the avatar through the speaker 42 of the HMD 4 based on the coordinates of the avatar.

  Next, processing performed by the virtual space experience system S when a game is played using the virtual space experience system S will be described with reference to FIGS. 3, 5, 9 and 13 are flowcharts showing processing performed in the virtual space experience system S at each stage of the game. Here, the game performed in this embodiment is a game in which two players move in cooperation and aim for each goal point from each start point.

  First, with reference to FIG. 2, FIG. 3 and FIG. 4, the processing executed by the virtual space experience system S at the stage when the game starts and when the trigger event is not recognized will be described.

  When a signal instructing the start of the game is recognized, first, the display image generation unit 31 of the server 3 generates the virtual space VS, the first avatar A1 and the second avatar A2, and a moving body (FIG. 3 / STEP01). ).

  Specifically, the virtual space generation unit 31a of the display image generation unit 31 generates various objects existing in the virtual space VS and the virtual space VS. The avatar generation unit 31b of the display image generation unit 31 corresponds to the first avatar A1 (first avatar) and the second player P2 (second player) corresponding to the first player P1 (first player). Two avatars A2 (second avatar) are generated. The moving body generating unit 31c of the display image generating unit 31 generates a moving body such as an elevator VS1 described later.

  In the virtual space VS generated by the processing of STEP01, as shown in FIG. 4B, in addition to the first avatar A1 and the second avatar A2, the elevator VS1, the floor VS2 and the jump stand VS3 which are moving objects, the real space RS An object related to a trigger event such as a button VS4 generated at a position corresponding to the whiteboard RS1 (see FIG. 4A) installed in is installed.

  Next, the player information detection unit 32 of the server 3 acquires image data captured by the camera 2, and based on the image data, the first player P1 and the second player P2 (hereinafter collectively referred to as “player”). P ”) in the real space RS and the posture (see FIG. 4A) are detected (FIG. 3 / STEP02).

  Next, the avatar coordinate determination unit 34 of the server 3 determines the coordinates in the virtual space VS of the first avatar A1 based on the coordinates in the real space RS of the first player P1 detected by the player information detection unit 32. Based on the coordinates in the real space RS of the two players P2, the coordinates in the virtual space VS of the second avatar A2 are determined (FIG. 3 / STEP03).

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 recognize the image and sound that the player P recognizes based on the coordinates and postures of the first avatar A1 and the second avatar A2 in the virtual space VS. (FIG. 3 / STEP04).

  Next, the HMD 4 attached to the player P displays the determined image on the monitor 41 and generates sound on the speaker 42 (FIG. 3 / STEP 05).

  Next, the player information detection unit 32 of the server 3 determines whether or not the movement of the coordinates or the change of posture in the real space RS of the first player P1 or the second player P2 is detected (FIG. 3 / STEP06).

  When the movement of the coordinate or the change of posture in the real space RS of the first player P1 or the second player P2 is detected (YES in STEP06), the process returns to STEP03, and the processes after STEP03 are executed again.

  When the movement of the coordinates or the change of posture in the real space RS of the first player P1 or the second player P2 is not detected (NO in STEP06), the server 3 recognizes a signal for instructing the end of the game. It is determined whether or not (FIG. 3 / STEP07).

  If the signal for instructing the end of the game cannot be recognized (NO in STEP07), the process returns to STEP06, and the processes after STEP06 are executed again. When the signal for instructing the end of the game is recognized (YES in STEP 07), the virtual space experience system S ends the current process.

  After the game is started by the above processing, the first avatar A1 corresponding to the first player P1 and the second avatar A2 corresponding to the second player P2 and the elevator VS1, which is a moving body, are added to the virtual space VS. A plurality of objects including the floor VS2 and the jump stand VS3 are installed.

  Then, the first player P1 and the second player P2 are imaginary by the images displayed on the HMD 4 and the sound generated, respectively, via the corresponding first avatar A1 and second avatar A2. It will be recognized that it exists in the space VS and can operate freely.

  Next, processing executed by the virtual space experience system S in the first stage of the game will be described with reference to FIGS. 2 and 5 to 8. In this first stage, the state of the virtual space VS becomes the state shown in FIG. 6B (that is, the movement of the first avatar A1 onto the mark VS1a of the elevator VS1) corresponds to the generation of the trigger event.

  In the first stage, first, the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of the trigger event based on the operation of the first player P1 has been recognized (FIG. 5 / STEP 11).

  Specifically, the trigger event recognition unit 33 moves in the virtual space VS so that the first avatar A1 corresponding to the first player P1 moves on the mark VS1a of the elevator VS1 (see FIG. 6B). Then, it is determined whether or not the first player P1 has moved in the Y-axis direction (see FIG. 6A).

  When the coordinates of the first player P1 are located at a predetermined position, the trigger event recognition unit 33 recognizes that a trigger event has occurred.

  At this time, since the elevator VS1 is a moving body, the first player P1 and the second player P2 recognize that the first avatar A1 corresponding to the first player is connected to the moving body.

  When the occurrence of the trigger event is recognized (YES in STEP 11), the avatar coordinate determination unit 34 of the server 3 is the first avatar riding on the elevator VS1 as the elevator VS1 that is the moving body moves. The coordinates of A1 are moved (FIG. 5 / STEP 12).

  Specifically, the avatar coordinate determination unit 34 uses the occurrence of the trigger event as a trigger, and the avatar coordinate determination unit 34 places the coordinates of the first avatar A1 in a predetermined direction as the elevator VS1, which is a moving body, moves. Move quantitatively.

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine the image and sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after the movement (see FIG. 5 / STEP 13).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41 and generates sound on the speaker 42 (FIG. 5 / STEP 14).

  After executing the process of STEP14, or when the occurrence of the trigger event is not recognized (NO in STEP11), the virtual space experience system S ends this process.

  During the processing of STEP12 to STEP14, in the real space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are the first stage start (FIG. 6A), the first stage progress (FIG. 7A) and the first stage. At the end of one stage (FIG. 8A), it has not moved.

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 are the first stage start (FIG. 6B), the first stage progress (FIG. 7B), and the first stage end (FIG. 8B). ), In accordance with the movement of the elevator VS1, which is a moving body, the X-axis direction moves away from the second avatar A2, and the Z-axis direction moves upward. Here, the movement speed of the coordinates of the first avatar A1 is slower in the Z-axis direction than in the X-axis direction.

  That is, by the processing of STEP12 to STEP14, the coordinates of the first avatar A1 move independently of the movement of the coordinates of the first player P1, and the coordinates of the first player P1 in the real space RS and the virtual space of the first avatar A1. There will be a shift in the correspondence with the coordinates in VS.

  Then, the image of the virtual space VS recognized by the player P changes according to the deviation of the correspondence relationship.

  Specifically, in the image of the virtual space VS recognized by the first player P1, the image of the second avatar A2 is based on the change in the relative coordinates of the first avatar A1 and the second avatar A2, and its size and angle. , Posture, etc. change. Moreover, the size, angle, etc. of images other than the second avatar A2 change based on the movement of the coordinates of the first avatar A1.

  Further, in the image of the virtual space VS recognized by the second player P2, the size, angle, etc. of the image of the elevator VS1, which is a moving body, change based on the movement of the elevator VS1. In addition, the size, angle, posture, and the like of the image of the first avatar A1 change based on the change in the relative coordinates of the first avatar A1 and the second avatar A2 accompanying the movement of the elevator VS1. Moreover, images other than elevator VS1 and 1st avatar A1 do not change.

  In addition, the voice of the virtual space VS (for example, the voice of an avatar determined based on the voice of another player or the sound generated from the moving body) is also displayed by the first avatar A1 in the same manner as the image of the virtual space VS. It changes according to movement with VS1.

  Then, the player P recognizes the virtual space VS expanded from the real space RS by recognizing the deviation of the correspondence relationship through the change in the image and sound of the virtual space VS. Specifically, the player P moves the virtual space VS in the X-axis direction and the Z-axis direction so that the first avatar A1 can move as the first avatar A1 moves in the X-axis direction and the Z-axis direction. It is recognized that it is expanded from the real space RS.

  Also, the trigger event in the first stage is that the first player P1 moves so that the first avatar A1 stands on the mark VS1a in a state where the first avatar A1 and the elevator VS1 that is a moving body are boarded (connected). It is supposed to be.

  In other words, the movement of the coordinates of the first avatar A1 to cause a shift in the correspondence relationship is a state in which the player P can predict that the movement of the elevator VS1, which is a moving body, affects the coordinates of the first avatar A1. appear.

  By this prediction, the player P can accept a shift in the correspondence between the coordinates in the real space RS of the first player P1 and the coordinates in the virtual space VS of the first avatar A1 without a sense of incongruity.

  By the way, as described above, the movement speed of the coordinates of the first avatar A1 generated in accordance with the movement of the elevator VS1 is slower in the Z-axis direction than in the X-axis direction.

  Thereby, the deviation of the correspondence relationship is large in the X-axis direction and small in the Z-axis direction. As a result, the player P greatly expands in the direction in which the first avatar A1 moves away from the second avatar A2 in the X-axis direction with respect to the real space RS, and in the Z-axis direction, the degree of expansion in the X-axis direction Recognize a small and expanded virtual space VS.

  In addition, the movement in the X direction and the movement in the Z-axis direction of the coordinates of the first avatar A1 for causing the correspondence relationship to shift are performed simultaneously. As a result, the time of the process of causing the correspondence relationship to deviate (that is, the time when the player P easily feels uncomfortable) is concentrated. As a result, the player P does not often feel uncomfortable.

  Next, with reference to FIG. 2 and FIG. 9 to FIG. 12, processing executed by the virtual space experience system S in the second stage of the game will be described. In this second stage, the state of the virtual space VS becomes the state shown in FIG. 11B (that is, the second avatar A2 performs an operation of pressing the button VS4) corresponds to the generation of the trigger event.

  In this second stage, first, the avatar coordinate determination unit 34 of the server 3 determines whether or not the first avatar A1 is connected to the moving object (FIG. 9 / STEP 21).

  Specifically, the avatar coordinate determination unit 34 moves in the virtual space VS on the floor VS2 on which the coordinates of the first avatar A1 corresponding to the first player P1 are likely to collapse (FIG. 10B). Reference), it is determined whether or not the coordinates of the first player P1 have moved in the Y-axis direction in the real space RS (see FIG. 10A).

  In the second stage, since the floor VS2 is a moving body, the first player P1 and the second player P2 recognize that the first avatar A1 has moved onto the floor VS2, so that the first avatar A1 moves. You will recognize that you are connected to your body.

  The determination in STEP 21 is repeated at a predetermined cycle until it is determined that the first avatar A1 is connected to the moving body (moved on the floor VS2) (every time NO is determined in STEP 21).

  When the first avatar A1 is connected to the moving body (in the case of YES at STEP21), it is determined whether or not the trigger event recognition unit 33 of the server 3 has recognized the occurrence of the trigger event based on the operation of the second player P2. Determination is made (FIG. 9 / STEP 22).

  Specifically, the trigger event recognition unit 33 is configured so that the second avatar A2 corresponding to the second player P2 touches the button VS4 at a position near the button VS4 in the virtual space VS (see FIG. 10B). In the real space RS, it is determined whether or not the second player P2 moves in the Y-axis direction and assumes a predetermined posture (see FIG. 10A).

  When the coordinates of the second player P2 move to a predetermined position and the posture of the second player P2 becomes a predetermined posture, the trigger event recognition unit 33 performs a trigger event based on the operation of the second player P2. Recognize that occurred.

  If the occurrence of the trigger event is recognized (YES in STEP 22), the avatar coordinate determination unit 34 of the server 3 stands on the floor VS2 as the floor VS2 collapses (that is, the moving body moves). The coordinates of the first avatar A1 are moved (FIG. 9 / STEP 23).

  Specifically, the avatar coordinate determination unit 34 moves only the coordinates of the first avatar A1 in a predetermined direction by a predetermined amount, triggered by the occurrence of a trigger event based on the action of the second player P2.

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine the image and sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after the movement (see FIG. 9 / STEP 24).

  Next, the HMD 4 worn by the player P displays the determined image on the monitor 41 and generates sound on the speaker 42 (FIG. 9 / STEP 25).

  After executing the process of STEP 25 or when the occurrence of the trigger event is not recognized (NO in STEP 22), the virtual space experience system S ends this process.

  During the processing of STEP23 to STEP25 described above, in the real space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are the second stage start (FIG. 10A), the second stage progression (FIG. 11A), and the first stage. It has not moved at the end of the second stage (FIG. 12A).

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 are the second stage start (FIG. 10B), the second stage progress (FIG. 11B), and the second stage end (FIG. 12B). ), It moves downward in the Z-axis direction with the collapse of the floor VS2 which is a moving body.

  That is, by the processing of STEP23 to STEP25, the coordinates of the first avatar A1 move independently of the movement of the coordinates of the first player P1, and the coordinates of the first player P1 in the real space RS and the virtual space of the first avatar A1. There will be a shift in the correspondence with the coordinates in VS.

  At this time, the image of the virtual space VS recognized by the player P changes in the same manner as the processing (STEP 12 to STEP 14) when the correspondence relationship is shifted in the first stage.

  Then, the player P recognizes that the virtual space VS is expanded more than the real space RS by recognizing the deviation of the correspondence relationship through the change in the image and sound of the virtual space VS. Specifically, the player P moves the first avatar A1 downward in the Z-axis direction so that the first avatar A1 can move in such a manner that the virtual space VS is lower in the Z-axis direction than the real space RS. Recognize that it has been expanded.

  In addition, the second stage trigger event (the operation in which the second avatar A2 presses the button VS4, the processing in STEP22) is a state in which the first avatar A1 is standing (connected) on the floor VS2 that is likely to collapse. (Processing in STEP 21) is assumed.

  In other words, the movement of the coordinates of the first avatar A1 to cause a shift in the correspondence relationship is predicted by the player P that the collapse (change) of the floor VS2b, which is a moving object, affects the coordinates of the first avatar A1. Occurs in the state to get

  By this prediction, the player P can accept a shift in the correspondence between the coordinates in the real space RS of the first player P1 and the coordinates in the virtual space VS of the first avatar A1 without a sense of incongruity.

  By the way, the trigger event in the second stage is not the movement of the moving first avatar A1 on the floor VS2, but the operation of the second avatar A2 pressing the button VS4. That is, the avatar whose coordinates move to cause a shift in the correspondence does not match the avatar that generates the trigger event.

  However, even if they do not coincide with each other, both the first player P1 and the second player P2 can recognize the virtual space VS expanded from the real space RS.

  Next, with reference to FIG. 2 and FIGS. 13 to 16, processing executed by the virtual space experience system S in the third stage of the game will be described. In this third stage, the state of the virtual space VS becomes the state shown in FIG. 14B (that is, the first avatar A1 moves on the jump base VS3) corresponds to the occurrence of the trigger event.

  In the third stage, first, the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of the trigger event based on the operation of the first player P1 has been recognized (FIG. 13 / STEP 31).

  Specifically, the trigger event recognizing unit 33 in the real space RS so that the first avatar A1 corresponding to the first player P1 moves on the jump base VS3 in the virtual space VS (see FIG. 14B). It is determined whether or not the first player P1 has moved in the Y-axis direction (see FIG. 14A).

  When the coordinates of the first player P1 are located at a predetermined position, the trigger event recognition unit 33 recognizes that a trigger event has occurred.

  At this time, since the jump base VS3 is a moving body, the first player P1 and the second player P2 recognize that the first avatar A1 corresponding to the first player is connected to the moving body.

  When the occurrence of the trigger event is recognized (in the case of YES in STEP 31), the avatar coordinate determination unit 34 of the server 3 determines the moving speed in the predetermined direction of the coordinates of the first avatar A1 to be moved by the moving body. Then, it is changed within a predetermined range (FIG. 13 / STEP 32).

  Specifically, the avatar coordinate determination unit 34 increases the movement speed of the coordinates of the first avatar A1 relative to the movement speed of the coordinates of the first player P1 only upward in the Z-axis direction only in the range above the jump base VS3. Change to

  Next, with the movement of the coordinates of the first player P1, the coordinates of the first avatar A1 are moved (FIG. 13 / STEP 33).

  Next, the virtual space image determination unit 35 and the virtual space sound determination unit 36 of the server 3 determine the image and sound of the virtual space to be recognized by the player P based on the coordinates of the first avatar A1 after the movement (see FIG. 13 / STEP 34).

  Next, the HMD 4 attached to the player P displays the determined image on the monitor 41 and generates sound on the speaker 42 (FIG. 13 / STEP 35).

  After executing the process of STEP 35 or when the occurrence of the trigger event is not recognized (NO in STEP 31), the virtual space experience system S ends this process.

  During the processing of STEP 32 to STEP 35 described above, in the real space RS, the coordinates of the first player P1 corresponding to the first avatar A1 are from the start of the third stage (FIG. 14A) to the progress of the third stage (FIG. 15A). It moves forward in the Y-axis direction and upward in the Z-axis direction, and moves forward in the Y-axis direction and downward in the Z-axis direction during the third stage (FIG. 15A) to the end of the third stage (FIG. 16A).

  On the other hand, in the virtual space VS, the coordinates of the first avatar A1 corresponding to the first player P1 are also forward in the Y-axis direction and the Z-axis from the start of the third stage (FIG. 14B) to the progress of the third stage (FIG. 15B). When the third stage is advanced (FIG. 15B) to the end of the third stage (FIG. 16B), it moves forward in the Y-axis direction and downward in the Z-axis direction.

  However, the coordinates of the first avatar A1 from the start of the third stage (FIG. 14B) to the progress of the third stage (FIG. 15B) are jump ranges that are the range in which the moving speed is changed (the range to be processed in STEP 32). Since it is a range above VS3, only the upward movement in the Z-axis direction is larger than the movement in the other direction (that is, the movement of the coordinates of the first avatar A1 with respect to the movement amount of the coordinates of the first player P1). The amount is changing.)

  As a result, when landing (at the end of the third stage (FIG. 16B)), the correspondence between the coordinates in the real space of the first player P1 and the coordinates in the virtual space of the first avatar A1 is shifted in the Z-axis direction. Will occur. Specifically, in the real space RS, the first player P1 has only jumped forward on a flat ground, but in the virtual space VS, the first avatar A1 corresponding to the first player P1 is high from a low position. I jumped on the step.

  At this time, the image of the virtual space VS recognized by the player P changes in the same manner as the processing (STEP 12 to STEP 14 and STEP 23 to STEP 25) when the correspondence relationship is shifted in the first stage and the second stage.

  Then, the player P recognizes the virtual space VS expanded from the real space RS by recognizing the deviation of the correspondence relationship through the change in the image and sound of the virtual space VS. Specifically, the player P moves the first avatar A1 so as to jump over the level difference, so that the virtual space VS actually falls downward in the Z-axis direction within a predetermined range (a range where the jump base VS3 exists). Recognize that the space RS is expanded.

  In the trigger event in the third stage, the first player P1 moves so as to stand on the first avatar A1 and the jump base VS3 which is a moving body.

  In other words, the movement of the coordinates of the first avatar A1 to cause a shift in the correspondence relationship occurs in a state in which the player P can predict that the jump base VS3 as a moving object affects the coordinates of the first avatar A1. To do.

  By this prediction, the player P can accept a shift in the correspondence between the coordinates in the real space RS of the first player P1 and the coordinates in the virtual space VS of the first avatar A1 without a sense of incongruity.

  By the way, in the third stage, the movement of the coordinates of the first avatar A1 for causing a shift in the correspondence is a jump (that is, a reciprocating motion including a rise and a descent immediately after the rise).

  As a result, the time of the process of causing the correspondence relationship to deviate (that is, the time when the player P easily feels uncomfortable) is concentrated. As a result, the player P does not frequently feel uncomfortable. Further, since the correspondence is shifted through the reciprocating motion, it is difficult for the player P to recognize the process in which the shift occurs.

  As described above, according to the virtual space experience system S, the correction for shifting the correspondence between the coordinates in the real space RS of the first player P1 and the coordinates in the virtual space VS of the first avatar A1 is performed by the first player. Since P1 and the second player P2 can make predictions, it is possible to make the player recognize a virtual space expanded from the real space while suppressing the uncomfortable feeling that the first player P1 and the second player P2 learn.

  Although the illustrated embodiment has been described above, the present invention is not limited to such a form.

  For example, in the above embodiment, the first player P1 and the second player P2 exist in the real space RS, and the second avatar A1 and the second player P2 corresponding to the first player P1 in the virtual space VS. Avatar A2 exists. However, the virtual space recognition system of the present invention does not correspond to only two players, and the number of players may be three or more.

  Moreover, in the said embodiment, the audio | voice which generate | occur | produces with the speaker 42 of HMD4 which is a virtual space audio | voice generator is determined by the virtual space audio | voice determination part 36 of the server 3. FIG. However, in the virtual space experience system of the present invention, the virtual space sound determination unit and the virtual space sound generator may be omitted, and the processing for sound may be omitted.

  In the above embodiment, the virtual space VS is expanded in the X-axis direction and the Z-axis direction relative to the real space RS. However, the virtual space in the virtual space sensation system of the present invention is not limited to this, and may be expanded from the real space in any direction.

  Moreover, in the said embodiment, the movement to the predetermined position of 1st avatar A1 and the predetermined operation | movement in the predetermined position of 2nd avatar A2 are made into the trigger event. However, the trigger event in the virtual space experience system of the present invention is not limited to this.

  For example, when an avatar jumps on a log flowing through a river in virtual space and the avatar is moved together with the log to cause a shift in the correspondence, the action of jumping on the log flowing through the river is This is an operation for recognizing the occurrence of a connection and trigger event.

  Moreover, in the said embodiment, as correction | amendment of the coordinate of the avatar for producing the shift | offset | difference in a corresponding relationship, the elevator VS1 which is a moving body is moved to the X-axis direction and the Z-axis direction upper side for a predetermined period at a 1st step. Yes. In the second stage, the first avatar A1 is moved downward in the Z-axis direction until it reaches a predetermined position (lower floor) in the Z-axis direction. In the third stage, in the third stage, the movement amount is corrected only in the range above the jump base VS3 which is a moving body.

  However, the correction of the avatar coordinates in the virtual space experience system according to the present invention is not limited to such a period and range, and there is a shift in the correspondence between the coordinates of the player in the real space and the coordinates of the avatar in the virtual space. Any correction may be used as long as the correction occurs. Therefore, the correction range and period may be changed as appropriate according to the direction and amount of expansion of the virtual space.

DESCRIPTION OF SYMBOLS 1 ... Sign, 2 ... Camera, 3 ... Server, 4 ... HMD, 31 ... Display image production | generation part, 31a ... Virtual space production | generation part, 31b ... Avatar production | generation part, 31c ... Mobile body production | generation part, 32 ... Player information detection part, 32a ... Player posture detection unit, 32b ... Player coordinate detection unit, 33 ... Trigger event recognition unit, 34 ... Avatar coordinate determination unit, 35 ... Virtual space image determination unit, 36 ... Virtual space audio determination unit, 41 ... Monitor (virtual space Image display), 42 ... Speaker (virtual space sound generator), A1 ... First avatar (first avatar), A2 ... Second avatar (second avatar), P ... Player, P1 ... First player ( First player), P2 ... second player (second player), RS ... real space, RS1 ... whiteboard, S ... virtual space experience system, VS ... virtual space, S1 ... elevator (mobile), VS1a ... mark, VS2 ... floor (mobile), VS3 ... jump, VS4 ... button.

Claims (2)

A virtual space generation unit that generates a virtual space corresponding to the real space in which the first player and the second player exist;
In one virtual space, a first avatar that operates in the virtual space corresponding to the motion of the first player, and a second that operates in the virtual space corresponding to the motion of the second player An avatar generator for generating an avatar of
A player coordinate detection unit for detecting coordinates of the first player and the second player;
An avatar coordinate determination unit that determines the coordinates of the first avatar based on the detected coordinates of the first player and determines the coordinates of the second avatar based on the coordinates of the second player. When,
A virtual space image determination unit that determines an image of the virtual space to be recognized by the first player and the second player based on the coordinates of the first avatar and the coordinates of the second avatar;
A virtual space image display for causing the first player and the second player to recognize the determined image of the virtual space;
The virtual space image determination unit is configured such that when the coordinates of the first avatar are corrected so as to cause a shift in the correspondence between the coordinates of the first player and the coordinates of the first avatar, A virtual space configured to change an image of the first avatar to be recognized by the second player based on a change in relative coordinates between one avatar and the second avatar. Experience system. The virtual space experience system according to claim 1,
Based on the coordinates of the first avatar and the coordinates of the second avatar, a virtual space audio determination unit that determines audio to be recognized by the first player and the second player;
A virtual space experience system, comprising: a virtual space sound generator that causes the first player and the second player to recognize the determined sound.

Images