JP7055527B1 - Virtual space experience system - Google Patents

Abstract

We provide a virtual space experience system that enables multiple users who have experienced different environments in virtual space to experience similar environments. When the occurrence of the trigger event is recognized, the avatar coordinate determination unit 34 of the VR system S sets the coordinates of one of the first avatar A1 and the second avatar A2 to the coordinates of the other of the first avatar A1 and the second avatar A1. Move to coordinates that match or are adjacent to.

Description

The present invention relates to a virtual space experience system for recognizing that the user himself / herself exists in the virtual space displayed as an image.

Conventionally, a virtual space is generated by a server or the like, an image of the virtual space is recognized by a user via a head-mounted display (hereinafter, may be referred to as “HMD”), and the user himself / herself exists in the virtual space. There is a virtual space experience system that makes you recognize that you are.

This type of virtual space experience system recognizes movements in the user's real space (for example, movement of coordinates, changes in posture including orientation, etc.) by a motion capture device or the like, and responds to the user according to the recognized movements. There is an avatar that operates in a virtual space (see, for example, Patent Document 1).

In the virtual space experience system described in Patent Document 1, a plurality of avatars are generated in the same virtual space so as to correspond to each of a plurality of users. Then, in this virtual space experience system, the image of the virtual space to be recognized by each user is determined based on the coordinates of the avatar corresponding to the user. That is, even when the user is experiencing the virtual space at the same time, the image of the virtual space visually recognized by each user (and by extension, the environment of the virtual space being experienced) is different.

Japanese Unexamined Patent Publication No. 2010157461

By the way, when a plurality of users are experiencing the virtual space at the same time and the environment of the virtual space that each user is experiencing is different, one user can experience the environment of the other. There are times when we want the user to experience it. Conversely, one user may want to experience the environment that the other user is experiencing.

The present invention has been made in view of the above points, and provides a virtual space experience system that enables a plurality of users who have experienced different environments in virtual space to experience similar environments. With the goal.

The virtual space experience system of the first invention is
A virtual space generator that creates a virtual space corresponding to the real space in which the first user and the second user exist, and
The first avatar corresponding to the first user and the second avatar corresponding to the second user are generated in the virtual space, and the first user and the second user are supported by the first user. An avatar generation unit that generates a ghost, which is an avatar independent of one avatar and the second avatar, in the virtual space .
A user coordinate recognition unit that recognizes the coordinates of the first user and the coordinates of the second user in the real space, and
Based on the coordinates of the first user, the coordinates of the first avatar in the virtual space are determined, and the coordinates of the second avatar in the virtual space are determined based on the coordinates of the second user, and the coordinates are determined. An avatar coordinate determination unit that determines the coordinates of the ghost based on the coordinates that cause a predetermined deviation in the coordinates of the first avatar or the second avatar corresponding to one of the first user and the second user .
A virtual space image determination unit that determines an image of the virtual space to be recognized by the first user and the second user based on the coordinates of the first avatar and the coordinates of the second avatar.
A trigger event recognition unit that recognizes the occurrence of the first trigger event,
In a virtual space experience system provided with a virtual space image display that causes the first user and the second user to recognize an image of the virtual space.
When the occurrence of the first trigger event is recognized, the avatar coordinate determination unit changes the coordinates of one of the first avatar and the second avatar to the coordinates of the other of the first avatar and the second avatar. Move to matching coordinates or adjacent coordinates ,
The virtual space image determination unit provides information indicating that the image of the virtual space to be recognized by the other of the first user and the second user corresponds to one of the first user and the second user. Include the added image of the ghost,
The first trigger event is characterized in that the first avatar or the second avatar corresponding to the other of the first user and the second user is a predetermined action to be executed for the ghost .

Here, the "image of the virtual space" includes an image of the background of the virtual space, an image of another avatar, an image of an object existing only in the virtual space, and an object existing in the virtual space corresponding to the real space. Images etc. are included.

As described above, in the virtual space experience system of the first invention, when the occurrence of the first trigger event is recognized, the avatar coordinate determination unit sets the coordinates of one of the first avatar and the second avatar. It is moved to the coordinates that match or are adjacent to the coordinates of the other of the 1 avatar and the 2nd avatar.

Here, the image of the virtual space to be recognized by the first user and the second user is determined based on the coordinates of the first avatar and the second avatar. Therefore, when the coordinates of the avatars match or are adjacent to each other, the image of the virtual space recognized by each user corresponding to those avatars is also the same or adjacent image (that is, a similar image).

Therefore, according to the virtual space experience system of the first invention, when the occurrence of the first trigger event is recognized, the images of the virtual space recognized by each user can be matched or adjacent to each other. Therefore, the first user and the second user who have experienced different environments in the virtual space can experience almost the same environment.

Further, the virtual space experience system of the second invention is
A virtual space generator that creates a virtual space corresponding to the real space in which the first user and the second user exist, and
The first avatar corresponding to the first user and the second avatar corresponding to the second user are generated in the virtual space, and the first user and the second user are supported by the first user. An avatar generation unit that generates a ghost, which is an avatar independent of one avatar and the second avatar, in the virtual space .
A user coordinate recognition unit that recognizes the coordinates of the first user and the coordinates of the second user in the real space, and
Based on the coordinates of the first user, the coordinates of the first avatar in the virtual space are determined, and the coordinates of the second avatar in the virtual space are determined based on the coordinates of the second user, and the coordinates are determined. An avatar coordinate determination unit that determines the coordinates of the ghost based on the coordinates that cause a predetermined deviation in the coordinates of the first avatar or the second avatar corresponding to one of the first user and the second user .
A virtual space image determination unit that determines an image of the virtual space to be recognized by the first user and the second user based on the coordinates of the first avatar and the coordinates of the second avatar.
A trigger event recognition unit that recognizes the occurrence of the first trigger event,
In a virtual space experience system provided with a virtual space image display that causes the first user and the second user to recognize an image of the virtual space.
The virtual space image determination unit provides information indicating that the image of the virtual space to be recognized by the other of the first user and the second user corresponds to one of the first user and the second user. The first image of the virtual space including the added image of the ghost and causing one of the first user and the second user to recognize when the occurrence of the first trigger event is recognized. An image is obtained when one of the coordinates of the avatar and the second avatar moves to a coordinate that matches or is adjacent to the other coordinates of the first avatar and the second avatar .
The first trigger event is characterized in that the first avatar or the second avatar corresponding to the other of the first user and the second user is a predetermined action to be executed for the ghost .

As described above, in the virtual space experience system of the second invention, when the occurrence of the first trigger event is recognized, the virtual space image determination unit makes one of the first user and the second user recognize the virtual. The image of the space is an image when the coordinates of one of the first avatar and the second avatar move to the coordinates corresponding to or adjacent to the coordinates of the other of the first avatar and the second avatar.

That is, when the occurrence of the first trigger event is recognized, the reference coordinates for determining the image of the virtual space to be recognized by one user are set regardless of the position of the coordinates of the avatar corresponding to that user. , Coordinates that match the coordinates of the avatar corresponding to the other user or coordinates that are adjacent to the coordinates.

As a result, when the occurrence of the first trigger event is recognized, one user is determined together with the other user based on the coordinates matching the coordinates of the avatar corresponding to the other user or the adjacent coordinates. It will recognize the image in the virtual space.

Therefore, according to the virtual space experience system of the second invention, after the occurrence of the first trigger event is recognized, one user has coordinates matching or adjacent to the coordinates of the avatar corresponding to the other user. Since the image of the virtual space determined based on the coordinates is recognized, the first user and the second user who have experienced different environments in the virtual space can experience almost the same environment. become.

By the way, in the virtual space experience system of the present invention,
The avatar generation unit generates a ghost in the virtual space, which corresponds to one of the first user and the second user and is an avatar independent of the first avatar and the second avatar.
The avatar coordinate determination unit determines the coordinates of the ghost based on the coordinates that cause a predetermined deviation in the coordinates of the first avatar or the second avatar corresponding to one of the first user and the second user. Decide and
The virtual space image determination unit provides information indicating that the image of the virtual space to be recognized by the other of the first user and the second user corresponds to one of the first user and the second user. Include the added image of the ghost,
The first trigger event is configured to be a predetermined action performed by the first avatar or the second avatar corresponding to the other of the first user and the second user on the ghost.

Here, the "information indicating that the user is responding" is, for example, direct information such as a message displayed at all times or in response to the user's request, and the corresponding avatar shape is made translucent. It also includes indirect information presented by adopting things as ghost shapes.

When generating an avatar corresponding to a user in a virtual space, it is not always the case that only one avatar is generated for each user. Therefore, in addition to the avatar that corresponds to the user and is the standard for determining the image to be recognized by the user, the avatar that corresponds to the user but is independent of the standard avatar (that is, the standard). You may generate a ghost that is not an avatar).

Here, in the virtual space experience system of the present invention, information indicating that a predetermined user is supported is added to the ghost. Therefore, other users can easily grasp which user the ghost corresponds to.

Then, if a predetermined action that the avatar executes for the ghost is set as the first trigger event, the user corresponding to the avatar can also experience the environment of the user corresponding to the ghost as a result of executing the action. You will be able to intuitively understand what you can do.

Here, the "predetermined action" may be any action performed by the avatar based on the ghost. For example, when the avatar touches the ghost, the avatar moves within a predetermined range based on the ghost, or when the avatar operates an object existing in the virtual space, the ghost is selected as the target. (For example, an operation such as shooting a ghost with a camera-type object) and the like.

Further, in the virtual space experience system of the present invention, in the case of a configuration that generates a ghost,
The trigger event recognition unit recognizes the occurrence of the second trigger event and recognizes the occurrence of the second trigger event.
When the occurrence of the second trigger event is recognized, the avatar generation unit generates the first ghost, which is the ghost corresponding to the first user, in the virtual space.
After the occurrence of the second trigger event is recognized, the avatar coordinate determination unit determines the coordinates of the first avatar based on the coordinates that cause the predetermined deviation from the coordinates of the first user. , The coordinates of the first ghost in the virtual space are determined based on the coordinates of the first user.
After the occurrence of the second trigger event is recognized, the virtual space image determination unit displays information indicating that the image of the virtual space to be recognized by the second user corresponds to the first user. The added image of the first ghost is included,
The first trigger event is preferably a predetermined action performed by the second avatar with respect to the first ghost.

For example, when the first user and the second user exist in the same area in the real space (for example, in the same room), the coordinates of the first avatar may deviate from the coordinates of the first user. If the determination is made based on the coordinates, even if the second user moves the second avatar corresponding to the user so as not to contact the first avatar, the second user contacts the first user corresponding to the first avatar. There is a risk that it will end up.

Then, in order to avoid the contact, a method is adopted in which the coordinates of the first ghost corresponding to the first user are set to the coordinates based on the coordinates of the first user (that is, the coordinates before the deviation occurs). There is. As a result, the second avatar (that is, the second user) moves so as to avoid the first ghost, so that it is possible to prevent the second user from coming into contact with the first user.

When such a method is adopted, it is preferable to adopt the action executed by the second avatar with respect to the first ghost as the first trigger event in this way.

With such a configuration, the operation allows the second user to intuitively understand that the first trigger event that shares the environment with the first user occurs. As a result, since the first trigger event is generated, it is possible to suppress the second user's immersive feeling in the virtual space from being hindered.

Further, in the virtual space experience system of the present invention, in the case of a configuration that generates a ghost,
The trigger event recognition unit recognizes the occurrence of the second trigger event and recognizes the occurrence of the second trigger event.
When the occurrence of the second trigger event is recognized, the avatar generation unit generates the second ghost, which is the ghost corresponding to the second user, in the virtual space.
After the occurrence of the second trigger event is recognized, the avatar coordinate determination unit determines the coordinates of the first avatar based on the coordinates that cause the predetermined deviation from the coordinates of the first user. , The coordinates of the second ghost in the virtual space are determined based on the coordinates that cause the predetermined deviation from the coordinates of the second user.
After the occurrence of the second trigger event is recognized, the virtual space image determination unit displays information indicating that the image of the virtual space to be recognized by the first user corresponds to the second user. The added image of the second ghost is included,
The first trigger event is preferably a predetermined action performed by the first avatar with respect to the second ghost.

For example, when the first user and the second user exist in the same area in the real space (for example, in the same room), the coordinates of the first avatar may deviate from the coordinates of the first user. If the determination is made based on the coordinates, even if the first user moves the first avatar corresponding to the user so as not to contact the second avatar, the first user contacts the second user corresponding to the second avatar. There is a risk that it will end up.

Then, in order to avoid the contact, a method is adopted in which the coordinates of the fourth ghost corresponding to the second user are set to the coordinates that cause the same deviation as the first avatar in the coordinates of the second avatar. There is. As a result, the first avatar (that is, the first user) moves so as to avoid the fourth ghost, so that it is possible to prevent the first user from coming into contact with the second user.

When such a method is adopted, it is preferable to adopt the action executed by the first avatar with respect to the second ghost as the first trigger event.

With such a configuration, the operation allows the first user to intuitively understand that the first trigger event that shares the environment with the second user occurs. As a result, since the first trigger event is generated, it is possible to suppress the immersive feeling of the first user in the virtual space from being hindered.

The schematic diagram which shows the schematic structure of the VR system which concerns on 1st Embodiment. The block diagram which shows the structure of the processing part of the VR system of FIG. The flowchart which shows the process which the VR system of FIG. 1 performs in a normal use state. The schematic diagram which shows the state of the real space and the virtual space in the normal use state of the VR system of FIG. The flowchart which shows the process to execute when the VR system of FIG. 1 expands a virtual space, and after that. The schematic diagram which shows the state of the real space and the virtual space when the virtual space is expanded in the VR system of FIG. The schematic diagram which shows the state of the real space and the virtual space after expanding the virtual space in the VR system of FIG. The flowchart which shows the process in 1st Embodiment which performs when the VR system of FIG. 1 synchronizes an environment, and after that. The schematic diagram which shows the state of the real space and the virtual space when the VR system of FIG. 1 synchronizes an environment. The schematic diagram which shows the state of the real space and the virtual space after the VR system of FIG. 1 synchronizes the environment. The flowchart which shows the process which the VR system of 2nd Embodiment executes when synchronizing an environment. The schematic diagram which shows the state of the real space and the virtual space when the VR system of FIG. 11 synchronizes an environment. The schematic diagram which shows the state of the real space and the virtual space after the VR system of FIG. 11 synchronizes the environment. FIG. 11 is a schematic diagram of an image of a virtual space recognized by a second user before the VR system of FIG. 11 synchronizes the environment. FIG. 11 is a schematic diagram of an image of a virtual space recognized by a second user after the VR system of FIG. 11 synchronizes the environment.

[First Embodiment]
Hereinafter, the VR system S, which is a virtual space experience system according to the first embodiment, will be described with reference to FIGS. 1 to 10.

The VR system S refers to the first user U1 and the second user U2 (hereinafter, collectively referred to as "user U") existing together in a predetermined area (for example, one room) of the real space RS. One virtual space VS corresponding to an area is made to recognize that it exists together via the first avatar A1 corresponding to the first user U1 and the second avatar A2 corresponding to the second user U2 (Fig.). See 4th grade).

In this embodiment and the second embodiment described later, the number of users is two for easy understanding. However, the virtual space experience system of the present invention is not limited to such a configuration, and the number of users may be three or more.

[Overview of system configuration]
First, a schematic configuration of the VR system S will be described with reference to FIG.

As shown in FIG. 1, the VR system S is a camera 2 that captures a plurality of signs 1 attached to a user U existing in the real space RS and a user U (strictly speaking, a sign 1 attached to the user U). It also includes a server 3 that determines the image and sound of the virtual space VS (see FIG. 4 and the like), and a head-mounted display (hereinafter referred to as "HMD4") that allows the user to recognize the determined image and sound. ..

In the VR system S, the camera 2, the server 3, and the HMD 4 can transmit and receive information to and from each other wirelessly such as an Internet network, a public line, and short-range wireless communication. However, any one of them may be configured to be able to send and receive information to and from each other by wire.

The plurality of signs 1 are attached to the head, both hands, and both feet of the user U via the HMD4, gloves, and shoes worn by the user U. The plurality of signs 1 are used to recognize the coordinates and the posture (for example, the movement of the coordinates, the change of the posture including the direction, etc.) in the real space RS of the user U as described later. Is. Therefore, the mounting position of the sign 1 may be appropriately changed according to other devices constituting the VR system S.

The camera 2 is installed so that the user U of the real space RS in which the user U exists can shoot the operable range (that is, the range in which the coordinates can be moved, the posture can be changed, etc.) from multiple directions.

The server 3 recognizes the sign 1 from the image taken by the camera 2, and recognizes the coordinates and the posture of the user U based on the position of the recognized sign 1 in the real space RS. Further, the server 3 determines the image and the sound to be recognized by the user U based on the coordinates and the posture.

The HMD 4 is attached to the head of the user U. The HMD 4 has a monitor 41 (virtual space image display) for causing the user U to recognize the image of the virtual space VS determined by the server 3, and the sound of the virtual space VS determined by the server 3. A speaker 42 (virtual space voice generator) for making the user U recognize is provided (see FIG. 2).

When playing a game or the like using the VR system S, the user U recognizes only the image and the sound of the virtual space VS, and is made to recognize that the user U himself / herself exists in the virtual space. That is, the VR system S is configured as a so-called immersive system.

The virtual space experience system of the present invention is not limited to such an immersive system. Therefore, for example, the configuration of the virtual space experience system of the present invention is applied to a system (so-called AR system) in which an image of a real space and an image of a virtual space are superimposed and displayed so that the user can recognize the expanded real space. You may.

The VR system S includes a so-called motion capture device composed of a marker 1, a camera 2, and a server 3 as a system for recognizing coordinates in the real space RS of the user U.

The virtual space experience system of the present invention is not limited to such a configuration. For example, when using a motion capture device, in addition to the above configuration, one having a different number of signs and cameras from the above configuration (for example, one is provided for each) may be used.

Further, for example, instead of the motion capture device, a device that recognizes only the user's coordinates may be used. Specifically, for example, a sensor such as GPS may be mounted on the HMD, and the coordinates, posture, etc. of the user may be recognized based on the output from the sensor. Further, such a sensor may be used in combination with a motion capture device as described above.

[Configuration of processing unit]
Next, the configuration of the processing unit included in the server 3 will be described in detail with reference to FIG.

The server 3 is composed of one or a plurality of electronic circuit units including a CPU, RAM, ROM, an interface circuit, and the like. As shown in FIG. 2, the server 3 includes a display image generation unit 31, a user information recognition unit 32, and a trigger event recognition unit 33 as functions (processing units) realized by the implemented hardware configuration or program. The avatar coordinate determination unit 34, the virtual space image determination unit 35, and the virtual space voice determination unit 36 are provided.

The display image generation unit 31 generates an image to be recognized by the user U via the monitor 41 of the HMD 4. The display image generation unit 31 has a virtual space generation unit 31a, an avatar generation unit 31b, and a mobile body generation unit 31c.

The virtual space generation unit 31a generates an image as a background of the virtual space VS and an image of an object existing in the virtual space VS.

The avatar generation unit 31b generates the first avatar A1 and the first ghost G1 which is an avatar independent of the first avatar A1 in the virtual space VS so as to correspond to the first user U1 (FIG. 6 and the like). reference). Further, the avatar generation unit 31b generates the second avatar A2 and the second ghost G2 which is an avatar independent of the second avatar A2 so as to correspond to the second user U2 (see FIG. 6 and the like). ..

The first avatar A1 and the second avatar A2 (hereinafter, collectively referred to as "avatar A"), and the first ghost G1 and the second ghost G2 (hereinafter, collectively referred to as "ghost G") are , Operates in the virtual space VS in response to the corresponding user U's operation in the real space RS (ie, coordinate movement and attitude change).

The mobile body generation unit 31c generates a mobile body that can be connected to the avatar in the virtual space VS because the object corresponding to the real space RS does not exist in the virtual space VS.

Here, the "moving body" is a device that causes the user U to predict the movement of the avatar (whether conscious or unconscious) that is different from the actual movement of the user when the avatar is connected. It should be.

For example, as moving objects, in addition to those used for movement in real space such as elevators, logs flowing through rivers where jumping is possible, floors that are likely to collapse when standing on, jumping platforms, wings that assist jumping, etc. Applies to. Further, as the moving body, characters, patterns and the like drawn on the ground and the wall surface of the virtual space are also applicable.

Further, here, the "connection" between the avatar and the moving body means that the user can predict that the movement of the moving body, the change in the shape of the moving body, etc. affect the coordinates of the avatar. ..

For example, the avatar gets into the elevator, the avatar rides on a log flowing through the river, the avatar stands on the floor where it is about to collapse, the avatar stands on the jumping platform, the avatar wears wings to assist in jumping, etc. Applicable. In addition, the avatar touching or approaching the characters, patterns, etc. drawn on the ground or wall surface of the virtual space also corresponds to the connection.

Image data of the user U including the sign 1 taken by the camera 2 is input to the user information recognition unit 32. The user information recognition unit 32 has a user posture recognition unit 32a and a user coordinate recognition unit 32b.

The user posture recognition unit 32a extracts the sign 1 from the input image data of the user U, and recognizes the posture of the user U based on the extraction result.

The user coordinate recognition unit 32b extracts the marker 1 from the input image data of the user U, and recognizes the coordinates of the user U based on the extraction result.

The trigger event recognition unit 33 recognizes that a predetermined trigger event has occurred or that the trigger event has been canceled when the system designer satisfies a predetermined condition.

Here, the trigger event may be one that the user is not aware of its occurrence. Therefore, as the trigger event, for example, an event caused by the user's action such as the user performing a predetermined action in the real space (that is, the avatar corresponding to the user performs the predetermined action in the virtual space) is also applicable. However, those that are not caused by the user's actions such as the passage of a predetermined time are also applicable.

The avatar coordinate determination unit 34 determines the coordinates of the avatar corresponding to the user U in the virtual space VS based on the coordinates in the real space RS of the user U recognized by the user coordinate recognition unit 32b.

Further, when the trigger event recognition unit 33 recognizes the occurrence of a predetermined trigger event, the avatar coordinate determination unit 34 has a predetermined period or a predetermined range, or a predetermined period and a predetermined range, regardless of the user's coordinates. Move the coordinates of the avatar corresponding to that user.

Further, when the trigger event recognition unit 33 recognizes the occurrence of a predetermined trigger event, the avatar coordinate determination unit 34 corresponds to the user U in the predetermined period or the predetermined range, or the predetermined period and the predetermined range. The coordinates of the ghost G are determined based on the coordinates that cause a predetermined deviation in the coordinates of.

The virtual space image determination unit 35 determines an image of the virtual space to be recognized by the user U corresponding to the avatar via the monitor 41 of the HMD 4 based on the coordinates of the avatar.

Here, the "image of the virtual space" includes an image of the background of the virtual space, an image of another avatar, an image of a ghost, an image of an object existing only in the virtual space, and a virtual space corresponding to the real space. Images of existing objects, etc. are included.

The image of the ghost G in the present embodiment is provided with information indicating that it corresponds to the user U corresponding to the ghost G.

Here, the "information indicating that the user is responding" is, for example, direct information such as a message displayed at all times or in response to the user's request, and the corresponding avatar shape is made translucent. It also includes indirect information presented by adopting things as ghost shapes.

The virtual space voice determination unit 36 determines the voice to be recognized by the user U corresponding to the avatar via the speaker 42 of the HMD 4 based on the coordinates of the avatar.

It should be noted that each processing unit constituting the virtual space experience system of the present invention is not limited to the above configuration.

For example, a part of the processing unit provided in the server 3 in the above embodiment may be provided in the HMD 4. Further, it may be configured by using a plurality of servers, or the servers may be omitted and the CPUs mounted on the HMD may be cooperated with each other. Further, a speaker other than the speaker mounted on the HMD may be provided. Further, in addition to the device that affects the visual sense and the auditory sense, the device that affects the sense of smell and the sense of touch that causes odor, wind, etc. according to the virtual space may be included.

[Process to be executed]
Next, with reference to FIGS. 2 to 10, a process executed by the VR system S when the user U is made to experience the virtual space VS by using the VR system S will be described.

[Processing under normal usage conditions]
First, with reference to FIGS. 2, 3 and 4, a process executed by the VR system S in a normal use state (that is, in a state in which the occurrence of a trigger event described later is not recognized) will be described.

In this process, first, the display image generation unit 31 of the server 3 generates the virtual space VS, the first avatar A1 and the second avatar A2, and the moving body (FIG. 3 / STEP100).

Specifically, the virtual space generation unit 31a of the display image generation unit 31 generates various objects existing in the virtual space VS and the virtual space VS. Further, the avatar generation unit 31b of the display image generation unit 31 generates the first avatar A1 corresponding to the first user U1 and the second avatar A2 corresponding to the second user U2. Further, the mobile body generation unit 31c of the display image generation unit 31 generates a mobile body such as an elevator VS1 described later.

As shown in FIG. 4, the virtual space VS generated by the process of STEP 100 is installed in the real space RS in addition to the first avatar A1 and the second avatar A2, and the moving body elevator VS1. Objects related to the trigger event such as the switch VS2 generated at the position corresponding to the whiteboard RS1 are installed.

Next, the avatar coordinate determination unit 34 of the server 3 determines the coordinates and attitude of the first avatar A1 in the virtual space VS based on the coordinates and attitude of the first user U1 in the real space RS, and determines the coordinates and attitude of the second user U2. Based on the coordinates and posture in the real space RS, the coordinates and posture of the second avatar A2 in the virtual space VS are determined (FIG. 3 / STEP101).

As the coordinates and postures of the first user U1 and the second user U2 in the processing after STEP 101, the coordinates and postures recognized by the user information recognition unit 32 of the server 3 based on the image data taken by the camera 2 are used. ..

Next, the virtual space image determination unit 35 and the virtual space voice determination unit 36 of the server 3 determine the image and sound to be recognized by the first user U1 based on the coordinates and the posture of the first avatar A1 in the virtual space VS. , The image and sound to be recognized by the second user U2 are determined based on the coordinates and the posture of the second avatar A2 in the virtual space VS (FIG. 3 / STEP102).

Next, the HMD4 mounted by the user U causes the monitor 41 mounted on the HMD4 to display the determined image, and the speaker 42 mounted on the HMD4 generates the determined voice (FIG. 3 /). STEP103).

Next, the user information recognition unit 32 of the server 3 determines whether or not the movement of coordinates or the change in posture in the real space RS of the first user U1 or the second user U2 is recognized (FIG. 3 / STEP104).

When the movement of coordinates or the change of posture in the real space RS of the first user U1 or the second user U2 is recognized (YES in STEP 104), the process returns to STEP 101 and the processing after STEP 101 is executed again.

On the other hand, when the movement of coordinates or the change of posture in the real space RS of the first user U1 or the second user U2 is not recognized (NO in STEP 104), the server 3 recognizes the signal instructing the end of processing. It is determined whether or not it has been done (Fig. 3 / STEP105).

If the signal indicating the end cannot be recognized (NO in STEP 105), the process returns to STEP 104, and the processing after STEP 104 is executed again.

On the other hand, when the signal instructing the end is recognized (YES in STEP 105), the VR system S ends the current process.

By the above processing, in the virtual space VS, the first avatar A1 corresponding to the first user U1, the second avatar A2 corresponding to the second user U2, the elevator VS1 which is a moving object, and the occurrence of the trigger event described later are related. A plurality of objects including the switch VS2 and the like are installed.

Then, the first user U1 and the second user U2 themselves virtualize themselves via the corresponding first avatar A1 and second avatar A2 by the image displayed by the HMD 4 and the generated voice. It exists in the space VS and comes to recognize that it can move freely.

[Processing when expanding virtual space and after]
Next, with reference to FIGS. 2, 4 to 7, the VR system S executes when and after expanding the virtual space VS so as to be wider than the real space RS corresponding to the virtual space VS. The processing will be described.

Here, prior to the explanation of the contents of the specific processing, the processing for expanding the virtual space VS so as to be wider than the real space RS corresponding to the virtual space VS, and the processing for avoiding contact accompanying the expansion. I will explain the outline.

In the VR system S, when a predetermined trigger event (second trigger event in the present invention) occurs, the correspondence between the coordinates of the first user U1 and the coordinates of the first avatar A1 or the second user U2 and the second user U2. 2 It is configured to perform a process of causing a deviation in the correspondence with the avatar A2.

In the present embodiment, for example, as shown in FIG. 4, the first avatar A1 is on the moving elevator VS1 (connected), and as shown in FIG. 6, the second avatar A2 is used. Pressing switch VS2 is set as its trigger event.

Then, when the occurrence of the trigger event is recognized, as shown in FIGS. 4 and 6, the coordinates of the first avatar A1 corresponding to the first user U1 are coordinated regardless of the movement of the coordinates of the first user U1. Moves upwards. Specifically, the first avatar A1 moves from the first floor F1 which is the first floor portion defined in the virtual space VS to the second floor F2 which is the second floor portion by the elevator VS1.

As a result, in the VR system S, the corresponding first avatar A1 is extended to the moved first user U1 and the second user U2 recognizing the first avatar A1 in the vertical direction from the real space RS. It is possible to recognize the virtual space VS that has been created.

Here, if such a deviation occurs, the first user U1 and the second user U2 may not be able to properly grasp the mutual positional relationship in the real space RS. As a result, there is a possibility that the first user U1 and the second user U2 may come into contact with each other unintentionally.

For example, in the state shown in FIG. 6, the second user U2 may misunderstand that the first user U1 is moving upward in the real space RS as well as the first avatar A1. Then, as shown in FIG. 7, the second user U2 misunderstands that the second avatar A2 corresponding to himself / herself can be moved below the elevator VS1 in the virtual space VS, and moves the second avatar A2 below the elevator VS1. You may try to move yourself, just as you would move to.

However, in the real space RS, the first user U1 corresponding to the first butter A1 actually exists at the same height as the second user U2. Therefore, in that case, the first user U1 and the second user U2 come into contact with each other in the real space RS. As a result, there is a possibility that the immersive feeling of the first user U1 and the second user U2 in the virtual space VS may be hindered.

Therefore, in the VR system S, when the occurrence of a predetermined trigger event is recognized, the virtual space VS is expanded so as to be wider than the real space RS corresponding to the virtual space VS, as described below. By executing the process and executing the process for avoiding contact, unintended contact between the first user U1 and the second user U2 is prevented.

In this process, first, the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of the trigger event has been recognized (FIG. 5 / STEP200).

Specifically, first, as shown in FIG. 4, the trigger event recognition unit 33 makes the coordinates of the first avatar A1 corresponding to the first user U1 ride on the elevator VS1 which is a moving body in the virtual space VS. , In the real space RS, it is determined whether or not the coordinates of the first user U1 have moved.

After that, the trigger event recognition unit 33 further, in the virtual space VS, in the real space RS so that the second avatar A2 corresponding to the second user U2 is in a posture of touching the switch VS2 at a position near the switch VS2. It is determined whether or not the second user U2 has moved to a predetermined posture (see FIG. 6).

Then, when the first avatar A1 is in the posture of touching the switch VS while the first avatar A1 is on the elevator VS1, the trigger event recognition unit 33 recognizes that the trigger event has occurred.

If the occurrence of the trigger event is not recognized (NO in STEP200), the process returns to STEP200 and the determination is executed again. This process is repeated at a predetermined control cycle.

On the other hand, when the occurrence of the trigger event is recognized (YES in STEP200), the avatar coordinate determination unit 34 of the server 3 moves the coordinates of the first avatar A1 (FIG. 5 / STEP201).

Specifically, the avatar coordinate determination unit 34 sets the coordinates of the first user U1 according to the content of the deviation (that is, the correction direction and the correction amount) predetermined according to the type of the recognized trigger event. Move the coordinates of the first avatar A1 based on it. This movement is performed independently of the movement of the coordinates of the first avatar A1 based on the movement of the coordinates of the first user U1. As a result, the correspondence between the coordinates of the first user U1 and the coordinates of the first avatar A1 is deviated.

In the present embodiment, the first avatar A1 moves upward from the first floor F1 to the second floor F2 integrally with the elevator VS1 so as to change from the state of FIG. 4 to the state shown in FIG. ..

Next, the display image generation unit 31 of the server 3 generates the first ghost G1 and the second ghost G2 (FIG. 5 / STEP202).

Specifically, the avatar generation unit 31b of the display image generation unit 31 generates the first ghost G1 corresponding to the first user U1 in the virtual space VS with the occurrence of the trigger event as a trigger, and the second user U2. Generates a second ghost G2 corresponding to.

In the present embodiment, as shown in FIG. 6, the first ghost G1 is configured as a translucent avatar having the same shape as the first avatar A1 in order to show that it corresponds to the first user U1. .. Further, a first information board G1a, which will be described later, is added to the first ghost G1. Similarly, the second ghost G2 is configured as a translucent avatar having the same shape as the second avatar A2 in order to indicate that it corresponds to the second user U2, and the second ghost G2 will be described later. A second information board G2a is added.

Further, in the present embodiment, the coordinates generated by the first ghost G1 are set to match the coordinates of the first avatar A1 immediately before the processing of STEP 201 is executed. Further, the coordinates generated by the second ghost G2 are set to be independent of the coordinates of the second user U2.

Next, the avatar coordinate determination unit 34 of the server 3 determines the virtual space VS of the first avatar A1 and the first ghost G1 based on the coordinates and posture in the real space RS of the first user U1 recognized by the user information recognition unit 32. (Fig. 5 / STEP203).

Specifically, the avatar coordinate determination unit 34 recognizes the occurrence of the trigger event according to the content of the deviation (that is, the correction direction and the correction amount) predetermined according to the type of the recognized trigger event. The first avatar after the time when the occurrence of the trigger event is recognized by correcting the coordinates and orientation of the first avatar A1 determined by the processing before the time point (processing before the processing of STEP201 is executed). Determine the coordinates and orientation of avatar A1.

In the present embodiment, the avatar coordinate determination unit 34 moves the coordinates of the first avatar A1 based on the coordinates of the first user U1 upward by the height of the second floor F2 with respect to the first floor F1. The coordinates are determined as the coordinates of the first avatar A1 after the time when the occurrence of the trigger event is recognized. Further, the avatar coordinate determination unit 34 determines the posture of the first avatar A1 based on the posture of the first user U1 as the posture of the first avatar A1 after the time when the occurrence of the trigger event is recognized.

Further, the avatar coordinate determination unit 34 uses the same process as the process of determining the coordinates and posture of the first avatar A1 before the time when the occurrence of the trigger event is recognized, and the coordinates of the first user U1. And, based on the posture, the coordinates and the posture of the first ghost G1 are determined.

Next, the virtual space image determination unit 35 and the virtual space voice determination unit 36 of the server 3 determine the image and sound to be recognized by the first user U1 based on the coordinates and the posture of the first avatar A1 in the virtual space VS. (Fig. 5 / STEP204).

Next, the avatar coordinate determination unit 34 of the server 3 determines the virtual space VS of the second avatar A2 and the second ghost G2 based on the coordinates and the posture of the second user U2 recognized by the user information recognition unit 32 in the real space RS. (Fig. 5 / STEP205).

Specifically, the avatar coordinate determination unit 34 uses the same processing as the processing for determining the coordinates and posture of the second avatar A2, and based on the coordinates and posture of the second user U2, the second 2 Determine the coordinates and attitude of the avatar A2.

Further, the avatar coordinate determination unit 34 is at a time when the occurrence of the trigger event is recognized according to the content of the deviation (that is, the correction direction and the correction amount) predetermined according to the type of the recognized trigger event. The coordinates and posture of the second avatar A2 determined by the previous processing are corrected, and the coordinates and posture of the second ghost G2 are determined.

In the present embodiment, the avatar coordinate determination unit 34 moves the coordinates of the second avatar A2 based on the coordinates of the second user U2 upward by the height of the second floor F2 with respect to the first floor F1. It is determined as the coordinates of the second ghost G2 after the time when the occurrence of the trigger event is recognized.

Further, the avatar coordinate determination unit 34 determines the posture of the second avatar A2 based on the posture of the second user U2 as the posture of the second ghost G2 after the time when the occurrence of the trigger event is recognized.

Next, the virtual space image determination unit 35 and the virtual space voice determination unit 36 of the server 3 determine the image and sound to be recognized by the second user U2 based on the coordinates and the posture of the second avatar A2 in the virtual space VS. (Fig. 5 / STEP206).

Next, the HMD 4 worn by the user U displays the determined image on the monitor 41 and generates voice on the speaker 42 (FIG. 5 / STEP207).

Next, the user information recognition unit 32 of the server 3 determines whether or not the movement of coordinates or the change in posture in the real space RS of the first user U1 or the second user U2 is recognized (FIG. 5 / STEP208).

When the movement of coordinates or the change of posture in the real space RS of the first user U1 or the second user U2 is recognized (YES in STEP 208), the process returns to STEP 203 and the processing after STEP 203 is executed again.

On the other hand, when the movement of coordinates or the change of posture in the real space RS of the first user U1 or the second user U2 is not recognized (NO in STEP 208), the server 3 recognizes the signal instructing the end of processing. It is determined whether or not it has been done (Fig. 5 / STEP209).

If the signal indicating the end cannot be recognized (NO in STEP209), the process returns to STEP208, and the processing after STEP208 is executed again.

On the other hand, when the signal instructing the end is recognized (YES in STEP209), the VR system S ends the current process.

As described above, in the VR system S, when a trigger event occurs and the correspondence between the coordinates of the first user U1 and the coordinates of the first avatar A1 corresponding to the first user U1 is deviated. The first ghost G1 corresponding to the coordinates of the first user U1 is generated, and the second ghost G2 is generated at the coordinates obtained by correcting the coordinates corresponding to the coordinates of the second user U2 so as to correspond to the deviation.

Then, the image and sound of the virtual space VS recognized by the first user U1 include the image and sound of the second ghost G2. Further, the image and sound of the virtual space VS recognized by the second user U2 include the image and sound of the first ghost G1.

Therefore, after the occurrence of the trigger event is recognized, the first user U1 naturally changes to the first avatar A1 corresponding to the corrected coordinates and the corrected coordinates of the second player when performing some operation. It operates while avoiding contact with the corresponding second ghost G2. In addition, the second user U2 operates while avoiding contact between the second avatar A2 that naturally corresponds to its own coordinates and the first ghost G1 that corresponds to the coordinates of the first user U1 when performing some operation. do.

This makes it possible to prevent contact between the first user U1 and the second user U2 in the real space RS.

In the present embodiment, the first ghost G1 is configured as a translucent avatar having the same shape as the first avatar A1, and the second ghost G2 is configured as a translucent avatar having the same shape as the second avatar A2. There is. This is to indicate that the first ghost G1 corresponds to the first user U1 and that the second ghost G2 corresponds to the second user U2.

Further, in the present embodiment, the first information board G1a is added to the first ghost G1, and the second information board G2a is added to the second ghost G2. This is a process executed when the user U generates a trigger event (first trigger event in the present invention) in the process for synchronizing the environment described later and the occurrence of the trigger event is recognized. This is to make the user U intuitively understand.

However, the method of displaying information indicating which user the avatar corresponds to in the virtual space experience system of the present invention and the method of displaying information related to ghosts are not limited to such a configuration. It may be set as appropriate.

Therefore, for example, in the present embodiment, the shapes of the first ghost G1 and the second ghost G2 may be limited to match the shapes of the first avatar A1 and the second avatar A2, and the information board may be omitted. On the contrary, only the information board may be displayed without displaying the shapes corresponding to the shapes of the first avatar A1 and the second avatar A2.

[Processing when synchronizing the environment and after]
Next, with reference to FIGS. 2 and 8 to 10, the processes to be executed when the environment is synchronized and thereafter will be described.

Here, prior to the explanation of the contents of the specific processing, the outline of the processing for synchronizing the environment in the present embodiment will be described.

When the VR system S recognizes the occurrence of a predetermined trigger event (first trigger event in the present invention), the first user U1 and the second user U2 are placed in one environment of the first user U1 and the second user U2. It is configured to perform the process of synchronizing one of the environments.

Here, the "environment" means at least one of the image and the sound recognized by the user corresponding to the avatar located at the coordinates based on the coordinates of the virtual space. Further, "environment synchronization" means that a plurality of users corresponding to a plurality of avatars will recognize the same environment.

In the present embodiment, for example, as shown in FIG. 9, the second avatar A2 touching the first ghost G1 corresponding to the first user U1 is set as the trigger event.

Then, when the occurrence of the trigger event is recognized, as shown in FIG. 10, the coordinates of the second avatar A2 corresponding to the second user U2 are the second, regardless of the movement of the coordinates of the second user U2. 1 Move to the coordinates adjacent to the coordinates of the avatar A1. Specifically, the second avatar A2 moves from the first floor F1 to the coordinates adjacent to the first avatar A1 on the second floor F2.

As a result, in the VR system S, after the occurrence of the trigger event is recognized, the environment of the first user U1 and the environment of the second user U2 are synchronized with each other, and the first user U1 and the second user U2 are synchronized. Is able to experience a similar environment.

In the following, the first user U1 corresponding to the first avatar A1 wants to view the rainbow VS3 existing above the second floor F2 of the virtual space VS together with the second user U2. Explain the processing when the second user U2 tries to synchronize the environment with the first user U1 (that is, he / she also tries to look at the rainbow VS3) when the two users U2 are informed via the message function or the like. ..

In this process, first, the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of the trigger event has been recognized (FIG. 8 / STEP300).

Specifically, first, as shown in FIG. 9, the trigger event recognition unit 33 has a second avatar A2 corresponding to the second user U2 in the virtual space VS, and a first avatar A1 corresponding to the first user U1. Judge whether or not you are in a position to touch. Then, when the second avatar A2 is in a posture of touching the first avatar A1, the trigger event recognition unit 33 recognizes that the trigger event has occurred.

If the occurrence of the trigger event is not recognized (NO in STEP300), the process returns to STEP300 and the determination is executed again. This process is repeated at a predetermined control cycle.

On the other hand, when the occurrence of the trigger event is recognized (YES in STEP300), the avatar coordinate determination unit 34 of the server 3 moves the coordinates of the second avatar A2 to the coordinates adjacent to the coordinates of the first avatar A1 (when it is YES). FIG. 5 / STEP301).

Specifically, the avatar coordinate determination unit 34 refers not only to the coordinates of the first avatar A1 but also to the posture, and determines the coordinates (that is, adjacent coordinates) located sideways, forward or backward of the first avatar A1. Recognize and move the second avatar A2 to that coordinate.

This movement is performed independently of the movement of the coordinates of the second avatar A2 based on the movement of the coordinates of the second user U2. As a result, the correspondence between the coordinates of the second user U2 and the coordinates of the second avatar A2 is deviated.

In the present embodiment, as shown in FIG. 9, the second avatar A2 located on the first floor F1 is the second floor F2 as shown in FIG. 10, and is to the left of the first avatar A1. Moves momentarily so that it is located at.

The process of movement (for example, the time required for movement, the route during movement, etc.) may be appropriately set. For example, when there is a third user different from the first user U1 and the second user U2, the movement speed of the second avatar A2 is slowed down to some extent so that the movement route of the second avatar A2 can be recognized. By setting the speed, it becomes possible for the third user to recognize the movement of the coordinates when the occurrence of the trigger event is recognized.

Next, the display image generation unit 31 of the server 3 erases the first ghost G1 and the second ghost G2 (FIG. 8 / STEP302).

In the present embodiment, the movement of the second avatar A2 in STEP 301 eliminates the deviation in the correspondence between the coordinates of the first avatar A1 and the coordinates of the second avatar A2 caused by the process of expanding the virtual space described above. To. That is, after the movement, the correspondence between the coordinates of the first avatar A1 and the coordinates of the second avatar A2 is the correspondence before the deviation occurs (that is, the coordinates of the first user U1 and the coordinates of the second user U2). (The one that matches the correspondence with).

Therefore, after executing the process in STEP 302, unintended contact is suppressed even if the first ghost G1 and the second ghost G2 do not exist. Rather, when the first ghost G1 and the second ghost G2 are present, there is a risk of causing unintended contact. Therefore, in the present embodiment, the process of erasing the unnecessary first ghost G1 and second ghost G2 is executed in this way.

Even after the processing in STEP 302 is executed, the correspondence between the coordinates of the first avatar A1 and the coordinates of the second avatar A2 and the correspondence between the coordinates of the first user U1 and the coordinates of the second user U2 remain unchanged. If it does not return to the same one, it is advisable to continue to have at least one of the first ghost G1 and the second ghost G2, if necessary.

Next, the avatar coordinate determination unit 34 of the server 3 determines the first avatar A1 and the first ghost based on the coordinates and attitudes of the first user U1 and the second user U2 in the real space RS recognized by the user information recognition unit 32. The coordinates and orientations of G1 and the second avatar A2 and the second ghost G2 in the virtual space VS are determined (FIG. 8 / STEP303).

Specifically, the avatar coordinate determination unit 34 continues to shift the coordinates and attitude determined based on the coordinates and attitude of the first user in the process of expanding the virtual space VS described above (that is, the content of the deviation (that is,). The coordinates and posture of the first avatar A1 are determined by making corrections based on the correction direction and correction amount).

Further, the avatar coordinate determination unit 34 determines the coordinates and attitude determined based on the coordinates and attitude of the second user, and the content of the deviation (that is, the correction direction) predetermined according to the type of the recognized trigger event. And the correction amount), the coordinates and the posture of the second avatar A2 are determined.

In the present embodiment, the avatar coordinate determination unit 34 moves the coordinates of the second avatar A2 based on the coordinates of the second user U2 upward by the height of the second floor F2 with respect to the first floor F1. In addition, the one moved horizontally from the coordinates of the second avatar A2 at the time when the occurrence of the trigger event is recognized to the coordinates to the left of the first avatar A1 is the second after the time when the occurrence of the trigger event is recognized. 2 Determined as the coordinates of the avatar A2.

Further, the avatar coordinate determination unit 34 determines the posture of the second avatar A2 based on the posture of the second user U2 as it is as the posture of the second avatar A2 after the time when the occurrence of the trigger event is recognized.

Next, the virtual space image determination unit 35 and the virtual space voice determination unit 36 of the server 3 determine the image and sound to be recognized by the first user U1 based on the coordinates and the posture of the first avatar A1 in the virtual space VS. , The image and sound to be recognized by the second user U2 are determined based on the coordinates and the posture of the second avatar A2 in the virtual space VS (FIG. 8 / STEP304).

Next, the HMD 4 worn by the user U displays the determined image on the monitor 41 and generates voice on the speaker 42 (FIG. 8 / STEP305).

Next, the user information recognition unit 32 of the server 3 determines whether or not the movement of coordinates or the change in posture in the real space RS of the first user U1 or the second user U2 is recognized (FIG. 8 / STEP306).

When the movement of coordinates or the change of posture in the real space RS of the first user U1 or the second user U2 is recognized (YES in STEP 306), the process returns to STEP 303 and the processing after STEP 303 is executed again.

On the other hand, when the movement of coordinates or the change of posture in the real space RS of the first user U1 or the second user U2 is not recognized (NO in STEP306), the server 3 recognizes the signal instructing the end of processing. It is determined whether or not it has been done (Fig. 8 / STEP307).

If the signal indicating the end cannot be recognized (NO in STEP307), the process returns to STEP306, and the processing after STEP306 is executed again.

On the other hand, when the signal instructing the end is recognized (YES in STEP307), the VR system S ends the current process.

As described above, in the VR system S, when the occurrence of the trigger event is recognized, the avatar coordinate determination unit 34 moves the coordinates of the second avatar A2 to the coordinates adjacent to the coordinates of the first avatar A1. I'm letting you.

Here, the image and sound of the virtual space VS to be recognized by the first user U1 and the second user U2 are determined based on the coordinates of the first avatar A1 and the second avatar A1. Therefore, when the coordinates of the avatars match or are adjacent to each other, the images and sounds of the virtual space VS recognized by each user corresponding to those avatars also match or have similar images and sounds (that is, similar images and sounds). Image and sound).

Therefore, according to the VR system S, when the occurrence of the trigger event is recognized, the image and sound of the virtual space recognized by each user can also be the same or adjacent images and sounds, so that until then. The first user U1 and the second user U2 who have experienced different environments in the virtual space will be able to experience almost the same environment.

In this embodiment, the case where the second user U2 synchronizes his / her environment with the environment of the first user U1 has been described. However, the virtual space experience system of the present invention is not limited to such a configuration, and when the occurrence of a trigger event is recognized, the environment of one of the first user and the second user is set to the first user and the environment of the second user. Anything that synchronizes with the other environment of the second user may be used.

Therefore, for example, in the present embodiment, even when the first avatar A1 touches the second ghost G2 corresponding to the second user U2, the coordinates of the second avatar A2 become the coordinates adjacent to the coordinates of the first avatar A1. It may be configured to move. That is, the second avatar A2 does not move to the coordinates matching or adjacent to the coordinates of the first avatar A1 by itself, but the first avatar A1 matches the coordinates of the second avatar A2 to the coordinates or adjacent coordinates. It may be configured to be called to the coordinates to be used.

Further, for example, in the present embodiment, when the second avatar A2 touches the first ghost G1 corresponding to the first user U1, the first avatar A1 has coordinates that match or are adjacent to the coordinates of the second avatar A2. It may be configured to move to the coordinates, or the first avatar A1 may be configured to call the coordinates of the second avatar A2 to the coordinates matching or adjacent to its own coordinates.

In addition, a configuration is performed in which one's own coordinates are moved to coordinates that match or are adjacent to the coordinates of another user, and a process is performed in which the coordinates of another user are called to coordinates that match or are adjacent to one's own coordinates. When implementing the configuration at the same time, the operation that becomes the trigger event may be different depending on the processing to be performed.

Specifically, for example, when the avatar corresponding to another user is touched with the right hand of the avatar corresponding to oneself, the process of moving one's own coordinates to the coordinates matching the coordinates of another user or the adjacent coordinates. When the left hand of the avatar corresponding to itself touches the avatar corresponding to another user, the process of calling the coordinates of the other user to the coordinates matching the own coordinates or the adjacent coordinates is executed. It should be configured as follows.

Further, in the present embodiment, when the occurrence of the trigger event is recognized, the process of moving the coordinates of the second avatar A2 to the adjacent coordinates instead of the coordinates matching the coordinates of the first avatar A1 is performed. .. This makes it easier for one user to include the avatar corresponding to the other user in the image recognized by one user when the coordinates of the second avatar A2 move, and the other user moves to the vicinity of the other user. This is to make it easier to recognize what you have done.

However, the present invention is not limited to such a configuration, and the coordinates for moving one avatar may be matched with the coordinates of the other avatar. With such a configuration, the degree of synchronization of the environment can be further increased as compared with the case of moving to adjacent coordinates.

Further, in the present embodiment, after the occurrence of the trigger event is recognized, the second avatar A2 is continuously located on the second floor F2. That is, based on the deviation caused by the movement when the occurrence of the trigger event is recognized, the state in which the correspondence between the coordinates of the second user U2 and the coordinates of the second avatar A2 is displaced continues.

However, the present invention is not limited to such a configuration, and may be configured to eliminate the deviation caused by the movement when the occurrence of the trigger event is recognized.

Therefore, for example, only for the period during which the trigger event continues (for example, in the above embodiment, only for the period during which the second avatar A2 is in contact with the first avatar A1), or after the occurrence of the trigger event is recognized, it is predetermined. The coordinates of the avatar may be moved by the period of, and after the period of time, the coordinates of the avatar may be returned to the coordinates before the occurrence of the trigger event is recognized.

[Second Embodiment]
Hereinafter, the VR system S, which is a virtual space experience system according to the second embodiment, will be described with reference to FIGS. 2 and 11 to 15.

The VR system S of the present embodiment has the same configuration as the VR system S of the first embodiment except for the processing to be executed when the environment is synchronized and thereafter.

Therefore, in the following description, only the processing to be executed when synchronizing the environment and after that will be described. Further, the same configuration or the corresponding configuration as the configuration of the VR system S of the first embodiment are designated by the same reference numerals, and detailed description thereof will be omitted.

[Processing when synchronizing the environment and after]
Hereinafter, the processes to be executed when the environment is synchronized and thereafter will be described with reference to FIGS. 2 and 11 to 15.

Here, prior to the explanation of the contents of the specific processing, the outline of the processing for synchronizing the environment in the present embodiment will be described.

When the VR system S recognizes the occurrence of a predetermined trigger event (first trigger event in the present invention), the first user U1 and the second user U2 are placed in one environment of the first user U1 and the second user U2. It is configured to perform the process of synchronizing one of the environments.

In the present embodiment, for example, as shown in FIG. 12, the second avatar A2 touching the first ghost G1 corresponding to the first user U1 is set as the trigger event.

Then, when the occurrence of the trigger event is recognized, as shown in FIG. 13, the environment recognized by the second user U2 is recognized by the first user U1 regardless of the coordinates of the second user U2. It will be consistent with your environment. Specifically, the environment recognized by the second user U2 changes from one based on the coordinates of the second avatar A2 (see FIG. 14) to one based on the coordinates of the first avatar A1 (see FIG. 15).

As a result, in the VR system S, the environment of the first user U1 and the environment of the second user U2 are synchronized so that the first user U1 and the second user U2 can experience the same environment. ing.

In the following, the first user U1 corresponding to the first avatar A1 wants to view the rainbow VS3 existing above the second floor F2 of the virtual space VS together with the second user U2. Explain the processing when the second user U2 tries to synchronize the environment with the first user U1 (that is, he / she also tries to look at the rainbow VS3) when the two users U2 are informed via the message function or the like. ..

As shown in FIG. 14, in the state at the start of this process, the second user U2 recognizes the image in the state of looking up at the first avatar A1 on the second floor F2 of the virtual space VS. It is assumed that there is.

In this process, first, the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of the trigger event has been recognized (FIG. 11 / STEP400).

Specifically, first, as shown in FIG. 12, the trigger event recognition unit 33 has a second avatar A2 corresponding to the second user U2 in the virtual space VS, and a first avatar A1 corresponding to the first user U1. Judge whether or not you are in a position to touch. Then, when the second avatar A2 is in a posture of touching the first avatar A1, the trigger event recognition unit 33 recognizes that the trigger event has occurred.

When the occurrence of the trigger event is recognized (YES in STEP 400), the avatar coordinate determination unit 34 of the server 3 fixes the coordinates of the second avatar A2 and the second ghost G2 (FIG. 11 / STEP 401).

In the present embodiment, in the subsequent STEP402 to STEP404 processes (that is, processes for synchronizing the environment), the image and sound recognized by the second user U2 corresponding to the second avatar A2 and the second ghost G2. However, the process of making it determined based on the coordinates of the first avatar A1 is executed.

Therefore, if the second avatar A2 can be moved while the process is being executed, the coordinates of the second avatar A2 are unintentionally moved after the process for synchronizing the environment is completed. Become. As a result, after the processing is completed, there is a possibility that the immersive feeling of the second user U2 who recognizes the image and the sound based on the coordinates of the second avatar A2 may be hindered.

Further, if the second ghost G2 can be moved while the process is being executed, the coordinates of the second ghost G2 are unintentionally moved after the process for synchronizing the environment is completed. Become. As a result, after the processing is completed, the position of the second ghost G2 suddenly changes in the image recognized by the first user U1, which may hinder the immersive feeling of the first user U1. ..

Therefore, when the VR system S recognizes the occurrence of the trigger event (that is, when the execution of the process for synchronizing the environment is started), the process of STEP401 is executed to execute the second avatar A2 and the second avatar. By fixing the coordinates of the ghost G2, it is possible to prevent the immersive feeling from being hindered in this way.

However, as shown in FIGS. 12 and 13, the postures of the second avatar A2 and the second ghost G2 continue to change according to the posture of the second avatar A2 even while the processing is being executed. do.

This is because if the posture is fixed, the correspondence between the posture of the second user U2, the posture of the second avatar A2, and the posture of the second ghost G2 will be different after the processing for synchronizing the environment is completed. On the other hand, even if the posture of the second ghost G2 changes during the process for synchronizing the environment, the immersive feeling of the first user U1 is not hindered.

However, the posture of the second avatar A2 may also be configured to match the posture of the first avatar A1. In this configuration, the image and sound recognized by the second user U2 further match the image and sound recognized by the first user U1, so that the second user U2 and the first user U1 You will be able to experience a more synchronized environment.

If the second user U2 moves with the coordinates of the second avatar A2 and the second ghost G2 fixed in this way, the coordinates of the second user U2, the coordinates of the second avatar A2, and the second ghost The correspondence with the coordinates of G2 will be unintentionally deviated. As a result, a factor that induces unintended contact occurs.

Therefore, as shown in FIG. 15, in the VR system S, a message indicating that the environment synchronization process is being executed and a message indicating that the user is careful not to move is displayed on the image recognized by the second user U2. .. As a result, the VR system S suppresses the occurrence of such deviation.

Returning to the explanation of the process to be executed, after executing the process of STEP 401, the avatar coordinate determination unit 34 of the server 3 is based on the coordinates and the posture of the first user U1 recognized by the user information recognition unit 32 in the real space RS. , The coordinates and postures of the first avatar A1 and the first ghost G1 in the virtual space VS are determined (FIG. 11 / STEP402).

Next, the virtual space image determination unit 35 and the virtual space voice determination unit 36 of the server 3 transmit the images and sounds to be recognized by the first user U1 and the second user U2 in the coordinates and posture of the first avatar A1 in the virtual space VS. It is determined based on (Fig. 5 / STEP403).

Specifically, the virtual space image determination unit 35 and the virtual space voice determination unit 36 determine the image and voice to be recognized by the first user U1 based on the coordinates and posture of the first avatar A1. Further, the virtual space image determination unit 35 and the virtual space sound determination unit 36 determine the image and sound to be recognized by the second user U2 based on the coordinates of the first avatar A1 and the posture of the second avatar A2.

The image and sound to be recognized by the first user U1 determined in this way are viewing the rainbow VS3 in the sky on the second floor F2 of the virtual space VS based on the coordinates and the posture of the first avatar A1. Become a thing.

Further, the image and the sound to be recognized by the second user U2 determined in this way are recognized when they are located at coordinates that are behind the coordinates of the first avatar A1 when viewed from the first avatar A1. Images and sounds. Specifically, as shown in FIG. 15, the rainbow VS3 in the sky is viewed from behind the first avatar A1 on the second floor F2 of the virtual space VS.

In this embodiment, since it is considered that the second user U2 enjoys the environment together with the first user U1, the first avatar A1 (and by extension, the first user U1) can be recognized in this process. The coordinates that are the reference of the image and the sound to be recognized by the two users U2 are the coordinates that are behind the coordinates of the first avatar A1 (that is, the adjacent coordinates).

However, when the second user U2 wants to experience an environment closer to the environment experienced by the first user U1, it is preferable to match the reference coordinates with the coordinates of the first avatar A1. .. Further, when the reference posture is also matched with the first avatar A1, the second user U2 can experience the same environment as that of the first user U1.

Next, the HMD4 mounted by the user U displays the determined image on the monitor 41 mounted on the HMD4, and generates the determined voice on the speaker 42 mounted on the HMD4 (FIG. 11 / STEP404).

Next, the trigger event recognition unit 33 of the server 3 determines whether or not the cancellation of the trigger event has been recognized (FIG. 11 / STEP405).

Specifically, first, the trigger event recognition unit 33 has a posture in which the second avatar A2 corresponding to the second user U2 touches the first avatar A1 corresponding to the first user U1 in the virtual space VS (see FIG. 12). ) Is canceled. Then, when the posture in which the second avatar A2 touches the first avatar A1 is released, the trigger event recognition unit 33 recognizes that the trigger event has been released.

The cancellation of the trigger event may be configured to be automatically recognized when a predetermined period has elapsed from the occurrence of the trigger event, or when another trigger event occurs (for example,). It may be configured to be recognized when the second avatar A2 is not in contact with the first ghost G1.

If the cancellation of the trigger event is not recognized (NO in STEP405), the process returns to STEP402 and the processing after STEP402 is executed again.

On the other hand, when the cancellation of the trigger event is recognized (YES in STEP 405), the avatar coordinate determination unit 34 of the server 3 releases the fixation of the coordinates of the second avatar A2 and the second ghost G2 (FIG. 11 / STEP 406). ..

When the occurrence of the trigger event is not recognized (NO in STEP400), or after the fixing of the coordinates of the second avatar A2 and the second ghost G2 is released, the avatar coordinate determination unit 34 of the server 3 uses the user. Based on the coordinates and posture of the first user U1 in the real space RS recognized by the information recognition unit 32, the coordinates and postures of the first avatar A1 and the first ghost G1 in the virtual space VS are determined (FIG. 11 / STEP407).

Next, the virtual space image determination unit 35 and the virtual space voice determination unit 36 of the server 3 determine the image and sound to be recognized by the first user U1 based on the coordinates and the posture of the first avatar A1 in the virtual space VS. (Fig. 11 / STEP408).

Next, the avatar coordinate determination unit 34 of the server 3 determines the virtual space VS of the second avatar A2 and the second ghost G2 based on the coordinates and the posture of the second user U2 recognized by the user information recognition unit 32 in the real space RS. (Fig. 11 / STEP409).

Next, the virtual space image determination unit 35 and the virtual space voice determination unit 36 of the server 3 determine the image and sound to be recognized by the second user U2 based on the coordinates and the posture of the second avatar A2 in the virtual space VS. (Fig. 11 / STEP410).

Next, the HMD 4 worn by the user U displays the determined image on the monitor 41 and generates voice on the speaker 42 (FIG. 11 / STEP411).

Next, the server 3 determines whether or not the signal instructing the end of the process has been recognized (FIG. 11 / STEP412).

If the signal indicating the end cannot be recognized (NO in STEP412), the process returns to STEP400, and the processing after STEP400 is executed again.

On the other hand, when the signal instructing the end is recognized (YES in STEP412), the VR system S ends the current process.

As described above, in the VR system S, when the occurrence of the trigger event is recognized, the virtual space image determination unit 35 and the virtual space voice determination unit 36 cause the second user U2 to recognize the image and sound of the virtual space VS. Is the image and sound when the coordinates of the second avatar A2 move to the coordinates adjacent to the coordinates of the first avatar A1.

That is, when the occurrence of the trigger event is recognized, the coordinates that serve as the reference for determining the image and sound of the virtual space VS to be recognized by the second user U2 are set to the second avatar A2 corresponding to the second user U2. Regardless of the position of the coordinates of, the coordinates are adjacent to the coordinates of the first avatar A1 corresponding to the first user U1.

As a result, when the occurrence of the trigger event is recognized, the second user U2 is determined together with the first user U1 based on the coordinates adjacent to the coordinates of the first avatar A1 corresponding to the first user U1. The image and sound of the virtual space VS will be recognized.

Therefore, according to the VR system S, after the occurrence of the trigger event is recognized, the second user U2 is a virtual determined based on the coordinates adjacent to the coordinates of the first avatar A1 corresponding to the first user U1. Since the image and sound of the space VS are recognized, the first user and the second user who have experienced different environments in the virtual space VS can experience almost the same environment.

In this embodiment, the case where the second user U2 synchronizes his / her environment with the environment of the first user U1 has been described. However, the virtual space experience system of the present invention is not limited to such a configuration, and when the occurrence of a trigger event is recognized, the environment of one of the first user and the second user is set to the first user and the environment of the second user. Anything that synchronizes with the other environment of the second user may be used.

Therefore, for example, in the present embodiment, when the first avatar A1 touches the second ghost G2 corresponding to the second user U2, the image and sound recognized by the first user U1 are set to the coordinates of the second avatar A2. It may be configured to be determined based on matching coordinates or adjacent coordinates.

Further, for example, in the present embodiment, the second user U2 synchronizes its own environment with the environment of the first user U1 which is another user, but the environment of the other user is synchronized with its own environment. It may be configured.

Specifically, for example, in the present embodiment, when the first avatar A1 touches the second ghost G2 corresponding to the second user U2, the image and sound recognized by the second user U2 are used as the first avatar A1. It may be configured to be determined based on the coordinates that match the coordinates of or adjacent coordinates. Conversely, when the second avatar A2 touches the first ghost G1 corresponding to the first user U1, the image and sound recognized by the first user U1 are coordinated or adjacent to the coordinates of the second avatar A2. It may be configured to be determined based on the coordinates.

If a configuration that synchronizes one's own environment with another user's environment and a configuration that synchronizes another user's environment with one's own environment are implemented at the same time, an operation that becomes a trigger event. May be different depending on the processing to be performed.

Specifically, for example, when the avatar corresponding to another user is touched with the right hand of the avatar corresponding to the user, the process of synchronizing the environment with the environment of the other user is executed and the avatar corresponds to the user. When the left hand of the avatar touches the avatar corresponding to another user, it is preferable to execute the process of synchronizing the environment of the other user with the environment of the avatar.

Further, as in the first embodiment, there is a configuration in which the coordinates are moved to synchronize the environment, and a configuration in which the reference coordinates are changed to synchronize the environment as in the present embodiment. When implementing at the same time, the operation that becomes the trigger event may be different depending on the processing to be performed.

Specifically, for example, when the avatar corresponding to oneself touches the hand of the avatar corresponding to another user, the process of moving the coordinates to synchronize the environment is performed, and the avatar corresponding to oneself is used for another. When the shoulder of the avatar corresponding to the user is touched, the reference coordinates may be changed to synchronize the environment.

[Other embodiments]
Although the illustrated embodiment has been described above, the present invention is not limited to such an embodiment.

For example, in the above embodiment, as shown in FIG. 4 and the like, the VR system S, which is a virtual space experience system, is used for the first user U1 and the second user U2, which coexist in one room of the real space RS. One virtual space VS corresponding to a room is configured to be recognized as existing to each other via a first avatar A1 corresponding to the first user U1 and a second avatar A2 corresponding to the second user U2.

However, the virtual space experience system of the present invention is not limited to such a configuration, and any avatar corresponding to a plurality of users may exist in the virtual space at the same time.

Therefore, for example, the first user and the second user may exist in different regions of the real space (for example, their own rooms).

Further, in the above embodiment, when a process of expanding the virtual space VS so as to be wider than the real space RS corresponding to the virtual space VS (process described with reference to the flowchart of FIG. 5) is executed, the environment is executed. The case where the process of synchronizing the above (the process described with reference to the flowchart of FIG. 8 or the flowchart of FIG. 11) is executed has been described.

This is because when users are made to recognize a virtual space that is expanded beyond the real space, each user has more opportunities to experience different environments (and thus to feel that they want to share the environment). Is.

However, the virtual space experience system of the present invention is not limited to a configuration in which the process of synchronizing the environment is executed only when the process of expanding such a virtual space is executed, and each user is not limited to himself / herself. It suffices if the user is configured to be able to recognize that he / she is experiencing some kind of virtual space. Therefore, for example, the avatar corresponding to each user does not have to exist in the same virtual space.

Specifically, a plurality of first avatars corresponding to a plurality of first users who are shoppers freely exist in a store existing in a virtual space, and a second avatar corresponding to a second user who is a clerk is present. , May be configured to exist at the concierge counter that exists in the virtual space. At this time, the virtual space in which the concierge counter exists may be a virtual space in which the store exists, or may be a virtual space different from the virtual space in which the store exists.

In the case of being configured in this way, when one avatar itself is configured to move to coordinates that match or are adjacent to the coordinates of the other avatar as in the first embodiment, the first When the occurrence of one trigger event is recognized, the second avatar moves from the concierge counter to the coordinates of the first avatar corresponding to the first user who generated the first trigger event among the plurality of first users. And move.

Further, even in the case of being configured in this way, as in the second embodiment, only the viewpoint of one avatar is configured to move to the coordinates that match the coordinates of the other avatar or the coordinates that are adjacent to each other. When the occurrence of the first trigger event is recognized, the image displayed to the second user corresponding to the second avatar is the first trigger of the plurality of first users from the image of the concierge counter. The image changes to the same as the image displayed to the first user who generated the event.

Further, when configured as described above, the first trigger event is, for example, an operation in which the first avatar presses the call button, which is an object created in the virtual space, or the second avatar presses the move button. Etc. are applicable.

Further, in the above embodiment, the second avatar A2 corresponding to the second user U2 corresponds to the first user U1 and is located at the coordinates where the correspondence with the coordinates of the first user U1 is deviated. The action of contacting G1 is adopted as the first trigger event. Further, the operation in which the first avatar A1 corresponding to the first user U1 corresponds to the second user U2 and comes into contact with the second ghost G2 located at the coordinates where the correspondence with the coordinates of the second user U2 is deviated. Can also be adopted as the first trigger event.

This is so that one user can intuitively understand that the operation causes a first trigger event that shares the environment with the other user. As a result, in order to generate the first trigger event, it is possible to suppress the immersive feeling of the user who is trying to generate the first trigger event in the virtual space.

However, the first trigger event in the present invention is not limited to such a configuration, and may be appropriately set by a system designer or the like.

Therefore, for example, the first trigger event may be generated by touching an object (for example, a movement switch, a call switch, etc.) generated in the virtual space. Further, the first trigger event may be configured to occur when the avatar is made to perform a specific action (for example, a beckoning action).

Further, in the above embodiment, the trigger event is an action in which the avatar corresponding to one user touches the ghost corresponding to the other user. However, the first trigger event in the present invention is not limited to such a configuration, and may be any predetermined action that the avatar corresponding to one user performs on the ghost corresponding to the other user. ..

Here, the "predetermined action" may be any action performed by the avatar based on the ghost. For example, in addition to the action of the avatar touching the ghost as in the present embodiment, the action of the avatar moving within a predetermined range based on the ghost, and when the avatar operates an object existing in the virtual space. In addition, an operation such as selecting a ghost as the target (for example, an operation such as shooting a ghost with a camera-type object) and the like can be mentioned.

Further, in the present embodiment, the ghost generated during the process of expanding the virtual space is adopted as the key for generating the trigger event. However, the ghost in the present invention is not limited to such a configuration, and may be an avatar that corresponds to the user and does not serve as a reference for the image and sound recognized by the user.

Therefore, for example, an avatar that corresponds to the user from the beginning and serves as a reference for the image and sound recognized by the user, regardless of the execution of processing for expanding the virtual space, and an avatar that is independent of the avatar. And its independent avatar (for example, generated at a coordinate different from the reference avatar's coordinate) may be adopted as the ghost.

Specifically, for example, in a virtual space, an avatar corresponding to a dance instructor, an avatar corresponding to a student, and a miniature-like avatar existing at hand of an avatar corresponding to an instructor and corresponding to a student are generated. If the instructor confirms the student's condition using the miniature-like avatar, the miniature-like avatar may be adopted as the ghost.

With such a configuration, the instructor will be able to observe the student's condition from an objective point of view and, if necessary, from the student's subjective point of view.

1 ... sign, 2 ... camera, 3 ... server, 4 ... HMD, 31 ... display image generation unit, 31a ... virtual space generation unit, 31b ... avatar generation unit, 31c ... mobile body generation unit, 32 ... user information recognition unit, 32a ... user attitude recognition unit, 32b ... user coordinate recognition unit, 33 ... trigger event recognition unit, 34 ... avatar coordinate determination unit, 35 ... virtual space image determination unit, 36 ... virtual space voice determination unit, 41 ... monitor (virtual space) Image display), 42 ... Speaker (virtual space sound generator), A ... Avatar, A1 ... 1st avatar, A2 ... 2nd avatar, F1 ... 1st floor, F2 ... 2nd floor, G1 ... 1st ghost, G1a ... 1st information board, G2 ... 2nd ghost, G2a ... 2nd information board, RS ... real space, RS1 ... white board, S ... VR system, U ... user, U1 ... 1st user, U2 ... 2nd user , VS ... virtual space, VS1 ... elevator (moving body), VS2 ... switch, VS3 ... rainbow.

Claims (4)

A virtual space generator that creates a virtual space corresponding to the real space in which the first user and the second user exist, and
The first avatar corresponding to the first user and the second avatar corresponding to the second user are generated in the virtual space, and the first user and the second user are supported by the first user. An avatar generation unit that generates a ghost, which is an avatar independent of one avatar and the second avatar, in the virtual space .
A user coordinate recognition unit that recognizes the coordinates of the first user and the coordinates of the second user in the real space, and
Based on the coordinates of the first user, the coordinates of the first avatar in the virtual space are determined, and the coordinates of the second avatar in the virtual space are determined based on the coordinates of the second user, and the coordinates are determined. An avatar coordinate determination unit that determines the coordinates of the ghost based on the coordinates that cause a predetermined deviation in the coordinates of the first avatar or the second avatar corresponding to one of the first user and the second user .
A virtual space image determination unit that determines an image of the virtual space to be recognized by the first user and the second user based on the coordinates of the first avatar and the coordinates of the second avatar.
A trigger event recognition unit that recognizes the occurrence of the first trigger event,
In a virtual space experience system provided with a virtual space image display that causes the first user and the second user to recognize an image of the virtual space.
When the occurrence of the first trigger event is recognized, the avatar coordinate determination unit changes the coordinates of one of the first avatar and the second avatar to the coordinates of the other of the first avatar and the second avatar. Move to matching coordinates or adjacent coordinates ,
The virtual space image determination unit provides information indicating that the image of the virtual space to be recognized by the other of the first user and the second user corresponds to one of the first user and the second user. Include the added image of the ghost,
The first trigger event is a virtual operation that the first avatar or the second avatar corresponding to the other of the first user and the second user performs on the ghost. Spatial experience system. A virtual space generator that creates a virtual space corresponding to the real space in which the first user and the second user exist, and
The first avatar corresponding to the first user and the second avatar corresponding to the second user are generated in the virtual space, and the first user and the second user are supported by the first user. An avatar generation unit that generates a ghost, which is an avatar independent of one avatar and the second avatar, in the virtual space .
A user coordinate recognition unit that recognizes the coordinates of the first user and the coordinates of the second user in the real space, and
Based on the coordinates of the first user, the coordinates of the first avatar in the virtual space are determined, and the coordinates of the second avatar in the virtual space are determined based on the coordinates of the second user, and the coordinates are determined. An avatar coordinate determination unit that determines the coordinates of the ghost based on the coordinates that cause a predetermined deviation in the coordinates of the first avatar or the second avatar corresponding to one of the first user and the second user .
A virtual space image determination unit that determines an image of the virtual space to be recognized by the first user and the second user based on the coordinates of the first avatar and the coordinates of the second avatar.
A trigger event recognition unit that recognizes the occurrence of the first trigger event,
In a virtual space experience system provided with a virtual space image display that causes the first user and the second user to recognize an image of the virtual space.
The virtual space image determination unit provides information indicating that the image of the virtual space to be recognized by the other of the first user and the second user corresponds to one of the first user and the second user. The first image of the virtual space including the added image of the ghost and causing one of the first user and the second user to recognize when the occurrence of the first trigger event is recognized. An image is obtained when one of the coordinates of the avatar and the second avatar moves to a coordinate that matches or is adjacent to the other coordinates of the first avatar and the second avatar .
The first trigger event is a virtual operation that the first avatar or the second avatar corresponding to the other of the first user and the second user performs on the ghost. Spatial experience system. In the virtual space experience system according to claim 1 or 2 .
The trigger event recognition unit recognizes the occurrence of the second trigger event and recognizes the occurrence of the second trigger event.
When the occurrence of the second trigger event is recognized, the avatar generation unit generates the first ghost, which is the ghost corresponding to the first user, in the virtual space.
After the occurrence of the second trigger event is recognized, the avatar coordinate determination unit determines the coordinates of the first avatar based on the coordinates that cause the predetermined deviation from the coordinates of the first user. , The coordinates of the first ghost in the virtual space are determined based on the coordinates of the first user.
After the occurrence of the second trigger event is recognized, the virtual space image determination unit displays information indicating that the image of the virtual space to be recognized by the second user corresponds to the first user. The added image of the first ghost is included,
The first trigger event is a virtual space experience system characterized in that the second avatar is a predetermined action executed for the first ghost. In the virtual space experience system according to any one of claims 1 to 3 .
The trigger event recognition unit recognizes the occurrence of the second trigger event and recognizes the occurrence of the second trigger event.
When the occurrence of the second trigger event is recognized, the avatar generation unit generates the second ghost, which is the ghost corresponding to the second user, in the virtual space.
After the occurrence of the second trigger event is recognized, the avatar coordinate determination unit determines the coordinates of the first avatar based on the coordinates that cause the predetermined deviation from the coordinates of the first user. , The coordinates of the second ghost in the virtual space are determined based on the coordinates causing the predetermined deviation from the coordinates of the second user.
After the occurrence of the second trigger event is recognized, the virtual space image determination unit displays information indicating that the image of the virtual space to be recognized by the first user corresponds to the second user. The added image of the second ghost is included,
The first trigger event is a virtual space experience system characterized in that the first avatar is a predetermined action executed for the second ghost.

Images