WO2022254585A1 - 仮想空間体感システム - Google Patents

仮想空間体感システム Download PDF

Info

Publication number
WO2022254585A1
WO2022254585A1 PCT/JP2021/020889 JP2021020889W WO2022254585A1 WO 2022254585 A1 WO2022254585 A1 WO 2022254585A1 JP 2021020889 W JP2021020889 W JP 2021020889W WO 2022254585 A1 WO2022254585 A1 WO 2022254585A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
avatar
coordinates
virtual space
trigger event
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/020889
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
良哉 尾小山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Abal Inc
Original Assignee
Abal Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Abal Inc filed Critical Abal Inc
Priority to JP2021575439A priority Critical patent/JP7055527B1/ja
Priority to PCT/JP2021/020889 priority patent/WO2022254585A1/ja
Publication of WO2022254585A1 publication Critical patent/WO2022254585A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/55—Controlling game characters or game objects based on the game progress
    • A63F13/56—Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics

Definitions

  • the present invention relates to a virtual space bodily sensation system that allows the user to recognize that he or she exists in a virtual space displayed as an image.
  • a virtual space is generated by a server or the like, and a user recognizes an image of the virtual space through a head-mounted display (hereinafter sometimes referred to as "HMD"), and the user himself/herself exists in the virtual space.
  • HMD head-mounted display
  • This type of virtual space experience system recognizes the user's motion in the real space (for example, movement of coordinates, change of posture including orientation, etc.) by a motion capture device or the like, and responds to the user according to the recognized motion.
  • a motion capture device or the like There is an avatar that operates in a virtual space (see Patent Document 1, for example).
  • the present invention has been made in view of the above points, and provides a virtual space experience system that enables a plurality of users experiencing different environments in a virtual space to experience the same environment. With the goal.
  • the virtual space experience system of the present invention is a virtual space generation unit that generates a virtual space corresponding to the real space in which the first user and the second user exist; an avatar generation unit that generates a first avatar corresponding to the first user and a second avatar corresponding to the second user in the virtual space; a user coordinate recognition unit that recognizes the coordinates of the first user and the coordinates of the second user in the physical space; Determining the coordinates of the first avatar in the virtual space based on the coordinates of the first user, and determining the coordinates of the second avatar in the virtual space based on the coordinates of the second user.
  • a virtual space experience system comprising a virtual space image display that allows the first user and the second user to recognize an image of the virtual space,
  • the avatar coordinate determination unit converts the coordinates of one of the first avatar and the second avatar to the coordinates of the other of the first avatar and the second avatar when occurrence of the first trigger event is recognized. It is characterized by moving to matching coordinates or adjacent coordinates.
  • the "image of the virtual space” includes images of the background of the virtual space, images of other avatars, images of objects that exist only in the virtual space, and images of objects that exist in the virtual space corresponding to the real space. Images, etc. are included.
  • the avatar coordinate determination unit sets the coordinates of one of the first avatar and the second avatar to It is moved to coordinates that match or are adjacent to the coordinates of the other of the second avatar.
  • the images of the virtual space recognized by the first user and the second user are determined based on the coordinates of the first avatar and the second avatar. Therefore, when the coordinates of the avatars match or are adjacent to each other, the images of the virtual space recognized by each user corresponding to those avatars are also matching or adjacent images (that is, similar images).
  • the images of the virtual space recognized by each user can also be matched or adjacent images.
  • the first user and the second user, who have experienced different environments in the virtual space until then, can now experience substantially the same environment.
  • the virtual space experience system of the present invention is a virtual space generation unit that generates a virtual space corresponding to the real space in which the first user and the second user exist; an avatar generation unit that generates a first avatar corresponding to the first user and a second avatar corresponding to the second user in the virtual space; a user coordinate recognition unit that recognizes the coordinates of the first user and the coordinates of the second user in the physical space; Determining the coordinates of the first avatar in the virtual space based on the coordinates of the first user, and determining the coordinates of the second avatar in the virtual space based on the coordinates of the second user.
  • a virtual space experience system comprising a virtual space image display that allows the first user and the second user to recognize an image of the virtual space,
  • the virtual space image determining unit determines the image of the virtual space to be recognized by one of the first user and the second user when occurrence of the first trigger event is recognized.
  • the image is characterized in that the coordinates of one of the two avatars are moved to coordinates that match or are adjacent to the coordinates of the other of the first and second avatars.
  • the virtual space image determining unit selects the virtual space image to be recognized by one of the first user and the second user. is an image when the coordinates of one of the first and second avatars are moved to coordinates that match or are adjacent to the coordinates of the other of the first and second avatars.
  • the coordinates serving as the reference for determining the image in the virtual space to be recognized by one user are set to the coordinates of the avatar corresponding to that user. , coordinates that match or are adjacent to the coordinates of the avatar corresponding to the other user.
  • one user and the other user are determined based on the coordinates that match or are adjacent to the coordinates of the avatar corresponding to the other user. You will recognize the image in the virtual space.
  • the virtual space experience system of the present invention after the occurrence of the first trigger event is recognized, one user can create a Therefore, the first user and the second user, who have experienced different environments in the virtual space until then, can now experience substantially the same environment.
  • the avatar generation unit generates a ghost, which corresponds to one of the first user and the second user and is an avatar independent of the first avatar and the second avatar, in the virtual space;
  • the avatar coordinate determining unit determines the coordinates of the ghost based on coordinates obtained by causing a predetermined deviation in the coordinates of the first avatar or the second avatar corresponding to one of the first user and the second user.
  • the virtual space image determination unit adds information indicating that the image of the virtual space to be recognized by the other of the first user and the second user corresponds to one of the first user and the second user. including an image of the added ghost,
  • the first trigger event is a predetermined action performed on the ghost by the first avatar or the second avatar corresponding to the other of the first user and the second user.
  • the ⁇ information indicating that it is compatible'' to the user means, for example, direct information such as a message that is displayed at all times or at the request of the user, as well as a translucent shape of the corresponding avatar. It also includes indirect information indicated by adopting things as ghost shapes.
  • an avatar that corresponds to the user and serves as a reference for determining an image to be recognized by the user an avatar that corresponds to the user but is independent of the reference avatar (that is, the reference You may generate a ghost that is an avatar that is not a character).
  • the ghost is added with information indicating that it corresponds to a predetermined user. Therefore, other users can easily grasp which user the ghost corresponds to.
  • the "predetermined action” may be any action performed by the avatar based on the ghost. For example, when an avatar touches a ghost, when an avatar moves within a predetermined range based on a ghost, when an avatar operates an object in the virtual space, the ghost is selected as the target. (for example, an action of shooting a ghost with a camera-type object, etc.).
  • the trigger event recognition unit recognizes occurrence of a second trigger event
  • the avatar generation unit generates a first ghost, which is the ghost corresponding to the first user, in the virtual space when occurrence of the second trigger event is recognized
  • the avatar coordinate determining unit determines the coordinates of the first avatar based on the coordinates that cause the predetermined deviation from the coordinates of the first user.
  • the virtual space image determination unit adds information indicating that the virtual space image to be recognized by the second user corresponds to the first user. including the image of the added first ghost;
  • the first trigger event is a predetermined action performed by the second avatar on the first ghost.
  • the coordinates of the first avatar are shifted from the coordinates of the first user by a predetermined amount. Even if the second user moves the second avatar corresponding to himself/herself so as not to contact the first avatar, the second user can contact the first user corresponding to the first avatar. There is a risk that it will be lost.
  • the second user can intuitively understand that the action causes the first trigger event that shares the environment with the first user. As a result, it is possible to prevent the second user's sense of immersion in the virtual space from being hindered due to the occurrence of the first trigger event.
  • the trigger event recognition unit recognizes occurrence of a second trigger event
  • the avatar generation unit generates a second ghost, which is the ghost corresponding to the second user, in the virtual space when occurrence of the second trigger event is recognized
  • the avatar coordinate determining unit determines the coordinates of the first avatar based on the coordinates that cause the predetermined deviation from the coordinates of the first user.
  • the virtual space image determination unit adds information indicating that the virtual space image to be recognized by the first user corresponds to the second user. including the image of the added second ghost,
  • the first trigger event is a predetermined action performed by the first avatar on the second ghost.
  • the coordinates of the first avatar are shifted from the coordinates of the first user by a predetermined amount. Even if the first user moves the first avatar corresponding to himself/herself so as not to contact the second avatar, the second user corresponding to the second avatar is contacted. There is a risk that it will be lost.
  • the first user can intuitively understand that the action causes the first trigger event that shares the environment with the second user. As a result, it is possible to prevent the first user's sense of immersion in the virtual space from being hindered due to the occurrence of the first trigger event.
  • FIG. 1 is a schematic diagram showing a schematic configuration of a VR system according to a first embodiment
  • FIG. FIG. 2 is a block diagram showing the configuration of a processing unit of the VR system in FIG. 1; 2 is a flowchart showing processing executed by the VR system of FIG. 1 in normal use;
  • FIG. 2 is a schematic diagram showing states of a real space and a virtual space in normal use of the VR system of FIG. 1;
  • FIG. 2 is a flow chart showing processing executed when the VR system in FIG. 1 expands the virtual space and after that;
  • FIG. FIG. 2 is a schematic diagram showing the states of the real space and the virtual space when expanding the virtual space in the VR system of FIG. 1;
  • FIG. 2 is a schematic diagram showing the state of the real space and the virtual space after the virtual space is expanded in the VR system of FIG. 1; 4 is a flow chart showing processing in the first embodiment that is executed when and after the VR system of FIG. 1 synchronizes the environment;
  • FIG. 2 is a schematic diagram showing the states of the real space and the virtual space when the VR system in FIG. 1 synchronizes the environments;
  • FIG. 2 is a schematic diagram showing the state of the real space and the virtual space after the VR system of FIG. 1 has synchronized the environments;
  • 10 is a flowchart showing processing executed when the VR system of the second embodiment synchronizes environments;
  • FIG. 12 is a schematic diagram showing the states of the real space and the virtual space when the VR system in FIG. 11 synchronizes the environments;
  • FIG. 12 is a schematic diagram showing the state of the real space and the virtual space after the VR system of FIG. 11 has synchronized the environments; 12 is a schematic diagram of an image of the virtual space as perceived by the second user before the VR system of FIG. 11 synchronizes the environment; FIG. FIG. 12 is a schematic diagram of an image of the virtual space as perceived by the second user after the VR system of FIG. 11 has synchronized the environment;
  • a VR system S which is a virtual space sensation system according to the first embodiment, will be described below with reference to FIGS. 1 to 10.
  • FIG. 1 A VR system S, which is a virtual space sensation system according to the first embodiment, will be described below with reference to FIGS. 1 to 10.
  • a first user U1 and a second user U2 (hereinafter collectively referred to as “users U”) existing together in a predetermined area (for example, one room) of the physical space RS
  • the VR system S One virtual space VS corresponding to the area is made to recognize that they exist together through a first avatar A1 corresponding to the first user U1 and a second avatar A2 corresponding to the second user U2 (Fig. 4, etc.).
  • the number of users is assumed to be two in order to facilitate understanding.
  • the virtual space experience system of the present invention is not limited to such a configuration, and the number of users may be three or more.
  • a VR system S includes a plurality of markers 1 attached to a user U existing in a physical space RS, and a camera 2 that captures the user U (strictly speaking, the marker 1 attached to the user U). , a server 3 that determines the image and sound of the virtual space VS (see FIG. 4, etc.), and a head-mounted display (hereinafter referred to as "HMD 4") that allows the user to recognize the determined image and sound. .
  • HMD 4 head-mounted display
  • the camera 2, server 3, and HMD 4 can mutually transmit and receive information wirelessly, such as through the Internet network, public lines, and short-range wireless communication. However, any one of them may be configured to transmit and receive information to and from each other by wire.
  • a plurality of markers 1 are attached to the user U's head, both hands, and both feet via the HMD 4, gloves, and shoes that the user U wears. As will be described later, the plurality of markers 1 are used to recognize the coordinates and posture of the user U in the physical space RS (furthermore, actions (eg, movement of coordinates, changes in posture including orientation, etc.)). is. Therefore, depending on other devices that constitute the VR system S, the mounting position of the marker 1 may be changed as appropriate.
  • the camera 2 is installed so that the user U's operable range (that is, the range in which the user U can move, change the posture, etc.) in the physical space RS where the user U exists can be photographed from multiple directions.
  • the user U's operable range that is, the range in which the user U can move, change the posture, etc.
  • the server 3 recognizes the sign 1 from the image captured by the camera 2, and recognizes the coordinates and orientation of the user U based on the position of the recognized sign 1 in the physical space RS. Also, the server 3 determines images and sounds to be recognized by the user U based on the coordinates and orientation.
  • the HMD 4 is worn on the user U's head.
  • the HMD 4 includes a monitor 41 (virtual space image display) for allowing the user U to recognize the image of the virtual space VS determined by the server 3, and the sound of the virtual space VS determined by the server 3.
  • a speaker 42 (virtual space audio generator) is provided for recognition by the user U (see FIG. 2).
  • the user U When playing a game or the like using the VR system S, the user U recognizes only the images and sounds of the virtual space VS, and is made to recognize that the user U himself exists in the virtual space. That is, the VR system S is configured as a so-called immersive system.
  • the virtual space experience system of the present invention is not limited to such an immersive system. Therefore, for example, the configuration of the virtual space experience system of the present invention is applied to a system (so-called AR system) that superimposes and displays an image of the real space and an image of the virtual space to allow the user to recognize the augmented real space. You may
  • the VR system S is equipped with a so-called motion capture device composed of a sign 1, a camera 2, and a server 3 as a system for recognizing the coordinates of the user U in the real space RS.
  • the virtual space experience system of the present invention is not limited to such a configuration.
  • a motion capture device in addition to the configuration described above, a configuration in which the numbers of signs and cameras are different from those described above (for example, one each is provided) may be used.
  • a device that recognizes only the user's coordinates may be used instead of the motion capture device.
  • a sensor such as GPS may be installed in the HMD, and the user's coordinates, posture, etc. may be recognized based on the output from the sensor. Also, such a sensor may be used in combination with the motion capture device as described above.
  • the server 3 is composed of one or more electronic circuit units including CPU, RAM, ROM, interface circuits, and the like. As shown in FIG. 2, the server 3 includes a display image generation unit 31, a user information recognition unit 32, and a trigger event recognition unit 33 as functions (processing units) implemented by the installed hardware configuration or programs. , an avatar coordinate determination unit 34 , a virtual space image determination unit 35 , and a virtual space sound determination unit 36 .
  • the display image generation unit 31 generates an image to be recognized by the user U through the monitor 41 of the HMD 4 .
  • the display image generator 31 has a virtual space generator 31a, an avatar generator 31b, and a moving object generator 31c.
  • the virtual space generation unit 31a generates an image that serves as the background of the virtual space VS and an image of an object that exists in the virtual space VS.
  • the avatar generation unit 31b generates, in the virtual space VS, a first avatar A1 corresponding to the first user U1, and a first ghost G1, which is an avatar independent of the first avatar A1 (FIG. 6, etc.). reference). In addition, the avatar generation unit 31b generates a second avatar A2 and a second ghost G2, which is an avatar independent of the second avatar A2, corresponding to the second user U2 (see FIG. 6, etc.). .
  • the first avatar A1 and second avatar A2 (hereinafter collectively referred to as “avatar A”), and the first ghost G1 and second ghost G2 (hereinafter collectively referred to as “ghost G”) are , operate in the virtual space VS in response to the corresponding user U's actions in the physical space RS (that is, coordinate movement and posture change).
  • the moving body generation unit 31c generates a moving body in the virtual space VS that has no corresponding object in the real space RS and that can be connected to the avatar in the virtual space VS.
  • the “moving object” is an object that allows the user U to predict (whether consciously or unconsciously) the movement of the avatar that differs from the actual movement of the user when the avatar connects. If it is
  • moving objects include objects used for movement in real space such as elevators, logs flowing in a river that can be jumped on, floors that are likely to collapse when standing on them, jumping platforms, wings that assist jumping, etc. is applicable.
  • objects used for movement in real space such as elevators, logs flowing in a river that can be jumped on, floors that are likely to collapse when standing on them, jumping platforms, wings that assist jumping, etc. is applicable.
  • characters, patterns, and the like drawn on the ground and wall surfaces of the virtual space also correspond to moving objects.
  • connection between the avatar and the moving object means that the user can predict that the movement of the moving object, the change in the shape of the moving object, etc. will affect the coordinates of the avatar. .
  • an avatar getting into an elevator an avatar riding on a log flowing in a river, an avatar standing on a crumbling floor, an avatar standing on a jumping platform, an avatar wearing wings that assist jumping, etc. Applicable.
  • an avatar touches or approaches characters, patterns, or the like drawn on the ground or wall surface of the virtual space this also corresponds to connection.
  • Image data of the user U including the sign 1 captured by the camera 2 is input to the user information recognition unit 32 .
  • the user information recognition section 32 has a user posture recognition section 32a and a user coordinate recognition section 32b.
  • the user posture recognition unit 32a extracts the marker 1 from the input image data of the user U, and recognizes the posture of the user U based on the extraction result.
  • the user coordinate recognition unit 32b extracts the marker 1 from the input image data of the user U, and recognizes the coordinates of the user U based on the extraction result.
  • the trigger event recognition unit 33 recognizes that a predetermined trigger event has occurred or that the trigger event has been canceled when a condition predetermined by the system designer is satisfied.
  • the trigger event may be one that the user is unaware of. Therefore, as a trigger event, for example, events caused by user actions such as the user performing a predetermined action in the real space (that is, the avatar corresponding to the user performing a predetermined action in the virtual space) are also applicable. In addition, it also applies to events that are not caused by the user's actions, such as the passage of a predetermined period of time.
  • the avatar coordinate determination unit 34 determines the coordinates of the avatar corresponding to the user U in the virtual space VS based on the coordinates of the user U in the physical space RS recognized by the user coordinate recognition unit 32b.
  • the avatar coordinate determination unit 34 when the trigger event recognition unit 33 recognizes the occurrence of a predetermined trigger event, the avatar coordinate determination unit 34, regardless of the coordinates of the user, during a predetermined period or within a predetermined range, or within a predetermined period and within a predetermined range, Move the coordinates of the avatar corresponding to the user.
  • the avatar coordinate determination unit 34 sets the avatar A corresponding to the user U for a predetermined period, a predetermined range, or a predetermined period and a predetermined range.
  • the coordinates of the ghost G are determined based on the coordinates obtained by shifting the coordinates of .
  • the virtual space image determination unit 35 determines the image of the virtual space to be recognized by the user U corresponding to the avatar via the monitor 41 of the HMD 4.
  • the "image of the virtual space” includes images of other avatars, images of ghosts, images of objects that exist only in the virtual space, and images in the virtual space corresponding to the real space. Images of existing objects, etc. are included.
  • the image of the ghost G in this embodiment is added with information indicating that it corresponds to the user U corresponding to the ghost G.
  • the ⁇ information indicating that it is compatible'' to the user means, for example, direct information such as a message that is displayed at all times or at the request of the user, as well as a translucent shape of the corresponding avatar. It also includes indirect information indicated by adopting things as ghost shapes.
  • the virtual space audio determining unit 36 determines the audio to be recognized by the user U corresponding to the avatar via the speaker 42 of the HMD 4.
  • each processing unit that constitutes the virtual space experience system of the present invention is not limited to the configuration as described above.
  • part of the processing unit provided in the server 3 in the above embodiment may be provided in the HMD 4.
  • a plurality of servers may be used, or the servers may be omitted and the CPUs mounted on the HMDs may cooperate with each other.
  • a speaker other than the speaker mounted on the HMD may be provided.
  • devices that affect sight and hearing devices that affect smell and touch such as generating smells, wind, etc. according to the virtual space may also be included.
  • the display image generation unit 31 of the server 3 generates the virtual space VS, the first avatar A1 and the second avatar A2, and the moving object (FIG. 3/STEP 100).
  • the virtual space generation unit 31a of the display image generation unit 31 generates the virtual space VS and various objects existing in the virtual space VS. Also, the avatar generation unit 31b of the display image generation unit 31 generates a first avatar A1 corresponding to the first user U1 and a second avatar A2 corresponding to the second user U2. Further, the moving object generation unit 31c of the display image generation unit 31 generates a moving object such as an elevator VS1, which will be described later.
  • a first avatar A1 a second avatar A2
  • an elevator VS1 which is a moving body
  • a real space RS An object related to a trigger event such as a switch VS2 generated at a position corresponding to the whiteboard RS1 is placed.
  • the avatar coordinate determination unit 34 of the server 3 determines the coordinates and posture of the first avatar A1 in the virtual space VS based on the coordinates and posture of the first user U1 in the physical space RS, and The coordinates and orientation of the second avatar A2 in the virtual space VS are determined based on the coordinates and orientation in the physical space RS (FIG. 3/STEP 101).
  • the coordinates and orientation of the first user U1 and the second user U2 in the processing after STEP 101 are the coordinates and orientation recognized by the user information recognition unit 32 of the server 3 based on the image data captured by the camera 2. .
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 of the server 3 determine the image and audio to be recognized by the first user U1 based on the coordinates and posture of the first avatar A1 in the virtual space VS.
  • the image and sound to be recognized by the second user U2 are determined based on the coordinates and posture of the second avatar A2 in the virtual space VS (FIG. 3/STEP 102).
  • the HMD 4 worn by the user U causes the monitor 41 mounted on the HMD 4 to display the determined image, and the speaker 42 mounted on the HMD 4 to generate the determined sound (FIG. 3/ STEP 103).
  • the user information recognition unit 32 of the server 3 determines whether or not the movement of the coordinates or the change of the posture in the physical space RS of the first user U1 or the second user U2 has been recognized (FIG. 3/STEP 104).
  • the server 3 recognizes the signal instructing the end of the process. (FIG. 3/STEP 105).
  • the first avatar A1 corresponding to the first user U1, the second avatar A2 corresponding to the second user U2, the elevator VS1 which is a moving body, and the A plurality of objects are placed including a switch VS2, etc., to be set.
  • the first user U1 and the second user U2 can visualize themselves via the corresponding first avatar A1 and second avatar A2 by the image displayed and the sound generated by the HMD 4 they wear. It comes to recognize that it exists in space VS and can move freely.
  • the VR system S sets the correspondence relationship between the coordinates of the first user U1 and the coordinates of the first avatar A1, or the relationship between the coordinates of the first user U2 and the first avatar A1.
  • 2 avatar A2 is configured to perform a process of causing a deviation in the correspondence relationship.
  • the coordinates of the first avatar A1 corresponding to the first user U1 are displayed regardless of the movement of the coordinates of the first user U1. moves upwards. Specifically, the first avatar A1 moves from the first floor F1 defined in the virtual space VS to the second floor F2 by the elevator VS1.
  • the first user U1 to whom the corresponding first avatar A1 has been moved and the second user U2 who recognizes the first avatar A1 are extended in the vertical direction from the physical space RS.
  • the virtual space VS created can be recognized.
  • the first user U1 and the second user U2 may not be able to properly grasp their mutual positional relationship in the physical space RS. As a result, there is a possibility that the first user U1 and the second user U2 may come into contact with each other unintentionally.
  • the second user U2 may mistakenly think that the first user U1 is moving upward in the real space RS as well as the first avatar A1. Then, as shown in FIG. 7, the second user U2 misunderstands that the second avatar A2 corresponding to him/herself in the virtual space VS can move below the elevator VS1, and moves the second avatar A2 below the elevator VS1. In some cases, they try to move themselves, as if they were moving to another area.
  • the first user U1 corresponding to the first butter A1 actually exists at the same height as the second user U2. Therefore, in that case, the first user U1 and the second user U2 come into contact in the physical space RS. As a result, there is a possibility that the feeling of immersion in the virtual space VS of the first user U1 and the second user U2 may be hindered.
  • the virtual space VS is expanded so as to be wider than the real space RS corresponding to the virtual space VS, as described below.
  • Unintended contact between the first user U1 and the second user U2 is prevented by executing the process and the process for contact avoidance.
  • the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of the trigger event has been recognized (FIG. 5/STEP 200).
  • the trigger event recognizing unit 33 sets the coordinates of the first avatar A1 corresponding to the first user U1 in the virtual space VS so that the first user U1 gets on the elevator VS1, which is a moving body. , in the physical space RS, it is determined whether or not the coordinates of the first user U1 have moved.
  • the trigger event recognition unit 33 further causes the second avatar A2 corresponding to the second user U2 to touch the switch VS2 at a position near the switch VS2 in the virtual space VS. It is determined whether or not the second user U2 has moved to a predetermined posture (see FIG. 6).
  • the trigger event recognition unit 33 recognizes that a trigger event has occurred.
  • the avatar coordinate determination unit 34 of the server 3 moves the coordinates of the first avatar A1 (FIG. 5/STEP201).
  • the avatar coordinate determination unit 34 determines the coordinates of the first user U1 according to the content of the deviation (that is, correction direction and correction amount) predetermined according to the type of the recognized trigger event. Move the coordinates of the first avatar A1 based on. This movement is performed independently of the movement of the coordinates of the first avatar A1 based on the movement of the coordinates of the first user U1. As a result, the correspondence relationship between the coordinates of the first user U1 and the coordinates of the first avatar A1 is deviated.
  • the first avatar A1 moves upward from the first floor F1 to the second floor F2 integrally with the elevator VS1 so that the state shown in FIG. 4 changes to the state shown in FIG. .
  • the display image generator 31 of the server 3 generates the first ghost G1 and the second ghost G2 (FIG. 5/STEP 202).
  • the avatar generation unit 31b of the display image generation unit 31 generates a first ghost G1 corresponding to the first user U1 in the virtual space VS using the occurrence of a trigger event as a trigger, and also generates a first ghost G1 corresponding to the first user U2. generates a second ghost G2 corresponding to .
  • the first ghost G1 is configured as a translucent avatar having the same shape as the first avatar A1 in order to indicate that it corresponds to the first user U1.
  • a first information board G1a which will be described later, is added to the first ghost G1.
  • the second ghost G2 is configured as a translucent avatar having the same shape as the second avatar A2 in order to indicate that it corresponds to the second user U2.
  • a second information board G2a is added.
  • the coordinates of the generated first ghost G1 are set to match the coordinates of the first avatar A1 immediately before the process of STEP201 is executed. Also, the generated coordinates of the second ghost G2 are set so as to be independent of the coordinates of the second user U2.
  • the avatar coordinate determination unit 34 of the server 3 determines the virtual space VS of the first avatar A1 and the first ghost G1 based on the coordinates and posture of the first user U1 in the physical space RS recognized by the user information recognition unit 32. Determine the coordinates and attitude in (FIG. 5/STEP 203).
  • the avatar coordinate determination unit 34 recognizes the occurrence of the trigger event according to the content of the deviation (that is, correction direction and correction amount) predetermined according to the type of the recognized trigger event. By correcting the coordinates and orientation of the first avatar A1 determined by the processing up to the time when the trigger event occurs (the processing before the processing of STEP 201 is executed), the first avatar A1 after the occurrence of the trigger event is recognized. Determine the coordinates and posture of avatar A1.
  • the avatar coordinate determination unit 34 moves the coordinates of the first avatar A1 based on the coordinates of the first user U1 upward by the height of the second floor F2 relative to the first floor F1. The coordinates are determined as the coordinates of the first avatar A1 after the occurrence of the triggering event is recognized. Also, the avatar coordinate determining unit 34 determines the posture of the first avatar A1 based on the posture of the first user U1 as the posture of the first avatar A1 after the occurrence of the trigger event is recognized.
  • the avatar coordinate determining unit 34 uses the same process as the process for determining the coordinates and orientation of the first avatar A1 before the occurrence of the trigger event is recognized to determine the coordinates of the first user U1. and the orientation, determine the coordinates and orientation of the first ghost G1.
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 of the server 3 determine the image and audio to be recognized by the first user U1 based on the coordinates and posture of the first avatar A1 in the virtual space VS. (FIG. 5/STEP 204).
  • the avatar coordinate determination unit 34 of the server 3 determines the virtual space VS of the second avatar A2 and the second ghost G2 based on the coordinates and posture of the second user U2 in the physical space RS recognized by the user information recognition unit 32. Determine the coordinates and attitude in (FIG. 5/STEP 205).
  • the avatar coordinate determination unit 34 uses the same processing as that for determining the coordinates and posture of the second avatar A2 so far, based on the coordinates and posture of the second user U2, to determine the 2 Determine the coordinates and posture of avatar A2.
  • the avatar coordinate determination unit 34 determines the timing at which the occurrence of the trigger event is recognized, according to the details of the deviation (that is, correction direction and correction amount) predetermined according to the type of the recognized trigger event.
  • the coordinates and orientation of the second avatar A2 determined by the previous processing are corrected to determine the coordinates and orientation of the second ghost G2.
  • the avatar coordinate determination unit 34 moves the coordinates of the second avatar A2 based on the coordinates of the second user U2 upward by the height of the second floor F2 relative to the first floor F1. is determined as the coordinates of the second ghost G2 after the time when the occurrence of the trigger event was recognized.
  • the avatar coordinate determination unit 34 determines the posture of the second avatar A2 based on the posture of the second user U2 as it is as the posture of the second ghost G2 after the occurrence of the trigger event is recognized.
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 of the server 3 determine the image and audio to be recognized by the second user U2 based on the coordinates and posture of the second avatar A2 in the virtual space VS. (FIG. 5/STEP 206).
  • the HMD 4 worn by the user U displays the determined image on the monitor 41 and emits sound from the speaker 42 (FIG. 5/STEP 207).
  • the user information recognition unit 32 of the server 3 determines whether or not the movement of the coordinates or the change of the posture in the physical space RS of the first user U1 or the second user U2 has been recognized (FIG. 5/STEP 208).
  • the server 3 recognizes a signal instructing the end of processing. It is determined whether or not it has been done (FIG. 5/STEP 209).
  • the image and sound of the virtual space VS recognized by the first user U1 include the image and sound of the second ghost G2.
  • the image and sound of the virtual space VS recognized by the second user U2 include the image and sound of the first ghost G1.
  • the first user U1 naturally moves to the first avatar A1 corresponding to the corrected coordinates of himself and the corrected coordinates of the second player when performing some action. It operates while avoiding contact with the corresponding second ghost G2.
  • the second user U2 naturally avoids contact between the second avatar A2 corresponding to his coordinates and the first ghost G1 corresponding to the coordinates of the first user U1. do.
  • the first ghost G1 is configured as a translucent avatar having the same shape as the first avatar A1
  • the second ghost G2 is configured as a translucent avatar having the same shape as the second avatar A2.
  • the first ghost G1 is added with the first information board G1a
  • the second ghost G2 is added with the second information board G2a.
  • the method of displaying information indicating which user the avatar corresponds to in the virtual space experience system of the present invention and the method of displaying information related to ghosts are not limited to such configurations. It may be set as appropriate.
  • the information board may be omitted by simply matching the shapes of the first ghost G1 and the second ghost G2 with the shapes of the first avatar A1 and the second avatar A2. Conversely, only the information board may be displayed without displaying shapes corresponding to the shapes of the first avatar A1 and the second avatar A2.
  • the VR system S When the VR system S recognizes the occurrence of a predetermined trigger event (the first trigger event in the present invention), the VR system S adds the first user U1 and the second user U2 to the environment of one of the first user U1 and the second user U2. It is configured to perform processing for synchronizing one environment of the
  • the “environment” refers to at least one of images and sounds recognized by the user corresponding to the avatar located at the coordinates of the virtual space.
  • environmental synchronization means that a plurality of users corresponding to a plurality of avatars come to recognize similar environments.
  • the second avatar A2 touching the first ghost G1 corresponding to the first user U1 is set as the trigger event.
  • the coordinates of the second avatar A2 corresponding to the second user U2 are moved to the second 1 Move to the coordinates adjacent to the coordinates of avatar A1.
  • the second avatar A2 moves from the first floor F1 to coordinates adjacent to the first avatar A1 on the second floor F2.
  • the environment of the first user U1 and the environment of the second user U2 are synchronized, and the first user U1 and the second user U2 can experience the same environment.
  • the first user U1 corresponding to the first avatar A1 wishes to view, together with the second user U2, the rainbow VS3 that exists above the second floor F2 of the virtual space VS.
  • a description will be given of the processing when the second user U2 tries to synchronize the environment with the first user U1 (that is, he himself tries to look at the rainbow VS3) when the second user U2 is notified via a message function or the like. .
  • the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of the trigger event has been recognized (FIG. 8/STEP 300).
  • the trigger event recognition unit 33 recognizes that the second avatar A2 corresponding to the second user U2 is the first avatar A1 corresponding to the first user U1 in the virtual space VS. It is determined whether or not it is in a posture to touch the . Then, when the second avatar A2 assumes a posture of touching the first avatar A1, the trigger event recognition unit 33 recognizes that a trigger event has occurred.
  • the avatar coordinate determination unit 34 of the server 3 moves the coordinates of the second avatar A2 to the coordinates adjacent to the coordinates of the first avatar A1 ( FIG. 5/STEP 301).
  • the avatar coordinate determination unit 34 refers not only to the coordinates of the first avatar A1 but also to the posture, and determines the coordinates located to the side, front, or rear of the first avatar A1 (that is, adjacent coordinates). Recognize and move the second avatar A2 to the coordinates.
  • This movement is performed independently of the movement of the coordinates of the second avatar A2 based on the movement of the coordinates of the second user U2. It should be noted that this causes a deviation in the corresponding relationship between the coordinates of the second user U2 and the coordinates of the second avatar A2.
  • the second avatar A2 located on the first floor F1 is located on the second floor F2 and is next to the first avatar A1 on the left, as shown in FIG. Momentarily move so as to be located in
  • the history of the movement (eg, the time it takes to move, the route during the movement, etc.) may be set as appropriate.
  • the movement speed of the second avatar A2 is slowed to some extent so that the movement route of the second avatar A2 can be recognized.
  • the third user it becomes possible for the third user to recognize the movement of the coordinates when the occurrence of the trigger event is recognized.
  • the display image generator 31 of the server 3 erases the first ghost G1 and the second ghost G2 (FIG. 8/STEP 302).
  • the movement of the second avatar A2 in STEP 301 eliminates the deviation in the corresponding relationship between the coordinates of the first avatar A1 and the coordinates of the second avatar A2, which is caused by the process of expanding the virtual space. be. That is, after the movement, the correspondence relationship between the coordinates of the first avatar A1 and the coordinates of the second avatar A2 is changed from the correspondence relationship before the deviation occurred (that is, the coordinates of the first user U1 and the coordinates of the second user U2). ).
  • the correspondence relationship between the coordinates of the first avatar A1 and the coordinates of the second avatar A2 and the relationship between the coordinates of the first user U1 and the corresponding coordinates of the second user U2 are If there is no match, etc., at least one of the first ghost G1 and the second ghost G2 should continue to exist as required.
  • the avatar coordinate determination unit 34 of the server 3 determines the first avatar A1 and the first ghost based on the coordinates and postures in the physical space RS of the first user U1 and the second user U2 recognized by the user information recognition unit 32.
  • the coordinates and orientations of G1, the second avatar A2, and the second ghost G2 in the virtual space VS are determined (FIG. 8/STEP 303).
  • the avatar coordinate determination unit 34 continues to determine the coordinates and orientation determined based on the coordinates and orientation of the first user by determining the details of the deviation that occurred in the process of expanding the virtual space VS (i.e., correction direction and correction amount) to determine the coordinates and orientation of the first avatar A1.
  • the avatar coordinate determination unit 34 determines the coordinates and posture determined based on the coordinates and posture of the second user as the content of the deviation (that is, the correction direction) predetermined according to the type of the recognized trigger event. and correction amount) to determine the coordinates and posture of the second avatar A2.
  • the avatar coordinate determination unit 34 moves the coordinates of the second avatar A2 based on the coordinates of the second user U2 upward by the height of the second floor F2 relative to the first floor F1,
  • the horizontal movement from the coordinates of the second avatar A2 at the time when the occurrence of the trigger event is recognized to the coordinates to the left of the first avatar A1 is the coordinates after the time when the occurrence of the trigger event is recognized. 2 Determined as coordinates of avatar A2.
  • the avatar coordinate determination unit 34 determines the posture of the second avatar A2 based on the posture of the second user U2 as the posture of the second avatar A2 after the occurrence of the trigger event is recognized.
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 of the server 3 determine the image and audio to be recognized by the first user U1 based on the coordinates and posture of the first avatar A1 in the virtual space VS.
  • the image and sound to be recognized by the second user U2 are determined based on the coordinates and posture of the second avatar A2 in the virtual space VS (FIG. 8/STEP 304).
  • the HMD 4 worn by the user U displays the determined image on the monitor 41 and emits sound from the speaker 42 (FIG. 8/STEP 305).
  • the user information recognition unit 32 of the server 3 determines whether or not the movement of the coordinates or the change of the posture in the physical space RS of the first user U1 or the second user U2 has been recognized (FIG. 8/STEP 306).
  • the server 3 recognizes the signal instructing the end of the process. It is determined whether or not it has been completed (FIG. 8/STEP 307).
  • the avatar coordinate determination unit 34 moves the coordinates of the second avatar A2 to coordinates adjacent to the coordinates of the first avatar A1. I am letting
  • the images and sounds of the virtual space VS recognized by the first user U1 and the second user U2 are determined based on the coordinates of the first avatar A1 and the second avatar A1. Therefore, when the coordinates of the avatars match or are adjacent to each other, the images and sounds in the virtual space VS recognized by each user corresponding to those avatars are also matched or similar images and sounds (that is, similar image and sound).
  • the images and sounds in the virtual space recognized by each user can be matched or adjacent to each other.
  • the first user U1 and the second user U2 who experienced different environments in the virtual space can now experience substantially the same environment.
  • the virtual space experience system of the present invention is not limited to such a configuration. Anything that synchronizes with the other environment of the second user may be used.
  • the coordinates of the second avatar A2 are set to the coordinates adjacent to the coordinates of the first avatar A1. It may be configured to move. That is, instead of the second avatar A2 moving itself to coordinates matching or adjacent to the coordinates of the first avatar A1, the first avatar A1 moves the coordinates of the second avatar A2 to coordinates matching or adjacent to its own coordinates. It may be configured to call to the coordinates that
  • the first avatar A1 when the second avatar A2 touches the first ghost G1 corresponding to the first user U1, the first avatar A1 itself has coordinates matching or adjacent to the coordinates of the second avatar A2.
  • the first avatar A1 may call the coordinates of the second avatar A2 to coordinates that match or are adjacent to the coordinates of the first avatar A1.
  • a configuration for performing a process of moving one's own coordinates to coordinates matching or adjacent to the coordinates of another user and a process of calling other users' coordinates to coordinates matching or adjacent to the coordinates of one's own are performed.
  • the action that becomes the trigger event may be made different according to the processing to be performed.
  • the process of moving the user's own coordinates to coordinates matching or adjacent to the coordinates of the other user is called to the coordinates that match or are adjacent to the own coordinates. It should be configured as follows.
  • processing is performed to move the coordinates of the second avatar A2 not to the coordinates that match the coordinates of the first avatar A1 but to the coordinates that are adjacent to them. .
  • This makes it easy for one user to include an avatar corresponding to the other user in the image recognized by one user when the coordinates of the second avatar A2 move, and for one user to move the other user closer to himself/herself. This is to make it easier for you to recognize what you have done.
  • the present invention is not limited to such a configuration, and the coordinates for moving one avatar may be matched with the coordinates of the other avatar. With this configuration, the degree of environmental synchronization can be further enhanced compared to the case of moving to adjacent coordinates.
  • the second avatar A2 continues to be located on the second floor F2. That is, the state in which the correspondence relationship between the coordinates of the second user U2 and the coordinates of the second avatar A2 continues to be deviated based on the deviation caused by the movement when the occurrence of the trigger event is recognized.
  • the present invention is not limited to such a configuration, and may be configured to eliminate the deviation caused by the movement when the occurrence of the trigger event is recognized after that.
  • a predetermined may be configured to move the avatar's coordinates for a period of time, and after the period elapses, return the avatar's coordinates to the coordinates before the occurrence of the triggering event was recognized.
  • a VR system S which is a virtual space experience system according to the second embodiment, will be described below with reference to FIGS. 2 and 11 to 15.
  • FIG. 1 A VR system S, which is a virtual space experience system according to the second embodiment, will be described below with reference to FIGS. 2 and 11 to 15.
  • the VR system S of this embodiment has the same configuration as the VR system S of the first embodiment, except for the processing that is executed when synchronizing the environment and after that.
  • the VR system S When the VR system S recognizes the occurrence of a predetermined trigger event (the first trigger event in the present invention), the VR system S adds the first user U1 and the second user U2 to the environment of one of the first user U1 and the second user U2. It is configured to perform processing for synchronizing one environment of the
  • touching the first ghost G1 corresponding to the first user U1 by the second avatar A2 is set as the trigger event.
  • the environment recognized by the second user U2 is recognized by the first user U1 regardless of the coordinates of the second user U2. be consistent with the environment in which they exist. Specifically, the environment recognized by the second user U2 changes from one based on the coordinates of the second avatar A2 (see FIG. 14) to one based on the coordinates of the first avatar A1 (see FIG. 15).
  • the environment of the first user U1 and the environment of the second user U2 are synchronized so that the first user U1 and the second user U2 can experience the same environment. ing.
  • the first user U1 corresponding to the first avatar A1 wishes to view, together with the second user U2, the rainbow VS3 that exists above the second floor F2 of the virtual space VS.
  • a description will be given of the processing when the second user U2 tries to synchronize the environment with the first user U1 (that is, he himself tries to look at the rainbow VS3) when the second user U2 is notified via a message function or the like. .
  • the second user U2 recognizes an image of the first avatar A1 on the second floor F2 of the virtual space VS looking up. It is assumed that there is
  • the trigger event recognition unit 33 of the server 3 determines whether or not the occurrence of the trigger event has been recognized (FIG. 11/STEP 400).
  • the trigger event recognizing unit 33 recognizes that the second avatar A2 corresponding to the second user U2 is the first avatar A1 corresponding to the first user U1 in the virtual space VS. It is determined whether or not it is in a posture to touch the . Then, when the second avatar A2 assumes a posture of touching the first avatar A1, the trigger event recognition unit 33 recognizes that a trigger event has occurred.
  • the avatar coordinate determination unit 34 of the server 3 fixes the coordinates of the second avatar A2 and the second ghost G2 (FIG. 11/STEP401).
  • the images and sounds recognized by the second user U2 corresponding to the second avatar A2 and the second ghost G2 is determined based on the coordinates of the first avatar A1.
  • the second avatar A2 is able to move while the process is being executed, the coordinates of the second avatar A2 will unintentionally move after the process for synchronizing the environments. Become. As a result, after the process is finished, there is a possibility that the sense of immersion of the second user U2, who recognizes the image and sound based on the coordinates of the second avatar A2, is disturbed.
  • the coordinates of the second ghost G2 may unintentionally move after the process for synchronizing the environments is completed. Become. As a result, after the process ends, the position of the second ghost G2 suddenly changes in the image recognized by the first user U1, which may hinder the first user U1's sense of immersion. .
  • the posture of the second avatar A2 may also be configured to match the posture of the first avatar A1. With this configuration, the image and sound recognized by the second user U2 are more consistent with the image and sound recognized by the first user U1. You will be able to experience a more synchronized environment.
  • the avatar coordinate determination unit 34 of the server 3 determines the coordinates and posture of the first user U1 in the physical space RS recognized by the user information recognition unit 32. , coordinates and orientations of the first avatar A1 and the first ghost G1 in the virtual space VS (FIG. 11/STEP 402).
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 of the server 3 determine the image and audio to be recognized by the first user U1 and the second user U2 as the coordinates and posture of the first avatar A1 in the virtual space VS. (FIG. 5/STEP 403).
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 determine the image and audio to be recognized by the first user U1 based on the coordinates and posture of the first avatar A1. Also, the virtual space image determination unit 35 and the virtual space audio determination unit 36 determine the image and audio to be recognized by the second user U2 based on the coordinates of the first avatar A1 and the posture of the second avatar A2.
  • the image and voice determined in this manner and recognized by the first user U1 are based on the coordinates and posture of the first avatar A1, and are based on the second floor F2 of the virtual space VS, and are looking at the rainbow VS3 in the sky above. become a thing.
  • the image and voice determined in this manner to be recognized by the second user U2 are recognized when positioned at coordinates behind the coordinates of the first avatar A1 as viewed from the first avatar A1.
  • image and sound are recognized when positioned at coordinates behind the coordinates of the first avatar A1 as viewed from the first avatar A1.
  • image and sound are recognized when positioned at coordinates behind the coordinates of the first avatar A1 as viewed from the first avatar A1.
  • image and sound Specifically, as shown in FIG. 15, the rainbow VS3 in the sky is viewed from behind the first avatar A1 on the second floor F2 of the virtual space VS.
  • the first avatar A1 (and thus the first user U1) can be recognized in this process.
  • the coordinates that serve as references for the images and sounds that are recognized by the second user U2 are the coordinates behind the coordinates of the first avatar A1 (that is, the adjacent coordinates).
  • the second user U2 wants to experience an environment that is closer to the environment experienced by the first user U1, it is preferable to match the reference coordinates with the coordinates of the first avatar A1. . Also, when the reference posture is also matched with the first avatar A1, the second user U2 can experience the same environment as the first user U1 is experiencing.
  • the HMD 4 worn by the user U causes the monitor 41 mounted on the HMD 4 to display the determined image, and the speaker 42 mounted on the HMD 4 to generate the determined sound (FIG. 11/ STEP 404).
  • the trigger event recognition unit 33 of the server 3 determines whether or not it has recognized the cancellation of the trigger event (FIG. 11/STEP 405).
  • the trigger event recognition unit 33 determines that the second avatar A2 corresponding to the second user U2 touches the first avatar A1 corresponding to the first user U1 in the virtual space VS (see FIG. 12). ) is released. Then, when the second avatar A2 releases the posture of touching the first avatar A1, the trigger event recognition unit 33 recognizes that the trigger event has been released.
  • the release of the trigger event may be configured to be automatically recognized, for example, when a predetermined period of time has passed since the occurrence of the trigger event, or when another trigger event occurs (for example, The second avatar A2 may be configured to be recognized when the second avatar A2 is not touching the first ghost G1.
  • the avatar coordinate determination unit 34 of the server 3 releases the fixation of the coordinates of the second avatar A2 and the second ghost G2 (FIG. 11/STEP406). .
  • the avatar coordinate determination unit 34 of the server 3 determines that the user Based on the coordinates and orientation of the first user U1 in the physical space RS recognized by the information recognition unit 32, the coordinates and orientation of the first avatar A1 and the first ghost G1 in the virtual space VS are determined (FIG. 11/STEP 407).
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 of the server 3 determine the image and audio to be recognized by the first user U1 based on the coordinates and posture of the first avatar A1 in the virtual space VS. (FIG. 11/STEP 408).
  • the avatar coordinate determination unit 34 of the server 3 determines the virtual space VS of the second avatar A2 and the second ghost G2 based on the coordinates and posture of the second user U2 in the physical space RS recognized by the user information recognition unit 32. Determine the coordinates and attitude in (FIG. 11/STEP 409).
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 of the server 3 determine the image and audio to be recognized by the second user U2 based on the coordinates and posture of the second avatar A2 in the virtual space VS. (FIG. 11/STEP 410).
  • the HMD 4 worn by the user U displays the determined image on the monitor 41 and emits sound from the speaker 42 (FIG. 11/STEP 411).
  • the server 3 determines whether or not it has recognized a signal instructing the end of processing (FIG. 11/STEP 412).
  • the virtual space image determining unit 35 and the virtual space audio determining unit 36 when the occurrence of the trigger event is recognized, generate images and sounds of the virtual space VS to be recognized by the second user U2. is the image and sound when the coordinates of the second avatar A2 move to the coordinates adjacent to the coordinates of the first avatar A1.
  • the coordinates serving as the reference for determining the image and sound of the virtual space VS to be recognized by the second user U2 are set to the second avatar A2 corresponding to the second user U2.
  • the coordinates are adjacent to the coordinates of the first avatar A1 corresponding to the first user U1 regardless of the position of the coordinates of .
  • the second user U2 is determined together with the first user U1 based on the coordinates adjacent to the coordinates of the first avatar A1 corresponding to the first user U1. Images and sounds in the virtual space VS are recognized.
  • the second user U2 appears in the virtual space determined based on coordinates adjacent to the coordinates of the first avatar A1 corresponding to the first user U1 Since the images and sounds of the space VS are recognized, the first user and the second user who have experienced different environments in the virtual space VS can now experience substantially the same environment.
  • the virtual space experience system of the present invention is not limited to such a configuration. Anything that synchronizes with the other environment of the second user may be used.
  • the image and voice recognized by the first user U1 are moved to the coordinates of the second avatar A2.
  • the determination may be based on matching coordinates or adjacent coordinates.
  • the second user U2 synchronizes his environment with the environment of the first user U1 who is another user. may be configured.
  • the image and voice recognized by the second user U2 are transferred to the first avatar A1.
  • the first avatar A1 touches the second ghost G2 corresponding to the second user U2
  • the image and voice recognized by the second user U2 are transferred to the first avatar A1.
  • the second avatar A2 touches the first ghost G1 corresponding to the first user U1
  • the image and sound recognized by the first user U1 are changed to coordinates matching the coordinates of the second avatar A2 or adjacent to the coordinates of the second avatar A2. It may be configured so as to be determined using the coordinates as a reference.
  • a process of synchronizing the user's environment with the environment of the other user is executed, and the user can respond to the user itself. It is preferable to configure such that when an avatar corresponding to another user is touched with the avatar's left hand, a process of synchronizing the other user's environment with the own environment is executed.
  • a configuration for performing processing for synchronizing the environments by moving the coordinates as in the first embodiment and a configuration for performing processing for synchronizing the environments by changing the reference coordinates as in the present embodiment may be combined.
  • the action that becomes the trigger event should be changed according to the process to be performed.
  • the coordinates are moved to synchronize the environment, and the avatar corresponding to the self touches the hand of the avatar corresponding to the other user.
  • the shoulder of the avatar corresponding to the user it may be configured such that processing for synchronizing the environment is performed by changing the reference coordinates.
  • the VR system S which is a virtual space experience system, provides a first user U1 and a second user U2 who are present together in one room in the real space RS.
  • a single virtual space VS corresponding to a room is configured to recognize each other through a first avatar A1 corresponding to a first user U1 and a second avatar A2 corresponding to a second user U2.
  • the virtual space experience system of the present invention is not limited to such a configuration, as long as avatars corresponding to multiple users can exist in the virtual space at the same time.
  • the first user and the second user may exist in different areas of the physical space (eg, their own rooms).
  • the virtual space experience system of the present invention is not limited to the configuration in which the process of synchronizing the environment is executed only when the process of expanding the virtual space is executed.
  • user can also recognize that they are experiencing some kind of virtual space. Therefore, for example, avatars corresponding to each user do not have to exist in the same virtual space.
  • the virtual space in which the concierge counter exists may be the virtual space in which the store exists, or may be a virtual space different from the virtual space in which the store exists.
  • the second avatar moves from the concierge counter to the coordinates of the first avatar corresponding to the first user who caused the first trigger event among the plurality of first users. and move.
  • the viewpoint of one avatar is configured to move to coordinates that match or are adjacent to the coordinates of the other avatar as in the second embodiment.
  • the image displayed to the second user corresponding to the second avatar is selected from the image of the concierge counter to display the first trigger of the plurality of first users.
  • the image changes to be similar to the image displayed to the first user who caused the event.
  • the first trigger event is, for example, an action in which the first avatar presses a call button, which is an object generated in the virtual space, or an action in which the second avatar presses a move button. etc.
  • the second avatar A2 corresponding to the second user U2 corresponds to the first user U1, and is the first ghost located at the coordinates where the correspondence relation with the coordinates of the first user U1 is deviated.
  • the action of touching G1 is taken as the first trigger event.
  • the first avatar A1 corresponding to the first user U1 contacts the second ghost G2 corresponding to the second user U2 and located at coordinates that are deviated from the coordinates of the second user U2. can also be adopted as the first trigger event.
  • the first trigger event in the present invention is not limited to such a configuration, and may be appropriately set by a system designer or the like.
  • the first trigger event may be generated by touching an object (eg, a movement switch, a call switch, etc.) generated in the virtual space.
  • the first trigger event may be generated when the avatar performs a specific action (eg, beckoning action).
  • the trigger event is the action of the avatar corresponding to one user touching the ghost corresponding to the other user.
  • the first trigger event in the present invention is not limited to such a configuration, and may be a predetermined action performed by the avatar corresponding to one user on the ghost corresponding to the other user. .
  • the "predetermined action” may be any action performed by the avatar based on the ghost.
  • the action in which the avatar contacts the ghost as in this embodiment, the action in which the avatar moves within a predetermined range based on the ghost, and when the avatar operates an object existing in the virtual space.
  • Another example is an operation of selecting a ghost as a target (for example, an operation of photographing a ghost with a camera-type object, etc.).
  • the ghost generated during the process of expanding the virtual space is used as a key for generating the trigger event.
  • the ghost in the present invention is not limited to such a configuration, and may be an avatar that corresponds to the user and does not serve as a reference for images and sounds recognized by the user.
  • an avatar that is independent of the avatar may be adopted as a ghost.
  • an avatar corresponding to a dance instructor an avatar corresponding to a student, and a miniature avatar corresponding to a student, which are present at the hands of the avatar corresponding to the instructor, are generated.
  • the miniature avatar may be employed as a ghost when the lecturer confirms the student's condition using the miniature avatar.
  • the instructor will be able to observe the student's condition from his/her own objective point of view and, if necessary, from the student's subjective point of view.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/JP2021/020889 2021-06-01 2021-06-01 仮想空間体感システム Ceased WO2022254585A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021575439A JP7055527B1 (ja) 2021-06-01 2021-06-01 仮想空間体感システム
PCT/JP2021/020889 WO2022254585A1 (ja) 2021-06-01 2021-06-01 仮想空間体感システム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/020889 WO2022254585A1 (ja) 2021-06-01 2021-06-01 仮想空間体感システム

Publications (1)

Publication Number Publication Date
WO2022254585A1 true WO2022254585A1 (ja) 2022-12-08

Family

ID=81289286

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/020889 Ceased WO2022254585A1 (ja) 2021-06-01 2021-06-01 仮想空間体感システム

Country Status (2)

Country Link
JP (1) JP7055527B1 (https=)
WO (1) WO2022254585A1 (https=)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019192178A (ja) * 2018-04-27 2019-10-31 株式会社コロプラ プログラム、情報処理装置、および方法
WO2021095175A1 (ja) * 2019-11-13 2021-05-20 株式会社Ａｂａｌ 仮想空間体感システム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019192178A (ja) * 2018-04-27 2019-10-31 株式会社コロプラ プログラム、情報処理装置、および方法
WO2021095175A1 (ja) * 2019-11-13 2021-05-20 株式会社Ａｂａｌ 仮想空間体感システム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Second Life Walking Handbook", vol. 51, 31 August 2007, SOTEC CO., LTD., JP, ISBN: 978-4-88166-592-3, article LYNE, JINN: "Passage; Handbook_How to walk in Second Life", pages: 44 - 45,51, XP009541803 *

Also Published As

Publication number Publication date
JPWO2022254585A1 (https=) 2022-12-08
JP7055527B1 (ja) 2022-04-18

Similar Documents

Publication Publication Date Title
US20240004458A1 (en) Massive simultaneous remote digital presence world
JP6936465B1 (ja) 仮想空間体感システム
JP2010253277A (ja) ビデオゲームにおいてオブジェクトの動きを制御する方法およびシステム
JP2010257461A (ja) ネットワークゲーム用の共有ゲーム空間を創出する方法およびシステム
JP7138392B1 (ja) 仮想空間体感システム
JP6538013B2 (ja) 仮想空間体感システム
JP7539006B1 (ja) 体感空間切替方法、体感空間切替システム、体感空間切替装置、並びに体感空間切替プログラム及びそれを記録した記録媒体
JP7055527B1 (ja) 仮想空間体感システム
JP6933850B1 (ja) 仮想空間体感システム
JP6538012B2 (ja) 仮想空間体感システム
WO2021240601A1 (ja) 仮想空間体感システム
JP6672508B2 (ja) 仮想空間体感システム
JPWO2022254585A5 (https=)

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2021575439

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21944089

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21944089

Country of ref document: EP

Kind code of ref document: A1