WO2023017890A1

WO2023017890A1 - Method for providing metaverse, apparatus for providing metaverse, and system for providing metaverse

Info

Publication number: WO2023017890A1
Application number: PCT/KR2021/011663
Authority: WO
Inventors: 문연국; 김민준; 김지은; 채승훈; 원광호
Original assignee: 한국전자기술연구원
Priority date: 2021-08-11
Filing date: 2021-08-31
Publication date: 2023-02-16
Also published as: KR20230024451A; KR102641519B1

Abstract

A method for providing a metaverse, according to one embodiment of the present invention, comprises: a) detecting the location of at least one user by using a camera in an experience space of an apparatus for providing a metaverse including the experience space provided by a plurality of displays; b) displaying metaverse content on at least one of the plurality of displays on the basis of the location of the user and metaverse content selected by the user; c) detecting the user's action by using a sensor closest to the location of the user from among a plurality of sensors; and d) displaying a user avatar synchronized with the user's action on a display corresponding to the closest sensor from among the plurality of displays.

Description

Metaverse providing method, metaverse providing device, and metaverse providing system

The present invention relates to a metaverse providing method, a metaverse providing device, and a metaverse providing system, and in detail, implements a metaverse that can be accessed in a mixed reality-based experience space, and a plurality of users or users in the same experience space A metaverse providing method, a metaverse providing device, and a metaverse providing system in which a plurality of users in different experience spaces can access and share the experience of metaverse contents, or a single user in the experience space can experience metaverse contents will be.

Recently, non-face-to-face environment-based activities have become popular due to the pandemic caused by COVID-19, but most of the consumable content is passive and the types are limited. In addition, most mixed reality-based experiences provide services using virtual reality devices such as HMDs (Head Mount Displays), but these virtual reality devices cause inconvenience to users when worn for a long time, and wear virtual reality devices. It is very difficult to have an active experience alone.

Patent Document 1 (Korean Patent Publication No. 10-2014-0036555), which is a prior art related to a metaverse client terminal and method for providing a metaverse space capable of interaction between users, is disclosed.

The metaverse space providing system disclosed in Patent Document 1 discloses a configuration in which, for example, a first user at home and a second user in an outdoor space share experiences through metaverse content displayed on a single flat-panel display, respectively. are doing In this prior art, since the metaverse contents such as the circumference and the Olle road experienced by each user are displayed on a single flat display provided for each real space, there is a limit to enhancing the reality of the provided metaverse. there is

(Patent Document 1) Korean Patent Publication No. 10-2014-0036555

An object of the present invention is to provide a metaverse providing method, a metaverse providing apparatus, and a metaverse providing system capable of enhancing the realism of the metaverse.

Another object of the present invention is a method for providing a metaverse, a device for providing a metaverse, and a method for providing an active experience by accessing the metaverse without a separate wearable device for access to virtual reality, such as a head mount display (HMD). It is to provide a metaverse provision system.

Another object of the present invention is to provide a metaverse providing method, a metaverse providing device, and a metaverse providing system capable of continuously expanding the number of metaverse contents provided in an experience space.

Another object of the present invention is not only to allow a single user in the experience space to experience metaverse content, but also to allow multiple users in the same experience space or multiple users in different experience spaces to access and share the experience of metaverse content. It is to provide a possible metaverse providing method, a metaverse providing device, and a metaverse providing system.

In order to achieve the above object, a metaverse providing method according to a first feature of an embodiment of the present invention a) using a camera in the experience space of a metaverse providing device including an experience space provided by a plurality of displays. Detecting the location of one or more users by doing; b) displaying the metaverse content on one or more displays of the plurality of displays based on the location of the user and the metaverse content selected by the user; c) detecting the user's action using a sensor closest to the user's location among a plurality of sensors; and d) displaying a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays.

In the metaverse providing method according to the first feature, step b) is performed in a state in which a first user among a plurality of users in the experience space selects a first metaverse content and a second user selects a second metaverse content. , displaying the first metaverse content on a display closest to the location of the first user among the plurality of displays, and displaying the second metaverse content on one or more displays among the remaining displays.

A method for providing a metaverse according to a second feature of an embodiment of the present invention is a) using a camera in each experience space of a plurality of metaverse providing devices each including a plurality of experience spaces provided by a plurality of displays. detecting the user's location; b) displaying the metaverse content on one or more displays among the plurality of displays based on the user's position in each experience space and the metaverse content selected by the user; c) sensing an action of the user by using a sensor closest to the user's location among a plurality of sensors in each of the experience spaces; and d) displaying a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays in each experience space.

In the metaverse providing method according to the second feature, in step d), the user of the first experience space of the first metaverse providing device and the second experience space of the second metaverse providing device among the plurality of metaverse providing devices. When the user of selects the same first metaverse content, on one or more displays among the plurality of displays of the first metaverse providing device and one or more displays among the plurality of displays of the second metaverse providing device, respectively, A user avatar synchronized with the user's behavior in the first experience space and a user avatar synchronized with the user's behavior in the second experience space may be simultaneously displayed.

A metaverse providing apparatus according to a third feature of an embodiment of the present invention includes a plurality of displays arranged to provide an experience space and displaying metaverse contents; a camera detecting a location of one or more users within the experience space; A plurality of sensors for detecting the user's behavior; And displaying the metaverse content on one or more displays of the plurality of displays based on the user's location and the metaverse content selected by the user, using a sensor closest to the user's location among the plurality of sensors A control unit for sensing the user's behavior and controlling the plurality of displays and the plurality of sensors to display a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays characterized by

A metaverse providing system according to a fourth aspect of an embodiment of the present invention includes a plurality of metaverse providing devices; And a server that transmits and receives information on one or more of metaverse contents and user avatars with the plurality of metaverse providing devices, wherein the plurality of metaverse providing devices are arranged to provide an experience space and display metaverse contents. display of; a camera detecting a location of one or more users within the experience space; A plurality of sensors for detecting the user's behavior; Based on the location of the user and the metaverse content selected by the user, the metaverse content is displayed on one or more displays among the plurality of displays, and the metaverse content is displayed using a sensor closest to the user's location among the plurality of sensors. a controller that senses a user's behavior and controls the plurality of displays and the plurality of sensors to display a user's avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays; and a communication unit that performs communication on one or more of the metaverse contents and the user avatar.

The following effects are achieved by using the metaverse providing method, the metaverse providing device, and the metaverse providing system according to an embodiment of the present invention.

1. It can increase the realism of the metaverse.

2. Active experiences can be performed by accessing the metaverse without a separate wearable device for access to virtual reality such as HMD (Head Mount Display).

3. The number of metaverse contents provided in the experience space can be continuously expanded.

4. Not only can a single user in the experience space experience metaverse content, but multiple users in the same experience space or multiple users in different experience spaces can access and share the experience of metaverse content.

Hereinafter, preferred embodiments of a metaverse providing method, a metaverse providing device, and a metaverse providing system according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a metaverse providing device according to an embodiment of the present invention.

2 is a schematic perspective view of a metaverse providing device for explaining an embodiment of a metaverse providing method according to an embodiment of the present invention.

3 is a schematic perspective view of a metaverse providing device for explaining another embodiment of a metaverse providing method according to an embodiment of the present invention.

4 is a flowchart of a metaverse providing method according to an embodiment of the present invention.

5 is a block diagram of a metaverse providing system according to an embodiment of the present invention.

6 is a schematic perspective view of a metaverse providing system for explaining an embodiment of a metaverse providing method according to a modified example of an embodiment of the present invention.

7 is a schematic perspective view of a metaverse providing system for explaining another embodiment of a metaverse providing method according to a modified example of an embodiment of the present invention.

8 is a flowchart of a metaverse providing method according to a modified example of an embodiment of the present invention.

1 is a block diagram of a metaverse providing device according to an embodiment of the present invention, and FIG. 2 is a schematic perspective view of a metaverse providing device for explaining an embodiment of a metaverse providing method according to an embodiment of the present invention. 3 is a schematic perspective view of a metaverse providing device for explaining another embodiment of a metaverse providing method according to an embodiment of the present invention. In this regard, the input unit 110, the control unit 150, the storage unit 160, the communication unit 170, the signal collection unit 180, and the driving unit 190 are shown in FIG. 1, but in FIGS. 2 and 3 not shown

Referring to Figures 1 to 3, the metaverse providing device 100 according to an embodiment of the present invention will be described.

The metaverse providing device 100 includes a plurality of displays 121 to 123, a camera 130, a plurality of sensors 141 to 149, and a controller 150. In addition, the metaverse providing device 100 may further include one or more of an input unit 110, a storage unit 160, a communication unit 170, a signal collection unit 180, and a driving unit 190.

The plurality of displays 121 to 123 are arranged to provide an experience space (S) and are components that display metaverse contents.

In this specification, “a plurality of displays 121 to 123 provide the experience space S” means “a plurality of displays 121 to 123 are provided on 75% or more of the sides of the total side of the experience space S” " can mean For example, referring to FIGS. 2 and 3 , when the experience space S has four sides, it may mean that a plurality of displays 121 to 123 are provided on three or more side surfaces. Of course, the plurality of displays 121 to 123 may be further provided on one or more of the ceiling surface and the floor surface of the experience space S as well as the side surface. In this specification, “a plurality of displays 121 to 123 provide an experience space S” may be expressed as “a plurality of displays 121 to 123 surround the experience space S”.

The camera 130 is a component that detects the location of one or more users U1 to U3 in the experience space S.

The plurality of sensors 141 to 149 are components that detect actions of the users U1 to U3. For example, the plurality of sensors 141 to 149 may be arranged along the plurality of displays 121 to 123 . For example, a configuration in which "a plurality of sensors 141 to 149 are disposed along a plurality of displays 121 to 123" is i) a plurality of sensors 141 to 149 are disposed on top of a plurality of displays 121 to 123. ii) a configuration in which a plurality of sensors 141 to 149 are disposed in front of a plurality of displays 121 to 123 (screen or extended surface of a screen), and iii) a plurality of sensors (141 ~ 149) may include one or more of the configurations arranged on the surface of the plurality of displays (121 ~ 123) side of the bottom surface of the experience space (S).

For example, each of the plurality of sensors 141 to 149 may include one or more of a gaze sensor, a motion sensor, a gesture sensor, a voice sensor, and a touch sensor.

The gaze sensor may detect the gaze of the users U1 to U3, and may be implemented as, for example, Tobii Inc.'s gaze sensor.

The motion sensors may detect motions of the users U1 to U3, and the gesture sensors may detect gestures of the users U1 to U3. In this specification, a “gesture” is a smaller movement than a “motion”. For example, a “action” is a relatively large movement, such as moving an “arm,” and a “gesture” is a relatively small movement, such as moving a “hand” while the “arm” is substantially stationary. The gesture sensor may be implemented as, for example, a gesture sensor of Leap Motion, Inc., and the motion sensor may be implemented as, for example, NUITRACK SDK of 3DiVi Inc. In addition, the motion sensors may be implemented as receivers that receive signals transmitted from the RFID tags or IMUs (Inertial Measurement Units) when the users U1 to U3 are wearing them. In addition, the motion sensor may be implemented as a pressure sensor installed on the floor of the experience space S to detect foot motions of the users U1 to U3.

The voice sensor may detect the voice of the users U1 to U3 and may be implemented as a microphone, for example. Also, the voice sensor may be implemented as a speech-to-text (STT) sensor.

The touch sensors may detect touches of the users U1 to U3, and may be implemented as, for example, a touch screen panel display in which touch sensors are provided on the screens of the displays 121 to 123.

The control unit 150 displays the metaverse content on one or more displays 121 to 123 among the plurality of displays 121 to 123 based on the location of the user U1 to U3 and the metaverse content selected by the user U1 to U3. A plurality of displays 121 to 123 are controlled to display. In addition, the control unit 150 uses a plurality of sensors 141 to 149 closest to the position of the users U1 to U3 among the plurality of sensors 141 to 149 to detect the behavior of the users U1 to U3. Control (141~149). In addition, the controller 150 displays the user U1 to U3 on the displays 121 to 123 corresponding to the sensors 141 to 149 closest to the position of the user U1 to U3 among the plurality of displays 121 to 123. The plurality of displays 121 to 123 are controlled to display the user avatars A1 to A3 synchronized with the action.

The input unit 110 is a component that receives selection signals of users U1 to U3 for metaverse content and user avatars A1 to A3 and images of users U1 to U3. The input unit 110 may be implemented by, for example, a touch screen panel and a camera disposed outside the experience space (S). In this case, the users U1 to U3 may select metaverse contents and user avatars A1 to A3 through the touch screen panel of the input unit 110 . Also, the users U1 to U3 may input images of the users U1 to U3 through the camera of the input unit 110 . In addition, the input unit 110 may be implemented by a portable terminal capable of communicating with the communication unit 170 of the metaverse providing device 100.

The storage unit 160 is a component in which information on metaverse contents and user avatars (A1 to A3) is stored. Information on these metaverse contents and user avatars (A1 to A3) may be pre-stored in the storage unit 160, or may be received from the server 200 shown in FIG. 5 and stored in the storage unit 160. there is.

The communication unit 170 is a component that communicates information about one or more of metaverse contents and user avatars A1 to A3. For example, the communication unit 170 may transmit/receive information about one or more of metaverse contents and user avatars A1 to A3 with the server 200 shown in FIG. 5 .

The signal collector 180 may collect the first signal received from the camera 130 and the second signal received from the plurality of sensors 141 to 149 . The signal collection unit 180 may transfer the collected first and second signals to the control unit 150 .

The driving unit 190 may activate the sensors 141 to 149 closest to the position of the user U1 to U3 among the plurality of sensors 141 to 149 according to a control signal from the control unit 150 . According to this activation, the sensors 141 to 149 closest to the location of the users U1 to U3 may detect the actions of the users U1 to U3.

Referring to FIG. 4 together with FIGS. 1 to 3, a metaverse providing method according to an embodiment of the present invention will be described.

In step 310, the camera 130 detects the location of one or more users U1 to U3 in the experience space S provided by the plurality of displays 121 to 123.

For example, before step 310, the input unit 110 receives a selection signal of the user U1 to U3 for the metaverse content and the user avatar A1 to A3 and the image of the user U1 to U3. steps can be performed.

In step 320, the control unit 150 displays one or more displays 121 to 123 among the plurality of displays 121 to 123 based on the location of the users U1 to U3 and the metaverse content selected by the users U1 to U3. A plurality of displays 121 to 123 are controlled to display metaverse contents.

For example, referring to FIG. 2 , the control unit 150, when all users U1 to U3 in the experience space S are in a state in which, for example, the first metaverse content related to “marathon” is selected, a plurality of The plurality of displays 121 to 123 may be controlled to display the first metaverse content on the displays 121 to 123 of the above.

For example, referring to FIG. 3 , the controller 150 determines that a first user U1 among a plurality of users U1 to U3 in the experience space S, for example, a first metaverse related to “marathon”. When content is selected and the second user U2 is in a state of selecting, for example, the second metaverse content related to "dance", the position closest to the position of the first user U1 among the plurality of displays 121 to 123 Control the plurality of displays 121 to 123 to display the first metaverse content on the display 121 and display the second metaverse content on one or

more displays

122 and 123 among the remaining

displays

122 and 123. can Here, the "first user" may be "the user U1 having the highest priority among the plurality of users U1 to U3 in the experience space S", but is not limited thereto, and any two users A user with a higher priority may be a "first user" and a user with a lower priority may be a "second user". Also, “the display closest to the location of the first user U1” may be one display, but is not limited thereto, and may be two or more displays.

In step 330, the controller 150 detects the action of the user U1 to U3 using the sensor 141 to 149 closest to the position of the user U1 to U3 among the plurality of sensors 141 to 149. Controls the sensors 141 to 149 of For example, the sensors 141 to 149 closest to the location of the users U1 to U3 are based on the metaverse content selected by the users U1 to U3, based on the gaze, motion, gesture, and voice of the users U1 to U3. At least one of , , and touch may be sensed.

For example, referring to FIG. 2 , when the metaverse content selected by the users U1 to U3 is “marathon,” the

sensors

142, 145, and 148 closest to the location of the users U1 to U3 are motion can be detected. In addition, although not specifically shown in FIG. 2, when the metaverse content selected by the users (U1 to U3) is "Go game", the sensors closest to the location of the users (U1 to U3) (142, 145, 148; For example, the

displays

121, 122, and 123 disposed on screens) may detect a user's touch.

In step 340, the controller 150 selects the user (U1 to U3) on the displays (121 to 123) corresponding to the sensors (141 to 149) closest to the position of the user (U1 to U3) among the plurality of displays (121 to 123). The plurality of displays 121 to 123 are controlled to display the user avatars A1 to A3 synchronized with the behavior of the user. For example, referring to FIG. 2 , the controller 150 displays the first user U1's action on the first display 121 corresponding to the second sensor 142 closest to the position of the first user U1. Controls the first display 121 to display the first user avatar A1 synchronized with the second user U2, and displays the second display 122 corresponding to the fifth sensor 145 closest to the position of the second user U2. The second display 122 is controlled to display the second user avatar A2 synchronized with the behavior of the second user U2 and corresponds to the eighth sensor 148 closest to the position of the third user U3. The third display 123 may be controlled to display the third user U3's avatar A3 synchronized with the behavior of the third user U3 on the third display 123.

In addition, in step 340, the controller 150 selects the sensors 141 to 149 closest to the position of the users U1 to U3 among the entire areas of the displays 121 to 123 corresponding to the sensors 141 to 149. The plurality of displays 121 to 123 may be controlled to display the user avatars A1 to A3 synchronized with the actions of the users U1 to U3 in the area corresponding to . For example, referring to FIG. 2 , the controller 150 controls the second sensor 142 of the entire area of the first display 121 corresponding to the second sensor 142 closest to the position of the first user U1. The first display 121 is controlled to display the first user avatar A1 synchronized with the behavior of the first user U1 in the central area corresponding to ), and the first display 121 closest to the location of the second user U2 is controlled. The second user U2's avatar A2 synchronized with the behavior of the second user U2 is displayed in the central area corresponding to the fifth sensor 145 among the entire area of the second display 122 corresponding to the fifth sensor 145. of the entire area of the third display 123 corresponding to the eighth sensor 148 closest to the position of the third user U3, corresponding to the eighth sensor 148. The third display 123 may be controlled to display the third user U3's avatar A3 synchronized with the behavior of the third user U3 in the central area.

According to a first feature of an embodiment of the present invention, a method for providing a metaverse is a) using a camera 130 in an experience space S provided by a plurality of displays 121 to 123 and one or more users U1 to U3. ) Detecting the location (310); b) The metaverse content is displayed on one or more displays 121 to 123 among the plurality of displays 121 to 123 based on the location of the users U1 to U3 and the metaverse content selected by the users U1 to U3. Displaying (320); c) sensing an action of the user U1 to U3 using a sensor 141 to 149 closest to the position of the user U1 to U3 among the plurality of sensors 141 to 149 (330); and d) user avatars (A1 to A3) synchronized with the actions of the users (U1 to U3) on the displays (121 to 123) corresponding to the closest sensors (141 to 149) among the plurality of displays (121 to 123). ) It is characterized in that it comprises a step 340 of displaying. Accordingly, compared to the prior art in which metaverse contents are displayed on a single flat display provided for each real space, the sense of reality of the metaverse can be enhanced. In addition, an active experience can be performed by accessing the metaverse without a separate wearable device for accessing virtual reality such as an HMD. In addition, a plurality of users (U1 to U3) in the experience space (S) can access the metaverse providing device 100 and share the experience of metaverse contents.

In addition, in step b), the first user U1 among the plurality of users U1 to U3 in the experience space S selects the first metaverse content and the second user U2 selects the second metaverse content. When the content is selected, the first metaverse content is displayed on the display 121 closest to the position of the first user U1 among the plurality of displays 121 to 123, and the

other displays

122 and 123 By including the step of displaying the second metaverse content on one or more of the

displays

122 and 123, it is possible to continuously expand the number of metaverse contents provided in the experience space (S).

5 is a block diagram of a metaverse providing system according to an embodiment of the present invention, and FIG. 6 is a metaverse providing system for explaining an embodiment of a metaverse providing method according to a modified example of an embodiment of the present invention. 7 is a schematic perspective view of a metaverse providing system for explaining another embodiment of a metaverse providing method according to a modification of an embodiment of the present invention. In this regard, the

input units

110a and 110b, the

control units

150a and 150b, the

storage units

160a and 160b, the communication units 170a and 170b, the

signal collection units

180a and 180b, and the driving

units

190a and 190b 5, but not shown in FIGS. 6 and 7.

Referring to FIGS. 5 to 7 , the metaverse providing system 1000 according to an embodiment of the present invention will be described as follows.

The metaverse providing system 1000 includes a plurality of

metaverse providing devices

100A and 100B and a server 200 .

Each of the plurality of

metaverse providing devices

100A and 100B includes a plurality of displays 121a to 123a and 121b to 123b,

cameras

130a and 130b, a plurality of sensors 141a to 149a and 141b to 149b, and a controller 150a. , 150b), and communication units 170a and 170b. In addition, each of the plurality of metaverse providing devices 100A and 100b includes one or more of

input units

110a and 110b,

storage units

160a and 160b,

signal collection units

180a and 180b, and driving

units

190a and 190b. may further include.

The server 200 is a component that transmits and receives information on one or more of metaverse contents and user avatars A11, A12, A13, A21, and A22 to and from a plurality of

metaverse providing devices

100A and 100B. The server 200 may include a server storage unit 210, a server communication unit 220, and a server control unit 230.

The server storage unit 210 is a component that stores information on one or more of metaverse contents and user avatars A11, A12, A13, A21, and A22. One or more of these metaverse content and user avatars (A11, A12, A13, A21, A22) is metaverse content and user avatars (A11, A12, A13 , A21, A22), or one or more of metaverse contents and user avatars A11, A12, A13, A21, A22 received from a plurality of metaverse providing devices 100A, 100b. there is.

The server communication unit 220 communicates information about one or more of the metaverse contents and user avatars A11, A12, A13, A21, and A22 with the communication units 170a and 170b of the plurality of

metaverse providing devices

100A and 100B. It is a component to perform.

The server control unit 230 transmits one or more information of metaverse content and user avatars (A11, A12, A13, A21, A22) according to the metaverse content selected from the plurality of

metaverse providing devices

100A and 100B to a plurality of metaverses. The server communication unit 220 and the server storage unit 210 may be controlled to transmit and receive data to and from the

bus providing devices

100A and 100B.

Referring to FIG. 8 together with FIGS. 5 to 7, a metaverse providing method according to a modified example of an embodiment of the present invention will be described.

In step 410, each experience space of a plurality of

metaverse providing devices

100A and 100B including a plurality of experience spaces S1 and S2 provided by a plurality of displays 121a to 123a and 121b to 123b, respectively. In (S1 and S2), the

cameras

130a and 130b detect the location of one or more users U11 to U13 and U21 to U22.

For example, prior to step 410, the

input units

110a and 110b input metaverse contents and user avatars A11 to A13 for each experience space S1 and S2 of the plurality of

metaverse providing devices

100A and 100B. , A step of receiving a selection signal of the user (U11 to U13, U21 to U22) for A21 to A22 and the user's image (U11 to U13, U21 to U22) may be input.

In step 420, in each of the experience spaces S1 and S2 of the plurality of

metaverse providing devices

100A and 100B, the

controllers

150a and 150b determine the location of the users U11 to U13 and U21 to U22 and the user U11 A plurality of displays to display the metaverse content on one or more displays 121a to 123a and 121b to 123b among the plurality of displays 121a to 123a and 121b to 123b based on the metaverse content selected by ~ U13 and U21 to U22. (121a to 123a, 121b to 123b) are controlled.

In step 430, in each of the experience spaces S1 and S2 of the plurality of

metaverse providing devices

100A and 100B, the

control units

150a and 150b select the user U11 among the plurality of sensors 141a to 149a and 141b to 149b. A plurality of sensors 141a to 149a and 141b to detect the actions of the users U11 to U13 and U21 to U22 using the sensors 141a to 149a and 141b to 149b closest to the positions of the ~U13 and U21 to U22. 149b). For example, with respect to each experience space (S1, S2) of the plurality of metaverse providing devices (100A, 100B), the closest sensors (141a to 149a, 141b to 149b) can detect one or more of the gaze, motion, gesture, voice, and touch of the user (U11 to U13, U21 to U22) based on the metaverse content selected by the user (U11 to U13, U21 to U22). can

In step 440, in each of the experience spaces S1 and S2 of the plurality of

metaverse providing devices

100A and 100B, the

control units

150a and 150b display the user U11 among the plurality of displays 121a to 123a and 121b to 123b. Synchronization with the actions of the users (U11 to U13, U21 to U22) on the displays (121a to 123a, 121b to 123b) corresponding to the sensors (141a to 149a, 141b to 149b) closest to the positions of ~U13 and U21 to U22 The plurality of displays 121a to 123a and 121b to 123b are controlled to display the user avatars A11 to A13 and A21 to A22.

For example, referring to FIG. 6 together with FIG. 5 , between the first experience space S1 of the first metaverse providing device 100A and the second experience space S2 of the second metaverse providing device 100B When there are no users (U11 to U13, U21 to U22) who have selected the same metaverse content, control of user avatars (A11 to A13) synchronized with the actions of the users (U11 to U13) in the first experience space (S1). 2 The display of the displays 121b to 123b of the metaverse providing device 100B is stopped, and the user avatars A21 to A22 synchronized with the actions of the users U21 to U22 in the second experience space S2 are displayed. 1 Display on the displays 121a to 121b of the metaverse providing device 100A may be stopped. Such processing is, for example, performed by the server 200 between the first experience space S1 of the first metaverse providing device 100A and the second experience space S2 of the second metaverse providing device 100B. When there are no users (U11 to U13, U21 to U22) who have selected the same metaverse content, the user avatars (A11 to A13) synchronized with the behavior of the users (U11 to U13) in the first experience space (S1) Transmission of information to the second metaverse providing device 100B, and provision of the first metaverse of information about the user avatars A21 to A22 synchronized with the actions of the users U21 to U22 in the second experience space S2 This can be done by stopping the transmission to device 100A.

For example, referring to FIG. 7 together with FIG. 5 , the user U12 and the user U12 of the first experience space S1 of the first metaverse providing device 100A among the plurality of metaverse providing devices 100A and 100B. 2 When the user U21 of the second experience space S2 of the metaverse providing device 100B selects the same first metaverse content (“dance” in FIG. 7 ), the first metaverse providing device On one or

more displays

122a, 123a of the plurality of displays 121a to 123a of 100A and one or more displays 121b to 123b of the plurality of displays 121b to 123b of the second metaverse providing device 100B , A user avatar A12 synchronized with the behavior of the user U12 in the first experience space S1 and a user avatar A21 synchronized with the behavior of the user U21 in the second experience space S2 are simultaneously displayed. can be displayed This processing is performed by, for example, the server 200, the user U12 and the user U12 of the first experience space S1 of the first metaverse providing device 100A among the plurality of metaverse providing devices 100A and 100B. 2 When the user U21 of the second experience space S2 of the metaverse providing device 100B selects the same first metaverse content, synchronization with the behavior of the user U12 of the first experience space S1 transmission of information on the user avatar A12 that has been created to the second metaverse providing device 100B, and provision of information on the user U21 synchronized with the behavior of the user U21 in the second experience space S2 1 It can be done by performing transmission to the metaverse providing device (100A).

According to a second feature of an embodiment of the present invention, a metaverse providing method includes a) a plurality of experience spaces S1 and S2 each of which is provided by a plurality of displays 121a to 123a and 121b to 123b. Detecting the location of one or more users (U11 to U13, U21 to U22) using the

cameras

130a and 130b in each of the experience spaces S1 and S2 of the

metaverse providing devices

100A and 100B (410) ; b) The plurality of displays based on the location of the users (U11 to U13 and U21 to U22) in each of the experience spaces (S1 and S2) and the metaverse content selected by the users (U11 to U13 and U21 to U22). Displaying the metaverse content on one or more displays 121a to 123a and 121b to 123b of (121a to 123a and 121b to 123b) (420); c) Among the plurality of sensors 141a to 149a and 141b to 149b in each of the experience spaces S1 and S2, the sensors 141a to 149a and 141b to the closest to the position of the user U11 to U13 and U21 to U22 149b) detecting the behavior of the users (U11 to U13 and U21 to U22) (430); and d) displays 121a to 123a corresponding to the closest sensors 141a to 149a and 141b to 149b among the plurality of displays 121a to 123a and 121b to 123b in each of the experience spaces S1 and S2, 121b to 123b) displaying user avatars A11 to A13 and A21 to A22 synchronized with the behaviors of the users U11 to U13 and U21 to U22 (440). Accordingly, compared to the prior art in which metaverse contents are displayed on a single flat display provided for each real space, the sense of reality of the metaverse can be enhanced. In addition, an active experience can be performed by accessing the metaverse without a separate wearable device for accessing virtual reality such as an HMD.

In addition, in step d), the user U12 and the second metaverse providing device of the first experience space S1 of the first metaverse providing device 100A among the plurality of

metaverse providing devices

100A and 100B When the user U21 of the second experience space S2 of 100B is in a state in which the same first metaverse content is selected, one of the plurality of displays 121a to 123a of the first metaverse providing device 100A. On one or more displays 121b to 123b among the plurality of displays 122a to 123a and the plurality of displays 121b to 123b of the second metaverse providing device 100B, respectively, the user of the first experience space S1 By simultaneously displaying the user avatar A12 synchronized with the behavior of U12 and the user avatar A21 synchronized with the behavior of the user U21 in the second experience space S2, the experience spaces S1 and S2 are different from each other. ) A plurality of users (U12, U21) in can access and share the experience of metaverse content.

Although the present invention has been shown and described with reference to the preferred embodiments of the accompanying exemplary drawings, it is not limited thereto, and those skilled in the art to which the present invention pertains within the scope of the technical idea of the present invention described in the claims below. Of course, it can be implemented in various forms.

Claims

In the metaverse providing method,

a) detecting a location of one or more users by using a camera in the experience space of a metaverse providing device including an experience space provided by a plurality of displays;

b) displaying the metaverse content on one or more displays of the plurality of displays based on the location of the user and the metaverse content selected by the user;

c) detecting the user's action using a sensor closest to the user's location among a plurality of sensors; and

d) displaying a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays;

A metaverse providing method comprising a.
The method of claim 1, wherein step b) comprises: when a first user among a plurality of users in the experience space selects a first metaverse content and a second user selects a second metaverse content, the plurality of Displaying the first metaverse content on a display closest to the location of the first user among the displays, and displaying the second metaverse content on one or more of the remaining displays.
The method of claim 1, before the step a), a1) receiving the user's selection signal for the metaverse content and the user avatar and the user's image through an input unit of the metaverse providing device. A metaverse providing method comprising:
The method of claim 1, wherein in step c), the closest sensor detects one or more of the user's gaze, motion, gesture, voice, and touch based on the metaverse content selected by the user. How to provide the metaverse.
The method of claim 1, wherein in step b), when all users in the experience space are in a state in which the first metaverse content is selected, the first metaverse content is displayed on the plurality of displays. How to provide.
In the metaverse providing method,

a) detecting a location of one or more users using a camera in each experience space of a plurality of metaverse providing devices, each of which includes a plurality of experience spaces provided by a plurality of displays;

b) displaying the metaverse content on one or more displays among the plurality of displays based on the user's position in each experience space and the metaverse content selected by the user;

c) sensing an action of the user by using a sensor closest to the user's location among a plurality of sensors in each of the experience spaces; and

d) displaying a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays in each experience space;

A metaverse providing method comprising a.
The method of claim 6, wherein in step d), a user of a first experience space of a first metaverse providing device and a user of a second experience space of a second metaverse providing device are the same among the plurality of metaverse providing devices. When 1 metaverse content is selected, on one or more displays among the plurality of displays of the first metaverse providing device and one or more displays among the plurality of displays of the second metaverse providing device, respectively, the first experience space A method for providing a metaverse, characterized in that simultaneously displaying a user avatar synchronized with a user's behavior and a user avatar synchronized with a user's behavior in the second experience space.
The method of claim 6, before the step a), a1) in each input unit of the plurality of metaverse providing devices, for each of the plurality of experience spaces, the metaverse content and the user for the user avatar A method for providing a metaverse, characterized in that it further comprises receiving a selection signal of and the user's image.
The method of claim 6, in the step c), the closest sensor is determined based on the metaverse content selected by the user for each of the experience spaces of the plurality of metaverse providing devices. A metaverse providing method characterized by detecting one or more of gestures, voices, and touches.
In the metaverse providing device,

A plurality of displays arranged to provide an experience space and displaying metaverse contents;

a camera detecting a location of one or more users within the experience space;

A plurality of sensors for detecting the user's behavior; and

Based on the location of the user and the metaverse content selected by the user, the metaverse content is displayed on one or more displays among the plurality of displays, and the metaverse content is displayed using a sensor closest to the user's location among the plurality of sensors. A control unit that detects a user's behavior and controls the plurality of displays and the plurality of sensors to display a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays.

Metaverse providing device comprising a.
11. The apparatus for providing a metaverse according to claim 10, further comprising a communication unit that communicates information about one or more of the metaverse contents and the user avatar.
In the metaverse providing system,

A plurality of metaverse providing devices; and

A server that transmits and receives one or more of metaverse contents and user avatars to and from the plurality of metaverse providing devices,

The plurality of metaverse providing devices are each implemented as the metaverse providing device according to claim 11, characterized in that the metaverse providing system.