KR102641519B1 - Method, apparatus, and system for providing metaverse - Google Patents

Abstract

A method for providing a metaverse according to an embodiment of the present invention includes the steps of: a) detecting the location of one or more users using a camera in the experience space of a metaverse providing device including an experience space provided by a plurality of displays; b) displaying the metaverse content on one or more of the plurality of displays based on the user's location and the metaverse content selected by the user; c) detecting the user's behavior using the sensor closest to the user's location among a plurality of sensors; and d) displaying a user avatar synchronized with the user's actions on a display corresponding to the closest sensor among the plurality of displays.

Description

Method for providing metaverse, apparatus for providing metaverse, and system for providing metaverse {Method, apparatus, and system for providing metaverse}

The present invention relates to a metaverse providing method, a metaverse providing device, and a metaverse providing system. In detail, the present invention relates to a metaverse providing a metaverse that can be accessed in a mixed reality-based experience space, and to implement a metaverse that can be accessed by a plurality of users or users in the same experience space. Metaverse provision method, metaverse provision device, and metaverse provision system in which multiple users within different experience spaces can connect and share the experience of metaverse content, or a single user within the experience space can experience metaverse content will be.

Recently, activities based on non-face-to-face environments have become popular due to the pandemic caused by COVID-19, but most consumable content is in a passive form and the types are limited. In addition, most mixed reality-based experiences provide services using virtual reality devices such as HMD (Head Mounted Display), but these virtual reality devices cause discomfort to users when worn for long periods of time. It is very difficult to have an active experience while staying alone.

Patent Document 1 (Korean Patent Publication No. 10-2014-0036555), which is a prior art regarding a metaverse client terminal and method for providing a metaverse space where interaction between users is possible, is disclosed.

The metaverse space provision system disclosed in Patent Document 1, for example, discloses a configuration in which a first user at home and a second user in an outdoor space share an experience through metaverse content displayed on a single flat display. I'm doing it. In this prior art, metaverse content such as Dulle-gil and Olle-gil experienced by each user is displayed on a single flat display provided in each actual space, which is a problem in that there is a limit to enhancing the realism of the metaverse provided. There is.

Korean Patent Publication No. 10-2014-0036555

The purpose of the present invention is to provide a metaverse providing method, a metaverse providing device, and a metaverse providing system that can enhance the realism of the metaverse.

Another object of the present invention is to provide a metaverse providing method, a metaverse providing device, and The purpose is to provide a metaverse provision system.

Another object of the present invention is to provide a metaverse providing method, a metaverse providing device, and a metaverse providing system that can continue to expand the number of metaverse contents provided in an experience space.

Another purpose of the present invention is to enable not only a single user within an experience space to experience metaverse content, but also to allow multiple users within the same experience space or multiple users within different experience spaces to connect and share the experience of metaverse content. The goal is to provide a metaverse provision method, a metaverse provision device, and a metaverse provision system.

In order to achieve the above object, the metaverse providing method according to the first feature of the embodiment of the present invention a) uses a camera in the experience space of the metaverse providing device including the experience space provided by a plurality of displays. detecting the location of one or more users; b) displaying the metaverse content on one or more of the plurality of displays based on the user's location and the metaverse content selected by the user; c) detecting the user's behavior using the sensor closest to the user's location among a plurality of sensors; and d) displaying a user avatar synchronized with the user's actions on a display corresponding to the closest sensor among the plurality of displays.

In the metaverse providing method according to the first feature, step b) is a state in which a first user among a plurality of users in the experience space selects the first metaverse content and the second user selects the second metaverse content. In this case, displaying the first metaverse content on one of the plurality of displays closest to the location of the first user and displaying the second metaverse content on one or more of the remaining displays.

The metaverse providing method according to the second feature of the embodiment of the present invention is a) using a camera in each experience space of a plurality of metaverse providing devices, each of which includes a plurality of experience spaces provided by a plurality of displays. Detecting the user's location; b) displaying the metaverse content on one or more of the plurality of displays based on the user's location in each experience space and the metaverse content selected by the user; c) detecting the user's behavior using the sensor closest to the user's location among a plurality of sensors in each experience space; and d) displaying a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays in each experience space.

The metaverse providing method according to the second feature includes, in step d), a user in the first experience space of the first metaverse providing device among the plurality of metaverse providing devices and the second experience space of the second metaverse providing device. When the user selects the same first metaverse content, on one or more displays among the plurality of displays of the first metaverse providing device and one or more displays among the plurality of displays of the second metaverse providing device, respectively, A user avatar synchronized with the user's behavior in the first experience space and a user avatar synchronized with the user's behavior in the second experience space may be displayed at the same time.

A metaverse providing device according to a third aspect of an embodiment of the present invention includes a plurality of displays arranged to provide an experience space and displaying metaverse content; a camera that detects the location of one or more users within the experience space; A plurality of sensors that detect the user's actions; and displaying the metaverse content on one or more of the plurality of displays based on the user's location and the metaverse content selected by the user, using the sensor closest to the user's location among the plurality of sensors. A control unit that detects the user's behavior and controls the plurality of displays and the plurality of sensors to display a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays. It is characterized by

The metaverse providing system according to the fourth feature of the embodiment of the present invention includes a plurality of metaverse providing devices; and a server that transmits and receives information of one or more of metaverse content and user avatars with the plurality of metaverse providing devices, wherein the plurality of metaverse providing devices are each arranged to provide an experience space and display metaverse content. display of; a camera that detects the location of one or more users within the experience space; A plurality of sensors that detect the user's actions; Displaying the metaverse content on one or more of the plurality of displays based on the user's location and the metaverse content selected by the user, and using the sensor closest to the user's location among the plurality of sensors a control unit that detects a user's behavior and controls the plurality of displays and the plurality of sensors to display a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays; and a communication unit that performs communication regarding one or more of the metaverse content and the user avatar.

The following effects are achieved by using the metaverse providing method, metaverse providing device, and metaverse providing system according to the embodiment of the present invention.

1. It can increase the realism of the metaverse.

2. You can access the metaverse and have an active experience without a separate wearable device to access virtual reality, such as a Head Mount Display (HMD).

3. The number of metaverse contents provided within the experience space can continue to expand.

4. Not only can a single user within an experience space experience metaverse content, but multiple users within the same experience space or multiple users within different experience spaces can connect and share the experience of metaverse content.

Hereinafter, preferred embodiments of the metaverse providing method, metaverse providing device, and metaverse providing system according to the present invention will be described in detail with reference to the attached drawings.
Figure 1 is a block diagram of a metaverse providing device according to an embodiment of the present invention.
Figure 2 is a schematic perspective view of a metaverse providing device for explaining an example of a metaverse providing method according to an embodiment of the present invention.
Figure 3 is a schematic perspective view of a metaverse providing device for explaining another example of a metaverse providing method according to an embodiment of the present invention.
Figure 4 is a flowchart of a metaverse provision method according to an embodiment of the present invention.
Figure 5 is a block diagram of a metaverse providing system according to an embodiment of the present invention.
Figure 6 is a schematic perspective view of a metaverse providing system for explaining an example of a metaverse providing method according to a modified example of an embodiment of the present invention.
Figure 7 is a schematic perspective view of a metaverse providing system for explaining another example of a metaverse providing method according to a modified example of an embodiment of the present invention.
Figure 8 is a flowchart of a method for providing a metaverse according to a modified example of an embodiment of the present invention.

Hereinafter, preferred embodiments of the metaverse providing method, metaverse providing device, and metaverse providing system according to the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a block diagram of a metaverse providing device according to an embodiment of the present invention, and Figure 2 is a schematic perspective view of a metaverse providing device for explaining an embodiment of a metaverse providing method according to an embodiment of the present invention. , and FIG. 3 is a schematic perspective view of a metaverse providing device for explaining another example of a metaverse providing method according to an embodiment of the present invention. In this regard, the input unit 110, the control unit 150, the storage unit 160, the communication unit 170, the signal collection unit 180, and the driver 190 are shown in Figure 1, but are shown in Figures 2 and 3. Not shown.

Figure 4 is a flowchart of a metaverse provision method according to an embodiment of the present invention.

With reference to FIGS. 1 to 3, the metaverse providing device 100 according to an embodiment of the present invention will be described as follows.

The metaverse providing device 100 includes a plurality of displays 121 to 123, a camera 130, a plurality of sensors 141 to 149, and a control unit 150. Additionally, the metaverse providing device 100 may further include one or more of an input unit 110, a storage unit 160, a communication unit 170, a signal collection unit 180, and a driver 190.

The plurality of displays 121 to 123 are arranged to provide an experience space (S) and are components that display metaverse content.

In this specification, “a plurality of displays 121 to 123 provide the experience space (S)” means “a plurality of displays 121 to 123 are provided on more than 75% of the total sides of the experience space (S).” "It can mean. For example, referring to FIGS. 2 and 3 , if the experience space S has four sides, this may mean that a plurality of displays 121 to 123 are provided on three or more sides. Of course, the plurality of displays 121 to 123 may be further provided not only on the sides but also on one or more of the ceiling and floor surfaces of the experience space S. In this specification, “a plurality of displays 121 to 123 provide an experience space (S)” may be expressed as “a plurality of displays 121 to 123 surround the experience space (S).”

The camera 130 is a component that detects the location of one or more users (U1 to U3) within the experience space (S).

The plurality of sensors 141 to 149 are components that detect the actions of users (U1 to U3). For example, a plurality of sensors 141 to 149 may be arranged along a plurality of displays 121 to 123. For example, a configuration in which “a plurality of sensors 141 to 149 are disposed along a plurality of displays 121 to 123” means that i) the plurality of sensors 141 to 149 are placed on top of the plurality of displays 121 to 123. A configuration arranged in, ii) a configuration in which a plurality of sensors 141 to 149 are disposed on the front side (screen or extension of the screen) of a plurality of displays 121 to 123, and iii) a plurality of sensors (141 to 149) may include one or more of the configurations disposed on the floor surface of the experience space (S) on the side of the plurality of displays (121 to 123).

For example, each of the plurality of sensors 141 to 149 may include one or more of a gaze sensor, a motion sensor, a gesture sensor, a voice sensor, and a touch sensor.

The gaze sensor can detect the gaze of the user (U1 to U3) and can be implemented, for example, as a gaze sensor from Tobii Inc.

The motion sensor can detect the movements of users (U1 to U3), and the gesture sensor can detect the gestures of users (U1 to U3). In this specification, a “gesture” is a smaller movement than an “action.” For example, a “motion” is a relatively large movement, such as moving an “arm,” and a “gesture” is a relatively small movement, such as moving a “hand” while the “arm” is substantially stationary. The gesture sensor may be implemented, for example, with a gesture sensor from Leap Motion, Inc., and the motion sensor may be implemented with, for example, the NUITRACK SDK from 3DiVi Inc. Additionally, the motion sensor may be implemented as a receiver that receives signals transmitted from users (U1 to U3) when they are wearing RFID tags or IMUs (Inertial Measurement Units). Additionally, the motion sensor may be implemented as a pressure sensor installed on the floor of the experience space (S) to detect the foot motion of the users (U1 to U3).

The voice sensor can detect the voices of users (U1 to U3) and, for example, can be implemented as a microphone. Additionally, the voice sensor may be implemented as a Speech-To-Text (STT) sensor.

The touch sensor can detect the touch of the user (U1 to U3) and, for example, can be implemented as a touch screen panel display in which touch sensors are provided on the screens of the displays (121 to 123).

The control unit 150 displays metaverse content on one or more displays (121 to 123) among the plurality of displays (121 to 123) based on the location of the user (U1 to U3) and the metaverse content selected by the user (U1 to U3). A plurality of displays 121 to 123 are controlled to display. In addition, the control unit 150 uses a plurality of sensors (141 to 149) to detect the actions of the users (U1 to U3) using the sensors (141 to 149) closest to the positions of the users (U1 to U3). Controls (141~149). In addition, the control unit 150 displays the user's (U1 to U3) information on the display (121 to 123) corresponding to the sensor (141 to 149) closest to the location of the user (U1 to U3) among the plurality of displays (121 to 123). A plurality of displays (121 to 123) are controlled to display user avatars (A1 to A3) synchronized with actions.

The input unit 110 is a component that receives metaverse content, selection signals of users (U1 to U3) for user avatars (A1 to A3), and images of users (U1 to U3). The input unit 110 may be implemented, for example, by a touch screen panel and a camera disposed outside the experience space (S). In this case, users (U1 to U3) can select metaverse content and user avatars (A1 to A3) through the touch screen panel of the input unit 110. Additionally, users (U1 to U3) can input their images through the camera of the input unit 110. Additionally, the input unit 110 may be implemented by a portable terminal capable of communicating with the communication unit 170 of the metaverse providing device 100.

The storage unit 160 is a component that stores information about metaverse content and user avatars (A1 to A3). Information about these metaverse contents and user avatars (A1 to A3) may be pre-stored in the storage unit 160, or may be received from the server 200 shown in FIG. 5 and stored in the storage unit 160. there is.

The communication unit 170 is a component that performs communication regarding one or more information among metaverse content and user avatars (A1 to A3). For example, the communication unit 170 may transmit and receive one or more information among metaverse content and user avatars (A1 to A3) with the server 200 shown in FIG. 5.

The signal collection unit 180 may collect the first signal received from the camera 130 and the second signal received from the plurality of sensors 141 to 149. The signal collection unit 180 may transmit the first and second signals collected in this way to the control unit 150.

The driver 190 may activate the sensors 141 to 149 closest to the positions of the users U1 to U3 among the plurality of sensors 141 to 149 according to the control signal from the controller 150. According to this activation, the sensors 141 to 149 closest to the location of the users (U1 to U3) can detect the actions of the users (U1 to U3).

Referring to FIG. 4 together with FIGS. 1 to 3, a method for providing a metaverse according to an embodiment of the present invention will be described as follows.

In step 310, the camera 130 detects the location of one or more users (U1 to U3) in the experience space (S) provided by the plurality of displays (121 to 123).

For example, before step 310, the input unit 110 receives the selection signal of the user (U1 to U3) for the metaverse content and the user avatar (A1 to A3), and the image of the user (U1 to U3). Steps can be performed.

In step 320, the control unit 150 displays information on one or more displays (121 to 123) among the plurality of displays (121 to 123) based on the location of the users (U1 to U3) and the metaverse content selected by the users (U1 to U3). A plurality of displays 121 to 123 are controlled to display metaverse content.

For example, referring to Figure 2, the control unit 150, when all users (U1 to U3) in the experience space (S) have selected the first metaverse content related to, for example, “marathon”, a plurality of A plurality of displays (121 to 123) can be controlled to display the first metaverse content on the displays (121 to 123).

For example, referring to FIG. 3, the control unit 150 allows the first user (U1) among a plurality of users (U1 to U3) in the experience space (S) to enter a first metaverse related to, for example, “marathon”. When content is selected and the second user (U2) selects the second metaverse content about, for example, “dance,” the closest to the location of the first user (U1) among the plurality of displays (121 to 123) Displaying the first metaverse content on the display 121 and controlling the plurality of displays 121 to 123 to display the second metaverse content on one or more displays 122 and 123 among the remaining displays 122 and 123. You can. Here, the “first user” may be “the user (U1) with the highest priority among a plurality of users (U1 to U3) in the experience space (S),” but is not limited thereto, and may be one of any two users. A user with a high priority may be a “first user” and a user with a low priority may be a “second user.” Additionally, the “display closest to the location of the first user U1” may be one display, but is not limited thereto, and may include two or more displays.

In step 330, the control unit 150 uses the sensor (141 to 149) closest to the location of the user (U1 to U3) among the plurality of sensors (141 to 149) to detect the behavior of the user (U1 to U3). Controls the sensors (141 to 149). For example, the sensors (141 to 149) closest to the location of the user (U1 to U3) are based on the user's (U1 to U3) gaze, motion, gesture, and voice based on the metaverse content selected by the user (U1 to U3). One or more of , and touch can be detected.

For example, referring to Figure 2, when the metaverse content selected by the user (U1 to U3) is "marathon", the sensors 142, 145, and 148 closest to the location of the user (U1 to U3) detect the user's Motion can be detected. In addition, although not specifically shown in FIG. 2, when the metaverse content selected by the users (U1 to U3) is “Go game”, the sensors 142, 145, and 148 closest to the positions of the users (U1 to U3); For example, disposed on the screens of the displays 121, 122, and 123) can detect the user's touch.

In step 340, the control unit 150 displays the user (U1 to U3) on the display (121 to 123) corresponding to the sensor (141 to 149) closest to the location of the user (U1 to U3) among the plurality of displays (121 to 123). ) controls a plurality of displays (121 to 123) to display user avatars (A1 to A3) synchronized with the actions of ). For example, referring to FIG. 2, the control unit 150 displays the behavior of the first user (U1) on the first display 121 corresponding to the second sensor 142 closest to the location of the first user (U1). Control the first display 121 to display the first user avatar A1 synchronized with the second display 122 corresponding to the fifth sensor 145 closest to the location of the second user U2. Controls the second display 122 to display the second user avatar A2 synchronized with the actions of the second user U2, and corresponds to the eighth sensor 148 closest to the location of the third user U3. The third display 123 may be controlled to display the third user avatar A3 synchronized with the actions of the third user U3 on the third display 123.

Additionally, in step 340, the control unit 150 selects the closest sensors 141 to 149 among the entire areas of the displays 121 to 123 corresponding to the sensors 141 to 149 closest to the positions of the users U1 to U3. The plurality of displays 121 to 123 may be controlled to display user avatars A1 to A3 synchronized with the actions of the users U1 to U3 in the corresponding area. For example, referring to FIG. 2, the control unit 150 selects the second sensor 142 among the entire area of the first display 121 corresponding to the second sensor 142 closest to the location of the first user U1. ) Control the first display 121 to display the first user avatar (A1) synchronized with the actions of the first user (U1) in the central area corresponding to Displaying the second user avatar (A2) synchronized with the actions of the second user (U2) in the central area corresponding to the fifth sensor (145) among the entire area of the second display (122) corresponding to the fifth sensor (145). The second display 122 is controlled to The third display 123 may be controlled to display a third user avatar (A3) synchronized with the actions of the third user (U3) in the central area.

According to the first feature of the embodiment of the present invention, the metaverse providing method is a) one or more users (U1 to U3) using the camera 130 in the experience space (S) provided by the plurality of displays (121 to 123). ) detecting the location (310); b) The metaverse content is displayed on one or more displays (121 to 123) among the plurality of displays (121 to 123) based on the location of the user (U1 to U3) and the metaverse content selected by the user (U1 to U3). displaying (320); c) detecting the behavior of the user (U1 to U3) using the sensor (141 to 149) closest to the location of the user (U1 to U3) among the plurality of sensors (141 to 149) (330); and d) user avatars (A1 to A3) synchronized with the actions of the users (U1 to U3) on the displays (121 to 123) corresponding to the closest sensors (141 to 149) among the plurality of displays (121 to 123). ), characterized in that it includes a step 340 of displaying. Accordingly, compared to the prior art in which metaverse content is displayed on a single flat display provided in each real space, the realism of the metaverse can be improved. Additionally, you can access the metaverse and have an active experience without a separate wearable device such as an HMD for accessing virtual reality. Additionally, a plurality of users (U1 to U3) within the experience space (S) may access the metaverse providing device 100 and share the experience of metaverse content.

In addition, in step b), among a plurality of users (U1 to U3) in the experience space (S), the first user (U1) selects the first metaverse content and the second user (U2) selects the second metaverse content. When content is selected, the first metaverse content is displayed on the display 121 closest to the location of the first user (U1) among the plurality of displays 121 to 123, and the remaining displays 122 and 123 are displayed. By including the step of displaying the second metaverse content on one or more of the displays 122 and 123, the number of metaverse content provided in the experience space S can be continuously expanded.

Figure 5 is a block diagram of a metaverse providing system according to an embodiment of the present invention, and Figure 6 is a metaverse providing system for explaining an embodiment of a metaverse providing method according to a modified example of an embodiment of the present invention. is a schematic perspective view of, and Figure 7 is a schematic perspective view of a metaverse providing system for explaining another embodiment of a metaverse providing method according to a modified example of an embodiment of the present invention. In this regard, the input units (110a, 110b), control units (150a, 150b), storage units (160a, 160b), communication units (170a, 170b), signal collection units (180a, 180b), and driving units (190a, 190b) It is shown in Figure 5, but not in Figures 6 and 7.

Figure 8 is a flowchart of a method for providing a metaverse according to a modified example of an embodiment of the present invention.

With reference to FIGS. 5 to 7, the metaverse providing system 1000 according to an embodiment of the present invention is described as follows.

The metaverse provision system 1000 includes a plurality of metaverse provision devices 100A and 100B and a server 200.

Each of the plurality of metaverse providing devices (100A, 100B) includes a plurality of displays (121a to 123a, 121b to 123b), cameras (130a, 130b), a plurality of sensors (141a to 149a, 141b to 149b), and a control unit (150a). , 150b), and communication units 170a and 170b. In addition, each of the plurality of metaverse providing devices (100A, 100b) includes one or more of input units (110a, 110b), storage units (160a, 160b), signal collection units (180a, 180b), and driving units (190a, 190b). It may further include.

The server 200 is a component that transmits and receives one or more information among metaverse content and user avatars (A11, A12, A13, A21, and A22) with a plurality of metaverse providing devices (100A, 100B). The server 200 may include a server storage unit 210, a server communication unit 220, and a server control unit 230.

The server storage unit 210 is a component that stores one or more information among metaverse content and user avatars (A11, A12, A13, A21, and A22). One or more of these metaverse content and user avatars (A11, A12, A13, A21, A22) are metaverse content and user avatars (A11, A12, A13) for transmission to a plurality of metaverse providing devices (100A, 100B). , A21, A22), or may be one or more of metaverse content and user avatars (A11, A12, A13, A21, A22) received from a plurality of metaverse providing devices (100A, 100b). there is.

The server communication unit 220 communicates information about one or more of the metaverse content and user avatars (A11, A12, A13, A21, and A22) with the communication units 170a and 170b of the plurality of metaverse providing devices 100A and 100B. It is a component for execution.

The server control unit 230 stores one or more of the metaverse content and user avatars (A11, A12, A13, A21, and A22) according to the metaverse content selected from the plurality of metaverse providing devices 100A and 100B. The server communication unit 220 and the server storage unit 210 can be controlled to transmit and receive data from the bus providing devices 100A and 100B.

Referring to FIG. 8 together with FIGS. 5 to 7, a method for providing a metaverse according to a modified example of an embodiment of the present invention will be described as follows.

In step 410, each experience space of the plurality of metaverse providing devices 100A and 100B each includes a plurality of experience spaces S1 and S2 provided by a plurality of displays 121a to 123a and 121b to 123b. In (S1, S2), the cameras 130a and 130b detect the location of one or more users (U11 to U13, U21 to U22).

For example, before step 410, for each experience space (S1, S2) of the plurality of metaverse providing devices (100A, 100B), the input units (110a, 110b) input metaverse content and user avatars (A11 to A13). , A step of receiving a selection signal of the user (U11 to U13, U21 to U22) for A21 to A22, and the user's image (U11 to U13, U21 to U22) may be performed.

In step 420, in each experience space (S1, S2) of the plurality of metaverse providing devices (100A, 100B), the control unit (150a, 150b) determines the location of the user (U11 ~ U13, U21 ~ U22) and the user (U11) A plurality of displays to display the metaverse content on one or more displays (121a to 123a, 121b to 123b) among the plurality of displays (121a to 123a, 121b to 123b) based on the metaverse content selected by ~U13, U21 to U22). Controls (121a~123a, 121b~123b).

In step 430, in each experience space (S1, S2) of the plurality of metaverse providing devices (100A, 100B), the control unit (150a, 150b) selects the user (U11) among the plurality of sensors (141a ~ 149a, 141b ~ 149b) A plurality of sensors (141a~149a, 141b~) to detect the actions of the user (U11~U13, U21~U22) using the sensors (141a~149a, 141b~149b) closest to the positions of ~U13, U21~U22). 149b) is controlled. For example, for each experience space (S1, S2) of a plurality of metaverse providing devices (100A, 100B), the sensors (141a - 149a, 141b~149b) detects one or more of the gaze, motion, gesture, voice, and touch of the user (U11~U13, U21~U22) based on the metaverse content selected by the user (U11~U13, U21~U22). You can.

In step 440, in each experience space (S1, S2) of the plurality of metaverse providing devices (100A, 100B), the control unit (150a, 150b) displays the user (U11) among the plurality of displays (121a ~ 123a, 121b ~ 123b). Synchronize the actions of the user (U11 to U13, U21 to U22) with the display (121a to 123a, 121b to 123b) corresponding to the sensor (141a to 149a, 141b to 149b) closest to the position of ~U13, U21 to U22). A plurality of displays (121a to 123a, 121b to 123b) are controlled to display user avatars (A11 to A13, A21 to A22).

For example, referring to FIG. 6 together with FIG. 5, between the first experience space (S1) of the first metaverse providing device (100A) and the second experience space (S2) of the second metaverse providing device (100B) When there are no users (U11 to U13, U21 to U22) who selected the same metaverse content, the actions of the user avatars (A11 to A13) synchronized with the actions of the users (U11 to U13) in the first experience space (S1). 2 The display on the displays (121b to 123b) of the metaverse providing device (100B) is stopped, and the user avatars (A21 to A22) synchronized with the actions of the users (U21 to U22) in the second experience space (S2) are displayed. 1 Display on the displays 121a to 121b of the metaverse providing device 100A may be stopped. This processing is, for example, between the first experience space (S1) of the first metaverse providing device (100A) and the second experience space (S2) of the second metaverse providing device (100B) by the server 200. When there are no users (U11~U13, U21~U22) who selected the same metaverse content, the user avatars (A11~A13) synchronized with the actions of the users (U11~U13) in the first experience space (S1) Transmission of information to the second metaverse providing device 100B, and provision of the first metaverse of information about the user avatars (A21 to A22) synchronized with the actions of the users (U21 to U22) in the second experience space (S2) This can be done by stopping transmission to device 100A.

For example, referring to FIG. 7 together with FIG. 5, the user (U12) and the first experience space (S1) of the first metaverse providing device (100A) among the plurality of metaverse providing devices (100A, 100B) 2 When the user (U21) of the second experience space (S2) of the metaverse providing device (100B) selects the same first metaverse content (in the case of FIG. 7, “dance”), the first metaverse providing device On one or more displays (122a, 123a) among the plurality of displays (121a ~ 123a) of (100A) and one or more displays (121b ~ 123b) among the plurality of displays (121b ~ 123b) of the second metaverse providing device (100B) , respectively, a user avatar (A12) synchronized with the behavior of the user (U12) in the first experience space (S1) and a user avatar (A21) synchronized with the behavior of the user (U21) in the second experience space (S2) at the same time. It can be displayed. For example, this processing is performed by the server 200, the user U12 and the first experience space S1 of the first metaverse providing device 100A among the plurality of metaverse providing devices 100A and 100B. 2 When the user (U21) of the second experience space (S2) of the metaverse providing device (100B) selects the same first metaverse content, synchronizes with the behavior of the user (U12) of the first experience space (S1) Transmission of information about the user avatar (A12) to the second metaverse providing device (100B), and provision of information about the user avatar (A21) synchronized with the behavior of the user (U21) in the second experience space (S2) 1 This can be done by performing transmission to the metaverse providing device 100A.

According to the second feature of the embodiment of the present invention, the method for providing a metaverse is a) a plurality of experience spaces (S1, S2) each provided by a plurality of displays (121a to 123a, 121b to 123b). Step 410 of detecting the location of one or more users (U11 to U13, U21 to U22) using cameras (130a, 130b) in each experience space (S1, S2) of the metaverse providing devices (100A, 100B). ; b) The plurality of displays based on the location of the users (U11 to U13, U21 to U22) in each experience space (S1, S2) and the metaverse content selected by the users (U11 to U13, U21 to U22) Displaying the metaverse content on one or more displays (121a to 123a, 121b to 123b) (121a to 123a, 121b to 123b) (420); c) Among the plurality of sensors (141a to 149a, 141b to 149b) in each experience space (S1, S2), the sensor (141a to 149a, 141b~) is closest to the location of the user (U11 to U13, U21 to U22). 149b) detecting the behavior of the users (U11 to U13, U21 to U22) (430); and d) displays (121a to 123a) corresponding to the closest sensors (141a to 149a, 141b to 149b) among the plurality of displays (121a to 123a, 121b to 123b) in each of the experience spaces (S1, S2). It is characterized by including a step 440 of displaying user avatars (A11 to A13, A21 to A22) synchronized with the actions of the users (U11 to U13, U21 to U22) in 121b to 123b. Accordingly, compared to the prior art in which metaverse content is displayed on a single flat display provided in each real space, the realism of the metaverse can be improved. Additionally, you can access the metaverse and have an active experience without a separate wearable device such as an HMD for accessing virtual reality.

In addition, in step d), the user (U12) and the second metaverse providing device in the first experience space (S1) of the first metaverse providing device (100A) among the plurality of metaverse providing devices (100A, 100B) When the user (U21) of the second experience space (S2) of (100B) selects the same first metaverse content, one of the plurality of displays (121a to 123a) of the first metaverse providing device (100A) The user of the first experience space (S1) appears on one or more displays (121b to 123b) among the displays (122a to 123a) and the plurality of displays (121b to 123b) of the second metaverse providing device (100B), respectively. By simultaneously displaying a user avatar (A12) synchronized with the behavior of (U12) and a user avatar (A21) synchronized with the behavior of the user (U21) of the second experience space (S2), different experience spaces (S1, S2) ) Multiple users (U12, U21) within can access and share the experience of metaverse content.

The present invention has been shown and described focusing on the preferred embodiments of the attached exemplary drawings, but is not limited thereto and is within the scope of the technical idea of the present invention as set forth in the following claims. Of course, it can be implemented in various forms.

100, 100A, 100B: Metaverse provision device
110, 110a, 110b: input unit 121, 121a, 121b: first display
122, 122a, 122b: second display 123, 123a, 123b: third display
130, 130a, 130b: Camera 141, 141a, 141b: First sensor
142, 142a, 142b: second sensor 143, 143a, 143b: third sensor
144, 144a, 144b: fourth sensor 145, 145a, 145b: fifth sensor
146, 146a, 146b: sixth sensor 147, 147a, 147b: seventh sensor
148, 148a, 148b: 8th sensor 149, 149a, 149b: 9th sensor
150, 150a, 150b: Control unit 160, 160a, 160b: Storage unit
170, 170a, 170b: Communication unit 180, 180a, 180b: Signal collection unit
190, 190a, 190b: driving unit 200: server
210: server storage unit 220: server communication unit
230: Server control unit 1000: Metaverse provision system
S, S1, S2: Experience space
U1, U2, U3, U11, U12, U13, U21, U22: User
A1, A2, A3, A11, A12, A13, A21, A22: User Avatar

Claims (12)

In the method of providing metaverse,
a) detecting the location of one or more users using a camera in the experience space of a metaverse providing device including an experience space provided by a plurality of displays;
b) displaying the metaverse content on one or more of the plurality of displays based on the user's location and the metaverse content selected by the user;
c) detecting the user's behavior using the sensor closest to the user's location among a plurality of sensors; and
d) displaying a user avatar synchronized with the user's actions on a display corresponding to the closest sensor among the plurality of displays.
Including,
In step b), when the first user among the plurality of users in the experience space selects the first metaverse content and the second user selects the second metaverse content, the first user among the plurality of displays A metaverse providing method comprising displaying first metaverse content on the display closest to the location of and displaying second metaverse content on one or more of the remaining displays. delete The method of claim 1, further comprising, before step a), a1) receiving the user's selection signal for the metaverse content and the user avatar, and the user's image from an input unit of the metaverse providing device. A metaverse provision method comprising: The method of claim 1, wherein in step c), the nearest sensor detects one or more of the user's gaze, motion, gesture, voice, and touch based on the metaverse content selected by the user. How to provide metaverse. In the method of providing metaverse,
a) detecting the location of one or more users using a camera in the experience space of a metaverse providing device including an experience space provided by a plurality of displays;
b) displaying the metaverse content on one or more of the plurality of displays based on the user's location and the metaverse content selected by the user;
c) detecting the user's behavior using the sensor closest to the user's location among a plurality of sensors; and
d) displaying a user avatar synchronized with the user's actions on a display corresponding to the closest sensor among the plurality of displays.
Including,
In step b), when all users in the experience space select the first metaverse content, the metaverse content is displayed on the plurality of displays. In the method of providing metaverse,
a) detecting the location of one or more users using a camera in each experience space of a plurality of metaverse providing devices, each of which includes a plurality of experience spaces provided by a plurality of displays;
b) displaying the metaverse content on one or more of the plurality of displays based on the user's location in each experience space and the metaverse content selected by the user;
c) detecting the user's behavior using the sensor closest to the user's location among a plurality of sensors in each experience space; and
d) displaying a user avatar synchronized with the user's behavior on a display corresponding to the closest sensor among the plurality of displays in each experience space.
Including,
In step d), among the plurality of metaverse providing devices, a user of the first experience space of the first metaverse providing device and a user of the second experience space of the second metaverse providing device select the same first metaverse content. When in the state, one or more displays among the plurality of displays of the first metaverse providing device and one or more displays among the plurality of displays of the second metaverse providing device are synchronized with the user's actions in the first experience space, respectively. A method for providing a metaverse, characterized by simultaneously displaying a user avatar synchronized with the user's actions in the second experience space. delete The method of claim 6, before step a), a1) at each input unit of the plurality of metaverse providing devices, for each of the plurality of experience spaces, the user for the metaverse content and the user avatar. A metaverse providing method further comprising receiving a selection signal and an image of the user. The method of claim 6, wherein in step c), for each experience space of the plurality of metaverse providing devices, the nearest sensor detects the user's gaze, motion, A metaverse provision method characterized by detecting one or more of gesture, voice, and touch. In the metaverse provision device,
A plurality of displays arranged to provide an experience space and displaying metaverse content;
a camera that detects the location of one or more users within the experience space;
A plurality of sensors that detect the user's actions; and
Displaying the metaverse content on one or more of the plurality of displays based on the user's location and the metaverse content selected by the user, and using the sensor closest to the user's location among the plurality of sensors A control unit that detects the user's behavior and controls the plurality of displays and the plurality of sensors to display a user avatar synchronized with the user's behavior on the display corresponding to the closest sensor among the plurality of displays.
Including,
The control unit determines the location of the first user among the plurality of displays when the first user among the plurality of users in the experience space selects the first metaverse content and the second user selects the second metaverse content. A metaverse providing device, characterized in that for controlling the plurality of displays to display first metaverse content on the display closest to the display and display second metaverse content on at least one of the remaining displays. The metaverse providing device according to claim 10, further comprising a communication unit that communicates information about one or more of the metaverse content and the user avatar. In the metaverse provision system,
Multiple metaverse provision devices; and
Comprising a server that transmits and receives one or more information of metaverse content and user avatars with the plurality of metaverse providing devices,
A metaverse providing system, wherein the plurality of metaverse providing devices are each implemented as a metaverse providing device described in claim 11.

Images