KR20230094289A - Extended Reality Server - Google Patents

Abstract

The present invention relates to an extended reality server. According to an embodiment of the present invention, the extended reality server comprises: a communication module capable of performing wired and wireless data communication through a network; a memory storing received data and a program for implementing an extended reality usage environment with simultaneous multipresence functionality; and a control unit executing the program stored in the memory. The control unit includes a simultaneous multipresence implementation unit applying data received from a user terminal or data stored in the memory to the program for implementing an extended reality usage environment with simultaneous multipresence functionality, to generate data to implement an extended reality usage environment. Therefore, the extended reality server can provide an environment that enables each user to simultaneously feel the presence of other users in a space.

Description

Extended Reality Server {Extended Reality Server}

The present invention relates to an extended reality server, and more particularly, to each user simultaneously feeling the presence of other users' spaces, while having a simultaneous multi-presence function capable of effectively quickly searching for other users. It relates to an extended reality server providing a real use environment.

In general, extended reality (XR), that is, eXtended Reality, is a variety of technologies such as virtual reality (VR), augmented reality (AR), mixed reality (MR), and hologram (HR), which are limited in time and space in a virtual space similar to reality. It is a word that means the foundation for communicating and living without the need, and is also called realistic technology.

Virtual reality is a computer-generated simulation of an environment (eg, a 3D environment) that a user can interact with in a seemingly real or physical way. A virtual reality system, which can be a single device or a group of devices, can create this simulation for display to a user on, for example, a virtual reality headset or some other display device. Simulations may include images, sounds, haptic feedback, and/or other senses to mimic real or virtual environments. As virtual reality becomes increasingly prominent, the range of useful applications is rapidly expanding. The most common application of virtual reality involves gaming or other interactive content, but other applications such as viewing visual media items (eg photos, videos) for entertainment or training purposes closely follow. The possibility of using virtual reality to simulate real-life conversations and other user interactions is also being explored.

An object of the present invention is to provide an extended reality server that provides an environment in which each user can simultaneously feel the presence of other users in a space.

In addition, the present invention is to provide an augmented reality server providing an environment capable of effectively performing a quick search for other users.

According to one aspect of the present invention, a communication module provided to perform wired/wireless data communication over a network; a memory for storing received data and a program for realizing an extended reality use environment having a simultaneous multi-presence function; and a control unit executing a program stored in the memory, wherein the control unit applies data received from a user terminal or data stored in the memory to a program for realizing an extended reality environment having a simultaneous multi-presence function. An extended reality server including a simultaneous multi-presence implementation unit generating data for realizing an extended reality use environment having a simultaneous multi-presence function by using a simultaneous multi-presence function may be provided.

Also, the simultaneous multi-presence implementer may include a telepresence unit that receives an image captured by a camera and generates a presence image by processing the received image.

In addition, the simultaneous multi-presence realization unit, the simultaneous multi-presence realization unit, presents images generated by photographing a space where each of the users participating in the joint project are located, to one user (U) as the center thereof. It may further include a multi-presence space management unit that implements a multi-presence mode in which the multi-presence space is displayed in a manner arranged around the center.

In addition, the multi-presence space management unit controls the space where each of the users participating in the joint project is located on the presence display screen, which is a virtual screen formed on the space of the image displayed to the user U through the user terminal 20. The multi-presence mode may be implemented by displaying presence images generated by photographing.

In addition, the multi-presence space management unit may enable an immersion mode in which only a specific image among presence images located on the presence display screen is displayed according to a user's selection.

According to an embodiment of the present invention, an extended reality server providing an environment in which each user can simultaneously feel the presence of other users in a space may be provided.

In addition, according to an embodiment of the present invention, an extended reality server providing an environment capable of effectively performing a quick search for other users may be provided.

1 is a diagram illustrating an augmented reality system according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating the augmented reality server of FIG. 1 .
3 is a block diagram showing the configuration of a control unit.
4 is a block diagram showing the configuration of a simultaneous multi-presence implementation unit.
5 is a diagram explaining a method of displaying a presence image for a space in which a user participating in a joint project is located to one user.
6 is a conceptual diagram illustrating an arrangement relationship in which one user recognizes a space in which a user participating in a joint project is located.
7 is a diagram explaining a state in which the user selects a specific presence image and enters an immersion mode.
8 is a diagram for explaining a state in which two users enter an immersion mode for the same presence image.
9 is a diagram illustrating an example of an image displayed to a user in an immersion mode.
10 is a diagram illustrating a relationship between concepts related to control of a shared object by an adaptive concurrency control implementation unit.
11 is a diagram illustrating the configuration of an adaptive concurrency control implementation unit.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the technical idea of the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided so that the disclosed content will be thorough and complete, and the spirit of the present invention will be sufficiently conveyed to those skilled in the art.

In this specification, when an element is referred to as being on another element, it means that it may be directly formed on the other element or a third element may be interposed therebetween. Also, in the drawings, the thicknesses of films and regions are exaggerated for effective explanation of technical content.

In addition, although terms such as first, second, and third are used to describe various elements in various embodiments of the present specification, these elements should not be limited by these terms. These terms are only used to distinguish one component from another. Therefore, what is referred to as a first element in one embodiment may be referred to as a second element in another embodiment. Each embodiment described and illustrated herein also includes its complementary embodiments. In addition, in this specification, 'and/or' is used to mean including at least one of the elements listed before and after.

In the specification, expressions in the singular number include plural expressions unless the context clearly dictates otherwise. In addition, the terms "comprise" or "having" are intended to designate that the features, numbers, steps, components, or combinations thereof described in the specification exist, but one or more other features, numbers, steps, or components. It should not be construed as excluding the possibility of the presence or addition of elements or combinations thereof. In addition, in this specification, "connection" is used to mean both indirectly and directly connecting a plurality of components.

In addition, in the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description will be omitted.

1 is a diagram illustrating an augmented reality system according to an embodiment of the present invention.

Referring to FIG. 1 , an extended reality system according to an embodiment of the present invention includes an extended reality server 10 and a user terminal 20 .

In the case where a plurality of users access and use the augmented reality system according to an embodiment of the present invention, each user can feel the presence of other users' space at the same time, while quickly searching for other users, It provides an extended reality user environment with a simultaneous multi-presence function that can effectively share information about one's workspace. In addition, the augmented reality system according to an embodiment of the present invention provides adaptive concurrency control that can reduce the occurrence of collisions between user manipulations and shorten work time when a plurality of users manipulate shared objects. .

The augmented reality server 10 is connected to the user terminal 20 through a network.

Each of the user terminals 20 is provided to the user so that the user can visually check the augmented reality. For example, the user terminal 20 may include a head mounted display (HMD). The HMD may display a virtual image or a scanned image on a real space with a transparent display area, or display a virtual or scanned image on a virtual or scanned background with an opaque display area. . In addition, the display area of the HMD is provided to be switchable between a transparent state and an opaque state, so that the output method can be changed. For example, the HMD may be provided by Microsoft HoloLens of Microsoft Co., Ltd., Google Glass of Google Co., Ltd., and the like. In addition, the user terminal 20 may further include a camera. The camera photographs the space around the user. The camera may be provided as a state attached to the HMD or as a separate device separated from the HMD. In addition, the user terminal 20 may further include a wearable sensor. A wearable sensor is worn by a user such as clothing, gloves, bands, etc. or attached to the skin to detect the position of a user's body part or an electrical signal generated from the user's body to detect the user's motion. Provided. For example, the wearable sensor may be Myo from Thalmic Labs.

A network refers to a connection structure capable of exchanging information between nodes such as terminals and servers, and examples of such networks include a 3rd Generation Partnership Project (3GPP) network and a Long Term Evolution (LTE) network. , 5G network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), Bluetooth (Bluetooth) network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, etc. are included, but are not limited thereto, and include all new communication standards and devices emerging as technology develops related to data transmission and reception in the future. do.

FIG. 2 is a block diagram illustrating the augmented reality server of FIG. 1 .

Referring to FIG. 2 , the augmented reality server 10 includes a communication module 11 , a memory 12 and a control unit 13 .

The communication module 11, the memory 12, and the control unit 13 may be physically implemented separately or implemented by integrating one or more of them. Here, the control unit 13 can control the communication module 11 and the memory 12, and can read and process data received through the communication module 11 or stored in the memory 12 according to a predetermined program. It can be understood as a processor with

The communication module 11 is provided to perform wired/wireless data communication through a network, and can transmit/receive data with the user terminal 20 . In addition, when the user terminal 20 includes an HMD and a camera, the communication module 11 may be provided to transmit and receive data in the same or different manner as each of the HMD and the camera.

The memory 12 includes received data, a program for realizing an extended reality use environment having a simultaneous multi-presence function, a program for implementing adaptive concurrency control, processed data generated by processing the received data, and various data. can be saved. Here, the memory 12 collectively refers to a non-volatile storage device that continuously retains stored information even when power is not supplied.

The control unit 13 executes a program stored in the memory 12, applies data received from the user terminal 20 or data stored in the memory 12 to the program, and data to be displayed through the user terminal 20 to be transmitted to the user terminal 20.

3 is a block diagram showing the configuration of a control unit.

Referring to FIG. 3 , the control unit 13 includes a simultaneous multi-presence implementation unit 130 and an adaptive concurrency control implementation unit 140 .

The simultaneous multi-presence realization unit 130 applies data received from the user terminal 20 or data stored in the memory 12 to a program for realizing an extended reality environment having a simultaneous multi-presence function, It generates data for realizing an extended reality use environment having a multi-presence function, and transmits data to be displayed through the user terminal 20 to the user terminal 20 to implement the extended reality use environment.

The adaptive concurrency control implementation unit 140 applies the data received from the user terminal 20 or the data stored in the memory 12 to a program for implementing the adaptive concurrency control to generate data for implementing the adaptive concurrency control. and causes data to be displayed through the user terminal 20 to be transmitted to the user terminal 20 in order to implement the adaptive concurrency control.

4 is a block diagram showing the configuration of a simultaneous multi-presence implementation unit.

Referring to FIG. 4 , the simultaneous multi-presence implementation unit 130 includes a personal area management unit 131, a tele presence unit 132, a multi-presence space management unit 133, and an interaction management unit 134. .

The personal area management unit 131 allows a personal workspace to be created for each user. At this time, the personal workspace is created when the user accesses the extended reality server 10, or when an account is created in the extended reality server 10, or when a joint project with a specific purpose is created in the extended reality server 10. and can be created when a user participates in a corresponding joint project. When the personal workspace is created, the user can perform work in the personal workspace, and the work result can be stored as work storage data in the personal workspace. In addition, the operator can update the job storage data by loading the previously stored job storage data, performing a continuing job, and storing the result. In addition, a plurality of work storage data may be created and each may be individually generated or provided to be updated. In addition, the user may be provided with the ability to set access rights such as reading, reading, and editing of other users to the job storage data. In addition, when there are a plurality of job storage dates, access rights for each job storage date may be individually set and changed.

The personal area management unit 131 may display the personal workspace to the user through the user terminal 20 such as an HMD in the form of a 3D image like virtual reality. In addition, the personal area management unit 131 displays the work storage data to the user through the user terminal 20 such as an HMD in a form in which the work storage data is located at a specific location in the personal work space of virtual reality, so that the user selects the work storage data. The action makes the job archive data editable, and the action of dropping the job archive data causes the job archive data to be saved. At this time, the user's behavior is detected through a camera or a wearable sensor and transmitted to the augmented reality server 10, and the personal area management unit 131 may determine the user's behavior through an image through the camera or a wearable sensor. . In addition, work storage data in a personal workspace may be shared with other users by a user's manipulation.

The tele presence unit 132 receives an image captured by a camera, processes the received image, and transmits a generated presence image to users performing a joint project, so that users performing a joint project can communicate in real time. so that telepresence can be achieved. At this time, the camera provides images taken from various angles of the space where the user is located, and the telepresence unit 132 processes them to display them in the form of stereoscopic images to the user through the user terminal 20 such as an HMD. A presence video can be created and transmitted.

5 is a diagram illustrating a method of displaying a presence image of a space where a user participating in a joint project is located to one user, and FIG. 6 is a space where a user participating in a common project is located. It is a conceptual diagram explaining the arrangement relationship that recognizes.

5 and 6, the multi-presence space management unit 133 captures the space where each of the users participating in the joint project is located, and the presence images generated are sent to one user U as the center. A multi-presence mode that allows them to be displayed in an arranged manner at attention. Specifically, the multi-presence space management unit 133 allows each user to create a ring-shaped presence display screen PS in a circumferential space centered on the corresponding user U. At this time, the presence display screen PS is a virtual screen formed on the space of an image displayed to the user U through the user terminal 20 such as an HMD. For example, the presence display screen PS may be provided in a ring shape having a preset radius and a preset height vertically around a point where the user U is located. In addition, the joint multi-presence space management unit 133 photographs the space where the users participating in the project are located, and the presence images (PV1, PV2, PV3, PV4) created by the tele presence unit 132 are displayed on the presence display screen ( PS). Accordingly, as shown in FIG. 6, in the multi-presence mode, the user U participates in a joint project through the presence images PV1, PV2, PV3, and PV4 displayed on the presence display screen PS. It becomes a form surrounded by users who play, and it is possible to feel the presence of other users in the space. At this time, the presence images (PV1, PV2, PV3, PV4) displayed on the presence display screen (PS) are provided as presence images of other users except the user himself, or all users participating in the joint project including himself. may be provided as presence images for In addition, the multi-presence space manager 133 may change the arrangement position and size of the presence images PV1, PV2, PV3, and PV4 displayed on the presence display screen PS according to a user's manipulation. there is.

Accordingly, the user U wearing the HMD can hold a meeting while viewing information in the space of other collaboration participants surrounding him.

FIG. 7 is a diagram illustrating a state in which a user selects a specific presence image to enter an immersion mode, and FIG. 8 is a diagram illustrating a state in which two users enter an immersion mode for the same presence image.

Referring to FIGS. 7 and 8 , the multi-presence space management unit 133 controls the presence images PV1, PV2, PV3, and PV4 located on the presence display screen PS according to the user U's manipulation. An immersion mode in which only a specific image (eg, PV3) is displayed can be set. In the immersion mode, only the presence image PV3 selected by the user U is displayed in the image displayed to the user U through the HMD, and the remaining presence images are not displayed. Accordingly, when the multi-presence mode is changed to the immersion mode, as shown in FIG. Recognition can be made in the form of entering a space corresponding to the selected presence image PV3. For example, the camera captures the space in which the user is located from various angles, and the presence image PV3 displayed to the user in the immersion mode may have a 3D stereoscopic shape. At this time, the selected presence image PV3 may be another user's presence image or the user's own presence image. In addition, when two users U1 and U2 enter the immersion mode for the same presence image PV3, as shown in FIG. 8, the two users U1 and U2 are in the same space together, Other users who have selected the presence image PV3 can be recognized. In this case, in order to improve immersion, when two users select a specific presence image as an immersion mode, the presence image displayed to each user may include the image of another user. That is, the user's appearance may be implemented in the form of an avatar through computer graphics, or may be implemented by extracting the user's appearance from an image captured by a camera and synthesizing it into a presence image.

9 is a diagram illustrating an example of an image displayed to a user in an immersion mode.

Referring to FIG. 9 , images displayed to the user U in the immersion mode may include a presence image PV and a personal workspace image WS. At this time, the personal workspace image WS and the presence image PV may belong to the same user (ie, the personal workspace image and the presence image belong to the same user A). Accordingly, when the user U selects the presence video PV and enters the immersion mode, perception can be made in the form of visiting the user specified by the immersion mode and examining the user's work results together. . Also, after the user U selects his or her presence image, he or she may perform work on interpolation data in his or her personal work space. For example, when an immersion mode image is provided in a stereoscopic form, the presence image PV may be positioned in the front area, and the image WS of the intervention workspace may be positioned in the rear area. In addition, the position, ratio, and size of the presence image PV and the intervention workspace image WS in the immersion mode image may be adjusted by the user. In addition, the user can display only one of the presence image PV and the intervention work space image WS in the immersion mode image.

In addition, when the user U moves from the immersion mode to the multi-presence mode, the user U leaves the space corresponding to the immersion mode and then displays the presence images PV1, PV2, PV3, and PV4. Recognition can be made in the form of moving to an enclosed space.

The interaction manager 134 receives a signal from the user and inputs the corresponding signal to the personal area manager 131 or the multi-presence space manager 133 . For example, the interaction management unit 134 analyzes an image received from a camera or detects a user's motion through a signal received from a wearable sensor, processes the corresponding signal, and then uses the personal area management unit 131 or multi-frame It can be input to the Jens space management unit 133. In addition, when a specific signal is received from a camera or a wearable sensor, the interaction management unit 134 displays an input means such as a keyboard in a virtual space displayed to the user, and then transmits the signal in such a way that the user manipulates the input means. can be input. Through a signal input to the interaction management unit 134, the user causes the multi-presence mode and the immersion mode to be mutually changed, manipulates the display state of the multi-presence mode or the immersion mode, and allows himself/herself or another user in the immersive mode state. Work storage data in the personal workspace of the person is read and edited, presence video is viewed, and movement in the space of the presence video or specific task is performed.

According to the simultaneous multi-presence method by the simultaneous multi-presence implementation unit 130 according to an embodiment of the present invention, a user can perceive the existence of another user in three dimensions through the presence display screen PS. there will be In addition, by selecting a specific presence image through the presence display screen (PS), the user can use it by actually entering or exiting the space where another user is located, in a way similar to the actual space in reality. It perceives the user and allows other users to collaborate.

The adaptive concurrency control implementation unit 140 controls the state change of the shared object according to the user's manipulation when two or more users are located in one space and the two users manipulate the shared object to be worked on. do. At this time, when two users are located in one space, two people are in immersion mode at the same time in one personal workspace, and two people are in immersion mode at the same time in a space by one presence image. can In addition, the case where two users are located in one space may be a case where two users are located in one real space (ie, a case where two users actually participate in a real space generating one presence image). . Also, the shared object is a virtual object implemented by computer graphics and displayed on an image displayed to a user through an HMD. In the process of users manipulating a shared object, a conflict phenomenon in which users' manipulation results are different may occur. The adaptive concurrency control implementation unit 140 regulates operations between users through ownership to prevent such conflicts from occurring. At this time, the ownership is the right that the user's operation is recognized as valid and can be reflected in the state change of the shared object.

For example, a method of directly manipulating a shared object of an MHD image using a hand through upper body motion recognition may be used as a signal input for manipulating a shared object. For example, the user may wear the MHD and wear the wearable sensors on both arms. In addition, the MHD can track a 3D position when a voice input is received from the user or when the user moves, and information on a rotation value of the user's head can be extracted. Accordingly, the user can perform various manipulations on the shared object while moving in space using the MHD image.

10 is a diagram illustrating a relationship between concepts related to control of a shared object by an adaptive concurrency control implementation unit.

Referring to FIG. 10 , concepts of goals, detailed goals, and tasks are set in relation to control of shared objects.

A goal is a final result value to be achieved for a shared object by a user's manipulation. For example, the goal may be to install an object such as an air conditioner in a specific location.

A detailed goal is a goal to change the state of a shared object with the same or similarity in the process of changing the state of a shared object step by step to achieve the goal. For example, if the goal is to install an air conditioner, the detailed goal is to move to the installation location of the air conditioner, which is a shared object (that is, move to the target location of the shared object), assemble parts or combine parts with the shared object, and install the air conditioner, which is a shared object. It may be fixed to the installation location (i.e., assembly of shared object), final test (i.e., shared object test), and the like. Detailed goals are set according to the contents of the goals. In addition, each detailed goal may be set to have a sequence.

A task is a user's action (ie, user's operation) to achieve each detailed goal, and is set according to each detailed goal. For example, an operation in which the user picks up and moves the shared object in response to the movement of the air conditioner, which is a shared object, to the installation location (i.e., transfer task), assembles parts or combines parts with the shared object, and places the air conditioner, which is a shared object, at the installation location. In response to fixing to, the user picks up a part or accessory and connects it to a shared object, the user adjusts the air conditioner's position and connects bolts, brackets, etc. to fix the air conditioner (i.e., assembly task), the final Each operation of operating the air conditioner in response to the test (ie, operation task) becomes a task. That is, tasks are assigned in a one-to-one matching manner corresponding to each detailed goal, and the content of each task is set to correspond to the content of the detailed goal.

11 is a diagram illustrating the configuration of an adaptive concurrency control implementation unit.

Referring to FIG. 11 , the adaptive concurrency control implementation unit 140 includes a task analysis unit 141, an object management unit 142, a task management unit 143, a target management unit 144, and an ownership management unit 145.

The task analyzer 141 analyzes task information that the user intends to perform through a signal received from the user terminal 20 .

The object management unit 142 manages the state of each shared object. In the state of the shared object, a user who has ownership for the shared object is set according to the analyzed task information, and the content of the ownership allocated to the user is managed.

The task management unit 143 reflects possible manipulations according to the ownership assigned to the user to the state change of the shared object through a signal received from the user terminal 20, and proceeds with the task for the shared object.

The goal management unit 144 manages the progress of the detailed goals in the detailed goals assigned to the goals.

The ownership management unit 145 executes concurrency control of joint work according to the ownership policy allocated to each user according to the details of the detailed goal currently in progress and the task corresponding thereto, and informs the user of the result.

First, when the detailed goal is to move the shared object to the target location, ownership assignment and state change of the shared object will be described. In this case, the user can hold, move, and rotate the shared object. First, in the process of moving the air conditioner, all users who hold the air conditioner can participate in the movement of the air conditioner, and in this case, movement according to ownership is not restricted. However, an algorithm for the movement of the air conditioner similar to that in the real world is required according to the user's movement input. When two or more users move or rotate a shared object while holding it together, information about the movement and rotation of the shared object is checked to prevent a collision between the position and rotation information of the shared object according to the manipulation by the users. Concurrency control is done as follows. First, when two or more users grab a shared object, the user who catches it first has priority in ownership of the shared object. Accordingly, if a user with priority is A and a user without priority is B according to the order in which shared objects are obtained, C, the midpoint of A and B, is obtained as shown in Equation (1) below.

Then, when the users move, the displacement of the user's movement is calculated as shown in Equation (2), and the position of the midpoint C is changed.

In addition, in relation to the rotation of the shared object, if the shared object is rotated with the rotation value of one user's hand, a rotation value conflict occurs. Therefore, it is rotated through an approximate change in direction according to the positions of the hands of two users. At this time, the user (that is, A) having priority for the shared object has the initiative in the direction. Therefore, the direction vector for rotation of the central point C of the shared object is as shown in Equation 3.

After the users complete moving the air conditioner, which is a shared object, a process of assembling the air conditioner is required. At this time, there is a user who is in charge of micro-movement of the air conditioner and a user who assembles accessories to the air conditioner. At this time, the user in charge of micro-movement of the air conditioner has exclusive ownership. Accordingly, a user who assembles parts and parts of an air conditioner, which is a shared object, can perform the work with the permission of the user having ownership.

After the assembly is completed, as a process of testing the air conditioner, adjustments such as movement for detailed position correction may be performed while the air conditioner is operated and tested. In this case, one of the users has ownership, and the other users can perform manipulations on the shared object with the permission of the user who has ownership.

Permission of the user having ownership may be made through a voice signal of the user having ownership using the user terminal 20 having a voice recognition function, or by clicking the corresponding menu in a raycasting manner. .

According to the adaptive concurrency control method by the adaptive concurrency control implementation unit 140 according to an embodiment of the present invention, a method for assigning ownership to a user according to a detailed goal, contents of a task performed according to the detailed goal, and a user The way manipulations of are reflected in shared objects is controlled to vary. Accordingly, a conflict between user operations is prevented from occurring, and time required to complete a goal consisting of detailed goals is reduced.

In the above, the present invention has been described in detail using preferred embodiments, but the scope of the present invention is not limited to specific embodiments, and should be interpreted according to the appended claims. In addition, those skilled in the art should understand that many modifications and variations are possible without departing from the scope of the present invention.

10: extended reality server 11: communication module
12: memory 13: control unit
20: user terminal 130: simultaneous multi-presence implementation unit
140: adaptive concurrency control implementation unit

Claims (5)

A communication module provided to perform wired/wireless data communication through a network;
a memory for storing received data and a program for realizing an extended reality use environment having a simultaneous multi-presence function; and
Including a control unit for executing a program stored in the memory,
The control unit,
Data for realizing an extended reality environment with a simultaneous multi-presence function by applying data received from a user terminal or data stored in the memory to a program for implementing an extended reality environment with a simultaneous multi-presence function An extended reality server including a concurrent multi-presence implementation unit that generates a According to claim 1,
The simultaneous multi-presence implementation unit,
An extended reality server including a telepresence unit that receives an image captured by a camera and generates a presence image by processing the received image. According to claim 2,
The simultaneous multi-presence implementation unit,
The simultaneous multi-presence implementation unit,
A multi-presence mode that implements a multi-presence mode in which the presence images created by photographing the space where each of the users participating in the joint project are located are displayed to one user (U) in a manner arranged around him. An extended reality server further comprising a Jens space management unit. According to claim 3,
The multi-presence space management unit photographs the space where each user participating in the joint project is located on the presence display screen, which is a virtual screen formed on the space of the image displayed to the user U through the user terminal 20. An extended reality server implementing the multi-presence mode by displaying the generated presence images. According to claim 3,
The multi-presence space management unit enables an immersion mode in which only specific images among presence images located on the presence display screen are displayed according to a user's selection.

Images