KR20230127669A - Method, apparatus and sysyem for providing group experiential extended reality using user characteristics - Google Patents

Abstract

One embodiment of the present invention provides an apparatus for providing collective experiential extended reality content to a plurality of users in a predetermined space, which can provide extended reality content that matches the location of each user. The apparatus comprises: a communication module transmitting and receiving information to and from a plurality of user terminals and a plurality of sensing units; a memory storing a content provision program; and a processor executing the program stored in the memory, wherein the processor executes the program to obtain feature information and location information including at least one of clothing information, facial information, body information, and behavioral information of each of the plurality of users based on image and scan data received from the plurality of sensing units, and to provide a user terminal of a user corresponding to each feature information with extended reality content matched to the location information of the user. The extended reality content is transmitted to experience terminals configured to be worn by the users associated with the user terminals.

Description

Method, apparatus and system for providing collective experiential extended reality using user characteristics {METHOD, APPARATUS AND SYSYEM FOR PROVIDING GROUP EXPERIENTIAL EXTENDED REALITY USING USER CHARACTERISTICS}

The present invention relates to a method, apparatus, and system for providing collective experiential augmented reality using user characteristics, and more particularly, to recognizing a user based on a user's characteristic, obtaining location information of the recognized user, and collecting A method, apparatus, and system for providing a user with augmented reality content that is matched with obtained location information.

Recently, as demand for devices providing extended reality content such as virtual reality, augmented reality, and mixed reality increases, various types of technologies for providing extended reality content are being developed.

In the conventional augmented reality content providing system, since each user equipment operates as an independent host, a group experience is impossible, or even if possible, the content implementation area is narrowed because the resources required for spatial recognition are large. Accordingly, when providing extended reality content to a group of a plurality of users existing in the same space, there is a problem in that the number of users who can simultaneously experience the corresponding extended reality content is very limited.

In addition, when a conventional augmented reality content providing system using a single sensor is applied in a relatively narrow space where a plurality of users can overlap, an occlusion phenomenon in which some overlapping users are not recognized in the process of sensing the users occurs. There were issues that arose.

Accordingly, there is a need for a method of providing group experiential extended reality content that can overcome the aforementioned occlusion problem and provide extended reality content to a plurality of users.

The present invention is to solve the problems of the prior art described above, and recognizes each user based on the user's characteristics, obtains location information of each of the recognized users, and expands reality content that matches the collected location information. It is a technical task to provide a method, device, and system for providing each user.

The technical problems to be achieved by the present invention are not limited to the above technical problems, and other technical problems of the present invention can be derived from the following description.

As a technical means for solving the above-mentioned technical problem, an embodiment according to the first aspect of the present invention provides an apparatus for providing group experience-type augmented reality content to a plurality of users in a predetermined space. The apparatus includes a communication module for transmitting and receiving information with a plurality of user terminals and a plurality of sensing units, a memory for storing a content providing program, and a processor for executing the program stored in the memory, the processor comprising: By executing the program, feature information and location information including at least one of costume information, face information, body information, and behavior information of each of a plurality of users based on the image and scan data received from the plurality of sensing units. is obtained, and extended reality content matching the user's location information is provided to the user's terminal corresponding to each characteristic information. The augmented reality content is transmitted to experience terminals configured to be attachable or detachable by the users linked to the user terminals.

In addition, the embodiment according to the second aspect of the present invention is a collective experience-type extended reality for a plurality of users in a predetermined space performed by a processor of a device communicatively connected to a plurality of user terminals and a plurality of sensing units. Provides a way to present content. The method includes receiving image and scan data from the plurality of sensing units, and at least one or more of costume information, face information, body information, and behavior information of each of the plurality of users based on the image and scan data. Collecting feature information and location information, and providing augmented reality content matching the user's location information to a user's terminal corresponding to each feature information. The augmented reality content is transmitted to experience terminals configured to be attachable or detachable by the users linked to the user terminals.

In addition, an embodiment according to a third aspect of the present invention provides a system for providing group experience-type extended reality content to a plurality of users in a predetermined space. The present system includes a server, a plurality of user terminals communicatively connected to the server, a plurality of sensing units that acquire images and scan data for the predetermined space, and outputs extended reality content received from the user terminals. and a plurality of experience terminals configured to be detachable by the users. The server may include characteristic information including at least one of costume information, face information, body information, and behavior information of each of the users and location of each of the users based on the image and scan data received from the sensing units. The information is obtained, and extended reality content matching the location information of the corresponding user is provided to the user terminal of the user corresponding to each characteristic information.

In addition, an embodiment according to a fourth aspect of the present invention provides a method of providing group experience-type augmented reality content to a plurality of users in a predetermined space performed by a server. The method includes the steps of receiving image and scan data of the predetermined space through a plurality of sensing units disposed on the predetermined space, and clothing information and face information of each of the users from the image and the scan data. , collecting characteristic information including at least one of body information and behavioral information and location information of each of the users, and matching the user's location information to the user terminal corresponding to each characteristic information. Transmitting the augmented reality content.

According to the above-described problem solving means of the present invention, it is possible to classify each user through the user's characteristics in a predetermined space, collect location information of the separated users, and provide extended reality content matching the location of each user. .

In addition, when a user is identified in an overlapping area of a plurality of sensing units that photograph and scan different areas, all of the plurality of sensing units may identify the corresponding user with one unique identification ID.

In addition, by sensing users through a plurality of camera modules and LIDAR modules, it is possible to implement a collective experiential extended reality content providing system that solves the existing Oculus problem.

1 is a diagram illustrating a system for providing group experience-type augmented reality using user characteristics according to an embodiment of the present invention.
FIG. 2 is a diagram showing the overall configuration of a system for providing collective experience type augmented reality using user characteristics shown in FIG. 1 .
3 is a block diagram showing the configuration of the server shown in FIG. 1;
FIG. 4 is a diagram illustrating an example of augmented reality content provided by a system for providing collective experiential augmented reality using user characteristics shown in FIG. 1 .
FIG. 5 is a diagram illustrating an example of a process of sensing a plurality of users by a server of a system for providing group experiential augmented reality using user characteristics shown in FIG. 2 .
6 is an operational flowchart illustrating a method for providing group experiential augmented reality according to another embodiment of the present invention.
FIG. 7 is a diagram illustrating detailed processes of some steps of the method for providing group experiential augmented reality shown in FIG. 6 .

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. However, the present invention may be implemented in many different forms, and is not limited to the embodiments described herein. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the accompanying drawings. All terms including technical terms and scientific terms used herein should be interpreted as meanings commonly understood by those of ordinary skill in the art to which the present invention belongs. The terms defined in the dictionary should be interpreted as having additional meanings corresponding to the related technical literature and the currently disclosed content, and are not interpreted in a very ideal or limiting sense unless otherwise defined.

In order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and the size, shape, and shape of each component shown in the drawings may be variously modified. Same/similar reference numerals are assigned to the same/similar parts throughout the specification.

The suffixes "module" and "unit" for the components used in the following description are given or used interchangeably in consideration of ease of writing the specification, and do not have meanings or roles that are distinguished from each other by themselves. In addition, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description is omitted.

Throughout the specification, when a part is said to be “connected (connected, contacted, or combined)” with another part, this is not only the case where it is “directly connected (connected, contacted, or coupled)”, but also has other members in the middle. It also includes the case of being "indirectly connected (connected, contacted, or coupled)" between them. In addition, when a part "includes (provides or provides)" a certain component, it does not exclude other components, but "includes (provides or provides)" other components unless otherwise specified. means you can

Terms indicating ordinal numbers such as first and second used in this specification are used only for the purpose of distinguishing one element from another, and do not limit the order or relationship of elements. For example, a first element of the present invention may be termed a second element, and similarly, the second element may also be termed a first element. Singular forms used herein should be construed to include plural forms as well, unless the meaning is clearly indicated to the contrary.

1 is a diagram illustrating a system for providing group experiential extended reality using user characteristics according to an embodiment of the present invention (hereinafter, referred to as “extended reality providing system”).

Referring to FIG. 1 , the augmented reality providing system includes a server 100 and a plurality of sensing units 200, and may further include a plurality of user terminals 300 and a plurality of experience terminals 400. . The server 100, the sensing unit 200, the plurality of user terminals 300, and the plurality of experience terminals 400 may be interconnected through a wired or wireless communication network.

The server 100 may be formed as a cloud computing server such as Software as a Service (SaaS), Platform as a Service (PaaS), or Infrastructure as a Service (IaaS). Alternatively, the server 100 may be a computing device such as a terminal. The plurality of sensing units 200 may include a camera module such as an RGB sensor that photographs a plurality of users and a LIDAR module that generates 3D scan data of the plurality of users. The plurality of terminals 300 include, for example, a laptop, a desktop, a laptop equipped with a web browser, a wireless communication device or a smartphone that ensures portability and mobility, and a touchpad. It may refer to all types of handheld-based wireless communication devices such as a tablet PC. A communication network is any wired network such as a Local Area Network (LAN), a Wide Area Network (WAN) or a Value Added Network (VAN), a mobile radio communication network, or a satellite communication network. It can be implemented as a kind of wireless network. The plurality of experience terminals 400 may be a virtual reality device, an augmented reality device, or a mixed reality device, and may be, for example, AR glasses or a head-mounted display.

The plurality of user terminals 300 receive motion information of each user from the experience terminals 400 of each user, and extended reality content matched with user location information of each user terminal 300 from the server 100. receive In addition, the plurality of user terminals 300 provide the experience terminals 400 of each user with an extended reality content image obtained by applying the motion information of each of the plurality of users to the extended reality content of each user.

The plurality of experience terminals 400 include an inertia module, and the inertia module senses motions of a plurality of users and generates motion information for each user. Each of the plurality of experience terminals 400 transmits the corresponding motion information to the user terminals 300 of each user. Each of the plurality of experience terminals 400 may receive an extended reality content image to which motion information is applied from the user terminals 300 of respective users, output the corresponding extended reality content image, and display the image on a display. FIG. 2 is a diagram showing the overall configuration of a system for providing group experiential augmented reality using user characteristics according to an embodiment of the present invention.

Referring to FIGS. 1 and 2 together, the augmented reality providing system provides group experiential augmented reality content to a plurality of users in a predetermined space P. The augmented reality providing system includes a server 100, a plurality of sensing units 200, a plurality of user terminals 300, and a plurality of experience terminals 400. Since the description of the plurality of user terminals 300 and the plurality of experience terminals 400 has been described with reference to FIG. 1 , it will be omitted below.

The server 100 performs at least one of costume information, face information, body information, and behavior information of each of a plurality of users based on the image and scan data for a predetermined space P received from the plurality of sensing units 200. Characteristic information including one or more and location information of each of a plurality of users is collected. The server 100 provides extended reality content matched to the user's location information to the user's terminal 300 corresponding to each feature information. Here, images and scan data are received from the plurality of sensing units arranged to photograph and scan different areas within a predetermined space P, and the different areas include one or more overlapping areas. The server 100 assigns a unique identification ID to each of a plurality of users based on the characteristic information, tracks the plurality of users assigned the unique identification ID, and collects location information of each user. For example, when a user is wearing a red tee and black shoes, the server 100 selects a red tee and search shoes as characteristics of the user from images and scan data received from the plurality of sensing units 200. It can be extracted, and a unique identification ID can be assigned to the corresponding user.

The server 100 allows the plurality of sensing units 200 to share IDs assigned to each of the plurality of users. More specifically, the server 100 includes a plurality of sensing units 200 that photograph and scan the overlapping area when a specific user among a plurality of users is sensed in the overlapping area by the plurality of sensing units 200. A user is recognized as a unique identification ID. This is when the plurality of sensing units 200 photographing and scanning different areas assign a first ID when recognizing a specific user in the first area, and assign a second ID when recognizing a specific user in the second area. Since a user is given several unique identification IDs, when a corresponding user is recognized in an overlapping area, a problem may occur in that the sensing units 200 recognize the corresponding user differently.

To solve this problem, the server 100 recognizes one user as one unique identification ID. The server 100 may extract user characteristics, classify the user characteristics, and assign a unique identification ID to each user through an artificial intelligence model.

A plurality of sensing units 200 are disposed on a predetermined space (P). The plurality of sensing units 200 are arranged to photograph and scan different areas within a predetermined space P, and the different areas include one or more overlapping areas. The plurality of sensing units 200 are inclined and disposed at different positions of the ceiling of a predetermined space P to photograph and scan different areas, thereby photographing and scanning a plurality of users from various angles. The plurality of sensing units 200 include a plurality of camera modules 210 and a plurality of lidar modules 220 .

A plurality of camera modules 210 continuously acquire 2D images of a plurality of users. A plurality of LIDAR modules 220 continuously acquire 3D scan data of a plurality of users. The plurality of LiDAR modules 220 have a 3D scan error range of 1 mm or less, and can be scanned in a 360-degree range.

The plurality of user terminals 300 include a communication module, a memory, an input/output module, and a processor.

The communication module of the user terminal 300 transmits and receives information between the server 100 and the experience terminal 400 . The communication module of the user terminal 300 may include a device including hardware and software necessary for transmitting/receiving a signal such as a control signal or a data signal through a wired/wireless connection with another network device.

The memory of the user terminal 300 stores an extended reality content execution program. The name of the extended reality content execution program is set for convenience of explanation, and the name itself does not limit the function of the program.

The input/output module of the user terminal 300 may receive information, data, etc. transmitted to the user terminal 300 from the outside or output information, data, etc. possessed by the user terminal 300 to the outside. For example, the input/output module of the user terminal 300 may include a display, a touch pad, a speaker, and a microphone.

The processor of the user terminal 300 is configured to execute the extended reality content execution program stored in the memory to perform the following functions and procedures.

The processor of the user terminal 300 receives motion information of the user from the experience terminal 400 and receives extended reality content matched with the user's location information from the server 100 . The user's movement information may be the user's head movement including head rotation and head direction. It is possible to know the direction the user is looking through the user's movement information.

The processor of the user terminal 300 provides the experience terminal 400 with an extended reality content image obtained by applying the user's field of view information according to the user's motion information to the extended reality content received from the server 100 . Through this, the processor of the user terminal 300 may provide the experience terminal 400 with an extended reality content image in a direction the user is looking at.

The plurality of experience terminals 400 include a communication module, a memory, an input/output module, an inertia module, and a processor.

The communication module of the experience terminal 400 transmits and receives information with the user terminal 300 . The communication module of the experience terminal 400 may include a device including hardware and software necessary for transmitting/receiving a signal such as a control signal or a data signal through a wired/wireless connection with another network device.

The memory of the experience terminal 400 stores an extended reality content output program. The name of the extended reality content output program is set for convenience of explanation, and the name itself does not limit the function of the program.

The input/output module of the experience terminal 400 may receive information, data, etc. transmitted to the experience terminal 400 from the outside or output information, data, etc. possessed by the experience terminal 400 to the outside. For example, the input/output module of the experience terminal 400 may include a display, a speaker, and a microphone.

The inertia module of the experience terminal 400 measures user movements such as head rotation, head movement speed, and head direction. The inertial module of the experience terminal 400 may be an inertial measurement unit (IMU) sensor.

The processor of the experience terminal 400 is configured to execute the extended reality content output program stored in the memory to perform the following functions and procedures.

The processor of the experience terminal 400 transmits the user motion measured by the inertia module to the user terminal 300 . The processor of the experience terminal 400 may receive an extended reality content image to which a user's motion is applied from the user terminal 300 and output the corresponding content image to an input/output module of the experience terminal 400 .

FIG. 3 is a block diagram showing the configuration of the server 100 shown in FIG. 1 .

Referring to FIG. 3 , the server 100 includes a communication module 110 , a memory 120 and a processor 140 , and may further include a database 130 .

The communication module 110 performs information transmission and reception with a plurality of user terminals and a plurality of sensing units. The communication module 110 may include a device including hardware and software necessary for transmitting and receiving a signal such as a control signal or a data signal to and from other network devices through a wired or wireless connection.

The memory 120 stores a content providing program. The name of the content providing program is set for convenience of explanation, and the name itself does not limit the function of the program. The memory 120 stores at least one of information and data input to the communication module 110, information and data necessary for functions performed by the processor 140, and data generated according to execution of the processor 140. can The memory 120 should be interpreted as collectively referring to a non-volatile storage device that continuously maintains stored information even when power is not supplied and a volatile storage device that requires power to maintain stored information. Also, the memory 120 may temporarily or permanently store data processed by the processor 140 . The memory 120 may include magnetic storage media or flash storage media in addition to volatile storage devices that require power to maintain stored information, but the scope of the present invention is not limited thereto. no.

The database 130 may be a place where data necessary to provide augmented reality content is stored. The database 130 may be built in a partial area of the memory 120 or implemented as separate hardware.

The processor 140 may include various types of devices that control and process data. The processor 140 may refer to a data processing device embedded in hardware having a physically structured circuit to perform functions expressed by codes or instructions included in a program. In one example, the processor 140 includes a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), an FPGA ( field programmable gate array), etc., but the scope of the present invention is not limited thereto. The processor 140 is configured to execute the content providing program stored in the memory 120 to perform functions and procedures performed by the server 100 described above with reference to FIG. 2 . That is, since the functions and operations performed by the processor 140 are substantially the same as the functions and operations performed by the server 100 described above, a description thereof will be omitted.

4 is a diagram showing an example of extended reality content provided by the system of FIG. 1, FIG. 4 (a) is a diagram showing a plurality of users in a real space (P1), and FIG. It is a diagram showing an example of providing augmented reality content to a plurality of users in the space P1.

Referring to (a) and (b) of FIG. 4 , a plurality of users 510 are located on a real space P1, the augmented reality providing system senses the plurality of users 510, and each user 510 The extended reality content is provided to the user terminal of the user terminal. Then, the user terminal provides the extended reality content to the user's experience terminal.

The augmented reality content may be generated in the server 100 of the augmented reality providing system and provided to the user terminal in the form of an interface including images and videos. The extended reality content may include at least one of landscaping, tiles, and other objects that add a sense of reality to the extended reality and allow interaction with the plurality of users 510 . The extended reality content may include sound information so that a plurality of users 510 may experience sound according to positions and angles. For example, when the augmented reality content includes an object such as a bell, when a user performs an act of ringing a corresponding bell, nearby users can also hear a bell suitable for each location. A higher volume bell sound is played for users located close to the bell, and a lower volume bell sound is played for users farther from the bell.

5 is a diagram showing an example of a process of sensing a plurality of users by a server of a collective experience-type augmented reality providing system. 5(a) is a diagram showing an example of photographing and scanning a predetermined space for each different area through a plurality of sensing units, and FIG. It is a diagram showing an example, and FIG. 5 (c) is a diagram showing an example of collecting location information of each of a plurality of users to which a unique identification ID is assigned, and FIG. It is a diagram showing an example of applying location information to augmented reality content.

Referring to (a) of FIG. 5 , the server 100 photographs and scans a predetermined space as different areas 610 , 620 , 630 , and 640 through the plurality of sensing units 200 . A plurality of camera modules 210 are disposed above a predetermined space, take pictures of different areas at an inclined angle, and each of the plurality of lidar modules 220 is adjacent to each of the plurality of camera modules 210. It is placed and scans a plurality of users in a 360-degree range. The different regions include a first region 610 , a second region 620 , a third region 630 and a fourth region 640 . The different regions 610, 620, 630 and 640 include one or more overlapping regions. For example, the overlapping area may be an overlapping area of at least one of the first area 610 , the second area 620 , the third area 630 , and the fourth area 640 .

Referring to (b) of FIG. 5 , the server 100 assigns a unique identification ID 650 to each of a plurality of users photographed and scanned in each area. The server 100 allows the plurality of sensing units 200 to share unique identification IDs assigned to each of the plurality of users. When a user is identified in an overlapping area of the first area 610 and the second area 620, the sensing units 200 that photograph and scan the first area 610 and the second area 620 select which one. One user can be recognized with one unique identification ID (650).

Referring to (c) and (d) of FIG. 5 , the server 100 collects location information 660 by tracking a plurality of users to which a unique identification ID 650 has been assigned. Then, the collected location information is matched with augmented reality content.

FIG. 6 is an operation flow chart illustrating a method for providing a group experiential type of augmented reality according to another embodiment of the present invention, and FIG. 7 is a diagram showing detailed processes of some steps of the method for providing a group experiential type of augmented reality. Hereinafter, a method for providing group experiential augmented reality will be described with reference to FIGS. 6 and 7 . Each step of the method for providing group experience-type augmented reality to be described below may be performed by the group experience-type augmented reality provision system described above with reference to FIGS. 1 to 5 . Therefore, the contents of the embodiments of the present invention described above with reference to FIGS. 1 to 5 can be equally applied to the embodiments to be described below, and descriptions overlapping with those described above will be omitted. The steps described below do not necessarily have to be performed in order, the order of the steps may be set in various ways, and the steps may be performed almost simultaneously.

Referring to FIG. 6 , the method for providing group experiential augmented reality includes receiving information (S1100), collecting feature information and location information (S1200), and providing content (S1300).

The information receiving step (S1100) is a step of receiving images and scan data from a plurality of sensing units. Images and scan data are received from a plurality of sensing units disposed to photograph and scan different areas within a predetermined space, and the different areas include one or more overlapping areas.

In the collecting feature information and location information (S1200), feature information including at least one or more of costume information, face information, body information, and behavior information of each of a plurality of users based on image and scan data of a predetermined space and This is a step of acquiring location information of each of a plurality of users.

The content providing step (S1300) is a step of providing extended reality content matched to the user's location information to the user's terminal corresponding to each feature information. Extended reality content may be transmitted to experience terminals configured to be attachable or detachable by the users linked to the user terminals. Experience terminals may output and display the transmitted extended reality content on a display.

Referring to FIG. 7 , the feature information and location information collection step (S1200) includes an ID assignment step (S1210) and location information collection step (S1220).

ID assignment step (S1210) is a step of assigning a unique identification ID to each of a plurality of users based on the characteristic information.

The location information collection step (S1220) is a step of collecting location information of each user by tracking a plurality of users to which a unique identification ID has been assigned.

The method for providing group experiential augmented reality using user characteristics according to the embodiments of the present invention described above is also in the form of a recording medium containing instructions executable by a computer, such as a program module executed by a computer. can be implemented Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

Those skilled in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention based on the above description. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting. The scope of the present invention is indicated by the following claims, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts thereof should be construed as being included in the scope of the present invention. The scope of the present application is indicated by the following claims rather than the detailed description above, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts thereof should be construed as being included in the scope of the present application.

100: server
110: communication module
120: memory
130: database
140: processor
200: sensing unit
210: camera module
220: lidar module
300: user terminal
400: experience terminal

Claims (18)

An apparatus for providing group experiential extended reality content to a plurality of users in a predetermined space,
A communication module for transmitting and receiving information with a plurality of user terminals and sensing units;
a memory for storing a content providing program; and
A processor for executing a program stored in the memory;
The processor executes the content providing program,
Based on the image and scan data of the predetermined space received from the sensing units, feature information including at least one of clothing information, face information, body information, and behavior information of each of the users and each of the users Acquiring location information of, and configured to provide extended reality content matching the location information of the user to a user terminal of a user corresponding to each characteristic information,
Wherein the extended reality content is transmitted to experience terminals configured to be detachable by the users interlocked with the user terminals. According to claim 1,
The image and scan data are received from the sensing units arranged to photograph and scan different areas in the predetermined space, and the different areas include one or more overlapping areas, providing a collective experiential type of extended reality. Device. According to claim 1,
the processor,
Based on the characteristic information, a unique identification ID is assigned to each of the users, and
and collecting location information of each user by tracking the users to whom the unique identification ID has been assigned. According to claim 3,
The processor
To share the unique identification ID assigned to each of the users of the image and scan data, a group experience-type augmented reality providing device. According to claim 2,
When a specific user among the users is photographed and scanned in the overlapping area,
the processor,
The apparatus for providing group experience-type augmented reality, wherein the sensing units sensing the overlapping area among the sensing units recognize the specific user with the same unique identification ID. A method of providing group experiential extended reality content to a plurality of users in a predetermined space, performed by a processor, comprising:
a) receiving images and scan data of the predetermined space from a plurality of sensing units disposed on the predetermined space;
b) obtaining feature information including at least one of costume information, face information, body information, and behavior information of each of the users and location information of each of the users based on the image and scan data; and
c) providing extended reality content matched to the user's location information to a user's terminal corresponding to each feature information;
Wherein the extended reality content is transmitted to experiential terminals configured to be attachable and detachable to the users interlocked with the user terminals. According to claim 6,
The image and scan data are received from the sensing units arranged to photograph and scan different areas in the predetermined space, and the different areas include one or more overlapping areas, providing a collective experiential type of extended reality. method. According to claim 6
In step b),
assigning a unique identification ID to each of the users based on the characteristic information; and
and collecting location information of each user by tracking the users to whom the unique identification ID has been assigned. In a system for providing group experiential extended reality content to a plurality of users in a predetermined space,
server;
a plurality of user terminals connected to the server in communication;
a plurality of sensing units for obtaining images and scan data of the predetermined space; and
Includes a plurality of experience terminals configured to output extended reality content received from the user terminals and to be detachable by the users;
The server may include characteristic information including at least one of costume information, face information, body information, and behavior information of each of the users and location of each of the users based on the image and scan data received from the sensing units. obtain information, and
A group experience-type augmented reality providing system, which provides extended reality content matching the user's location information to a user terminal corresponding to each characteristic information. According to claim 9,
The sensing units are arranged to photograph and scan different areas within the predetermined space, and
Wherein the different areas include one or more overlapping areas, a group experiential augmented reality providing system. According to claim 9,
The sensing units include a plurality of camera modules and LIDAR modules,
The camera modules continuously acquire two-dimensional images of the users, and
The lidar modules continuously acquire the three-dimensional scan data of the users, the collective experiential augmented reality providing system. According to claim 10,
The server,
Based on the characteristic information, a unique identification ID is assigned to each of the users, and
Collecting location information of each user by tracking the users to whom the unique identification ID is assigned, a collective experience-type augmented reality providing system. According to claim 12,
The server,
The group experience-type augmented reality providing system, wherein the sensing units share a unique identification ID assigned to each of the users. According to claim 13,
When a specific user among the users is sensed in the overlapping area by the sensing units,
The server,
The group experience-type augmented reality providing system, wherein the sensing units for photographing and scanning the overlapping area recognize the specific user with the same unique identification ID. According to claim 9,
The experience terminals include an inertia module that senses the motions of the users and generates motion information of each user, and
The user terminals,
and providing an extended reality content image obtained by applying user's view information according to the movement information to the extended reality content matched to the location information received from the server to the experience terminals. A method of providing group experiential extended reality content to a plurality of users in a predetermined space performed by a server, the method comprising:
i) receiving images and scan data of the predetermined space through a plurality of sensing units disposed on the predetermined space;
ii) collecting characteristic information including at least one of costume information, face information, body information, and behavior information of each of the users and location information of each of the users from the image and the scan data; and
iii) A method for providing group experience-type augmented reality, which includes transmitting extended reality content matched with location information of a corresponding user to a user terminal of a user corresponding to each characteristic information. According to claim 16,
In step i),
receiving the image and scan data from the sensing units disposed to photograph and scan different areas within the predetermined space; and
Wherein the different regions include one or more overlapping regions, a collective experiential type of augmented reality providing method. According to claim 17,
In step ii),
assigning a unique identification ID to each of the users based on the characteristic information; and
and collecting location information of each user by tracking the users to whom the unique identification ID has been assigned.

Images