KR20210157738A - System for certificating and synchronizing virtual world and physical world - Google Patents

Abstract

Provided is a digital twin service, which registers a device or space existing in physical space in the form of a digital object on the virtual space, and connects an offline device or space to a digital object on the virtual space. A computer device of the present invention comprises at least one processor implemented to execute computer readable instructions.

Description

A system for authenticating and synchronizing the virtual world and the physical world

The description below relates to a technology for authenticating and synchronizing the virtual world and the physical world.

In the existing browsing environment, the operator operating the media providing the service and the third-party operator, which is an external operator, each used their own cookies to record and utilize user information. For example, a third-party operator exposes appropriate information to users in real time through the operator's medium using programmatic bidding or real time bidding (RTB) based on information obtained through cookies.

However, in the case of virtual space, there is a problem in that it is difficult to effectively collect and confirm user experience information from the perspective of a third-party operator because all user experiences are made in a provider-centered environment of a specific virtual space. Accordingly, in the prior art, the third-party operator simply exposes general information to an unspecified number of users regardless of the user's activity in the virtual space, or based on information other than the user's activity in the virtual space, such as a user's profile. There is a limit in providing the user with relevant information.

[Prior literature number]

Korean Patent Publication No. 10-2002-0007892

It is possible to provide a method and a system for authentication and synchronization when the virtual world and the physical world are interconnected.

A method and system for authenticating a device in a space of a virtual world may be provided.

A method and system for authenticating a space to be registered on a DTS (Digital Twin Space) may be provided.

A method and system may be provided for performing user check-in on a certified space.

at least one processor implemented to execute computer readable instructions, wherein the at least one processor establishes, by the at least one processor, an interconnection relationship between the virtual space and the physical space based on the information of the virtual space and the information of the physical space It provides a computer apparatus, characterized in that it manages and registers a device or space existing in the physical space in the form of a digital object in the virtual space.

According to one aspect, the at least one processor may provide a digital twin service through association between an offline device or an offline store and a digital object in the virtual space.

According to another aspect, the at least one processor may synchronize user information and activity information between the virtual space and the physical space according to whether the user approves the synchronization.

According to another aspect, the at least one processor may connect event information related to a digital object in the virtual space as the information in the virtual space.

According to another aspect, the information related to the agent in the virtual space may be connected by the at least one processor as the information in the virtual space.

According to another aspect, the at least one processor may connect information related to currency of the virtual space as the information of the virtual space.

According to another aspect, a device recognizable in the virtual space may be registered by the at least one processor using device information or a code issued through pre-authentication.

According to another aspect, the at least one processor may register a recognizable space in the virtual space using map-based data or spatial information.

According to another aspect, the at least one processor may register software in the form of a digital object in the virtual space using a unique key value.

According to another aspect, a group consisting of a plurality of agents may be registered in the form of a digital object on the virtual space by the at least one processor.

According to another aspect, in the case of a device that provides a service linked to the virtual space, the device may be registered by the at least one processor in the form of pre-authentication at the time of device production.

According to another aspect, the at least one processor may perform a status check of the device based on data periodically received from the device or information collected in the virtual space.

According to another aspect, the at least one processor may manage information on the physical space bound to the virtual space, and manage user access and visit records associated with the space.

According to another aspect, a connection with a network service for traffic transmitted from the physical space may be provided by the at least one processor.

According to another aspect, the at least one processor may receive, buffer or queue data transferred from the device or the space, and route the data.

According to another aspect, the at least one processor may manage local information and owner information related to the space as information of the physical space.

According to another aspect, a key used for a link service between the virtual space and the physical space may be issued and managed by the at least one processor.

According to another aspect, the at least one processor may manage the approval for each individual service subject participating in the link service between the virtual space and the physical space.

According to embodiments of the present invention, it is possible to authenticate and synchronize the interconnection relationship between the virtual world and the physical world.

According to embodiments of the present invention, it is possible to authenticate a device in the space of the virtual world for mutual linkage between the virtual world and the physical world.

According to embodiments of the present invention, it is possible to authenticate a space to be registered on the DTS for mutual linkage between the virtual world and the physical world.

According to embodiments of the present invention, user check-in in an authenticated space may be performed.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention.
2 is a block diagram illustrating an example of a computer device according to an embodiment of the present invention.
3 is a view for explaining spaces according to an embodiment of the present invention.
4 is a diagram illustrating an example of movement between spaces in a virtual world according to an embodiment of the present invention.
5 is a diagram illustrating a relationship between elements constituting a space of a virtual world according to an embodiment of the present invention.
6 is a diagram illustrating an example in which a digital object is configured in a space of a virtual world according to an embodiment of the present invention.
7 is a diagram illustrating an example of information for determining whether to expose digital objects to an agent in a space of a virtual world according to an embodiment of the present invention.
8 is a view showing a general appearance of a virtual space configuration system according to an embodiment of the present invention.
9 is a block diagram illustrating an example of an internal configuration of a virtual space management system according to an embodiment of the present invention.
10 to 11 show examples of connecting the physical space PS and the virtual space VS according to an embodiment of the present invention.
12 illustrates an example of a service target based on a link function between a physical space (PS) and a virtual space (VS) according to an embodiment of the present invention.
13 is a diagram for explaining examples of a virtual space (VS) according to an embodiment of the present invention.
14 is a block diagram illustrating an example of an authentication and synchronization system for connection between a physical space (PS) and a virtual space (VS) according to an embodiment of the present invention.
15 is a flowchart illustrating an example of a device authentication process according to an embodiment of the present invention.
16 is a flowchart illustrating an example of an agent registration process according to an embodiment of the present invention.
17 is a flowchart illustrating an example of a space authentication process according to an embodiment of the present invention.
18 illustrates an example of a user check-in process in an authenticated space according to an embodiment of the present invention.
19 is a flowchart illustrating an example of a user check-in process in an authenticated space according to an embodiment of the present invention.
20 is a diagram illustrating an example of an interface screen for synchronizing approval when a PS and a VS are linked according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention. The network environment of FIG. 1 shows an example including a plurality of electronic devices 110 , 120 , 130 , 140 , a plurality of servers 150 , 160 , and a network 170 . 1 is an example for explaining the invention, and the number of electronic devices or the number of servers is not limited as in FIG. 1 . In addition, the network environment of FIG. 1 only describes one example of environments applicable to the present embodiments, and the environment applicable to the present embodiments is not limited to the network environment of FIG. 1 .

The plurality of electronic devices 110 , 120 , 130 , and 140 may be a fixed terminal implemented as a computer device or a mobile terminal. Examples of the plurality of electronic devices 110 , 120 , 130 , 140 include a smart phone, a mobile phone, a navigation device, a computer, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), and a portable multimedia player (PMP). ), tablet PCs, etc. As an example, in FIG. 1 , the shape of a smartphone is shown as an example of the electronic device 110 , but in embodiments of the present invention, the electronic device 110 is substantially different through the network 170 using a wireless or wired communication method. It may refer to one of various physical computer devices capable of communicating with the electronic devices 120 , 130 , 140 and/or the servers 150 and 160 .

The communication method is not limited, and not only a communication method using a communication network (eg, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network 170 may include, but also short-range wireless communication between devices may be included. For example, the network 170 may include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). , the Internet, and the like. In addition, the network 170 may include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, etc. not limited

Each of the servers 150 and 160 communicates with the plurality of electronic devices 110 , 120 , 130 , 140 and the network 170 through a computer device or a plurality of computers to provide commands, codes, files, content, services, etc. It can be implemented in devices. For example, the server 150 provides services (eg, virtual space-based services, instant messaging services, game services, It may be a system that provides a group call service (or voice conference service), a messaging service, a mail service, a social network service, a map service, a translation service, a financial service, a payment service, a search service, a content providing service, etc.).

2 is a block diagram illustrating an example of a computer device according to an embodiment of the present invention. Each of the plurality of electronic devices 110 , 120 , 130 , 140 or the servers 150 and 160 described above may be implemented by the computer device 200 illustrated in FIG. 2 .

As shown in FIG. 2 , the computer device 200 may include a memory 210 , a processor 220 , a communication interface 230 , and an input/output interface 240 . The memory 210 is a computer-readable recording medium and may include a random access memory (RAM), a read only memory (ROM), and a permanent mass storage device such as a disk drive. Here, a non-volatile mass storage device such as a ROM and a disk drive may be included in the computer device 200 as a separate permanent storage device distinct from the memory 210 . Also, an operating system and at least one program code may be stored in the memory 210 . These software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210 . The separate computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD/CD-ROM drive, and a memory card. In another embodiment, the software components may be loaded into the memory 210 through the communication interface 230 instead of a computer-readable recording medium. For example, the software components may be loaded into the memory 210 of the computer device 200 based on a computer program installed by files received through the network 170 .

The processor 220 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. The instructions may be provided to the processor 220 by the memory 210 or the communication interface 230 . For example, the processor 220 may be configured to execute a received instruction according to a program code stored in a recording device such as the memory 210 .

The communication interface 230 may provide a function for the computer device 200 to communicate with other devices via the network 170 . For example, a request, command, data, file, etc. generated by the processor 220 of the computer device 200 according to a program code stored in a recording device such as the memory 210 is transmitted to the network ( 170) to other devices. Conversely, signals, commands, data, files, etc. from other devices may be received by the computer device 200 through the communication interface 230 of the computer device 200 via the network 170 . A signal, command, or data received through the communication interface 230 may be transferred to the processor 220 or the memory 210 , and the file may be a storage medium (described above) that the computer device 200 may further include. persistent storage).

The input/output interface 240 may be a means for an interface with the input/output device 250 . For example, the input device may include a device such as a microphone, keyboard, or mouse, and the output device may include a device such as a display or a speaker. As another example, the input/output interface 240 may be a means for an interface with a device in which functions for input and output are integrated into one, such as a touch screen. At least one of the input/output devices 250 may include the computer device 200 and one device. For example, like a smart phone, a touch screen, a microphone, a speaker, etc. may be implemented in a form included in the computer device 200 .

Also, in other embodiments, the computer device 200 may include fewer or more components than those of FIG. 2 . However, there is no need to clearly show most of the prior art components. For example, the computer device 200 may be implemented to include at least a portion of the above-described input/output device 250 or may further include other components such as a transceiver and a database.

3 is a view for explaining a space according to an embodiment of the present invention. 3 shows a physical space (PS) that is a real world space, and a virtual space (VS (Virtual Space, 320), MS (Mixed Space, 330) and DTS (Digital Twin Space, 340) of the virtual world).

The space of the virtual world can be designed by the provider (operator) of the virtual world, or can be configured by a user or a third party operator who is an external operator. The space of the virtual world may be configured in the form of the VS 320 , the MS 330 , and/or the DTS 340 according to the characteristics of the space. The VS 320 may be a pure digital-based space that can be interlocked with a CPS (Cyber Physical System), and the DTS 340 may be a space interlocked with the CPS as a real world-based virtual space, and the MS 330 may be a space in which the VS 320 and the DTS 340 are mixed. In the case of the MS 330, it may be provided in a form in which an agent, which is a user's object, is adapted to the real world environment, or in a form in which the real world environment is rendered in the virtual world.

The space of the virtual world is a concept of a basic virtual space in which the user's agent can act, and policies regarding agent activity and information utilization and/or exposure may exist for each space. When the user's agent uses the service in the space of a specific virtual world, the user should be able to recognize that each personal information and Privacy & Terms exist according to the subject of the service provision.

The space of the virtual world can be created and utilized in various ways depending on the provider or user. To this end, a separate gate may be provided as an interface for the movement of the agent between spaces of each virtual world.

4 is a diagram illustrating an example of movement between spaces in a virtual world according to an embodiment of the present invention. 4 illustrates a gate #1 430 for movement between two virtual spaces, VS #1 410 and VS #2 420 . Here, the 'gate' may be a basic interface that provides movement between spaces in the virtual world. This 'gate' can control not only movement between the spaces of the virtual world, but also movement between the space of the virtual world and the space of the non-virtual world. For example, in FIG. 4 , the agent of VS#1 410 is also a moving target as a space in a non-virtual world such as a web page, a streaming channel, streaming content, a game environment, an actual offline video call, etc. indicates that it can be moved. The method of classifying the space of the virtual world may be determined by the provider of the space of the virtual world.

The agent may mean a user or a program in the space of the virtual world. Here, the agent as a program may be a virtual avatar or persona existing on behalf of a third-party operator in the form of an artificial intelligence agent. Physical characteristics of the space of the virtual world to which the agent belongs may be applied to such an agent, and a service profile set in the space of the virtual world may be applied. In addition, the agent may have characteristics based on the information of the physical device used by the user. For example, the agent may have a viewing angle according to a display characteristic of a physical device used by the user or a control characteristic according to a controller of the corresponding physical device.

In addition, a digital object, which will be described later, is a core element constituting world information in the space of the virtual world, and may collectively refer to objects that provide a function of interaction with an agent.

5 is a diagram showing the relationship between elements constituting the space of the virtual world according to an embodiment of the present invention, and FIG. 6 is an example in which a digital object is configured in the space of the virtual world according to an embodiment of the present invention. It is the drawing shown.

5 shows that the space 500 of the virtual world, such as the VS 320 , the MS 330 , and/or the DTS 340 described above with reference to FIG. 3 , may include a digital object 510 . have. In this case, the digital object 510 may be formed in an object area (OA) that is an area included in the space 500 of the virtual world. In addition, the digital object 510 is a display object (Display Object, DO, 511), an interaction object (Interaction Object, IO, 512), a web object (Web Object, WO, 513) and a streaming object (Streaming Object, SO, 514) ) may be included. In this case, each of the display object 511 , the interaction object 512 , the web object 513 , and the streaming object 514 may selectively include a display area for displaying content.

6 shows an example in which digital objects are arranged in object areas 610 to 640 formed on the space 600 of the virtual world. In this case, the digital objects may include DOs 651 to 654 as display objects, IOs 661 to 663 as interaction objects, WO 671 as web objects, and/or SO 681 as streaming objects. The dotted arrows 691 and 692 shown in FIG. 6 represent examples of the agent's movable movement line.

As in the example of FIG. 6 , various types of digital objects may exist in the space of the virtual world according to an embodiment of the present invention. Each digital object may be created centered on the agent according to a predetermined condition, and in this case, the digital object may be created on the object area. When the space of the virtual world simulates the real world as in the DTS (eg, the DTS 340 of FIG. 3 ), the location of the object area may be determined based on the determined physical location of the real world. For example, when a specific shopping mall or historic site in the real world is virtualized, the location of the object area may be determined to have the same configuration as the actual location configuration.

A DO (Display Object) may be an object exposed in a spatial form (structural form) in the space of the virtual world, and a simple control function may be provided to the agent. An IO (Interactive Object) may be exposed in a spatial form in the space of the virtual world, and may be an object with interactive characteristics that can interact with an agent. For example, an IO may provide various interaction characteristics with an agent. In addition, a WO (Web Object) may be an object in the form of exposing content on the web through a space of a virtual world. Also, a streaming object (SO) may be an object in which streaming content such as video and audio can be continuously exposed.

The OA may have a space characteristic in which a digital object, which is a virtual object, can be created in the space of the virtual world. A digital object existing on the OA may have the following characteristics. Whether to provide each function may be determined based on a contract between the owner of the digital object and the provider of the virtual world space.

1. Agent linkage related functions

1) Interaction function: A function that provides an interface that the agent can directly control

2) History function: The ability to track and store agent visits and interactions related information

3) Saving Interest Information (Favorite/Like) Function: The ability for the agent to store interest information about a digital object

4) Follow me function: A function to make digital objects on OA into small windows or icons and follow them around the agent.

2. Functions related to external API linkage

1) A function to share information about the creation and end times of digital objects in the space of the virtual world

2) Interface function to externally provide agent-related information collected by digital objects on OA

3) Interface function to reflect real world information and express it on DO or IO (for example, a function to express information such as order waiting in an actual store, congestion level in the store, parking situation, etc.)

3. Gate linkage related functions

1) Gate connection function: A function to connect the agent to another VS or PS in the digital object existing on the OA

4. Display Area (DA) related functions

1) DA function: This is an area where the owner of the digital object can expose content according to his/her own will, and it can be exposed to the agent.

2) Display content request function: Ability to receive external content through the Real Time Content Control Module

On the other hand, DO and IO are some of the elements constituting the space of the virtual world and may exist on the OA. DO and IO are basically displayed in the form displayed on the user's screen, and may have the characteristics of a structure having a certain standard. The external information of DO can be designed by the owner of the DO to the provider of the virtual world space, by using a template provided by the provider, or by using a preset tool. Also, each DO and IO may have a DA directly controllable by the owner. Content exposed on the DA may be provided according to the selection of the owner of the DO and/or IO within an appropriate range based on a policy between the owner of the DO and/or IO and the provider of the space. The DA may have an exposure characteristic (perspective, or a characteristic for ignoring and emphasizing perspective, etc.) and an interaction characteristic according to an agent's viewing angle individually. In addition, each IO may have interactive features that the owner of the IO can directly control. The IO may provide an interaction suitable for the agent's situation based on the agent's interaction characteristic activation information. For example, if the user only wears a head mounted display (HMD), the IO may provide the same type of operation function as the DO. On the other hand, when the user has a controller combined with the HDM, it is possible to provide interaction features (eg, grabbing, pulling, drawing, etc.) with the agent provided in the space of the virtual world. As another example, if the user has an additional motion recognition controller, the corresponding feature may be utilized. In the case of DO, it may have basic control features. These basic control features may include a basic control function of the space of the virtual world set by the provider. For example, the basic control function may include setting history and/or setting interest information.

7 is a diagram illustrating an example of information for determining whether to expose digital objects to an agent in a space of a virtual world according to an embodiment of the present invention. 7 shows a state in which the object area 710, the digital object 720, and the agent 730 are arranged in the space 700 of the virtual world. The space 700 of the virtual world may be linked with the physical world (the real world) 740 . Here, the digital object features (Digital Object Features) may include the object area features (Object Area Features). The characteristics of the object area 710 may include basic information on a specific area in the space 700 of the virtual world. For example, a plurality of sub-digital objects may exist in the space 700 of the virtual world, and each of the plurality of sub-digital objects may follow an existing policy of a corresponding object area. Also, as already described, the digital object 720 may be any one of DO, IO, WO, and SO. Accordingly, the characteristics of the digital object 720 may include any one of characteristics of DO, characteristics of IO, characteristics of WO, and characteristics of SO. In addition, the characteristics of the digital object 720 may further include the characteristics of the display area 750 included in the digital object 720 and the tracking characteristics 760 for the agent 730. have.

At this time, in order to determine whether to expose the digital object 720 to the agent 730 in the space 700 of the virtual world, (1) the characteristics of the digital object 720, (2) the viewing angle of the object 730 (Field of View, FoV) and (3) the distance between the agent 730 and the display area 750 may be utilized.

8 is a view showing a general appearance of a virtual space configuration system according to an embodiment of the present invention. The virtual space configuration system 800 of FIG. 8 includes a VR client device (Virtual Reality (VR) Client Device, 810), a mobile edge computing device (Mobile Edge Computing Device, 820), an edge computing device (Edge Computing Device, 830) and It may include a cloud computing system (Cloud Computing System, 840). Each of the VR client device 810 , the mobile edge computing device 820 , the edge computing device 830 , and the cloud computing system 840 may be implemented through the computer apparatus 200 described above with reference to FIG. 2 . It will be readily appreciated that cloud computing system 840 may be implemented by more than one computer device 200 .

The VR client device 810 may be a physical device for displaying the space of the virtual world to the user, and as shown in FIG. 8 , the rendering machine 811 and the rendering machine 811 may include a virtual space controller (hereinafter, “VSC”, 812 ), a head mounted display (hereinafter, “HMD”, 813 ), and controllers and sensors (Controllers & Sensors, 814 ). The rendering machine 811 may display the space of the virtual world on the head mounted display 813 through the VSC 812, and the output values of the controller and the sensor 814 control the user's agent in the space of the virtual world, or and/or may be utilized to interact with a digital object disposed in the space of the virtual world.

According to an embodiment, the VSC 812 may not be directly included in the VR client device 810 or the rendering machine 811 , but may be included in the mobile edge computing device 820 or the edge computing device 830 . For example, if the user's VR client device 810 is a level device capable of directly rendering the space of the virtual world, the space of the virtual world may be rendered using the VSC 812 of the VR client device 810. can On the other hand, when the user's VR client device 810 cannot directly render the space of the virtual world, the VR client device 810 wirelessly connects to the VSC of the mobile edge computing device 820 through the access point 822. The space of the virtual world may be rendered and displayed on the HMD 813 through the 821 or through the VSC 831 of the edge computing device 830 connected by wire. When both the mobile edge computing device 820 and the edge computing device 830 are not supported, as will be described later, a Virtual Space Controller farm 842 included in the cloud computing system 840 is used. Thus, the space of the virtual world can be rendered. The virtual space controller farm 842 may create an instance of the VSC for the user and support the user to display the rendered virtual world space on the HMD 813 . Here, the VSCs 812 , 821 , and 831 may be VSC instances generated and provided by the cloud computing system 840 through the virtual space controller farm 842 .

The VSCs 812 , 821 , and 831 may render the space of the virtual world so that the content delivered in relation to the display area of the digital object can be displayed in the space of the virtual world for the agent. The VSCs 812 , 821 , and 831 may be created for the user's VR client device 810 corresponding to the agent by the cloud computing system 840 that provides a service by configuring the space of the virtual world, and the VR client It may be launched in at least one of the device 810 , the mobile edge computing device 820 , the edge computing device 830 , and the cloud computing system 840 to support rendering of a space in the virtual world for the VR client device 810 . .

On the other hand, the VR client device 810 is directly connected to the cloud computing system 840 or connected to the cloud computing system 840 through the mobile edge computing device 820 or the edge computing device 830 to interact with the space of the virtual world. related services can be provided.

The cloud computing system 840 may be a system of a business operator for configuring the space of the virtual world and providing a service related to the space of the virtual world to the user. As shown in FIG. 8 , the cloud computing system 840 may include a virtual space management system 841 and a virtual space controller farm 842 . The virtual space controller farm 842 may be implemented in a form included in the virtual space management system 841 . The virtual space management system 841 will be described in more detail later with reference to FIG. 9 .

9 is a block diagram illustrating an example of an internal configuration of a virtual space management system 841 according to an embodiment of the present invention. As shown in FIG. 9, the virtual space management system 841 according to this embodiment includes a client interface (Client I/F, 910), an agent tracking management module (Agent Tracking Management Module, 920), an agent information management module ( Agent Information Management Module (930), Virtual World Information Management Module (940), Real Time Content Control Module (950), Physical World Interface Module (960) and A virtual space controller farm 842 may be included. The components of the virtual space management system 841 may be functional expressions of the processor 220 included in at least one computer device 200 implementing the cloud computing system 840 .

The client interface 910 may provide a user interface for the VR client device 810 . For example, the client interface 910 allows the user to interact with the space of the virtual world while the user is provided with a service for the space of the virtual world provided by the cloud computing system 840 using the VR client device 810 . It can provide a variety of user interfaces to work with.

The agent tracking management module 920 may track agents disposed and moving in the space of the virtual world. The information obtained by tracking the agent can be stored in real time in association with the agent's identifier in the tracking database, and the tracking history information about the agent is stored in the tracking history database (Tracking History DB) with the agent's identifier and identifier. can be stored in association.

The agent information management module 930 may store the agent's profile and the agent's consent. For example, the agent information management module 930 may store the agent's profile in association with the agent's identifier in the agent profile database (Agent Profile DB), and associate the agent's consent with the agent's identifier to associate the agent with the agent's identifier. It can be stored in the consent database (Agent Consent DB). Here, consent may include consent to personal information and terms of use.

The virtual world information management module 940 may manage information about the space of the virtual world. For example, the virtual world information management module 940 may include information about a policy of a space of a virtual world, virtual map information, and location information of a space of a virtual world (eg, space of a virtual world). GPS information), information of digital objects arranged in the space of the virtual world, etc. can be stored, and the corresponding information can be provided in response to a request from another module.

The real-time content control module 950 may select content to be displayed in the space of the virtual world. For example, the real-time content control module 950 may select content to be displayed through a display area of a digital object configured in a virtual world space. To this end, the real-time content control module 950 may include a function for content bidding and a function for selecting content to be displayed. For example, the real-time content control module 950 may select content to be displayed through the display area based on a bidding for the third-party display content provider 970 .

The physical world interface module 960 may provide a function for controlling a physical resource and an interface for the physical resource.

As described above, the virtual space controller farm 842 may create, provide, and manage an instance of the VSC to assist in rendering the VR client device 810 .

The virtual space management system 841 may receive HMD information and control/sensor information from the VR client device 810 . The HMD information may include device motion tracking information of 3-DoF (Degrees of Freedom) or 6-DoF. Here, the device motion tracking information may include motion tracking information for the VR client device 810 . In addition, the HMD information may include user information from the VR client device 810 . For example, the user information may include rotation of the user's head, movement of the user's body, and eye-gaze information of the user. In addition, the HMD information may include rendering related information such as rendering delay and temperature. Meanwhile, the control/sensor information may include information about the movement of the user's body or real-time controller information such as a key event and movement.

Hereinafter, specific embodiments of a method and system for providing a service through the connection between a user, a device, and a space in a VR space will be described.

In order to provide a service based on the link function between the virtual world and the real world, trust between the digital object and the agent is required.

(1) Usage example 1: Agent service can be differentiated through linkage between offline stores and digital objects.

When a digital object conducts an event for an agent, a user visits and purchases an offline store in a situation where a store in the real world is in the form of a digital object on the virtual space controller (VSC (812, 821, 831)) If there is, differentiated service is provided on VS.

When a digital object is an individual service subject and wants to perform a customized service or event using agent information, a trust-based data provision method between the digital object and the agent is required.

In addition, from the point of view of the digital object, a means should be provided to confirm that the profile of the collecting agent is reliable.

(2) Usage example 2: A mutual link service between an offline device and a virtual device on VS can be provided.

FIG. 10 shows an example of connecting the PS 1010 corresponding to the offline fitness center and the devices in the PS 1010 with the digital objects in the VS 1020 and the VS 1020 .

As the user visits the fitness center on the PS 1010, which is the real world, and exercises on the device certified in the form of a digital twin, the agent of the VS 1020 also visits the fitness center on the VS 1020 to exercise. A change in the agent's shape may occur and compensation may be made accordingly.

When the user is exercising offline, the PS(1010) fitness center provides a digital twin function with the VS(1020), and if the user's agent wants to show the simultaneity in the cyberspace, the agent will use the VS(1020) You can simulate exercising through the device on the screen.

Alternatively, in order to show how active offline subscribers on the VS 1020 are in terms of the fitness center, it may represent a state in which an arbitrary agent provided by a service provider rather than an agent of an actual user is exercising. A general agent who visits fitness on the VS 1020 may determine the degree of activation of the corresponding offline environment by checking virtual information currently used by the digital twin-based agent of the registered user. Through this, an unsubscribed agent who visits the fitness center on the VS 1020 may determine whether to subscribe in the real world by viewing the active level of the corresponding fitness.

And, the exercise record may be reflected in real time or may be reflected by the user's decision on the VS 1020 according to the user's selection. In this process, the fitness center operator can choose between real-time or non-real-time linkage depending on the subscription model of the digital twin.

(3) Usage example 3: A method for authenticating the identity of the agent is required when dating on VS.

11 shows an example of a shopping mall providing a digital twin service simulating the real world PS 1110. Stores in the shopping mall on the PS 1110 may be expressed as digital objects on the VS 1120 based on the state information of the individual stores. Virtual users generated based on the number of users entering and leaving the shopping mall may be included on the VS 1120 , and when a location such as a proximity sensor can be identified, user processing is possible based on location information. The VS 1120 may include an agent who wants to express their information among users who have checked in at a specific store, or an agent created as a virtual customer on the VS 1120 based on the information checked in at a specific store, in this case, the agent User characteristics such as face, clothes, and state can be imaged and expressed so that the difference between the two can be visually distinguished. When a user who has checked in at a specific store allows his/her agent to be exposed to the VS 1120 , the agent may have an explicit appearance including user information, unlike a ghost agent.

12 shows an example of a service target based on a link function between PS and VS. In this embodiment, a method for mutually linking and authenticating between PS and VS is required. It is necessary to organize information that can be linked in each area and provide a system to link it. In this case, information for mutual linkage between PS and VS can be exposed or controlled according to the situation, and the information can be supplied to a desired consumer.

Referring to FIG. 12 , the certification controller 1210 provides a core function of managing the interconnection relationship in connecting the VS and the PS. Basically, the authentication controller 1210 provides a registration process for connecting information on the PS on the VS, and provides authentication as to whether a space exists in the real world or the like. Information for interconnection between PS and VS can be controlled by VSC 1220 (corresponding to one of 812, 821, and 831), and can be used with reliable real-world data acquisition systems such as Data Creator 1230 and It is possible to share data with a certified data consumer (Certified Data Consumer, 1240) as an institution that uses it and links with it.

The physical digital element (Digital Element with Physical, 1250) includes information related to the environment in the VS environment (eg, air, wind, temperature, etc.) and other information connected to spatial information (eg, check-in information of a shopping mall or proximity sensor). information, traffic jams, etc.). The physical digital element 1250 is a generic term for other entities other than entities with separate owners, such as digital objects (DO, IO, etc.) 1260 , and may include information connected to the PS.

The data generator 1230 is an external API that generates actual user information, and includes information that can be reflected on VS, and may correspond to, for example, an authenticated fitness app.

13 shows examples of VS. Each space on the VS 1310 has a spatial specificity similar to that of an actual PS when a digital twin-based service is provided.

A public space (1311), which is one of the VS (1310), means a space created for the agent of the VS (1310), such as a square, a park, etc., in order to enter the public space (1311), a separate agent No permission is required, and devices in the real world connected to the public place 1311 are controlled by the VSC (corresponding to one of 812, 821, and 831).

The commercial space 1312, which is another one of the VS 1310, refers to a digital object paid by a specific operator, such as a store, and generally refers to a space simulating an offline store in the real world. Although the commercial space 1312 is basically accessible by an anonymous agent, only a registered agent can access the space of some digital objects according to the characteristics of the owner of the space. A device connected to the commercial space 1312 is linked through the VSC (corresponding to one of 812, 821, and 831), and the space owner may be delegated control authority for the commercial space 1312 from the VSC.

Another one of the VS 1310, Home (Personal) Space, 1313 is a digital object constructed by an individual and means a private space. The personal space 1313 is basically accessible only by the owner of the space, and can be accessed by a registered agent according to the request of the owner of the space. A device connected to the personal space 1313 is linked through the VSC (corresponding to one of 812 , 821 , and 831 ), and the space owner may be delegated control authority for the personal space 1313 from the VSC.

In the case of an agent using the above-described VS 1310 and the digital twin service, VS information owned by the agent and device information interworking on the VS may be exposed based on approval. The VSC (corresponding to one of 812, 821, and 831) may utilize VS information and device information in an unidentified or anonymized form.

When an agent visits a specific store corresponding to the commercial space 1312 on the VS 1310 using VS information and device information, the store can recommend customized products based on the user's information on the VS 1310. . For example, if there is a coffee machine in the commercial space 1312 , a user's favorite coffee bean may be recommended, and if there is an audiobook, an audiobook of a similar genre preferred by the user may be recommended.

A certified space may refer to a space in which a space simulating a space (shop, brand, etc.) existing in the real world exists on the VS 1310 and provides a function interconnected with the real world. The requirements of the certified space include (1) user check-in, (2) connection with POS (point of sales) for membership registration, purchase, point accumulation, etc. It may include association with a device, and the like. Additional compensation may be provided when using certified devices such as store BGM and fitness GYM in a certified space.

14 is a diagram schematically illustrating an authentication and synchronization system according to an embodiment of the present invention. The authentication and synchronization system 1400 of FIG. 14 provides an authentication and synchronization (interworking) process for connection between the PS 1401 and the VS 1402 .

The authentication and synchronization system 1400 may be implemented through the computer device 200 described with reference to FIG. 2 . According to an embodiment, the authentication and synchronization system 1400 may be implemented in a form included in the virtual space management system 841 described with reference to FIG. 8 or implemented in a form capable of interworking with the virtual space management system 841 as a separate system. can

The authentication and synchronization system 1400 may include the service targets (authentication controller 1210 , VSC 1220 , data generator 1230 , etc.) described with reference to FIG. 12 .

Referring to FIG. 14 , the authentication and synchronization system 1400 includes a VS connection unit (Virtual Space Connector, 1410), a registration control unit (Registration Control, 1420), a common control unit (Common Control, 1430), and a space control unit (Space Control, 1440). , and a PS connection unit (Physical Space Connector, 1450).

First, the VS connection unit 1410 serves to provide a connection function between the VS service and the service provided by the authentication and synchronization system 1400 , and includes an object connection unit (Object Connector, 1411) and an agent activity connection unit (Agent Activity Connector, 1412). ), and a cyber currency connector (Cyber Currency Connector, 1413).

The object connection unit 1411 may connect event information related to a digital object (DO, IO, etc.) on the VS. For example, the object connection unit 1411 may provide information such as on/offline advertisement linkage and events, and in this case, a video stream in a real environment may be utilized.

The agent activity connection unit 1412 may connect information related to the agent on the VS. A service such as a form of virtually exposing the agent information of a user who checked in offline is possible. For example, the agent activity connection unit 1412 may expose the corresponding motion to the virtual agent of VS when the user is exercising in real-world fitness GYM, etc., and may reflect the visual effect according to the amount of exercise, etc. to the agent on the VS. .

The cyber call connection unit 1413 may connect information related to a call on the VS. For example, the cyber call connection unit 1413 may link data received from a store POS and link points on VS.

In addition, the registration controller 1420 may include a Pre-Certification Manager 1421 , a Health Check Manager 1422 , and a Registration Manager 1423 .

The pre-authentication management unit 1421 may issue a code (eg, OTP, etc.) that can be pre-registered at the time of device production or when an API function on software is built-in at the time of production. The pre-authentication management unit 1421 may perform registration in a pre-authentication form when a digital twin device producer or software company mass-produces an authenticated device that provides a link service with VS. For example, a check-in device, a POS device, a waiting queue module, etc. correspond to this, and hardware or software is irrelevant.

The status check management unit 1422 may be in charge of checking the status of the registered device. The status check management unit 1422 may perform a status check operation by periodically receiving data from the device or collecting information upon request from the VS side.

The registration manager 1423 may provide an individual registration function for devices and software. In the case of a device, the registration management unit 1423 utilizes device information (eg, UUID, unique IME, MAC address, etc.) or registers using an OTP-based registration code issued using the pre-authentication management unit 1421. can In the case of software, the registration management unit 1423 may authenticate using a unique key value, and may provide a separate authentication module on the VS. In the case of space, the registration management unit 1423 utilizes map-based data (eg, cadastral data, road view data, identifiable information such as satellite photos, etc.) or a separate authentication method (eg, affiliated store information, land registration book, etc.) can In this case, the registration management unit 1423 may perform spatial registration by linking spatial information provided by a third-party operator. In the case of a group, the registration management unit 1423 may provide information on agents registered with more than a specific number of people, and may be given when paying a fee for owning a corresponding group name on VS. The authenticated group means a group that wants to use the same environment (rights) as in the real world on the VS 1402 through authentication on the VS 1402 among specific interest groups and groups in the real world, for example, a social service page Forms can be spread into groups. It is possible to set conditions for forming groups based on authenticated information on the real world or VS 1402, rather than based on naming, etc., where the condition is a rule that there are N or more authentication agents on the VS 1402 can be applied. Alternatively, when a predetermined fee required by the VS 1402 is paid, a group name in the VS 1402 may be uniquely assigned, such as a domain. Through this, the registration management unit 1423 configures a group that satisfies the condition as authenticated information on the VS 1402, so that it can be differentiated from an agent that does not satisfy the condition.

In addition, the common control unit 1430 may include a key manager 1431 , a permission manager 1432 , and a security manager 1433 .

The key management unit 1431 may provide a function of issuing and managing a key used for a service throughout the service.

The permission management unit 1432 provides a function of managing approval for each individual service subject (eg, a space owner such as an agent, a device, a digital object, or a group owner).

The security management unit 1433 may provide a security function for each module according to the interworking between the PS 1401 and the VS 1402 .

In addition, the space control unit 1440 provides a function of managing information of the PS 1401 bound to the VS 1402, and includes a POS manager (POS Manager, 1441), a marketing manager (Marketing Manager, 1442), and check-in. It may include a management unit (Check-in Manager, 1443).

The POS management unit 1441 serves to manage POS sales information. The POS management unit 1441 may manage compensation information such as points and coupons in addition to sales information.

The marketing management unit 1442 can be utilized when an event linked between the PS 1401 and the VS 1402 is conducted, and for example, online information can be updated during offline check-in.

The check-in manager 1443 may provide a management function for user access and visit records associated with the space (PS 1401 and VS 1402 ).

Finally, the PS connection unit 1450 provides a function of linking information on the PS 1401 that is the real world. The connection target may include a device type as well as a software type. PS connection unit 1450 includes a network adapter (Network Adapter, 1451), a stream manager (Stream Manager, 1452), a location information provider (Location Information Provider, 1453), and a check-in module (Check-in Module, 1454). can

The network adapter 1451 may connect a network service for traffic transmitted from the PS 1401 . The network adapter 1451 may support various network protocols (eg, TCP, HTTP, etc.) for device-specific or service-specific compatibility.

The stream manager 1452 serves to process data continuously received from the device or the PS 1401 . The stream manager 1452 may receive a large stream and provide a function of buffering or queuing it, and may also provide a function of routing the received stream thereafter.

The location information providing unit 1453 may manage connection information with a service provider that supplies local information. The location information providing unit 1453 may manage main information such as real estate or shopping mall information for space management. Businesses that provide information on the owner of the space may be subject to management.

The check-in module 1454 may manage a user access and visit record associated with a space through interworking with the check-in management unit 1443 .

15 is a flowchart illustrating an example of a device authentication process according to an embodiment of the present invention. The device authentication process according to the present embodiment may be performed by the computer apparatus 200 implementing the authentication and synchronization system 1400 .

In operation 1510 , the authentication and synchronization system 1400 may enter a device registration procedure according to a request of the device owner and proceed with the corresponding procedure.

In operation 1520, the authentication and synchronization system 1400 may set device information to be registered as an individual registration function for the device. In this case, the device information may include basic information for recognizing a corresponding device on the VS. When a service is provided by connecting on the VS, the permission related to data access between the owner and the VS must be mutually set, and the VS service provider must notify the agent using the device. The authentication and synchronization system 1400 is device information as device name (Device Name), device ID (serial number or unique key), device data interface (Device Data Interface) (eg, API, etc.), tracking permission information (Tracking Permission Information) ), device UI (eg, 3D Rendering Information), and the like. In the case of device ID, if the device producer provides a unique registration function to the VS service provider, it is necessary to register it in advance. Regarding the tracking approval information, the device owner and the agent among the data acquired by VS may provide in the form of approval whether or not the data is open.

In operation 1530 , the authentication and synchronization system 1400 may set spatial association information for the device registered in operation 1520 . The spatial link information may be registered by the owner of the digital object under a contract with the VS service provider, or by individual users. The owner of the digital object may provide a service based on linkage between spaces on VS or linkage with multiple offline points. In this case, the VS service provider may additionally request a fee for registration, and may set restrictions on registration. The authentication and synchronization system 1400 determines the number of connectable devices per space, the number of interoperable agents per device, the number of devices that can be updated simultaneously, the number of devices that can be exposed simultaneously, the number of devices that can be simultaneously controlled, etc. as spatial association information. can be set.

In step 1540 , the authentication and synchronization system 1400 may set agent access authority information for the device registered in step 1520 . The authentication and synchronization system 1400 may grant access to the corresponding device to each of the agents capable of interworking with the device associated with the VS.

In step 1550, the authentication and synchronization system 1400 may verify the review and response to the VS in which the device information and spatial association information are set. The authentication and synchronization system 1400 may check the status of the device by periodically receiving data from the registered device or collecting information upon request from the VS side.

In operation 1560 , the authentication and synchronization system 1400 may confirm a final review of the corresponding device from the registrant who is the owner of the device.

In step 1570 , the authentication and synchronization system 1400 may provide a digital twin-based service through interworking between a device and an agent on VS when device registration is completed.

16 is a flowchart illustrating an example of an agent registration process according to an embodiment of the present invention. The agent registration process according to the present embodiment may be performed by the computer device 200 implementing the authentication and synchronization system 1400 .

At step 1610, the authentication and synchronization system 1400 may authenticate the owner of the digital object. The authentication and synchronization system 1400 may authenticate the owner of a digital object that provides a service based on association between spaces on VS or association with a plurality of offline branches.

In step 1620, the authentication and synchronization system 1400 may input agent information to be linked with the digital object.

In step 1630, the authentication and synchronization system 1400 may determine whether or not the range of an agent capable of interworking with a digital object is out of the range of an agent capable of interworking with a digital object when registering an agent corresponding to the input agent information.

In step 1640 , the authentication and synchronization system 1400 may complete the agent registration according to the input agent information if it does not deviate from the corresponding range within the range of the agent capable of interworking with the digital object.

In step 1650 , when the authentication and synchronization system 1400 is out of the range of an agent capable of interworking with a digital object, it may calculate an estimated cost for the corresponding digital object, request an additional cost, and confirm payment for the corresponding cost.

In operation 1660, the authentication and synchronization system 1400 may update the range of agents capable of interworking with digital objects by inputting spatial association information according to payment of costs.

In step 1670 , the authentication and synchronization system 1400 may complete the agent registration as the range of agents capable of interworking with the digital object is updated.

The authentication and synchronization system 1400 may set additional agent interworking information to a previously registered digital object.

The device registrant can set the agent's access right for the device. For example, in the case of a product seller, a registration right for a corresponding product may be acquired through the authentication controller 1210 , and the maximum number of agents that can be registered may be determined based on this. For example, up to two agents can be registered for one device code.

Thereafter, in a situation in which the actual purchase is made, the user may proceed with a procedure for authenticating the registration code of the actual product and the agent using the product. After the initial authentication, the owner of the corresponding digital object can register additional user agents within the set agent registration possible range. In this case, the authority of the owner of the digital object may be delegated.

Separately, when the owner of the commercial space 1312 or the personal space 1313 wants to provide a device existing in his PS to a plurality of agents, a separate authority is obtained from the authentication controller 1210 .

17 is a flowchart illustrating an example of a space authentication process according to an embodiment of the present invention. The spatial authentication process according to the present embodiment may be performed by the computer device 200 implementing the authentication and synchronization system 1400 .

The authentication and synchronization system 1400 may register a space for providing a digital twin-based service on the DTS.

In step 1710, the authentication and synchronization system 1400 may select an OA (object area) or digital object (DO, IO, etc.) on the DTS for spatial registration. In order for the real world owner to search for an OA or digital object on the DTS, it is possible to directly pin it using an interface (in case information on VS is linked to map data) or a map that can be found by entering an address, phone number, etc. It is possible to provide a selectable interface in the form.

In operation 1720 , the authentication and synchronization system 1400 may perform owner authentication of the PS corresponding to the OA or digital object selected in operation 1710 . In order to authenticate the owner of the real space, the VS manager may use information such as mutual information on the map to use map-based data. When a specific owner wants to register mapping information, such as a franchise, an interface can be provided to directly input related information using OCR or the like.

In step 1730, the authentication and synchronization system 1400 may set the service range of the space authenticated through the above-described processes 1710 and 1720, that is, the range of the actual space. As an example, the authentication and synchronization system 1400 may set a service range using an intellectual range of map data. As another example, it is also possible for the authentication and synchronization system 1400 to set a service range through a selection method using real space modeling information. After synthesizing an image of a space using scanning using a drone or the like or a depth sensor, the right request for the space may be applied. As another example, the authentication and synchronization system 1400 may apply a differentiated request according to a space setting range based on a differential grade according to a registration cost, an advertisement exposure space, and the like.

In step 1740, the authentication and synchronization system 1400 may perform authentication of a device to be linked with the authenticated space. When the authentication and synchronization system 1400 intends to register a device in the interworking space, additional registration of the device may be performed.

At step 1750, the authentication and synchronization system 1400 may establish agent viewing and tracking authorizations for the authenticated space. The authentication and synchronization system 1400 may set agent information to be acquired in the interworking space as information between the interworking space and the agent, and may also request agent tracking information in the interworking space according to cost.

18 illustrates an example of a user check-in process in an authenticated space according to an embodiment of the present invention. The user check-in process according to the present embodiment may be performed by the computer device 200 implementing the authentication and synchronization system 1400 .

In step 1), after the user arrives on the PS 1810 corresponding to the authenticated space, check-in is performed using his/her mobile device. As a check-in method, check-in is processed using signals obtainable from a mobile device, such as GPS, WiFi, beacon, etc., check-in is processed using a QR code, and check-in is processed based on AR-based spatial recognition technology. method may be used.

In step 2), the user may selectively determine whether to synchronize check-in between the VS 1820 and an authenticated space for interworking with the agent on the VS 1820 .

Step 3) may approve the agent's entry on the VS 1820 . When the agent accesses a specific space range on the VS 1820, it can enter the VS 1820 of the space after user authentication/non-authentication.

The authentication and synchronization system 1400 may generate and provide a one-time check-in code for a user's check-in. Users can access the authenticated space through a one-time check-in code using a mobile device at check-in. Check-in information of the user for the authenticated space is recorded on the VS 1820 , and usage information for a device registered in the authenticated space may also be recorded together.

According to the selection of the owner of the digital object on the VS 1820 , a differentiated service may be provided offline according to a macro-based check-in method such as GPS and a check-in method such as WiFi or a beacon.

19 is a flowchart illustrating an example of a user check-in process in an authenticated space according to an embodiment of the present invention. The user check-in process according to the present embodiment may be performed by the computer device 200 implementing the authentication and synchronization system 1400 .

At step 1910 the authentication and synchronization system 1400 may receive a user check-in request on the PS from the user device.

In operation 1920, the authentication and synchronization system 1400 may receive a check-in method selected from the user in response to the user check-in request. As already described, the user check-in method includes a check-in method using a one-time code such as QR code, barcode, and personal password, a check-in method using location-based authentication such as GPS, WiFi, and beacon, an AR-based space or appearance (eg, a specific A check-in method through recognition of an object or a sculpture for authenticating a store) may be included.

In step 1930 , the authentication and synchronization system 1400 may request an authentication code through the check-in manager 1443 when a check-in method using a separate one-time code is selected in step 1920 . At this time, the verification code request must be provided with information from PS, and the information may be composed of location-based, registered SSID (service set identifier)-based, beacon ID-based, QR code or barcode-based, or separate personal password. In addition, information about a surface detection point of an AR-based Certification Recognition Object may be included.

In step 1940 , the authentication and synchronization system 1400 may check whether the PS requesting user check-in is registered through the registration manager 1423 based on PS information included in the authentication code request. The authentication and synchronization system 1400 utilizes map-based data (eg, cadastral data, road view data, identifiable information such as satellite photos, etc.) or a separate authentication method (eg, affiliated store information, land registry, etc.). You can check whether the PS you want to check in is registered or not.

In step 1950, the authentication and synchronization system 1400 may issue an authentication code for user check-in when the PS requesting user check-in corresponds to a pre-registered space.

In step 1960, the authentication and synchronization system 1400 may recognize the access code through the user device or a separate device, that is, the access of the authentication code issued in step 1950.

In step 1970, the authentication and synchronization system 1400 may confirm user check-in based on user information or device information according to code access. When the check-in method selected in step 1920 does not use a separate one-time code, the code generation process may be skipped and the user may check-in by directly entering step 1970 .

In step 1980, the authentication and synchronization system 1400 may update agent information on VS according to user check-in and link check-in information in real time. Check-in information may or may not be exposed to other digital objects or agents according to user settings. For example, even when checking in in the real world, the check-in information may not be updated in the VS user agent based on the set value for the agent on VS.

The authentication and synchronization system 1400 may provide an admission control function of the agent in connection between the PS and the VS. When user information and activity information on PS and VS are linked, it is possible to determine whether to synchronize and expose (reflect) the corresponding information according to the user's selection. Referring to FIG. 20 , the authentication and synchronization system 1400 may provide a synchronization target list 2010 for synchronization approval through the synchronization approval screen 2000 . A user may selectively set a synchronization target such as check-in, payment, activity, and device use through the synchronization target list 2010 and may approve synchronization between PS and VS for the selected target. The owner of the digital object can control settings related to synchronization between the registered offline stores and online stores when linking them. A control point for synchronization is available on the synchronization approval screen 2000 provided on the user's mobile device and the control panel on the VS.

As such, according to the embodiments of the present invention, it is possible to authenticate and synchronize the interconnection relationship between the virtual world and the physical world, and perform spatial authentication and device authentication for interconnection between the virtual world and the physical world, According to embodiments of the present invention, user check-in in an authenticated space may be performed.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, the apparatus and components described in the embodiments may include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), and a programmable logic unit (PLU). It may be implemented using one or more general purpose or special purpose computers, such as a logic unit, microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

Software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be embodied in any tangible machine, component, physical device, computer storage medium or device for interpretation by or providing instructions or data to the processing device. have. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. In this case, the medium may be to continuously store a program executable by a computer, or to temporarily store it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or several hardware combined, it is not limited to a medium directly connected to any computer system, and may exist distributed over a network. Examples of the medium include a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as CD-ROM and DVD, a magneto-optical medium such as a floppy disk, and those configured to store program instructions, including ROM, RAM, flash memory, and the like. In addition, examples of other media may include recording media or storage media managed by an app store that distributes applications, sites that supply or distribute other various software, and servers.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible from the above description by those skilled in the art. For example, the described techniques are performed in an order different from the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (18)

at least one processor implemented to execute computer-readable instructions
including,
by the at least one processor;
managing the interconnection relationship between the virtual space and the physical space based on the information of the virtual space and the physical space,
Registering a device or space existing in the physical space in the form of a digital object in the virtual space
A computer device comprising a. According to claim 1,
by the at least one processor;
Providing a digital twin service through connection between an offline device or an offline store and a digital object in the virtual space
A computer device comprising a. According to claim 1,
by the at least one processor;
Synchronizing user information and activity information between the virtual space and the physical space according to whether the user approves the synchronization
A computer device comprising a. According to claim 1,
by the at least one processor;
Connecting event information related to a digital object in the virtual space as information of the virtual space
A computer device comprising a. According to claim 1,
by the at least one processor;
Connecting information related to the agent of the virtual space as the information of the virtual space
A computer device comprising a. According to claim 1,
by the at least one processor;
Connecting currency-related information of the virtual space as the information of the virtual space
A computer device comprising a. According to claim 1,
by the at least one processor;
Registering a device that can be recognized in the virtual space using device information or a code issued through pre-authentication
A computer device comprising a. According to claim 1,
by the at least one processor;
Registering a recognizable space in the virtual space using map-based data or spatial information
A computer device comprising a. According to claim 1,
by the at least one processor;
Registering software in the form of a digital object in the virtual space using a unique key value
A computer device comprising a. According to claim 1,
by the at least one processor;
Registering a group consisting of a plurality of agents in the form of a digital object in the virtual space
A computer device comprising a. According to claim 1,
by the at least one processor;
In the case of a device providing a service linked to the virtual space, registering the device in the form of pre-authentication at the time of device production
A computer device comprising a. According to claim 1,
by the at least one processor;
Performing a status check of the device based on data periodically received from the device or information collected in the virtual space
A computer device comprising a. According to claim 1,
by the at least one processor;
managing information on the physical space bound to the virtual space,
Managing user access and visit records related to the space
A computer device comprising a. According to claim 1,
by the at least one processor;
Providing a connection with a network service for traffic delivered from the physical space
A computer device comprising a. According to claim 1,
by the at least one processor;
receiving and buffering or queuing data transferred from the device or the space and routing the data;
A computer device comprising a. According to claim 1,
by the at least one processor;
Managing local information and owner information related to the space as information of the physical space
A computer device comprising a. According to claim 1,
by the at least one processor;
Issuing and managing a key used for a link service between the virtual space and the physical space
A computer device comprising a. According to claim 1,
by the at least one processor;
Managing approval for each individual service subject participating in the linked service between the virtual space and the physical space
A computer device comprising a.

Images