KR102559768B1 - Method, Server and Computer-readable Medium for Providing Application List Interface Using the Relationship between Objects and Applications - Google Patents

Abstract

The present invention relates to a method for providing an app list interface using a degree of association between objects and apps, a service server performing the same, and a computer-readable medium for performing the same, and more particularly, a plurality of virtual objects for each of a plurality of applications connected to each of the plurality of virtual objects projected on the 3D map, receiving reality information for each of a plurality of reality objects in reality, generating a plurality of virtual objects corresponding to the plurality of reality objects based on the reality information, and projecting them on a 3D map A method of providing an app list interface using a degree of association between objects and apps, capable of efficiently recommending applications related to a plurality of virtual objects currently displayed on a 3D map by deriving a predetermined number of applications in order of highest degree of relevance to a 3D map and providing a map interface including a 3D map onto which a plurality of virtual objects are projected and an app display area in which the derived predetermined number of applications are displayed.

Description

A method for providing an app list interface using the degree of association between objects and apps, a service server and computer-readable medium that performs the same {Method, Server and Computer-readable Medium for Providing Application List Interface Using the Relationship between Objects and Applications}

The present invention relates to a method for providing an app list interface using a degree of association between objects and apps, a service server performing the same, and a computer-readable medium for performing the same, and more particularly, a plurality of virtual objects for each of a plurality of applications connected to each of the plurality of virtual objects projected on the 3D map, receiving reality information for each of a plurality of reality objects in reality, generating a plurality of virtual objects corresponding to the plurality of reality objects based on the reality information, and projecting them on a 3D map A method of providing an app list interface using a degree of association between objects and apps, capable of efficiently recommending applications related to a plurality of virtual objects currently displayed on a 3D map by deriving a predetermined number of applications in order of highest degree of relevance to a 3D map and providing a map interface including a 3D map onto which a plurality of virtual objects are projected and an app display area in which the derived predetermined number of applications are displayed.

Recently, as various services are implemented online, the spread of mobile devices such as smart phones and tablet PCs as well as traditional computing devices such as PCs is widespread, and these electronic devices have become so important that daily life is impossible without them.

On the other hand, in the case of the above-described operating system running on a device such as a conventional PC, smart phone, etc., the background screen (background screen) is displayed after the first drive or the lock screen is released, and one or more installed on the device by the user. Graphical elements (icons) for executing applications (applications) are displayed.

In general, a user can execute an application corresponding to the selected icon by selecting any one of one or more icons displayed on the desktop, and by selecting an object processable by the application in the executed application, the processing result of the corresponding application for the selected object can be provided. That is, in the conventional case, a user is provided with a processing result for an object centered on an application.

For example, by executing a video playback application and selecting a video file (object) playable by the application, the user can play the corresponding video file as a result of processing by the video playback application. In addition, the user executes a food ordering application and selects a food or restaurant (object) displayed in the application, and as a result of the processing of the food ordering application, the user may order a specific food from a specific restaurant.

Meanwhile, as described above, as various services are implemented on-line, various services are applied to one object. Therefore, in the case of the conventional application-centered service providing method, since the user must first determine which service to be provided and execute the application to receive the service, there is a problem that is not suitable for the method of selecting an object first and then selecting a service related to the object.

Therefore, it is necessary to develop a new interface to provide services centered on objects, rather than the conventional application-centered ones. In particular, in services such as digital twins and metaverses where various objects are displayed on devices, it is essential to develop a new interface providing method to provide object-oriented services.

delete

Korean Patent Publication No. 10-2020-0122701 (Method of providing restaurant information and service server for this, published on October 28, 2020)

The present invention relates to a method for providing an app list interface using a degree of association between objects and apps, a service server performing the same, and a computer-readable medium for performing the same, and more particularly, a plurality of virtual objects for each of a plurality of applications connected to each of the plurality of virtual objects projected on the 3D map, receiving reality information for each of a plurality of reality objects in reality, generating a plurality of virtual objects corresponding to the plurality of reality objects based on the reality information, and projecting them on a 3D map To provide a method for providing an app list interface using a degree of association between objects and apps, which can efficiently recommend applications related to a plurality of virtual objects currently displayed on a 3D map by deriving a predetermined number of applications in order of highest degree of association with, and providing a map interface including a 3D map on which a plurality of virtual objects are projected and an app display area in which the derived predetermined number of applications are displayed. to be

In order to solve the above problems, in one embodiment of the present invention, a method of providing an app list interface using a degree of association between objects and apps executed in a service server including one or more processors and one or more memories includes a reality information receiving step of receiving reality information for each of the plurality of reality objects from a plurality of reality objects in reality or an external system communicating with the plurality of reality objects; a virtual object creation step of generating a virtual object reflecting the shape and position of the corresponding reality object based on the reality information of each of the reality objects and projecting them on a 3D map; an app derivation step of deriving a predetermined number of applications in order of highest degree of association between each application and the plurality of virtual objects among a plurality of applications connected to a plurality of virtual objects projected on the 3D map; and a map interface providing step of providing a map interface including a 3D map on which the plurality of virtual objects are projected and an app display area in which the derived predetermined number of applications are displayed to a user terminal.

In one embodiment of the present invention, in the app derivation step, for each of a plurality of applications connected to a plurality of virtual objects projected on the 3D map, the higher the number of virtual objects connected to each application, the higher the degree of relevance of the corresponding application.

In one embodiment of the present invention, in the map interface, when an area displayed on the 3D map is changed according to a user's input at the user terminal, and in the app derivation step, when the area displayed on the 3D map is changed according to the user's input, the predetermined number of applications may be derived again based on a plurality of virtual objects included in the changed area.

In one embodiment of the present invention, in the virtual object generating step, attributes for the type of the corresponding real object are given to the virtual object based on reality information of the real object, and in the app derivation step, a plurality of applications preset for attributes assigned to the virtual object may be used as applications linked to the corresponding virtual object.

In one embodiment of the present invention, the method of providing an app list interface using the degree of association between the object and the app may include, when an application included in an app display area of a map interface displayed on the user terminal is selected, target object providing step of deriving target object information for one or more virtual objects to be executed by any one selected application among a plurality of virtual objects displayed on the 3D map, and providing the target object information to the user terminal. ; and a service information providing step of deriving service information for the selected one virtual object by executing the selected one application and providing the service information to the user terminal when any one virtual object included in the target object information provided to the user terminal is selected through the target object providing step.

In an embodiment of the present invention, the target object list layer providing step includes a target object list layer providing step of providing the user terminal with a target object list layer displaying a list of one or more virtual objects included in the target object information, and the target object list layer may be overlaid and displayed on a map interface displayed on the user terminal through the map interface providing step.

In order to solve the above problems, in one embodiment of the present invention, a service server that performs a method of providing an app list interface using a degree of association between objects and apps, including one or more processors and one or more memories, comprising: a reality information receiving step of receiving reality information for each of the reality objects from a plurality of reality objects in reality or an external system communicating with the plurality of reality objects; a virtual object creation step of generating a virtual object reflecting the shape and position of the corresponding reality object based on the reality information of each of the reality objects and projecting them on a 3D map; an app derivation step of deriving a predetermined number of applications in order of highest degree of association between each application and the plurality of virtual objects among a plurality of applications connected to a plurality of virtual objects projected on the 3D map; And a map interface providing step of providing a map interface including a 3D map on which the plurality of virtual objects are projected and an app display area in which the derived predetermined number of applications are displayed to the user terminal.

In order to solve the above problems, in one embodiment of the present invention, a computer-readable medium for implementing a method of providing an app list interface using a degree of association between objects and apps executed in a service server including one or more processors and one or more memories, the computer-readable medium including computer executable instructions for causing the service server to perform the following steps, the following steps being: From a plurality of reality objects in the real world or an external system that communicates with the plurality of reality objects. a reality information receiving step of receiving reality information for each of the reality objects; a virtual object creation step of generating a virtual object reflecting the shape and position of the corresponding reality object based on the reality information of each of the reality objects and projecting them on a 3D map; an app derivation step of deriving a predetermined number of applications in order of highest degree of association between each application and the plurality of virtual objects among a plurality of applications connected to a plurality of virtual objects projected on the 3D map; And a map interface providing step of providing a map interface including a 3D map on which the plurality of virtual objects are projected and an app display area in which the derived predetermined number of applications are displayed to a user terminal.

According to an embodiment of the present invention, when a virtual object displayed on a 3D map of a map interface is selected, an app list layer displaying app list information for one or more applications connected to the selected virtual object is provided to the user terminal and displayed, so that an object-based service according to application execution can be provided.

According to an embodiment of the present invention, reality information about a plurality of reality objects in the real world is received, virtual objects corresponding to the reality objects are generated according to the reality information, and displayed on a 3D map, and the shapes and positions of the reality objects included in the reality information are reflected on the 3D map, so that a user using the 3D map can feel a sense of reality.

According to an embodiment of the present invention, the step of providing the app list layer causes the app list layer to be overlaid and displayed on the 3D map of the map interface displayed on the user terminal, so that the user can more conveniently recognize the virtual object displayed on the 3D map of the map interface and the app list layer for the corresponding virtual object.

According to one embodiment of the present invention, in the service information providing step, when any one application displayed on the app list layer is selected, the selected application is executed to derive service information for the selected virtual object, and the service layer including the service information is overlaid on the map interface displayed on the user terminal, so that the user can select a virtual object on the map interface, select any one application related to the virtual object, and receive service information. can exert

According to one embodiment of the present invention, the app list layer includes an installation suggestion area, and one or more applications not installed on the user terminal among one or more applications connected to the selected virtual object are displayed in the installation suggestion area.

According to an embodiment of the present invention, in the step of providing a map interface, when a virtual object having a building attribute is selected on the 3D map and entry to the virtual object is input, an indoor interface for the interior of the selected virtual object and detailed virtual objects included in the interior are displayed, so that the user can confirm the interior of the selected building and the objects included therein.

According to one embodiment of the present invention, a list of a predetermined number of applications selected according to a predetermined rule from among one or more applications connected to each of a plurality of virtual objects projected on a 3D map is displayed in the app display area, thereby providing an effect of recommending applications related to a plurality of virtual objects displayed on the 3D map currently viewed by the user.

According to an embodiment of the present invention, the area displayed on the 3D map is variable according to user input, and a list of a predetermined number of applications displayed according to one or more applications connected to a plurality of virtual objects projected on the variable area on the 3D map is changed in the app display area.

According to an embodiment of the present invention, in the app derivation step, for each of a plurality of applications, the higher the number of virtual objects connected to each application, the higher the degree of association between the application and the plurality of virtual objects.

1 schematically illustrates components for performing a method of providing an object-oriented app execution interface according to an embodiment of the present invention.
2 schematically shows a virtual object that receives reality information in the reality information receiving step according to an embodiment of the present invention and is displayed on a 3D map according to the reality information.
3 schematically illustrates detailed steps of a method of providing an object-oriented app execution interface according to an embodiment of the present invention.
4 schematically illustrates one or more applications connected to a virtual object according to attributes assigned to the virtual object according to an embodiment of the present invention.
5 schematically illustrates a map interface displayed on a user terminal according to an embodiment of the present invention.
6 schematically illustrates an App Store layer displayed on a user terminal according to a user's input on a map interface according to an embodiment of the present invention.
7 schematically illustrates an object information layer for a corresponding virtual object displayed on a user terminal when any one virtual object displayed on a 3D map of a map interface according to an embodiment of the present invention is selected.
8 schematically illustrates an app list layer for a corresponding virtual object displayed on a user terminal when any one virtual object displayed on a 3D map of a map interface according to an embodiment of the present invention is selected.
9 schematically illustrates a service layer displayed on a user terminal through a service information providing step according to an embodiment of the present invention.
10 schematically illustrates an indoor interface displayed on a user terminal through an indoor interface providing step according to an embodiment of the present invention.
11 schematically illustrates a virtual object displayed on a 3D map of a map interface displayed on a user terminal according to an embodiment of the present invention.
12 schematically illustrates virtual objects displayed on a 3D map of an indoor interface and a map interface displayed on a user terminal according to an embodiment of the present invention.
13 schematically illustrates components for performing a method of providing an object-related app list interface according to an embodiment of the present invention.
14 schematically illustrates detailed steps of a method of providing an object-related app list interface according to an embodiment of the present invention.
15 schematically illustrates one or more applications connected to each virtual object displayed on a 3D map according to an embodiment of the present invention.
16 schematically illustrates an app display area included in a map interface according to an embodiment of the present invention.
17 schematically illustrates a process in which a list of applications displayed in an app display area is changed according to a change in an area displayed on a 3D map according to an embodiment of the present invention.
18 schematically illustrates one or more applications preset according to attributes assigned to a virtual object according to an embodiment of the present invention.
19 schematically illustrates a target object list layer according to an application selected through an app display area according to an embodiment of the present invention.
20 schematically illustrates detailed steps of a method of providing an app list interface using a degree of association between objects and apps according to an embodiment of the present invention.
21 schematically illustrates a process of calculating a degree of association between an application and a plurality of virtual objects in an app derivation step according to an embodiment of the present invention.
22 schematically illustrates a list of applications displayed in an app display area according to a plurality of virtual objects displayed on a 3D map according to an embodiment of the present invention.
23 schematically illustrates a configuration in which one or more applications are connected according to attributes assigned to a virtual object created in the virtual object creation step according to an embodiment of the present invention.
24 schematically illustrates an internal configuration of a computing device according to an embodiment of the present invention according to an embodiment of the present invention.

In the following, various embodiments and/or aspects are disclosed with reference now to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth in order to facilitate a general understanding of one or more aspects. However, it will also be appreciated by those skilled in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings describe in detail certain illustrative aspects of one or more aspects. However, these aspects are exemplary and some of the various methods in principle of the various aspects may be used, and the described descriptions are intended to include all such aspects and their equivalents.

Moreover, various aspects and features will be presented by a system that may include a number of devices, components and/or modules, and the like. It should also be understood and appreciated that various systems may include additional devices, components and/or modules, and/or may not include all of the devices, components, modules, etc. discussed in connection with the figures.

“Example”, “example”, “aspect”, “exemplary”, etc., used herein should not be construed as preferring or advantageous to any aspect or design being described over other aspects or designs. The terms '~unit', 'component', 'module', 'system', 'interface', etc. used below generally mean a computer-related entity, and may mean, for example, hardware, a combination of hardware and software, or software.

Also, the terms "comprises" and/or "comprising" should be understood to mean that the feature and/or element is present, but does not preclude the presence or addition of one or more other features, elements and/or groups thereof.

In addition, terms including ordinal numbers, such as first and second, may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention. The terms and/or include any combination of a plurality of related recited items or any of a plurality of related recited items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the embodiments of the present invention, an ideal or excessively formal meaning. It is not to be interpreted.

1. How to provide an object-oriented app execution interface

Prior to explaining the method of providing the object-related app list interface of the present invention, hereinafter, as one method for providing service information related to a selected object more effectively to the user in an interface in which a plurality of objects are displayed, '1. A method of providing an object-oriented application execution interface' will be described first.

1 schematically illustrates components for performing a method of providing an object-oriented app execution interface according to an embodiment of the present invention.

As shown in FIG. 1, the service server 1000 communicates with a plurality of reality objects 2000 or an external system 3000 that communicates with the plurality of reality objects 2000 and a user terminal 4000 to perform the method of providing an object-oriented app execution interface of the present invention.

Specifically, the service server 1000 may include a reality information receiving unit 1100, a map interface providing unit 1200, an app list layer providing unit 1300, a service information providing unit 1500, and a DB 1600 in order to perform the method of providing an object-oriented app execution interface of the present invention.

The reality information receiving unit 1100 performs a reality information receiving step (S100), and receives reality information for each reality object 2000 from a plurality of reality objects 2000 located in a real space, or receives the plurality of reality objects from an external system 3000 that includes the plurality of reality objects 2000 or communicates with the plurality of reality objects 2000. Reality information for each project 2000 is received. That is, the reality information receiving unit 1100 may receive reality information directly from the plurality of reality objects 2000 or indirectly from the external system 3000 . In addition, the reality information receiving unit 1100 may continuously receive reality information in real time or according to a preset period, instead of receiving reality information from the reality object 2000 or the external system 3000 only once.

The map interface providing unit 1200 performs a map interface providing step (S200), based on the reality information received from the reality information receiving unit 1100, creates a virtual object for the reality object 2000 corresponding to the corresponding reality information, and displays the created virtual object on a 3D map. At this time, the virtual object is generated based on the shape information of the reality object 2000 included in the reality information, and based on the location information of the reality object 2000 additionally included in the reality information, the virtual object is projected at a predetermined location on the 3D map corresponding to the location of the reality object 2000. On the other hand, the map interface provider 1200 provides a map interface L1 including a 3D map on which virtual objects are projected to the user terminal 4000, and the user terminal 4000 receiving the map interface L1 can display the map interface L1 on the display of the user terminal 4000. In addition, even after providing the map interface L1 to the user terminal 4000, the map interface providing unit 1200 may continuously provide the user terminal 4000 with a map interface L1 in which the position of a virtual object on a 3D map is changed according to location information included in continuously received reality information, in real time or at predetermined intervals.

The app list layer providing unit 1300 performs the app list layer providing step (S300), and when the user selects any one virtual object projected on the 3D map on the map interface L1 displayed on the user terminal 4000 through the map interface providing unit 1200, the user terminal 4000 sends any one virtual object to the service server 1000. is selected, the app list layer providing unit 1300 of the service server 1000 derives app list information corresponding to a list of one or more preset applications for the selected virtual object, and provides the app list layer L4 where the app list information is displayed to the user terminal 4000 so that the app list layer L4 is displayed on the user terminal 4000.

The service information providing unit 1500 performs a service providing step. When an application is selected on the app list layer L4 displayed on the user terminal 4000 through the service information providing unit 1500, the user terminal 4000 transmits the selected application to the service server 1000, and the service information providing unit 1500 of the service server 1000 executes the selected application. , Service information targeting the selected virtual object is generated, and the created service information is provided to the user terminal 4000.

Meanwhile, in the DB 1600 included in the service server 1000, information received or generated to perform the method of providing the object-oriented app execution interface of the present invention in the service server 1000 may be stored. For example, the DB 1600 may store reality information received by the reality information receiver 1100, virtual objects created by the map interface provider 1200, one or more applications preset for virtual objects, and service information generated by the service information provider 1500.

The reality object 2000 refers to various objects included in the real space. For example, the reality object 2000 may correspond to a means of transportation, a building, a structure, a device or facility disposed in a building or structure, and the like, and additionally, a person may also correspond to the reality object 2000. On the other hand, the reality object 2000 includes or attaches one or more elements such as sensors and GPS to sense the environment or motion around the reality object 2000 or measure the location of the reality object 2000, and such information is included in reality information and can be received by the reality information receiver 1100 of the service server 1000. In addition, when the reality object 2000 corresponds to the above-described device or facility, the reality information for the object may additionally include an operation result according to the operation of the device or facility.

The reality information may be directly transmitted from the reality object 2000 to the reality information receiver 1100 of the service server 1000, but may also be transmitted indirectly through the external system 3000 as described above. At this time, the external system 3000 may communicate with the reality object 2000 to receive reality information generated by the reality object 2000 and transmit the received reality information to the reality information receiver 1100. Specifically, the external system 3000 may correspond to an external server separate from the service server 1000 of the present invention, or may correspond to a gateway or relay.

Meanwhile, the user terminal 4000 may correspond to a computing device in which a user who wants to receive various services through the map interface L1 provided by the service server 1000 becomes a user. In addition, a separate application for communicating with the service server 1000 is installed in the user terminal 4000, or a separate web page implemented through a web browser installed in the user terminal 4000 can perform communication with the service server 1000.

Figure 2 schematically shows a virtual object displayed on a 3D map according to reality information received in the reality information receiving step (S100) according to an embodiment of the present invention.

As shown in (A) of FIG. 2 , the reality information receiving unit 1100 included in the service server 1000, specifically the service server 1000, performs a reality information receiving step (S100) to receive reality information for each of a plurality of reality objects 2000 from a plurality of reality objects 2000 or an external system 3000 communicating with the plurality of reality objects 2000. do

At this time, as shown in (B) of FIG. 2, the reality information received in the reality information receiving step (S100) may include shape information, location information, and service information about the corresponding reality object (2000).

The shape information is for implementing the shape of the virtual object when creating a virtual object corresponding to the corresponding real object 2000. For example, when the real object 2000 is a building, the shape information may include the area and height of the building, and accordingly, the virtual object for the real object 2000 may be created in a form in which the shape information is reflected.

The location information is information about the location of the corresponding reality object 2000, and corresponds to information for locating a virtual object corresponding to the corresponding reality object 2000 on a 3D map. For example, when the corresponding reality object 2000 is located at 123-4 Building A, a virtual object for the corresponding reality object 2000 may also be projected at 123-4 Building A on the 3D map. Meanwhile, when the corresponding reality object 2000 is fixedly located, such as a building, the location information may be included only in reality information initially received by the reality information receiving unit 1100, and may not be included in reality information about the corresponding reality object 2000 received later. On the other hand, when the location of the reality object 2000 varies with time, such as a person or a means of transportation, the reality information about the corresponding reality object 2000 continuously received by the reality information receiver 1100 may include location information corresponding to the location of the corresponding reality object 2000 at the time when the reality information is generated.

The service information may include information obtained by sensing the surrounding environment or the operation of the reality object 2000 through one or more sensors included or disposed in the corresponding reality object 2000, or may include information on the result of operation according to the operation of the corresponding reality object 2000. On the other hand, when a virtual object displayed on the 3D map of the map interface L1 displayed on the user terminal 4000 is selected by the user, the service information included in the reality information for the corresponding virtual object may be displayed on the user terminal 4000 as it is, and the virtual object displayed on the 3D map of the map interface L1 displayed on the user terminal 4000 is selected by the user, and the corresponding virtual object When an application for an object is selected, the selected application may be executed to generate new service information based on service information of reality information corresponding to the selected virtual object.

On the other hand, in the map interface providing step (S200), based on the reality information received in the reality information receiving step (S100), a virtual object corresponding to the reality object 2000 to which the corresponding reality information has been transmitted is generated, and the generated virtual object can be projected and displayed on a predetermined location on a 3D map, as shown in FIG. 2(C). Taking the matter shown in (C) of FIG. 2 as an example, when the position of the real object O1 changes by going straight on a road in real space and then turning right at an intersection, the position of the virtual object O2 relative to the real object O1 may also change in the same way on the 3D map based on the reality information of the real object O1. To this end, in the reality information receiving step (S100), reality information of the corresponding reality object O1 may be continuously received in real time or according to a preset period.

As described above, in the present invention, since a virtual object having the same shape as the reality object 2000 is displayed on a 3D map according to the reality information of the reality object 2000 as a change in the position of the reality object 2000, the reality object 2000 in the real space can be implemented as a virtual object on the 3D map corresponding to the virtual space.

3 schematically illustrates detailed steps of a method of providing an object-oriented app execution interface according to an embodiment of the present invention.

As shown in FIG. 3, a method of providing an object-oriented app execution interface performed in a service server (1000) including one or more processors and one or more memories, comprising a reality information receiving step (S100) of receiving reality information for each of the plurality of reality objects (2000) from a plurality of reality objects (2000) or an external system (3000) communicating with the plurality of reality objects (2000); A map interface providing step (S200) of providing a map interface (L1) in which a virtual object reflecting the shape and location of the corresponding reality object (2000) is displayed on a 3D map based on the reality information of each of the reality object (2000) to the user terminal (4000); When any one virtual object displayed on the map interface (L1) displayed on the user terminal (4000) is selected, an app list layer providing step (S300) of deriving app list information for one or more applications connected to the selected virtual object and providing an app list layer (L4) including the app list information to the user terminal (4000); and a service information providing step (S400) of executing the selected application when any one application is selected on the app list layer L4 displayed on the user terminal 4000 through the app list layer providing step (S300).

Specifically, in the reality information receiving step (S100), reality information of each of the plurality of reality objects 2000 is directly or indirectly received from the plurality of reality objects 2000 in the reality. In addition, in the reality information receiving step (S100), reality information for the reality object 2000 is not received only once, but reality information generated from the corresponding reality object 2000 in real time or according to a predetermined cycle can be continuously received.

In the map interface providing step (S200), a virtual object corresponding to the corresponding reality object 2000 is created based on the reality information received in the reality information receiving step (S100), and the virtual object is projected onto a 3D map based on the location information included in the reality information. Specifically, the 3D map may correspond to a three-dimensional map of the same geography as reality, and the virtual object may be projected at a position corresponding to the location information on the 3D map based on location information included in the reality information of the reality object 2000. On the other hand, the 3D map on which the virtual object is projected is included in the map interface L1, and the map interface L1 is provided to the user terminal 4000, and the map interface L1 can be displayed on the screen of the user terminal 4000.

In addition, the map interface providing step (S200) is not performed only once, but may be repeatedly performed in real time or according to a preset period. Specifically, when the location of the reality object 2000 changes in real time or the operation result of the reality object 2000 corresponding to the service information included in the reality information is updated, in the map interface providing step (S200), which is repeatedly performed, the user terminal 4000 provides a map interface L1 including a 3D map in which the location of a virtual object corresponding to the reality object 2000 changes in real time. , or a map interface L1 to which updated service information is applied may be provided to the user terminal 4000 .

In the step of providing the app list layer (S300), when the user selects any one virtual object on the 3D map of the map interface (L1) displayed on the user terminal 4000 through the above-described map interface providing step (S200), app list information for a list of one or more applications connected to the selected virtual object is derived, and the app list layer (L4) on which the app list information is displayed is provided to the user terminal (400). 0) to be displayed. Through the app list layer L4 displayed on the user terminal 4000, the user can recognize one or more applications that can provide services related to the virtual object selected by the user, and by selecting one of the one or more applications displayed on the app list layer L4, the selected application can be executed targeting the corresponding virtual object.

In the service providing step, when the user selects one or more applications from among one or more applications displayed on the app list layer L4 displayed on the user terminal 4000 through the app list layer providing step (S300), the selected application is executed to derive service information for the virtual object selected by the user. Meanwhile, in deriving service information by executing any one application selected by the user in the service providing step, separate service information may be derived using service information included in reality information corresponding to the selected virtual object.

4 schematically illustrates one or more applications connected to a virtual object according to attributes assigned to the virtual object according to an embodiment of the present invention.

As shown in FIG. 4 , in the step of providing the app list layer (S300), app list information for one or more applications determined based on the properties of the selected virtual object among a plurality of applications usable in the user terminal 4000 may be derived.

Specifically, one or more applications connected to the virtual object may refer to one or more applications preset for each of one or more properties assigned to the virtual object.

More specifically, as shown in (A) of FIG. 4 , one or more applications are preset in the service server 1000 for each property that can be assigned to a virtual object. Taking FIG. 4(A) as an example, application #1, application #2, application #4, and application #6 are preset in attribute #1, and application #1, application #3, application #4, application #5, and application #6 are preset in attribute #2.

Meanwhile, when a virtual object is created in the map interface providing step (S200), one or more properties may be assigned to the corresponding virtual object. For example, when a virtual object for the real object 2000 corresponding to the subway is created, the corresponding virtual object may be given a property of means of transportation and a property of public transportation.

Accordingly, in the step of providing the app list layer (S300), a list of one or more applications preset in the corresponding attribute for the attribute assigned to the virtual object selected by the user may be derived as the app list information. Taking FIG. 4(B) as an example, when 'property #2' is assigned to the virtual object O3 selected by the user on the 3D map, as shown in FIG.

As described above, in the present invention, in order to provide a service based on an object (virtual object), rather than providing a service based on an application, a list of one or more applications capable of providing a service targeting a virtual object selected by the user is provided to the user, so that the user can easily select an application.

Figure 5 schematically shows a map interface (L1) displayed on the user terminal 4000 according to an embodiment of the present invention.

As shown in FIG. 5 , the provided map interface L1 is displayed on the user terminal 4000 through the map interface providing step (S200). As shown in (A) of FIG. 5, a total of three areas may be displayed on the map interface L1. The first area corresponds to a menu area that can call various functions provided by the service server 1000, and the menu area can be displayed on the leftmost side of the map interface L1, taking (A) of FIG. 5 as an example. Meanwhile, as shown in (B) of FIG. 5, the menu area may be expanded and displayed according to a user's input.

The second area corresponds to a 3D map area in which a 3D map on which virtual objects are projected in the map interface providing step (S200) is displayed. In the 3D map area, a plurality of projected virtual objects are displayed, and the location of the displayed virtual object on the 3D map varies according to periodic reality information about the reality object 2000 corresponding to the virtual object. can be applied in the same way as Taking (A) of FIG. 5 as an example, the 3D map area may be displayed in the center of the map interface L1.

The third area corresponds to an app display area in which icons capable of executing a predetermined number of applications are displayed by comprehensively considering information on the currently displayed 3D map area, information on the rendering state of the 3D map for the area, and a plurality of virtual objects included in the currently displayed 3D map area. In the app display area, taking (A) of FIG. 5 as an example, name information about the currently displayed 3D map area, such as 'Bundang-gu, Seongnam-si, Gyeonggi-do', and information about the rendering state of the 3D map, such as '100% connected', etc. can be displayed. Also, the app display area may be displayed at the bottom of the map interface L1.

Meanwhile, the map interface L1 displays a predetermined area determined according to a user's input from the user terminal 4000 on the 3D map, and on the 3D map on which the predetermined area is displayed, one or more virtual objects corresponding to the one or more reality objects 2000 based on reality information about one or more reality objects 2000 moving or entering a real space corresponding to the predetermined area. The movement of can be displayed in real time.

Specifically, as shown in FIGS. 5(A) and 5(B), the 3D map displayed on the 3D map area of the map interface L1 is not fixed to a specific area, but the area of the 3D map can be varied according to one or more inputs of the user to the user terminal 4000. For example, when the user terminal 4000 includes a touch display like a smart phone, the user can change the area displayed on the 3D map through an input such as pinch out, pinch in, or drag on the touch display. Similarly, when the user terminal 4000 is connected to a traditional keyboard and mouse, the user can change the area displayed on the 3D map through drag input, enlargement, and reduction input through the mouse.

On the other hand, as described above, when the area displayed on the 3D map is changed according to the user's input on the map interface L1, on the 3D map for the changed area, one or more virtual objects corresponding to the one or more reality objects 2000 are placed in the real space area corresponding to the changed area on the 3D map, moved, or one or more reality objects 2000 entering the corresponding area. Movement of the object can be displayed in real time.

Specifically, when the user performs an input to change the area of the 3D map on the map interface L1, the map interface providing step (S200) projects one or more virtual objects included in the changed area on the 3D map, and provides the user terminal 4000 with a map interface L1 including a 3D map for the changed area on which the one or more virtual objects are projected. In addition, the map interface providing step (S200) is repeatedly performed, and the user terminal 4000 may be provided with a map interface L1 including a 3D map reflecting the motions of one or more virtual objects within the variable area periodically.

6 schematically illustrates an App Store layer L2 displayed on the user terminal 4000 according to a user's input on the map interface L1 according to an embodiment of the present invention.

As described above in FIG. 5, the map interface L1 provided to the user terminal 4000 includes a menu area, and the user selects 'app' in the menu area shown in FIG.

As shown in (A) of FIG. 6, a list of one or more applications usable in the user terminal 4000 is displayed in the App Store layer L2, and the user selects any one application displayed in the list to set the application to be usable in the user terminal 4000.

Meanwhile, in one embodiment of the present invention, the application may correspond to software that can be directly installed on the user terminal 4000 . Accordingly, when the user selects any one application to be set as usable through the app store layer L2, the service server 1000 provides an installation file for the selected application to the user terminal 4000, and the user terminal 4000 can execute the installation file to directly install the selected application in the user terminal 4000.

On the other hand, in another embodiment of the present invention, the application is installed in the service server 1000, and when the user selects an application to be set as usable through the app store layer (L2), the service server 1000 can set the selected application to be available for the user terminal 4000. That is, the application in another embodiment of the present invention may correspond to a function provided by a kind of service server 1000, and when a user selects an application, the selected application (function) can be used in the corresponding user terminal 4000. It can be understood.

On the other hand, when 'manage my apps' is selected in the app store layer L2 shown in FIG. 6 (A), the user terminal 4000 has a separate app store layer shown in FIG. 6 (B) (L2) can be displayed. A list of one or more applications set as usable by the user is displayed on the separate App Store layer L2. Accordingly, the user may recognize a list of one or more applications that the user sets as usable through the separate app store layer L2.

FIG. 7 schematically shows an object information layer (L3) for a corresponding virtual object displayed on the user terminal 4000 as any one virtual object O3 displayed on the 3D map of the map interface L1 according to an embodiment of the present invention is selected.

As shown in FIG. 7, the user can select any one virtual object O3 on the 3D map of the map interface L1 displayed on the user terminal 4000, and when any one virtual object O3 is selected, the selected virtual object O3 is visually displayed differently from other objects, and the service server 1000 provides an object information layer for the selected virtual object O3. (L3) is derived and provided to the user terminal 4000.

The object information layer (L3) provided to the user terminal 4000 is displayed overlaid on the map interface (L1) layer displayed on the user terminal 4000, and the object information layer (L3) may display attributes of the corresponding virtual object O3 (‘office’ in FIG. 7) and detailed information of the corresponding virtual object O3.

8 schematically shows the app list layer L4 for the corresponding virtual object O3 displayed on the user terminal 4000 as any one virtual object O3 displayed on the 3D map of the map interface L1 according to an embodiment of the present invention is selected.

As described above in FIG. 7, when the user selects 'app' from the object information layer L3 displayed as the virtual object O3 is selected, as shown in FIG.

In the step of providing the app list layer (S300), the app list layer (L4) including the derived app list information may be overlaid and displayed on the 3D map of the map interface (L1) displayed on the user terminal (4000). area (A2); and an installation suggestion area A1 displaying a list of one or more applications not set from the user terminal 4000 among one or more applications connected to the selected virtual object O3.

Specifically, the app list layer L4 provided to the user terminal 4000 in the app list layer providing step (S300) may be overlaid and displayed at a predetermined location (upper right corner in FIG. 8) on the map interface L1 displayed on the user terminal 4000. Through this configuration, the user can exert an effect of recognizing the selected virtual object O3 and the app list layer L4 for the selected virtual object O3 together on one screen.

Meanwhile, the app list layer L4 displayed overlaid on the map interface L1 displayed on the user terminal 4000 through the app list layer providing step (S300) includes an installation suggestion area A1 and an execution suggestion area A2.

In the installation suggestion area A1, a list of one or more applications connected to the virtual object O3 selected by the user and not set as usable in the corresponding user terminal 4000 is displayed, and in the execution suggestion area A2, a list of one or more applications connected to the virtual object O3 selected by the user and set as usable in the corresponding user terminal 4000 is displayed in the execution suggestion area A2.

When the user selects an installation input for any one application from among the list of one or more applications displayed in the installation suggestion area A1, the selected application can be set to be usable in the user terminal 4000, and when the user selects an execution input for any one application from among the list of one or more applications displayed in the execution suggestion area A2, the above-described service information providing step S400 is performed and the selected one application can be executed.

In this way, unlike the conventional method of providing services according to application execution, in the present invention, the virtual object O3 is first selected, and then an application executable for the virtual object O3 is selected through the app list layer L4. Since the virtual object service is provided, the service can be provided in a manner optimized for user experience in interfaces where numerous objects exist or objects are the core, such as a metaverse or a digital twin.

9 schematically shows a service layer (L5) displayed on the user terminal 4000 through the service information providing step (S400) according to an embodiment of the present invention.

As shown in FIG. 9 , the service information providing step (S400) includes a service layer providing step of executing the selected application, deriving service information targeting the selected virtual object (O3), and providing a service layer (L5) including the service information to the user terminal (4000), and the service layer (L5) is overlaid on the map interface (L1) displayed on the user terminal (4000). It can be.

Specifically, in the service information providing step (S400), when any one application is selected from among one or more applications included in the execution suggestion area A2 of the app list layer L4, the service information providing step S400 is performed to execute the selected application to derive service information for the selected virtual object O3. It can be provided to the horse (4000).

As such, the service layer L5 provided to the user terminal 4000 through the service information providing step (S400) may be overlaid and displayed at a predetermined location (upper right corner in FIG. 9 (A)) on the map interface L1 displayed on the user terminal 4000, as shown in FIG. In the service layer (L5), a selected application may be executed and service information on the selected virtual object (O3) may be displayed. For example, the service information displayed in the service layer (L5) shown in (A) of FIG. 9 is the application described as 'Analytics' that provides the trend of the number of visitors to the real object (2000) corresponding to the virtual object (O3) in the execution suggestion area (A2) of the app list layer (L4) of FIG. O3) may correspond to trend information on the number of visitors who have visited the real object 2000 corresponding to the virtual object O3.

Meanwhile, in the service layer L5 overlaid and displayed on the map interface L1 displayed on the user terminal 4000 through the service providing step, the user may input a request for detailed service information for service information derived from the selected application, as shown in FIG. ), and the detailed service layer L6 can be displayed on the user terminal 4000 as shown in (B) of FIG. 9 . The detailed service layer (L6) can display more specific information about the above-described service information, and the configuration of the detailed service layer (L6) can be configured differently depending on the executed application.

10 schematically shows an indoor interface L7 displayed on the user terminal 4000 through the indoor interface providing step according to an embodiment of the present invention.

As shown in FIG. 10 , in the map interface providing step (S200), when any one virtual object having a building attribute is selected on the 3D map of the map interface L1 displayed on the user terminal 4000, and entry into any one virtual object having the building attribute is input, the indoor interface L7 in which the inside of any one virtual object having the building attribute is displayed is provided to the user. and providing an indoor interface to the terminal 4000; and, on the indoor interface L7, one or more detailed virtual objects O4, O5, and O6 corresponding to one or more detailed reality objects 2000 included in the inside of the real object 2000 corresponding to any one virtual object having the building property may be displayed.

Specifically, as shown in (A) of FIGS. 7, 8 and 9 described above, when the user selects a virtual object that can provide an interface for the internal configuration of the real object 2000, such as a virtual object having building properties, among a plurality of virtual objects displayed on the 3D map of the map interface L1 displayed on the user terminal 4000, 3 of the map interface L1 An indoor entry element capable of calling the indoor interface L7 for the selected virtual object ('entering' in FIGS. 7, 8 and 9 (A)) is displayed on the D map, preferably on the upper side of the selected virtual object, and when the user selects the indoor entry element, as shown in FIG. L7) can be displayed.

Meanwhile, the virtual object on which the indoor entry element is displayed on the 3D map according to the user's selection is not limited to the virtual object having the aforementioned building properties. For example, even if the virtual object for which the indoor entry element is displayed on the 3D map has the property of a structure such as a subway station or other properties, if the indoor interface L7 for the virtual object exists, the indoor entry element can be displayed on the 3D map according to the user's selection of the corresponding virtual object.

More specifically, the step of providing a map interface (S200) includes the step of providing an indoor interface, and the step of providing an indoor interface may be performed when a user selects a virtual object to select an indoor entry element displayed on a 3D map.

In the step of providing an indoor interface, an indoor interface L7 displaying the interior of the virtual object selected by the user is derived and the indoor interface L7 is provided to the user terminal 4000, which can be displayed on the user terminal 4000. As shown in FIG. 10, the indoor interface L7 displays the internal structure of the virtual object selected by the user. The internal structure of the virtual object displayed on the indoor interface L7 may be configured in a form in which the internal structure of the real object 2000 corresponding to the virtual object is reflected.

Meanwhile, on the indoor interface L7, one or more detailed virtual objects O4, O5, and O6 may be displayed at one or more predetermined locations of the displayed internal structure, and the one or more detailed virtual objects O4, O5, and O6 correspond to one or more detailed reality objects 2000 included in the reality object 2000 corresponding to the virtual objects, Based on the reality information about the reality object 2000, the location and shape of the one or more detailed virtual objects O4, O5, and O6 may be determined. Taking the indoor interface L7 shown in FIG. 10 as an example, a total of three detailed virtual objects O4, O5, and O6 can be displayed in the internal structure displayed on the indoor interface L7, and the three detailed virtual objects O4, O5, and O6 correspond to the detailed reality object 2000 corresponding to the access control device disposed inside the real object (building). may apply.

In addition, in one embodiment of the present invention, as described above in FIGS. 7 and 8 , when the user selects the detailed virtual objects O4, O5, and O6 displayed on the indoor interface L7, the app list layer providing step (S300) may be performed, and the app list layer providing step (S300) derives app list information for a list of one or more applications connected to the detailed virtual object selected by the user, The app list layer L4 including the app list information may be provided to the user terminal 4000 and displayed overlaid on the indoor interface L7 displayed on the user terminal 4000 .

On the other hand, in another embodiment of the present invention, as shown in FIG. 10, when the interior of the virtual object selected by the user is composed of a plurality of layers or a plurality of areas, an area for calling the internal structure of another floor or area ('Uspace Building B 12F' in FIG. 10) may be displayed on the indoor interface L7 for the corresponding virtual object. The internal structure of another floor or area selected by the user may be displayed on the indoor interface L7 displayed on the terminal 4000 .

In addition, an exit element ('Exit' in FIG. 10) is displayed on the indoor interface L7, and when the user selects the exit element, the map interface L1 may be displayed again on the user terminal 4000.

11 schematically illustrates a virtual object displayed on a 3D map of a map interface L1 displayed on a user terminal 4000 according to an embodiment of the present invention.

11 schematically illustrates examples of virtual objects displayed on the 3D map of the map interface L1.

11(A) is a map interface overlaid with a service layer L8 displaying service information for the virtual object O7 by executing the selected application when a user selects a virtual object O7 corresponding to a real object 2000 for a bus displayed on a 3D map of a map interface L1 and selects one or more applications connected to the selected virtual object O7. (L1) is schematically shown.

In (A) of FIG. 11, the user selects an application capable of checking the real-time moving path of the virtual object (bus) O7, the application derives a real-time moving path (service information) for the virtual object (bus) O7 selected by the user, and the real-time moving path is displayed on the service layer L5.

On the other hand, in another embodiment of the present invention, when there is only one application connected to the virtual object O7 selected by the user, a list of applications connected to the map interface L1 is displayed, and the process of selecting an application by the user from the list can be omitted, one application connected to the virtual object O7 selected by the user is automatically executed, and service information according to the execution of the application can be displayed in the service layer L5.

11(B) schematically shows a map interface L1 in which a virtual object O8 corresponding to a real object 2000 for an airplane is displayed on a 3D map. As shown in (B) of FIG. 11, in the case of the reality object 2000 whose location is not fixed and whose location changes over time, the location of the virtual object O8 is also displayed on a 3D map on which the virtual object O8 for the corresponding reality object 2000 is displayed based on periodically received reality information of the reality object 2000. Depending on the location change of the corresponding reality object 2000, it may be changed and displayed in real time.

12 schematically illustrates a virtual object O9 displayed on a 3D map of an indoor interface L7 and a map interface L1 displayed on the user terminal 4000 according to an embodiment of the present invention.

12(A) schematically shows a screen on which the user terminal 4000 displays the indoor interface L7 of the virtual object selected by the user. As shown in (A) of FIG. 12, the indoor interface L7 displays detailed virtual objects O9 for each currently visited visitor inside the real object 2000 corresponding to the inside displayed on the indoor interface L7.

At this time, in the case of the detailed virtual object O9 for the visitor, reality information about the visitor is transmitted through a mobile device such as a smartphone possessed by the visitor or an external system 3000 communicating with the mobile device, the reality information receiving step (S100) of the service server 1000 receives reality information, and the map interface providing step (S200) provides detailed virtual objects for the visitor on the internal structure displayed on the indoor interface L7. Project O9.

12(B) schematically shows a map interface L1 in which a plurality of virtual objects O10, O11 and O12 are displayed on a 3D map. An area displayed on the 3D map of the map interface L1 displayed on the user terminal 4000 may be varied according to a user's input, and a plurality of virtual objects located in the actual area for the corresponding area may be displayed in the area displayed on the 3D map. For example, in (B) of FIG. 12, a virtual object O12 having building properties, a virtual object O11 having transportation means properties, and a virtual object O10 having human properties are displayed on the 3D map of the map interface L1.

As such, on the 3D map of the map interface L1, one or more virtual objects corresponding to one or more reality objects 2000 located in the real area are displayed in real time with respect to a predetermined area displayed on the 3D map, and one or more detailed reality objects 2000 located inside the reality object 2000 corresponding to the selected virtual object are displayed on the indoor interface L7 for the virtual object selected by the user. Since one or more sub-virtual objects for ) are displayed in real time, the user can exert an effect of grasping the positions of various objects in real time through the map interface L1 and the internal interface.

2. How to provide object-related app list interface

In the following, '1. As another method to more effectively provide service information related to the selected object to the user on an interface displaying a large number of objects, apart from the 'method of providing an object-oriented app execution interface', '2. How to provide an object-related app list interface' will be described.

13 schematically illustrates components for performing a method of providing an object-related app list interface according to an embodiment of the present invention.

As shown in FIG. 13, the service server 1000 communicates with a plurality of reality objects 2000 or an external system 3000 communicating with a plurality of reality objects 2000 and a user terminal 4000, as shown in FIG.

Specifically, the service server 1000 may include a reality information receiving unit 1100, a map interface providing unit 1200, an app list layer providing unit 1300, a target object providing unit 1400, a service information providing unit 1500, and a DB 1600 in order to perform the method of providing an object-related app list interface of the present invention. Meanwhile, since the reality object 2000, the external system 3000, the user terminal 4000, the reality information receiving unit 1100, the app list layer providing unit 1300, and the DB 1600 have been described in detail in FIG. 1, descriptions thereof will be omitted.

The map interface providing unit 1200 performs the map interface providing step (S600). As described above in the map interface providing step (S200) of FIG. 1, a list of one or more applications according to the one or more virtual objects projected on the 3D map displayed in the app display area A3 is provided in order to perform the method of providing a 3D map on which one or more virtual objects are projected and an object-related app list interface of the present invention. derived, and provides a map interface (L1) including an app display area (A3) in which the 3D map and a list of the one or more applications are displayed to the user terminal (4000). Through this, the user terminal 4000 displays an app display area A3 displaying a 3D map on which one or more virtual objects are projected and a list of one or more applications related to the one or more virtual objects projected on the 3D map.

The target object providing unit 1400 performs a target object providing step S700, and when the user selects any one application on the app display area A3 of the map interface L1 displayed on the user terminal 4000, the user terminal 4000 transmits information about the selection of any one application to the service server 1000, and accordingly the target object providing step S7 00) can be performed. In the target object providing step (S700), target object information for a list of one or more virtual objects to be executed by any one application selected by the user is derived, and the target object information is provided to the user terminal 4000.

On the other hand, the service information providing unit 1500 performs a service information providing step (S800). As described above in FIG. 1, the service information providing step (S800) may provide service information when a virtual object is first selected and any one application targeting the selected virtual object is subsequently selected. In addition, in the method of providing an object-related app list interface of the present invention, an application to be executed is selected first, and when a target virtual object is selected in the selected application, the selected application is executed to derive service information for the target virtual object.

As such, the present invention is another method for providing service information related to a selected object more effectively to a user in an interface in which a plurality of objects are displayed,

For a plurality of virtual objects projected on the 3D map, a list of a predetermined number of applications in order of high relevance to the plurality of virtual objects is displayed on the app display area A3, and when the user selects any one application in the app display area A3, target object information corresponding to a list of one or more virtual objects that may be the execution target of the selected application among the plurality of virtual objects projected on the 3D map is derived, and the user terminal ( 4000), and corresponds to a method of deriving service information and providing it to the user terminal 4000 when the user terminal 4000 selects any one virtual object included in the target object information.

Meanwhile, hereinafter, a method of providing an object-related app list interface according to the present invention will be described in detail.

14 schematically illustrates detailed steps of a method of providing an object-related app list interface according to an embodiment of the present invention.

As shown in FIG. 14, a method of providing an object-related app list interface executed in a service server (1000) including one or more processors and one or more memories, comprising: a reality information receiving step (S500) of receiving reality information for each of the plurality of reality objects (2000) from a plurality of reality objects (2000) or an external system (3000) communicating with the plurality of reality objects (2000); Based on the reality information of each of the reality objects 2000, a virtual object reflecting the shape and position of the corresponding reality object 2000 is displayed on a 3D map, and a map interface L1 including an app display area A3 displaying a list of one or more applications determined according to a predetermined rule among a plurality of applications connected to a plurality of virtual objects displayed on the 3D map is provided to the user terminal 4000. Interface providing step (S600); When any one application included in the app display area A3 of the map interface L1 displayed on the user terminal 4000 is selected, target object information for one or more virtual objects to be executed of the selected one application among a plurality of virtual objects displayed on the 3D map is derived, and the target object information is provided to the user terminal 4000 (S700) ; and a service information providing step (S800) of deriving service information for the selected virtual object by executing any one selected application when any one virtual object included in the target object information provided to the user terminal 4000 is selected through the target object providing step (S700) and providing the service information to the user terminal 4000.

Specifically, in the reality information receiving step (S500), as in the reality information receiving step (S100) described above with reference to FIG.

The map interface providing step (S600) generates a plurality of virtual objects for each of the plurality of reality objects (2000) based on the reality information received in the reality information receiving step (S500), displays one or more virtual objects corresponding to an area displayed on the 3D map on the 3D map, and additionally, displays one or more applications connected to each of the plurality of virtual objects displayed on the area of the 3D map. A list of a predetermined number of applications may be derived according to a predetermined rule for virtual objects, and the list of the predetermined number of applications may be included in the app display area A3 included in the map interface L1. In this way, the map interface providing step (S600) provides a map interface (L1) including a 3D map and an app display area (A3) to the user terminal 4000, the user terminal (4000) The map interface (L1) can be displayed.

The target object providing step (S700) may be performed when the user selects any one application from the list displayed in the app display area A3 of the map interface L1 displayed on the user terminal 4000. In the target object providing step (S700), target object information including one or more virtual objects that can be an execution target of an application selected by the user is derived. More specifically, one or more virtual objects included in the target object information may correspond to one or more virtual objects that may be an execution target of an application selected by the user among a plurality of virtual objects included in a predetermined area displayed on a 3D map of the map interface L1 displayed on the user terminal 4000. Meanwhile, the target object information derived in the target object providing step (S700) is provided to the user terminal 4000, and the target object information can be displayed on the user terminal 4000.

The service information providing step (S800) may be performed when the user selects any one virtual object included in the target object information from the target object information provided to the user terminal 4000 through the target object providing step (S700). In the service information providing step (S800), the user executes the application selected in the app display area A3 of the map interface L1, derives service information for the virtual object selected by the user included in the target object information, and provides it to the user terminal 4000.

The service information providing step (S800) includes a service layer providing step of providing the user terminal 4000 with a service layer including service information for any one of the selected virtual objects, and the service layer may be overlaid and displayed on the map interface L1 displayed on the user terminal 4000.

More specifically, the service information providing step (S800) includes a service layer providing step of providing the user terminal 4000 with a service layer displaying the derived service information. Meanwhile, the service layer provided to the user terminal 4000 may be overlaid and displayed at a predetermined location on the map interface L1 displayed on the user terminal 4000 . Since this has been described in detail with reference to FIG. 9 , it will be omitted.

15 schematically illustrates one or more applications connected to each virtual object displayed on a 3D map according to an embodiment of the present invention.

Figure 15 (A) schematically shows a map interface (L1) displayed on the screen of the user terminal (4000). The map interface L1 includes a 3D map and an app display area A3 on which a plurality of virtual objects are projected. A plurality of virtual objects corresponding to a plurality of reality objects 2000 located in a real area (region) corresponding to the corresponding area (region) are displayed on the 3D map, and a list of one or more applications determined according to predetermined rules is displayed in the app display area A3 among one or more applications connected to each of the plurality of virtual objects displayed in the corresponding area (region) of the 3D map.

Taking (A) of FIG. 15 as an example, a plurality of virtual objects (O20, O21, O22, O23, O24, O25, and O26) are displayed on the 3D map of the map interface (L1), and a plurality of virtual objects (O20, O21, O22, O23, O24, O25, and O26) are displayed on the app display area (A3) of the map interface (L1). A list of one or more applications (App#1, App#2, App#3, App#4, and App#5) derived by applying a preset rule to one or more applications connected to each other is displayed.

Meanwhile, (B) of FIG. 15 schematically shows one or more applications connected to each of the plurality of virtual objects (O20, O21, O22, O23, O24, O25, and O26) displayed on the 3D map shown in (A) of FIG. As shown in (B) of FIG. 15, one or more applications are connected to each of the virtual objects O20, O21, O22, O23, O24, O25, and O26, and in the map interface providing step (S600), in order to derive a list of one or more applications to be displayed in the app display area A3, the plurality of virtual objects O20, O21, O22, O23, Preset rules may be applied to one or more applications connected to O24, O25 and O26).

Specifically, the map interface providing step (S600) derives a degree of association with a plurality of virtual objects (O20, O21, O22, O23, O24, O25, and O26) for each application connected to the plurality of virtual objects (O20, O21, O22, O23, O24, O25, and O26), and derives a predetermined number of applications in order of highest degree of association to the app display area (A3). ) to be displayed.

As such, in the present invention, since applications having a high degree of correlation with a plurality of virtual objects currently displayed on the 3D map are displayed through the app display area A3, it is possible to recommend applications suitable for execution by the user.

16 schematically illustrates an app display area A3 included in a map interface L1 according to an embodiment of the present invention.

As shown in the map interface L1 shown in FIG. 16, a plurality of virtual objects are displayed on the 3D map, such as a virtual object having a property of a building, a virtual object having a property of a means of transportation (bus), and a virtual object having a property of a structure (bus stop), and a plurality of virtual objects among a plurality of applications connected to the plurality of virtual objects displayed on the 3D map are displayed in the app display area A3 according to predetermined rules. A list of a predetermined number of applications with a high degree of relevance, preferably, elements E1 to E6 for executing the applications may be displayed.

Meanwhile, the number of elements of the plurality of applications displayed on the app display area A3 is not limited to six as shown in FIG. 16, but may be changed by a manager or the like.

17 schematically illustrates a process in which the list of applications displayed in the app display area A3 is changed according to the change in the area displayed on the 3D map according to an embodiment of the present invention.

As shown in FIG. 17 , in the map interface L1, an area displayed on a 3D map is changed according to a user's input from the user terminal 4000, and in the map interface providing step (S600), the list of one or more applications displayed in the app display area A3 can be changed according to a plurality of virtual objects included in the area of the 3D map that is changed according to the user's input.

Specifically, the list of a predetermined number of applications displayed in the app display area A3 of the map interface L1 may vary as the 3D map area of the map interface L1 changes.

With respect to the 3D map of the map interface L1 displayed on the user terminal 4000, the user can change the area currently displayed on the 3D map. The user may perform an input for enlarging or reducing the currently displayed area in the user terminal 4000 or an input for moving the currently displayed area, and accordingly, the area displayed on the 3D map may be changed. For example, with respect to the area displayed on the 3D map of the map interface L1 of FIG. 17 (A), the user may input an input for moving to the right through the user terminal 4000, and accordingly, the area moved to the right from the area displayed in (A) of FIG. 17 may be displayed on the 3D map of the map interface of FIG. 17 (B).

Accordingly, a plurality of virtual objects included in the changed area may be displayed on the 3D map with the changed area. For example, a plurality of objects O20 to O26 are displayed on the 3D map in (A) of FIG. 17 , but on the 3D map in (B) of FIG. 17 in which the displayed area is changed according to a user input, the existing virtual objects O20, O21, O22, O25, and O26 located on the right are no longer displayed, and new virtual objects O27 to O30 are additionally displayed.

In addition, as the area implemented on the 3D map is changed, a list of a predetermined number of applications displayed in the app display area A3 of the map interface L1 may also be changed. Specifically, in (A) of FIG. 17, a list of a predetermined number of applications (App#1 to App#5 in (A) of FIG. 17) that are highly related to the plurality of virtual objects (O20 to O26) determined according to a predetermined rule among one or more applications connected to each of the plurality of virtual objects (O20 to O26) projected on the area implemented on the 3D map is displayed.

On the other hand, in (B) of FIG. 17, the area implemented on the 3D map is variable compared to the area implemented on the 3D map shown in (A) of FIG. 17 according to a user's input, and accordingly, the map interface providing step (S600) is based on preset rules among one or more applications connected to each of the plurality of virtual objects (O23, O24, O27 to O30) projected on the area implemented on the 3D map of FIG. 17 (B). A list of a predetermined number of applications (App#1, App#3, App#4, App#6, and App#7 in FIG. 17(B)) having a high degree of relevance to the plurality of virtual objects O23, O24, O27 to O30 determined according to the above is displayed.

In this way, the map interface providing step (S600) of the present invention implements a 3D map according to the changed area when the user performs an input for varying the area implemented in the 3D map with respect to the 3D map of the map interface L1 displayed on the user terminal 4000. Specifically, the 3D map is implemented by projecting a plurality of virtual objects located in the area on the changed area of the 3D map, and also implemented for the changed area. A predetermined number of application lists having a high degree of relation to the plurality of virtual objects projected on the 3D map are derived and displayed in the app display area A3 of the map interface L1.

That is, as a plurality of virtual objects displayed on the 3D map are changed in the app display area A3, a list of a predetermined number of applications displayed on the app display area A3 is re-derived, so that applications that are highly related to the plurality of currently displayed virtual objects can be recommended in conjunction with the 3D map that the user wants to see.

18 schematically illustrates one or more applications preset according to attributes assigned to a virtual object according to an embodiment of the present invention.

As shown in FIG. 18, in the step of providing a map interface (S600), one or more pre-set applications for each attribute may be set as a connected application according to attributes assigned to each of a plurality of virtual objects displayed on the 3D map.

Specifically, as described above, in deriving a list of a predetermined number of applications displayed on the app display area A3 in the map interface providing step (S600), one or more applications connected to a plurality of virtual objects displayed on the 3D map are preferably, as shown in FIG. It may correspond to one or more set applications.

Taking the items shown in FIG. 18 as an example, 'means of transportation', 'building', 'person', and 'access control' correspond to attributes that can be assigned to virtual objects. App#1, App#3, and App#4 are connected to 'means of transportation', App#1, App#2, App#5, and App#6 are connected to 'building', App#2, App#7, and App#8 are connected to 'person', and 'Access Control' is connected to Just as App#9 and App#10 are connected, one or more preset applications for each attribute are connected.

In this way, in the map interface providing step (S600), one or more applications preset for one or more properties assigned to the virtual object displayed on the 3D map may correspond to one or more applications connected to the corresponding virtual object.

19 schematically illustrates a target object list layer L9 according to an application selected through the app display area A3 according to an embodiment of the present invention.

As shown in FIG. 19, the target object providing step (S700) includes a target object list layer providing step of providing a target object list layer (L9) on which a list of one or more virtual objects included in the target object information is displayed to the user terminal (4000), and the target object list layer (L9) is a map interface displayed on the user terminal (4000). It may be displayed overlaid on the screen L1.

Specifically, in the target object providing step (S700), as shown in (A) of FIG. 19, in the app display area (A3) of the map interface (L1) displayed on the user terminal 4000, the user selects any one application as shown in (B) of FIG. It can be performed in the case of App#2) in (B) of 19.

In the target object providing step (S700), target object information for one or more virtual objects that may be an execution target of the application selected by the user is derived. More specifically, the target object providing step (S700) derives target object information for one or more virtual objects that can be an execution target of an application selected by a user among a plurality of virtual objects projected on a currently displayed 3D map.

For example, when the user selects an application providing a public transport location service from the app display area A3, in the target object providing step (S700), only virtual objects with public transport properties are included in the target object information, except for virtual objects with building properties among a plurality of virtual objects displayed on the 3D map. That is, in the target object providing step (S700), not all of the plurality of virtual objects displayed on the 3D map are included in the target object information, but only virtual objects that can be executed by the application selected by the user are selectively included in the target object information, so that the user can more easily receive service information according to the execution of the application.

Meanwhile, the target object list layer providing step (S700) includes a target object list layer providing step, and the target object list layer providing step provides the target object list layer L9 including the derived target object information to the user terminal 4000, so that the target object list layer L9 is displayed on the user terminal 4000. At this time, the target object list layer (L9) on which the target object information is displayed may be overlaid and displayed at a predetermined position on the 3D map of the map interface (L1) displayed on the user terminal (4000).

Taking FIG. 19 (B) as an example, the target object providing step (S700) derives target object information (object #1, object #2, object #4, object #6, and object #7 in FIG. 19 (B)) including one or more virtual objects that can be an execution target of an application (App#2 in FIG. 19 (B)) selected by the user, and the target object information is provided to the user terminal 4000. It can be displayed on the target object list layer (L9) overlaid on a predetermined position of the displayed map interface (L1).

Accordingly, the user can select any one virtual object from among the target object information displayed on the target object list layer L9, and as any one virtual object is selected, the above-described service information providing step (S800) is performed to execute any one application selected by the user on the app display area A3 to derive service information for the selected one virtual object, and the service information is the user terminal 40 as shown in FIG. 00) can be displayed.

3. A method of providing an app list interface using the degree of association between objects and apps

The above '2. In the method for providing an object-related app list interface, a list of a predetermined number of applications displayed in the app display area A3 is described as deriving a predetermined number of applications by applying a predetermined rule to a degree of association with a plurality of virtual objects displayed on a 3D map of the map interface L1 displayed on the user terminal 4000, and deriving a predetermined number of applications in order of highest degree of association.

Hereinafter, the above-mentioned '2. As an example of the preset rules described in 'Method of providing object-related app list interface', a method of deriving a degree of association between one or more applications connected to a plurality of virtual objects displayed on a 3D map and a plurality of virtual objects will be described.

20 schematically illustrates detailed steps of a method of providing an app list interface using a degree of association between objects and apps according to an embodiment of the present invention.

As shown in FIG. 20, a method of providing an app list interface using a degree of association between objects and apps executed in a service server (1000) including one or more processors and one or more memories, wherein reality information for each of the reality objects (2000) is received from a plurality of reality objects (2000) or an external system (3000) communicating with the plurality of reality objects (2000) (S1). 000); a virtual object creation step (S1100) of generating a virtual object reflecting the shape and location of the corresponding reality object 2000 based on the reality information of each of the reality objects 2000 and projecting them on a 3D map; App derivation step of deriving a predetermined number of applications in the order of highest degree of association between each application and the plurality of virtual objects among the plurality of applications connected to the plurality of virtual objects projected on the 3D map (S1200); And a map interface providing step (S1300) of providing a map interface (L1) including a 3D map on which the plurality of virtual objects are projected and an app display area (A3) in which the derived predetermined number of applications are displayed to the user terminal (4000) (S1300).

Specifically, in the reality information receiving step (S1000), as in the reality information receiving step (S100) described above in FIG. 1 and the reality information receiving step (S500) described above in FIG.

Although the virtual object generating step (S1100) is not shown in the service server 1000 shown in FIGS. 1 and 14, it may be performed in a virtual object generating unit (not shown), and the virtual object generating step (S1100) generates the corresponding reality object (2) based on the reality information for each of the plurality of reality objects (2000) received in the reality information receiving step (S1000). 000) to create a virtual object. Specifically, the reality information received through the reality information receiving step (S1000) may include shape information, location information, and service information as described with reference to FIG.

Meanwhile, in displaying the virtual objects generated on the 3D map in the virtual object generation step (S1100), all generated virtual objects may be displayed on the 3D map at once. 000), if a region displayed on the 3D map is changed according to a user's input, virtual objects to be displayed in the changed region may be displayed on the 3D map.

The app derivation step (S1200) is not included in the service server 1000 shown in FIGS. 1 and 14, but may be performed by an app derivation unit (not shown). derive Meanwhile, a method of calculating a degree of association for a plurality of virtual objects projected on a 3D map for each of a plurality of applications in the app derivation step (S1200) will be described in detail with reference to FIG. 21 .

The map interface providing step (S1300) provides a map interface (L1) including a 3D map on which the virtual object is projected in the virtual object generating step (S1100) and an app display area (A3) displaying a predetermined number of applications derived in the app derivation step (S1200) to the user terminal 4000, and the user terminal 4000 has the 3D map and the A map interface L1 including an app display area A3 may be displayed on the user terminal 4000 .

Meanwhile, the virtual object generation step (S1100) and the app derivation step (S1200) may be understood to be included in the map interface providing step (S1300), like the map interface providing step (S200) described above in FIG. 3 and the map interface providing step (S600) described above in FIG. 14.

21 schematically illustrates a process of calculating a degree of association between an application and a plurality of virtual objects in the app derivation step (S1200) according to an embodiment of the present invention.

As shown in FIG. 21 , in the app derivation step (S1200), for each of a plurality of applications connected to a plurality of virtual objects projected on the 3D map, the higher the number of virtual objects connected to each application, the higher the degree of relevance of the corresponding application.

Specifically, as shown in FIG. 21(A), in the app derivation step S1200, a plurality of virtual objects displayed on the 3D map (O30 to O35 in FIG. 21(A)) for each of a plurality of applications connected to each of the plurality of virtual objects (O30 to O35 in FIG. 21(A)) displayed on the 3D map through the virtual object generation step (S1100) is calculated, and a predetermined number of applications are derived in order of highest degree of relevance.

As shown in (B) of FIG. 21, a plurality of applications are preset in the plurality of virtual objects (O30 to O35 in (A) of FIG. 21) displayed on the 3D map. Here, the plurality of applications preset in each virtual object may refer to applications capable of targeting the corresponding virtual object for execution. Taking FIG. 21(B) as an example, each of the three applications App#1, App#2, and App#5 preset in the virtual object O30 may refer to an application capable of deriving service information for the virtual object O30 with the virtual object O30 as an execution target.

Meanwhile, in the app derivation step (S1200), as a method for calculating the degree of association between an application and a plurality of virtual objects, the number of virtual objects connected to each application is calculated, and the higher the number, the higher the degree of association. Taking FIGS. 21(B) and 21(C) as an example, among applications connected to a plurality of virtual objects (O30 to O35 in (B) of FIG. 21), only one virtual object O30 is connected to application App#1, and three virtual objects O30, O31, and O33 are connected to application App#2, and virtual object O3 is connected to application App#3. 1, Virtual Object O33, Virtual Object O34, Virtual Object O35, that is, 4 are connected, Application App#5 has one Virtual Object O30, which is connected, Application App#6 has a Virtual Object O34, Virtual Object O35, that is, two connected, and Application App#7 and Application App#8 are connected with Virtual Object O32 and Virtual Object O34, respectively. has been

In this way, in the app derivation step (S1200), it is determined how many virtual objects are connected for each application, and a predetermined number of applications are derived in the order of the largest number of connected applications. As shown in (C) of FIG. 21, when the predetermined number is 3, the app derivation step (S1200) derives applications to be displayed in the app display area A3 in order of application App#3, application App#2, and application App#3 in the order of the largest number of connections. On the other hand, the predetermined number derived in the app derivation step (S1200) is not limited to three, as shown in FIG. 21 (C), and can be changed in design to various numbers.

As described above, in the present invention, applications suitable for the plurality of virtual objects displayed on the current 3D map can be effectively recommended to the user by easily calculating the degree of association between each application and a plurality of virtual objects and displaying applications having a high degree of association in the app display area A3.

22 schematically illustrates a list of applications displayed in the app display area A3 according to a plurality of virtual objects displayed on a 3D map according to an embodiment of the present invention.

As shown in FIG. 22 , in the map interface L1, when an area displayed on a 3D map is changed according to a user's input from the user terminal 4000, and in the app derivation step S1200, when an area displayed on the 3D map is changed according to the user's input, the predetermined number of applications may be derived again based on a plurality of virtual objects included in the changed area.

Specifically, the area (region) of the 3D map displayed on the user terminal 4000 may be changed to another area according to a user's input and displayed on the user terminal 4000 . At this time, one or more virtual objects to be located in the corresponding area are displayed on the 3D map changed to the other area. In addition, even if the user does not change the area displayed on the 3D map to another area, if the reality object 2000 leaves the area corresponding to the area displayed on the 3D map or another reality object 2000 enters the area, the virtual object corresponding to the deviating reality object 2000 disappears from the 3D map in real time, and the virtual object corresponding to the entered reality object 2000 is displayed. may be additionally displayed. That is, in the present invention, the virtual objects included in the area displayed on the 3D map can be displayed by periodically receiving reality information of the real object 2000 corresponding to the created virtual object, tracking the movement of the corresponding reality object 2000 through the periodically received reality information, and reflecting the location of the virtual object corresponding to the corresponding reality object 2000.

Taking FIG. 22 as an example, as shown in (A) of FIG. 22, a plurality of virtual objects O30 to O35 are displayed on the 3D map initially displayed on the user terminal 4000, and then the changed positions of the plurality of virtual objects over time are displayed on the 3D map. Taking FIG. 22(B) as an example, as time goes by, the virtual object O34 shown in FIG.

Meanwhile, in the app derivation step (S1200), as the virtual object displayed on the 3D map changes, a relationship between a plurality of applications connected to the changed virtual object and the changed virtual object is calculated based on the changed virtual object, and a predetermined number of applications are derived in order of high correlation, and the derived predetermined number of applications can be displayed in the app display area A3.

For example, if application App#3, application App#2, and application App#6 are displayed in the app display area A3 shown in (A) of FIG. 22, and the virtual objects displayed on the 3D map change over time as shown in (B) of FIG. A predetermined number of applications App#3, App#2 and App#1 are derived in ascending order, and the derived application App#3, App#2 and App#1 are displayed in the app display area A3.

Meanwhile, in one embodiment of the present invention, the order in which a predetermined number of applications displayed in the app display area A3 are displayed may be sequentially displayed in order of high degree of relevance.

23 schematically shows a configuration in which one or more applications are connected according to attributes assigned to the virtual object created in the virtual object creation step (S1100) according to an embodiment of the present invention.

As shown in FIG. 23 , in the virtual object creation step (S1100), based on the reality information of the reality object 2000, properties for the type of the corresponding reality object 2000 are given to the virtual object, and in the app derivation step (S1200), a plurality of applications preset for the properties assigned to the virtual object can be set as applications connected to the corresponding virtual object.

Specifically, one or more applications connected to the virtual object shown in FIG. 21 (B) may preferably have one or more properties assigned to the virtual object created through the virtual object creation step (S1100), and one or more applications preset for each of the one or more assigned properties may correspond to one or more applications connected to the corresponding virtual object.

More specifically, one or more applications may be preset in the service server 1000 for each attribute that may be assigned to a virtual object. For example, as shown in FIG. 23 , application App#1, application App#2, and application App#5 are preset for building properties, application App#2 is preset for transportation properties, application App#3 is preset for public transportation properties, application App#7 is preset for structure properties, application App#3 and application App#6 are preset for person properties, and application App#8 is preset for authorization attributes. On the other hand, the virtual object O30 created through the virtual object generation step (S1100) is endowed with building properties, the virtual objects O31 and O33 are endowed with the properties of means of transportation and the properties of public transportation, the virtual object O32 is endowed with the properties of a structure, the virtual object O34 is endowed with the properties of a person and the properties for endowing rights, and the virtual object O35 is endowed with a person When the attribute of is assigned, as shown in FIG. 23, in the app derivation step (S1200), one or more applications preset in one or more attributes assigned to the corresponding virtual object may correspond to one or more applications connected to the corresponding virtual object.

As described above, in one embodiment of the present invention, by connecting one or more applications for each property assigned to a virtual object, an effect of connecting one or more applications to an easily created virtual object can be achieved.

24 schematically illustrates the internal configuration of a computing device according to an embodiment of the present invention.

The service server 1000 shown in FIGS. 1 and 13 described above may include components of the computing device 11000 shown in FIG. 24 .

As shown in FIG. 24 , a computing device 11000 may include at least one processor 11100, memory 11200, peripheral interface 11300, I/O subsystem 11400, power circuit 11500, and communication circuit 11600. At this time, the computing device 11000 may correspond to the service server 1000 shown in FIGS. 1 and 13 .

The memory 11200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or non-volatile memory. The memory 11200 may include a software module, a command set, or other various data necessary for the operation of the computing device 11000.

In this case, access to the memory 11200 from other components, such as the processor 11100 or the peripheral device interface 11300, may be controlled by the processor 11100.

Peripheral interface 11300 may couple input and/or output peripherals of computing device 11000 to processor 11100 and memory 11200 . The processor 11100 may execute various functions for the computing device 11000 and process data by executing software modules or command sets stored in the memory 11200 .

The input/output subsystem can couple various input/output peripherals to peripheral interface 11300. For example, the input/output subsystem may include a controller for coupling a peripheral device such as a monitor, keyboard, mouse, printer, or touch screen or sensor to the peripheral device interface 11300 as needed. According to another aspect, input/output peripherals may be coupled to the peripheral interface 11300 without going through the input/output subsystem.

The power circuit 11500 may supply power to all or some of the terminal's components. For example, the power circuit 11500 may include a power management system, one or more power sources such as a battery or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or any other component for generating, managing, or distributing power.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, the communication circuit 11600 may include an RF circuit and transmit/receive an RF signal, also known as an electromagnetic signal, to enable communication with other computing devices.

The embodiment of FIG. 24 is just one example of the computing device 11000, and the computing device 11000 may omit some of the components shown in FIG. 24, further include additional components not shown in FIG. 24, or may have a configuration or arrangement in which two or more components are combined. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. Components that may be included in the computing device 11000 may be implemented as hardware including one or more signal processing or application-specific integrated circuits, software, or a combination of both hardware and software.

Methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in computer readable media. In particular, the program according to the present embodiment may be configured as a PC-based program or a mobile terminal-only application. An application to which the present invention is applied may be installed in the computing device 11000 through a file provided by a file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to a request of the computing device 11000 .

The device described above may be implemented as a hardware component, a software component, and/or a combination of hardware components and software components. For example, devices and components described in the embodiments may be implemented using one or more general purpose computers or special purpose computers, such as, for example, a processor, controller, arithmetic logic unit (ALU), digital signal processor, microcomputer, field programmable gate array (FPGA), programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will recognize that the processing device may include a plurality of processing elements and/or multiple types of processing elements. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include a computer program, code, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired, or may independently or collectively direct a processing device. Software and/or data may be permanently or temporarily embodied in any tangible machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave, to be interpreted by or to provide instructions or data to a processing device. Software may be distributed on networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions such as ROM, RAM, and flash memory. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

According to an embodiment of the present invention, when a virtual object displayed on a 3D map of a map interface is selected, an app list layer displaying app list information for one or more applications connected to the selected virtual object is provided to the user terminal and displayed, so that an object-based service according to application execution can be provided.

According to an embodiment of the present invention, reality information about a plurality of reality objects in the real world is received, virtual objects corresponding to the reality objects are generated according to the reality information, and displayed on a 3D map, and the shapes and positions of the reality objects included in the reality information are reflected on the 3D map, so that a user using the 3D map can feel a sense of reality.

According to an embodiment of the present invention, the step of providing the app list layer causes the app list layer to be overlaid and displayed on the 3D map of the map interface displayed on the user terminal, so that the user can more conveniently recognize the virtual object displayed on the 3D map of the map interface and the app list layer for the corresponding virtual object.

According to one embodiment of the present invention, in the service information providing step, when any one application displayed on the app list layer is selected, the selected application is executed to derive service information for the selected virtual object, and the service layer including the service information is overlaid on the map interface displayed on the user terminal, so that the user can select a virtual object on the map interface, select any one application related to the virtual object, and receive service information. can exert

According to one embodiment of the present invention, the app list layer includes an installation suggestion area, and one or more applications not installed on the user terminal among one or more applications connected to the selected virtual object are displayed in the installation suggestion area.

According to an embodiment of the present invention, in the step of providing a map interface, when a virtual object having a building attribute is selected on the 3D map and entry to the virtual object is input, an indoor interface for the interior of the selected virtual object and detailed virtual objects included in the interior are displayed, so that the user can confirm the interior of the selected building and the objects included therein.

According to one embodiment of the present invention, a list of a predetermined number of applications selected according to a predetermined rule from among one or more applications connected to each of a plurality of virtual objects projected on a 3D map is displayed in the app display area, thereby providing an effect of recommending applications related to a plurality of virtual objects displayed on the 3D map currently viewed by the user.

According to an embodiment of the present invention, the area displayed on the 3D map is variable according to user input, and a list of a predetermined number of applications displayed according to one or more applications connected to a plurality of virtual objects projected on the variable area on the 3D map is changed in the app display area.

According to an embodiment of the present invention, in the app derivation step, for each of a plurality of applications, the higher the number of virtual objects connected to each application, the higher the degree of association between the application and the plurality of virtual objects.

As described above, although the embodiments have been described with limited examples and drawings, those skilled in the art can make various modifications and variations from the above description. For example, even if the described techniques are performed in an order different from the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form from the described method, or replaced or substituted by other components or equivalents, appropriate results can be achieved.

Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (8)

As a method of providing an app list interface using an association between an object and an app executed in a service server including one or more processors and one or more memories,
a reality information receiving step of receiving, by the service server, reality information including shape information and location information for each of the reality objects from a plurality of reality objects in reality or an external system communicating with the plurality of reality objects;
A virtual object creation step of generating, by the service server, a virtual object to which the shape and location of the corresponding reality object are reflected based on the reality information of each reality object and to which one or more properties corresponding to the type of the corresponding reality object are assigned, and projecting the virtual object onto a 3D map;
an app derivation step of deriving, by the service server, a predetermined number of applications in order of highest degree of association between each application and the plurality of virtual objects among a plurality of applications connected to a plurality of virtual objects projected on the 3D map;
A map interface providing step of providing, by the service server, a map interface including a 3D map on which the plurality of virtual objects are projected and an app display area in which the derived application of a preset number is displayed to a user terminal;
When any one application included in the app display area of the map interface displayed on the user terminal is selected, a target object providing step of deriving target object information for one or more virtual objects to be executed, and providing the target object information to the user terminal; and
When any one virtual object included in the target object information provided to the user terminal is selected through the target object providing step, a service information providing step of executing the selected one application to derive service information for the selected one virtual object and providing the service information to the user terminal;
The app derivation step,
For each of the plurality of virtual objects projected on the 3D map, a plurality of applications preset as being capable of deriving service information on the virtual object to which the corresponding property is assigned for each of one or more properties assigned to each of the plurality of virtual objects projected on the 3D map are connected applications for the corresponding virtual object, and for each of the plurality of connected applications, it is determined that the higher the number of virtual objects connected to each application, the higher the degree of relevance of the corresponding application;
In the step of providing the target object,
A target object list layer providing step of providing the user terminal with a target object list layer displaying a list of one or more virtual objects included in the target object information;
The target object list layer,
Through the map interface providing step, the location of one or more virtual objects displayed on the user terminal is overlaid and displayed on a map interface that changes in real time, and a list of virtual objects included in the target object information together with the information displayed on the map interface is simultaneously displayed on the user terminal,
The map interface,
A 3D map in which an area displayed on the 3D map is varied according to a user's input at the user terminal and the position of one or more virtual objects corresponding to a real object is changed in real time;
The app derivation step,
When the area displayed on the 3D map is changed according to the user's input, a method of providing an app list interface using a degree of association between objects and apps, in which a predetermined number of applications are derived again based on a plurality of applications preset for a corresponding property for each of one or more properties assigned to each of a plurality of virtual objects included in the changed area.
delete delete delete delete delete A service server that performs a method of providing an app list interface using an association between an object and an app, including one or more processors and one or more memories,
a reality information receiving step of receiving reality information including shape information and location information for each of the reality objects from a plurality of reality objects in reality or an external system communicating with the plurality of reality objects;
A virtual object creation step of generating a virtual object to which the shape and position of the corresponding reality object are reflected based on the reality information of each of the reality objects and to which one or more properties corresponding to the type of the corresponding reality object are assigned, and projecting the virtual object onto a 3D map;
an app derivation step of deriving a predetermined number of applications in order of highest degree of association between each application and the plurality of virtual objects among a plurality of applications connected to a plurality of virtual objects projected on the 3D map;
A map interface providing step of providing a map interface including a 3D map on which the plurality of virtual objects are projected and an app display area in which the derived application of the preset number is displayed to a user terminal;
When any one application included in the app display area of the map interface displayed on the user terminal is selected, a target object providing step of deriving target object information for one or more virtual objects to be executed, and providing the target object information to the user terminal; and
When any one virtual object included in the target object information provided to the user terminal is selected through the target object providing step, a service information providing step of executing the selected one application to derive service information for the selected one virtual object and providing the service information to the user terminal;
The app derivation step,
For each of the plurality of virtual objects projected on the 3D map, a plurality of applications preset as being capable of deriving service information on the virtual object to which the corresponding property is assigned for each of one or more properties assigned to each of the plurality of virtual objects projected on the 3D map are connected applications for the corresponding virtual object, and for each of the plurality of connected applications, it is determined that the higher the number of virtual objects connected to each application, the higher the degree of relevance of the corresponding application;
In the step of providing the target object,
A target object list layer providing step of providing the user terminal with a target object list layer displaying a list of one or more virtual objects included in the target object information;
The target object list layer,
Through the map interface providing step, the location of one or more virtual objects displayed on the user terminal is overlaid and displayed on a map interface that changes in real time, and a list of virtual objects included in the target object information together with the information displayed on the map interface is simultaneously displayed on the user terminal,
The map interface,
A 3D map in which an area displayed on the 3D map is varied according to a user's input at the user terminal and the position of one or more virtual objects corresponding to a real object is changed in real time;
The app derivation step,
When an area displayed on the 3D map is changed according to the user's input, a service server performing a method of providing an app list interface using a degree of association between objects and apps, in which a predetermined number of applications are derived again based on a plurality of applications preset for a corresponding attribute for each of at least one attribute assigned to each of a plurality of virtual objects included in the changed region.
A computer-readable medium for implementing a method of providing an app list interface using an association between an object and an app executed in a service server including one or more processors and one or more memories, wherein the computer-readable medium includes computer-executable instructions for causing the service server to perform the following steps,
The following steps are:
a reality information receiving step of receiving reality information including shape information and location information for each of the reality objects from a plurality of reality objects in reality or an external system communicating with the plurality of reality objects;
A virtual object creation step of generating a virtual object to which the shape and position of the corresponding reality object are reflected based on the reality information of each of the reality objects and to which one or more properties corresponding to the type of the corresponding reality object are assigned, and projecting the virtual object onto a 3D map;
an app derivation step of deriving a predetermined number of applications in order of highest degree of association between each application and the plurality of virtual objects among a plurality of applications connected to a plurality of virtual objects projected on the 3D map;
A map interface providing step of providing a map interface including a 3D map on which the plurality of virtual objects are projected and an app display area in which the derived application of the preset number is displayed to a user terminal;
When any one application included in the app display area of the map interface displayed on the user terminal is selected, a target object providing step of deriving target object information for one or more virtual objects to be executed, and providing the target object information to the user terminal; and
When any one virtual object included in the target object information provided to the user terminal is selected through the target object providing step, a service information providing step of executing the selected one application to derive service information for the selected one virtual object and providing the service information to the user terminal;
The app derivation step,
For each of the plurality of virtual objects projected on the 3D map, a plurality of applications preset as being capable of deriving service information on the virtual object to which the corresponding property is assigned for each of one or more properties assigned to each of the plurality of virtual objects projected on the 3D map are connected applications for the corresponding virtual object, and for each of the plurality of connected applications, it is determined that the higher the number of virtual objects connected to each application, the higher the degree of relevance of the corresponding application;
In the step of providing the target object,
A target object list layer providing step of providing the user terminal with a target object list layer displaying a list of one or more virtual objects included in the target object information;
The target object list layer,
Through the map interface providing step, the location of one or more virtual objects displayed on the user terminal is overlaid and displayed on a map interface that changes in real time, and a list of virtual objects included in the target object information together with the information displayed on the map interface is simultaneously displayed on the user terminal,
The map interface,
A 3D map in which an area displayed on the 3D map is varied according to a user's input at the user terminal and the position of one or more virtual objects corresponding to a real object is changed in real time;
The app derivation step,
A computer-readable recording medium having a computer program recorded thereon for realizing a method for providing an app list interface using a degree of association between objects and apps, in which, when the area displayed on the 3D map is changed according to the user's input, the preset number of applications is derived again based on a plurality of applications preset for a corresponding property for each of one or more properties assigned to each of the plurality of virtual objects included in the changed area.

Images