KR20240030481A - Method and apparatus for generating customized region within the space with which service element is associated using tool for generating customized region - Google Patents

Abstract

A method of creating a custom area associated with a service element using a custom area creation tool, setting an area corresponding to the custom area in a space using a first user interface (UI) of the custom area creation tool, and , Associating a service element with a set area, and using the second UI of the custom area creation tool, for the set area, scenario conditions for controlling the user terminal based on the service element as the user terminal is located in the custom area. A method for creating a custom area is provided.

Description

Method and apparatus for creating a custom area associated with a service element within a space using a custom area creation tool

The description below relates to a method and device for creating a custom area associated with a service element in a space. Using a custom area creation tool, an area corresponding to the custom area is set in the space and a service element is placed in the set area. It relates to a method and device for creating a custom area by associating and setting scenario conditions for controlling a user terminal based on service elements.

Augmented Reality (AR) refers to a technology that fuses and complements virtual objects and information created with computer technology in the real world. In other words, augmented reality is a technology that augments and displays virtual content in a real environment, and users can view augmented content corresponding to the real environment through an electronic device.

Through the user terminal, which is the user's electronic device, content related to objects existing at a certain distance or within a certain radius based on the location of the user terminal is augmented on the image of the user terminal and provided. In this way, when augmented content is provided only based on the physical distance from the user terminal, there are cases where an unnecessarily large amount of content is augmented, increasing the user's cognitive load and the load on the user terminal. Additionally, content that does not match the service intended by the user may be inappropriately augmented on the user terminal.

In order to solve this problem, an area for controlling the user terminal, such as providing AR content to the user terminal, can be set within the space, and the use of a tool to conveniently set the area is required.

As a technology related to various services utilizing augmented reality technology, for example, in Korean Patent Publication No. 10-2014-0065963 (published on May 30, 2014), an image of the driving path captured by a camera installed in a vehicle An augmented reality navigator is disclosed that displays on a display and maps virtual display information guiding a driving route to the image displayed on the display.

The information described above is for illustrative purposes only and may include content that does not form part of the prior art and may not include what the prior art would suggest to a person skilled in the art.

Using the custom area creation tool, create a custom area by setting an area corresponding to the custom area in the space, associating service elements with the set area, and setting scenario conditions for controlling the user terminal based on the service element. We can provide a way to do this.

Using the User Interface (UI) provided by the custom area creation tool, define a custom area in two-dimensional space and/or three-dimensional space within the space, associate service elements with the custom area, and create service elements based on the service elements. By defining a scenario for providing services or information related to the space or controlling the settings of the user terminal, a custom area for controlling the user terminal according to the scenario can be created.

By setting various condition(s), such as whether the user terminal enters or exits the custom area, as scenario conditions in the custom area, the content provided to the user terminal is varied depending on whether the scenario conditions are satisfied, or the user The UI provided to the terminal can be changed, or the settings control of the user terminal can be changed differently.

According to one aspect, a method of creating a custom area using a custom area creation tool for creating a custom area associated with at least one service element, performed by a computer system, comprising: a first part of the custom area creation tool; 1 Using a user interface (UI), setting an area corresponding to the custom area in a space, associating the service element with the set area, and using the second UI of the custom area creation tool Thus, a method for creating a custom area is provided, including the step of setting scenario conditions for controlling the user terminal based on the service element as the user terminal is located in the custom area corresponding to the set area. .

The set area may include at least one of a two-dimensional space that is at least a part of the space and a three-dimensional space that is at least a part of the space, which are set using the first UI.

The defining step includes displaying, through the first UI, at least one of a map of the space, point cloud data (PCD) collected for the space, and an image in which the space is captured, and the displayed Establishing the area by defining the area based on input received from a user according to the geometry of the space identified by at least one of a map of the space, the PCD, and the image. You can.

The first UI may be a UI for creating an indoor map of the space.

In the defining step, the area may be automatically set based on the location of an object predefined in the space, a two-dimensional space predefined in the space, or a polygon predefined in the space.

The area is defined to include a two-dimensional space and a three-dimensional space with a set height range, and when the user terminal is located in the two-dimensional space and the height of the user terminal falls within the set height range, the user terminal is It is determined to be located in a custom area and can be controlled based on the set scenario conditions and the service elements.

The scenario condition includes a 3DoF (Degree Of Freedom) or 6DoF posture condition of the user terminal, and when the user terminal is determined to be located in the custom area, if the posture of the user terminal satisfies the posture condition , can be set to control the user terminal based on the service element.

The scenario condition may be set to distinguish between when the user terminal enters the custom area and when the user terminal leaves the custom area, and to control the user terminal differently based on the service element.

The service element includes data for displaying AR (augmented reality) content related to a service associated with the space, and when the user terminal is located in the custom area, according to the set scenario conditions, the user The AR content may be displayed through an AR view that includes an image captured by the terminal's camera.

The scenario condition is set to distinguish between when the user terminal enters the custom area and when the user terminal leaves the custom area, so that different AR contents are displayed through the AR view as the AR content. You can.

The scenario condition is the AR content when the user terminal enters the custom area and when the user terminal leaves the custom area while moving according to the route guidance to the destination, and different AR Content may be set to be displayed through the AR view.

Whether the user terminal enters the custom area or leaves the custom area may be determined based on the route presented to the user terminal according to the route guidance.

The scenario condition is that, when the user terminal is located in the custom area, the AR content is determined based on another custom area that the user terminal entered before entering the custom area. It can be set to be displayed through AR view.

The scenario condition may be set so that when the user terminal is located in the custom area, the AR content determined based on the point the user terminal passed through is displayed through the AR view.

The scenario conditions include: i) a first scenario condition indicating whether the user terminal has passed through a custom area other than the custom area, and ii) whether the number of user terminals located in the custom area falls within a predetermined range. Includes at least one of the second scenario conditions representing,

The scenario condition is set to differently provide services or information associated with the space or to differently control settings of the user terminal based on the service element to the user terminal, depending on whether the scenario condition is satisfied. How to create a zone.

A unique ID is assigned to the created custom area, and the set area and set scenario conditions can be stored in association with the ID.

The second UI includes a third UI for setting at least one control state of the user terminal and at least one trigger condition for reaching the control state based on the service element, and the third UI According to the control state and the trigger condition set through , the scenario condition may be set.

The control state includes display of content indicated by the service element, de-display of the content, display form of the content, or display time of the content, and the trigger condition includes whether or not to enter the custom area, the It may include at least one of whether the user terminal has entered a custom area, whether the user terminal has passed through a specific point, and whether the user terminal has passed through another predetermined custom area. How to create a custom area.

The third UI includes a graph in which the control state is a node and the trigger condition is an edge connecting the nodes, and the node and the edge can be added, changed, or deleted by the user. It is configured to enable, and the step of setting the scenario conditions includes setting the control state corresponding to the node selected by the user through the graph, and setting the trigger condition corresponding to the edge selected by the user. The scenario conditions can be set.

By directly placing the service element in the set area, the set area and the service element can be associated, and the second UI can be provided when the service element associated with the set area or the set area is selected.

The method of creating the custom area further includes the step of importing the set area and the set scenario condition of the created custom area when creating another custom area, and the shape of the set area is copied and used in the other custom area. It is used to set the area corresponding to the area, and the scenario conditions can be copied and used to set the scenario conditions of the other custom area.

In another aspect, a computer system for creating a custom area using a custom area creation tool for creating a custom area associated with at least one service element, the computer system configured to execute computer readable instructions included in a memory. Comprising at least one processor, wherein the at least one processor sets an area corresponding to the custom area in space using a first user interface (UI) of the custom area creation tool, and Associating the service element with a set area, and using the second UI of the custom area creation tool, controlling the user terminal based on the service element as the user terminal is located in the custom area corresponding to the set area A computer system is provided that sets scenario conditions for:

Conveniently set an area corresponding to the custom area in two-dimensional space and/or three-dimensional space within the space, associate service elements with the area, and provide services or information related to the space based on the service element, or provide information on the user terminal. A custom area creation tool may be provided that allows intuitive definition of scenario conditions for controlling settings.

The custom area creation tool may provide a UI that allows the area corresponding to the custom area to be manually set considering the geometry of the space, or automatically set based on pre-stored mapping information for the space.

The custom area creation tool is a UI that allows you to intuitively set at least one control state of the user terminal and at least one trigger condition for reaching the control state in order to set scenario conditions for the area corresponding to the custom area. can be provided.

FIG. 1A illustrates a method of controlling a user terminal based on the user terminal being located in a preset custom area, according to an embodiment.
Figure 1B shows a method of creating a custom area by an administrator terminal, according to one embodiment.
Figure 2 illustrates a computer system performing a method for creating a custom region.
Figure 3 is a flowchart showing a method for creating a custom area, according to one embodiment.
Figure 4 is a flowchart showing a method of setting an area corresponding to a custom area using a custom area creation tool, according to an example.
Figures 5A to 5C show a method of setting a region including two-dimensional space and/or three-dimensional space using a user interface provided by a custom region creation tool.
Figure 5D shows a custom area defined in three-dimensional space, according to an example.
FIGS. 6A to 6C illustrate a method of setting scenario conditions for an area corresponding to a custom area using a user interface provided by a custom area creation tool, according to an example.
7 to 11 show a method of controlling a user terminal located in a custom area according to various scenario conditions defined for the custom area, according to an example.
Figure 12 shows the DoF (Degree Of Freedom) of a user terminal, according to an example.
Figure 13 shows a custom area including a plurality of points, according to an example.
Figure 14 shows a method in which a plurality of custom areas are set in a space and scenario conditions for controlling a user terminal are set for each custom area, according to an example.

Hereinafter, embodiments will be described in detail with reference to the attached drawings.

FIG. 1A illustrates a method of controlling a user terminal based on the user terminal being located in a preset custom area, according to an embodiment.

In the detailed description to be described later, “control” of the user terminal 100 is, for example, as shown in FIG. 1, using the AR view 10 of the user terminal 100 to display a space ( 5) Augmenting and displaying content representing services or information related to (e.g., AR content 30, etc.); Displaying a user interface (UI) related to a service associated with the space 5 on the user terminal 100; displaying map element content 35 related to a service associated with space 5 on the map (or map view 20) of the user terminal 100; It may include at least one of controlling settings of the user terminal 100 in order to provide the user terminal 100 with a service related to the space 5. Additionally, “control” of the user terminal 100 in embodiments of the present disclosure may include controlling the functions and/or operations of the user terminal 100, but is not limited to the above examples. .

'Space 5' related to the provision of augmented content in embodiments may represent an indoor space and/or an outdoor space. In other words, the space 5, which will be described later, may be defined as a space including an indoor location or an outdoor location, and may also be defined as a complex space in which indoor space and outdoor space are combined. The space 5 may be at least a part of the service target area for providing services including provision of content.

In the detailed description to be described later, the location of the user holding the user terminal 100 may be described as the location of the user terminal 100 for convenience of explanation. Additionally, for convenience of explanation, 'user' and 'user terminal 100' owned by the user may be used interchangeably.

In the detailed description to be described later, “augmented and displaying” content and/or information (e.g., indicators, etc.) on an image refers to overlapping and displaying the corresponding content and/or information on the video/screen of the AR view, depending on the embodiment. It can be interpreted in an inclusive sense.

As shown, a user terminal 100, such as a smart phone, can photograph the surroundings using a camera and display AR content 30 through the AR view 10 including the image captured by the camera. . AR content 30 may be related to an object existing in space 5. This AR content 30 may be mapped to the corresponding object (or node representing the object).

At least one custom area may be defined on the map of the space 5 shown. In the illustrated example, a total of two custom areas, a first custom area 60 and a second custom area 70, are defined. At least one service element may be associated with each custom area 60, 70. In addition, in each custom area (60, 70), a scenario (i.e., scenario condition) is defined for providing services or information related to the space (5) or controlling the settings of the user terminal (100) based on the corresponding service element. You can. The services or information may include information for advertising or marketing. These scenario conditions may include conditions for controlling the user terminal 100. The 'custom areas 60 and 70' may be preset on the server 200. For example, on the server 200, at least a partial area of the space 5 or a distinct partial area of the space 5 may be set as a 'custom area 60, 70'.

A method of creating custom areas 60 and 70 by setting an area corresponding to each custom area 60 and 70, associating service elements with the set area, and setting scenario conditions for the set area will be described later. This is explained in more detail with reference to Figures 1B to 14.

Custom areas 60 and 70 can be created and used to control the user terminal 100. As shown, based on the location of the user terminal 100, it may be determined whether the user terminal 100 is located in the first custom area 60 in the space 5, and the user terminal 100 may be located in the first custom area 60. If it is determined to be located in the custom area 60, AR content 30 may be displayed in the AR view 10 of the user terminal 100 based on service elements associated with the custom area 60. For example, when the user terminal 100 enters the first custom area 60, AR content 30 associated with the object 'metal type' may be displayed in the AR view 10. At this time, the current location 50 of the user terminal 100 may be displayed on the map view 20. The current location 50 may correspond to a location 50' in space 5. In the illustrated embodiment, when the user terminal 100 enters the first custom area 60, AR content 30 associated with “metal type”, which is an object existing outside the first custom area 60, is displayed. An example of the display is shown, but depending on the service element associated with the first custom area 60, when the user terminal 100 enters the first custom area 60, inside the first custom area 60 Other AR content related to an existing object, for example, “Eumbo of the Queen Mother,” etc. may be displayed.

Meanwhile, in another embodiment, according to various scenario conditions defined for the first custom area 60, such as when the user terminal 100 moves away from the first custom area 60 based on the location of the user terminal 100. , the AR view 10 may display other types of content, provide an appropriate UI, display appropriate map element content, or change appropriate settings of the user terminal 100.

The map view 20 displayed together with the AR view 10 on the screen of the user terminal 100 may include a map matching the image of the AR view 10. The map view 20 may include the current location 50 of the user terminal 100. The map view 20 may include a two-dimensional map or a three-dimensional map. The map view 20 may include objects within the space 5 through which the user terminal 100 moves. Map element content 35 may be displayed in map view 20 corresponding to AR content 30. Map element content 35 may be displayed when AR content 30 is displayed in AR view 10, or when an object associated with AR content 30 is included in map view 20.

The user terminal 100 may communicate with the server 200 to control entry and exit into the custom areas 60 and 70. For example, the server 200 may control the user terminal 100 based on service elements associated with the custom areas 60 and 70 where the user terminal 100 is located.

The server 200 is a computer system that manages the custom areas 60 and 70 defined for the space 5, and manages the association of service elements and setting of scenario conditions for the custom areas 60 and 70. It can be. Additionally, the server 200 may be a map server that provides digital maps (3D maps and/or 2D maps).

1B to 14, which will be described later, a method for creating custom areas 60 and 70 using a custom area creation tool will be described in more detail, and further, the custom areas 60 and 70 of the user terminal 100 will be described. A more detailed method of controlling the user terminal 100 according to its location and/or entry/exit is described in more detail.

Figure 1B shows a method of creating a custom area by an administrator terminal, according to one embodiment.

Referring to FIG. 1B, an area corresponding to the above-described custom area 60, 70 is set within the space 5, a service element is associated with the area (i.e., custom area 60, 70), and the user A method of providing services or information related to the space 5 to the terminal 100 or setting scenario conditions for controlling settings of the user terminal 100 will be described.

Custom areas 60 and 70 may be created by the custom area creation tool 102. The custom area creation tool 102 may be included in software or applications running on the administrator terminal 101.

The administrator terminal 101 may be a terminal of a service provider used to define custom areas 60 and 70 on the map of space 5, and receives the above-mentioned services and contents, that is, provides contents and information. It may be distinct from the displaying user terminal 100.

The administrator terminal 101 executes the custom area creation tool 102 (i.e., software or application including the custom area creation tool 102) to create a space ( 5) Set an area corresponding to the custom area 60, 70, associate a service element with the set area, and set scenario conditions for controlling the user terminal 100 based on the service element for the set area. By doing so, custom areas 60 and 70 can be created.

Once the custom areas 60 and 70 are created through the administrator terminal 101, they can be registered on the server 200.

The custom area creation tool 102 includes a first UI 103 for setting an area corresponding to the custom area 60, 70 to be created, and a second UI 104 for setting the scenario conditions for the set area. ) may include. In addition, although not shown, the custom area creation tool 102 may further include additional UI for associating service elements with the set area.

For example, the first UI 103 can load data representing the space 5 and set areas corresponding to the custom areas 60 and 70 based on input from the user for the loaded data. . Data representing space 5 includes at least one of a map of space 5, point cloud data (PCD) collected for space 5, and an image taken of space 5. can do. The user can set the area by selecting the area corresponding to the custom area 60, 70 for the loaded data. Meanwhile, the second UI 104 may include a UI that allows the user to set scenario conditions for the set area. For example, the second UI 104 sets at least one control state of the user terminal 100 when it is located within the set area corresponding to the custom area 60 and 70 and sets at least one trigger in the control state. It may include a UI for setting conditions (a third UI to be described later).

The first UI 103 and a specific method of setting the area corresponding to the custom area 60 and 70 through the first UI 103 will be described in more detail with reference to FIGS. 3 to 5 to be described later, and the second A specific method of setting scenario conditions for an area set through the UI 104 and the second UI 104 will be described in more detail with reference to FIGS. 3 and 6 to be described later.

Meanwhile, the administrator terminal 101 and the user terminal 100 have been described as being distinct from each other, but depending on the embodiment, the user terminal 100 may be used to create custom areas 60 and 70 in the space 5. It may be possible. In this embodiment, the custom area creation tool 102 may be executed on the user terminal 100.

In other words, the user terminal 100 that receives services for the space 5 can also create custom areas 60 and 70 for providing services for the space 5. At this time, the service for space 5 may be based on crowdsourcing of user terminals 100.

Additionally, at least one location or at least one area within the space 5 for creating a custom area 60 or 70 within the space 5 may be sold to the user terminal 100 . The user terminal 100 can purchase the location or area for creating the custom area 60, 70 through the server 200, and create the custom area 60, 70 in the purchased location or area. there is. Accordingly, the user terminal 100 creates its own custom area 60, 70 in the location or area purchased by the user, thereby transmitting the desired AR content to other user terminals located in the custom area 60, 70. It can be displayed through the AR view, or other user terminals can be controlled according to the scenario conditions of the custom area (60, 70). In this embodiment, the location or area where the user terminal 100 can be purchased may not belong to the entire extent of the space 5, but may belong to a partial range of the space 5 permitted by the service provider. In other words, the user terminal 100 personalizes the creation of custom areas 60 and 70 by purchasing a location or area that falls within a portion of the space 5 allowed by the service provider (i.e., a location or area permitted for sale). can do.

The description of the technical features described above with reference to FIG. 1A can also be applied to FIG. 1B, so redundant description will be omitted.

Figure 2 illustrates a computer system performing a method for creating a custom region.

The manager terminal 101 described above with reference to FIG. 1B according to embodiments may be implemented through the illustrated computer system 2. Meanwhile, the user terminal 100 described above with reference to FIG. 1A may also be implemented through the computer system 2.

For example, a computer program for implementing the method of the embodiment may be installed and driven in the computer system 2, and the computer system 2 may be configured to create a custom area (custom area) according to the embodiment according to the control of the driven computer program. 60, 70) can be performed.

The method of creating custom areas 60 and 70 according to embodiments may be performed through a PC-based program or a mobile terminal-specific application including the custom area creation tool 102. For example, the method of creating custom areas 60 and 70 according to embodiments may be implemented in the form of a program that operates independently, or may be implemented in the form of a function executed in a specific program. In an embodiment, a method of creating custom areas 60 and 70 may be performed through the custom area creation tool 102 included in such a program.

The computer system 2 is an electronic device corresponding to the above-described administrator terminal 101 (and user terminal 100), and is a PC capable of installing and executing an application or program as shown in FIG. 1B (and FIG. 1A). It may be a personal computer, a smart device, or a similar device. For example, the computer system 2 may be a smartphone, PC, laptop computer, laptop computer, tablet, Internet Of Things device, or wearable computer, etc. there is.

As shown, the computer system 2 includes a memory 110, a processor 120, a communication interface 130, and an input/output interface 140 as components for executing the method for creating the custom areas 60 and 70. It can be included.

The memory 110 is a computer-readable recording medium and may include a non-permanent mass storage device such as random access memory (RAM), read only memory (ROM), and a disk drive. Here, non-permanent large-capacity recording devices such as ROM and disk drives may be included in the computer system 2 as a separate permanent storage device separate from the memory 110. Additionally, an operating system and at least one program code may be stored in the memory 110. These software components may be loaded into the memory 110 from a computer-readable recording medium separate from the memory 110. Such separate computer-readable recording media may include computer-readable recording media such as floppy drives, disks, tapes, DVD/CD-ROM drives, and memory cards. In another embodiment, software components may be loaded into the memory 110 through the communication interface 130 rather than a computer-readable recording medium. For example, software components may be loaded into memory 110 of computer system 2 based on computer programs being installed by files received over network 160.

The processor 120 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Commands may be provided to the processor 120 by the memory 110 or the communication interface 130. For example, the processor 120 may be configured to execute received instructions according to program codes stored in a recording device such as memory 110.

That is, the processor 120 can manage the components of the computer system 2 and execute programs or applications used by the computer system 2. For example, the processor 120 executes the custom area creation tool 102 to create the custom areas 60 and 70 of the embodiment, and the user and/or server 200 to create the custom areas 60 and 70. It may be configured to process data received from. Additionally, the processor 120 may process operations necessary for executing programs or applications and processing data, and may be at least one processor of the computer system 2 or at least one core within the processor.

The communication interface 130 may provide a function for the computer system 2 to communicate with another computer system (not shown) through the network 160. For example, requests, commands, data, files, etc. generated by the processor 120 of the computer system 2 according to the program code stored in a recording device such as memory 110 are transmitted to the network ( 160) and can be transmitted to other computer systems. Conversely, signals, commands, data, files, etc. from other computer systems may be received by the computer system 2 through the communication interface 130 of the computer system 2 via the network 160. Signals, commands, data, etc. received through the communication interface 130 may be transmitted to the processor 120 or memory 110, and files, etc. may be stored in a storage medium (as described above) that the computer system 2 may further include. It can be stored as a permanent storage device). For example, the communication interface 130 may be a hardware module such as a network interface card, network interface chip, and networking interface port of the computer system 2, or a software module such as a network device driver or networking program.

The input/output interface 140 may be a means for interfacing with the input/output device 150. For example, input devices may include devices such as a microphone, keyboard, or mouse, and output devices may include devices such as displays and speakers. As another example, the input/output interface 140 may be a means for interfacing with a device that integrates input and output functions, such as a touch screen. The input/output device 150 may be composed of a single device with the computer system 2.

Additionally, in other embodiments computer system 2 may include more components than those of FIG. 2 . However, it is not necessary to clearly show most prior art components. For example, the computer system 2 is implemented to include at least some of the input/output devices connected to the input/output interface 140 described above, or a transceiver, a Global Positioning System (GPS) module, a camera, various sensors, It may further include other components such as a database, etc. As a more specific example, when the computer system 2 is implemented in the form of a mobile device such as a smartphone, the mobile device generally includes a camera, an acceleration sensor or a gyro sensor, various physical buttons, buttons using a touch panel, Various components such as input/output ports and vibrators for vibration may be implemented to be further included in the computer system 2.

Meanwhile, the computer system 2 corresponding to the user terminal 100 may include a camera that photographs the surroundings to execute the AR view 10. At this time, the computer system 2 can display the image captured through the camera as the AR view 10 and display the AR content 30 by augmenting the image of the AR view 10. For example, the computer system 2 determines whether the user terminal 100 is located in the preset custom areas 60 and 70 according to the positioning, and determines whether the user terminal 100 is located in the custom areas 60 and 70. In this case, the AR view 10 may display AR content 30 based on service elements associated with the custom areas 60 and 70. A method using visual localization or VPS (Visual Positioning System) may be used to determine the position of the user terminal 100. Alternatively, the positioning of the user terminal 100 may include a method by recognizing a marker, a method using GPS, a method using WPS (Wi-Fi Positioning System), a method using a Bluetooth module, and odometry. Methods such as using can be used. Meanwhile, the actual operation of determining whether the computer system 2 is located in the custom area 60 or 70 may be performed by the server 200 rather than the computer system 2. The server 200 communicates with the user terminal 100 and provides data for controlling the user terminal 100, thereby allowing the user terminal 100 to be controlled. The user terminal 100 may communicate with the server 200 and be controlled based on data and/or information provided from the server 200. At this time, the server 200 may receive the location of the user terminal 100 and, based on the received location, determine whether the user terminal 100 is located within the custom area 60 or 70. , when the user terminal 100 is located within the custom areas 60 and 70, the user terminal 100 can be controlled based on service elements associated with the custom areas 60 and 70.

The server 200 is a device that manages (registration, change, deletion, storage, maintenance, etc.) data and content to be provided for the user terminal 100 and the custom areas 60 and 70, and includes a database or such a database. You can communicate with. Additionally, server 200 may be or include a map server that provides digital maps (3D maps and/or 2D).

The server 200 may provide the administrator terminal 101 with data necessary for the administrator terminal 101 to create the custom areas 60 and 70. For example, data representing the space 5 loaded by the manager terminal 101 may be provided from the server 200. In addition, the custom areas 60 and 70 (i.e., set areas and set scenario conditions corresponding to the custom areas 60 and 70) created by the administrator terminal 101 may be registered and stored in the server 200. .

Server 200 may include at least one computer system. The computer system included in the server 200 may include similar configurations to the computer system 2 described above, and redundant description thereof will be omitted.

In the detailed description to be described later, for convenience of explanation, embodiments will be described focusing on the computer system 2 corresponding to the administrator terminal 101 or the user terminal 100, and communication with the server 200 and operation on the server 200 side. The explanation may be simplified or omitted. In addition, for convenience of explanation, the operations (steps) performed by the components (e.g., processor, etc.) of the computer system 2 (or the server 200) are referred to as the computer system 2 (or the server 200). It can be described as being carried out by .

The description of the technical features described above with reference to FIG. 1 can also be applied to FIG. 2 , so overlapping descriptions will be omitted.

Figure 3 is a flowchart showing a method for creating a custom area, according to one embodiment.

Referring to FIG. 3, a method for creating custom areas 60 and 70 performed by the computer system 2 will be described. The computer system 2 may be the administrator terminal 101 described above with reference to FIG. 1, and in the detailed description to be described later, the embodiment will be described using the terminology of the administrator terminal 101 instead of the computer system 2. do. The administrator terminal 101 can also be replaced with a user terminal 100 on which the custom area creation tool 102 is installed.

In addition, the actual calculations and operations of at least some of the steps 310 to 350 to be described later and the steps described with reference to FIG. 4 may be configured to be performed by the server 200 rather than the manager terminal 101. Below, the execution of steps will be described focusing on the administrator terminal 101, and redundant explanation regarding the server 200 may be omitted.

The administrator terminal 101 may create custom areas 60 and 70 using a custom area creation tool 102 for creating custom areas 60 and 70 associated with at least one service element. The custom area creation tool 102 may be a program or part of a program installed on the administrator terminal 101, or a program or part of a program running on the server 200.

The custom area creation tool 102 is, as an example, an authoring tool for creating custom areas 60 and 70 for the space 5 to provide location-based AR services, and includes the custom areas 60 and 70 corresponding to the custom areas 60 and 70. By setting an area, setting predetermined scenario conditions (i.e., space conditions, etc.) in the area corresponding to the custom area 60, 70, and associating a specific service element with the area, AR content can be created on the user terminal 100. 3D content such as can be generated, augmented, and displayed. In other words, the custom area creation tool 102 sets a two-dimensional space and/or a three-dimensional space as areas corresponding to the custom areas 60 and 70, and has the function of associating the set area with a service for outputting three-dimensional content. You can have The custom area creation tool 102 can manage each custom area (60, 70) using a unique ID, and can create an ID for each custom area (60, 70) through the ID of each custom area (60, 70). The relevant area and scenario conditions can be managed in association.

Below, a method for creating custom areas 60 and 70 using the custom area creation tool 102 and its user interfaces 103 and 104 will be described in more detail.

In step 310, the administrator terminal 101 uses the first user interface (UI) 103 of the custom area creation tool 102 to create custom areas 60 and 70 within the space 5. You can set the corresponding area.

The first UI 103 may include a user interface for setting areas corresponding to the custom areas 60 and 70 within the space 5 according to an absolute coordinate system.

The administrator terminal 101 can use the first UI 103 to set areas corresponding to the custom areas 60 and 70 as two-dimensional space and/or three-dimensional space. That is, the set area may include at least one of a two-dimensional space that is at least a part of the space 5 and a three-dimensional space that is at least a part of the space that is set using the first UI 103. In this way, the set space may be set as a complex dimensional space including both two-dimensional space and three-dimensional space.

The administrator terminal 101 can load data related to the space 5 through the custom area creation tool 102 through the first UI 103, and according to the input from the user about this loaded data, custom Areas corresponding to areas 60 and 70 can be set. For example, the administrator terminal 101 can load a map of the space 5 through the first UI 103 and select areas corresponding to the custom areas 60 and 70 on the map according to input from the user about the map. can be defined.

The first UI 103 may be a map making tool for creating a map of the space 5. For example, 3D data of the space 5 may be loaded (or rendered) through the first UI 103. The 3D data may be at least one of 3D point cloud data (PCD) obtained by scanning the space 5, an image taken of the space 5, and a blueprint or drawing representing the space 5. For example, when the space 5 is indoor, the first UI 103 may include an indoor map creation UI for creating an indoor map of the space 5 or may be a part of the indoor map creation UI. The indoor map creation UI includes detailed spaces (exhibition rooms, etc.) within space (5); Means of transportation such as stairs, escalators, elevators, etc.; Facilities such as restrooms, signs, signs, information centers, etc.; Poles and other obstacles; path information within space (5); A function for setting nodes and links connecting nodes may be provided.

In relation to this, referring to FIG. 4, the method of step 310 of rendering three-dimensional data of the space 5 through the first UI 103 and setting areas corresponding to the custom areas 60 and 70 is further described. Explain in detail.

Figure 4 is a flowchart showing a method of setting an area corresponding to a custom area using a custom area creation tool, according to an example.

In step 410, the manager terminal 101, through the first UI 103, selects at least one of a map of the space 5, a PCD collected for the space 5, and an image in which the space 5 is captured. can be displayed. In other words, data representing this space 5 can be rendered in the first UI 103. The PCD/image may be collected by direct scanning/photography of the space 5 by the administrator terminal 101 or other devices such as a mapping robot. The map of space 5 may be generated based on the collected PCD/image.

In step 420, the manager terminal 101 displays the geometry of the space 5 identified by at least one of a map of the space 5 displayed through the first UI 103, a PCD representing the space 5, and an image. Depending on the geometry, input can be received from the user.

In step 430, the administrator terminal 101 may set the area by defining the area corresponding to the custom area 60 or 70 according to the input received from the user.

In this way, data representing the space 5 displayed through the first UI 103 may be displayed so that the geometry of the space 5 can be identified. In other words, through data representing the displayed space 5, the user can identify (at least roughly) the physical structure of the space 5 and set the area corresponding to the custom area 60, 70 by reflecting this. You can. For example, while checking specific rooms, facilities, walls, ceilings, floors, etc. within the space 5 through data representing the space 5 displayed through the UI 103, the user selects a specific room, facility, wall, ceiling, floor, etc. corresponding to the custom area 60, 70. You can set the area. Setting of the area corresponding to the custom area 60 or 70 by the user may be accomplished by at least one of inputting coordinate values corresponding to the area, selection of a point, and selection by dragging the area. In this way, the user using the UI 103 can appropriately set the areas corresponding to the custom areas 60 and 70 while intuitively checking the physical structure of the space 5.

When the first UI 103 is included in the indoor map creation UI, the custom areas 60 and 70 may be created along with the construction of the indoor map for the space 5.

Meanwhile, setting of the areas corresponding to the custom areas 60 and 70 may be made automatically without direct area designation from the user. For example, the administrator terminal 101 may receive a user input through the first UI 103 (step 440), and use the mapping information for the user input and the previously stored space 5 to create a custom area 60. , 70) can be automatically set (step 450).

In other words, based on mapping information pre-stored in the server 200 or the administrator terminal 101 for the space 5, the areas corresponding to the custom areas 60 and 70 can be automatically set with minimal user input. there is. Mapping information is information stored in the server 200 or the administrator terminal 101 to build a map of the space 5, including the location of a predefined object within the space 5 and a predefined two-dimensional information within the space 5. It may be information about space or a polygon (i.e., three-dimensional space) predefined within the space.

The manager terminal 101 is based on the location of an object predefined in space 5, a two-dimensional space predefined in space 5, or a polygon predefined in space 5, corresponding to this mapping information. Thus, the areas corresponding to the custom areas 60 and 70 can be automatically set. The user input for triggering automatic setting of the area by the manager terminal 101 may be a semantic input for selecting a part of the space 5. For example, this user input may be an input of a name or identifier of a 2-dimensional space or 3-dimensional space or a landmark that is already defined within the space 5. In other words, the user inputs the name of exhibition room A and landmark A predefined within the space 5, or inputs to define the space (e.g., between pillar A and pillar B) without inputting coordinates or directly setting the area. The areas corresponding to the custom areas 60 and 70 can be automatically set on the custom area creation tool 102 by simply transmitting the entire space) to the manager terminal 101.

Below, with reference to FIG. 5, specific examples for setting areas corresponding to the custom areas 60 and 70 and areas corresponding to the set custom areas 60 and 70 will be described in more detail.

Figures 5A to 5C show a method of setting a region including two-dimensional space and/or three-dimensional space using a user interface provided by a custom region creation tool. Figure 5D shows a custom area defined in three-dimensional space, according to an example.

The custom areas 500, 530, and 540 are areas corresponding to the above-described custom areas 60 and 70, that is, they may represent areas before scenario conditions are set.

The first UIs 502 to 506, which will be described later, can be enlarged or reduced as needed.

In FIG. 5A , an example in which a custom area 500 including a two-dimensional space is set on the first UI 502 is shown. In the illustrated example, as data representing the space 5, a map (or blueprint or drawing) representing the space 5 may be loaded on the first UI 502. A plurality of custom areas 500 may be set on the data representing the loaded space 5. Each of the custom areas 500 is defined to represent a means of transportation such as stairs, escalators, elevators, etc., or to represent a specific space (exhibition room, etc.) within the space 5. As shown, a plurality of nodes may be defined on the map of space 5, which is data representing space 5.

The user can set each of the custom areas 500 through drag input or coordinate designation on data such as a map of the space 5 loaded on the first UI 502.

In FIG. 5B , an example in which a custom area 500 including a two-dimensional space and/or a three-dimensional space is set on the first UI 504 is shown. As in the illustrated example, as data representing the entire space 5, the PCD 510 representing the space 5 was rendered on the first UI 504. The PCD 510 may be displayed by overlapping a map of the space 5 and/or an image taken of the space 5. In the example shown, PCD 510 is displayed overlapping with the map of space 5.

A plurality of custom areas 500 may be set on the data representing the loaded space 5. Each of the custom areas 500 may be set to a dimensional space and/or a 3-dimensional space. The user may identify the geometry of the space 5 through the PCD 510 and/or the image, and may appropriately define each of the custom areas 500 by considering the geometry of the space 5. Accordingly, the custom area 500 that accurately reflects the shape of the actual space 5 can be set.

In FIG. 5C , an example of a custom area 530 including a three-dimensional space is set on the first UI 506 is shown. In the illustrated example, as data representing the space 5, a PCD representing the space 5 has been rendered on the first UI 506. Although not shown, the PCD may be displayed by overlapping a map of the space 5 and/or an image taken of the space 5.

As shown, the custom area 530 may be set in the form of a three-dimensional polygon on data representing the rendering space 5. The user can set the custom area 530 through drag input or specifying coordinates on data representing the rendered space 5. The custom area 530 is a complex space and may be configured to include an additional two-dimensional space in addition to a three-dimensional space. Polygons and polygons corresponding to the custom area 530 may be defined as a combination of coordinates.

In Figure 5D, the custom area 540 defined in three-dimensional space is explained in more detail. The custom area 540 may correspond to the custom area 530 described above.

As described above, the custom area 540 may be defined to include at least one of a two-dimensional space and a three-dimensional space on data representing the space 5, such as a map of the space 5.

As the association of service elements and the setting of scenario conditions for the custom area 540 are completed, the user terminal 100 or the server 200 determines that the location of the user terminal 100 is located in the custom area 540. At this time, the user terminal 100 can be controlled based on service elements associated with the custom area 540.

As shown, custom area 540 can be defined to include a two-dimensional area and a three-dimensional space with a set height range. Alternatively, the custom area 540 may be defined as a complex dimensional space including two-dimensional space and three-dimensional space.

The two-dimensional area constituting the custom area 540 may include a two-dimensional coordinate space (x, z). The height range constituting the custom area 540 may include the y-axis coordinate space. The height range may be a range with upper and lower limits as shown (H), or may be a range without upper or lower limits as shown (H).

The user terminal 100 or the server 200 is located in a two-dimensional area constituting the custom area 540, and the height of the user terminal 100 is within a set height range constituting the custom area 540. If it belongs to, it is determined that the user terminal 100 is located in the custom area 540, and the user terminal 100 is connected to the user terminal 100 based on the scenario conditions set for the custom area 540 and the service elements associated with the custom area 540. can be controlled. At this time, the height of the user terminal 100 may be obtained by a sensor included in the user terminal 100. The height of the user terminal 100 may represent, for example, the height of the camera of the user terminal 100.

Meanwhile, although one height range (H) is illustrated in FIG. 5D, a plurality of height ranges may be defined in the custom area 540, and service elements may be associated with each height range and scenario conditions may be defined.

In this way, by setting the custom area 540 in a three-dimensional space, even if the user terminal 100 is located in the same two-dimensional space, the user terminal 100 can be adjusted according to the height of the user terminal 100 and under different scenario conditions. Can be controlled differently.

Meanwhile, the device used for scanning the space 5 described above may be a measuring device capable of precise positioning. This measurement device may be the manager terminal 101 or a separate device. The positioning of the measuring device includes a method using visual localization, a method using VPS (Visual Positioning System), a method using marker recognition, a method using GPS, and a method using WPS (Wi-Fi Positioning System). A method using a Bluetooth module, a method using odometry, etc. may be used.

At this time, a certain range of areas may be automatically set as areas corresponding to the custom areas 60 and 70 through the positioning of the measuring device within the space 5. That is, areas corresponding to the custom areas 60 and 70 may be automatically set on the map of the space 5 based on the recognized area and/or recognized object according to the positioning of the measuring device. In other words, the creation of the custom areas 60 and 70 can also be achieved by directly scanning the space 5 using a measuring device, and the first UI 103 automatically changes the defined area and It can also be used as an auxiliary for coordination.

Next, in step 320, the manager terminal 101 may associate a service element with the area set by step 310. For example, the user of the administrator terminal 101 may associate the set area with the service element by directly placing the service element in the area set through the first UI 103. The custom area creation tool 102 may provide a separate UI for selection and placement of service elements to be associated with the set area. Users can select and place service elements through methods such as clicking, dragging and dropping.

Service elements associated with the set area include displaying content in the AR view 10 of the user terminal 100 for the user terminal 100 entering the set custom area 60, 70; Displaying a UI related to a service on the user terminal 100; displaying map element content on a map of the user terminal 100; It may include data for performing at least one of controlling settings of the user terminal 100 to provide services for the user terminal 100. As an example, the service element may include data for display of augmented reality (AR) content related to a service associated with the space 5. In step 320, the manager terminal 101 may associate a service element corresponding to the AR content with the set area, and, for example, perform this association by directly placing the AR content in the set area.

The user can change the position (eg, height, etc.) of the service element (or AR content) placed within the set area or set the position of the placed service element. The “location” at this time may correspond to the location where the AR content is output when the user terminal 100 is located in the custom area 60 or 70.

Meanwhile, after a service element is associated with a set area, when the corresponding service element or set area is selected, the second UI 104 may be provided to the manager terminal 101.

In step 330, the administrator terminal 101 uses the second UI 104 of the custom area creation tool 102 to create a custom area 60 (to be created) corresponding to the area set by step 310. As the user terminal 100 is located at 70), scenario conditions for controlling the user terminal 100 can be set based on service elements.

These scenario conditions are conditions for controlling the user terminal 100 and may include scenario conditions that are conditions for providing services or information related to the space 5 or controlling settings of the user terminal 100.

In embodiments, scenario conditions may be defined for each service element and may be part of the service element. That is, service elements associated with custom areas 60 and 70 may be configured to include the above scenario or scenario condition.

After the scenario conditions are set and the custom areas 60 and 70 are created, when the location of the user terminal 100 is located in the custom areas 60 and 70 on the map, according to the scenario conditions and based on the service elements, the user Terminal 100 can be controlled. For example, according to scenario conditions defined in the created custom areas 60 and 70, services or information associated with the space 5 are provided to the user terminal 100 based on service elements, or settings of the user terminal 100 are changed. It can be controlled.

The scenario condition distinguishes between when the user terminal 100 enters the custom area 60 and 70 and when the user terminal 100 leaves the custom area 100, and controls the user terminal differently based on service elements. It can be set to do so. In other words, when the user terminal 100 is located in a specific custom area 60 or 70, it can be determined whether it has entered the custom area 60 or 70 or has left the custom area 60 or 70, and the decision is made. Depending on the results and set scenario conditions, the user terminal 100 may be controlled differently when entering and exiting the custom areas 60 and 70.

A method of controlling a user terminal located in a custom area according to various scenario conditions defined for the custom area will be described in more detail with reference to FIGS. 7 to 11 to be described later.

The second UI 104 includes a third UI for setting at least one control state of the user terminal 100 based on a service element associated with the area and at least one trigger condition for reaching the control state. can do. Scenario conditions can be set according to the control state and trigger conditions set through the third UI.

The control state set through the third UI includes display of the content or UI indicated by the service element, de-display of the content or UI, display form of the content or UI, or display time of the content or UI (e.g., display time of the content, display duration, etc.) may be included. In addition, when the service element includes data for controlling the settings of the user terminal 100, the control state set through the third UI is the type of settings of the controlled user terminal 100 or the user terminal 100. It may include activation/deactivation of settings of (100).

Controlling the settings of the user terminal 100 may include controlling functions and/or operations of the user terminal 100 related to services that can be provided to the user terminal 100 within the space 5. . Controlling a function and/or operation may include turning the function and/or operation on/off or activating/deactivating the function and/or operation. For example, controlling the settings of the user terminal 100 may include executing or stopping the execution of a module for recognizing objects in the space 5 or the custom area 60 or 70 into which the user terminal 100 has entered. You can. The module for object recognition may be, for example, a module for VOT (Vision Object Tracking). Alternatively, the module for object recognition may be a component used for object recognition using the smart lens of the user terminal 100. This module may be part of the processor 120 or may be implemented separately within the user terminal 100. Additionally, these modules may be software modules that the processor 120 executes. By setting the scenario conditions as in the example above, when the user terminal 100 enters the custom area 60 and 70, the module for object recognition of the user terminal 100 is turned on or initiated. may be, and accordingly, the user terminal 100 may recognize objects in the space 5 or the custom areas 60 and 70. When the user terminal 100 leaves the custom areas 60 and 70, the module for object recognition of the user terminal 100 may be turned off or deactivated again.

Trigger conditions set through the third UI include whether the user terminal 100 enters the created custom areas 60 and 70, whether the user terminal 100 advances into the custom areas 60 and 70, and the user terminal ( It may include at least one of whether the user terminal 100 passed through a specific point and whether the user terminal 100 passed through another predetermined custom area. A custom area different from the specific point may be set through the third UI. Trigger conditions can be set for each control state.

As a scenario condition, by completing the setting of the control state and trigger condition, setting of a scenario for controlling the user terminal 100 located in the custom area 60 and 70 can be completed.

Relatedly, FIGS. 6A to 6C illustrate a method of setting scenario conditions for an area corresponding to a custom area using a user interface provided by a custom area creation tool, according to an example.

In FIG. 6A , a UI 630 for setting trigger conditions included in the above-described third UI 602 according to an example is shown. In FIG. 6B, a UI 640 for setting a control state included in the above-described third UI 604 according to an example is shown.

In the illustrated example, seven control states (states 1 to 7) 610-1 to 610-7 are defined, and trigger conditions are expressed as lines connecting the control states.

The illustrated control states and trigger conditions may constitute scenario conditions set for the custom areas 60 and 70.

Each control state may include the name of the control state (states 1 to 7) and setting information for each control state. These names and setting information can be set through the UI 640. When a control state is selected, the UI 640 may be displayed to set a name and/or setting information for the control state.

A trigger condition may represent a condition for transition from one control state to another control state. The specific details of these trigger conditions can be set through the UI 630. When a specific trigger condition 620 is selected, the UI 630 may be displayed to set condition contents for the trigger condition.

As shown, the third UI (602, 604) may include a graph where the control state is a node and the trigger condition is an edge connecting the nodes. Nodes and edges constituting the graph may be configured to be added, changed, or deleted by the user of the administrator terminal 101. That is, the user can add, change or delete control states and/or trigger conditions.

In this way, the scenario conditions in the manager terminal 101 display the control state corresponding to the node selected by the user (e.g., using the UI 640) through the graph included in the third UI 602 and 604. It can be set by setting and setting a trigger condition corresponding to an edge selected by the user (eg, using the UI 630).

Accordingly, the user of the custom area creation tool 102 can set scenario conditions for the custom areas 60 and 70 in an intuitive manner.

The graph included in the third UI (602, 604) may be a Finite State Machine (FSM), each node may represent a state of the FSM, and each edge may be an edge connecting the states of the FSM.

For example, in the case where the service element includes data representing content, for example, AR content, the first state 610-1 is a start state, and the second state 610-2 is an idle state. The third state 610-3 is the state when entering the custom area 60 and 70, and the fourth to sixth states 610-4 to 610-6 are for controlling the display of content. Among the states, the seventh state 610-7 may represent a state that disables display of content. Setting information about the state may include transparency of the content, whether animation included in the content is played, and display time of the content. Setting information for the seventh state 610-7 may include a deactivation method (eg, fade out) of the content. As described above, the trigger condition represented by the edge connecting the states 610-1 to 610-7 includes, for example, a condition for transition from one state to another state, to the custom areas 60 and 70. Whether or not the user terminal 100 enters, whether the user terminal 100 enters the custom area 60 or 70, whether the user terminal 100 passes through a specific point, and whether the user terminal 100 moves to a predetermined location. At least one of whether it passed through another custom area can be set.

In FIG. 6C, a third UI 606 is shown by abstracting the above-described third UIs 602 and 604, according to an example. As shown, a third UI 606 in an abstract form may be provided to set scenario conditions. Scenario conditions can be set more intuitively through the third UI 606.

As in the example shown, each control state includes whether to activate the content (e.g., inactive or active or faded out) and how the content is displayed (transparency, display shape, display time, display count, display of specific animations, etc.) can do. Additionally, each trigger condition may include a type of condition to be set for the custom areas 60 and 70 and a directional condition (eg, a condition based on entry or exit).

Using the third UIs 602, 604, and 606 illustrated with reference to FIG. 6, in the embodiment, each control state and trigger condition constituting the scenario condition can be set in a way that is intuitive to the user.

The areas corresponding to the custom areas 60 and 70 are set through the above-described steps 310 to 330, and the custom areas 60 and 70 are created by associating service elements with the set areas and setting scenario conditions. You can.

As described above, a unique ID may be assigned to the created custom areas 60 and 70.

In step 340, the manager terminal 101 may store the area set in step 310 and the scenario conditions set in step 320 in association with these IDs. For example, the administrator terminal 101 may store the area and scenario conditions set in association with the ID on the server 200, or store the area and scenario conditions set in association with the ID locally.

In an embodiment, a plurality of custom areas may be defined on the space 5 and an ID may be assigned to each. At least one service element may be associated with the ID of each of these custom areas. As the service element is individually matched with the ID of the custom area, the user terminal 100 can be correctly controlled by these custom areas even if custom areas are defined in the space 5 in which some areas overlap each other.

In step 350, when creating another custom area, the administrator terminal 101 uses the set area and set scenario conditions (e.g., stored in association with ID) of the previously created custom areas 60 and 70. It can be imported. In other words, the form (shape and size, etc.) of the previously created custom areas 60 and 70 and the set scenario conditions can be used when creating another custom area.

The shape of the area corresponding to the previously created custom area 60 and 70 can be copied and used to set the area corresponding to another custom area. For example, the first UI 103 may include a function for importing (or loading) an area corresponding to a preset custom area when setting the area in step 310 described above. At this time, only the (2-dimensional and/or 3-dimensional) shape of the area corresponding to the previously created custom area 60, 70 can be copied, and the coordinates are at the duplicated location (i.e., at the duplicated location). (based on) coordinates can be followed. Accordingly, in order to create another custom area, the other custom area can be created by designating an area of the same shape as the previously created custom areas 60 and 70 at a selected location.

Meanwhile, scenario conditions set in the previously created custom areas 60 and 70 can also be copied and used to set scenario conditions in other custom areas.

In step 350, the administrator terminal 101 may import only a part of the forms (shape and size, etc.) of the custom areas 60 and 70 previously created according to the user's selection and a part of the set scenario conditions. In addition, the manager terminal 101 adjusts the imported form (shape and size, etc.) and scenario conditions appropriately (e.g., using the first UI 103 and the second UI 104) according to the user's input. You can create other custom areas by modifying them.

In this way, the custom area creation tool 102 in the embodiment allows the creation of a new custom area using the previously created custom areas 60 and 70, thereby easily creating a custom area with similar shapes or scenario conditions. You can.

The description of the technical features described above with reference to FIGS. 1 and 2 can also be applied to FIGS. 3 to 6, so overlapping descriptions will be omitted.

7 to 11 illustrate a method of controlling a user terminal located in a custom area according to various scenario conditions defined for the custom area, according to an example.

With reference to FIGS. 7 to 11 , a method of controlling the user terminal 100 using a custom area created through the above-described custom area creation method will be described in more detail.

As described above, service elements associated with the created custom area may include data for displaying augmented reality (AR) content related to services associated with the space. When the user terminal is located in the custom area, AR content may be displayed through the AR view 10 according to scenario conditions set for the custom area. As such, in the examples of FIGS. 7 to 11 , a method of displaying AR content on the user terminal 100 as a method of controlling the user terminal 100 that has entered the custom area will be described.

FIG. 7A shows the AR view 10 in a state in which the custom area of the embodiment does not exist and the position of the user terminal 100 at this time. As shown, in the AR view 10, AR content displayed on the first floor of the space (e.g., AR content associated with an object located on the first floor) and AR content A2 displayed on the second floor (e.g., AR content A2 displayed on the second floor) AR content associated with an object located in can all be displayed. An example of AR content displayed at this time may be an image and/or text corresponding to a sign. That is, in the example of FIG. 7A, even though the user terminal 100 is located on the first floor, even the AR content (A2) on the second floor is displayed in the AR view 10, so the AR view 10 on the user terminal 100 Implementation becomes complicated, and the burden on the user terminal 100 for implementing the AR view 10 of the user terminal 100 may also increase accordingly.

FIGS. 7B to 7D illustrate a case where two custom regions (CR_1 and CR_2) are created in the same space as shown in FIG. 7A. Each of the custom regions (CR_1 and CR_2) may be created using the custom region tool 102 described above. The custom area (CR_1) may represent the first floor of the space, and the custom area (CR_2) may represent the second floor of the space. Each of the custom regions (CR_1 and CR_2) represents a three-dimensional space and may correspond to a polygon, which is a rectangular parallelepiped, as shown.

As shown in FIG. 7C, when the user terminal 100 is located on the first floor and in the custom area (CR_1), only the AR content (A1) on the first floor is displayed in the AR view 10 of the user terminal 100. It can be. In other words, when the user terminal 100 is located in the custom area (CR_1), the AR content (AR2) on the second floor may not be displayed.

Meanwhile, as shown in FIG. 7D, when the user terminal 100 is located on the second floor and in the custom area (CR_2), the AR view 10 of the user terminal 100 shows the AR content (AR2) on the second floor. Only can be displayed. In other words, when the user terminal 100 is located in the custom area (CR_2), the AR content on the first floor may not be displayed. Depending on the embodiment, the AR content of the floor must be positioned to look down on the user terminal 100 (for example, the AR view 10 must be positioned to face the first floor) to be displayed within the AR view 10. You can do it as well.

As in the examples of FIGS. 7C and 7D, as the custom areas (CR_1 and CR_2) are appropriately defined for each floor, the user terminal 100 has a user terminal 100 according to the location of the user terminal 100. Only AR content in the located custom area can be displayed.

Meanwhile, in the created custom area, the scenario conditions differentiate between when the user terminal 100 enters the custom area and when the user terminal 100 leaves the custom area, and different AR contents are displayed in the AR view (10). ) can be set to be displayed through. In other words, even if the user terminal 100 is located within the same custom area, different AR contents are displayed through the AR view 10 when the user terminal 100 enters the custom area and when the user leaves the custom area. can be displayed.

Relatedly, FIGS. 8A to 8C illustrate a case where six custom regions (CR_1 to CR_6) are created in the same space as shown in FIG. 7.

As shown, a plurality of nodes may be defined in the space in addition to the custom areas (CR_1 to CR_6). Lines connecting nodes may be named “links”. The defined nodes and links can be used to guide the user terminal 100 to a predetermined destination. A plurality of nodes may be defined within each of the custom areas (CR_1 to CR_6).

8A to 8C, a path R along which the user terminal 100 moves according to this route guidance is shown. The route R may be provided to the user terminal 100 as route guidance information.

Service elements associated with each custom area may be associated with at least one node within the custom area.

The scenario conditions of the custom area are when the user terminal 100 moves according to the route guidance to the destination, that is, while moving along the route (R) presented through the route guidance, when the user terminal enters the custom area and when the user terminal 100 moves according to the route guidance to the destination. When the user terminal 100 leaves the area, different AR contents may be set to be displayed through the AR view 10.

At this time, whether the user terminal 100 enters the custom area 100 or leaves the custom area may be determined based on the route R presented to the user terminal according to route guidance. In other words, the user terminal 100 or the server 200 can determine which node the user terminal 100 has already passed through or which node it will pass through based on the path R, and accordingly, the user terminal 100 It can be determined whether 100 has entered the currently located custom area or whether to advance from the custom area.

For example, as in the example shown in FIG. 8B, the user terminal 100 enters the custom area CR1 based on the current location of the user terminal 100 and the path (R) along which the user terminal 100 has already moved or will move. It can be judged that it was done. At this time, AR content including an arrow in the direction of the door along with the text “Entering into the building” may be displayed in the AR view 10 of the user terminal 100. Such AR content may be displayed in association with a specific node (Gate node) within the custom area (CR1). In the illustrated example, the custom area CR1 may be outdoors and the custom area CR2 may be indoors.

When the user terminal 100 enters the custom area CR2, information related to the indoor space including the custom area CR2 may be displayed as AR content in the AR view 10. Alternatively, welcome content such as “Welcome” may be displayed through the AR view 10. Meanwhile, as shown in FIG. 8C, the user terminal 100 may advance from the custom area CR2 based on the current location of the user terminal 100 and the path (R) along which the user terminal 100 has already moved or will move. It can be judged that At this time, AR content including an arrow in the direction of the door along with the text “Move outside the building” may be displayed in the AR view 10 of the user terminal 100. Such AR content may be displayed in association with a specific node (Gate node) within the custom area (CR2).

As such, in the embodiment, depending on the movement path provided to the user terminal 100, it may be determined whether the user terminal 100 enters or exits a specific custom area, and appropriate AR content is displayed in the AR view 10 accordingly. can be displayed.

In Figure 9, the case where a plurality of custom areas are defined for one space (exhibition room space) is explained in more detail. As shown, four CRs may be created for one exhibition room space. It is assumed that there are three objects in the exhibition room space, namely, work A, work B, and work C.

The scenario conditions set for the long-distance augmentation CR include AR content including the first information of work A, work B, and work C in the AR view 10 of the user terminal 100 located in the long-distance augmentation CR (AR view ( 10) may be indicated. The first information may include only overview information such as the name of the work.

Meanwhile, the scenario conditions set for CR for work A display AR content including the second information of work A in the AR view 10, but disable all AR content related to other works. It may be to do so. The second information may include information about the first work that is richer and more detailed than the first information. In other words, the user terminal 100 that has entered the CR for work A can only focus on checking detailed information about work A related to the CR for work A. A similar explanation can be applied to CR for work B and CR for work C.

In this way, in the embodiment, a plurality of custom areas that output AR content with different amounts of information can be created for one space, and accordingly, the experience of the user receiving AR content can be improved.

FIG. 10 shows a case where two custom areas are created within the space described with reference to FIG. 7 and a specific point or sub-area is defined in each custom area. For example, a point or sub-area (Point B) may be defined within the custom area (CR_1) corresponding to the first floor, and a point or sub-area (Point A) may be defined within the custom area (CR_2) corresponding to the second floor. It may be defined.

The scenario conditions set for the custom area (CR_1) include cases where the custom area (CR_1) is entered through a specific point or sub-area (Point B) and other cases; Cases of advancing from the custom area (CR_1) through a specific point or sub-area (Point B) and other cases; Cases of entering the custom area (CR_1) through another custom area (CR_2) and other cases; The display of AR content may be set to be different in each case, such as when entering the custom area (CR_1) through a specific point or sub-area (Point A) of another custom area (CR_2) and in other cases.

In other words, the scenario condition is determined based on other custom areas that the user terminal 100 entered/passed through before the user terminal 100 entered the custom area when the user terminal 100 was located in the custom area. AR content may be set to be displayed through the AR view 10. Alternatively, the scenario condition may be set so that when the user terminal 100 is located in the custom area, AR content determined based on the point the user terminal 100 passed through is displayed through the AR view 10.

The above-mentioned “determined AR content” refers to displaying existing AR content in a different form, applying different animations, or applying different effects, displaying AR content with different content, or additional content to the existing AR content ( Additional information (voice, text, image, video, etc.) may be added.

In FIG. 11 , a method of changing AR content displayed through the AR view 10 will be described in consideration of the directionality of the user terminal 100.

In Figure 11a, the user terminal 100 entered the custom area (CR_A) via the custom area (CR_A_1). In Figure 11b, the user terminal 100 entered the custom area (CR_A) via the custom area (CR_A_2).

In FIGS. 11A and 11B, the user terminal 100 is located in the same custom area (CR_A), but in each case, the content displayed through the AR view 10 may be different. For example, when the user terminal 100 passes through the custom area (CR_A_1), it is determined that the user terminal 100 is entering a specific space (restaurant), and an entrance to the specific space or additional service (e.g., at a restaurant) is determined to be entered. AR content that guides (recommended menus, etc.) may be displayed in the AR view 10. On the other hand, when the user terminal 100 passes through the custom area (CR_A_2), it is determined that the user terminal 100 is leaving a specific space (restaurant), and information about an outdoor space, a parking lot, or an additional service (e.g., another dessert cafe) is provided. etc.) may be displayed in the AR view 10.

As another example, when the user terminal 100 enters a specific space (shopping mall, etc.) through a custom area representing a parking lot, the user terminal 100 or the server 200 allows the user to enter the specific space through his or her own vehicle as a means of transportation. It can be judged that you have visited . Alternatively, when the user terminal 100 enters a specific space (such as a shopping mall) through a custom area indicating the entrance to a subway station, the user terminal 100 or the server 200 allows the user to use public transportation as a means of transportation. Through this, it can be determined that a specific space has been visited. At this time, when the user terminal 100 enters a custom area within a specific space or leaves the specific space, content customized for the means of transportation used by the user is displayed in the AR view 10 of the user terminal 100. can be printed. For example, users using a vehicle may be provided with AR content including information about movement to the parking lot, vehicle supplies, etc.; Users who use public transportation may be provided with AR content including information on movement to the subway station.

The description of the technical features described above with reference to FIGS. 1 to 6 can also be applied to FIGS. 7 to 11, so overlapping descriptions will be omitted.

Below, other examples of scenario conditions set for the custom areas 60 and 70 are described in more detail.

Figure 12 shows the DoF (Degree Of Freedom) of a user terminal, according to an example.

The custom areas 60 and 70 may have 3DoF or 6DoF posture conditions of the user terminal 100 defined. 6DoF can represent movement in the x-, y-, and z-axis directions, and rotation (roll, yaw, and pitch) in the axial, y-, and z-axis directions.

These attitude conditions may be included in scenario conditions set for the custom areas 60 and 70, and, as described above, may be included in service elements associated with the custom areas 60 and 70.

When the user terminal 100 or the server 200 determines that the user terminal 100 is located in the custom area 60 or 70, the posture of the user terminal 100 is defined in the custom area 60 or 70. If the posture condition is satisfied, the user terminal 100 can be controlled based on service elements associated with the custom areas 60 and 70. The posture of the user terminal 100 may be acquired by a sensor included in the user terminal 100, for example, a gyro sensor.

As such posture conditions are defined in the custom areas 60 and 70, for example, the user terminal 100 enters the custom areas 60 and 70 and the AR view 10 is maintained at a specific angle or a specific angle range. Only then can the user terminal 100 be controlled based on service elements. For example, AR content that must be displayed in a specific area within the custom area 60, 70, for example, at a position above or below a certain height, is displayed when the user terminal 100 enters the custom area 60, 70 and displays the AR view. (10) can be displayed in the AR view 10 of the user terminal 100 only when it is maintained at an angle or angle range that illuminates a specific area above or below a certain height.

Therefore, in the embodiment, AR content can be displayed at a more appropriate location and viewpoint of the AR view 10.

In addition, the custom areas 60 and 70 are provided with at least one of a first condition indicating a time condition, a second condition indicating movement of the user terminal 100, and a third condition indicating an operation on the user terminal 100. This may be set as a scenario condition.

The first condition, for example, requires that the user terminal 100 stay in the custom area 60, 70 for a certain time or more (e.g., 3 seconds or more), or to stay in the custom area 60, 70 for a certain time or less. It may be a condition. Alternatively, the first condition is a condition requiring the user terminal 100 to enter the custom area 60, 70 at a predetermined time period, or to enter the custom area 60, 70 at a time other than the predetermined time period. It can be. The second condition, for example, represents physical manipulation of the user terminal 100 and may be a condition requiring the user terminal 100 to be shaken a certain number of times or with a certain intensity or more. Alternatively, the second condition may be a condition requiring an action to move the user terminal 100 in a specific shape (eg, the letter '8'). The third condition may be an act of electronically manipulating the user terminal 100, for example, inputting a specific button or key, inputting a specific gesture, inputting a specific voice or audio, or photographing a specific object. It may be a condition that requires something to be done, etc.

When the user terminal 100 or the server 200 determines that the user terminal 100 is located in the custom area 60 or 70, the user terminal 100 satisfies at least one of the first to third conditions. If the in-scenario condition is satisfied, the user terminal 100 can be controlled based on service elements associated with the custom areas 60 and 70. For example, the user terminal 100 may display AR content differently, display UI differently, display map element content differently, or control settings of the user terminal 100 differently depending on whether the scenario conditions are satisfied. You can.

The description of the technical features described above with reference to FIGS. 1 to 11 can also be applied to FIG. 12 , so overlapping descriptions will be omitted.

13 illustrates a generated example custom area that includes a plurality of points, according to an example.

The custom area 1300 may include a point indicating entrance A and a point indicating entrance B. Additionally, the custom area 1300 may further include a point representing object A and a point representing object B. The user terminal 100 or the server 200 may determine whether the user terminal 100 has entered or exited the custom area 1300 by tracking the location of the user terminal 100.

A plurality of service elements may be associated with the custom area 1300. At this time, each service element of the plurality of service elements may be associated with a different point within the custom area 1300. Scenarios or scenario conditions defined in the custom area may be defined to provide services or information related to the space 5 differently depending on the order in which the user terminal 100 passes through points associated with each service element. Services or information provided differently may be AR content, or other types of content that can be output from the user terminal 100, such as voice, text, image, video, etc.

For example, a scenario condition that causes the user terminal 100 to output different types of content is defined in the custom area 1300 by distinguishing between cases where the user terminal 100 enters and exits the custom area 1300. It can be.

Alternatively, when the user terminal 100 enters the custom area 1300 through a specific point (e.g., at least one of the points of entrance A, entrance B, object A, and object B shown), the custom area 1300 Scenario conditions that allow the user terminal 100 to output different types of content, such as when entering the custom area 1300 after passing through a specific external point, may be defined in the custom area 1300. For example, when the user terminal 100 enters the custom area 1300 through a point indicating entrance A, general welcome content may be output to the user terminal 100, but the user terminal 100 enters the custom area 1300 through entrance B. When the custom area 1300 is entered through the indicated point, other content, for example, coupon content, may be output on the user terminal 100. Coupon content may include discount coupons or benefits available within the space (5).

Alternatively, when the user terminal 100 enters the custom area 1300, an additional action is requested from the user terminal 100, such as requesting to move along the edge of the custom area 1300. As an action is performed, scenario conditions that allow the user terminal 100 to output different types of content may be defined in the custom area 1300. The request for the above additional action may also be provided to the user terminal 100 in the form of content or UI.

Alternatively, if the user terminal 100 counts the number of times it has entered the custom area 1300 and enters the custom area 1300 more than n times (n is a natural number of 2 or more) (the user terminal 100 enters the custom area ( 1300) may be counted only within a certain period of time (eg, 1 hour or 1 day), a scenario condition for outputting specific content to the user terminal 100; When the user terminal 100 stays in the custom area 1300 for a predetermined time or more, a scenario condition for outputting specific content to the user terminal 100 may be defined in the custom area 1300.

Meanwhile, when the user terminal 100 leaves the custom area 1300 (i.e., advances), all content displayed on the user terminal 100 may be non-displayed, that is, de-displayed. When the user terminal 100 leaves the custom area 1300, a predetermined notification sound may be output to the user terminal 100. Alternatively, when the user terminal 100 leaves the custom area 1300, AR content indicating that the user terminal 100 has left the custom area 1300 may be displayed in the AR view 10.

As such, in the embodiment, it may be determined whether the user terminal 100 is entering or exiting the custom area 1300, and depending on the determination result, the AR content may be displayed differently (e.g., upon entry, an entry guide AR may be displayed). (content augmentation, advance guide AR content augmentation when advancing, etc.), UI display can be changed differently, map element content can be displayed differently, or setting control of the user terminal 100 can be changed differently.

The description of the technical features described above with reference to FIGS. 1 to 12 can also be applied to FIG. 13 , so overlapping descriptions will be omitted.

Figure 14 shows a method in which a plurality of custom areas are set in a space and scenario conditions for controlling a user terminal are set for each custom area, according to an example.

Below, other examples of scenario conditions defined for each of the plurality of custom areas 1410 to 1440 set in the space 1400 will be further described.

The above-described custom areas 60 and 70 may be any one of the custom areas 1410 to 1440.

In any one of the custom areas 60 and 70 of the custom areas 1410 to 1440, i) a second message indicating whether the user terminal 100 passed through a custom area other than the custom area 60 or 70; At least one scenario condition may be defined among 1 scenario condition and ii) a second scenario condition indicating whether the number of user terminals located in the custom areas 60 and 70 falls within a predetermined range. Depending on whether the corresponding scenario conditions are satisfied, the user terminal 100 is provided with services or information associated with the space 5, 1400 differently, based on service elements associated with the custom area 60, 70, or the user terminal 100 The setting of 100 can be controlled differently.

The first scenario condition may be a condition that requires the user terminal 100, which has entered the custom area 60 or 70, to enter the custom area 60 or 70 after entering another specific custom area. For example, when the user terminal 100 enters a specific custom area among the custom areas 1420 to 1440 and then enters the custom area 1410 (within a predetermined time), the first scenario condition may be satisfied. Alternatively, when the user terminal 100 enters the custom area 1410 (within a predetermined time) after entering at least some of the custom areas 1410 to 1640 in a specific order, the first scenario condition may be satisfied. there is. The user terminal 100 may display AR content differently, display UI differently, display map element content differently, or control settings of the user terminal 100 differently depending on whether the first scenario condition is satisfied. You can.

The second scenario condition is that the number of user terminals located in the custom areas 60 and 70 or the cumulative number of user terminals entering the custom areas 60 and 70 (over a predetermined period of time) is greater than or equal to a certain number or less than a certain number. It may be a condition requiring something. Alternatively, the second scenario condition is the number of user terminals located in a custom area other than the custom area 60, 70 into which the user terminal 100 enters, or the number of user terminals that have entered the other custom area (for a predetermined period of time) ui) It may be a condition that requires the cumulative number to be more than a certain number or less than a certain number. Alternatively, the second scenario condition is the number of user terminals located in both the custom areas 60 and 70 and other custom areas, or the accumulation (over a predetermined time) of the user terminals that have entered the two custom areas. It may be a condition that requires the number to be greater than a certain number or less than a certain number. The user terminal 100 may display AR content differently, display UI differently, display map element content differently, or control settings of the user terminal 100 differently depending on whether the second scenario condition is satisfied. You can.

The above-described first scenario condition and second scenario condition may be used in combination with each other. For example, the user terminal 100 or the server 200 may determine whether the first scenario condition and the second scenario condition are satisfied when the user terminal 100 enters the custom area 60 or 70. and only when both scenario conditions are satisfied, the user terminal 100 can be controlled based on the service element. Alternatively, control of the user terminal 100 based on service elements may be varied depending on which condition of the first scenario condition and the second scenario condition is satisfied.

The description of the technical features described above with reference to FIGS. 1 to 13 can also be applied to FIG. 14 , so overlapping descriptions will be omitted.

As such, in embodiments, a “rendering range”-based method of displaying AR content or controlling the user terminal 100 based on the distance or radius of the position of an object located in space, Compared to the "Semantic Range"-based method of dividing the space into a unit area and displaying AR content or controlling the user terminal 100 when the user terminal 100 enters the unit space, it is more user friendly. A “Custom Range” method that can display AR content on the user terminal 100 and control the user terminal 100 in a friendly and natural manner can be used. The custom range may use the “custom area” described with reference to the embodiments. The “custom range” method can utilize a custom area in which service elements are associated and scenario conditions are defined for display of AR content and control of the user terminal 100.

When using a “rendering range”-based method or a “semantic range”-based method, AR content is displayed inappropriately at the position of an object in the AR view 10 depending on the location of the user terminal 100. may occur, and in some cases, a problem may occur where AR content is displayed in an occlusion area. In the “custom range” method described with reference to the embodiments, this problem can be solved by utilizing a custom area.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, the devices and components described in the embodiments include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), and a programmable logic unit (PLU). It may be implemented using one or more general-purpose or special-purpose computers, such as a logic unit, microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. The software and/or data may be embodied in any type of machine, component, physical device, computer storage medium or device for the purpose of being interpreted by or providing instructions or data to the processing device. there is. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. At this time, the medium may continuously store a computer-executable program, or temporarily store it for execution or download. In addition, the medium may be a variety of recording or storage means in the form of a single or several pieces of hardware combined. It is not limited to a medium directly connected to a computer system and may be distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, And there may be something configured to store program instructions, including ROM, RAM, flash memory, etc. Additionally, examples of other media include recording or storage media managed by app stores that distribute applications, sites or servers that supply or distribute various other software, etc.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims (22)

A method of creating a custom area using a custom area creation tool for creating a custom area associated with at least one service element, performed by a computer system, comprising:
Setting an area corresponding to the custom area in a space using a first user interface (UI) of the custom area creation tool; and
Associating the service element with the set area, and using the second UI of the custom area creation tool, the user terminal is located in the custom area corresponding to the set area, based on the service element. Steps to set scenario conditions for control
How to create a custom area, including. According to paragraph 1,
The set area is set using the first UI and includes at least one of a two-dimensional space that is at least a part of the space and a three-dimensional space that is at least a part of the space. According to paragraph 1,
The step of setting the area is,
Displaying at least one of a map of the space, point cloud data (PCD) collected for the space, and an image in which the space is captured, through the first UI; and
Setting the area by defining the area based on input received from a user according to the geometry of the space identified by at least one of a displayed map of the space, the PCD, and the image.
How to create a custom area, including. According to paragraph 1,
A method of creating a custom area, wherein the first UI is a UI for creating an indoor map of the space. According to paragraph 1,
The step of setting the area is,
A method of creating a custom area that automatically sets the area based on the position of a predefined object in the space, a two-dimensional space predefined in the space, or a polygon predefined in the space. According to paragraph 1,
The region is defined to include a two-dimensional space and a three-dimensional space with a set height range,
If the user terminal is located in the two-dimensional space and the height of the user terminal falls within the set height range, it is determined that the user terminal is located in the custom area, and control is performed based on the set scenario conditions and the service elements. How to create a custom area. According to paragraph 1,
The scenario condition includes a 3DoF (Degree Of Freedom) or 6DoF posture condition of the user terminal, and when the user terminal is determined to be located in the custom area, if the posture of the user terminal satisfies the posture condition , A method of creating a custom area set to control the user terminal based on the service element. According to paragraph 1,
The scenario condition is a custom area that is set to control the user terminal differently based on the service element by distinguishing when the user terminal enters the custom area and when the user terminal leaves the custom area. How to create it. According to paragraph 1,
The service element includes data for display of augmented reality (AR) content related to a service associated with the space,
When a user terminal is located in the custom area, the AR content is displayed through an AR view including an image captured by a camera of the user terminal according to the set scenario conditions. According to clause 9,
The scenario conditions are:
By distinguishing between when the user terminal enters the custom area and when the user terminal leaves the custom area, creating a custom area in which different AR contents are set to be displayed through the AR view as the AR content. How to. According to clause 10,
The scenario conditions are:
While the user terminal moves according to the route guidance to the destination, when the user terminal enters the custom area and when the user terminal leaves the custom area, different AR contents are displayed in the AR view as the AR content. How to create a custom area, set to be displayed via . According to clause 11,
Whether the user terminal enters the custom area or leaves the custom area is determined based on a route presented to the user terminal according to the route guidance. According to clause 9,
The scenario condition is that, when the user terminal is located in the custom area, the AR content is determined based on another custom area that the user terminal entered before entering the custom area. How to create a custom area that is set to be displayed through an AR view. According to clause 9,
The scenario condition is to create a custom area in which, when the user terminal is located in the custom area, the AR content determined based on the point through which the user terminal passed is set to be displayed through the AR view. How to. According to paragraph 1,
The scenario conditions include: i) a first scenario condition indicating whether the user terminal has passed through a custom area other than the custom area, and ii) whether the number of user terminals located in the custom area falls within a predetermined range. Includes at least one of the second scenario conditions representing,
The scenario condition is set to differently provide services or information associated with the space or to differently control settings of the user terminal based on the service element to the user terminal, depending on whether the scenario condition is satisfied. How to create a zone. According to paragraph 1,
A unique ID is assigned to the created custom area,
The set area and the set scenario conditions are stored in association with the ID. According to paragraph 1,
The second UI is,
A third UI for setting at least one control state of the user terminal based on the service element and at least one trigger condition for reaching the control state,
A method of creating a custom area in which the scenario conditions are set according to the control state and the trigger condition set through the third UI. According to clause 17,
The control state includes display of the content indicated by the service element, de-display of the content, display form of the content, or display time of the content,
The trigger condition is at least one of whether the user terminal has entered the custom area, whether the user terminal has entered the custom area, whether the user terminal has passed through a specific point, and whether the user terminal has passed through another predetermined custom area. How to create a custom area, including: According to clause 17,
The third UI includes a graph in which the control state is a node and the trigger condition is an edge connecting the nodes,
The nodes and edges are configured to be added, changed, or deleted by the user,
The step of setting the scenario conditions is,
A method of creating a custom area, setting the scenario condition by setting the control state corresponding to the node selected by the user and setting the trigger condition corresponding to the edge selected by the user through the graph. According to paragraph 1,
Associating the set area with the service element by directly placing the service element in the set area,
A method of creating a custom area, wherein the second UI is provided when the service element associated with the set area or the set area is selected. According to paragraph 1,
When creating another custom area, importing the set area and the set scenario conditions of the created custom area.
It further includes,
The shape of the set area is copied and used to set an area corresponding to the other custom area,
A method of creating a custom area, wherein the scenario conditions are duplicated and used to set scenario conditions of the other custom area. 1. A computer system for creating a custom area using a custom area creation tool for creating a custom area associated with at least one service element, the computer system comprising:
At least one processor configured to execute computer-readable instructions contained in memory
Including,
The at least one processor,
Using the first user interface (UI) of the custom area creation tool, set an area corresponding to the custom area in the space,
Associating the service element with the set area, and using the second UI of the custom area creation tool, the user terminal is located in the custom area corresponding to the set area, based on the service element. A computer system that sets scenario conditions for control.

Images