KR102208634B1 - Method and system of providing augemented reality contents to exhibition hall - Google Patents

Abstract

The present invention relates to a method and a system for providing augmented reality content to an exhibition hall. In the artificial intelligence-based method performed by a server, the exhibition hall includes partial regions and each partial region corresponds to at least one augmented reality content databased in advance. A first characteristic level of an AR goggle wearer obtained from the AR goggle wearer is one of pre-staged first characteristic levels. The augmented reality content corresponding to each partial region has pre-staged versions. The method includes: a step of acquiring the AR goggle wearer′s first characteristic level; a step of acquiring an exhibition hall image in front of the AR goggle; a step of recognizing at least one partial region in the exhibition hall image; a step of referring to the augmented reality content of a version determined by artificial intelligence inference in the augmented reality content corresponding to the partial region; a step of generating an augmented reality layer including the augmented reality content of the version; and a step of transmitting the augmented reality layer to the AR goggle. The artificial intelligence inference can be generated by inputting the AR goggle wearer′s first characteristic level to the artificial neural network of the artificial intelligence.

Description

Method and system for providing augmented reality contents to the exhibition hall {METHOD AND SYSTEM OF PROVIDING AUGEMENTED REALITY CONTENTS TO EXHIBITION HALL}

The following embodiments relate to a technology for providing augmented reality content to an exhibition hall.

As a background technology related to the embodiments, Korean Patent Publication No. KR 10-2055627 B1 discloses an augmented reality guidance system for an exhibition hall. Specifically, the prior literature is an AR marker attached to the exhibit; Including a smartphone; and when the AR mark is photographed with the smartphone, information on the exhibit is displayed on the smartphone, and if the information is a basic type, voice information is output through the smartphone, and if the information is extended type , If a video is output through a smartphone and the information is interactive, an augmented reality guidance system for an exhibition hall in which an interactive app is driven on the smartphone is disclosed.

Through this, the exhibition hall augmented reality guidance system of the prior literature can provide an augmented reality guidance service to users by classifying it by type according to the guidance content of the exhibition object.

In addition, Korean Patent Application Publication No. KR 10-1902315 B1 discloses an experiential exhibition guide system. Specifically, the prior literature includes a viewer's smartphone, a location notification device, a management PC, and an encyclopedia DB server; The location notification device is used to obtain the location of the spectator smartphone; The illustrated book DB server stores the illustrated book of exhibits; The spectator's smartphone includes an augmented reality content module that stores augmented reality content of the exhibited object, a game module that stores a game related to the exhibited object, an encyclopedia module that stores an encyclopedia of the exhibited object, and Disclosed is an experiential exhibition guide system including a unique exhibition hall module for viewing augmented reality contents and illustrated explanations and playing games related to specific exhibitions viewed.

Furthermore, the prior literature is based on the order of the exhibits to be viewed through the viewer's smartphone by using the location information of the viewer's smartphone obtained by the location notification device by the management PC. It includes an exhibition object information module for deriving an encyclopedia of an exhibit to be viewed, providing it to a viewer's smartphone, and storing an augmented reality character of the exhibit; After viewing the exhibition hall, if a specific exhibition object is selected from the encyclopedia list on the screen of your own exhibition hall, your own exhibition hall module extracts the 3D augmented reality contents of the specific exhibition from the augmented reality contents module and extracts the illustrated description from the encyclopedia module. Launches an experiential exhibition guide system, characterized in that when a specific exhibition is selected in the ecosystem of your own exhibition hall and a specific exhibition related game is played through a smartphone, learning about a specific exhibition is performed. .

However, prior documents do not disclose a method for providing augmented reality content to an exhibition hall by referring to a version of augmented reality content determined by inference of artificial intelligence among augmented reality content corresponding to some areas. In addition, prior literatures have shown that when the wearer of AR goggles re-appreciates a part of the exhibition hall, whether to provide the same version of the augmented reality content that was previously viewed, or whether the content of a different version from the previously viewed augmented reality content It does not disclose how to decide whether to provide. Furthermore, prior literature does not disclose a method of differently determining the version of the augmented reality content provided to the visitor depending on whether the visitor is a companion.

Accordingly, it is required to implement a technology that can be provided by referring to a version of augmented reality content determined by inference of artificial intelligence among augmented reality contents corresponding to some areas. In addition, when AR goggles wearers re-appreciate some areas of the exhibition hall, whether to provide the same version of the augmented reality content that was previously viewed or whether to provide a different version of the augmented reality content that was previously viewed. The implementation of the decision-making technique is requested. Furthermore, implementation of a technique for determining a method of differently determining the version of augmented reality content provided to the visitor is requested depending on whether the visitor is a companion or not.

Korean patent publication KR 10-2055627 B1 Korean Patent Publication KR 10-1902315 B1 Korean Patent Publication KR 10-1809444 B1 Korean Patent Application Publication KR 10-2019-0092897 A

The embodiments are intended to provide a method and system capable of providing augmented reality content corresponding to some areas with reference to a version of augmented reality content determined by inference of artificial intelligence.

In the embodiments, when the wearer of AR goggles re-appreciates a part of the exhibition hall, whether to provide the same version of the content as the previously viewed augmented reality content, or to provide a different version of the previously viewed augmented reality content. I would like to provide a way to determine if it is.

The embodiments are intended to provide a method of determining a method of differently determining a version of an augmented reality content provided to a visitor according to whether or not a visitor is a companion.

Further, the embodiments are intended to provide a method and system for providing augmented reality content to an exhibition hall to solve the problems mentioned in the background art and the problems of the relevant technical field disclosed in the present specification.

In the method of providing an augmented reality content to an exhibition hall based on artificial intelligence according to an embodiment, the exhibition hall has partial regions-each partial region has a correspondence relationship with at least one augmented reality content previously databased- Including, The first characteristic level of the AR goggles wearer obtained from the AR goggle wearer is one of the first staged first characteristic levels, each augmented reality content corresponding to each partial area is pre-staged A method of providing an augmented reality content to an exhibition hall performed by a server and having the version versions includes: acquiring a first characteristic level of a wearer of AR goggles; Acquiring an image of an exhibition hall in front of the AR goggles; Recognizing at least one partial area in the exhibition hall image; Referring to a version of augmented reality content determined by inference of the artificial intelligence from among augmented reality content corresponding to the partial area; Generating an augmented reality layer including the version of augmented reality content; And transmitting the augmented reality layer to the AR goggles, wherein the inference of the artificial intelligence may be generated by inputting a first characteristic level of the wearer of the AR goggles into the artificial neural network of the artificial intelligence.

According to an embodiment, as the version of the augmented reality content is lower, the interest and graphics of the augmented reality content are emphasized, and as the version of the augmented reality content is higher, the person description and message of the augmented reality content may be emphasized. .

According to an embodiment, a first viewpoint precedes a second viewpoint, and a method of providing an augmented reality content to an exhibition hall at the second viewpoint includes determining whether the wearer of the AR goggles re-appreciates the partial region; Acquiring an age of the AR goggles wearer when it is determined that the AR goggles wearer is re-appreciating the partial area; Determining whether the wearer of the AR goggles is a child based on the age of the wearer of the AR goggles; If it is determined that the wearer of the AR goggles is not a child, determining a version of the augmented reality content referenced at the second time point as a version higher than the version of the augmented reality content referenced at the first time point; And when the AR goggles wearer is determined to be a child, determining a version of the augmented reality content referenced at the second point of view as the same version as the version of the augmented reality content referenced at the first point of view. have.

A method of providing an augmented reality content to an exhibition hall according to an embodiment includes: acquiring the age of the wearer of the AR goggles; Determining whether the wearer of the AR goggles is a child based on the age of the wearer of the AR goggles; If it is determined that the wearer of the AR goggles is not a child, checking whether there is a companion of the wearer of the AR goggles; Determining whether a child is included in the companion when the wearer of the AR goggles is determined to have a companion; When it is determined that the companion includes a child, the version of the referenced augmented reality content is augmented included in the augmented reality layer transmitted to the companion child's AR goggles, instead of the version determined by the artificial intelligence inference. It may further include determining a version identical to the version of the actual content.

A system for providing augmented reality content to an exhibition hall based on artificial intelligence according to an embodiment includes: AR goggles worn by a wearer who enjoys the exhibition hall; And a server in which augmented reality contents have been converted into a database in advance, wherein the exhibition hall includes some areas, each of which has a correspondence relationship with at least one augmented reality content that has been previously databased, and from a wearer of AR goggles. The acquired first characteristic level of the AR goggle wearer is one of pre-staged first characteristic levels, each augmented reality content corresponding to each partial region has pre-staged versions, and the server , Acquiring a first characteristic level of the wearer of the AR goggles, the AR goggles, acquiring an exhibition hall image in front of the AR goggles, and transmitting the exhibition hall image to the server, the server, at least one from the exhibition hall image Recognizes a partial region of, among augmented reality contents corresponding to the partial region, refers to the version of augmented reality content determined by the inference of the artificial intelligence, and generates an augmented reality layer including the version of augmented reality content, The AR goggles transmit the augmented reality layer, and the AR goggles output the augmented reality layer overlaid on the exhibition hall image, and the inference of the artificial intelligence determines the first characteristic level of the wearer of the AR goggles. It can be created by inputting it into an artificial neural network of

The embodiments may provide a method and a system capable of providing augmented reality content corresponding to some areas with reference to a version of augmented reality content determined by inference of artificial intelligence.

In the embodiments, when the wearer of AR goggles re-appreciates a part of the exhibition hall, whether to provide the same version of the content as the previously viewed augmented reality content, or to provide a different version of the previously viewed augmented reality content. Can provide a way to determine if it is.

The embodiments may provide a method of determining a method of differently determining the version of the augmented reality content provided to the visitor according to whether the visitor is a companion.

On the other hand, the effects according to the embodiments are not limited to those mentioned above, and other effects that are not mentioned will be clearly understood by those of ordinary skill in the art from the following description.

1 is an exemplary diagram of a configuration of a system according to an embodiment.
2 is a diagram illustrating an operation of a system according to an embodiment.
3 is a flowchart illustrating an operation of determining a version of augmented reality content based on the age of a wearer according to an embodiment.
4 is a flowchart illustrating an operation of determining a version of augmented reality content based on a companion of a wearer according to an exemplary embodiment.
5 and 6 are diagrams for explaining learning of an artificial neural network according to an embodiment.
7 is an exemplary diagram of a configuration of an apparatus according to an embodiment.

Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings. However, since various changes may be made to the embodiments, the scope of the rights of the patent application is not limited or limited by these embodiments. It should be understood that all changes, equivalents, or substitutes to the embodiments are included in the scope of the rights.

Specific structural or functional descriptions of the embodiments are disclosed for illustrative purposes only, and may be changed in various forms and implemented. Accordingly, the embodiments are not limited to a specific disclosure form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical idea.

Although terms such as first or second may be used to describe various components, these terms should be interpreted only for the purpose of distinguishing one component from other components. For example, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

When a component is referred to as being "connected" to another component, it is to be understood that it may be directly connected or connected to the other component, but other components may exist in the middle.

The terms used in the examples are used for illustrative purposes only and should not be interpreted as limiting. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present specification, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc., as shown in the figure It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms including different directions of components during use or operation in addition to the directions shown in the drawings. For example, if a component shown in a drawing is turned over, a component described as "below" or "beneath" of another component will be placed "above" the other component. I can. Accordingly, the exemplary term “below” may include both directions below and above. Components may be oriented in other directions, and thus spatially relative terms may be interpreted according to orientation.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the embodiment belongs. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in this application. Does not.

In addition, in the description with reference to the accompanying drawings, the same reference numerals are assigned to the same components regardless of the reference numerals, and redundant descriptions thereof will be omitted. In describing the embodiments, when it is determined that a detailed description of related known technologies may unnecessarily obscure the subject matter of the embodiments, the detailed description thereof will be omitted.

1 is an exemplary diagram of a configuration of a system according to an embodiment.

The system according to an embodiment may include a server 100 and AR goggles 110. The server 100 and the AR goggles 110 may be connected to a network to exchange data through wired or wireless communication. The system may provide augmented reality contents linked to the exhibition hall to visitors who come to appreciate the exhibition hall 120.

The exhibition hall 120 may be, for example, a "Digital Bible Adventure" with the Bible as a motif. Exhibition hall 120 is 1-2. Garden of Eden, 1-5. Noah's Ark Experience Hall, 3-2. It may be configured with various detailed themes, such as the Red Sea Miracle Experience Hall 130. The exhibition hall 120 may include “partial areas” having a corresponding relationship with at least one augmented reality content that has been previously databased. When it is determined that the wearer of the AR goggles 110 is viewing an exhibition hall image including a partial area of the exhibition hall, the AR goggles 110 may output an augmented reality layer including augmented reality content corresponding to the partial area. Through this, the wearer of the AR goggles 110 can enjoy the augmented reality content. In this case, some areas and augmented reality contents having a corresponding relationship may have content robustness. For example, some areas included in the Red Sea Miracle Experience Center 130 may be the appearance of “Moses” drawn on the walls of the exhibition hall, and the augmented reality contents 131 corresponding to some areas may be animations in which the sea splits. Meanwhile, although FIG. 1 shows an exhibition and exhibition hall called “Digital Bible Adventure” as an example, the types and sizes of exhibition halls to which the system can be applied are not particularly limited.

The server 100 may be its own server owned by a person or organization that provides services using the server 100; May be a cloud server; It may be a peer-to-peer (p2p) set of distributed nodes. The server 100 includes arithmetic functions of an ordinary computer; Save/reference function; Input/output function; And it may be configured to perform all or part of the control function. The server 100 may include at least one artificial neural network that performs an inference function. The server 100 may be configured to communicate with the AR goggles 110 by wire or wireless.

The server 100 communicates with the AR goggles 110 and may perform operations for providing augmented reality content corresponding to a partial area of the exhibition hall viewed by the wearer of the AR goggles 110. To this end, the server 100 may acquire the first characteristic level of the wearer of the AR goggles 110. The first characteristic level of the wearer of the AR goggles 110 obtained from the wearer of the AR goggles 110 may be one of pre-staged first characteristic levels. Here, the first characteristic levels may be an expression system in which the degree of the first characteristic that the wearer of the AR goggles 110 may have is classified in stages. As the first characteristic level of the wearer of the specific AR goggles 110 is higher, it may mean that the wearer of the corresponding AR goggles 110 has a stronger degree of the first characteristic.

For example, the first characteristic may be “Christian faith” of the wearer of the AR goggles 110. The first characteristic levels may be an expression system in which the degree of “Christian faith” that the wearer of the AR goggles 110 may have is classified in stages. For example, the first trait levels are “Level 1: Believe in another religion”; “Level 2: No Christian Faith”; “Level 3: Sometimes I go out of church”; “Level 4: leaving church every week”; “Level 5: deeply religious”; It could be “Level 6: Be active in missionary work”. The first characteristic level of the wearer of the AR goggles 110 obtained from the wearer of the AR goggles 110 may be one of pre-staged first characteristic levels (levels 1 to 6). As the first characteristic level of the wearer of the specific AR goggles 110 is higher, it may mean that the wearer of the AR goggles 110 has a strong Christian faith. For example, it can be interpreted that the wearer whose first characteristic level is "Level 4: Leave the church every week" is stronger than the wearer whose first characteristic level is "Level 3: sometimes leave church".

In addition, the server 100 may pre-database augmented reality contents corresponding to some areas of the exhibition hall. In this case, each augmented reality content corresponding to each partial area may have respective pre-staged versions. The lower the version of augmented reality content, the more interesting and graphics can be emphasized. In addition, the lower the version of augmented reality content, the shorter the display time may be. On the other hand, the higher the version of augmented reality content, the more emphasis may be on character descriptions and messages than on interest and graphics. In addition, the higher the version of augmented reality content, the longer the display time may be.

For example, a partial area of the exhibition hall may be a shape of “Moses” drawn on the walls of the exhibition hall, and the augmented reality content 131 corresponding to the partial area may be an animation in which the sea splits. The server 100 may create a database of “augmented reality content 131 of animation where the sea splits” into different versions. For example, the server 100 may store the first version of "Augmented Reality Contents 131 of the Sea Splitting Animation" in which interest and graphics are emphasized, into a database. The display time of the augmented reality content of the first version may be short. In addition, the server 100 may store the mth version of the “augmented reality content 131 of animation where the sea splits” in which character descriptions and messages are emphasized, into a database. The m-th version of the augmented reality content may be displayed for a long time. The server 100 may store an augmented reality content in which interest and graphics are emphasized as a database as the version of the augmented reality content is lower. In addition, as the version of the augmented reality content is higher, the server 100 may store the version of the augmented reality content emphasizing character descriptions and messages into a database.

AR goggles 110 may be configured to be worn by those who appreciate the exhibition hall. AR goggles 110 has a calculation function of a typical computer; Save/reference function; Input/output function; And it may be configured to perform all or part of the control function. AR goggles 110 may be configured to communicate with the server 100 by wire or wireless.

AR goggles 110 may install applications produced or distributed by a person or organization providing services using the server 100. The AR goggles 110 may transmit an exhibition hall image viewed by the wearer of the AR goggles 110 to the server 100 through an application, and obtain augmented reality layers calculated and generated by the server 100. . For example, the AR goggles 110 can transmit the image of “Moses” drawn on the wall of the exhibition hall to the server 100 through the application, and the augmented reality content of the “sea splitting animation” generated by the server 100 ( 131)” can be acquired. The AR goggles 110 may output an augmented reality layer overlaid on the exhibition hall image. Through this, the wearer of the AR goggles 110 can enjoy the appearance of the augmented reality layer overlaid on the exhibition hall image.

Meanwhile, for convenience of explanation, only one AR goggles 110 is shown in FIG. 1, but the number of AR goggles may vary depending on the number of people viewing the exhibition hall. As long as the processing capacity of the server 100 allows, the number of AR goggles is not particularly limited.

Hereinafter, embodiments will be described based on the operation of the server 100 and the AR goggles 110, but the embodiments are not limited by the subject or aspect of communication, and various application examples may be employed. Hereinafter, an embodiment related to the operation of the system will be described with reference to FIG. 2. Referring to FIG. 3, an embodiment related to an operation of determining a version of augmented reality content based on the age of the wearer is described. Referring to FIG. 4, an embodiment related to an operation of determining a version of augmented reality content based on a companion of a wearer is described. An embodiment related to a learning operation of an artificial neural network will be described with reference to FIGS. 5 and 6.

2 is a diagram illustrating an operation of a system according to an embodiment.

First, the server 100 may acquire the first characteristic level of the wearer of the AR goggles 110 (201).

Specifically, in the step of delivering the AR goggles 110 to visitors who enjoy the exhibition hall, the server 100 uses an electronic questionnaire that asks for information on the first characteristics of the visitors. You can acquire the attribute level. Alternatively, the server 100 is the first characteristic of the wearer of the AR goggles 110 through an electronic questionnaire that asks visitors for information on the first characteristic in the step of making reservations for the exhibition hall through online. You can get a level.

The first characteristic level of the wearer of the AR goggles 110 obtained from the wearer of the AR goggles 110 may be one of pre-staged first characteristic levels. The first characteristic levels may be an expression system in which the degree of the first characteristic that the wearer of the AR goggles 110 may have is classified in stages. As the first characteristic level of the wearer of the specific AR goggles 110 is higher, it may mean that the wearer of the corresponding AR goggles 110 has a stronger degree of the first characteristic.

For example, the first characteristic may be “Christian faith” of the wearer of the AR goggles 110. The first characteristic levels may be an expression system in which the degree of “Christian faith” that the wearer of the AR goggles 110 may have is classified in stages. For example, the first trait levels are “Level 1: Believe in another religion”; “Level 2: No Christian Faith”; “Level 3: Sometimes I go out of church”; “Level 4: leaving church every week”; “Level 5: deeply religious”; It could be “Level 6: Be active in missionary work”. The first characteristic level of the wearer of the AR goggles 110 obtained from the wearer of the AR goggles 110 may be one of pre-staged first characteristic levels (levels 1 to 6). As the first characteristic level of the wearer of the specific AR goggles 110 is higher, it may mean that the wearer of the AR goggles 110 has a strong Christian faith.

Next, the AR goggles 110 may acquire an image of an exhibition hall in front of the AR goggles 110 (202).

The AR goggles 110 may acquire an exhibition hall image of the exhibition hall 120 through an input device such as a camera or an optical sensor included in the AR goggles 110. The exhibition hall image may include “some areas” having a corresponding relationship with at least one augmented reality content. For example, the AR goggles 110 may acquire an image of the Red Sea miracle experience hall 130 viewed by the wearer. The image of the Red Sea Miracle Experience Center 130 may include the image of “Moses” drawn on the wall of the exhibition hall, which is a partial area corresponding to the animation of the augmented reality content 131, the sea splitting.

Subsequently, the AR goggles 110 may transmit an exhibition hall image to the server 100 (203). Through this, the server 100 may acquire an image of an exhibition hall in front of the AR goggles 110.

In the following order, the server 100 may recognize at least one partial area in the exhibition hall image (204).

Specifically, the server 100 may detect a partial region (a region having a correspondence relationship with the augmented reality content) in the exhibition hall image through an object recognition algorithm. In addition, the server 100 may calculate an area occupied by a partial area in the exhibition hall image and a location of a partial area on the exhibition hall image.

Next, the server 100 may refer to a version of augmented reality content determined by inference of artificial intelligence from among augmented reality content corresponding to a partial area (205).

To this end, the server 100 may create a database of augmented reality contents corresponding to each partial area of the exhibition hall in advance. Some areas of the exhibition hall having a corresponding relationship and the augmented reality contents that have been databased may have a content relationship. For example, when a part of the area is a shape of “Moses” drawn on the wall of an exhibition hall, the augmented reality content in the database may be an augmented reality content 131 of animation where the sea splits.

Furthermore, each augmented reality content corresponding to each partial area may have pre-stepped versions. The server 100 may refer to a version of augmented reality content determined by inference of learned artificial intelligence from among augmented reality content corresponding to some areas. The inference of the artificial intelligence may be generated by inputting the first characteristic level of the wearer of the AR goggles 110 to the artificial neural network of the artificial intelligence. At this time, the server 100 refers to the version of augmented reality content determined by the inference of artificial intelligence, so that the correspondence between the versions of the augmented reality content corresponding to each partial area and the first characteristic levels of the AR goggle wearer May be different for each augmented reality content. The learning process of artificial intelligence (artificial neural network) will be described later with reference to FIGS. 5 and 6.

For example, when the first characteristic level of the wearer of the AR goggles 110 is level 2 (no Christian faith), the server 100 is an animation in which the sea corresponding to the appearance of “Moses” drawn on the walls of the exhibition hall is split Among the versions of the augmented reality content 131 of, according to the inference of artificial intelligence, a relatively low version of the augmented reality content may be referred to. The relatively low version of the augmented reality content may be “augmented reality content 131 of animation where the sea splits” in which interest and graphics are emphasized. In addition, when the first characteristic level of the wearer of the AR goggles 110 is level 5 (deep faith), the server 100 enhances the animation of the sea splitting corresponding to the appearance of “Moses” drawn on the walls of the exhibition hall, which is a partial area. Among the versions of the reality content 131, a relatively high version of the augmented reality content may be referenced according to the inference of artificial intelligence. The relatively high version of the augmented reality content may be “augmented reality content 131 of animation where the sea splits” in which character descriptions and messages are emphasized.

As such, the server 100 according to the inference of artificial intelligence, the lower the first characteristic level of the AR goggles 110 wearer, among the versions of augmented reality contents corresponding to some areas, the version in which interest and graphics are emphasized. You can refer to augmented reality content. In addition, as the first characteristic level of the wearer of the AR goggles 110 is higher, the server 100 may refer to a version of augmented reality content emphasizing a character description and a message among versions of augmented reality content corresponding to some areas. . Through this, the server 100 may provide each augmented reality content corresponding to a partial area with reference to a version of augmented reality content differentiated according to the first characteristic level of the wearer of the AR goggles 110.

In this case, a correspondence relationship between versions of augmented reality content corresponding to each partial area and the first characteristic levels of the AR goggle wearer may be different for each augmented reality content. For example, the augmented reality content of the animation where the sea is divided by Moses, which is a relatively famous story by reasoning of artificial intelligence, corresponds to a higher version of augmented reality content even if the first characteristic level of the AR goggle wearer is relatively low. So, if you wear AR goggles with even a little faith, you can enjoy the version of augmented reality content that emphasizes character descriptions and messages in addition to the graphic where the Red Sea splits. On the other hand, augmented reality content related to the death of the good king Yoshiya, which is a relatively less-known story by artificial intelligence inference, corresponds to a lower version of augmented reality content even if the first characteristic level of the AR goggle wearer is relatively high. As a result, even a wearer of AR goggles with a certain degree of faith can enjoy a version of augmented reality content that emphasizes graphics rather than character descriptions and messages so that storytelling of unfamiliar stories can be done well.

Subsequently, the server 100 may generate an augmented reality layer including augmented reality content (206).

To this end, the server 100 may calculate the size and position at which the referenced version of augmented reality content will be displayed based on the area occupied by a partial area included in the exhibition hall image and the position of the partial area on the exhibition hall image. For example, if the wearer of the AR goggles 110 is far from a partial area included in the exhibition hall, the area occupied by a partial area on the exhibition hall image will be small, so the server 100 has a size in which the augmented reality content corresponding to the partial area will be displayed. It can be calculated to be small. Alternatively, when a partial area is located below the floor or the like in the exhibition hall image, the server 100 may calculate a position at which the augmented reality content corresponding to the partial area is to be displayed is lower.

The server 100 may calculate a size and a location in which the referenced version of augmented reality content is to be displayed, and then generate an augmented reality layer including the referenced version of the augmented reality content in the calculated size and location.

In the following order, the server 100 may transmit an augmented reality layer with AR goggles (207). Through this, the AR goggles 110 may acquire an augmented reality layer generated and calculated by the server 100.

Next, the AR goggles 110 may output an augmented reality layer overlaid on the exhibition hall image (208).

Specifically, the AR goggles 110 may overlay an augmented reality layer obtained from the server 100 on an exhibition hall image acquired through an input device such as a camera or an optical sensor included in the AR goggles 110. Thereafter, the AR goggles 110 may output an image in which an augmented reality layer is added to the exhibition hall image through an output device such as a monitor or a projector included in the AR goggles 110. The image output to the naked eye of the wearer of the AR goggles 110 includes an exhibition hall image and augmented reality content.

In this case, the version of the augmented reality content included in the image outputted to the naked eye of the wearer of the AR goggles 110 may vary according to the first characteristic level of the wearer of the AR goggles 110. That is, the server 100 generates inference by inputting the first characteristic level of the wearer of the AR goggles 110 to the artificial intelligence, refers to the version of augmented reality content determined by the inference of the artificial intelligence, and the referenced version of augmented reality Since an augmented reality layer is created based on the content and the augmented reality layer is transmitted to the AR goggles 110, the augmented reality content included in the augmented reality layer acquired by the AR goggles 110 is made by the wearer of the AR goggles 110. 1 May be different versions depending on the level of the feature.

For example, when the first characteristic level of the wearer of the AR goggles 110 is level 1 (belief in another religion), the AR goggles 110 may output an augmented reality layer including a relatively low version of augmented reality content. I can. The relatively low version of the augmented reality content may be “augmented reality content 131 of animation where the sea splits” in which interest and graphics are emphasized. In addition, when the first characteristic level of the wearer of the AR goggles 110 is level 6 (to actively engage in missionary activities), the AR goggles 110 may output an augmented reality layer containing a relatively high version of augmented reality content. I can. The relatively high version of the augmented reality content may be “augmented reality content 131 of animation where the sea splits” in which character descriptions and messages are emphasized.

Through the above, the system including the server 100 and the AR goggles 110, the AR goggles 110 wearers according to the first characteristic level of the AR goggles 110 wearer (for example, the degree of "Christian faith") It can provide augmented reality content in a version inferred by artificial intelligence. Through this, wearers of the AR goggles 110 who view the exhibition in the exhibition hall may be provided with augmented reality content tailored to their first characteristic level. Through this, visitors who are unfamiliar with the exhibition theme displayed in the exhibition hall can be provided with a version of augmented reality content that emphasizes interest and graphics, and through this, they can have interest, curiosity, and open mind about the exhibition theme. In addition, visitors who are familiar with the exhibition theme displayed in the exhibition hall can be provided with a version of augmented reality content emphasizing character descriptions and messages, and through this, they can have an opportunity to in-depth understanding and appreciation of the exhibition theme. There will be.

3 is a flowchart illustrating an operation of determining a version of augmented reality content based on the age of a wearer according to an embodiment.

First of all, the first viewpoint may mean a viewpoint preceding the second viewpoint. The operation of determining the version of the augmented reality content based on the wearer's age may be performed at the second time point.

The first point in time may be a point in time when a specific visitor visits the exhibition hall 120 for the first time or before, and views a specific partial area of the exhibition hall; The second point of view may be a point in time when the same viewer visits the exhibition hall 120 next or later, and views the same partial area of the exhibition hall. Alternatively, when a visitor views the exhibition hall 120 once, the first viewpoint may be a time when a specific visitor first or previously viewed a specific partial area of the exhibition hall; The second viewpoint may be a viewpoint when the same viewer views the same partial area of the exhibition hall next or later.

The method of providing the augmented reality content to the exhibition hall at the second viewpoint may include the following operation.

First, the server 100 may determine whether the wearer of the AR goggles 110 re-appreciates a partial area (310).

Specifically, the server 100 may acquire an exhibition hall image from the AR goggles 110. Subsequently, the server 100 may recognize a partial area included in the exhibition hall image. Then, the server 100, from the AR goggles 110 that the same person as the wearer of the AR goggles 110 at the second viewpoint was wearing at the first viewpoint, the exhibition hall image including a partial region identical to the partial region at the second viewpoint You can inquire whether there was an acquired history. Subsequently, when there is a history of acquiring an exhibition hall image including a partial region that is the same as a partial region of the second viewpoint at the first viewpoint, the server 100 determines that the wearer of the AR goggles 110 reappreciates the partial region. I can.

Next, when it is determined that the wearer of the AR goggles 110 re-appreciates a partial area, the server 100 may acquire the age of the wearer of the AR goggles 110 (320).

Specifically, the server 100 may acquire the age of the wearer of the AR goggles 110 through an electronic questionnaire asking the age of the visitors, etc. in the step of issuing the AR goggles 110 to visitors who enjoy the exhibition hall. Alternatively, the server 100 may acquire the age of the wearer of the AR goggles 110 through an electronic questionnaire asking the audience about their age in the step of booking the exhibition hall through online by visitors who enjoy the exhibition hall.

Subsequently, the server 100 may determine whether the wearer of the AR goggles 110 is a child based on the age of the wearer of the AR goggles 110 (330).

Specifically, the server 100 may define a reference age, and determine wearers of AR goggles under the reference age as children. In this case, the reference age may vary according to culture, education, and perception of the country or region in which the exhibition hall 120 is opened. Also, the standard age may vary depending on the exhibition theme displayed in the exhibition hall. For example, if the subject of the exhibition is relatively difficult or unfamiliar, the reference age may increase, and if the subject of the exhibition is relatively easy or familiar, the reference age may decrease.

In the following order, when it is determined that the wearer of the AR goggles 110 is not a child, the server 100 determines the version of the augmented reality content referenced at the second point of view, higher than the version of the augmented reality content referenced at the first point of view. The version can be determined (340).

Meanwhile, when the wearer of the AR goggles 110 is determined to be a child, the server 100 converts the version of the augmented reality content referenced at the second point of view to the same version as the version of the augmented reality content referenced at the first point of view. Can be determined (350).

For example, the first characteristic level of the wearer of the AR goggles 110 may be 4. At the first point in time, when the wearer of the AR goggles 110 appreciates the appearance of “Moses” drawn on the walls of the exhibition hall, which is a partial area of the exhibition hall, the server 100 indicates that the artificial intelligence is the first characteristic level of the wearer of the AR goggles 110 It may be determined to refer to the version of "Augmented Reality Contents 131 of Animation where the Sea Splits" based on these four points. The server 100 may generate an augmented reality layer based on the version of the “augmented reality content 131 of the sea splitting animation” inferred by artificial intelligence and transmit it to the AR goggles 110, through which AR goggles (110) The wearer may enjoy the version of “augmented reality content 131 of animation where the sea splits” inferred by artificial intelligence based on the fact that the first characteristic level of the wearer of the AR goggles 110 is 4.

Meanwhile, the age of the wearer of the AR goggles 110 may be 15 years old, and the server 100 may determine that the wearer of the AR goggles 110 is not a child. In this case, at the second viewpoint, when the wearer of the AR goggles 110 re-appreciates the appearance of “Moses” drawn on the walls of the exhibition hall, which is a partial area of the exhibition hall, the server 100 displays the augmented reality content referenced at the first viewpoint. It may be determined to refer to a version higher than the version of "Augmented Reality Contents 131 of the animation where the sea splits". The augmented reality content of a version higher than the version of the augmented reality content referenced at the first view point may be an augmented reality content in which character descriptions and messages are emphasized than the version of the augmented reality content referenced at the first view point. The server 100 generates an augmented reality layer on the basis of the version higher than the version of the augmented reality content referenced at the first point of view "augmented reality content 131 of the animation where the sea splits", and uses the AR goggles 110 Through this transmission, the wearer of the AR goggles 110 can enjoy a higher version of the “augmented reality content 131 of the animation where the sea splits” than the version of the augmented reality content referenced at the first time point.

Alternatively, the age of the wearer of the AR goggles 110 may be 5 years old, and the server 100 may determine that the wearer of the AR goggles 110 is a child. In this case, at the second viewpoint, when the wearer of the AR goggles 110 re-appreciates the appearance of “Moses” drawn on the walls of the exhibition hall, which is a partial area of the exhibition hall, the server 100 displays the augmented reality content referenced at the first viewpoint. It may be determined to refer to the same version as the version of "Augmented Reality Contents 131 of the animation where the sea diverges". The server 100 generates an augmented reality layer based on the same version as the version of the augmented reality content referenced at the first point of view "augmented reality content 131 of the animation where the sea is split", and uses the AR goggles 110 Through this, the wearer of the AR goggles 110 can enjoy the same version as the version of the augmented reality content referenced at the first point of view, "augmented reality content 131 of the animation where the sea diverges".

Through the above, when the wearer of the AR goggles 110 re-appreciates a partial area of the exhibition hall, when the wearer of the AR goggles 110 is a child, the augmented reality version of the same version as when the wearer of the AR goggles 110 is a child. By providing content, it is possible to satisfy the appreciation desire of children who like repetitive content. In addition, when the wearer of the AR goggles 110 re-appreciates a partial area of the exhibition hall, when the wearer of the AR goggles 110 is not a child, the augmented reality content of a higher version than when previously viewing a partial area of the exhibition hall By providing, it is possible to provide an environment in which visitors who reappreciate can enjoy deeper appreciation without feeling boredom.

4 is a flowchart illustrating an operation of determining a version of augmented reality content based on a companion of a wearer according to an exemplary embodiment.

First, the server 100 may acquire the age of the AR goggle wearer (410).

Specifically, the server 100 may acquire the age of the wearer of the AR goggles 110 through an electronic questionnaire asking the age of the visitors, etc. in the step of issuing the AR goggles 110 to visitors who enjoy the exhibition hall. Alternatively, the server 100 may acquire the age of the wearer of the AR goggles 110 through an electronic questionnaire asking the audience about their age in the step of booking the exhibition hall through online by visitors who enjoy the exhibition hall.

Next, the server 100 may determine whether the AR goggle wearer is a child based on the age of the AR goggle wearer (420).

Specifically, the server 100 may define a reference age, and determine wearers of AR goggles under the reference age as children. In this case, the reference age may vary according to culture, education, and perception of the country or region in which the exhibition hall 120 is opened. Also, the standard age may vary depending on the exhibition theme displayed in the exhibition hall. For example, if the subject of the exhibition is relatively difficult or unfamiliar, the reference age may increase, and if the subject of the exhibition is relatively easy or familiar, the reference age may decrease.

Subsequently, when it is determined that the wearer of the AR goggles 110 is not a child, the server 100 may check whether there is a companion of the wearer of the AR goggles 110 (430).

Specifically, the server 100 checks whether there are companions of the AR goggles 110 wearer through an electronic questionnaire asking whether the visitors are accompanied by an electronic questionnaire at the stage of issuing the AR goggles 110 to visitors who enjoy the exhibition hall. I can. Alternatively, the server 100 can check whether there are companions of the AR goggles 110 wearer through an electronic questionnaire that asks visitors whether or not they are companions at the stage of making reservations for the exhibition hall through online. have.

In the following order, when it is determined that the wearer of the AR goggles 110 has a companion, the server 100 may determine whether a child is included in the companion (440).

To this end, the server 100 determines the age of the companions of the AR goggles 110 wearer through an electronic questionnaire asking the age of companions of the visitors at the stage of issuing the AR goggles 110 to visitors who enjoy the exhibition hall. Can be obtained. Alternatively, the server 100 acquires the ages of the companions of the AR goggles 110 wearer through an electronic questionnaire that asks visitors about the age of the companions at the stage of booking the exhibition hall through online by visitors who enjoy the exhibition hall. can do.

Thereafter, the server 100 may determine whether a child is included in the companions based on the ages of the companions. Specifically, the server 100 may define a reference age and determine companions under the reference age as children. In this case, the reference age may vary according to culture, education, and perception of the country or region in which the exhibition hall 120 is opened. Also, the standard age may vary depending on the exhibition theme displayed in the exhibition hall. For example, if the subject of the exhibition is relatively difficult or unfamiliar, the reference age may increase, and if the subject of the exhibition is relatively easy or familiar, the reference age may decrease.

Next, when it is determined that the accompanying guest includes a child, the server 100 determines the version of the referenced augmented reality content, the version of the augmented reality content included in the augmented reality layer transmitted to the AR goggles of the companion child. The same version can be determined (450).

For example, the first characteristic level of the wearer of the AR goggles 110 may be level 4. When the wearer of the AR goggles 110 is not accompanied by a companion, when viewing the appearance of “Moses” drawn on the walls of the exhibition hall, which is a part of the exhibition hall, the server 100 uses artificial intelligence as the first characteristic of the wearer of the AR goggles 110 It may be determined to refer to the version of "Augmented Reality Contents 131 of Animation where the Sea Splits" based on the point at which the level is 4. The server 100 may generate an augmented reality layer based on the version of the “augmented reality content 131 of the sea splitting animation” inferred by artificial intelligence and transmit it to the AR goggles 110, through which AR goggles (110) The wearer may enjoy the version of “augmented reality content 131 of animation where the sea splits” inferred by artificial intelligence based on the fact that the first characteristic level of the wearer of the AR goggles 110 is 4.

Meanwhile, the age of the wearer of the AR goggles 110 may be 40 years old, and the server 100 may determine that the wearer of the AR goggles 110 is not a child. In addition, the server 100 may determine that there is a child among the companions of the AR goggles 110 wearer. The first characteristic level of the accompanying child may be 3. Therefore, when a companion child appreciates the appearance of “Moses” drawn on the walls of the exhibition hall, the version of “Augmented Reality Contents 131 of the Sea Splitting Animation” included in the augmented reality layer transmitted to the accompanying child's AR goggles. May be lower than the version of “Augmented Reality Content 131 of an animation where the sea splits” included in the augmented reality layer transmitted to the AR goggles 110 of the AR goggles 110 wearer.

In this case, the server 100 provides a version of the augmented reality content included in the augmented reality layer to be transmitted to the AR goggles 110 of the wearer of the AR goggles 110 of the age of 40. Instead of the version of the augmented reality content inferred based on the first characteristic level, it may be determined as the version of the augmented reality content included in the augmented reality layer transmitted to the AR goggles of the accompanying child.

If the version of the augmented reality content included in the augmented reality layer transmitted to the AR goggles of the accompanying child is lower than the version of the augmented reality content inferred based on the first characteristic level of the AR goggles 110 wearer, The version of the augmented reality content determined to be referred to for inclusion in the augmented reality layer to be transmitted to the AR goggles 110 may be a lower version of augmented reality content in which interest and graphics are emphasized. In addition, the version of the augmented reality content included in the augmented reality layer transmitted to the AR goggles of the accompanying child will be higher than the version of the augmented reality content inferred based on the first characteristic level of the AR goggles 110 wearer. In this case, the version of the augmented reality content determined to be referred to for inclusion in the augmented reality layer to be transmitted to the AR goggles 110 may be a high version of augmented reality content in which a person description and a message are emphasized.

Through the above, when the wearer of the AR goggles 110 comes to visit the exhibition hall 120 with a child companion, the version of the augmented reality content displayed to the wearer of the AR goggles 110 and the accompanying child The version of the augmented reality content can be unified based on the companion child. Through this, the wearer of the AR goggles 110 and the accompanying child can enjoy the same version of the augmented reality content that the companion child enjoys. Through this, adults who visit the exhibition hall 120 with children, enjoy the same augmented reality contents as children, share memories while enjoying the same augmented reality contents as children, and easily explain the contents of the augmented reality contents to children. Can give.

5 and 6 are diagrams for explaining learning of an artificial neural network according to an embodiment.

The artificial intelligence (artificial neural network) may be a component included in the server 100 and may be learned through the server 100 or a separate learning device.

The artificial neural network 501 before learning may be in a state in which a correspondence relationship between the first characteristic level of the AR goggle wearer and the version of the augmented reality content corresponding to a partial region cannot be established. On the other hand, the artificial neural network 502 in which the learning has been performed receives the first characteristic level of the artificial AR goggle wearer, and among augmented reality contents corresponding to a partial area of the exhibition hall, an augmented reality suitable for the wearer of the AR goggles having the first characteristic level. The version of the content can be inferred and output.

Hereinafter, a process of learning an artificial neural network through a learning device will be described.

First, the learning device may acquire training data and a label (600).

For artificial neural network learning, the learning device may acquire a first characteristic level of each wearer of AR goggles as training data.

In addition, for learning of artificial neural networks, each AR goggle wearer shows all versions of augmented reality content corresponding to some areas of the exhibition hall, and the augmented reality content that each wearer of AR goggles answered that they most preferred or appreciated it. A version of can be obtained as a label for each training data. Here, as the first characteristic level of the AR goggle wearer is higher, it can be expected that the answer that the AR goggle wearer prefers or appreciates the higher version of augmented reality content.

Now, the learning device may generate an input of an artificial neural network from the training data (610).

The learning device may use the training data as an input of the artificial neural network or generate an input of the artificial neural network after undergoing known processing such as removing unnecessary information from an image.

Next, the learning device may apply the input to the artificial neural network (620). The artificial neural network included in the server may be an artificial neural network that is learned according to supervised learning. The artificial neural network may be a convolutional neural network (CNN) or a recurrent neural network (RNN) structure suitable for training through supervised learning.

Subsequently, the learning device may obtain an output from the artificial neural network (630).

The output of the artificial neural network may be an inference of a version of augmented reality content most suitable for a wearer of AR goggles having a first characteristic level corresponding to training data, among augmented reality content corresponding to each partial area of the exhibition hall. Specifically, the artificial neural network, for augmented reality content corresponding to each partial area, when the first characteristic level of the AR goggles wearer is close to the maximum value, when the first characteristic level of the AR goggles wearer is close to the minimum value, AR goggles A pattern such as a case where the wearer's first characteristic level is close to the intermediate value may be analyzed, and a version of the augmented reality content deduced to be most suitable for the wearer of AR goggles having the first characteristic level corresponding to the training data may be output.

Thereafter, the learning device may compare the output and the label (640 ). The process of comparing the output of the artificial neural network corresponding to the inference with the label corresponding to the correct answer may be performed by calculating a loss function. As the loss function, a known mean squared error (MSE), cross entropy error (CEE), etc. may be used. However, the present invention is not limited thereto, and loss functions used in various artificial neural network models may be used as long as a deviation, error, or difference between the output of the artificial neural network and the label can be measured.

Next, the learning device may optimize the artificial neural network based on the comparison value (650). By updating the weight of the nodes of the artificial neural network so that the comparison value of the learning device becomes smaller, the output of the artificial neural network corresponding to the inference and the label corresponding to the correct answer can be gradually matched. Through this, the artificial neural network It can be optimized to output an inference close to the correct answer. Specifically, the learning apparatus may optimize the artificial neural network by repeating the process of resetting the weight of the artificial neural network so that the loss function corresponding to the comparison value approaches the estimated value of the minimum value. For the optimization of artificial neural networks, known backpropagation algorithms, stochastic gradient descent, and the like can be used. However, the present invention is not limited thereto, and a weight optimization algorithm used in various neural network models may be used.

The learning device can train an artificial neural network by repeating this process.

Through this, the learning device is based on the first characteristic level of the wearer of the AR goggles; Among the augmented reality contents corresponding to each partial area of the exhibition hall, an artificial neural network that infers and outputs a version of an augmented reality content suitable for a wearer of AR goggles having a first characteristic level may be trained. Through this, compared to the artificial neural network 501 before learning, the artificial neural network 502 in which the learning has been made receives the first characteristic level of the wearer of the artificial AR goggles, and among augmented reality contents corresponding to some areas of each exhibition hall. , A version of an augmented reality content suitable for a wearer of AR goggles having a first characteristic level may be inferred and output.

In particular, a correspondence relationship between versions of augmented reality content corresponding to each partial area and first characteristic levels (eg, levels of Christian faith) of the AR goggle wearer may be different for each augmented reality content. For example, the learned artificial intelligence is such that the augmented reality content of animation where the sea is split by Moses, which is a relatively famous story, corresponds to a higher version of augmented reality content even if the first characteristic level of the AR goggle wearer is relatively low. Thus, if a wearer of AR goggles with even a little faith can enjoy augmented reality content in a version that emphasizes character descriptions and messages, in addition to the graphic where the Red Sea splits, it is possible to enjoy. On the other hand, the learned artificial intelligence, augmented reality content related to the death of the good king Yoshiya, which corresponds to a relatively less-known story, corresponds to a lower version of augmented reality content even if the first characteristic level of the AR goggle wearer is relatively high. Thus, even a wearer of AR goggles with a certain degree of faith can appreciate a version of augmented reality content that emphasizes graphics rather than character descriptions and messages so that storytelling of unfamiliar stories can be done well.

The learned artificial intelligence (artificial neural network) may be used to determine the version of the augmented reality content to be referred to above with reference to FIGS. 2 to 4.

7 is an exemplary diagram of a configuration of an apparatus according to an embodiment.

The device 701 according to an embodiment includes a processor 702 and a memory 703. The processor 702 may include at least one of the devices described above with reference to FIGS. 1 to 6, or may perform at least one method described above with reference to FIGS. 1 to 6. Specifically, the device 701 includes a server 100; An embedded or attached computer included in the AR goggles 110; Alternatively, it may be an artificial neural network learning device. A person or organization using the device 701 may provide services related to some or all of the methods described above with reference to FIGS. 1 to 6.

The memory 703 may store information related to the above-described methods or a program in which methods described below are implemented. The memory 703 may be a volatile memory or a nonvolatile memory.

The processor 702 can execute a program and control the device 701. The code of a program executed by the processor 702 may be stored in the memory 703. The device 701 is connected to an external device (eg, a personal computer or a network) through an input/output device (not shown), and may exchange data through wired or wireless communication.

The device 701 may be used to train an artificial neural network or use the learned artificial neural network. The memory 703 may include a learning artificial neural network or a learned artificial neural network. The processor 702 may train or execute an artificial neural network algorithm stored in the memory 703. The apparatus 701 for training the artificial neural network and the apparatus 701 using the learned artificial neural network may be the same or may be separate.

The embodiments described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices, methods, and components described in the embodiments include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

As described above, although the embodiments have been described by the limited drawings, various technical modifications and variations can be applied based on those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments and claims and equivalents fall within the scope of the following claims.

Claims (5)

In a method of providing augmented reality content to an exhibition hall based on artificial intelligence,
The exhibition hall includes some areas, each of which has a corresponding relationship with at least one augmented reality content that has been previously databased,
The first characteristic level of the AR goggle wearer obtained from the AR goggle wearer is one of the pre-staged first characteristic levels,
Each augmented reality content corresponding to each partial area has pre-stepped versions,
A method of providing augmented reality content to an exhibition hall performed by a server,
Acquiring a first characteristic level of an AR goggle wearer;
Acquiring an image of an exhibition hall in front of the AR goggles;
Recognizing at least one partial area in the exhibition hall image;
Determining a version of the AR content for the AR goggle wearer corresponding to the partial area by applying the first characteristic level of the AR goggle wearer to the artificial intelligence;
Generating an augmented reality layer including a version of the augmented reality content;
Transmitting the augmented reality layer to the AR goggles;
Acquiring the age of the wearer of the AR goggles;
Determining whether the wearer of the AR goggles is an adult or a child based on the age of the wearer of the AR goggles;
If the AR goggles wearer is determined to be an adult, determining whether a child is included in a companion of the adult AR goggles wearer; And
When it is determined that the accompanying guest of the adult AR goggles wearer includes a child, matching the version of the augmented reality content provided to the adult AR goggle wearer and the accompanying child
Including,
The step of determining whether the wearer of the AR goggles is an adult or a child,
Defining a reference age;
Discriminating as children of AR goggles wearers under the reference age
Including,
The reference age is,
The higher the subject of the exhibition displayed in the exhibition hall is divided into difficult subjects according to the predefined level of difficulty,
As the exhibition theme is divided into easy subjects according to the predefined difficulty criterion,
The step of matching the version of the augmented reality content provided to the adult AR goggle wearer and the companion child,
Determining a version of an augmented reality content to be included in an augmented reality layer to be transmitted to the accompanying child's AR goggles by applying the first characteristic level of the companion child to the artificial intelligence; And
The version of the augmented reality content to be included in the augmented reality layer transmitted to the AR goggles of the adult AR goggles wearer, instead of the version of the augmented reality content for the adult AR goggles wearer determined based on the inference of the artificial intelligence, the accompanying Determining the version of the augmented reality content included in the augmented reality layer transmitted to the customer's AR goggles
Including,
The pre-staged first characteristic levels are levels in which the degree of “Christian devotion” of the AR goggle wearer is divided into stages,
The first characteristic level is one of levels from level 1 to level 6,
If the wearer of the AR goggles believes in another religion, the first characteristic level is classified as level 1,
When the AR goggles wearer answers that they do not have Christian faith, the first characteristic level is classified as level 2,
If the wearer of the AR goggles leaves church but does not go out every week, the first characteristic level is classified as level 3,
When the wearer of the AR goggles leaves the church every week, the first characteristic level is classified as level 4,
When the AR goggle wearer answers that the Christian faith is deep, the first characteristic level is classified as level 5,
When the AR goggles wearer performs missionary activity, the first characteristic level is classified as level 6,
How to provide augmented reality content to the exhibition hall.
The method of claim 1,
The lower the version of the augmented reality content, the more interesting and graphic the augmented reality content is,
As the version of the augmented reality content is higher, the character description and message of the augmented reality content are highlighted,
How to provide augmented reality content to the exhibition hall.
The method of claim 1,
The first time point precedes the second time point,
In the method of providing an augmented reality content to an exhibition hall at the second viewpoint,
Determining whether the wearer of the AR goggles re-appreciates the partial area;
Acquiring an age of the AR goggles wearer when it is determined that the AR goggles wearer is re-appreciating the partial area;
Determining whether the wearer of the AR goggles is a child based on the age of the wearer of the AR goggles;
If it is determined that the wearer of the AR goggles is not a child, determining a version of the augmented reality content referenced at the second time point as a version higher than the version of the augmented reality content referenced at the first time point; And
When the AR goggles wearer is determined to be a child, determining a version of the augmented reality content referenced at the second view point as the same version as the version of the augmented reality content referenced at the first view point;
Further comprising,
How to provide augmented reality content to the exhibition hall.
delete A system that provides augmented reality content to the exhibition hall based on artificial intelligence,
AR goggles worn by wearers who appreciate the exhibition hall; And
Server with augmented reality contents pre-database
Including,
The exhibition hall includes some areas, each of which has a corresponding relationship with at least one augmented reality content that has been previously databased,
The first characteristic level of the AR goggle wearer obtained from the AR goggle wearer is one of the pre-staged first characteristic levels,
Each augmented reality content corresponding to each partial area has pre-stepped versions,
The server,
Acquiring the first characteristic level of the wearer of the AR goggles,
The AR goggles,
Acquire an image of the exhibition hall in front of the AR goggles,
Transmit the exhibition hall image to the server,
The server,
Recognizing at least one partial area in the exhibition hall image,
Applying the first characteristic level of the AR goggle wearer to the artificial intelligence to determine a version of the augmented reality content for the AR goggle wearer corresponding to the partial area,
Creating an augmented reality layer including the version of the augmented reality content,
Transmitting the augmented reality layer with the AR goggles,
The AR goggles,
The augmented reality layer is overlaid on the exhibition hall image and output,
Furthermore, the server,
Acquiring the age of the wearer of the AR goggles,
Based on the age of the AR goggles wearer, it is determined whether the AR goggles wearer is an adult or a child,
When the AR goggles wearer is determined to be an adult, it is determined whether a child is included in the accompanying guest of the adult AR goggles wearer,
When it is determined that a child is included in the companion of the adult AR goggle wearer, the version of the augmented reality content provided to the adult AR goggle wearer and the companion child is matched,
The operation of the server to determine whether the wearer of the AR goggles is an adult or a child,
Define a baseline age,
To identify AR goggles wearers under the reference age as children
Includes actions,
The reference age is,
The higher the subject of the exhibition displayed in the exhibition hall is divided into difficult subjects according to the predefined level of difficulty,
As the exhibition theme is divided into easy subjects according to the predefined difficulty criterion,
The operation of matching the version of the augmented reality content provided to the adult AR goggle wearer and the companion child by the server,
Applying the first characteristic level of the accompanying child to the artificial intelligence to determine a version of the augmented reality content to be included in the augmented reality layer to be transmitted to the accompanying child's AR goggles,
The version of the augmented reality content to be included in the augmented reality layer transmitted to the AR goggles of the adult AR goggles wearer, instead of the version of the augmented reality content for the adult AR goggles wearer determined based on the inference of the artificial intelligence, the accompanying The version of the augmented reality content included in the augmented reality layer transmitted to the customer's AR goggles
Includes actions,
The pre-staged first characteristic levels are levels in which the degree of “Christian devotion” of the AR goggle wearer is divided into stages,
The first characteristic level is one of levels from level 1 to level 6,
When the AR goggles wearer believes in a different religion, the first characteristic level of the AR goggles wearer is classified as level 1,
When the AR goggles wearer answers that they do not have Christian faith, the first characteristic level of the AR goggles wearer is classified as level 2,
If the AR goggles wearer leaves church but does not go out every week, the first characteristic level of the AR goggles wearer is classified as level 3,
When the AR goggles wearer leaves the church every week, the first characteristic level of the AR goggles wearer is classified as level 4,
If the AR goggles wearer answers that the Christian faith is deep, the first characteristic level of the AR goggles wearer is classified as level 5,
When the AR goggles wearer performs missionary activity, the first characteristic level of the AR goggles wearer is classified as level 6,
A system that provides augmented reality content to the exhibition hall.

Images