KR102420503B1 - Method and device for providing perfomance contents based on augmented reality - Google Patents

Abstract

The present invention, according to an embodiment, is performed by a server, augmented reality-based performance content providing method. (a) providing information on the content to a user terminal in which a specific program or application is installed, and receiving location information of the user terminal from the user terminal; (b) when the user terminal arrives at a preset location, the server provides guide information on the content that can be viewed at the preset location to the user terminal through the location information received from the user terminal to do; (c) the user terminal receives an image of an object located in front of the user photographed through the camera shooting mode, and the image of the object in the received object image corresponds to a pre-stored AR (Augmented Reality) marker image determining whether (d) when the image of the object corresponds to the pre-stored AR (Augmented Reality) marker image, the user gives a command to display the predetermined content on the object image received from the user terminal in augmented reality transmitting to the terminal; may include.

Description

Augmented reality-based performance content providing method and device {METHOD AND DEVICE FOR PROVIDING PERFOMANCE CONTENTS BASED ON AUGMENTED REALITY}

The present invention relates to a method and apparatus for providing performance content based on augmented reality, and more particularly, photographing an object through a user terminal, and an image of the photographed object corresponding to an AR (Augmented Reality) marker pre-stored in a server In this case, the server relates to a technology for displaying predetermined content in augmented reality on an object image received by a user terminal.

After the release of Google Glass in 2013, with the Pokemon Go craze in 2016 and the commercialization of 5G in 2019, expectations for the growth of the immersive content market including AR (Augmented Reality) are increasing day by day. According to a report by Statista, a market research firm, the AR market is expected to grow at an average annual rate of about 60.3% from 2017, forming a global market of about $198.2 billion by 2025. As a result, the volume of AR devices is also expected to increase by an average of 42% per year.

Global market forecasting organizations such as Gartner and PwC predict that AR technology will become a universal technology within 3 to 5 years and spread as a high value-added service in various industries including the ICT ecosystem. The fact that domestic and foreign telecom operators, including existing ICT companies such as Apple, Facebook, Google, Samsung, LG, etc., are investing manpower and funds in the AR market and launching new services one after another, can also be seen as proof of this pink prospect. .

In Korea, Samsung Electronics and LG Electronics have participated in AR and VR (Virtual Reality) devices in the AR market, but they are expected to challenge the AR and VR glass market in the future. In addition, the three domestic telecommunication companies are considering the AR market as a new platform to replace smartphones along with the spread of 5G. that is emerging as a problem. Therefore, the development of content that can reach more customers is emerging as the most important along with the development of hardware, and several operators are acting as a platform to distribute augmented reality services, and at the same time, are making various efforts to develop content that can be consumed on the platform. .

The present invention is to solve the problems of the prior art described above, when a user shoots an object through a user terminal, and the image of the photographed object corresponds to an AR (Augmented Reality) marker pre-stored in the server, the server By displaying predetermined content in augmented reality on the object image received by the terminal, the user can view the predetermined content in augmented reality through the user terminal, and information on other content related thereto is easily provided can do.

However, the technical problem to be achieved by an embodiment of the present invention is not limited to the above-described technical problem, and other technical problems may exist.

As a technical means for achieving the above-described technical task, the augmented reality-based performance content providing method performed by the server. (a) providing information on the content to a user terminal in which a specific program or application is installed, and receiving location information of the user terminal from the user terminal; (b) when the user terminal arrives at a preset location, the server provides guide information on the content that can be viewed at the preset location to the user terminal through the location information received from the user terminal to do; (c) the user terminal receives an image of an object located in front of the user photographed through the camera shooting mode, and the image of the object in the received object image corresponds to a pre-stored AR (Augmented Reality) marker image determining whether (d) when the image of the object corresponds to the pre-stored AR (Augmented Reality) marker image, the user gives a command to display the predetermined content on the object image received from the user terminal in augmented reality transmitting to the terminal; Including, the content may be a performance image, or an introductory image of an object or place, and a plurality of the content may have a single story structure.

Also, the information on the content may include information on a place where the content can be viewed and information on the order of the content.

In addition, the step (a) may further include the step of receiving, by the user terminal, information on the content for each location from the server through a guide message.

In addition, the guide message may include a message for guiding the order of the locations where the content can be viewed according to the order information of the content so that the user can view the content according to the order of the content.

In addition, in step (b), when the user arrives at the preset location according to the guide message, the user terminal checks the location information and provides guide information for the content that can be viewed at the preset location. It may include the step of providing.

In addition, the guide information may include information about the existence of the content that can be viewed at the preset location, a method of viewing the content, and information on the content in the next order associated with the content.

In addition, the step (c) further comprises extracting a feature point that is a feature of the image of the object in the received object image, and matching the feature point with a preset AR marker image,

In addition, in step (c), the object image may be an image of a specific space indoors or outdoors, or an image of a booklet or a specific object.

In addition, the step (d) generates the predetermined content corresponding to the size and angle of the object in the image of the object received from the user terminal, and generates a command to display the content in augmented reality on the user terminal. It may further include the step of transmitting to the user terminal.

In addition, after step (d), when any one of the contents is reproduced in augmented reality on the user terminal, providing the other location information to the user terminal so that other contents of the following story can be viewed may include more.

In addition, there is provided an apparatus for providing a method for providing performance content based on augmented reality, comprising: a memory in which a program related to a method for providing performance content based on augmented reality is stored; and a processor executing the program. Including, wherein the processor provides information on the content to a user terminal in which a specific program or application is installed by executing the program, and receives location information of the user terminal from the user terminal, wherein the user terminal is When arriving at a set location, through the location information received from the user terminal, guide information on the content that can be viewed at the preset location is provided to the user terminal, and the user terminal uses the camera shooting mode Receives an image of an object located in front of a photographed user, determines whether an image of the object in the received object image corresponds to a pre-stored AR (Augmented Reality) marker image, and the image of the object is stored in the pre-stored AR (Augmented Reality) When it corresponds to a marker image, a command to display the predetermined content in augmented reality on the object image received from the user terminal is transmitted to the user terminal, but the content is a performance image or an object Alternatively, an introduction video for a place may be included, and a plurality of the contents may have a single story structure.

According to the present invention, an object is photographed through the camera shooting mode of the user terminal and transmitted to the server, and the server can provide augmented reality content to the user terminal when the received image and the pre-stored AR marker correspond. Through this, the user can be provided with augmented reality-based performance image content.

In the present invention, in providing performance content to a user terminal, it is possible to not only remove spatial constraints and time constraints, but also generate revenue through various channels from the standpoint of performance content producers, and perform performance content and indoor It is possible to create a business model linked with various exhibitions and art works, including cultural assets and cultural assets.

1 is a diagram illustrating a system configuration of an augmented reality-based performance content providing method according to an embodiment of the present invention.
2 is a diagram showing the configuration of a server according to an embodiment of the present invention.
3 is a flowchart of a method of providing augmented reality-based performance content to a user terminal according to an embodiment of the present invention.
FIG. 4 is an exemplary diagram showing that a performance image is provided to a user terminal when a pre-stored AR marker and an AR marker image in a specific space correspond to each other according to an embodiment of the present invention.
FIG. 5 is an exemplary diagram showing that a performance image is provided to a user terminal when a pre-stored AR marker and an AR marker image of a booklet image correspond to each other according to an embodiment of the present invention.
6 is an exemplary diagram showing that a performance image provided to a user terminal has a single story structure, according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . Also, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

In this specification, a "part" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. In addition, one unit may be implemented using two or more hardware, and two or more units may be implemented by one hardware. Meanwhile, '~ unit' is not limited to software or hardware, and '~ unit' may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors. Thus, as an example, '~' denotes components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. The functions provided in the components and '~ units' may be combined into a smaller number of components and '~ units' or further separated into additional components and '~ units'. In addition, components and '~ units' may be implemented to play one or more CPUs in a device or secure multimedia card.

The "user terminal" referred to below may be implemented as a computer or portable terminal that can access a server or other terminal through a network. Here, the computer is, for example, a laptop, desktop, laptop, VR HMD (eg, HTC VIVE, Oculus Rift, GearVR, DayDream, PSVR, etc.) equipped with a web browser (WEB Browser), etc. may include Here, VR HMD is for PC (e.g., HTC VIVE, Oculus Rift, FOVE, Deepon, etc.), mobile (e.g., GearVR, DayDream, Storm Horse, Google Cardboard, etc.) Independently implemented Stand Alone models (eg Deepon, PICO, etc.) are included. A portable terminal is, for example, a wireless communication device that guarantees portability and mobility, and includes not only a smart phone, a tablet PC, a wearable device, but also Bluetooth (BLE, Bluetooth Low Energy), NFC, RFID, and ultrasound (Ultrasonic). , infrared, Wi-Fi, Li-Fi, etc. may include various devices equipped with a communication module. In addition, "network" refers to a connection structure capable of exchanging information between each node, such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), and the Internet. (WWW: World Wide Web), wired and wireless data communication networks, telephone networks, wired and wireless television networks, and the like. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, ultrasound Communication, Visible Light Communication (VLC), LiFi, and the like are included, but are not limited thereto.

Hereinafter, "content" may be a performance image or various types of images and images including an introductory image of an object or place, and a plurality of contents may have a single story structure.

Hereinafter, with reference to FIG. 1, the system configuration of the augmented reality-based performance content providing method according to an embodiment of the present invention will be described in general as follows.

According to an embodiment of the present invention, the system 10 may include a server 100 and a user terminal 200, and the server 100 may be communicatively connected to the user terminal 200 through a wired/wireless network. .

At this time, the server 100 may receive user information including the user's location information from the user terminal 200, and based on the provided location information of the user, information on contents available around the user terminal 200 can provide

According to an embodiment of the present invention, the server 100 receives an image captured through the camera shooting mode of the user terminal 200, and a specific space in the received image or an AR (Augmented Reality) marker in which a booklet image is pre-stored. It may be determined whether it corresponds to the image 400 .

When a specific space or booklet image corresponds to a pre-stored AR (Augmented Reality) marker image 400 , the server 100 displays predetermined content on the image received from the user terminal 200 in augmented reality. The command is transmitted to the user terminal 200 , and the user terminal 200 can view the received predetermined content.

In addition, the server 100 matches and stores different content for each of a plurality of specific spaces or booklet images, and a plurality of content may have a single story structure, and any one content may be converted into augmented reality on the user terminal 200 . When playback is completed, guide information including other spatial information or booklet image information may be provided so that other content of a subsequent story can be viewed.

For example, when the user takes a picture of the signboard of Gwanghwamun, which is the entrance to Gyeongbokgung through the user terminal, through the camera shooting mode of the user terminal 200, content introducing Gwanghwamun in front of Gwanghwamun may be played. When the content playback is complete, you can provide the location of Geunjeongjeon and an image of the signboard along with the message “If you go to Geunjeongjeon of Gyeongbokgung Palace, you can hear more detailed explanations about Gyeongbokgung”. When the user moves to Geunjeongjeon through the provided location and the image of the signboard and takes a photo of the signboard of Geunjeongjeon through the camera shooting mode of the user terminal 200, contents containing the description of Geunjeongjeon of Gyeongbokgung can be played.

2 is a diagram showing the configuration of the server 100 according to an embodiment of the present invention.

Referring to FIG. 2 , the server 100 includes a communication module 110 , a memory 120 , and a processor 130 .

In detail, the communication module 110 provides a communication interface necessary to provide a transmission/reception signal between the server 100 and the user terminal 200 in the form of packet data by interworking with a communication network. Furthermore, the communication module 110 may serve to receive a data request from the terminals and transmit data in response thereto.

Here, the communication module 110 may be a device including hardware and software necessary for transmitting and receiving signals such as control signals or data signals through wired/wireless connection with other network devices.

The memory 120 records a program for performing the augmented reality-based performance content providing method. In addition, the processor 130 performs a function of temporarily or permanently storing the processed data. Here, the memory 120 may include magnetic storage media or flash storage media, but the scope of the present invention is not limited thereto.

The processor 130 controls the entire process of providing augmented reality-based performance content as a kind of central processing unit. Each step performed by the processor 130 will be described later with reference to FIG. 3 .

Here, the processor 130 may include all kinds of devices capable of processing data, such as a processor. Here, the 'processor' may refer to a data processing device embedded in hardware, for example, having a physically structured circuit to perform a function expressed as a code or an instruction included in a program. As an example of the data processing device embedded in the hardware as described above, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated (ASIC) circuit) and a processing device such as a field programmable gate array (FPGA), but the scope of the present invention is not limited thereto.

Hereinafter, with reference to FIG. 3, a method for providing performance content based on augmented reality according to an embodiment of the present invention will be described in detail.

First, content is matched for each specific space or booklet image in a plurality of indoor or outdoor spaces and stored in the server 100, and the plurality of content may be composed of one story. (S800)

For example, in Gwanghwamun for entering Gyeongbokgung Palace, the contents about the changing of the guard ceremony are matched and stored in the server 100, and the contents about the enthronement ceremony of the king can be stored in Geunjeongjeon of Gyeongbokgung, a plurality of contents such as the history of Joseon It can be composed of one story under the theme.

The server 100 may provide information on content to the user terminal 200 in which a specific program or application is installed, and may receive the user's location information from the user terminal 200 . (S810)

The server 100 may provide the user terminal 200 with information about content that the user terminal 200 can use. At this time, the information on the content provided to the user terminal 200 may include space (place) information where the content can be used and information on the order of each content.

Accordingly, the user terminal 200 desiring to use the content may use the plurality of contents in order through the order information and spatial information of each content provided from the server 100 .

In addition, the server 100 may receive the location information from the user terminal 200, and provide a guide message for a specific space in which the content that the user terminal 200 wants to use is matched, and the content through the guide message. Information including location information, directions, and information on nearby convenience facilities may be provided with matching.

At this time, the server 100 is continuously provided with location information from the user terminal 200, and when the user terminal 200 arrives at a specific space where the content is matched, the user terminal 200 provides information about the specific space. Guide information can be provided. The guide information relates to a method for receiving content matched to a specific space, and may include information such as taking a picture of a specific space or photographing an object located in a specific space, and the specific method is not limited.

The user terminal 200 may execute a camera photographing mode to photograph a specific space or booklet image in front, and transmit the photographed image to the server 100 . (S820)

Through the camera shooting mode of the user terminal 200 in which a specific program or specific application is installed, an image of a specific space or booklet in front may be photographed, and this may be transmitted to the server 100 .

In this case, the specific space is a specific space indoors or outdoors, and may be an object or an image of an object installed in a specific space. For example, it may be a signboard installed in front of a museum or art gallery or a large image.

The server 100 may determine whether an image of an object in the received image corresponds to an AR (Augmented Reality) marker image 400 for pre-stored content. (S830)

When the server 100 corresponds to the image received from the user terminal 200 and the pre-stored AR marker image 400 , the server 100 may transmit a command so that the content is displayed in augmented reality in the user terminal 200 . (S840)

When the reproduction of any one content is completed, the server 100 provides place information for a specific space or page information of a booklet image to the user terminal 200 according to the order information of the content so that subsequent content can be used. can (S850)

At this time, the server 100 provides a guide message for place information for a specific space provided according to the order information to the user terminal 200, and the guide message includes place information, route guidance, and nearby convenience where the content is matched. May include information on facility guidance.

As an additional embodiment, the user terminal 200 may execute a specific program or application provided by the server 100 and receive a viewing content guide through this. At this time, the user terminal 200 may be provided with guide information on what kind of content there is for each offline place, and when the user terminal 200 clicks on a specific content, the server 100 corresponds to the user terminal 200 . Information including directions to use the content can be provided. After that, when the user visits a place for using a specific content, the server 100 determines that the place where the user terminal 200 is currently located is based on GPS through a specific program or application installed in the user terminal 200 . If it is checked whether there is a place, and a designated background image is captured through the camera shooting mode of the user terminal 200 , AR content matching the corresponding place can be provided from the server 100 .

When the user terminal 200 completes using the content, a guide to the next place to use the next content is provided to the user terminal 200, and the user visits the next place and repeats the process described in the previous paragraph. can run

Hereinafter, a case in which the pre-stored AR marker 400 image corresponds to a specific space or booklet image may be described with reference to FIGS. 4 and 5 .

Hereinafter, a “performance video” in FIGS. 4 and 5 is a type of the above-described content, and may be content including an image containing an introduction or explanation at a specific place and an image with a background of the specific place.

4 is an exemplary diagram illustrating an example in which a performance image 510 is reproduced on the user terminal 200 when an image is located in a specific space.

The user takes an image located in a specific space through the camera shooting mode of the user terminal 200 and transmits it to the server 100, and the server 100 stores an AR marker ( 400), the performance association 510 may be provided to the user terminal 200 .

For example, if the present invention is practiced at the entrance to Gyeongbokgung, an episode about Gyeongbokgung. A guide can explain explanations such as history by appearing through augmented reality, and as an additional embodiment, an augmented reality control command identifier that can select a language or a character selection before the performance image 510 is played appears first. Thus, when the user transmits an input to the server 100 through the control command identifier, the server 100 may provide the performance image 510 to the user terminal 200 in response to the input of the control command identifier.

In addition, when the performance image 510 is finished playing, the server 100 provides the user terminal 200 with place information for a specific space so that the user terminal 200 can reproduce the subsequent performance image 510 . can do.

In a further embodiment, when a specific object exists in a specific space or outdoor space, and the AR image is content reproduced in association with the specific object, the server 100 may By comparing the size of the object appearing in the performance image 510 provided to the terminal 200, and correcting the size of the performance image 510 to correspond to the location and image size of the object, on the user terminal 200 It is possible to provide a performance image 510 corresponding to the size and angle of an object in the photographed image.

For example, in an AR video of a performance in which a bench is actually built in an outdoor space and the main character sitting on a bench in a park is talking with someone else, the video of the main character in the AR video sitting on the bench and the video are recorded on the user terminal screen. SYNC such as size and angle with the losing bench image must match. Therefore, the terminal first measures the size and angle of the actual photographed object displayed on the screen of the user terminal, and matches the size and direction of the character's sitting motion on the performance image 510 with each other. It is determined whether or not the performance image 510 modified by adjusting the size of the character in the AR image to be displayed can be provided to the user terminal 200 in augmented reality.

5 is an exemplary diagram showing a case in which the pre-stored AR marker 400 image corresponds to the booklet image.

The user takes a picture of the booklet through the camera shooting mode of the user terminal 200 and transmits it to the server 100, and the server 100 stores the image transmitted from the user terminal 200 in advance with the AR marker 400 and In a corresponding case, the performance association 510 may be provided to the user terminal 200 .

In this case, the performance image 510 may be a performance image 510 including an image containing an introduction or explanation of the booklet image and an image with the booklet image as a background.

As an additional embodiment, the user terminal 200 may execute a specific program or application provided by the server 100 and receive a viewing content guide through this. When the user terminal 200 clicks a specific content and opens a pop-up book matching the corresponding content, executes the camera shooting mode of the user terminal 200 through a specific program or application to shoot a designated background image, the server 100 ) from the AR content matching the background image.

After that, when the user terminal 200 completes using the content, a guide for page information for using the next content is provided to the user terminal 200, and the user opens the pop-up book of the guided page and in the previous paragraph The above process may be repeated.

In a further embodiment, the invitation image may be provided to the user terminal 200 through the invitation image. For example, in the case of carrying out the present invention through a wedding invitation image, the user terminal 200 shoots the wedding invitation image and transmits it to the server 100, the performance image 510 with the image of the wedding invitation as a background to the user terminal (200) can be transmitted. When the reproduction of the performance image 510 is completed, the server 100 transmits the participation status identifier to the user terminal 200, and the user may transmit the attendance status identifier to the server 100 through the user terminal 200. . In this case, the provided attendance identifier may be a response to accepting or not attending the invitation to the event. Through this, the host can check whether the user is able to attend the event or not.

With reference to FIG. 6 , it may be described that a plurality of contents have a single story structure.

6 is an exemplary diagram showing that the performance image 510 provided to the user terminal 200 has a single story structure, according to an embodiment of the present invention.

For example, in the performance image 510 shown in FIG. 6 , the characters are the same but the content is different according to a specific space. It can be confirmed that a plurality of contents (performance video) matched according to a specific space have a single story structure.

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

Although the methods and systems of the present invention have been described with reference to specific embodiments, some or all of their components or operations may be implemented using a computer system having a general purpose hardware architecture.

The foregoing description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and likewise components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

10: Augmented reality-based performance content providing method system
100: server
110: communication module
120: memory
130: processor
200: user terminal
400: AR marker image
510: AR performance video

Claims (12)

A method of providing performance content based on augmented reality, performed by the server.
(a) providing information on the content to a user terminal in which a specific program or application is installed, and receiving location information of the user terminal from the user terminal;
(b) when the user terminal arrives at a preset location, the server provides guide information on the content that can be viewed at the preset location to the user terminal through the location information received from the user terminal to do;
(c) the user terminal receives an image of an object located in front of the user photographed through the camera shooting mode, and the image of the object in the received object image corresponds to a pre-stored AR (Augmented Reality) marker image determining whether and
(d) when the image of the object corresponds to the pre-stored AR (Augmented Reality) marker image, the user gives a command to display the predetermined content on the object image received from the user terminal in augmented reality transmitting to the terminal; including,
Step (d) is
The step of generating the predetermined content corresponding to the size and angle of the object in the image of the object received from the user terminal, and transmitting a command to display in augmented reality on the user terminal to the user terminal further including,
When the predetermined content is a performance video,
Determining whether the size and angle of the object received from the user terminal, the size of the character on the performance image, and the direction of the sitting motion of the character match each other,
Adjusting the size and direction of the character on the performance image to correspond to the size and angle of the object received from the user terminal,
A method of providing performance content based on augmented reality. The method of claim 1,
The content is a performance image, or includes an introductory image about an object or place, and a plurality of the content has a single story structure,
A method of providing performance content based on augmented reality. The method of claim 1,
The information on the content will include information on a place where the content can be viewed and information on the order of the content,
A method of providing performance content based on augmented reality. The method of claim 1,
The step (a) is,
The user terminal will further include the step of receiving information on the content for each location from the server through a guide message,
A method of providing performance content based on augmented reality. 5. The method of claim 4,
The guide message includes a message for guiding the order of the location where the user can view the content according to the order information of the content, so that the user can view the content according to the order of the content,
A method of providing performance content based on augmented reality. 5. The method of claim 4,
Step (b) is,
When the user arrives at the preset location according to the guide message, the user terminal checks the location information and provides guide information on the content that can be viewed at the preset location,
A method of providing performance content based on augmented reality. The method of claim 1,
The guide information includes information on the existence of the content that can be viewed at the preset location, a method of viewing the content, and information on the content in the next order associated with the content,
A method of providing performance content based on augmented reality. The method of claim 1,
Step (c) is,
Extracting a feature point that is a feature of the image for the object in the received object image, and matching the feature point with a preset AR marker image,
A method of providing performance content based on augmented reality. The method of claim 1,
In step (c),
The object image is an image about a specific space indoors or outdoors, or an image of a booklet or a specific object,
A method of providing performance content based on augmented reality. delete 4. The method of claim 3,
After step (d),
When any one of the contents is reproduced in augmented reality on the user terminal, the method further comprising the step of providing the other location information to the user terminal so that other contents of the following story can be viewed,
A method of providing performance content based on augmented reality. In the providing apparatus for providing a method for providing performance content based on augmented reality,
a memory in which a program related to an augmented reality-based performance content provision method is stored; and
a processor executing the program; includes,
The processor performs the method according to the execution of the program,
the method
(a) providing information on the content to a user terminal in which a specific program or application is installed and receiving location information of the user terminal from the user terminal;
(b) when the user terminal arrives at a preset location, providing guide information on the content that can be viewed at the preset location to the user terminal through the location information received from the user terminal;
(c) whether the user terminal receives an image of an object located in front of the user photographed through the camera shooting mode, and whether the image of the object in the received object image corresponds to a pre-stored AR (Augmented Reality) marker image judging; and
(d) when the image of the object corresponds to the pre-stored AR (Augmented Reality) marker image, the user gives a command to display the predetermined content on the object image received from the user terminal in augmented reality transmitting to the terminal; including,
Step (d) is
The step of generating the predetermined content corresponding to the size and angle of the object in the image of the object received from the user terminal, and transmitting a command to display in augmented reality on the user terminal to the user terminal further including,
When the predetermined content is a performance video,
Determining whether the size and angle of the object received from the user terminal, the size of the character on the performance image, and the direction of the sitting motion of the character match each other,
Adjusting the size and direction of the character on the performance image to correspond to the size and angle of the object received from the user terminal,
Augmented reality-based performance content providing device.

Images