KR102443016B1 - Apparatus and method for implementing advertising using augmented technology - Google Patents

Abstract

According to an embodiment of the present invention, there is provided a method for implementing an advertisement using augmentation technology, performed by a user terminal, the method comprising: (a) receiving an AR interface from a server; (b) reproducing real-time image information captured through the camera of the user terminal through the AR interface, and transmitting the image information and location information to a server; (c) when a specific object appears on the image information, receiving an AR graphic corresponding to the specific object from the server, inserting it into the image information being reproduced through the AR interface, and playing it; and (d) providing an advertisement interface corresponding to a specific object from the server when the user touches and inputs the AR graphic; the AR graphic is a graphic icon representing a specific object or a preset movement may refer to any one of three-dimensional graphics performing

Description

Apparatus and method for implementing advertisement using augmentation technology

The present invention relates to an apparatus and method for performing advertising using reality augmentation technology. More specifically, it relates to a technology for recognizing when a specific object is photographed in a user terminal, applying augmented reality graphics related to the specific object to an image being photographed by a camera, and performing advertisements using this.

Due to the continuous growth of the recent travel market, it is estimated that by 2020, the size of the travel market will grow to about 60 trillion won at home and abroad. As a result, the number of tourists is also increasing, and as of 2019, there were about 40 million domestic travelers and about 20 million overseas travelers.

Generations in their 20s and 30s, who have a lot of classes who prefer improvised travel, face many difficulties in unfamiliar tourist destinations. For example, time poor people are always pressed for time, or it is difficult to find a store that provides products or services at low or reasonable prices.

Although the communication environment has recently developed a lot, it is not easy for travelers to travel to these unfamiliar areas to obtain a place for the relevant place through improvised travel. In addition, even when searching for necessary information using a mobile phone at a travel destination, there is a problem in that it is difficult to find information such as where a desired product or service can be obtained, or at what price, and it takes a long time.

The present invention is to solve the problems of the prior art described above, and when a user visits an unfamiliar area or travel destination, using reality augmentation technology to recommend or advertise a product or service located in the area is implemented. The purpose.

However, the technical task to be achieved by the present embodiment is not limited to the above-described technical task, and other technical tasks may exist.

As a technical means for achieving the above technical problem, according to an embodiment of the present invention, in a method for implementing an advertisement using augmentation technology, performed by a user terminal, (a) receiving an AR interface from a server to do; (b) reproducing real-time image information captured through the camera of the user terminal through the AR interface, and transmitting the image information and location information to a server; (c) when a specific object appears on the image information, receiving an AR graphic corresponding to the specific object from the server, inserting it into the image information being reproduced through the AR interface, and playing it; and (d) providing an advertisement interface corresponding to a specific object from the server when the user touches and inputs the AR graphic; the AR graphic is a graphic icon representing a specific object or a preset movement may refer to any one of three-dimensional graphics performing

In addition, before step (b) receives map data corresponding to the location information from the server, step (b) additionally provides a map interface on the AR interface based on the map data and location information, and the map interface is It is possible to display the location of the terminal and a specific object.

In addition, in step (b), the server may increase the recognition rate of a specific object by transmitting the time, angle, and location information at which the image information is captured to the server.

In addition, step (c) may set a position where the AR graphic is inserted based on the position, viewpoint, and angle of a specific object on the image information.

In addition, based on the distance between the location information and a specific object, the size and location of the AR graphic inserted into the image information can be adjusted.

Also, in step (c), when a specific object appears on the image information, an indicator for emphasizing the specific object may be displayed on the image information.

Also, the indicator is provided in the form of a border having a preset size that can surround a specific object appearing in the image information, and AR graphic having the shape of an icon corresponding to the specific object may be located in any one area of the indicator.

In addition, when a plurality of specific objects appear on the image information and the distance between each specific object is less than or equal to a preset distance, the AR interface overlaps one area of each indicator and displays an icon in the form of an icon corresponding to each specific object. AR graphics can be displayed using an augmentation technology that is displayed spaced apart from each other by more than a preset interval so as not to overlap with each other.

In addition, if the AR graphic is implemented in the form of an icon, a preset image of a specific object may be used as an image representing the icon, and the distance between the user terminal and the specific object may be displayed in one area of the icon.

In addition, when AR graphics are implemented as three-dimensional graphics, when a specific object appears in image information, a preset three-dimensional AR graphics having a polygonal shape can be reproduced on image information.

Also, in step (d), if the purpose of the advertisement interface is advertisement for a specific object, an additional interface for using a service corresponding to the advertisement may be displayed on the AR interface.

In addition, when the service corresponding to the advertisement is performing any one of a sale or a special sale event, the image of the AR graphic having the shape of an icon may be emphasized according to a preset method.

In addition, in step (d), when at least two or more AR graphics are continuously input within a preset time, a comparison interface may be provided that compares and shows advertisements corresponding to each AR graphic.

In addition, the comparison interface may present advertisements of each specific object at the same time, but any one of menu information and price information for using the service provided by the specific object may be presented to be arranged at the same height and spacing on the display of the user terminal. have.

In addition, before step (b), the server pre-stores landmarks and location information of landmarks located within a preset range of a specific object, and in step (b), the user terminal recognizes a specific object on the image information. City, a landmark located within a preset range from a specific object is searched for, and when the landmark is found, the location information of the user terminal may be corrected based on the distance and angle between the user terminal, the specific object, and the landmark.

In addition, the landmark calculates a preset feature point from a plurality of images uploaded by the user terminal to the server, the server labels and stores the image having a common feature point for each image, and the number of matching stored images is a preset number If , the location of the image is regarded as a landmark and can be stored.

In addition, a method for implementing an advertisement using an augmentation technology performed by a server, the method comprising the steps of: (a) providing an AR interface to a user terminal; (b) receiving image information and location information from the user terminal, providing an AR graphic corresponding to a specific object on the image information to the user terminal; and (c) when the user terminal inputs AR graphics, providing an advertisement interface corresponding to a specific object; including, wherein the user terminal receives the AR interface from the server, and a real-time image captured through the camera of the user terminal Information is played back through the AR interface, video information and location information are transmitted to the server, when a specific object appears on the video information, AR graphic corresponding to the specific object is received from the server, and the video being played through the AR interface When the user touches and inputs the AR graphic, the server provides an advertisement interface corresponding to the specific object, and the AR graphic is a graphic icon representing a specific object or performs a preset movement. 3D graphics, and the advertisement interface may refer to an interface including detailed information on a specific object and information on any one of advertisements.

According to the present invention, when a user visits an unfamiliar area or travel destination, it is possible to implement a platform capable of recommending or advertising products or services located in the corresponding area using reality augmentation technology.

In addition, in connection with tourism, festivals, local and alley commercial areas, it can be used as a means to promote the area. For example, in connection with large festivals and music festivals (Jarasum), where more than 100,000 people visit during a specific period, publicity and information about the festival can be provided through augmented technology, and linkage with local franchises can be improved. This can be an easy way to find the store.

1 is a diagram illustrating a system for implementing an advertisement using augmentation technology, according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of a user terminal for implementing advertisements using augmentation technology, according to an embodiment of the present invention.
3 is an operation flowchart illustrating a process of implementing an advertisement using an augmentation technology, according to an embodiment of the present invention.
4 is a diagram illustrating an example of an AR interface according to an embodiment of the present invention.
5 is a diagram illustrating an example of an advertisement interface according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, this means that other components may be further included, rather than excluding other components, unless otherwise stated.

The following examples are detailed descriptions to help the understanding of the present invention, and do not limit the scope of the present invention. Accordingly, an invention of the same scope performing the same function as the present invention will also fall within the scope of the present invention.

1 is a diagram illustrating a system for implementing an advertisement using augmentation technology, according to an embodiment of the present invention.

Referring to FIG. 1 , a system for implementing advertisements using augmentation technology may include a user terminal 100 and a server 200 . In addition, each device in the drawing is interconnected through a communication network.

According to an embodiment of the present invention, the user terminal 100 receives the AR interface from the server 200 in order to implement advertisements using augmentation technology.

In this case, the AR interface may be a type of interface provided through the user terminal 100 to enable the user to use an advertisement implementation service using augmentation technology.

When the user generates real-time image information by capturing a distance in real time through a camera provided in the user terminal 100 , the AR interface displays it through the display module of the user terminal 100 .

In addition, the user terminal 100 transmits image information and location information generated in real time to the server 200 .

Thereafter, when a specific object appears on the image information, the user terminal 100 receives the AR graphic corresponding to the specific object from the server 200 and includes it in the image information being displayed through the AR interface.

In this case, the specific object means an area or an object corresponding to a target target to which the augmentation technology is applied, located at a distance photographed by the user terminal 100 . For example, the specific object may correspond to a store, a structure representing a corresponding area, an event hall, and the like.

Also, AR graphic may refer to graphic data implemented by conventional augmentation technology. Accordingly, in the present invention, AR graphic may refer to any one of a graphic icon for representing a specific object or a 3D graphic performing a preset movement. For example, if implemented in the form of a graphic icon, it may be implemented as a sign representing a store or a photo of a specific object to inform the location of a specific object or perform interaction through a user's input. In addition, when AR graphic is implemented as 3D graphic data, it may be implemented as a graphic in the form of a polygon that takes a preset motion in harmony with the landscape in the image information.

As a further embodiment, when the user terminal 100 additionally captures the user's hand, interaction between the AR graphic and the user's hand may be performed through a contact method. In this case, the user can operate the application without touching the screen of the user terminal 100 .

If the user performs an input through a method of touching an AR graphic displayed on the display module of the user terminal 100 (AR interface), the server 200 displays an advertisement interface corresponding to a specific object to the user terminal 100 It is characterized in that it is provided as

Here, the advertisement interface may refer to an interface including any one of detailed information on a specific object and advertisement. For example, when a user touch-inputs an AR graphic corresponding to a store, prices or information on products sold in the store, a reservation and purchase interface, and the like are provided.

According to an embodiment of the present invention, the user terminal 100 may correspond to a terminal used by a user to receive a service for implementing advertisements using augmentation technology.

The user terminal 100 may receive the AR interface from the server 200 , and provide image information captured through the AR interface to the user, or may transmit it to the server 200 .

In addition, AR graphics for a specific object may be received from the server 200 and included in the image information being displayed through the AR interface.

In an optional embodiment, the display module of the user terminal 100 is implemented in an input/output touch method, and when a user touches and inputs an AR graphic included in image information, an advertisement interface corresponding to a specific object from the server 200 is displayed. can be provided

An application for implementing advertisements using augmentation technology may be driven as an application embedded in the user terminal 100 or may be an application downloaded from an application distribution server and installed in the user terminal 100 to be driven.

In addition, the user terminal 100 refers to a communication terminal capable of using a terminal application in a wired/wireless communication environment. Here, the user terminal 100 may be a user's portable terminal. In FIG. 1, the user terminal 100 is illustrated as a smart phone, which is a type of a portable terminal, but the spirit of the present invention is not limited thereto. can be borrowed

In more detail, the user terminal 100 may be a handheld computing device (eg, PDA, email client, etc.), any type of mobile phone (eg, smart phone or AR glasses, etc.), or any other type of device. It may include any form of computing or communication platform, but the invention is not limited thereto.

According to an embodiment of the present invention, the server 200 may provide a service for implementing advertisements to the user terminal 100 using augmentation technology.

The server 200 may provide an AR interface to the user terminal 100 and receive image information and location information from the user terminal 100 .

In addition, when a specific object appears on the image information provided by the user terminal 100 , the AR graphic corresponding to the specific object is provided to the user terminal 100 .

Finally, when the user terminal 100 inputs AR graphics, an advertisement interface corresponding to a specific object is provided.

Meanwhile, the communication network serves to connect the user terminal 100 and the server 200 . That is, the communication network refers to a communication network that provides an access path so that the user terminal 100 can transmit and receive data after accessing the server 200 . The communication network is, for example, wired networks such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), ISDNs (Integrated Service Digital Networks), etc., or wireless networks such as wireless LANs, CDMA, Bluetooth, and satellite communication. However, the scope of the present invention is not limited thereto.

2 is a diagram illustrating a configuration of a user terminal for implementing advertisements using augmentation technology, according to an embodiment of the present invention.

Referring to FIG. 2 , according to an embodiment of the present invention, the user terminal 100 includes a communication module 110 , a memory 120 , a processor 130 , a display module 140 , a camera module 150 , and a database ( 160) can be configured.

In detail, the communication module 110 provides a communication interface necessary to provide a transmission/reception signal between the user terminal 100 and the server 200 in the form of packet data in connection with a communication network. Furthermore, the communication module 110 may perform a role of receiving a data request from the server 200 and transmitting data as a response thereto.

Here, the communication module 110 may be a device including hardware and software necessary for transmitting and receiving signals such as control signals or data signals through wired/wireless connection with other network devices.

In the memory 120, a program for performing a method of implementing an advertisement using an augmentation technology is recorded. In addition, the processor 130 performs a function of temporarily or permanently storing the processed data. Here, the memory 120 may include magnetic storage media or flash storage media, but the scope of the present invention is not limited thereto.

The processor 130 is a kind of central processing unit and controls the entire process of implementing the advertisement using augmentation technology. Each step performed by the processor 130 will be described later with reference to FIG. 3 .

Here, the processor 130 may include all kinds of devices capable of processing data, such as a processor. Here, the 'processor' may refer to a data processing device embedded in hardware, for example, having a physically structured circuit to perform a function expressed as a code or an instruction included in a program. As an example of the data processing device embedded in the hardware as described above, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated (ASIC) circuit) and a processing device such as a field programmable gate array (FPGA), but the scope of the present invention is not limited thereto.

The display module 140 performs a function of displaying an execution screen of an application implementing an advertisement using augmentation technology. Accordingly, an embodiment corresponding to the AR interface, image information, AR graphic, and advertisement interface through the display module 140 will be described later with reference to FIGS. 4 and 5 .

The camera module 150 may correspond to a camera provided in the user terminal 100 . Image information for using the augmentation technology may be generated in real time through the camera module 150 .

As an additional embodiment, pre-captured image information may be used instead of image information generated by the camera module 150 in real time.

The database 160 may store information for the user terminal 100 to implement advertisements using augmentation technology. For example, it may include at least one of user information (or identification information), data necessary to implement AR graphics, and map data.

Although not shown in FIG. 2, some of user information (or identification information), AR graphic data, and map data may be stored in a database (not shown) physically or conceptually separated from the database 160 .

As an additional embodiment, the database 160 may be excluded from the user terminal 100 , and may be implemented in a form in which the server 200 receives all data necessary to implement an advertisement using augmentation technology in real time.

3 is an operation flowchart illustrating a process of implementing an advertisement using an augmentation technology, according to an embodiment of the present invention.

Referring to FIG. 3 , in order to implement an advertisement using augmentation technology, the user terminal 100 receives an AR interface from the server 200 ( S301 ).

The user terminal 100 reproduces image information through the AR interface, and transmits image information and location information generated in real time to the server 200 (S302).

Before step S302 , the user terminal 100 may receive map data corresponding to the location information from the server 200 . Thereafter, in step S302 , the user terminal 100 may additionally provide a map interface on the AR interface based on the map data and location information. In this case, the map interface may display the location of the user terminal 100 and the specific object, thereby guiding the user to check the map interface and move to which area to discover the specific object.

Also, as a further embodiment, when a user inputs a specific object displayed on the map interface, an advertisement interface corresponding to the input specific object may be received from the server 200 . Through this, the user can use information or services on a specific object without going to the specific object.

In addition, the user terminal 100 may transmit the time, angle, and location information at which the image information is captured to the server 200 together, so that the server 200 may increase the recognition rate of a specific object in the image information.

For example, a specific object disposed on a street may have a different appearance of a specific object photographed in image information depending on a direction in which the camera of the user terminal 100 takes a picture or a distance between the user terminal 100 and a specific object. .

In addition, although location information is generally set based on GPS technology included in the user terminal 100 , a Kalman filter and a vision algorithm are applied to accurately measure the location where the user is currently located. In detail, the data calculated by the GPS and the sensor included in the user terminal 100 are corrected through ARKit, ARcore, and positioning algorithms. In addition, the location can be corrected in consideration of the user's data usage. For example, when a user currently uses mobile data of the user terminal 100, a location in which the corresponding data is used or a location of advertisement data may be used, and data (user data) and It is possible to correct the location information by using the information on the place where the payment is performed using the user terminal 100 or a credit card.

Through this, according to the present invention, it is possible to provide customized information or advertisement about a place on AR according to the user's interest and movement.

Accordingly, the server 200 increases the recognition rate by calculating the shape of a specific object through additional information such as the time point, angle, and location information at which the image information is captured from the user terminal 100 .

When a specific object appears on the image information, the user terminal 100 displays the AR graphic on the image information (S303).

At this time, if the server 200 successfully recognizes the specific object, the user terminal 100 determines the position where the AR graphic is inserted based on the position of the specific object on the image information, the viewpoint and the angle with the user terminal 100 . will be set

In addition, the user terminal 100 may adjust and reproduce the size and position of the AR graphic inserted into the image information based on the distance between the location information and the specific object. For example, the AR graphic of a specific object located far away from the user terminal 100 is implemented in a small size, and the size increases as it approaches the user terminal 100, which induces the user to feel a sense of perspective. .

When the user terminal 100 receives an AR graphic input from the user in a touch manner, the user terminal 100 receives an advertisement interface corresponding to a specific object from the server 200 (S304).

At this time, in the present specification, the display module 140 of the user terminal 100 is based on being implemented in the form of a touch input/output pad. Thus, the user will be able to interact by touching the AR graphic on the display.

Accordingly, when AR graphics are input in step S304, an advertisement interface corresponding to a specific object may be provided. In this case, in the case of an advertisement interface, the name of the advertisement is used in the specification of the present application, but since it may include text description or media information for a specific object, the type of information displayed by the advertisement interface limits the scope of the present invention. I never do that. For example, in the advertisement interface, when a specific object is a landmark object, detailed description or related event information may be provided. A reservation interface for use is included.

In step S304, if the advertisement interface of the user terminal 100 performs an advertisement role for a specific object, an additional interface for using a service corresponding to the advertisement may be displayed on the AR interface.

If a specific object corresponds to a store or a company that provides a specific service, and the service corresponding to the advertisement is performing either a sale or a special sale event, an AR graphic image that is implemented in the form of an icon to emphasize a specific object may be emphasized according to a preset method. For example, it can be emphasized through a size, color, and shape different from the AR graphic corresponding to another specific object displayed on the image information.

In addition, when at least two or more AR graphics are continuously input from the user within a preset time, a comparison interface may be provided that compares and shows advertisements corresponding to each AR graphic.

In this case, the comparison interface may present advertisements of each specific object at the same time, but any one of menu information and price information for using the service provided by the specific object may be presented to be arranged at the same height and spacing on the display of the user terminal. have. Through this, the user can compare the prices of menus (or services) provided by the two stores at a glance.

The location information of the user terminal 100 is generated based on the conventional GPS technology. However, since location information generated in this way may be unclear, in the present invention, the following method of correcting location information may be applied to precisely perform an interaction between the user terminal 100 and a specific object.

Before step S302, the server 200 may pre-store a landmark located within a preset range of a specific object and location information of the landmark. Thereafter, when recognizing a specific object on the image information, the user terminal 100 searches for a landmark located within a preset range from the specific object. If the landmark is found, the current location information of the user terminal 100 is corrected based on the distance and angle between the user terminal 100, a specific object, and the landmark. At this time, the method to be corrected may be applied to the conventional triangulation technique.

At this time, in the method of selecting a landmark, the user terminal 100 calculates a preset feature point from a plurality of images uploaded to the server 200, and the server 200 selects an image having a common feature point for each image. Matching is saved after labeling. Thereafter, when the number of matching stored images exceeds a preset number, the server 200 regards the location of the image as a landmark.

After step S304, when a user purchases a product or uses a service based on the advertisement interface, the server 200 may collect and analyze customer data. In detail, for the service of the present invention provided in a specific space or region or the specific AR content advertisement provided by the present invention, user behavior data can be collected and analyzed to perform targeted marketing based on the location. . This can be carried out simultaneously not only in Korea but also around the world, and it can have the effect of increasing customer participation and increasing sales of products or services.

4 is a diagram illustrating an example of an AR interface according to an embodiment of the present invention.

Referring to FIG. 4 , AR graphics 401a to 401c and a map interface 402 can be identified in Figures (a) to (c).

Referring to the figure (a), the AR graphic 401a may be implemented in the form of an icon to display the positions of specific objects to the user.

In this case, the user can interact with information corresponding to a specific object by touching the AR graphic 401a.

In this case, the AR graphic 401a implemented in the form of an icon may use a preset image of a specific object as an image representing the icon, and a distance between the user terminal and the specific object may be displayed in one area of the icon.

The map interface 402 is used for the user terminal 100 to apply the location information being measured in real time to the map data received from the server 200 by the user terminal 100 to notify the current user about the area in which a specific object is located. can be used as

In the case of the figure (a), the map interface 402 has a circle shape, but the location and shape of the map interface 402 may be provided in various ways, so that the scope of the present invention is not limited.

Looking at the figure (b), the AR graphic 401b may be an example in which the shape of an icon is emphasized more than usual to indicate a store where a sale is in progress.

In the figure (b), the AR graphic 401b was implemented in a way that the discount rate is expressed in numbers, but there are various ways to emphasize the representative product or event by making it an icon, or by emphasizing it in a larger size than other AR graphic 401b nearby. method can be applied.

Referring to the figure (c), the AR graphic 401c may be an example composed of 3D graphic data performing a preset movement.

The AR graphic 401c may be reproduced naturally when the user terminal 100 enters a specific area, or may be reproduced upon a touch input of a specific object.

At this time, when a specific object appears in the image information, the AR graphic 401c implemented as a three-dimensional graphic considers at least any one of a viewpoint, an angle, and a position of a specific object to be photographed of a camera that captures image information. AR graphic having the shape of a three-dimensional polygon is reproduced on the image information.

Accordingly, the viewpoint, size, and position of the AR graphic 401c may be adjusted and reproduced according to the structure and position of the surrounding environment in the image information.

Although not shown in the drawing, when a specific object appears on the image information, an indicator for emphasizing the specific object may be displayed on the image information.

In this case, the indicator is provided in the form of a border having a preset size that can surround a specific object appearing in the image information, and an AR graphic having the shape of an icon corresponding to the specific object may be located in any one area of the indicator.

If a plurality of specific objects appear on the image information and the distance between each specific object is less than or equal to a preset distance, the AR interface may be displayed by overlapping one area of each indicator. At this time, the AR graphic in the form of an icon corresponding to each specific object is displayed spaced apart from each other by a predetermined interval or more so as not to overlap each other, thereby preventing an error in the user's touch input.

5 is a diagram illustrating an example of an advertisement interface according to an embodiment of the present invention.

Referring to FIG. 5 , an advertisement interface 403 in which a user can touch and input an AR graphic 401a advertisement on image information to confirm is shown.

The advertisement interface 403 shown in the drawing may be an example of a price list in which a specific object corresponds to a store, and a product sold in the store is displayed.

In this case, the advertisement interface 403 may be implemented in various forms according to the characteristics of a specific object.

In addition, when the user continuously touches at least two of the AR graphics 401a appearing on the image information within a preset time, it is possible to compare and show advertisements corresponding to each AR graphic 401a. A comparison interface may be provided instead of the advertisement interface 403 .

In addition, the comparison interface presents advertisements of each specific object together on the display of the user terminal 100 . In this case, any one of menu information and price information for using a service provided by a specific object may be presented to be arranged at the same height and spacing on the display of the user terminal 100 .

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

Although the methods and systems of the present invention have been described with reference to specific embodiments, some or all of their components or operations may be implemented using a computer system having a general purpose hardware architecture.

The foregoing description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and likewise components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

100: user terminal 200: server
401a, 401b, 401c: AR Graphics
402: map interface
403 advertising interface

Claims (17)

A method of implementing an advertisement using augmentation technology, performed by a user terminal, the method comprising:
(a) receiving the AR interface from the server;
(b) playing real-time image information captured through the camera of the user terminal through the AR interface, and transmitting the image information and location information to the server;
(c) when a specific object appears on the image information, receiving an AR graphic corresponding to the specific object from the server, inserting it into the image information being reproduced through the AR interface, and playing it; and
(d) providing an advertisement interface corresponding to the specific object from the server when the user touches and inputs the AR graphic;
including,
The AR graphic means any one of a graphic icon for representing the specific object or a 3D graphic performing a preset movement,
The advertisement interface refers to an interface including any one of detailed information and advertisements on the specific object,
before step (b)
The server pre-stores a landmark located within a preset range of the specific object and location information of the landmark,
Step (b) is
When the user terminal recognizes the specific object on the image information, it searches for the landmark located within a preset range from the specific object, and when the landmark is found, the user terminal, the specific object and the distance between the landmark and Based on the angle, correcting the location information of the user terminal,
Step (c) is
Set a position where the AR graphic is inserted based on the position, viewpoint, and angle of the specific object on the image information,
Step (d) is
If the purpose of the advertisement interface is advertisement for the specific object, an additional interface for using a service corresponding to the advertisement is displayed on the AR interface, and the service corresponding to the advertisement is either a sale or a special sale event. is being performed, the image of the AR graphic having the shape of the icon is emphasized through a size, color, and shape different from the AR graphic corresponding to another specific object displayed on the image information,
Based on the distance between the location information and the specific object, the size and location of the AR graphic inserted into the image information is adjusted, but as the distance between the user terminal and the specific object gets closer, the size of the AR graphic increases. A method of implementing an advertisement using augmentation technology. The method of claim 1,
before step (b)
receiving map data corresponding to the location information from the server;
Step (b) is
Based on the map data and location information, a map interface is additionally provided on the AR interface, and the map interface displays the location of the user terminal and the specific object. Way. The method of claim 1,
Step (b) is
A method of implementing an advertisement using augmentation technology, which transmits the time point, angle, and location information at which the image information is taken together to the server to increase the recognition rate of the specific object of the server. delete delete The method of claim 1,
Step (c) is
When the specific object appears on the image information, an indicator for emphasizing the specific object is displayed on the image information, the method of implementing an advertisement using augmentation technology. 7. The method of claim 6,
The indicator is provided in the form of a border having a preset size that can surround a specific object appearing in the image information,
A method of implementing advertisements using augmentation technology, wherein the AR graphic having the shape of an icon corresponding to the specific object is located in any one area of the indicator. 8. The method of claim 7,
When a plurality of the specific objects appear on the image information and the distance between each of the specific objects is less than or equal to a preset distance, the AR interface overlaps and displays a region of each of the indicators, but corresponds to each of the specific objects The method of implementing advertisements using augmentation technology, wherein the AR graphic in the form of an icon is displayed spaced apart from each other by more than a preset interval so as not to overlap with each other. The method of claim 1,
When the AR graphic is implemented in the form of an icon, the preset image of the specific object is used as an image representing the icon, and the distance between the user terminal and the specific object is displayed in one area of the icon. How to use technology to implement advertising. The method of claim 1,
When the AR graphic is implemented as a 3D graphic,
When the specific object appears in the image information, it has a preset three-dimensional polygon shape in consideration of at least any one of a viewpoint, an angle, and a position of the specific object to be photographed. A method of implementing an advertisement using augmentation technology, which is to reproduce the AR graphic on the image information. delete delete The method of claim 1,
Step (d) is
When at least two or more of the AR graphics are continuously input within a preset time, a comparison interface that compares and shows advertisements corresponding to each AR graphic is provided. 14. The method of claim 13,
The comparison interface presents advertisements of each specific object at the same time, but any one of menu information and price information for using the service provided by the specific object is presented to be arranged at the same height and spacing on the display of the user terminal A method of implementing an advertisement using augmentation technology. delete The method of claim 1,
The landmark calculates a preset feature point from a plurality of images uploaded by the user terminal to the server, and the server labels and stores the image having the feature point common to each image, and the number of matching stored images When the number exceeds a preset number, the location of the image is regarded as the landmark and stored, a method of implementing an advertisement using augmentation technology. A method of implementing an advertisement using augmentation technology, performed by a server, the method comprising:
(a) providing an AR interface to the user terminal;
(b) receiving image information and location information from the user terminal, providing an AR graphic corresponding to a specific object on the image information to the user terminal; and
(c) providing an advertisement interface corresponding to the specific object when the user terminal inputs the AR graphic;
including,
The user terminal receives the AR interface from the server, reproduces real-time image information photographed through the camera of the user terminal through the AR interface, transmits the image information and location information to the server, and the image information When a specific object appears on the screen, AR graphic corresponding to the specific object is received from the server, inserted into the image information being reproduced through the AR interface, and played, and when the user touches and inputs the AR graphic, An advertisement interface corresponding to the specific object is provided from the server, and the AR graphic means either a graphic icon for representing the specific object or a 3D graphic performing a preset movement, and the advertisement The interface refers to an interface including any one of detailed information and advertisements on the specific object,
before step (b)
The server pre-stores a landmark located within a preset range of the specific object and location information of the landmark,
Step (b) is
When the user terminal recognizes the specific object on the image information, it searches for the landmark located within a preset range from the specific object, and when the landmark is found, the user terminal, the specific object and the distance between the landmark and Based on the angle, correcting the location information of the user terminal,
Step (c) is
setting a position where the AR graphic is inserted based on the position, viewpoint, and angle of the specific object on the image information,
Step (d) is
If the purpose of the advertisement interface is advertisement for the specific object, an additional interface for using a service corresponding to the advertisement is displayed on the AR interface, and the service corresponding to the advertisement is either a sale or a special sale event. is being performed, the image of the AR graphic having the shape of the icon is emphasized through a size, color, and shape different from the AR graphic corresponding to another specific object displayed on the image information,
Based on the distance between the location information and the specific object, the size and location of the AR graphic inserted into the image information is adjusted, but as the distance between the user terminal and the specific object gets closer, the size of the AR graphic increases. A method of implementing an advertisement using augmentation technology.

Images