KR102469244B1 - Method of collecting results of offline advertisement based on image processing - Google Patents

Abstract

The present invention relates to a method for collecting offline advertisement performance data based on image processing. The method for collecting offline advertisement performance, according to the present invention, comprises the steps of: (a) storing location information of a place where a first offline advertisement is performed and a target image obtained by photographing a place where the first offline advertisement is displayed; (b) extracting and storing features of the target image; (c) receiving data indicating that the first offline advertisement has been selected; (d) receiving a first image and location information where the first image was photographed; (e) performing template matching between a second image and the target image; (f) determining that image matching between the second image and the target image is successful when the template matching is successful; (g) performing feature matching between the second image and the target image when the template matching fails; (h) determining that the image matching between the second image and the target image has failed when the feature matching fails; (i) determining that the image matching between the second image and the target image is successful when the feature matching is successful; (j) providing a reward to a first user when the image matching between the second image and the target image is successful; and (k) determining the performance of the first offline advertisement. Therefore, it is possible to determine how many potential customers recognized an offline advertisement.

Description

How to collect offline advertising performance data based on image processing {METHOD OF COLLECTING RESULTS OF OFFLINE ADVERTISEMENT BASED ON IMAGE PROCESSING}

The present invention relates to a method for collecting offline advertisement performance data based on image processing.

Companies create and improve their brand image through advertisements, and spread product information to consumers to increase purchase desire. Since advertising is directly related to the increase in sales of a company, it will be said that it is a very important means for the operation and growth of a company. On the other hand, since the advertiser has to pay the cost to run the advertisement, it is necessary to evaluate the performance of the advertisement in order to select the optimal advertisement medium, advertisement method, and period.

Advertising media includes online media such as applications, SNS, and keyword search advertisements, and offline media such as outdoor billboards and paper advertisements. When an advertisement is published using an online medium, data on potential customers using the online medium in which the advertisement is displayed may be electronically collected, and it may be expected that the potential customer has seen the online medium in which the advertisement is displayed. On the other hand, when an advertisement is published through an offline medium, it is difficult to determine whether the potential customer recognizes the offline medium where the advertisement is exposed because the advertisement medium occupies a lower portion in a potential customer's field of view than the online advertisement. Therefore, it is difficult to determine how many potential customers recognized the offline advertisement.

An object of the present invention is to provide a method for collecting offline advertisement performance data based on image processing.

According to an embodiment of the present invention, a method for collecting offline advertisement performance data includes, by a processor of a server: (a) photographing location information of a place where a first offline advertisement is made and a place where the first offline advertisement is displayed. storing a target image in the memory of the server; (b) extracting features of the target image and storing them in the memory of the server; (c) receiving data indicating that the first offline advertisement has been selected from the first user terminal in a state in which a user interface corresponding to a plurality of offline advertisements including the first offline advertisement is provided to the first user terminal; ; (d) receiving a first image and information on a location where the first image was captured from the first user terminal; (e) performing template matching between a second image based on the first image and the target image; (f) determining that image matching between the second image and the target image is successful when the template matching is successful; (g) performing feature matching between the second image and the target image when the template matching fails; (h) determining that image matching between the second image and the target image has failed when the feature matching fails; (i) determining that image matching between the second image and the target image is successful when the feature matching is successful; (j) providing a reward to a first user corresponding to the first user terminal when image matching between the second image and the target image succeeds; and (k) determining a performance of the first offline advertisement based on information on a location where the first image was captured and performance of a reward.

According to an embodiment of the present invention, a method for collecting offline advertisement performance data includes obtaining an image of an offline advertisement taken from a user terminal, which is a potential customer, and matching the image acquired from the user terminal with an actual offline advertisement through image processing. When it is confirmed that the advertisement is performed, the user as a potential customer may be induced to authenticate that he or she has seen the advertisement by providing a reward to the user. Therefore, it can contribute to understanding how many potential customers recognized offline advertisements.

1 illustrates an offline advertisement performance data collection system according to various embodiments of the present invention.
2 illustrates components of a server included in an offline advertisement performance data collection system according to various embodiments of the present invention.
3 illustrates a method performed in an offline advertising performance data collection system, in accordance with various embodiments of the present invention.
4A shows an example of a target image according to various embodiments of the present invention.
4B illustrates an interface provided to a user terminal to acquire a first image, according to various embodiments of the present disclosure.
5 illustrates an interface provided to a user terminal to obtain a first image according to various embodiments of the present disclosure.

As used herein, "comprises" and/or "comprising" does not exclude the presence or addition of one or more other elements other than the recited elements. Various embodiments and terms used herein are not intended to limit the technical features described herein to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In the present specification, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish that component from other corresponding components, and may refer to that component in other respects (eg, importance or order) is not limited. When a (eg, first) element is referred to as being “connected” to another (eg, second) element, with or without the terms “functionally” or “communicatively,” it is This means that the certain component can be connected to the other component directly (eg, wired), wirelessly, or through a third component.

Various embodiments of the present specification may be implemented as software including one or more instructions stored in a storage medium (eg, internal memory or external memory) readable by a machine. For example, the processor of the device may call at least one command among one or more commands stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed herein may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or between two user terminals (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or steps among the aforementioned components may be omitted, or one or more other components or steps may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the steps performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the steps are executed in a different order, or omitted. or one or more other steps may be added.

1 illustrates an offline advertising performance data collection system 100, in accordance with various embodiments of the present invention. Referring to FIG. 1 , the offline advertisement performance data collection system 100 may include a server 110 and a plurality of user terminals 120 , 130 , and 140 .

The server 110 may store information about offline advertisements for which performance data is to be collected. The server 110 may store location information of a place where an offline advertisement for which performance data is to be collected and a target image of a place where an offline advertisement is displayed are captured. The server 110 may extract features of the target image and store the extracted features in a memory.

Each of the plurality of user terminals 120, 130, and 140 may be terminals used by general consumers who are targets of advertisements. 4A, 4B, and 5 show examples in which the user terminal is a smart phone, but the type of user terminal is not limited according to various embodiments.

The server 110 may communicate with a plurality of user terminals 120 , 130 , and 140 on which applications are installed. User terminals 120 , 130 , and 140 where the application is executed may provide a user interface for collecting data such as images from users in order to collect offline advertisement performance data. Users of the user terminals 120, 130, and 140 each take a picture of a place where an offline advertisement is displayed and transmits it to the server 110, and the server 110 captures the image obtained from the user terminal 120, 130, and 140 and the target Image matching can be performed.

When matching is successful, the server 110 may provide a reward to the user corresponding to the user terminal that provided the image used for successful matching.

Meanwhile, at least some of the users of the plurality of user terminals 120 , 130 , and 140 may be designated as friends through an application associated with the server 110 . The server 110 may store a friend list of users.

The server 110 may determine the performance of the offline advertisement based on the location information of the place where the offline advertisement to collect the reward performance and performance data and the location where the image provided from the user terminal was taken.

A detailed method for collecting offline advertisement performance data will be described later with reference to FIG. 3 .

2 illustrates components of a server included in an offline advertisement performance data collection system according to various embodiments of the present invention. Referring to FIG. 2 , the server 110 may include a communication circuit 210 , a processor 220 , and a memory 230 .

The communication circuit 210 may transmit information to or receive information from other electronic devices, and the type of communication supported by the communication circuit 210 is not limited.

The processor 220 performs an operation based on data received through the communication circuit 210 and/or data stored in the memory 230, and transmits at least a part of the result of the operation to another electronic device through the communication circuit 210. (For example, the user terminal (120, 130, 140)) or may be stored in the memory (230).

Hereinafter, that the processor 220 receives data from the user terminal or provides data to the user terminal means that the processor 220 receives data from the user terminal through the communication circuit 210 or data to the user terminal. It means that it controls the communication circuit 210 to transmit.

The memory 230 may store a result calculated by the processor 220 and data received through the communication circuit 210 . According to various embodiments, the memory 230 may store location information of a place where an offline advertisement for which performance data is to be collected is made, a target image of a place where the offline advertisement is displayed, and features of the target image. have. According to various embodiments, the memory 230 includes a first image received from the user terminal, features extracted from the first image, whether feature matching between the first image and the target image was successful, and whether the first image was captured. Location information, reward performance related to the target image, and offline advertisement performance information related to the target image may be stored. According to various embodiments, the memory 230 may store friend lists of users and whether or not users of user terminals agree to provide real-time location information.

3 illustrates a method performed in an offline advertising performance data collection system, in accordance with various embodiments of the present invention.

In step 310, the processor 220 of the server 110 may store the location information of the place where the first offline advertisement is made and the target image in the memory 230. The target image may be an image of a place where the first offline advertisement is displayed. According to various embodiments, the server 110 may obtain location information of a place where the first offline advertisement is made and a target image according to a manager's input.

In step 320, the processor 220 of the server 110 may extract features of the target image and store them in the memory 230. According to various embodiments, the method for extracting features is not limited. Any suitable feature detection technique may be used, including, for example, scale-invariant feature transform (SIFT), Oriented FAST and rotated BRIEF (ORB), speeded up robust features (SURF), KAZE, AKAZE, and the like.

In step 330, the processor 220 of the server 110 provides a user interface corresponding to a plurality of offline advertisements including the first offline advertisement to the first user terminal from the user terminal through the communication circuit 210. In , data indicating that the first offline advertisement has been selected may be received.

In step 340, the processor 220 of the server 110 may receive a first image and location information where the first image was captured through the communication circuit 210. The first image may be an image captured by the user terminal. Whenever a photo is taken, the user terminal may store location information of the user terminal in association with the captured image when the photo is taken.

In step 350, the processor 220 of the server 110 may determine a second image based on the first image, and perform template matching between the second image and the target image. A menu for selecting an image from among images stored in a memory of the user terminal and a menu for driving a camera application may be displayed on the user terminal in order to receive input of an image for performing matching with the target image. When the user selects a menu for selecting an image from among images stored in the memory, the processor 220 of the server 110 may determine that the second image is the same as the first image. When the user selects a menu for selecting an image from among images stored in the memory, the user terminal provides an interface for selecting one of the images stored in the memory of the user terminal, and when the user selects an image, the image shown in FIG. An interface such as a bar can be provided.

4A shows an example of a target image according to various embodiments of the present invention. Referring to FIG. 4A , a first offline advertisement area 420 may be included in the target image 410 .

An example of a screen displayed on the user terminal when the user selects a menu for selecting an image from among images stored in the memory and then selects a specific image from among the images stored in the memory is shown in FIG. 4B . Referring to FIG. 4B , an area 435 where an offline advertisement is displayed may be displayed on an image 415 selected by a user, but the size and slope of the area where the offline advertisement is displayed depends on the first offline advertisement of the target image 410. It may be different from area 420 . Accordingly, a translucent comparison image 425 representing the first offline advertisement area 420 of the target image 410 may be overlaid and displayed on the image 415 selected by the user.

The user terminal may provide an interface capable of rotating, enlarging, and reducing the image 415 . Referring to the translucent comparison image 425, the user rotates, enlarges, and reduces the image 415 so that the comparison image 425 and the area 435 where the offline advertisement is displayed within the selected image 415 match. can do. An image obtained by rotating, enlarging, or reducing the image 415 by the user may be transmitted to the server 110, and the server 110 may define the received image as a second image for performing image matching with the target image. can

An example of a screen displayed on a user terminal when a user selects a menu for driving a camera application is shown in FIG. 5 . Referring to FIG. 5 , as the camera of the user terminal is driven, an image 510 obtained by the camera and a photographing button 540 are displayed on the screen.

The image 510 obtained by the camera may include an area 520 where an offline advertisement is displayed, but the area 520 where an offline advertisement is displayed is the same as the first offline advertisement area 420 of the target image 410. may be different. Accordingly, a translucent comparison image 520 indicating the first offline advertisement area 420 of the target image 410 may be displayed overlaid on the image 510 acquired by the camera.

The user terminal may provide an interface capable of rotating, enlarging, and reducing the comparison image 520 . The user may rotate, enlarge, and reduce the comparison image 520 so that the area 530 where the offline advertisement is displayed in the comparison image 520 and the image 510 acquired by the camera match. When the comparison image 520 and the area 530 where the offline advertisement is displayed in the image 510 acquired by the camera match, the user may press the capture button 540 to input a capture command.

The user terminal transmits the image captured by the user to the server 110 as the first image, and indicates how much the comparison image 520 is rotated, enlarged, and reduced when the user captures the first image. and the reduction information may be transmitted to the server 110 .

The processor 220 of the server 110 may acquire the second image based on rotation, enlargement, and reduction information of the comparison image 520 and the first image. The processor 220 of the server 110 obtains the second image by performing an operation to correspond the rotated, enlarged, and reduced comparison image 520 to the first offline advertisement area 420 again to the first image. can In other words, the processor 220 of the server 110 may obtain the second image by performing an inverse operation of rotation, expansion, and reduction indicated by rotation, expansion, and reduction information on the first image.

Template matching is a digital image processing technology for finding a small part of an image that matches a template image. In the present invention, template matching between a target image and a second image means that the first offline advertisement area 420 in the target image ) may mean finding a part of the second image that matches ) in the second image.

If the template matching between the second image and the target image is successful, in step 370, the server 110 may provide a reward to the user corresponding to the user terminal. The method of providing a reward and the type of reward are not limited.

If template matching between the second image and the target image fails, in step 360, the processor 220 of the server 110 may perform feature matching between the second image and the target image. After performing feature matching, the processor 220 may store features included in the second image and whether or not the feature matching was successful in the memory 230 . Feature matching is a method of evaluating the identity of a target image and a second image based on how similar features included in the target image and features included in the second image are.

For feature matching, features of the target image extracted in step 320 may be used. The processor 220 of the server 110 may extract features of the second image in the same method as the method used to extract features of the target image in step 320 .

Various common methods may be used for feature matching, but in one embodiment, the processor 220 of the server 110 calculates weights for a pair of any two features among the features extracted from the target image, and calculates the calculated weights. Successful feature matching may be determined based on the weight and whether features exist in the second image.

일 때, 임의의 두 피쳐의 페어

에 대한 가중치

는 수학식 1과 같이 결정될 수 있다.Features extracted from the target image

When , a pair of any two features

weight for

Can be determined as in Equation 1.

함수는 수학식 2와 같이 정의된다.in Equation 1

The function is defined as in Equation 2.

는

가 추출되었으면서 타겟 이미지와의 피쳐 매칭에 성공한 이미지의 수를

가 추출된 이미지의 수로 나눈 값이다. 다양한 실시예에 따라서, 피쳐 매칭을 수행한 횟수가 충분히 많지 않을 때에는, 서버(110)는 제2 이미지로부터 피쳐를 추출하고, 피쳐 매칭 대신 관리자가 육안으로 매칭 여부를 판단하고, 매칭 성공 여부와 입력된 제2 이미지들로부터 추출된 피쳐들을 연관시켜 저장하는 것으로 피쳐 매칭 절차를 대체할 수 있다.

은 모든 페어들에 대한 score함수의 값의 평균,

는 모든 페어들에 대한 score함수의 값의 분산으로 정의될 수 있다.in Equation 2

Is

The number of images that successfully feature matched with the target image while being extracted

is the value divided by the number of extracted images. According to various embodiments, when the number of feature matching is not sufficiently large, the server 110 extracts a feature from the second image, and instead of feature matching, a manager visually determines whether or not the match is successful, and inputs whether the matching is successful or not. The feature matching procedure may be replaced by associating and storing features extracted from the extracted second images.

is the average of the values of the score function for all pairs,

can be defined as the variance of the value of the score function for all pairs.

Whether feature matching is successful may be determined using Equation 3.

는 상기 제2 이미지로부터 피쳐

가 추출되었으면 1, 상기 제1 이미지로부터 피쳐

가 추출되지 않았으면 0의 값을 갖는다. In Equation 3,

is a feature from the second image

If 1 is extracted, the feature from the first image

If is not extracted, it has a value of 0.

When the value of Equation 3 is less than 0, the processor 220 of the server 110 may determine that feature matching between the second image and the target image has failed. Conversely, the processor 220 of the server 110 may determine that feature matching between the second image and the target image is successful when the value of Equation 3 is equal to or greater than 0.

If feature matching is successful in step 360, step 370 may be performed. If feature matching fails in step 360, the method may end without providing a reward.

In step 380, the processor 220 of the server 110 may determine the performance of the first offline advertisement based on location information where the first image was captured and the reward performance. When there are multiple places where the first offline advertisement is displayed, the processor 220 determines which of the first offline advertisements displayed at which location is exposed to the user based on location information where the first image was captured. can For example, the processor 220 may confirm that the first offline advertisement at a location closest to the location information where the first image was captured among the places where the first offline advertisements are displayed has been exposed to the user.

The processor 220 of the server 110 determines how many consumers the first offline advertisement was exposed to and recognized as a whole, based on the results of rewarding by various user terminals, and if there are several places where the first offline advertisement was displayed. , It is possible to determine, as a performance of the first offline advertisement, where the advertisement displayed is most exposed and recognized.

Although not shown in FIG. 3, according to various embodiments, a plurality of user friend lists are stored in the memory 230 of the server 110, respectively, and users corresponding to each ID agree to provide real-time location information. whether can be stored.

If the first user agrees to provide real-time location information through his or her first user terminal, the server 110 receives the location information of the first user terminal in real time, and the location of the first user terminal is determined by the first user terminal. When another user who is a friend of ' is within a first distance from a place where an offline advertisement provided with a reward is displayed, a command to provide a push alarm may be sent to the first user terminal. The push alarm may indicate the name of the friend who received the reward, the reward provided to the friend, and the distance from the location of the first user terminal to a place where the corresponding offline advertisement is displayed.

Although not shown in FIG. 3 , according to various embodiments, when several users who are friends visit a place where an offline advertisement is displayed together, they do not need to authenticate themselves with their respective terminals, but if only one user authenticates, multiple users Everyone can get a reward.

After a specific offline advertisement is selected from among a plurality of offline advertisements through the first user terminal of the first user who has agreed to provide real-time location information, the first user terminal may display a friend list of the first user. The first user may select a friend to share a reward associated with the first image to be submitted by the first user. The first user terminal may transmit to the server 110 a first image, location information where the first image was captured, real-time location information of the first user terminal, and friends selected by the first user.

The server 110 may check whether the friend selected by the first user agrees to provide real-time location information by referring to the memory 230, and if the friend does not agree to provide real-time location information, the friend's terminal displays the real-time location information. A command to display a message querying whether or not to agree to provide information may be sent to the friend's terminal.

When the friend agrees to provide real-time location information, the server 110 may check whether the location of the friend's terminal is within a second distance from the location of the first user terminal. If the location of the friend's terminal is within a second distance from the location of the first user terminal, and image matching between the target image and the second image determined based on the first image submitted through the first user terminal succeeds, the server ( 110) may provide a reward to both the first user and a friend selected by the first user.

In the above method, multiple users who are friends do not need to authenticate each other with their respective terminals, but if only one person is authenticated, not only can multiple users receive rewards, but also induces users to agree to the provision of real-time location information. .

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features of the present invention. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (5)

The method for collecting offline advertising performance data, by the server's processor:
(a) storing location information of a place where a first offline advertisement is made and a target image of a place where the first offline advertisement is displayed are captured in a memory of the server;
(b) extracting features of the target image and storing them in the memory of the server;
(c) receiving data indicating that the first offline advertisement has been selected from the first user terminal in a state in which a user interface corresponding to a plurality of offline advertisements including the first offline advertisement is provided to the first user terminal; ;
(d) receiving a first image and information on a location where the first image was captured from the first user terminal;
(e) performing template matching between a second image based on the first image and the target image;
(f) determining that image matching between the second image and the target image is successful when the template matching is successful;
(g) if the template matching fails, performing feature matching between the second image and the target image, performing feature matching, and then storing features included in the second image and whether feature matching succeeds;
(h) determining that image matching between the second image and the target image has failed when the feature matching fails;
(i) determining that image matching between the second image and the target image is successful when the feature matching is successful;
(j) providing a reward to a first user corresponding to the first user terminal when image matching between the second image and the target image succeeds; and
(k) determining a performance of the first offline advertisement based on location information where the first image was captured and a reward performance
including,
The step (g) is:
extracting features of the second image;
calculating a weight for a pair of any two features among features extracted from the target image; and
Determining whether feature matching is successful based on the weight
including,
Features extracted from the target image

when,
Pair of any two features

weight for

Is

ego,

ego,

Is

The number of images that successfully feature matched with the target image while being extracted

is the value divided by the number of extracted images,

is the average of the values of the score function for all pairs,

is the variance of the value of the score function for all pairs,
The step of determining whether feature matching is successful based on the weight is:

Determining that feature matching has failed if the value of is less than 0, and determining that feature matching has succeeded if it is equal to or greater than 0;

is a feature from the second image

1 if r was extracted, the feature from the first image

A method with a value of 0 if is not extracted. delete According to claim 1:
providing, in the first user terminal, an interface through which one of the images stored in the first user terminal can be selected;
In the first user terminal, a translucent comparison image representing the first offline advertisement area in the target image is overlaid and displayed on a third image selected by the user, and the third image is rotated, enlarged, and reduced. providing an interface capable of; and
receiving, by the server, an image obtained by rotating, enlarging, and reducing the third image according to an input of the first user from the first user terminal, and defining the second image as the second image;
Including, method. According to claim 1:
In response to selection of a menu for driving a camera application in the first user terminal, a camera is driven, and on an image acquired according to the operation of the camera, a translucent image showing the first offline advertisement area in the target image is displayed. Overlaying and displaying one comparison image; and
providing an interface capable of rotating, enlarging, and reducing the comparison image in the first user terminal;
transmitting, at the first user terminal, rotation, enlargement, and reduction information of the first image and the comparison image obtained by a photographing command in a state in which the comparison image is displayed to the server;
Defining, in the processor of the server, the second image by rotating, enlarging, and reducing the first image based on rotation, enlargement, and reduction information of the comparison image
Including, method. According to claim 1:
storing friend lists of a plurality of users in the memory of the server, respectively;
Receiving real-time location information from the first user terminal;
When the location of the first user terminal is within a first distance from a place where the second offline advertisement is displayed, and there is a history of providing a reward to a friend of the first user with respect to the second offline advertisement, the first user terminal sending a command to provide a push notification to;
In the first user terminal, a friend list of the first user is displayed on the first user terminal so that the first user can select a friend to share a reward associated with the first image, and the friend list of the first user is displayed. receiving a selection for a first friend from the list;
In the processor of the server, confirming whether the first friend agrees to provide real-time location information;
In the processor of the server, if the first friend does not agree to provide real-time location information, a command to display a message querying whether or not to agree to provide real-time location information to the terminal of the first friend is transmitted to the first friend. Transmitting to the terminal of;
if the first friend agrees to provide real-time location information, checking whether the location of the terminal of the first friend is within a second distance from the location of the first user terminal; and
Providing a reward to a first user and a first friend when the location of the terminal of the first friend is within a second distance from the location of the first user terminal and the image matching between the second image and the target image succeeds step
Further comprising a method.

Images