KR20180020654A - Method for providing communication service based on augment reality - Google Patents

Abstract

The present invention relates to a method for providing communication based on AR information sharing. The method comprises: a step of receiving an AR event activating an AR interface from a search terminal; a step of collecting a position of the search terminal on the basis of the received AR event; a step of extracting at least one search target terminal which is positioned within a preset radius of the collected position or in which coordinates are set; a step of mapping the information, position, and coordinates of the extracted search target terminal, and outputting them on an AR screen of the search terminal; a step of transmitting, when receiving a selection event of selecting any one among the information of the search target terminal in the search terminal, the selection event of the search terminal to the selected search target terminal; and a step of forming, when receiving a response event from the selected search target terminal in response to the selection event, a communication channel between the search target terminal and the search terminal.

Description

METHOD FOR PROVIDING COMMUNICATION SERVICE BASED ON AUGMENT REALITY [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of providing AR-based information communication, and more particularly, to a method of linking online communication and information sharing offline by combining reality and augmented reality.

In recent years, online communication has progressed smoothly due to popularization of smart terminals and technology development. However, since online communication is only online, it is rarely connected to offline, and online communication is connected offline, Because it is known as a shortcut to this, a tool that connects online communication offline is required.

At this time, a method of linking online communication offline is performed by using augmented reality. In this connection, in Korean Patent Laid-Open Publication No. 2011-0072438 (published on June 29, 2011), which is a prior art, a character of a person who is located in an area in a direction indicated by a screen is superimposed on a photographing screen, A communication service with a user can be provided.

However, even if a person is shown overlapping, it may be difficult to grasp what kind of person has a character when a large number of people exist, and when the character is selected to enable chatting, It is unlikely that the chat will continue.

An embodiment of the present invention allows online communication to be carried out through an augmented reality through an augmented reality, enabling contact and conversation with various people, and outputting online information on an AR screen, It is possible to provide a communication providing method based on AR information sharing, which enables a new view of the real world by combining the world and the virtual world, and enables advertisement and information of a completely different viewpoint to be shared with the public relations contents. It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

As a technical means for achieving the above technical object, an embodiment of the present invention is a method for receiving an AR event that activates an AR interface from a search terminal, collecting a position of a search terminal based on a received AR event Extracting at least one retrieved terminal located within a predetermined radius of the collected position or having coordinates set therein, mapping information, position and coordinates of the retrieved at least one retrieved terminal, and outputting the retrieved information on the AR screen of the retrieving terminal Transmitting a selection event of a search terminal to a selected search terminal when a selection event for selecting any one of information of at least one search terminal is received at the search terminal, , The communication channel between the called terminal and the searching terminal is received And a step of sex.

According to any one of the above-described objects of the present invention, it is possible to allow online communication to be carried out in offline communication through the augmented reality, enable contact and conversation with various people, Thereby realizing a new view of the real world by combining the real world and the virtual world, and sharing advertisements and information of totally different viewpoints on the publicized contents.

FIG. 1 is a block diagram for explaining an AR information sharing-based communication providing system according to an embodiment of the present invention.
FIG. 2 is a block diagram for explaining an AR information sharing-based communication providing server shown in FIG. 1. FIG.
3 is a view for explaining an embodiment in which an AR information sharing-based communication providing service according to an embodiment of the present invention is provided.
4 is a view for explaining an embodiment in which an AR information sharing-based communication providing service according to another embodiment of the present invention is provided.
FIG. 5 is a flowchart illustrating an AR information sharing-based communication providing method according to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

The terms "about "," substantially ", etc. used to the extent that they are used throughout the specification are used in their numerical value or in close proximity to their numerical values when the manufacturing and material tolerances inherent in the stated meanings are presented, Accurate or absolute numbers are used to help prevent unauthorized exploitation by unauthorized intruders of the referenced disclosure. The word " step (or step) "or" step "does not mean" step for. &Quot;

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by a terminal, a device, or a device may be performed instead in a server connected to the terminal, device, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal, device or device connected to the server.

In this specification, some of the operations or functions described in the mapping or matching with the terminal are mapping or matching the unique number of the terminal, which is the identification data of the terminal, or the identification information of the individual . ≪ / RTI >

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram for explaining an AR information sharing-based communication providing system according to an embodiment of the present invention. Referring to FIG. 1, an AR information sharing-based communication providing system 1 includes at least one search terminal 100, an AR information sharing-based communication providing server 300, at least one search terminal 400, The information providing terminal 500 of FIG. However, the AR information sharing-based communication providing system 1 of FIG. 1 is only an embodiment of the present invention, and thus the present invention is not limited to FIG.

At this time, the respective components of FIG. 1 are generally connected through a network 200. For example, as shown in FIG. 1, at least one search terminal 100 is connected to an AR information sharing-based communication providing server 300 and at least one search terminal 400 through a network 200 . Here, the AR information sharing-based communication providing server 300 is connected to at least one search terminal 100, at least one search terminal 400 and at least one information providing terminal 500 through the network 200 . The at least one piconet terminal 400 may be connected to the AR information sharing based communication providing server 300 through the network 200 and may be connected to the AR information sharing based communication providing server 300 ) Or directly connected to at least one search terminal 100. Also, at least one information providing terminal 500 can be connected to the AR information sharing-based communication providing server 300 through the network 300.

Here, the network 200 refers to a connection structure capable of exchanging information between nodes such as a plurality of terminals and servers. One example of such a network 200 is a 3rd Generation Partnership Project (3GPP) network, A 5th Generation Partnership Project (5GPP) network, a World Interoperability for Microwave Access (WIMAX) network, an Internet, a LAN (Local Area Network), a Wireless LAN (Local Area Network) But are not limited to, a wide area network (PAN), a personal area network (PAN), a Bluetooth network, a satellite broadcast network, an analog broadcast network, and a digital multimedia broadcasting network. The at least one search terminal 100, the AR information sharing-based communication providing server 300, the at least one search terminal 400 and the at least one information providing terminal 500 shown in FIG. It is not intended to be construed in a limiting sense.

At least one search terminal 100 may be a terminal of a user using an AR information sharing-based communication providing service. At least one search terminal 100 may be a chat partner or a terminal for searching for information. At this time, the chatting partner may be based on the distance, may be based on the tag or metadata mapped and stored in the searcher, or may be based on other keywords. Also, at least one search terminal 100 may be a terminal for searching for information. At this time, at least one search terminal 100 transmits the three-dimensional coordinates of the at least one search terminal 100 and the shooting screen to the AR information sharing-based communication providing server 300 when searching for a chat partner or information, And may be a terminal that receives search results in response thereto. At this time, at least one search terminal 100 may be a terminal that receives AR (Augment) or VR (Virtual Reality) when performing a search or receiving a search result. Also, at least one search terminal 100 may be a terminal that outputs a VR screen to at least one VR device (not shown) interlocked with at least one search terminal 100 when outputting the VR screen.

Here, the at least one search terminal 100 may be implemented as a computer capable of connecting to a remote server or terminal through the network 200. Here, the computer may include, for example, a notebook, a desktop, a laptop, and the like on which a WEB browser is installed. At this time, at least one search terminal 100 may be implemented as a terminal capable of connecting to a remote server or terminal through the network 200. [ At least one search terminal 100 may be a wireless communication device that is guaranteed to be portable and mobility, for example, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular) (PHS), a PDA (Personal Digital Assistant), an IMT (International Mobile Telecommunication) -2000, a CDMA (Code Division Multiple Access) -2000, a W-CDMA A handheld based wireless communication device such as a handheld device, a smartphone, a smartpad, a tablet PC, and the like.

The AR information sharing-based communication providing server 300 transmits the AR information sharing-based communication providing service web page, program, application, app page and user interface to at least one search terminal 100 and at least one search terminal 400, Lt; / RTI > The AR information sharing-based communication providing server 300 may be configured to receive at least one of the at least one search terminal 100 and at least one of the at least one search terminal 100, The server 100 may be a server that receives a photographing image photographed by the photographing apparatus 100 and transmits the received information and a search result corresponding to the photographing screen to at least one search terminal 100. The AR information sharing-based communication providing server 300 may be configured such that when an acceptance response to a chat request of at least one search terminal 100 is received from at least one search terminal 400, 100 and the at least one called terminal 400 may form a chat channel. In addition, the AR information sharing-based communication providing server 300 authenticates and registers an identity when an event for scanning a business card occurs in at least one search terminal 100 or at least one search terminal 400, When the search event occurs, it may be a server that outputs the information of the business card scanned in response to the search event. At this time, the AR information sharing-based communication providing server 300 may be realized by a computer capable of connecting to a remote server or terminal through the network 200. [ Here, the computer may include, for example, a notebook, a desktop, a laptop, and the like on which a WEB browser is installed.

At least one search terminal 400 may be a search terminal of at least one search terminal 100 or a terminal that registers information matching the keyword. Therefore, the at least one search termination terminal 400 may be a terminal that is searched by the search of at least one search termination terminal 100. At least one of the searched terminals 400 may be a terminal that registers its own information in the AR information sharing-based communication providing server 300, or may be a terminal that sets conditions for a searcher capable of searching. In addition, when at least one of the search terminals 100 receives a chat request via the AR information sharing-based communication providing server 300 or directly from the search terminal 100, Or the like. Here, when generating a response event of approval, at least one of the search terminals 400 may be connected to at least one search terminal 100 that has transmitted a chat request to at least one search terminal 400 through a communication channel And may be a terminal that transmits and receives a message. Here, the at least one search terminal 400 may be a terminal that searches for at least one search terminal 100 that has sent a chat request to itself on an AR or VR screen, and when outputting an AR screen or a VR screen, And may be a terminal that guides the position of at least one search terminal 100 through a location guide in communication with the AR information sharing based communication providing server 300.

At least one of the searched terminals 400 may be implemented as a computer capable of connecting to a remote server or terminal through the network 200. Here, the computer may include, for example, a POS (Point Of Sale) terminal, a notebook equipped with a web browser (WEB Browser), a desktop, a laptop, and the like. At this time, the at least one search terminal 400 may be implemented as a terminal capable of connecting to a remote server or terminal through the network 200. The at least one searched terminal 400 may be, for example, a wireless communication device with guaranteed portability and mobility, such as navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular) , A PHS (Personal Handyphone System), a PDA (Personal Digital Assistant), an IMT (International Mobile Telecommunication) -2000, a CDMA (Code Division Multiple Access) -2000, a W-CDMA Based wireless communication device such as a wireless Internet terminal, a smartphone, a smartpad, a tablet PC, and the like.

At least one information providing terminal 500 may be a terminal providing information to the AR information sharing-based communication providing server 300. For example, at least one information providing terminal 500 may be a terminal of an owner of an agent who wants to promote the store, a terminal of a salesperson who intends to open a business, It is possible. At this time, the type of information is not limited to publicity or review, and the review is not corrected or edited by the reviewer. At this time, at least one information providing terminal 500 can be implemented as a computer that can access a remote server or terminal through the network 200. Here, the computer may include, for example, a POS (Point Of Sale) terminal, a notebook equipped with a web browser (WEB Browser), a desktop, a laptop, and the like. At this time, at least one information providing terminal 500 can be implemented as a terminal capable of connecting to a remote server or terminal through the network 200. At least one information providing terminal 500 is a wireless communication device that is guaranteed to be portable and mobility, for example, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular) , A PHS (Personal Handyphone System), a PDA (Personal Digital Assistant), an IMT (International Mobile Telecommunication) -2000, a CDMA (Code Division Multiple Access) -2000, a W-CDMA Based wireless communication device such as a wireless Internet terminal, a smartphone, a smartpad, a tablet PC, and the like.

FIG. 2 is a block diagram for explaining an AR information sharing-based communication providing server shown in FIG. 1. FIG. Referring to FIG. 2, an AR information sharing-based communication providing server 300 according to an embodiment of the present invention includes a receiving unit 310, a collecting unit 320, an extracting unit 330, an output unit 340, A part 350, a forming part 360, and a databasing part 370.

(Not shown) operating in conjunction with the AR information sharing-based communication providing server 300 or the AR information sharing-based communication providing server 300 according to an embodiment of the present invention may include at least one search terminal 100, When at least one search terminal 100 and at least one search terminal 400 transmit AR information sharing based communication service applications, programs, app pages, web pages, etc. to at least one search terminal 400, May install or open an AR information sharing based communication service application, a program, an app page, a web page, and the like. In addition, a service program may be executed in at least one search terminal 100 and at least one search terminal 400 using a script executed in a web browser. Here, a web browser is a program that enables a WWW (World Wide Web) service, and is a program for receiving and displaying hypertext described in hypertext mark-up language (HTML), for example, Netscape (Netscape) An Explorer, chrome, and the like. Further, the application refers to an application on the terminal, for example, an app (app) running on a mobile terminal (smart phone).

At least one search terminal 100, an AR information sharing-based communication providing server 300 and at least one search terminal 400 may be connected to the network 200 through the network 200. In this case, Lt; RTI ID = 0.0 > communication < / RTI > The AR information sharing-based communication providing server 300 can exchange data with each other through a communication object.

The receiving unit 310 may receive an AR event for activating the AR interface from the search terminal 100. [ The AR interface may be defined as an interface for outputting virtual objects previously stored in the real space while the photographing screen of the search terminal 100 is activated. For example, when the object C is pre-stored in the three-dimensional coordinates of X, Y, and Z, or the object D exists in the coordinates of X, Y, and Z, Refers to an interface that combines a real space and a virtual space by exposing an object named C or D to a shooting screen of the search terminal 100 in real time when the coordinates of X, Y, and Z are photographed . Accordingly, when the user of the search terminal 100 wants to search for an object and activates the AR interface, the user may output the object stored in the AR information sharing-based communication providing server 300 on the photographing screen, When one PES 400 is located, information of at least one PES 400 may be output. This will be described in detail below.

The collection unit 320 may collect the location of the search terminal 100 based on the received AR event. At this time, the position can be obtained up to the altitude with the GPS coordinates, and the collecting unit 320 can collect the altitude using a separate altitude collection module. At this time, not only two-dimensional coordinates of the location but also three-dimensional coordinates are required because if different objects are located in each building or floor, it is necessary to distinguish the objects. Also, in the case of an object having three-dimensional coordinates, three-dimensional coordinates may be required because only two-dimensional coordinates are provided so that the object can not be found. And, even if it is the same layer, it is possible to detect and collect three-dimensional precise position according to the altitude set by the acceleration sensor, altitude sensor, rotation sensor, angle sensor and the like. That is, even if it is the same layer, the object may be set or located at different points.

The extracting unit 330 may extract at least one of the retrieved terminals 400 located within a predetermined radius of the collected position or set to coordinates. For example, if the location of the search terminal 100 is assumed to be a three-floor A coffee shop, an extraction unit (not shown) may be used to output information of at least one of the search terminals 400 located within the shooting radius of the search terminal 100 330 may extract at least one of the search terminals 400 located within the shooting radius based on the search terminal 100. At this time, the extracting unit 330 determines that at least one of the retrieved terminals 400 has the same retrieval condition as that of the searcher that can search for itself, or the terminal that sets the retrieval conditions such as the retrieval time You can only extract it. For example, if the person to be searched is a person who is 60 years old who does not want to talk to a person under 40 years old, a search condition of "prohibition of searching for persons under 40 years old" is set. If the searcher is 40 years old, The extracting unit 330 does not extract the retrieved person according to the retrieved condition, so that the retrieving unit 330 can adjust the retrieved retrieved person to meet the needs of the retrieved person.

If the search condition of the search terminal 100 is input to the AR event after extracting at least one of the search terminals 400 located within a predetermined radius of the collected position or set coordinates, , It is possible to filter at least one search terminal 400 that matches the search conditions and extract at least one filtered search terminal 400 that has been filtered. That is, not only searching for a searcher based on a location, but also searching for a person who is close to the searcher can be desired. For example, suppose that user A searches for a foreign car dealership on the third floor B coffee shop. At this time, the extracting unit 330 may search for the location of the B coffee shop as the first condition and the condition of the foreign car dealer as the second condition. At this time, if the result of applying the altitude value of the three layers does not satisfy both the first condition and the second condition, the extracting unit 330 searches for the first condition and the second condition excluding the altitude value as the search condition . At this time, when the search result is extracted, the extracting unit 330 extracts the altitude of the searcher terminal 400 having the information of the search result, thereby searching for the searcher terminal 400 in the search terminal 100 So that the guide can be displayed on the AR screen. For example, if the searcher terminal 400 is located on the first floor, it may be a text and direction indicator such as descending to the first floor. At this time, the direction indicator may be, but is not limited to,?,?,?,?,?,?,?

The output unit 340 may map information, position and coordinates of the extracted at least one searched terminal 400, and output the mapped information on the AR screen of the search terminal 100. The reason why the position and the coordinates are required is that the position of at least one of the retrieved terminals 400 extracted from the AR screen which is a real time photographing screen of at least one retrieving terminal 400 should be accurately displayed. Here, the information may be disclosed to the extent that at least one search term 400 is allowed to search, and may include information such as name, sex, age, job, search partner, content to be promoted, However, it is to be understood that the present invention is not limited thereto.

At this time, when the information, position and coordinates of at least one of the retrieved terminals 400 extracted from the output unit 340 are mapped and output from the AR screen of the retrieving terminal 100, The same image as the image template of the preset human shape can be extracted. The output unit 340 outputs the information of at least one of the retrieved terminals 400 extracted at the upper left or upper right of the extracted image of the AR screen to the AR It can be controlled to be outputted on the screen. In addition, the output unit 340 may monitor the moving position of the extracted image to output the information content. Here, the information content and the extracted image may be connected by lines and output to the AR screen.

In other words, although a person A is located at (x, y, z) coordinates, when the information of a person A is output to the AR, the person is intuitively grasped If you expose information in difficult locations, it can be difficult to see a person's face and information at a glance. Therefore, the output unit 340 can search for a face on the screen being photographed. At this time, the face shape can be extracted using the image template, and information can be displayed on the upper right side of the face, And the information of the AR are displayed at a glance so that the searcher can intuitively grasp the information at a glance.

 The transmitting unit 350 transmits the selected event to the search terminal 100 to the selected search terminal 400 when the selection event for selecting any one of the information of the at least one search terminal 400 is received in the search terminal 100. [ Lt; RTI ID = 0.0 > event. That is, allowing the search without the permission of at least one of the search terminals 400 selected by the search terminal 100 may ignore the intention of the user of the at least one search terminal 400 Therefore, it is possible to transmit a selection event for asking at least one of the searched terminals 400. Of course, in the case where at least one of the search terminals 400 is set to allow all chats, an exception may be made, and the present invention is not limited to such a case, and various embodiments may exist.

When the selection event for selecting any one of the information of at least one of the search terminals 400 is received in the search terminal 100, the transmitter 350 transmits the search event to the search terminal 400 100 in the AR screen of the selected search terminal 400 and then executes the AR event for executing the AR screen in the selected search terminal 400 after transmitting the selection event of the search terminal 100 in the AR screen of the selected search terminal 400 It is possible to output a marker to tell. That is, the selected search terminal 400 has a right to know who is searching for itself. Therefore, it is possible to search through the AR screen to find out who is searching for the user.

When the AR screen of the search terminal 400 selected in the direction corresponding to the output indicator moves, the transmitting unit 350 transmits the image of the searcher holding the search terminal 100 to the image It is possible to extract the outer circumference of the searcher output on the AR screen of the selected search terminal 400 by edge point extraction. Then, the transmitting unit 350 can display the extracted outer circumference with a line and output it to the AR screen. That is, when the searcher is photographed, the searcher can be clearly displayed by marking the border with a line so that the searcher can clearly distinguish the searcher.

The transmitting unit 350 may also be configured to not output the information of the search terminal 400 selected by the search terminal 100 when the selection rejection response of the selection event is received as the feedback data in the selected search terminal 400 The information output can be interrupted. That is, when the searcher is confirmed on the AR screen or the information of the searcher is confirmed in the search terminal 400 and then the search is blocked, the searcher is dissatisfied or does not want the searcher. Therefore, The terminal 400 can be prevented from outputting the search terminal 100 and the search terminal 100 can be configured not to output the search terminal 400. [

The forming unit 360 may form a communication channel between the search terminal 400 and the search terminal 400 when a response event is received from the selected search terminal 400 in response to the selection event. At this time, communication between the search terminal 400 and the search terminal 100 can be encrypted. After the chat is terminated, the chat is transmitted to the search terminal 400 and the search terminal 100 as well as the AR information sharing based communication It may also be deleted in the providing system 1.

The database generating unit 370 receives the AR event from the search terminal 100 and the at least one search terminal 400 from the search terminal 100 before receiving the AR event from the search terminal 100, Information can be received and databaseized. At this time, the user information may use information included in at least one of the accounts used by the user, and may automatically fill the input box using the information. For example, for an application distributor, it is the first information collection for one application of its own, but for the user it is necessary to input the same information repeatedly in order to use multiple applications, and in the case of different input interfaces, The user may have to give up the subscription at the time of subscription. Accordingly, the database generating unit 370 collects the user information from the search terminal 100 or the at least one search terminal 400 to activate the member recruitment, So that the user can check only the user's hassle.

The database generating unit 370 may further include a condition for searching the search terminal 100 and the at least one search terminal 400 from the search terminal 100 and the at least one search terminal 400, Input can be received. At this time, the condition to be not searched and the condition to be searched may include the profile information of the searched person. In other words, there may be a searcher who wants to search for a person, but there may be a searcher who does not want to be searched by anyone. For example, if a person has certain information that disgusts a person with certain information, or if there is a trauma personally and dislikes a certain level of person, then when the person knows that the person has searched for him, Or a program or the like. Also, a case where a person of a certain hierarchy is prefered can be applied. For example, in the case of a woman who prefers a man who likes spicy toppokki, a spoon toppokki and a male can be described as a condition to be searched, and the database processing unit 370 can determine the condition of ((spicy AND toppokki) AND male) Can be input.

Before receiving the AR event for activating the AR interface from the search terminal 100 at the receiving unit 310, the database forming unit 370 stores the information to be provided from at least one information providing terminal 500 providing information The content including the image, and the identifier, and stores it in a database. In addition, the database production unit 370 may store the evaluation score and review data of the promoted contents collected as keywords with the publicized contents corresponding to the identifiers.

The extractor 330 receives the AR event for activating the AR interface from the search terminal 100 in the receiver 310 and then generates an AR event in the search terminal 100 when the publicized content is a menu , The position of the search terminal 100 is extracted and the position and the image taken at the position of the search terminal 100 are photographed on the AR screen of the search terminal 100 The list of the menu plate and the coordinates of the list can be respectively extracted. In addition, the outer circumference of the image of the menu plate included in the AR screen photographed by the search terminal 100 is extracted through the edge point extraction algorithm. At this time, the publicized content may be the content received from the user of the store holding the menu board, or may be an image collected by the web crawler.

The extracting unit 330 may increase or decrease the size of the pre-stored promotional content so as to correspond to the size of the extracted menu, and when the sizes of the promoted and stored promotional contents match the sizes of the menu, Compare the menu list included in the image of the pre-stored publicized content, and output the previously stored rating score and review data to the AR screen of the search terminal 100 so as to correspond to the coordinates. The previously stored evaluation score and review data displayed so as to correspond to the coordinates of the list of the AR screen can be connected by lines so as to correspond to the list of the menu screen of the AR screen, respectively. In other words, if it is not displayed as a line, since it is not known what rating score or review is related to which menu, the extracting unit 330 distinguishes the list photographed on the AR screen, By outputting a line connecting the score and the review, the user is prevented from being confused.

For example, suppose that the user of the search terminal 100 called A goes to the restaurant of B and worries about what kind of menu he / she is going to give. At this time, the search terminal 100 may search for a restaurant B on the Internet and search for a menu, but this can be troublesome. Accordingly, when the AR screen is activated in the search terminal 100 and the menu plate is being photographed on the AR screen, the position of the list described on the menu plate is confirmed, and information corresponding to the position is output to the corresponding position have. That is, assuming that the first list of the menu of the restaurant B is "La Rocchi," the user can output the previously stored evaluation scores and review data of the La Rocchi at the location of the AR screen where the La Rocchi is photographed, You can choose the menu quickly and easily without searching or asking the employee.

Hereinafter, an AR information sharing-based communication providing service having the above-described configuration will be described with reference to FIGS. 3 and 4. FIG.

FIG. 3 is a view for explaining an embodiment in which an AR information sharing-based communication providing service according to an embodiment of the present invention is provided. FIG. 4 is a diagram illustrating an AR information sharing- And FIG.

Referring to FIG. 3, (a) when the AR activation interface (AR start) for starting the search in the search terminal 100 is selected, the search is performed based on the location, the location and the specific search condition It is possible to set whether or not to perform the operation.

At this time, (b) the search terminal 100 searches for reason, and (c) the chat request information is transmitted to the searched terminal 400, which is a searched terminal. (d) At this time, when the chat application is rejected from the search terminal 400, the search terminal 100 may continue searching for another reason and may select an option such as a gift cycle for the challenge again.

Referring to FIG. 4, it is assumed that (a) the search terminal 100 searches the evaluation score and review of the menu plate through the AR activation interface. At this time, the photographing screen of the search terminal 100 is analyzed by the AR information sharing-based communication providing server 300, and the information corresponding to the information and the information is outputted so that the information corresponding to the menu list is outputted in the screen (B) the search terminal 100 can output the evaluation score and review data on the AR screen in real time. At this time, it is possible to output only one data. However, if a single review is clicked on the search terminal 100 in order to output a plurality of data, other reviews for the menu can be outputted. And the data obtained by averaging the score can be output on one line. For example, if 70% of the 100 reviews are bad review data such as bad or bad, and the score is below the preset threshold, 70% of the 100 recent reviews in a single line summary did not recommend this menu Information may be output. Accordingly, the user may not have to read and judge a plurality of reviews.

The AR information sharing-based communication providing method shown in FIGS. 3 and 4 is not described. The AR information sharing-based communication providing method described above with reference to FIGS. 1 and 2 So that the following description will be omitted.

FIG. 5 is a flowchart illustrating an AR information sharing-based communication providing method according to the present invention. Referring to FIG. 5, an AR information sharing-based communication providing server receives an AR event for activating an AR interface from a searching terminal (S5100).

Then, the AR information sharing-based communication providing server collects the position of the searching terminal based on the received AR event (S5200), and searches the at least one searching terminal, which is located within a predetermined radius of the collected position, (S5300).

Also, the AR information sharing-based communication providing server maps information, position, and coordinates of the extracted at least one retrieved terminal to the AR screen of the retrieving terminal (S5400), and searches the at least one retrieved terminal When a selection event for selecting one of the information items is received, the selection event of the search terminal is transmitted to the selected retrieved terminal (S5500).

Then, the AR information sharing-based communication providing server forms a communication channel between the search terminal and the search terminal when a response event is received from the selected search terminal in response to the selection event (S5600).

The AR information sharing-based communication providing method of FIG. 5 is not described. The AR information sharing-based communication providing method described above with reference to FIGS. 1 to 4 can be easily derived from the same or explained contents So that the description will be omitted.

The AR information sharing-based communication providing method according to the embodiment described with reference to FIG. 5 can also be implemented in the form of a recording medium including instructions executable by a computer, such as an application or a program module executed by a computer . Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

The AR information sharing-based communication providing method according to an embodiment of the present invention may be executed by an application installed in a terminal (which may include a program included in a platform or an operating system basically installed in the terminal) And may be executed by an application (that is, a program) directly installed on a master terminal by a user through an application providing server such as an application store server, an application, or a web server associated with the service. In this regard, the AR information sharing-based communication providing method according to an embodiment of the present invention described above is implemented as an application (i.e., a program) installed in a terminal or installed directly by a user and can be read by a computer And can be recorded on the recording medium.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

Claims (7)

A method for providing AR information sharing based communication executed in an AR information sharing based communication providing server,
Receiving an AR event for activating an AR interface from a search terminal;
Collecting the location of the search terminal based on the received AR event;
Extracting at least one retrieved terminal located within a predetermined radius of the collected position or with coordinates set;
Mapping the information, position and coordinates of the extracted at least one retrieved terminal to the AR screen of the retrieving terminal;
Transmitting a selection event of the search terminal to the selected search terminal when a selection event for selecting any one of the information of the at least one search terminal is received at the search terminal;
Forming a communication channel between the searched terminal and the search terminal when a response event corresponding to the selection event is received from the selected searched terminal;
Based on the AR information.
The method according to claim 1,
After extracting the at least one search terminal located within a predetermined radius of the collected position or with coordinates set,
Filtering at least one search terminal matching the search condition when the search condition of the search terminal is input to the AR event;
Extracting the filtered at least one retrieved terminal;
Based on the AR information.
The method according to claim 1,
Prior to the step of receiving an AR event for activating the AR interface from the search terminal,
Receiving user information from the search terminal and at least one search terminal and converting the received user information into a database;
Receiving a condition to be searched and a condition to be searched from the search terminal and at least one searched terminal;
Further comprising:
Wherein the condition to be searched and the condition to be searched include profile information of the searcher.
The method according to claim 1,
The step of mapping information, position and coordinates of the extracted at least one retrieved terminal to the AR screen of the retrieving terminal,
Extracting an image identical to a preset human-shaped image template on the AR screen of the search terminal;
Controlling the extracted information on at least one of the retrieved terminals to be outputted from the AR screen of the retrieving terminal as information contents including text at the upper left or upper right of the extracted image of the AR screen;
If the extracted image moves, monitoring the moved information to output the information content;
Further comprising:
Wherein the information content and the extracted image are connected by lines and output to the AR screen.
The method according to claim 1,
Prior to the step of receiving an AR event for activating the AR interface from the search terminal,
Receiving a publicity content including a location of information to be provided from at least one information providing terminal providing information, a content including an image and an identifier, and converting the publicized content into a database;
Storing evaluation scores and review data for the publicized contents collected as keywords as the publicized contents so as to correspond to the identifiers;
Based on the AR information.
6. The method of claim 5,
After receiving the AR event activating the AR interface from the search terminal,
Extracting a position of the search terminal when generating the AR event at the search terminal when the publicized content is a menu plate;
Extracting a list of menu plates and a coordinate of the list photographed on the AR screen of the search terminal, when the position and the image photographed at the position of the search terminal coincide with the position coordinates and the image of the menu plate;
Extracting an outer circumference of an image of a menu plate included in an AR screen photographed by the search terminal through an edge point extraction algorithm;
Increasing or decreasing the size of the pre-stored PR content to correspond to the size of the extracted menu plate;
Comparing the coordinates of the list with a menu list included in an image of the pre-stored publicized content, and comparing the pre-stored rating score and review data with the menu list included in the image of the pre- And outputting the result to the AR screen of the search terminal so as to correspond to the coordinates;
Further comprising:
And the previously stored evaluation score and review data displayed corresponding to the coordinates of the list of the AR screen are connected in a line so as to correspond to the list of the menu screen of the AR screen respectively.
The method according to claim 1,
When the selection event for selecting any one of the information of the at least one retrieved terminal is received at the retrieving terminal, after transmitting the selection event of the retrieving terminal to the selected retrieved terminal,
Outputting an indicator indicating the location of the search terminal in the AR screen of the selected search terminal when the selected search terminal executes the AR event for executing the AR screen;
When the AR screen of the selected terminal is moved in the direction corresponding to the output indicator, if the image of the searcher holding the search terminal matches the image of the previously stored searcher, Extracting an outer circumference of a searcher output to an edge point extraction;
Displaying the extracted outer circumference as a line and outputting it to the AR screen;
Blocking the information output so that the search terminal does not output the information of the selected search terminal when the selection response of the selected search terminal is received as the feedback data in the selected search terminal;
Based on the AR information.

Images