KR101907885B1 - Terminal and control method thereof - Google Patents

Abstract

The present invention discloses a terminal and a control method thereof. The terminal may display predetermined category information when a terminal is located within a predetermined radius based on a current position of a terminal among a plurality of pieces of information registered in advance in a server and at least one information corresponding to a keyword according to user input of a terminal and/or a recognized pattern does not exist and enhance the effectiveness of public relations based on the provision of virtual reality or mixed reality information and easily identify real-time information on goods and service of interest by providing at least one information corresponding to a specific category selected among displayed category information to a terminal. The control method comprises the steps of: transmitting keyword or pattern information and position and identification information of a terminal to a server; receiving category information transmitted from the server; displaying the received category information; controlling a display unit to display at least one second information; displaying selected specific information; and controlling the display unit to display a result of performing a function.

Description

[0001] The present invention relates to a terminal and a control method thereof,

The present invention relates to a terminal and a control method thereof, and more particularly to a terminal and a control method thereof, which are located within a predetermined radius based on a current position of the terminal among a plurality of information registered in advance in a server and correspond to a keyword and / And displays the preset category information and provides at least one piece of information corresponding to a specific category selected from the displayed category information to the terminal and a control method thereof .

2. Description of the Related Art Generally, a mobile terminal is a device that performs a Global Positioning System (GPS) function and a call function (or a call function) and provides a result of the operation to a user.

These mobile terminals are able to transmit and receive more information in a shorter time and have various functions, but there is a lack of UI (User Interface) for user-oriented convenience in accordance with these functions.

Korean Patent Laid-Open No. 10-2013-0084274 [entitled " 3D virtual reality Internet shopping mall]

It is an object of the present invention to provide an information processing apparatus and a method of searching for a location of a terminal, which are located within a predetermined radius based on a current location of the terminal among a plurality of information registered in advance in a server, and at least one information corresponding to a keyword and / And provides at least one piece of information corresponding to a specific category selected from the displayed category information to the terminal, and a control method thereof.

It is another object of the present invention to provide a method and apparatus for searching for a location of a terminal, which is located within a predetermined radius based on a current location of the terminal among a plurality of information registered in advance in a server, and at least one information corresponding to a keyword and / And provides the corresponding at least one piece of information to the terminal, and a control method thereof.

A control method of a terminal according to an embodiment of the present invention is a control method of a terminal, wherein when receiving a keyword according to a user input or receiving pattern information according to pattern recognition for an object, Transmitting location information of the terminal and identification information of the terminal to the server; Receiving, by the communication unit, category information transmitted from the server when the keyword, the pattern information, and the information corresponding to the location information of the terminal do not exist among a plurality of pieces of information stored in the server; Displaying the received category information by a display unit; Controlling the display unit to display, by the control unit, at least one information corresponding to a specific category selected according to a user selection from the category information displayed on the display unit; Displaying the selected specific information by the display unit when specific information is selected from at least one piece of information displayed on the display unit; And controlling the display unit to perform a preset function corresponding to the event by the control unit when a preset event is detected while the specific information is being displayed on the display unit and to display the function execution result . ≪ / RTI >

As an example related to the present invention, when there is information corresponding to at least one of the keyword, the pattern information, and the location information of the terminal among a plurality of pieces of information stored in the server by the communication unit, Receiving information provided from the server in response to the request; And displaying the received information by the display unit.

As an example related to the present invention, when the selection of one of the plurality of items included in the information displayed on the terminal is detected, when the selection of the button provided on the terminal is detected, When a tilt exceeding a preset threshold value in the up / down / left / right direction of the terminal is detected, when a movement of more than a predetermined number of times in the up / down direction or the left / right direction or the diagonal direction of the terminal is detected, Wherein the touch gesture by the user of the terminal includes at least one of a case where a predetermined number of rotations in the clockwise / anticlockwise direction of the terminal is detected or a touch gesture by the user of the terminal is detected, Tap, touch & hold, double tap, drag, flick, drag & drop, pinch and swipe. ) Of And may include any one of them.

In one embodiment of the present invention, the step of performing a preset function corresponding to the event and controlling the display unit to display the function execution result includes: a step of receiving a link for confirming the MR content related to the keyword included in the information When the information is selected, the display unit can display the MR content related to the selected link information.

In one embodiment of the present invention, the step of performing a predetermined function corresponding to the event and controlling the display unit to display the function execution result may include: When the link information for displaying the route guidance information to the destination is selected, the display unit overlaps the route information to the destination included in the information on the screen corresponding to the current position of the terminal, A process of displaying; And displaying a continuous screen which changes according to the automatic moving function at a preset speed from the first screen to the destination by the display unit while the state of the route information displayed on the display unit is maintained . ≪ / RTI >

As an example related to the present invention, the route information may include at least one of lane information, road information, traveling restriction speed information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, And the like.

As a related example of the present invention, the step of performing a predetermined function corresponding to the event and controlling the display unit to display the result of performing the function may include: connecting to a blog or a social network service related to the keyword included in the information The screen corresponding to the blog related to the selected link information or the screen corresponding to the social network service can be displayed by the display unit.

In one embodiment related to the present invention, the information includes MR content, and the MR content includes at least one of panorama image information related to the keyword, a code related to an object included in the panorama image information, Position information of an object marker within a marker, an image or a moving image, and attribute information of the object marker.

As an example related to the present invention, the MR content may include: displaying the panorama image information on the display area of the display unit by the display unit; When a first object marker selected from a plurality of object markers displayed in the object marker display area of the display unit is dropped in a first area on the image display area by a drag and drop function, Placing the selected first object marker in a first area; And setting the attribute information of the selected first object marker based on the user input by the controller when the first object marker disposed in the image display area is selected.

The terminal according to the embodiment of the present invention may be configured such that when receiving a keyword according to a user input or receiving pattern information according to pattern recognition of an object, the terminal according to an embodiment of the present invention includes the keyword, the pattern information, A communication unit for receiving category information transmitted from the server when the keyword, the pattern information, and the information corresponding to the location information of the terminal do not exist among a plurality of pieces of information stored in the server; A display unit for displaying the received category information; And controlling the display unit to display at least one piece of information corresponding to a specific category selected according to a user's selection from the category information displayed on the display unit, and when the specific information is selected from the at least one piece of information displayed on the display unit Wherein the control unit controls the display unit to display specific information, performs a predetermined function corresponding to the event when a preset event is detected in a state where the specific information is displayed on the display unit, And a control unit for controlling the control unit.

As an example related to the present invention, when the link information for confirming the MR content related to the keyword included in the information is selected, the display unit may display the MR content related to the selected link information.

As an example related to the present invention, when the link information for displaying the route guidance information from the current position of the terminal included in the information to the destination included in the information is selected, Wherein the display unit displays the first screen by overlapping the route information to the destination included in the information on the corresponding screen and displays the first screen in a state in which the route information displayed on the display unit It is possible to display a continuous screen which changes according to the automatic movement function at a set speed.

As an example related to the present invention, when the link information for accessing the blog or the social network service related to the keyword included in the information is selected, the display unit displays the screen corresponding to the blog or the social A screen corresponding to the network service can be displayed.

The present invention is characterized in that if a plurality of pieces of information previously registered in the server are located within a predetermined radius based on the current position of the terminal and at least one piece of information corresponding to the keyword and / And displaying the preset category information and providing at least one piece of information corresponding to a specific category selected from the displayed category information to the terminal so as to enhance the publicity effect according to provision of the business information to which the virtual reality or mixed reality is applied, It is possible to easily confirm the real-time information on the goods and services of interest.

According to the present invention, there is provided a method of searching for a location of a terminal, which is located within a predetermined radius based on a current location of the terminal among a plurality of information registered in advance in a server and at least one information corresponding to a keyword and / , Providing at least one corresponding information to the terminal, thereby providing a user interface for user convenience and improving convenience for the user.

1 is a block diagram showing a configuration of a content providing system according to an embodiment of the present invention.
2 is a block diagram illustrating a configuration of a UE according to an embodiment of the present invention.
3 to 15 are diagrams illustrating screens of a terminal according to an embodiment of the present invention.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms that can be understood by a person skilled in the art can be properly understood. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. The term " comprising " or " comprising " or the like in the present invention should not be construed as necessarily including the various elements or steps described in the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

1 is a block diagram showing a configuration of a content providing system (or a content providing apparatus) 10 to which a terminal 100 according to an embodiment of the present invention is applied.

As shown in Fig. 1, the content providing system 10 is composed of a terminal 100 and a server 200. Fig. Not all of the components of the content providing system 10 shown in Fig. 1 are essential components, and the content providing system 10 may be implemented by more components than the components shown in Fig. 1, The content providing system 10 may also be implemented by a component.

The terminal 100 may be a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) terminal, a telematics terminal, A portable terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device (for example, a watch type A smart TV, a digital broadcasting terminal, an AVN (Audio Video Navigation) terminal, a digital broadcasting terminal, a digital video broadcasting terminal, An audio / video (A / V) system, a flexible terminal, and the like.

2, the terminal 100 includes an input unit 110, a reader 120, a communication unit 130, a GPS receiver 140, a storage unit 150, a display unit 160, an audio output unit 170 and a control unit 180. Not all the components of the terminal 100 shown in Fig. 2 are essential components, and the terminal 100 may be implemented by more components than the components shown in Fig. 2, The terminal 100 may be implemented.

The input unit 110 receives a command or a control signal generated by an operation such as a button operation by a user or a signal according to an arbitrary function selection or a touch / scroll operation of a displayed screen.

The input unit 110 receives a signal corresponding to information input by a user and may include a key pad, a dome switch, a touch pad (for example, a contact type capacitance type, a pressure type A touch screen, a jog wheel, a jog switch, a jog shuttle, a mouse, and the like are included in the present invention, including a resistance film type, an infrared ray detection type, a surface ultrasonic wave conduction type, an integral type tension measurement type, , A stylus pen, a touch pen, and the like can be used.

In addition, the input unit 110 may include at least one microphone (not shown) and a camera (not shown) for receiving an audio signal or a video signal. The microphone receives an external sound signal (including user's voice (voice signal or voice information)) by a microphone in a communication mode, a recording mode, a voice recognition mode, a video conference mode, And processes it as data. The processed voice data may be output through the voice output unit 170 or converted into a form that can be transmitted to an external terminal through the communication unit 130 and output. In addition, the microphone may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

In addition, the camera processes image frames such as still images or moving images obtained by an image sensor (camera module or camera) in a video communication mode, a shooting mode, a video conference mode, and the like. That is, the image data obtained by the image sensor according to the CODEC is encoded / decoded according to each standard. The processed image frame may be displayed on the display unit 160 under the control of the control unit 180. [ For example, the camera captures an object (or a subject) (user image or video conference), and outputs a video signal corresponding to the captured image (object image).

In addition, the image frame processed by the camera may be stored in the storage unit 150 or transmitted to an external terminal (including any video conferencing terminal included in the video conferencing system) through the communication unit 130.

In addition, the camera photographs an object (e.g., a face, a fingerprint, a product, a building, a tag attached / attached to a product / a display panel, etc.), and transmits image information including the photographed object to the controller 180 ).

The reader 120 recognizes (or tags) tags or tags attached to or attached to a product or an arbitrary place (for example, a shelf, etc.) (for example, a barcode, a QR code, etc.).

Also, the reader 120 provides the recognized tag information to the controller 180.

As described above, the present invention can confirm the pattern information through the image information including an arbitrary object through the input unit 110 and / or the reader 120, or can check the pattern information through the scan for the object have.

The communication unit 130 communicates with at least one external terminal or any internal component via a wired / wireless communication network. At this time, the external arbitrary terminal may include the server 200 and the like. Here, the wireless Internet technology includes a wireless LAN (WLAN), a digital living network alliance (DLNA), a wireless broadband (Wibro), a world interoperability for a microwave (WiMAX), a high speed downlink packet access ), HSUPA (High Speed Uplink Packet Access), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) And the communication unit 130 transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above. In addition, the near field communication technology includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC) , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, and Wi-Fi Direct. The wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, an optical / coaxial cable, and the like.

In addition, the communication unit 130 can transmit information to and from an arbitrary terminal through a universal serial bus (USB).

In addition, the communication unit 130 may be configured to transmit data to a mobile communication system, such as a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (E.g., Long Term Evolution-Advanced), and the like, on the mobile communication network.

The communication unit 130 transmits the keyword, the pattern information, the location information of the terminal 100 confirmed in real time, the identification information of the terminal 100, and the like to the server 200 under the control of the controller 180 . At this time, the identification information of the terminal 100 includes a mobile directory number (MDN), a mobile IP, a mobile MAC, a SIM (subscriber identity module) card unique information, and a serial number.

The communication unit 130 receives information transmitted from the server 200 in response to the transmitted keyword, pattern information, location information of the terminal 100, etc., under the control of the controller 180.

The GPS receiver 140 receives the GPS signal transmitted from the satellite, generates position data of the terminal 100 in real time based on the longitude coordinates and the latitude coordinates included in the received GPS signal, And outputs the position data to the controller 180. Here, the generated position data is defined as the current position (or current position data) of the terminal 100. Here, the GPS receiver 140 may receive location information through Wi-Fi or WiBro communication as well.

In addition, the signal received through the GPS receiver 140 includes 802.11, a standard for a wireless network for a wireless LAN including a wireless LAN and some infrared communication proposed by IEEE (Institute of Electrical and Electronics Engineers) A wireless metropolitan area network (MAN) including 802.15, a standard for a wireless personal area network (PAN) including UWB and ZigBee, and a fixed wireless access (FWA), a broadband wireless access 802.20, which is a standard for Mobile Internet for Mobile Broadband Wireless Access (MBWA) including 802.16, WIBRO, WiMAX, etc., The location information of the terminal may be provided to the terminal 100 by using the location information.

The storage unit 150 stores various user interfaces (UI), a graphical user interface (GUI), and the like.

In addition, the storage unit 150 stores data and programs necessary for the terminal 100 to operate.

That is, the storage unit 150 may store a plurality of application programs or applications that are driven by the terminal 100, data for operation of the terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may exist on the terminal 100 from the time of departure for the basic functions (e.g., call incoming, outgoing, message reception, origination) of the terminal 100. The application program may be stored in the storage unit 150 and may be installed in the terminal 100 and may be operated by the control unit 180 to perform the operation (or function) of the terminal 100.

The storage unit 150 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory And a PROM (Programmable Read-Only Memory). In addition, the terminal 100 may operate a web storage that performs a storage function of the storage unit 150 on the Internet, or may operate in association with the web storage.

The storage unit 150 stores information corresponding to the keyword, the pattern information, and the location information of the terminal 100 received through the communication unit 130.

The display unit 160 may display various contents such as various menu screens using the user interface and / or graphical user interface stored in the storage unit 150 under the control of the controller 180. [ Here, the content displayed on the display unit 160 includes various text or image data (including various information data), a menu screen including data such as an icon, a list menu, and a combo box. Also, the display unit 160 may be a touch screen.

The display unit 160 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) And may include at least one of a flexible display, a 3D display, an e-ink display, and an LED (Light Emitting Diode).

The display unit 160 displays information corresponding to the received keyword, the pattern information, and the position information of the terminal 100 under the control of the controller 180.

The audio output unit 170 outputs audio information included in the signal processed by the controller 180. [ Here, the audio output unit 170 may include a receiver, a speaker, a buzzer, and the like.

Also, the voice output unit 170 outputs the guidance voice generated by the control unit 180.

The voice output unit 170 outputs voice information corresponding to information corresponding to the received keyword, the pattern information, and the position information of the terminal 100 by the controller 180.

The control unit 180 executes the overall control function of the terminal 100. [

The control unit 180 executes the overall control functions of the terminal 100 using the programs and data stored in the storage unit 150. [ The control unit 180 may include a RAM, a ROM, a CPU, a GPU, and a bus, and the RAM, the ROM, the CPU, and the GPU may be connected to each other via a bus. The CPU accesses the storage unit 150 and performs booting using the O / S stored in the storage unit 150. The CPU can perform various operations using various programs, contents, data stored in the storage unit 150, Can be performed.

Also, the controller 180 receives one or more pieces of panorama image information provided from the server 200 through the communication unit 130.

In the embodiment of the present invention, the panorama image information is received from the server 200 or another terminal, but the controller 180 may generate the panorama image information.

That is, the control unit 180 recognizes a code (or a sticker) included in an image photographed through a 360-degree camera (not shown) provided in a specific store. Here, the code (or sticker) is related to a product in a shop, a point of purchase (POP), a leaflet, a banner advertisement, a bulletin board advertisement, a billboard, a signboard, Information (or category information), and may be generated by a combination of numbers, letters, symbols, figures, and the like. At this time, the 360-degree camera can take two-dimensional or three-dimensional panoramic images.

The control unit 180 may further include a temporary marker corresponding to the type of the recognized code, positional information of the temporary marker in the video, information on the image (e.g., image, video, etc.) Camera number of the 360-degree camera, file number of the image (or panorama image), photographing date and time information, run time information, image type information (for example, (For example, VOD, live, unset, etc.).

In addition, the control unit 180 may determine whether or not the recognized marker, the unique identification information of the recognized code, the type of the recognized code, the position information of the code in the image, (For example, a major classification, a middle classification, a small classification information, and the like) related to the image (for example, an image and a moving image), a camera number, a panorama image file number, (For example, image, video, and the like) associated with the information such as the date and time of shooting, the date and time of shooting, the date and time of shooting, the runtime information, and the image type information (for example, VOD, do.

In addition, the controller 180 stores the panorama image information generated on the basis of the image photographed through the specific 360-degree camera provided in the specific store in the storage unit 150.

In addition, the controller 180 transmits the panorama image information generated based on the image photographed through the specific 360-degree camera provided in the specific store to the server 200 and the other terminal through the communication unit 130 do.

As described above, the panoramic image information may be generated in the server 200 or the other terminal, and then provided to the terminal 100 or may be generated in the terminal 100 itself.

If the received panoramic image information is to be displayed on the display unit 160, the controller 180 determines whether the application for displaying the panoramic image information is installed in the terminal 100.

If the application for displaying the panoramic image information is not installed in the terminal 100, the controller 180 controls the operation of the terminal 100 in cooperation with the server 200, Respectively.

As a result of checking, if the application installed in the terminal 100 is executed, the controller 180 displays the application execution result screen on the display unit 160. [ Here, the application execution result screen may include an exhibition management item (or a menu / button) for exhibition management (for example, including creation, deletion, modification and addition of an exhibition), an MR Content management items, MR content distribution items for sharing MR contents, and the like. The application execution result screen may further include a member information item for receiving or transmitting member information, a setting item for setting a function of the application, a My Page item for managing the MR content editing history information, and the like. At this time, the terminal 100 communicates with the server 200 related to the corresponding application in the background state.

In addition, the controller 180 generates a panorama image information request signal for requesting panorama image information related to a specific store, a specific exhibition, and the like.

The control unit 180 transmits the generated panorama image information request signal, the identification information of the terminal 100, and the like to the server 200 through the communication unit 130. [

In addition, the controller 180 receives specific panorama image information related to a specific store, a specific exhibition, and the like transmitted from the server 200 through the communication unit 130 in response to the transmitted panorama image information request signal.

In addition, the controller 180 stores the received specific panorama image information in the storage unit 150.

The control unit 180 controls the display unit 160 to display the list of the application execution result on the display unit 160. The control unit 180 controls the display unit 160 to display the menu on the display unit 160, A list (or list) of one or more panoramic image information is displayed. Here, the panoramic image information includes an image, a moving image, and the like. In addition to the image / moving picture, the panorama image information may include a code related to an object included in the image / moving picture, unique identification information of a code, a type of a code, a location information of a code in an image / (For example, a major classification, an intermediate classification, a small classification information, and the like) related to the image / video, a camera number, a panorama image file number , Shooting date and time information, runtime information, image type information (for example, VOD, live broadcasting, unsetting, etc.). At this time, the screen according to the preset menu selection includes a first area (or an image display area) for displaying a panorama image, a second area (or a category area) for displaying a category classification, A fourth area (or a setting area) for displaying a setting menu, a fifth area (or a list / list display area) for displaying a list including one or more panorama image information, and the like .

The first area (or the image display area) is an area for displaying an image, a moving image, or the like corresponding to the panoramic image. At this time, if the panorama image is a moving image, the moving image is displayed on one side of the first area, and a menu for playing, pausing, 2x fast forward / reverse playback of the moving image is displayed on the other side of the first area A menu indicating a highlight reproduction point, a menu indicating the total run time of the moving picture and the time of the reproduction point, and the like.

The second area (or category area) is an area for displaying one or more exhibition items set (or registered) through the exhibition management menu or the like in the form of a list box, a combo box, or the like. At this time, the category region can be divided into a plurality of category regions by a major category, a middle category, and a small category. In addition, when any one category is selected through the category region, the controller 180 displays the list including the panorama image information corresponding to the selected category in the fifth region.

The third area (or the object marker display area) is a region for displaying an object marker (for example, a shop camera (or a camera), a product, a vendor, event information, etc.) that can be added to the panorama image information to be. In this case, when a specific object marker is selected (or a touch / double click is included) after the specific object marker is placed in the panorama image information, the controller 180 displays the selected specific object marker on one side of the third region, And further displays a screen for setting the attribute information for the user.

The fourth area (or setting area) is an area for displaying menu items such as a preview function, a delete function, a storage function, and a cancel function for the panorama image information being edited.

The fifth area (or list / list display area) is an area for displaying a list (or list) of one or more pieces of panorama image information stored in the storage unit 150.

When one of the panorama image information displayed on the display unit 160 is selected, the controller 180 displays the selected panorama image information on the first region (or the first region) of the display unit 160 Video display area). At this time, the panorama image information displayed in the first area of the display unit 160 may include an image or a moving image including a code photographed through a camera (not shown), one or more temporary markers related to the code have. Here, the temporary marker is for displaying the code type in relation to the code, and is for displaying a shop camera, a product, a vendor, event information, and the like. The temporary marker may be a shop camera temporary marker (for example, indicated as 'CM') for indicating a shop camera, a product temporary marker (for example, indicated as 'PD') for indicating a product, (For example, 'EV') to display event information for displaying event information, a promotional information temporary markers for displaying promotional information (for example, Quot; PR ") and the like. In order to distinguish the temporary marker from the object marker, the border of the temporary marker is processed by dotted line, the background color is set to be transparent or the color is set to a specific color before being replaced (or replaced / changed) with the actual object marker State.

The controller 180 may display a panning button for panning the 360 degrees panoramic image up / down / left / right on the other side of the panoramic image information displayed on the display unit 160.

At this time, the controller 180 may display the one or more panorama image information corresponding to the at least one panorama image information displayed in the second area (or category area) in the screen displayed on the display unit 160 according to the user selection (or user touch / user input) Category, and may display any one of the panorama image information selected from the at least one panorama image information corresponding to the selected category information in the first area (or the image display area) of the display unit 160 have.

In addition, the control unit 180 may display any one or more of the one or more object markers displayed in the third area (or the object marker display area) according to the user input (or control / operation command / user touch / When a specific region (or a specific position) on the first region (or the image display region) is selected after one object marker is selected, a code type corresponding to the selected specific region (or specific position) . Here, the code type (or the type of the temporary marker corresponding to the code type) corresponding to the specific region (or the specific position) may be any one of a shop camera, a product, a vendor, event information, and no related data. In addition, the type of the object marker may be any one of a shop camera, a product, a vendor, and event information.

That is, when one of the object markers displayed on the display unit 160 is selected and the selected object marker is to be arranged in a specific area on the panorama image information displayed on the display unit 160, The control unit 180 confirms (or determines) whether or not the code type preset for the specific area (or the type of the temporary marker corresponding to the code type) matches the type of the selected object marker.

At this time, the controller 180 uses the drag and drop function of the display unit 160 to select one of the object markers in the third region (or the object marker display region) (Or a specific position) on the first area (or the image display area) by the drag-and-drop function after the object marker is dropped (or dragged) And the type of the selected one of the object markers may be compared with each other.

In this way, the control unit 180 determines whether or not the object marker to be placed in the specific region (or the specific position) is the same as the temporary marker set in advance corresponding to the specific region (or the same / similar field / Category).

If the code type corresponding to the selected specific region (or specific position) is no related data or the code type corresponding to the selected specific region (or specific position) and the code type corresponding to the selected specific region If the types of the object markers do not match, the control unit 180 displays information indicating that the object marker setting has failed in a pop-up form or the like on a part of the display unit 160 or displays the information in the image display area.

When the preset confirmation button is selected on the display unit 160, the controller 180 releases the selected object marker (or the dropped object marker is displayed on the display unit 160) The object markers are deleted, the temporary markers corresponding to the selected specific regions (or specific positions) are continuously displayed, and the state is switched to the state for selecting the object markers.

If the code type corresponding to the selected specific region (or specific position) matches the type of the selected object marker, the control unit 180 determines whether the code region corresponding to the specific region (or the specific position) Or a specific position). Here, the controller 180 may arrange the object markers at other predetermined positions corresponding to the specific area / specific position. At this time, the controller 180 deletes the temporary marker located at the specific region (or the specific location) according to the arrangement of the object markers.

When the verification (or confirmation) of the object marker to be placed in the specific area is completed normally, the controller 180 replaces the temporary marker corresponding to the specific area with the object marker (or updates / / Change / apply).

In addition, the control unit 180 may display any one or more of the one or more object markers displayed in the third area (or the object marker display area) according to the user input (or control / operation command / user touch / When a specific region (or a specific position) on the first region (or the image display region) is selected after one object marker is selected, the object marker is placed in the specific region (or a specific position). Here, the controller 180 may arrange the object markers at other predetermined positions corresponding to the specific area / specific position. At this time, the type of the object marker may be any one of a shop camera, a product, a company, a promotion, and a creator. In addition, the edges of the object markers can be subjected to solid line processing.

At this time, the controller 180 determines whether any one of the object markers in the third region (or the object marker display region) is selected (or dragged) using the drag and drop function for the display unit 160 (Or a specific position) on which the object marker is dropped when the object marker is dropped to a specific area (or a specific position) on the first area (or the image display area) by a drag and drop function It can also be deployed.

In this manner, when the panorama image information includes the temporary marker, the controller 180 can replace (or dispose) the corresponding temporary marker with the same type of object marker as the temporary marker.

When the temporary marker is not included in the panoramic image information, the controller 180 may arrange the object marker according to the user's selection at a specific position in the panoramic image information.

In addition, even when the panorama image information includes the temporary marker, the controller 180 disposes the object marker according to the user selection at another specific position where the corresponding temporary marker is not located, You can also replace (or place) the corresponding temporary marker with another object marker.

In this way, depending on whether the temporary marker is included in the panoramic image information, the controller 180 replaces the temporary marker and arranges object markers of the same type as the corresponding temporary marker, Markers can be placed.

When the object marker positioned (or arranged) in the first area (or the image display area) displayed on the display unit 160 is selected (or touched / double-clicked) (Or the user touch / user selection), the attribute information for the selected object marker is set. Here, the attribute information for the object marker may differ depending on the type of the object marker.

That is, when the object marker is a commodity, the controller 180 displays an image, a commodity name, a commodity unique code, price information, a moving image link / addition, a detailed description, a catalog, (Or edit / modify / delete / add).

If the object marker is a shop camera, the control unit 180 sets (or edits / corrects / deletes / adds) at least one camera link among at least one camera related to the corresponding panorama image.

If the object marker is a business (or business information), the control unit 180 displays a business name, an image of the business, a business logo, a company unique code, a video link / addition related to the business, Set (or edit / modify / delete / add) the details of stored company details page address link.

If the object marker is an event (or event information), the control unit 180 sets an event name, an image / movie for the event, an event specific code, an event description, an event detail description page address link stored externally, (Or edit / modify / delete / add).

In addition, when the object marker is a promotion (or promotion information / event / event information), the controller 180 displays one or more pieces of promotion information previously stored in the storage unit 150 on the display unit 160. Also, the controller 180 confirms a specific promotion (or specific promotion information) according to the user's selection from the one or more promotional information displayed on the display unit 160. In addition, the controller 180 sets (or edits / edits / edits) the promotional name included in the selected promotion information, the image / video for the promotion, the promotion unique code, the description of the promotion, Deletion / addition).

If the object marker is a creator, the controller 180 displays one or more creator (or shopping host) information stored in the storage unit 150 on the display unit 160. Also, the controller 180 confirms a specific creator (or specific creator information) according to the user's selection from one or more pieces of creator information displayed on the display unit 160. [ Further, the control unit 180 sets (or edits / corrects / deletes / adds) the creator name, image (or moving picture), creator unique code, creator description, and the like included in the selected creator information.

In addition, the controller 180 may set (or check) a specific object marker size (or object marker size information) for setting the size of the object marker according to the user's selection among the plurality of object marker sizes displayed on the display unit 160 )do.

In addition, the controller 180 may select an object marker according to the user input, arrange the selected object marker in a specific area on the first area (or the image display area), and set property information on the disposed object marker , And arranges object markers and attribute information for all temporary markers included in the selected panorama image information to edit (or create / author) the MR contents.

In this way, in the state where the panorama image information including one or more temporary markers is displayed in the first area (or the image display area) of the display unit 160, The process of arranging the object markers by replacing the at least one temporary marker according to the touch point, and setting the attribute information for the disposed object markers is performed for all temporary markers included in the panorama image information.

If the temporary marker is changed (or replaced / replaced / arranged) with the object marker in a state that the panoramic image information is moving, the controller 180 may generate unique identification information of the code corresponding to the temporary marker (Or the unique identification information of the code related to the area / position in which the object marker is disposed)), information relating to the corresponding temporary marker and code included in the moving picture is stored in the object marker Object markers) all at once (or matched / synchronized / updated).

When the object marker is placed in the state that the panorama image information is moving, the control unit 180 displays the unique identification information of the code corresponding to the object marker (or a code related to the area / (Or the attribute information of the object marker is included in the area / position where the object marker in the moving image is disposed) based on the unique identification information of the object marker (Or matching / interlocking / updating / applying) all at once. At this time, the controller 180 may further apply the set object markers to pre / post frames by a preset number of frames based on the position of the object markers in the moving image.

When the object marker is placed on the display unit 160 or when the setting of the attribute information for the object marker disposed on the display unit 160 is completed, the controller 180 displays the image corresponding to the object marker / The object included in the moving picture (or the code related to the object, the temporary marker related to the object / code) and the object marker are linked and stored.

At this time, the controller 180 extends the outline of the disposed object marker to the outline of the object corresponding to the temporary marker related to the object marker included in the image / moving image. That is, the controller 180 stores the coordinate values of the outline of the disposed object markers with the coordinate values of the outline of the object corresponding to the temporary marker associated with the object marker.

For example, when the event information object marker is disposed by replacing the temporary marker related to the object corresponding to the ABCD signboard, and the attribute information setting for the arranged event information object marker is completed, (Or extend) the coordinate value of the outline of the event information object marker with the coordinate value of the outline of the ABCD signboard.

In this way, by extending the outline of the object marker to the outline of the object related to the object marker, it is possible to obtain the effect of selecting the object marker even if the object is later selected.

When a preset preview menu (or button) displayed on the display unit 160 is selected, the controller 180 displays a result screen for one or more object markers arranged in the panorama image information in a pop-up form or the like And displays it on the display unit 160.

That is, when a predetermined preview menu (or button) displayed on the display unit 160 is selected, the controller 180 displays the result image of the MR content (or the one or more object markers disposed in the panorama image information) Attribute information) on the display unit 160 in a preview form.

When the preset storage menu (or button) displayed on the display unit 160 is selected, the controller 180 displays a plurality of panorama image information on the panorama image information of the first region (or the image display region) (Or one or more) object markers. At this time, the MR content may include at least one of a panorama image information (e.g., image / video), a code related to an object included in the image / video, unique identification information of the code, , Temporary marker corresponding to the type of code, positional information of the temporary marker in the image / video, category information related to the image / video (including major classification, middle classification, small classification information, etc.), camera number, (Including, for example, VOD, live broadcasting, unsetting, etc.)), an object marker corresponding to the type of code, an object marker For example, a shop camera, a product, a business, a promotion, a creator, etc.), position information of an object marker in an image / video, and attribute information of an object marker The.

That is, when the preset storage menu displayed on the display unit 160 is selected, the controller 180 displays, for all temporary markers included in the panorama image information of the first area, It is checked whether or not the setting of the attribute information of the object marker is completed.

If it is determined that all the temporary markers included in the panorama image information of the first area are not completely set in accordance with the user's selection and the attribute information setting of the object marker, ) Displays, on the display unit 160, a temporary marker for which object marker placement and / or attribute setting of the object marker is not completed among all the temporary markers, and attribute information setting of the object marker and / or object marker is completed Guidance information on the arrangement of object markers for temporary markers that are not used and / or attribute information setting of object markers is displayed on one side of the display unit 160. [

If it is determined that all the object markers included in the panorama image information of the first area are not completely set according to the user's selection and the attribute information setting of the object marker, A temporary marker for which object marker placement and / or attribute setting of the object marker is not completed among all the temporary markers, one or more object markers for which property information setting is not completed among the plurality of newly arranged object markers, Information on the arrangement of the object markers and / or the attribute information of the object markers for the temporary markers for which the object markers are arranged and / or the attribute information setting of the object markers is not completed, Information on the setting of the attribute information of the object marker whose information setting is not completed is displayed on one side of the display unit 160 Displays.

If it is determined that all the temporary markers included in the panorama image information of the first region are completely set according to the user's selection and attribute information setting of the object marker, (Or one or more) object markers disposed on the panoramic image information of the region 1 (or the image display region).

When the preset storage menu is selected, the controller 180 determines whether the property markers of all the object markers included (or arranged) in the panorama image information of the first area are completely set Check whether it is in a state.

If it is determined that all of the object markers included in the panorama image information of the first area are not completely set, Displays one or more object markers for which the setting is not completed on the display unit 160 and displays guidance information on attribute information setting of object markers for which attribute information setting of the object information is not completed on one side of the display unit 160 do.

If it is determined that all the object markers included in the panorama image information of the first area are completely set, the controller 180 controls the first area (or the image display area < RTI ID = 0.0 > (Or one or more) object markers disposed on the panoramic image information of the MR image.

When the panorama image information is a moving image and one or more object markers are arranged in a specific screen (or a specific image) in the moving image, and the preset storage button is selected in a state where property information setting of the object marker is completed, ) Includes code and temporary markers included in the moving picture based on the unique identification information of the code related to the temporary marker in which the object marker is disposed (or the unique identification information of the code related to the area / position where the object marker is disposed) (Or matching / updating / updating / updating) the related information to the set object marker (or the object marker including the attribute information of the object marker).

In this case, even if the object marker arrangement and attribute information setting process are not completed for all the temporary markers included in the panorama image information in the state where the temporary storage item is additionally included in the setting area, The controller 180 may temporarily store the object marker arrangement and property information set up to the point in time, the information about the remaining temporary markers that are not set as object markers, and the like in the storage unit 150 .

When the panorama image information is a moving image and one or more object markers are arranged in a specific screen (or a specific image) in the moving image, and the preset storage button is selected in a state where property information setting of the object marker is completed, Based on the unique identification information of the code corresponding to the object marker (or the unique identification information of the code related to the area / position where the object marker is disposed / the information about the area / position where the object marker is disposed) (Or matching / updating / updating / applying) all of the object markers (or object markers including the attribute information of the object markers) set in the area / position where the object markers in the video are arranged do. At this time, the controller 180 may apply and store the object markers set in pre / post frames by a predetermined number of frames based on the position of the object marker in the moving image.

When the exhibition management item included in the application execution result screen displayed on the display unit 160 is selected, the control unit 180 newly adds one or more pieces of exhibition-related information based on the user's input.

In addition, when the exhibition management item displayed on the display unit 160 is selected, the control unit 180 displays the category information of the specific panorama image information selected from the one or more panorama image information stored in advance in the storage unit 150, (Or interlocking / matching), changing (or updating), or deleting an exhibit item, and the like.

When the MR content distribution item included in the application execution result screen displayed on the display unit 160 is selected, the control unit 180 controls one or more other terminals connected through the communication unit 130, the server 200, (Or sharing) at least one of the MR contents stored in the storage unit 150 to the Social Networking Service (SNS) related to the terminal 100.

In this way, the controller 180 generates the MR content and provides the generated MR content to the server 200 or another terminal through the communication unit 130.

The MR content included in the information described in the embodiment of the present invention may be MR content generated at the terminal 100 or MR content generated at another terminal.

When a terminal 100 receives a keyword corresponding to a user input (or a user selection / touch) of the terminal 100, the terminal 100 may transmit an arbitrary object (e.g., a face, a fingerprint, (E.g., tagged / attached to a product / shelf, etc.), the controller 180 controls the received keyword, the location information of the terminal 100 to be checked in real time, To the server 200 through the communication unit 130. [0050] FIG. At this time, the identification information of the terminal 100 includes an MDN, a mobile IP, a mobile MAC, a SIM (Subscriber Identity Module) card unique information, and a serial number.

Here, the keyword includes a character type keyword according to a user input, a voice type keyword according to a user input, and the like.

Also, when the terminal 100 receives the voice information including the keyword of the voice type according to the user input, the controller 180 performs the voice recognition function on the received voice information.

Also, the controller 180 confirms the keyword as a result of performing the voice recognition function.

The control unit 180 may transmit the identified keyword, the location information of the terminal 100, the identification information of the terminal 100, and the like to the server 200 through the communication unit 130.

In addition, when receiving image information including an object such as a face, a fingerprint, a product, and a building through the input unit 110, the controller 180 determines whether the received image information includes a pattern recognition Function.

In addition, the controller 180 confirms the pattern information that is the result of performing the pattern recognition function.

The control unit 180 may transmit the confirmed pattern information, the location information of the terminal 100, the identification information of the terminal 100, and the like to the server 200 through the communication unit 130.

The control unit 180 extracts one or more minutiae of a face, a fingerprint, and the like according to the scan when the scan function is performed on a face or fingerprint of a person, To the server 200 together with the location information of the terminal 100.

In addition, when recognizing a tag (for example, a bar code, a QR code, and the like) through the reader 120, the controller 180 identifies information (or pattern information) included in the recognized tag.

The control unit 180 may transmit the confirmed pattern information, the location information of the terminal 100, the identification information of the terminal 100, and the like to the server 200 through the communication unit 130.

Also, the controller 180 may receive one or more pieces of information (or information) transmitted from the server 200 in response to the previously transmitted keyword, the pattern information, the location information of the terminal 100, the identification information of the terminal 100, The location information of the terminal 100 and at least one information corresponding to the keyword) through the communication unit 130. [

Also, the controller 180 outputs the received one or more pieces of information through the display unit 160 and / or the audio output unit 170. Herein, the information (or contents) includes business information, product information, service information, personal information, and the like registered by an arbitrary company official or a general user in the server 200. The information may include at least one of panorama image information related to the keyword / pattern information corresponding to the arbitrary company-related person or the general user, a code related to the object included in the panorama image information, an object marker corresponding to the type of the code, (Or information including the MR content) including positional information of the object marker in the moving image, attribute information of the object marker, and the like.

The control unit 180 transmits category information transmitted from the server 200 in response to the previously transmitted keyword, the pattern information, the location information of the terminal 100, the identification information of the terminal 100, (130).

Also, the controller 180 outputs the received category information through the display unit 160 and / or the audio output unit 170. Here, the category information may be category information related to the keyword and / or the pattern information.

In addition, the control unit 180 may operate, in cooperation with the server 200, at least one piece of category information corresponding to a specific category selected according to a user selection (or a user touch / input) Through the display unit 160 and / or the audio output unit 170.

That is, when a specific category is selected from the category information displayed on the display unit 160, the controller 180 transmits information on the selected specific category to the server 200 through the communication unit 130. [

Also, the controller 180 receives at least one piece of information related to the selected specific category transmitted from the server 200 via the communication unit 130 in response to the transmission.

Also, the controller 180 outputs the received at least one information through the display unit 160 and / or the audio output unit 170.

When the specific information is selected from the at least one information displayed on the display unit 160, the controller 180 displays the selected specific information (or detailed information on the selected specific information) on the display unit 160 and / / RTI > and / or through the audio output 170.

In addition, when a preset event is detected while information is being displayed on the display unit 160, the controller 180 performs a predetermined function corresponding to the event. Here, the event may include a plurality of items included in the information displayed on the terminal 100 (for example, an AR route search item (or menu), a content information item, a map information item, a coupon information item, (Or selection / click) on any one of the item (e.g., item, blog connection item, social network service connection item, etc.) Down (or up / down / left / right) direction of the terminal 100 when a tilt exceeding a predetermined threshold value in the up / down / left / right directions of the terminal 100 is detected, (Or movement) of the terminal 100 by a predetermined number of times in the clockwise / anticlockwise direction in the case where a movement (or shake / vibration) of more than a predetermined number of times in the left / Detected Wu, and the like if a touch gesture by a user of the terminal 100 is detected. At this time, the touch gesture by the user of the terminal 100 includes a tap, a touch & hold, a double tap, a drag, a flick, a drag and drop, a pinch and a swipe.

That is, when a plurality of items included in the information (for example, AR route guidance item (or menu), content information item, map information item, coupon information item, currency item, (Or a selection / click) is detected for any one of the items (e.g., a message sending item, a blog connection item, and a social network service connection item), the control unit 180 controls the content Through the display unit 160 and / or the audio output unit 170.

When a touch (or a select / click) of a button (or a menu) provided in the terminal 100 is detected while information is being displayed on the display unit 160, And outputs the content related to the button through the display unit 160 and / or the audio output unit 170.

When the tilt of the terminal 100 in the upward, downward, leftward, and rightward directions is detected in a state where information is being displayed on the display unit 160, And outputs a predetermined content corresponding to the tilt through the display unit 160 and / or the audio output unit 170. [

(Or swing / vibration) of the terminal 100 by a predetermined number of times in the up / down (or up / down) direction or the left / right direction or the diagonal direction of the terminal 100 while the information is displayed on the display unit 160, The controller 180 outputs other preset contents through the display unit 160 and / or the audio output unit 170 in response to movement in a specific direction.

In addition, when a predetermined number of rotations (or motions) of the terminal 100 in the clockwise / anticlockwise direction are sensed while information is being displayed on the display unit 160, the controller 180 controls the clock / And outputs another preset content corresponding to the rotation in the clockwise direction through the display unit 160 and / or the audio output unit 170. [

When the touch gesture by the user of the terminal 100 is detected while information is being displayed on the display unit 160, the controller 180 may display another content preset in correspondence with the touch gesture, (160) and / or the audio output unit (170). At this time, the touch gesture by the user of the terminal 100 includes a tap, a touch & hold, a double tap, a drag, a flick, a drag and drop, a pinch and a swipe.

Quot; tap " means an operation in which a user touches a screen (including an object, a place name, additional information, and the like) using a finger or a touch tool .

&Quot; touch & hold " means that a user touches a screen (e.g., an object, a place name, additional information, etc.) using a finger or a touch tool 2 seconds) or more. That is, the time difference between the touch-in point and the touch-out point is equal to or greater than a threshold time (for example, 2 seconds). In order to allow the user to recognize whether the touch input is a tap or a touch & hold, the feedback signal may be provided visually, audibly or tactually when the touch input is maintained for a predetermined time or more. The threshold time may vary depending on the implementation.

&Quot; Double tap " represents an operation in which a user touches a screen (including an object, a place name, additional information, and the like) twice with a finger or a stylus.

A " drag " is a method in which a user touches a finger or a touch tool on a screen (e.g., an object, a place name, a side information, etc.) and then moves the finger or the touch tool to another position Operation. The object is moved due to the drag operation or a panning operation to be described later is performed.

A " flick " means that a user touches a finger or a touch tool to a screen (e.g., an object, a place name, additional information, etc.) ). ≪ / RTI > It is possible to distinguish the drag (or panning) from the flick based on whether the moving speed of the finger or the touch tool is equal to or greater than a critical speed (for example, 100 pixel / s).

&Quot; Drag & drop " means an operation in which a user drags an object (including an object, a place name, additional information, and the like) to a predetermined position using a finger or a touch tool and then releases the object.

A " pinch " indicates an operation in which a user moves two fingers in different directions while touching them on a screen (e.g., including an object, a name, and additional information).

A "swipe" is an operation of moving a certain distance in a horizontal or vertical direction while touching an object (for example, an object, a place name, additional information, etc.) on the screen with a finger or a touch tool. Motion in the diagonal direction may not be recognized as a swipe event.

In addition, when the function corresponding to the event (or the touch gesture) is terminated, the controller 180 returns to the augmented reality image, which is the image before the event is detected, or the augmented reality image, in which the additional information is displayed.

That is, when the selected state of the specific object, the specific additional object, or the specific additional information is released, the controller 180 displays the augmented reality image, which is the image before the event detection, or the augmented reality image, Return.

If the predetermined time has elapsed since the touch gesture detection by the user of the terminal 100, the control unit 180 sets the augmented reality image, which is the image before the event detection, or the augmented reality image, Return.

When the controller 180 displays route guidance information from the current location of the terminal 100 to the destination according to the detection of the event, And displays the view (or street view / road view / foreground view) on the display unit 160. At this time, the aerial view, the street view, the road view, the panoramic view, and the like may be virtual reality or may be an image (or image) photographed in advance through a camera or the like.

The road view (or the road view / foreground view) may be displayed on a road (or a lead), a building, or the like by the terminal 100 (Not shown) or the like provided on the display unit (not shown).

In addition, when the user views an image of an area where the terminal 100 is located through the camera, the controller 180 displays an image (for example, a street view (or a road view / foreground view)) confirmed through the camera And displays it on the display unit 160 (or a view finder).

In addition, the controller 180 controls the current position of the terminal 100, information about the object in the displayed street view (or the road view / foreground view) (for example, the street view (or the road view / foreground view) And the like), and the like, and confirms the augmented reality information related to the corresponding street view.

In addition, the controller 180 applies the identified augmented reality information to the street view (or the road view / foreground view), and displays an image to which the augmented reality information is applied on an image previously confirmed through the camera 130, And displays it on the display unit 160.

As described above, in the embodiment of the present invention, the aerial view, the street view, the road view, and the panoramic view can be provided in the form of real images, virtual reality, augmented reality and the like.

The controller 180 controls the display of the current position of the terminal 100 on the screen displayed on the terminal 100 (or the position and coordinate information related to the avatar / the screen on the screen) transmitted from the server 200 And receives at least one event information related to the location through the communication unit 130.

In addition, the control unit 180 may receive at least one of the received event information and the event information of the terminal 100 (or the avatar / position and coordinate information related to the avatar / corresponding screen on the screen) displayed on the display unit 160 And generates at least one route information corresponding to the at least one event information based on the current location. Here, the route information may include information on driving (or driving) of the lane information, the road information, the traveling speed limit information, the turn-by-turn information, the traffic safety information, the traffic guidance information, the vehicle information, And movement information).

The control unit 180 overlaps the event name and the generated at least one route information on the screen of the display unit 160 (for example, an aerial view, a street view, a road view, a foreground view, do. Here, the route information may be displayed in the form of an arrow or line in the form of a turn-by-turn for going to a destination corresponding to the event information.

In addition, when the event name and the at least one route information are overlapped and displayed on the screen of the display unit 160, the control unit 180 may display an event end (or an end) event based on the event period and the event time period information in the event information (Or when the event period and the event time zone are within a predetermined threshold value), the thickness of the arrow or line included in the corresponding route information is displayed in a relatively bold manner, The thickness of the arrow or line included in the path information can be displayed relatively thinly as compared with the case where the end of the event is imminent.

As described above, in the embodiment of the present invention, in a state where the terminal 100 displays a screen represented by virtual reality or augmented reality, at least one event corresponding to the position of the terminal 100 or the avatar on the screen When the information exists, the terminal 100 receives at least one event information provided from the server 200, generates at least one path information corresponding to the received at least one event information, An event name corresponding to the generated at least one route information and event information is displayed on the screen in an overlapping manner. However, the present invention is not limited to this, Whether there is event information corresponding to the position of the terminal 100 or the avatar on the screen is checked in advance , It may generate the path information in the presence of the event information corresponding to the position of the terminal 100 or avatar on the screen and configured to display the path information and an event name applied screen.

The terminal 100 may receive a plurality of event information from the server 200 and store the event information in the terminal 100 so that the terminal 100 displays the event information on the screen displayed on the terminal 100, And generates at least one route information corresponding to the at least one event information when at least one event information corresponding to the location of the avatar exists and displays the generated one or more route information on the screen displayed on the terminal The load of the server 200 may be reduced.

In the embodiment of the present invention, the terminal 100 generates at least one path information based on at least one event information provided from the server 200, and then transmits the generated at least one path information to the screen The server 200 generates at least one route information based on the at least one event information and the location information of the terminal 100 and the avatar 100. However, And provides the generated at least one path information to the terminal 100. At this time, the server 200 generates a new screen by overlapping the generated at least one path information on the screen, and transmits the generated screen (or the screen on which the at least one path information is applied) to the terminal 100 ). Thereafter, the terminal 100 receives at least one route information provided from the server 200, and overlaps and displays the received at least one route information on the screen displayed on the terminal 100 have.

When the application state of the at least one event information is changed as the location of the terminal 100 or the avatar is changed on the screen to which the event name and the generated at least one route information are applied, May generate path information according to the changed event information, delete the path information corresponding to the event information for which the application of the event information is canceled, and display the path information according to the generated changed event information.

For example, in the 3D panorama image on the first floor lobby of the AAA department store, the first route information related to the discount event of the underground first floor fishery corner and the second route information related to the discount event of the ground third floor clothing corner are displayed The 3D panorama image in the lobby of the first floor of the department store is moved (or screen switched) according to the user's control (or user touch), and the 3D panorama image moved forward by 50 meters in the lobby on the first floor of the department store and moved to the escalator Or a 3D panoramic image related to the escalator of the first floor of the AAA department store) is displayed, the terminal 100 selects one of the plurality of event information corresponding to the position of the avatar in the 3D panorama image related to the escalator of the AAA department store, The server 200 receives the above event information. At this time, one or more event information corresponding to the position of the avatar in the 3D panorama image related to the escalator of the AAA department store 1 floor may include at least one event information corresponding to the position of the avatar in the 3D panorama image in the lobby of the first floor of the AAA department store Compared with the event information, event information related to the discount event at the first floor of the basement is kept as it is, but event information related to the discount event of the 3rd floor garment corner on the ground is not included. Instead, Of the event information. In addition, the terminal 100 generates the eleventh route information related to the discount event of the underground one-storey marine product corner based on the received one or more event information, And generates path information. In addition, the terminal 100 overlays and displays the generated eleventh route information, the twelfth route information, and the like on the 3D panorama image related to the escalator of the first floor of the AAA department store.

At least one of the plurality of event information related to the position information of the terminal 100 or the avatar is selected based on the position information of the terminal 100 or the avatar in the screen currently displayed on the terminal 100 The terminal 100 can generate the route information by applying the corresponding event information in real time and display the generated route information.

That is, the terminal 100 can provide real-time route information according to the current position of the terminal 100 or the avatar by applying an interactive concept according to the movement of the terminal 100 or the avatar.

When the current position of the terminal 100 or the avatar on the screen displayed on the terminal 100 in the state where the time sale event is registered in the server 200 is included in the area related to the time sale event, The terminal 100 receives time sale event information provided from the server 200. Here, the time sale event (or time sale event) may be an event that discounts prices of some goods or services while setting a time zone.

In addition, the terminal 100 may further display the received type sale event information on the other side of the screen to which the event name and the generated at least one route information are applied.

In addition, when the time sale event information displayed on the terminal 100 is selected, the terminal 100 displays a detailed screen for the selected time sale event information, or displays a 3D panorama image related to the selected time sale event information Display the image.

In addition, when a state in which any one of the path information displayed on the display unit 160 is selected (or touched / clicked) is maintained, the control unit 180 controls the display unit 160 to display the start / The remaining distance from the position on the screen (or the current position of the avatar in the terminal 100 / screen) corresponding to the at least one route information to the destination corresponding to the selected route information, (Or average travel time information), event information related to the route information, and the like are displayed on one side of the screen in which at least one route information of the display unit 160 is displayed in an overlapped manner, (Or an automatic traveling function) at a predetermined speed up to a predetermined speed is continuously displayed on the display unit 160 .

In addition, the controller 180 senses a pressure for a touch state in which one of the path information selected from the at least one path information displayed on the display unit 160 is selected. Also, the controller 180 may perform another function depending on the sensed pressure (or the pressure of the touch).

That is, in a state in which one path information is selected (or touched / clicked) from at least one path information displayed on the display unit 160, the control unit 180 determines whether the path information included in the terminal 100 (Or touch) through a sensor unit (not shown).

If the sensed pressure is less than or equal to a predetermined reference value, the controller 180 determines whether the at least one route information corresponding to the departure point (or the reference point / start point) The remaining distance to the destination corresponding to the route information, the average travel time information (or the average travel time information) to the destination, and the event information related to the route information are displayed on one side of the screen And continuously displaying a screen on which the automatic moving function (or the automatic driving function) is performed at a predetermined speed from the position on the screen to the destination.

If the sensed pressure is greater than a preset reference value, the control unit 180 displays a screen related to the final destination corresponding to the selected route information on the screen to which at least one route information displayed on the display unit 160 is applied And displays it on the display unit 160.

In addition, when the selected route information for the display unit 160 is released, the controller 180 controls the display unit 160 to display a route to the destination displayed on the display unit 160 Stops the display of the screen according to the automatic moving function (or the automatic driving function) of the at least one route information, and displays the screen in which the at least one route information is displayed in an overlapped manner on the display unit 160.

The server 200 communicates with the terminal 100 and the like.

In addition, the server 200 may store at least one store on an offline or street store through a plurality of cameras (not shown) included in the server 200, a merchandise, an exhibition merchandise, a POP, a flyer, A first image and a second image including an advertisement, a poster advertisement, a signboard, a price tag, and the like are photographed. Here, the store includes a department store, a shopping mall, an outlet, a restaurant, a hospital, a building (or a building), and the like. At this time, the server 200 confirms position information (for example, GPS position information and the like) of a point at which the first image and the second image are photographed, and transmits the identified position information to the first image (Or interlocked) with the second image and stores the same.

Here, the POP (Point of Purchase) represents an advertisement providing information on goods and / or services on the spot to the customer who visited the store. Also, the leaflets (or flyer advertisements / leaflets / flyer advertisements) represent a simple printed matter that is distributed for advertising or publicity purposes. In addition, the banner advertisement is an advertisement provided at a specific location of a store to provide information on a specific product and / or service. In addition, the poster billing refers to a paper made and adhered to an advertisement, and it is produced in consideration of characters, figures, and sentences so as to appeal to the viewer. In addition, the signboard indicates a plate indicating a company name, a store name, a product name, a service name, etc. related to a store.

In addition, the server 200 acquires the overlapped region in which the first image and the second image are superimposed on the photographed first image and the second image based on the directionality of the pixel.

In addition, the server 200 generates the preliminary panoramic image by synthesizing the first image and the second image based on the obtained overlapping area. At this time, the server 200 may generate the preliminary panoramic image by synthesizing the photographed first image and the second image by various previously known synthesis methods. At this time, the generated preliminary panoramic image includes (or interlocks / matches) positional information about a first object, a product, a point (or coordinates) included in the preliminary panoramic image, and the like.

That is, the preliminary panoramic image can be used to search (or check) a 3D panoramic image corresponding to not only the image but also position information of an arbitrary terminal (for example, the location information of the purchasing terminal 100) And position information on a first object, a product, a point, and the like included in the panoramic image.

In the embodiment of the present invention, the preliminary panoramic image is generated by combining the first image and the second image on the basis of the obtained overlap region, but the present invention is not limited thereto, The preliminary panoramic image may be generated by synthesizing the photographed first image and the second image by various previously known synthesis methods.

At this time, the server 200 may be based on a first image and a second image photographed through a plurality of cameras (for example, a special device for photographing a 3D panorama image, a plurality of cameras configured by a special vehicle, etc.) The preliminary panoramic image may be generated.

In addition, the server 200 recognizes one or more first objects included in the preliminary panoramic image. Here, the first object may be a store located on the off-line, a point-of-purchase (POP), a leaflet, a banner, a poster positioned on the off- A poster, a signboard, a price tag, and the like. At this time, the first object in the present invention may include or exclude goods and services provided by each store. In addition, the POP, shear, banner advertisement, poster advertisement, signboard and the like represent a discount event code, and the price tag may represent a product code.

That is, the server 200 recognizes one or more stores included in the preliminary panoramic image, or recognizes POP, flyer, banner advertisement, poster advertisement, signboard, price tag, etc. included in the preliminary panoramic image.

In addition, the server 200 may store sales advertisements, enlarged images, videos (or promotional videos), coupons (including discount coupons, free coupons, etc.), donations, and comments corresponding to the recognized one or more first objects (Or inserts) another object for screen switching and / or another additional object for screen switching to a partial area on the first object in the preliminary panoramic image, or to add (Or inserts) the 3D panorama image to generate a 3D panorama image.

That is, the server 200 adds (or inserts) an object related to the sales advertisement corresponding to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image, (Or inserts) them adjacent to each other within a predetermined distance to generate a 3D panoramic image. Here, the sales advertisement includes POP, flyer, banner advertisement, poster advertisement, signboard, price tag, and the like.

In addition, the server 200 may add (or insert) an object for providing a magnified image corresponding to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image, The 3D panorama image is generated by adding (or inserting) the objects adjacent to each other within a predetermined distance from the object. Here, the enlarged image may be an internal photograph (or an additional image related to a product) of a product such as a refrigerator or a washing machine, or may be an enlarged photograph of a fresh food.

In addition, the server 200 may add (or insert) an object for providing a moving image (or a promotional movie) corresponding to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image Or inserts (or inserts) the objects in a neighborhood within a predetermined distance from the first object to generate a 3D panoramic image. Here, the video (or the video for promotional use) may include a video related to the product and / or service, a video related to the usage of the product (e.g., a video about how to use cosmetics, , Video on tool usage, video on cooking method, etc.), and may include text and / or voice messages.

In addition, the server 200 may add (or insert) an object for providing a coupon corresponding to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image, (Or inserts) the 3D panorama image within a predetermined distance from the 3D panorama image. Here, the coupon is a coupon to which a discount is applied when a corresponding commodity is purchased. In case of a plurality of coupons, the coupon is arranged in order by a slide method, and may be downloaded to the purchasing terminal 100 according to a user's selection.

In addition, the server 200 may add an object for providing goods and / or service information related to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image Or inserts (or inserts) the 3D panorama image into the 3D object within a predetermined distance from the first object. Herein, the base displays detailed guide information on base information to be applied when purchasing a corresponding commodity, and may be in a state of being arranged in a slide manner in a plurality of cases.

In addition, the server 200 may add (or insert) an object for providing comment information on a product and / or service related to the recognized one or more first objects to a partial area on the first object in the preliminary panoramic image, ) Or add (or insert) adjacent to the first object within a predetermined distance from the first object to generate a 3D panoramic image. Here, the comment includes information related to the corresponding goods and / or services (for example, a feeling of purchase, a review of the service, etc.) registered in another terminal that purchased the corresponding goods and / or services.

At this time, the object (and / or another additional object) added to the preliminary panoramic image information may be displayed in a state where light (or a specific color) is gradually The effect of repeatedly changing from the light-off state to the maximum state, the flickering effect of the light, the neon sign effect, and the effect of changing the color of the light to different colors at a predetermined cycle may be applied.

As described above, various effects can be applied to objects added to the preliminary panoramic image information and / or other additional objects to facilitate identification in the 3D panoramic image information.

The generated 3D panorama image includes (or interlocks / matches) position information about a first object, a product, a point (or coordinates) included in the 3D panorama image, and the like.

In addition, the server 200 may generate the 3D panoramic image for each language in consideration of language-specific characteristics.

The 3D panoramic image generated according to the embodiment of the present invention includes (or interlocks / matches) position information about a first object, a product, a point (or coordinates) included in the 3D panorama image, and the like.

That is, the 3D panorama image is not only the 3D panorama image but also the 3D panorama image corresponding to the arbitrary terminal (for example, the location information of the purchasing terminal 100) And location information about a first object, a commodity, a point,

Accordingly, when requesting a 3D panorama image corresponding to the position information from the arbitrary terminal, the server 200 selects one of the plurality of 3D panorama image information including position information of one or more objects, products, The 3D panorama image information corresponding to the specific location information requested from the arbitrary terminal can be confirmed and the 3D panorama image information can be provided to the corresponding terminal.

For example, in the server 200, an object corresponding to 123-45 of Gangnam-gu, Gangnam-gu, Seoul, which is the location information of the arbitrary terminal, among the 3D panoramic image information linked with the location information of a plurality of objects and / You can check the included 3D panorama image information.

If there is no object and / or product corresponding to 123-45 Gangnam-gu, Gangnam-gu, Seoul, which is the location information of the arbitrary terminal, among the 3D panoramic image information interlocked with the location information of the plurality of objects and / The server 200 may check the 3D panoramic image information including the object and / or the commodities similar to the position information of the arbitrary terminal (for example, 123-44 or 123-46 in Gangnam-gu, Seoul, Korea) .

When the plurality of 3D panoramic image information is matched with the GPS information configured at predetermined intervals, the server 200 generates the arbitrary 3D panorama image information based on the position information of the arbitrary terminal and the GPS information configured at the predetermined interval It is possible to confirm one 3D panorama image information corresponding to (or similar / related to) the position information of the terminal.

In addition, the 3D panorama image information corresponding to the specific position information among the plurality of 3D panorama image information stored in advance in the server 200 may be applied to the techniques utilized in the map search service.

As described above, the 3D panorama image information generated by the present invention is interlocked with the position information, and the 3D panorama image information, which is stored in advance in the server 200, for specific position information transmitted from an arbitrary terminal, The 3D panorama image information corresponding to the specific location information can be confirmed and the 3D panorama image information can be provided to the terminal that has transmitted the specific location information.

In addition, the server 200 repeatedly performs the preceding steps with a predetermined period (for example, 10 seconds, 1 minute, etc.) to generate a new 3D panorama image.

That is, the server 200 generates a new preliminary panoramic image by synthesizing images photographed in real time through the plurality of cameras at predetermined intervals (for example, 10 seconds, 1 minute, etc.) Recognizes one or more first objects included in the preliminary panoramic image, and adds the first code corresponding to the recognized one or more first objects to the new preliminary panoramic image to generate the new 3D panoramic image.

At this time, when a person is recognized in the generated new preliminary panoramic image, the server 200 acquires (or extracts) the outline of a person in the new preliminary panoramic image, and, in the new preliminary panoramic image, Removing the recognized person, adding a first code corresponding to the recognized one or more first objects and a contour of the acquired (or extracted) person in the new preliminary panorama image from which the person has been removed, And generates an image. Here, the server 200 adds the obtained contour of the person to the position of the person in the new preliminary panorama image.

In this way, when a person is included in the generated new preliminary panoramic image, the server 200 keeps only the outline of the person included in the new preliminary panoramic image for personal information protection, The inner area may be processed as an empty space or replaced with a screen of the immediately preceding preliminary panoramic image generated in the immediately preceding step.

In addition, the server 200 confirms the difference between the generated new 3D panorama image and the previously generated 3D panorama image (or the generated new 3D panorama image information and the previously generated 3D panorama image information).

In addition, the server 200 compensates for the identified difference in real time to the 3D panorama image generated in advance and maintains the latest 3D panorama image.

That is, if the generated new 3D panorama image and the previously generated 3D panorama image are the same (or there is no difference), the server 200 generates one or more first objects included in the previously created 3D panorama image, / Or the state of the product is not changed, and the 3D panorama image generated in advance is maintained as the latest 3D panorama image.

When there is a difference between the generated new 3D panorama image and the previously generated 3D panorama image, the server 200 compensates the changed part (or the identified difference) to the 3D panorama image generated in advance (Or reflects) the 3D panorama image to generate a new 3D panorama image that is compensated for the difference between the 3D panorama images to be compared.

If the new 3D panorama image includes a person (or a person is recognized in the new 3D panorama image), the server 200 stores the 3D panorama image generated in the new 3D panorama image, A 3D panoramic image including a contour shaped person may be generated as a newest new 3D panoramic image by adding a contour of a person.

In the case where a person is included in the generated new 3D panoramic image, the server 200 maintains only the outline of the person included in the new 3D panoramic image for personal information protection, The inner area can be processed as an empty space or replaced with a screen of the immediately preceding 3D panorama image generated in the immediately preceding step.

When the new 3D panorama image includes a person, the server 200 processes the person included in the new 3D panorama image, and the contour processed human inside area is displayed on the immediately preceding By displaying a screen of the 3D panoramic image, it is possible to prevent a case where an object, a product or the like in the 3D panoramic image is hidden by the person and is not seen.

At this time, the server 200 may compensate only the difference in the 3D panorama image generated in advance, and replace the generated new 3D panorama image with the new 3D panorama image that is generated in advance, instead of the 3D panorama image generated in advance You may.

In this way, the server 200 can maintain the latest 3D panorama image in real time through background modeling.

The server 200 receives the keyword, the pattern information, the location information of the terminal 100, the identification information of the terminal 100, and the like transmitted from the terminal 100.

Also, the server 200 determines whether there is information corresponding to at least one of the position information of the terminal 100 and the keyword and the pattern information among a plurality of pieces of information previously registered (or stored) in the server 200 (Or identifies) it. Here, the information includes business information, product information, service information, personal information, etc. registered in the server 200 by an arbitrary company official or a general user. The information may include at least one of panorama image information related to the keyword / pattern information corresponding to the arbitrary company-related person or the general user, a code related to the object included in the panorama image information, an object marker corresponding to the type of the code, Position information of the object marker in the moving image, attribute information of the object marker, and the like.

That is, the server 200 is located within a predetermined radius based on the position information of the terminal 100 among a plurality of pieces of information previously registered (or stored) in the server 200, (Or identifies) whether there is information corresponding to at least one. The predetermined radius may be a state previously set for each terminal by a user of the terminal 100 or may be set to a default value by an administrator of the server 200. [

As described above, the server 200 determines whether or not the pattern information including at least one feature point extracted through the scan function for the face of a person, fingerprint, etc., It is possible to judge whether or not there is an error.

When the determination result (or the identification result) indicates that there is information corresponding to at least one of the position information of the terminal 100 and the keyword and the pattern information among a plurality of pieces of information registered in advance in the server 200 , The server 200 transmits the one or more pieces of information to the terminal 100.

That is, the determination result (or the identification result) is located within a predetermined radius based on the position information of the terminal 100 among a plurality of information registered in advance in the server 200, and the keyword and / The server 200 transmits the one or more pieces of information corresponding to the location information of the terminal 100, the keyword, the pattern information, and the like to the terminal 100.

If there is no information corresponding to the position information of the terminal 100, the keyword, the pattern information, and the like among a plurality of pieces of information registered in advance in the server 200, The server 200 transmits the category information (or category list) set in advance to the server 200 to the terminal 100. Here, the category information may be category information related to the keyword and / or the pattern information.

That is, the determination result (or the identification result) is located within a predetermined radius based on the position information of the terminal 100 among a plurality of information registered in advance in the server 200, and the keyword and / If there is no information corresponding to the information, the server 200 transmits the category information (or category list) set in advance to the server 200 to the terminal 100. At this time, if the information corresponding to the keyword and / or the pattern information does not exist in a predetermined radius based on the position information of the terminal 100 among a plurality of information registered in advance in the server 200 , The server 200 further extends the radius and determines whether information corresponding to the keyword and / or the pattern information is present within the extended radius from a plurality of pieces of information registered in the server 200 May be further determined. Here, the radius expanding function may be repeated a predetermined number of times.

When the server 200 does not have information corresponding to at least one of the keyword, the pattern information, and the location information of the terminal among the plurality of information registered in advance in the server 200, (Or category list) preset in the terminal 200 to the terminal 100.

When the server 200 transmits the category information to the terminal 100, the server 200 transmits the category information preset in the server 200 to the terminal 100, And transmits category information related to the received keyword and / or the received pattern information to the terminal 100.

In a state where the terminal 100 has registered a pre-set preference category in the server 200, the terminal 200 may store the preference category in advance, based on the position information of the terminal 100, among a plurality of pieces of information registered in advance in the server 200 The server 200 transmits one or more pieces of information corresponding to the corresponding preference category registered in the server 200 to the terminal 200. In this case, 100 or whether or not there is a company (or a store) that has previously visited or performed a payment function in the terminal 100 based on the current location of the terminal 100, And may provide the terminal 100 with one or more pieces of information corresponding to the category related to the company that visited or performed the payment function.

In addition, the predetermined radius may be one or a plurality of different values (for example, 1Km, 2Km, 3Km, etc.).

In addition, when the predetermined radius is configured by a plurality of radii (for example, including a first radius, a second radius, a third radius, and the like) with different values, the server 200 first determines the most Selects a first radius which is a small value and determines whether or not information corresponding to the keyword exists in the first radius among a plurality of information registered in advance in the server 200. [ As a result of the determination, if the server 200 is positioned within the first radius and information corresponding to the keyword exists, the server 200 transmits the information to the terminal 100. As a result of the determination, if the server 200 is located within the first radius and does not have the information corresponding to the keyword, the server 200 obtains a second radius (e.g., The server 200 determines whether or not information corresponding to the keyword exists in the second radius among a plurality of pieces of information registered in advance in the server 200 . As a result of the determination, if the information corresponding to the keyword exists within the radius of 2, the server 200 transmits the information to the terminal 100. As a result of the determination, if the server 200 is located within the second radius and does not have the information corresponding to the keyword, the server 200 selects a third radius (e.g., The server 200 determines whether information corresponding to the keyword exists in the third radius from a plurality of pieces of information registered in advance in the server 200 And the like may be repeatedly performed.

Also, when the category information related to the pattern information can not be confirmed, the server 200 may not provide category information to the terminal 100.

In addition, the server 200 may transmit at least one piece of information corresponding to a specific category selected in accordance with a user selection (or a user touch / input) among category information displayed on the terminal 100 in cooperation with the terminal 100 To the terminal (100).

That is, when a specific category is selected according to the user's selection from the category information displayed on the terminal 100, the server 200 receives the information on the selected specific category transmitted from the terminal 100.

In addition, the server 200 may check at least one information related to the received specific category from a plurality of information registered in advance in the server 200, and may transmit at least one information related to the identified category To the terminal (100).

In this manner, when a plurality of pieces of information previously registered in the server are located within a predetermined radius based on the current position of the terminal and at least one piece of information corresponding to the keyword and / , Display predetermined category information, and provide at least one piece of information corresponding to a specific category selected from the displayed category information to the terminal.

In this manner, among a plurality of pieces of information registered in advance in the server, the information is located within a predetermined radius based on the current position of the terminal and at least one piece of information corresponding to a keyword and / or a recognized pattern according to user input of the terminal exists , It is possible to provide at least one corresponding information to the terminal.

Hereinafter, a control method of a content providing system to which a terminal according to the present invention is applied will be described in detail with reference to FIG. 1 to FIG.

3 is a flowchart illustrating a control method of a content providing system to which a terminal is applied according to an embodiment of the present invention.

First, when receiving a keyword according to a user input (or a user selection / touch) of the terminal 100 in the terminal 100, the terminal 100 searches for an arbitrary object (for example, a face, a fingerprint, (Including tags attached to / displayed on a product / shelf, etc.), the terminal 100 determines whether the received keyword, the pattern information related to the recognized pattern, The location information of the terminal 100, the identification information of the terminal 100, and the like to the server 200. At this time, the identification information of the terminal 100 includes an MDN, a mobile IP, a mobile MAC, a SIM (Subscriber Identity Module) card unique information, and a serial number.

Here, the keyword includes a character type keyword according to a user input, a voice type keyword according to a user input, and the like.

Also, when the terminal 100 receives voice information including a voice-like keyword according to the user's input, the terminal 100 performs a voice recognition function on the received voice information, And may transmit the identified keyword, the location information of the terminal 100, the identification information of the terminal 100 to the server 200, and the like.

When the terminal 100 receives image information including an object such as a face, a fingerprint, a product, and a building through the input unit 110 included in the terminal 100, Recognizes the pattern information as a result of the performed pattern recognition function, and outputs the confirmed pattern information, the location information of the terminal 100, the terminal information of the terminal 100, 100 to the server 200. The server 200 may be connected to the server 200 via a network.

When the terminal 100 recognizes a tag (for example, a bar code, a QR code, and the like) through the reader 120 included in the terminal 100, the terminal 100 transmits the recognized tag (Or pattern information) contained in the terminal 100, and transmits the confirmed pattern information, the location information of the terminal 100, the identification information of the terminal 100, and the like to the server 200.

For example, when the first terminal 100 receives a first keyword (e.g., a department store) of a character type according to a user input of the first terminal, (For example, a department store), location information of the first terminal (e.g., Teheran Road 201, Gangnam-gu, Seoul, Korea), information of the first terminal Identification information and the like to the server 200.

In another example, when the second terminal 100 receives voice information including a second keyword in the form of a voice in accordance with a user input of the second terminal (for example, Chul Soo Kim), the second terminal transmits, Check the real-time current location of the terminal (for example, 507 Nonhyeonro, Gangnam-gu, Seoul).

Also, the second terminal performs a voice recognition function on the received voice information, extracts (or discriminates) the second keyword (e.g., Kim Cheol-Soo) according to a result of performing the voice recognition function, To the server 200, a second keyword (e.g., Kim Chul-soo), the location information of the second terminal (e.g., Nonhyeonro 507, Gangnam-gu, Seoul) and the identification information of the second terminal .

As another example, when the third terminal 100 receives the third image information of the face of the CCC entertainer in the magazine by the input unit 110 included in the third terminal, 3 Check the real-time current location of the terminal (eg Yeoksam-ro 101, Gangnam-gu, Seoul).

In addition, the third terminal extracts feature points for a face of the CCC entertainer, which is an object included in the received third image information, generates third pattern information including the extracted feature points, Pattern information, location information of the verified third terminal (e.g., Yeoksam-ro 101 in Gangnam-gu, Seoul), identification information of the third terminal, and the like to the server 200.

As another example, a fourth keyword (e.g., a convenience store) in the form of a letter according to user input of the fourth terminal in the fourth terminal 100 and a DDD item (or DDD item) in the reader 120 included in the fourth terminal The fourth terminal confirms the real-time current location of the fourth terminal (e.g., 511 in Nonhyeon-ro, Gangnam-gu, Seoul) when receiving the tag information that recognizes the tag attached to the terminal.

Also, the fourth terminal may store the received fourth keyword (e.g., a convenience store), the received tag information (or fourth pattern information), the location information of the verified fourth terminal (e.g., 511), identification information of the fourth terminal, and the like to the server 200 (S310).

The server 200 receives the keyword, the pattern information, the location information of the terminal 100, the identification information of the terminal 100, and the like transmitted from the terminal 100.

Also, the server 200 determines whether there is information corresponding to at least one of the position information of the terminal 100 and the keyword and the pattern information among a plurality of pieces of information previously registered (or stored) in the server 200 (Or identifies) it. Here, the information includes business information, product information, service information, personal information, etc. registered in the server 200 by an arbitrary company official or a general user. The information may include at least one of panorama image information related to the keyword / pattern information corresponding to the arbitrary company-related person or the general user, a code related to the object included in the panorama image information, an object marker corresponding to the type of the code, Position information of the object marker in the moving image, attribute information of the object marker, and the like.

That is, the server 200 is located within a predetermined radius based on the position information of the terminal 100 among a plurality of pieces of information previously registered (or stored) in the server 200, (Or identifies) whether there is information corresponding to at least one. The predetermined radius may be a state previously set for each terminal by a user of the terminal 100 or may be set to a default value by an administrator of the server 200. [

For example, the server 200 may store the first keyword (e.g., a department store) transmitted from the first terminal, the location information of the first terminal (e.g., Teheran Road 201 in Gangnam-gu, Seoul) Identification information, and the like.

Also, the server 200 is located within a predetermined radius (for example, 1 Km) based on the position information of the first terminal among a plurality of information registered in advance in the server 200, and the first keyword (For example, business information) corresponding to a department store (e.g., a department store). Here, the business information includes business name, business type (or category), telephone number, location information (or address information / distance information), and MR content (or AR content) related to the business.

For example, the server 200 may store the second keyword (for example, Kim Chul Soo) transmitted from the second terminal, the location information of the second terminal (e.g., Nonhyeonro 507, Gangnam-gu, Seoul) 2 terminal identification information and the like.

Also, the server 200 is located within a predetermined radius (for example, 1 Km) based on the location information of the second terminal among a plurality of information registered in advance in the server 200, and the second keyword (For example, personal information) corresponding to the information (e.g., Kim, Chul-soo). Here, the personal information includes name / title / alias, telephone number, location information (distance information relative to the terminal 100), MR content (or AR content) related to the individual, , Social network service information, and the like. At this time, the server 200 determines whether the location information of the other terminal related to the personal information at the time of registering the corresponding personal information in the server 200 is within the radius based on the location information of the second terminal, It may be determined whether the position information of the other terminal, which is confirmed in real time at the determination time, is within the radius based on the position information of the second terminal.

As another example, the server 200 may transmit the third pattern information transmitted from the third terminal, the location information of the third terminal (for example, Yeoksam-ro 101 in Gangnam-gu, Seoul) And the like.

Also, the server 200 is located within a predetermined radius (for example, 1 Km) based on the position information of the third terminal among a plurality of pieces of information registered in advance in the server 200, (For example, information related to the CCC entertainer) corresponding to the face information of the CCC entertainer in the magazine.

As another example, the server 200 may transmit the fourth keyword (e.g., a convenience store), the tag information (or the fourth pattern information) transmitted from the fourth terminal, the location information of the fourth terminal 511 in Nonhyeon-ro, Gangnam-gu, Seoul), identification information of the fourth terminal, and the like.

The server 200 is located within a predetermined radius (for example, 1 Km) based on the location information of the fourth terminal among a plurality of information registered in advance in the server 200, and the fourth keyword In step S320, information corresponding to the fourth pattern information (for example, pattern information related to the DDD surface) (for example, information related to a convenience store for selling DDD surface) exists.

When the determination result (or the identification result) indicates that there is information corresponding to at least one of the position information of the terminal 100 and the keyword and the pattern information among a plurality of pieces of information registered in advance in the server 200 , The server 200 transmits the one or more pieces of information to the terminal 100.

That is, the determination result (or the identification result) is located within a predetermined radius based on the position information of the terminal 100 among a plurality of information registered in advance in the server 200, and the keyword and / The server 200 transmits the one or more pieces of information corresponding to the location information of the terminal 100, the keyword, the pattern information, and the like to the terminal 100.

(For example, 1 Km) based on the position information of the first terminal among a plurality of pieces of information registered in advance in the server 200, and the first keyword (for example, a department store) When the corresponding first information exists, the server 200 transmits the first information to the first terminal. Here, the first information may include a first company name (e.g. ABC department store), a first category (e.g. shopping), a first telephone number (e.g. 02-1234-5678), a distance from the first terminal Information (e.g., 505m), first MR content associated with the ABC department store, and the like.

For example, the second keyword is located within a predetermined radius (for example, 1 Km) based on the position information of the second terminal among a plurality of information registered in advance in the server 200, and the second keyword (for example, ), The server 200 transmits the second information to the second terminal. Here, the second information may include a second name (e.g., a telephone number), a second telephone number (e.g., 010-9876-5432), a second email address associated with the chief executive officer Kim, Information on the second social network service related to the above-mentioned Kim Chul-soo, and the like.

As another example, the location information is located within a predetermined radius (for example, 1 Km) based on the location information of the third terminal among a plurality of information registered in advance in the server 200, The server 200 transmits the third information to the third terminal when there is third information corresponding to the CCC entertainer face in the first terminal. Here, the third information includes the name of the CCC entertainer, the image related to the CCC entertainer, the blog information related to the CCC entertainer, the homepage related to the CCC entertainer, the social network service information related to the CCC entertainer, .

As another example, the location information may be located within a predetermined radius (for example, 1 Km) based on the location information of the fourth terminal among a plurality of information registered in advance in the server 200, And the fourth information corresponding to the fourth pattern information (for example, pattern information related to DDD) exists, the server 200 transmits the fourth information to the fourth terminal. Here, the fourth information may include at least one name of convenience store selling the DDD ramp, a phone number of each convenience store, distance information of each convenience store from the fourth terminal, , And the like (S330).

Thereafter, the terminal 100 transmits one or more information (or information) transmitted from the server 200 in response to the previously transmitted keyword, the pattern information, the location information of the terminal 100, the identification information of the terminal 100, Location information of the terminal 100 and at least one information corresponding to the keyword).

Also, the terminal 100 displays the received one or more pieces of information.

For example, the first terminal may transmit the first keyword (e.g., department store), the location information of the first terminal (e.g., Teheran Road 201 in Gangnam-gu, Seoul) to the server 200, 4, information 400 indicating that the information corresponding to the first keyword and the location information of the first terminal is being searched may be displayed.

In addition, the first terminal may store the first keyword (e.g., a department store), the location information of the first terminal (e.g., Teheran Road 201 in Gangnam-gu, Seoul), the identification information of the first terminal, And receives first information transmitted from the server 200.

In addition, as shown in FIG. 5, the first terminal displays the received first information 500. Here, the first information 500 includes a first company name (e.g., ABC department store) 510, a first category (e.g., shopping) 520, a first telephone number (e.g., 02-1234-5678 530, distance information 505m from the first terminal 540, available coupon information 550, first link information (not shown) for a shopping mall server (not shown) linked to the ABC department store 560), second link information 570 for confirming an event or product information provided by the ABC department store, third link information 580 for identifying a first MR content related to the ABC department store, Fourth link information 590 for route guidance from the current location of the terminal to the ABC department store, and the like.

For example, the second terminal may store the second keyword (e.g., Kim Cheol-Soo), the location information of the second terminal (e.g., Nonhyeonro 507, Gangnam-gu, Seoul) And receives second information transmitted from the server 200 in response to the second information.

Also, as shown in FIG. 6, the second terminal displays the received second information (600). Here, the second information 600 includes a second name (e.g., a telephone number) 610, a second telephone number (e.g., 010-9876-5432) 620, distance information from the second terminal For example, 450m) 630, 11th link information 640 for transmitting a message to another terminal related to the Kim, Chul-soo exaggeration, 11th link information 640 for transmitting a mail to a second e-mail address related to the Kim, 650), 12th link information 660 for accessing the second blog related to the Kim Chul-soo exaggeration, 13th link information 670 for accessing a second social network service related to the Kim Chul-soo exaggeration, and the like.

As another example, in response to the third pattern information previously transmitted, the location information of the third terminal (e.g., Yeoksam-ro 101 in Gangnam-gu, Seoul), the identification information of the third terminal, And receives third information transmitted from the second terminal 200.

In addition, the third terminal may include the name of the received CCC entertainer, the image related to the CCC entertainer, the blog information related to the CCC entertainer, the homepage address related to the CCC entertainer, the social network service information related to the CCC entertainer, Information, and the like.

As another example, the fourth terminal may transmit the fourth keyword (e.g., a convenience store), the tag information (or the fourth pattern information), the location information of the fourth terminal (e.g., 511), and receives fourth information transmitted from the server 200 in response to identification information of the fourth terminal.

Also, the fourth terminal may include at least one name of a convenience store for selling the DDD ramp, a telephone number for each convenience store, distance information for each convenience store from the fourth terminal, And displays the fourth information including MR contents related to each convenience store (S340).

If there is no information corresponding to the position information of the terminal 100, the keyword, the pattern information, and the like among a plurality of pieces of information registered in advance in the server 200, The server 200 transmits the category information (or category list) set in advance to the server 200 to the terminal 100. Here, the category information may be category information related to the keyword and / or the pattern information.

That is, the determination result (or the identification result) is located within a predetermined radius based on the position information of the terminal 100 among a plurality of information registered in advance in the server 200, and the keyword and / If there is no information corresponding to the information, the server 200 transmits the category information (or category list) set in advance to the server 200 to the terminal 100. At this time, if the information corresponding to the keyword and / or the pattern information does not exist in a predetermined radius based on the position information of the terminal 100 among a plurality of information registered in advance in the server 200 , The server 200 further extends the radius and determines whether information corresponding to the keyword and / or the pattern information is present within the extended radius from a plurality of pieces of information registered in the server 200 May be further determined. Here, the radius expanding function may be repeated a predetermined number of times.

When the server 200 transmits the category information to the terminal 100, the server 200 transmits the category information preset in the server 200 to the terminal 100, And transmits category information related to the received keyword and / or the received pattern information to the terminal 100.

Also, when the category information related to the pattern information can not be confirmed, the server 200 may not provide category information to the terminal 100.

(For example, 1 Km) based on the position information of the first terminal among a plurality of pieces of information registered in advance in the server 200, and the first keyword (for example, a department store) When there is no corresponding at least one piece of information, the server 200 transmits first category information related to the first keyword (e.g., a department store) to the first terminal.

For example, the second keyword is located within a predetermined radius (for example, 1 Km) based on the position information of the second terminal among a plurality of information registered in advance in the server 200, and the second keyword (for example, The server 200 transmits the second category information registered in advance to the server 200 to the second terminal.

As another example, the location information is located within a predetermined radius (for example, 1 Km) based on the location information of the third terminal among a plurality of information registered in advance in the server 200, (For example, information related to the CCC entertainer) does not exist in the server 200, the server 200 determines that the third pattern information registered in advance in the server 200 (E.g., entertainment category information) related to the first category information to the third terminal.

As another example, the location information may be located within a predetermined radius (for example, 1 Km) based on the location information of the fourth terminal among a plurality of information registered in advance in the server 200, And the information corresponding to the fourth pattern information (for example, the pattern information related to the DDD) does not exist (for example, information related to a convenience store for selling DDD), the server 200 transmits the DDD And transmits the fourth category information related to the noodles and the convenience store to the fourth terminal (S350).

The terminal 100 receives the category information transmitted from the server 200 in response to the previously transmitted keyword, the pattern information, the location information of the terminal 100, the identification information of the terminal 100, and the like .

Also, the terminal 100 displays the received category information.

For example, the first terminal responds to the first keyword (e.g., a department store) transmitted previously, the location information of the first terminal (e.g., Teheran Road 201 in Gangnam-gu, Seoul) And receives first category information related to the first keyword (for example, a department store) transmitted from the server 200.

Also, as shown in FIG. 7, the first terminal displays first category information 700 related to the received first keyword (for example, a department store).

For example, the second terminal may store the second keyword (e.g., Kim Cheol-Soo), the location information of the second terminal (e.g., Nonhyeonro 507, Gangnam-gu, Seoul) Receives the second category information registered in advance in the server 200 transmitted from the server 200 in response to the first category information, and displays the received second category information.

As another example, in response to the third pattern information previously transmitted, the location information of the third terminal (e.g., Yeoksam-ro 101 in Gangnam-gu, Seoul), the identification information of the third terminal, Receives the third category information related to the third pattern information registered in advance in the server 200 transmitted from the server 200, and displays the received third category information.

As another example, the fourth terminal may transmit the fourth keyword (e.g., a convenience store), the tag information (or the fourth pattern information), the location information of the fourth terminal (e.g., 511), receives fourth DDD information transmitted from the server 200 and fourth category information related to the convenience store in response to the identification information of the fourth terminal, and displays the received fourth category information (S360 ).

Then, the terminal 100, in cooperation with the server 200, transmits at least one piece of information corresponding to a specific category selected according to a user selection (or a user touch / input) from the category information displayed on the terminal 100 .

For example, when the shopping category 710 is selected from the first category information 700 displayed on the first terminal, the first terminal transmits information on the selected shopping category to the server 200, And receives the eleventh to fourteenth information related to the selected shopping category transmitted from the server 200 in response to the transmission. 8, the first terminal displays the received 11th to 14th information (for example, ABCD department store, POPS department store, AAA shopping mall, BBB shopping mall, etc.) 800 S370).

Thereafter, when specific information is selected from at least one information displayed on the terminal 100, the terminal 100 displays the selected specific information (or detailed information on the selected specific information).

For example, when the twelfth information (for example, the POPS department store) 810 is selected from among the eleventh information to the fourteenth information shown in FIG. 8 according to user selection, as shown in FIG. 9, The terminal displays information (900) about the selected twelfth information (e.g. POPS department store) (S380).

Thereafter, when a preset event is detected while information is being displayed on the terminal 100, the terminal 100 performs a preset function corresponding to the event. Here, the event may include a plurality of items included in the information displayed on the terminal 100 (for example, an AR route search item (or menu), a content information item, a map information item, a coupon information item, (Or selection / click) on any one of the item (e.g., item, blog connection item, social network service connection item, etc.) Down (or up / down / left / right) direction of the terminal 100 when a tilt exceeding a predetermined threshold value in the up / down / left / right directions of the terminal 100 is detected, (Or movement) of the terminal 100 by a predetermined number of times in the clockwise / anticlockwise direction in the case where a movement (or shake / vibration) of more than a predetermined number of times in the left / Detected Wu, and the like if a touch gesture by a user of the terminal 100 is detected. At this time, the touch gesture by the user of the terminal 100 includes a tap, a touch & hold, a double tap, a drag, a flick, a drag and drop, a pinch and a swipe.

For example, when the usable coupon information 550 is selected (or touched) according to a user's touch while the first information 500 is displayed on the first terminal, as shown in FIG. 10, 1 terminal displays detailed information 1000 of the selected available coupon information.

In another example, when the first information 500 is being displayed on the first terminal, the second link information 570 for checking an event or product information provided by the ABC department store according to a user's touch is selected (or displayed) The first terminal displays event information 1100 related to the selected second link information, as shown in FIG.

As another example, when the first information 500 is being displayed on the first terminal, the third link information 580 for confirming the first MR content related to the ABC department store is selected (or touched) ), The first terminal displays the first MR content 1200 associated with the selected third link information, as shown in FIG.

As another example, when two rotations in the clockwise direction of the first terminal are detected while the first information (400) is being displayed in the first terminal, the first terminal And route guidance information 1300 from the current position of the first terminal to the ABC department store in association with the preset fourth link information corresponding to the two rotations in the clockwise direction.

As another example, when the second terminal 600 detects the tilt of the second terminal in the right direction of the second terminal in the state where the second information 600 is being displayed, The second terminal accesses the second social network service related to the Kim Chul-soo exaggeration relating to the thirteenth link information set in advance corresponding to the inclination of the predetermined threshold value or more in the right direction, And displays a screen 1400 provided by the social network service.

As another example, when the first terminal detects the second movement in the up / down direction of the first terminal while the twelfth information 900 is being displayed, as shown in FIG. 15, 1 terminal displays route guidance information 1500 for route guidance from the current location of the first terminal to the POPS department store associated with the twelfth information at step S390.

As described above, in the embodiment of the present invention, among a plurality of pieces of information previously registered in the server, the embodiment of the present invention is located within a predetermined radius on the basis of the current position of the terminal and corresponds to the keyword and / When at least one piece of information does not exist, displays predetermined category information, and provides at least one piece of information corresponding to a specific category selected from the displayed category information to the terminal, It is possible to enhance the publicity effect according to the provision of the information and to easily confirm the real-time information on the goods and / or services of interest.

In addition, as described above, the embodiment of the present invention is characterized in that, among the plurality of pieces of information previously registered in the server, the embodiment of the present invention is located within a predetermined radius based on the current position of the terminal, When there is at least one corresponding information, providing at least one corresponding information to the terminal, providing a user interface for user convenience, and improving the user's convenience.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

The present invention is characterized in that if a plurality of pieces of information previously registered in the server are located within a predetermined radius based on the current position of the terminal and at least one piece of information corresponding to the keyword and / And displaying the preset category information and providing at least one piece of information corresponding to a specific category selected from the displayed category information to the terminal so as to enhance the publicity effect according to provision of the business information to which the virtual reality or mixed reality is applied, (MR), terminal, panoramic image, shopping information, marketing, server, etc., which can easily confirm real-time information on the goods and / And the like.

10: Content providing system 100:
200: server 110: input unit
120: reader 130:
140: GPS receiver 150:
160: Display section 170: Audio output section
180:

Claims (13)

A method for controlling a terminal,
Transmitting the keyword or pattern information, the location information of the terminal and the identification information of the terminal to the server when receiving the keyword according to the user input or receiving the pattern information according to the pattern recognition for the object;
Receiving, by the communication unit, category information transmitted from the server when position information of the terminal and first information corresponding to the keyword or the pattern information do not exist among a plurality of pieces of information stored in the server;
Displaying the received category information by a display unit;
Controlling the display unit to display, by the control unit, at least one second information corresponding to a specific category selected according to a user selection from the category information displayed on the display unit;
Displaying the selected specific information by the display unit when specific information is selected from at least one second information displayed on the display unit; And
Performing a predetermined function corresponding to the event by the control unit and controlling the display unit to display the function execution result when a predetermined event is detected in a state where the specific information is displayed on the display unit ≪ / RTI &
The object comprising:
A tag included in a face of a person, a fingerprint, a product, a building, a commodity or a shelf, and at least one of a face, a fingerprint, a product, and a building included in the image information. The method according to claim 1,
When the position information of the terminal and the first information corresponding to the keyword or the pattern information are present among a plurality of pieces of information stored in the server by the communication unit and provided from the server in response to the position information transmitted to the server ≪ / RTI > And
Further comprising the step of displaying the received first information by the display unit. The method according to claim 1,
In the event,
When a selection of one of a plurality of items included in the first information being displayed on the terminal is sensed, if selection of a button provided on the terminal is sensed, When a tilt exceeding a preset threshold value in the right direction is sensed, when a movement of a predetermined number or more in the up / down direction or the left / right direction or the diagonal direction of the terminal is detected, A case where a rotation of a predetermined number of times or more is detected, and a case where a touch gesture by a user of the terminal is detected,
Wherein the touch gesture by the user of the terminal comprises:
Touch and hold, double tap, drag, flick, drag & drop, pinch, and swipe. And a control unit for controlling the terminal. The method according to claim 1,
Wherein the step of performing the predetermined function corresponding to the event and controlling the display unit to display the function execution result comprises:
Wherein when the link information for identifying the MR content related to the keyword included in the first information is selected, the display unit displays the MR content related to the selected link information. The method according to claim 1,
Wherein the step of performing the predetermined function corresponding to the event and controlling the display unit to display the function execution result comprises:
When the link information for displaying the route guidance information from the current location of the terminal included in the first information to the destination included in the first information is selected by the display unit, Displaying a first screen on the screen by overlapping path information to a destination included in the first information; And
A process of displaying a continuous screen which changes according to the automatic moving function at a predetermined speed from the first screen to the destination by the display unit while the selected state of the route information displayed on the display unit is maintained, And controlling the terminal. 6. The method of claim 5,
The route information includes:
Wherein the control information includes at least one of traffic information, lane information, road information, driving restriction speed information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, Way. The method according to claim 1,
Wherein the step of performing the predetermined function corresponding to the event and controlling the display unit to display the function execution result comprises:
When the link information for accessing a blog or a social network service related to the keyword included in the first information is selected by the display unit, the screen corresponding to the blog or the social network service corresponding to the selected link information Wherein the display unit displays a screen on which the terminal is to be displayed. The method according to claim 1,
Wherein the first information comprises:
MR content,
Wherein the MR content comprises:
At least one of the panorama image information related to the keyword, the code relating to the object included in the panorama image information, the object marker corresponding to the code type, the position information of the object marker in the image or moving image, And transmitting the control information to the terminal. 9. The method of claim 8,
Wherein the MR content comprises:
Displaying the panoramic image information on the image display area of the display unit by the display unit;
When a first object marker selected from a plurality of object markers displayed in the object marker display area of the display unit is dropped in a first area on the image display area by a drag and drop function, Placing the selected first object marker in a first area; And
And setting attribute information for the selected first object marker based on a user input by the control unit when a first object marker disposed in the image display area is selected. Control method. In the terminal,
And transmits the keyword or pattern information, the location information of the terminal, and the identification information of the terminal to the server when receiving the keyword according to the user input or the pattern information according to the pattern recognition of the object, A communication unit for receiving the location information of the terminal and the category information transmitted from the server when the first information corresponding to the keyword or the pattern information does not exist;
A display unit for displaying the received category information; And
The control unit controls the display unit to display at least one second information corresponding to a specific category selected according to a user's selection from the category information displayed on the display unit and selects specific information from at least one second information displayed on the display unit When the predetermined event is detected while the specific information is being displayed on the display unit, performing a preset function corresponding to the event, and displaying the function execution result And a control unit for controlling the display unit,
The object comprising:
A tag provided on a face of a person, a fingerprint, a product, a building, a product or a shelf, and a face or fingerprint included in the image information, or at least one of a product or a building. 11. The method of claim 10,
The display unit includes:
Wherein when the link information for identifying the MR content related to the keyword included in the first information is selected, the terminal displays the MR content related to the selected link information. 11. The method of claim 10,
The display unit includes:
When the link information for displaying the route guidance information from the current position of the terminal included in the first information to the destination included in the first information is selected on the screen corresponding to the current position of the terminal, 1 information to display the first screen by overlapping the route information to the destination included in the first screen, and while the selected state of the route information displayed on the display unit is maintained, automatic moving at a preset speed from the first screen to the destination And displays a continuous screen that changes according to the performance of the terminal. 11. The method of claim 10,
The display unit includes:
When the link information for accessing a blog or a social network service related to the keyword included in the first information is selected, a screen corresponding to the blog related to the selected link information or a screen corresponding to the social network service .

Images