KR20180129033A - Apparatus and method for providing travel information service by using augmented reality - Google Patents

Abstract

The present invention relates to an apparatus and a method for providing a travel information service using augmented reality, which are capable of obtaining location and direction information of a user through a terminal by arriving at a specific domestic or international airport, confirming an airport obtained through a camera of the terminal on the basis of the obtained location and direction information of the user, and displaying information about the airport and travel information corresponding to the airport location on the terminal on the basis of augmented reality. To this end, the apparatus comprises: a location and image information receiving unit for receiving, in real time, location information of a user from a user terminal, and image information being outputted to a display of the terminal in order to provide travel information on the basis of augmented reality to the user; an airport information confirming unit for confirming which airport is included in the received image on the basis of a direction indicated by the terminal from the current location of the user when the current location of the user and the direction information of the terminal are received from the user terminal; an airport information collecting unit for collecting airport information about confirmed main surrounding information when the main surrounding information existing in the image is confirmed by using the confirmed airport information; an augmented information generating unit which generates relatively simple basic information by combining at least a part of surrounding information and airport information to generate augmented information to be provided to the user by using surrounding information and collected travel information for each piece of surrounding information of the confirmed airport, and generates detailed additional information for each surrounding type; and an augmented information transmitting unit for transmitting the generated augmented information to the user terminal when the augmented information is generated for each piece of surrounding information. A travel information providing server apparatus has a technical configuration included in an augmented server.

Description

[0001] Apparatus and method for providing travel information service using augmented reality [0002]

The present invention relates to an apparatus and method for providing a travel information service using an augmented reality, and more particularly, to an apparatus and method for providing a travel information service using augmented reality, A travel information service providing apparatus using an augmented reality, which provides an augmented reality based on the augmented reality to provide information on the airport and travel information corresponding to the airport location on the basis of the augmented reality, And methods.

With the development of the mobile communication network and the development of the terminal specification, the mobile communication terminal has become a necessity of modern people and has evolved into a total entertainment device beyond the conventional category of simple communication apparatus or information providing apparatus.

Particularly, due to the development of mobile communication, interest in location based service (LBS) is increasing. A location-based service is a service that provides specific information to a user of a wireless Internet or a mobile terminal (e.g., a smartphone) according to the location of the user. Location - based services can generate a wide variety of information in terms of providing local information specialized for users, and there is a wide variety of applications. Some examples of location-based services include locating nearby locations such as gas stations or restaurants, locating information on facilities, and finding useful information, such as finding the location of the other.

In the case of a mobile terminal, which is currently in widespread use, a camera is mounted to capture an image, and an image can be displayed on the screen. Therefore, the local information provided through the location-based service is combined with the image captured by the camera, As a method of projecting various information becomes possible, a service in the form of Augmented Reality (AR) can be implemented. The augmented reality is a hybrid virtual reality that fuses a real environment with a virtual environment by utilizing a technique of displaying a three-dimensional virtual object overlaid on a camera image actually viewed by a user. This augmented reality can be applied to maximize the advantages of location based services to users in that it integrates the virtual world into the real world.

In this way, the augmented reality combines the real image and the virtual graphic, so that the virtual peripheral information must be accurately positioned on the screen in order to obtain more realistic and accurate images. In order to realize this, three-dimensional coordinates of the virtual peripheral information are required, and these coordinates should be coordinate values based on the camera.

In addition, as a method of displaying virtual reality data in an actual reality in the augmented reality, there is a method of recognizing peripheral information in a marker / markerless manner from an actual reality photographed through a camera and stored in a storage medium, There is a method of displaying real data and a method of recognizing peripheral information from a real reality photographed by a camera in a marker / markerless manner and displaying virtual reality data on the recognized peripheral information, and in recent years, Research is underway to visualize the augmented reality image on the environment.

Korean Patent No. 10-1573599 (Title: Travel Route Setting and Guidance Service Providing System Using Smart Terminal and Method for Providing the Same)

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to solve the above-mentioned problems, and it is an object of the present invention to solve the above problems. The present invention provides an apparatus and method for providing a travel information service using an augmented reality that maximizes the convenience of travel information collection by receiving information related to travel, such as shopping malls, using augmented reality technology.

It is another object of the present invention to provide an apparatus and method for displaying information on travel information and positional travel information acquired through a camera of a smart terminal based on an augmented reality on a terminal, And an apparatus and method for providing information and additional information.

According to the travel information service apparatus using the augmented reality according to the present invention, the augmented reality-based travel information service providing server apparatus is provided with a server for receiving image information included in an arbitrary airport from a user terminal, An information checking unit, an airport information collecting unit for collecting travel information related to the airport using the confirmed airport information, and an augmentation information generating unit for generating augmentation information for the airport based on the airport information and the travel information.

The airport information confirmation unit may further receive the location information of the user including at least one of the current location of the user and the direction information of the terminal from the user terminal and confirm the airport information based on the location information of the received user.

The airport information confirmation unit analyzes the location of the airport to determine the route guidance within the airport, and can confirm the airport information by using the location information of the user and the route guidance within the determined airport.

At this time, the airport information may include an airport name or an airport location.

The airport information collecting unit may request the airport server for the travel information about the airport using the airport location information in the airport information and receive the travel information about the airport from the airport server.

At this time, the augmentation information may include basic information generated by combining at least a part of the airport information and at least a part of the travel information, and additional information generated based on the travel type.

In addition, the augmented reality-based travel information service providing terminal includes a terminal control unit for controlling the image capturing module to acquire an image included in the airport and outputting the acquired image to a display, An information receiving unit for receiving the augmentation information, and an information output unit for outputting the received augmentation information at a corresponding position in the image.

The information output unit determines the output size of the augmented information corresponding to each destination based on the distance between each destination and the user when the augmentation information is received for a plurality of destinations in the image, and outputs the received augmented information to the determined output size Can be output.

The information output unit may output the detailed travel information on the selected destination when the selection information of the destination to which the augment information is output from the user is received.

The terminal control unit may further collect location information of the user including at least one of the current position of the user and the direction information of the terminal, and the travel information service providing terminal device may enhance the collected location information of the user and the acquired image information And an information transmitting unit for transmitting the information to the server.

The terminal control unit collects the current position of the user through one of the positioning technologies including the GPS, the communication company base station, the WiFi AP, the NFC and the beacon method, collects the direction information of the terminal by controlling the gyro sensor have.

According to another aspect of the present invention, there is provided a method for providing a travel information service based on an augmented reality, comprising the steps of: receiving image information being output from a user terminal to a display device by a travel information providing server device; confirming travel information and traffic information about destinations existing in the received image; Collecting travel information and traffic information related to the destination using the confirmed travel information and traffic information, and generating the augmentation information for the destination using the travel information and the traffic information.

The method may further include receiving location information of a user including at least one of the current location of the user and the direction information of the terminal.

At this time, the step of confirming the travel information may include a step of determining the type of travel existing in the image, and a step of confirming the travel information about the destination using the determined type of travel and the location information of the user.

According to another aspect of the present invention, there is provided a method for providing a travel information service based on an augmented reality, comprising the steps of: acquiring an image including a destination by controlling a photographing module by a travel information providing terminal; outputting the acquired image to a display; And a step of outputting the received augmented information to a corresponding position in the image.

In addition, the method of providing a travel information service includes collecting location information of a user including current location of the user and direction information of the terminal, and transmitting location information of the collected user and information of the acquired image to the augmentation server .

The method may further include receiving selection information of a destination to which the augmented information is output from the user, and outputting detailed travel information for the selected destination.

In addition, the augmented reality-based travel information providing system acquires travel information about the airport when the image information included in the airport is received from the user terminal, transmits the acquired travel information to the airport server, Acquires the travel information, generates the augmentation information based on the confirmed travel information and the received travel information, and transmits the acquired augmentation information to the augmentation server And a user terminal for superimposing the received enhancement information at a corresponding position in the image when the enhancement information including travel information related to the airport is received from the enhancement server.

The present invention displays information about an airport acquired through a camera of a terminal based on an augmented reality and surrounding travel information of an airport location on a terminal to provide travel information to a user, It is possible to minimize inconvenience of direct input.

In addition, the user can easily check the detailed travel information of the corresponding airport by providing the detailed travel information and additional information for any airport selected from the airports displayed on the terminal based on the augmented reality.

1 is a block diagram of a system for providing a travel information service using an augmented reality according to an embodiment of the present invention;
2 is a block diagram of a travel information providing server apparatus in a travel information service providing system using an augmented reality according to an embodiment of the present invention;
3 is a block diagram of a travel information providing terminal in a travel information service providing system using an augmented reality according to an embodiment of the present invention;
FIG. 4 is a block diagram illustrating a travel environment record server in a travel information service providing system using an augmented reality according to an embodiment of the present invention; FIG.
FIG. 5 is a flowchart illustrating a method of providing a travel information service performed by the travel information service providing system using the augmented reality shown in FIG. 1;
FIG. 6 is a flowchart illustrating a method of providing a travel information service performed by a travel information providing server device of a travel information service providing system using the augmented reality of FIG. 2;
FIG. 7 is a flowchart illustrating a method of providing a travel information service performed by a travel information providing terminal of a travel information service providing system using the augmented reality of FIG. 3;

The present invention will now be described in detail with reference to the accompanying drawings. Hereinafter, a detailed description of known functions and configurations that may unnecessarily obscure the gist of the present invention will be omitted. Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art.

In addition, airport information to be described later can be used in the same meaning in place of travel information, and the description content of the information is not limited.

Hereinafter, various embodiments of an apparatus and method for providing a travel information service using an augmented reality will be described with reference to the drawings.

1 is a block diagram of an augmented reality-based travel information providing system according to an embodiment. Referring to FIG. 1, an augmented reality-based travel information providing system according to an embodiment includes a user terminal 110 and an augmentation server 120, and may further include a travel information server 130. In this case, the augmentation server 120 and the travel information server 130 may be hardware devices physically separated from each other as shown in the figure, but the present invention is not limited thereto. One hardware device may be installed in the augmentation server 120 and the travel information server 130), which are not shown in the drawings.

The user terminal 110 may be a mobile terminal such as a smart phone or a smart pad, and may include a video photographing module and a display.

The user terminal 110 outputs travel service information such as text, image, voice, moving picture, etc. as contents including the augmented reality image, location information, spot information and traffic information at the request of the user to the display of the terminal, .

The travel information providing terminal 300 may be installed at the time of manufacturing the user terminal 110 or may be installed in the open market Downloaded and installed travel service provisioning application. The user can check the travel information such as the travel time in real time through the travel information providing terminal 300 mounted on the user terminal 110 without any restriction on the time and place.

The user terminal 110 acquires the real image by controlling the image taking module and the like through the mounted travel information providing terminal 300. The airport information and the travel service information about the major airports in the real image acquired are stored in the augmented reality (Augmented Reality).

Also, the user terminal 110 may transmit the location information of the user and the acquired image information to the augmentation server 120, and receive the augmentation information for the airports included in the image from the augmentation server 120. [ When the user terminal 110 receives the augmentation information including the airport information related to the airports included in the image from the augmentation server 120, the user terminal 110 superimposes the received augmentation information on the position of the airport in the image and outputs can do.

1, the user terminal 110 directly receives the travel information from the travel information server 130 and transmits the received travel information and the augmentation information received from the augmentation server 120 Can be combined and output at a corresponding position in the image.

For example, when the user terminal 110 receives the augmentation information from the augmentation server 120, the user terminal 110 transmits the airport information included in the augmentation information to the travel information server 130, Information can be directly received. Alternatively, when the augmentation server 120 transmits the airport information to the travel information server 130 and requests travel information related to the airport, the travel information server 130 transmits the travel information related to the airport to the user terminal 110 It is also possible to transmit.

When the user's location information and the image information are received from the user terminal 110, the augmentation server 120 checks the main airport existing in the image information based on the user's location information. And, it can generate the augmented information including the airport information and the travel information about the location of the airport to the identified major airports, and transmit the augmented information to the user terminal 110.

At this time, when the main airport is confirmed, the augmentation server 120 transmits the confirmed airport information to the travel information server 130, requests travel information on the location of the airport, and transmits the travel information from the travel information server 130 to the airport Travel information can be received.

As described above, according to another embodiment, the augmentation server 120 transmits the confirmed travel information to the travel information server 130 to transmit the travel information server 130 directly to the user terminal 110 Can be requested. At this time, the augmentation server 120 transmits the information of the user terminal 110 together with the airport information, and the travel information server 130 transmits the travel information related to the airport using the information of the user terminal 110 to the user terminal 110 As shown in FIG.

According to another embodiment, when the main airport is identified, the augmentation server 120 may acquire travel information for the identified major airport and transmit the travel information to the user terminal 110 as the augmentation information.

The travel information server 130 periodically receives the travel record information from the travel sharing server 140 in which the travel contents are stored in real time from the travel-related individual or business member, and generates the travel information using the received travel record information have.

The travel information server 130 generates and manages travel information using the travel record information collected from the travel sharing server 140 and transmits a travel information request related to the airport from the augmentation server 120 or the user terminal 110 And may transmit the corresponding travel information to the requesting enhancement server 120 or the user terminal 110 when it is received.

As described above, the augmented reality-based travel information providing system according to the present invention can be applied to the computing performance of the user terminal 110, the augmentation server 120 and the travel information server 130, the travel information providing terminal 300, The development policy of the device 200, and the like.

Hereinafter, for convenience of explanation, among various embodiments of the travel information providing system according to the present invention, airport information and travel information are transmitted and received between the augmentation server 120 and the travel information server 130, The travel information providing method performed by the providing terminal 300 and the travel information providing server 200 will be described.

2 is a block diagram of an augmented reality-based travel information providing server apparatus according to an exemplary embodiment of the present invention. The augmented reality-based travel information providing server apparatus 200 according to one embodiment may be an embodiment of the travel information providing server apparatus 200 mounted on the augmentation server 120 of FIG.

2, the travel information providing server 200 includes a location and image information receiving unit 210, an airport information checking unit 220, an airport information collecting unit 230, an augmentation information generating unit 240, And a transmission unit 250. FIG. Here, the airport information can be replaced with travel information or destination information.

The location and image information receiving unit 210 receives the location information of the user from the user terminal 110 and the image information being outputted to the display of the terminal in real time to provide the user with travel information based on the augmented reality.

At this time, the location information of the user may include the current location of the user and the direction information of the terminal.

When the location information of the user, that is, the current location of the user and the direction information of the terminal, is received, the airport information confirmation unit 220 searches the airport based on the direction indicated by the terminal 110 from the current location of the user, Check if it is included.

For example, the airport information confirmation unit 220 may analyze the shape of the surrounding information in the image in the image and determine the surrounding shape of the airport based on the analysis result. At this time, the surrounding form of the airport may include one or more of an airport entrance, a bus or a taxi stand, a subway station, a specific facility around the airport, and a major special point. When the surrounding form of the airport is determined for each peripheral information in the image, the airport information confirmation unit 220 acquires from the location of the user the location of the terminal 110 using the user's location, the direction information of the terminal 110, ) In the direction of the direction of the corresponding peripheral information.

For example, when the surrounding information of the airports included in the image is confirmed, the airport information confirmation unit 220 may generate the travel information for each of the identified surrounding information. At this time, the travel (airport) information may include, for example, basic tourist information such as attractions around the airport, information about the area around the airport, weather information, accommodation information, and restaurant information. In addition, it may include detailed information of the surrounding travel of the airport, which may be classified by each surrounding information or the surrounding form of the airport. For example, the detailed information of the nearby trips may include traffic and accommodation information, travel destination information, shopping in major buildings or destinations, advertising information, weather information by time or date, and the like.

The airport information collecting unit 230 collects travel information about the main peripheral information that is confirmed when the main peripheral information existing in the image is confirmed by the airport information checking unit 220. The airport information collecting unit 230 transmits request information including the location information of the airport to the travel information server 130 with respect to the confirmed main peripheral information, Information can be received.

The augmentation information generation unit 240 generates augmentation information to be provided to the user using the surrounding information and the collected travel (airport) information for each of the identified peripheral information. The augmented information generating unit 240 may generate relatively simple basic information by combining at least some of the peripheral information and the travel information, and may generate more detailed additional information for each peripheral form.

For example, the basic information may include information about nearby airports, traffic information, weather information, accommodation information, and restaurant information. In addition, the peripheral form additional information may include various time-based traffic route information calculated based on the traffic information, weather information or safety information of the travel destination, and the like.

The augmented information transmitting unit 250 transmits the augmented information to the user terminal 110 when the augmented information is generated for each surrounding information.

3 is a block diagram of an augmented reality-based travel information providing terminal according to an embodiment. The augmented reality-based travel information providing terminal 300 according to an embodiment may be an embodiment of the travel information providing terminal 300 installed in the user terminal of Fig.

3, the augmented reality-based travel information providing terminal 300 includes a request receiving unit 310, a terminal control unit 320, an information transmitting unit 330, an information receiving unit 340, and an information output unit 3500 .

The request reception unit 310 receives a travel information provision request from the user. The user terminal 110 may receive various requests from the user and may be provided with an interface for providing travel information based on the augmented reality to the user, and the request receiving unit 310 may receive the user's request through the interface .

When receiving a travel information provision request from a user, the terminal control unit 320 controls various sensors and modules to provide travel information based on the augmented reality, and collects necessary information through the sensor. At this time, various sensors and modules may be basically installed in the terminal or may be an external device connected to the terminal.

For example, the terminal control unit 320 may control an image capturing module such as a camera to collect images of an airport or a destination for providing travel information. Then, when the image is collected, the collected image can be output to the display.

Also, the terminal control unit 320 may collect the current location information of the user by controlling the GPS sensor. Or various position measurement techniques such as a communication base station cell, a WiFi AP, an NFC, and a beacon method to collect and communicate the current position of the user.

The terminal control unit 320 may control the gyro sensor of the terminal 110 to collect direction information of the terminal 110 that the terminal 110 is facing.

The information transmission unit 330 transmits the collected information to the augmentation server 120 when the location information of the user such as the current position of the user and the direction of the terminal and the image information of the airport or the destination to provide the travel information are collected .

The information receiving unit 340 receives the augmentation information from the augmentation server 120 when the augmentation server 120 generates augmentation information for each peripheral information existing in the image. At this time, the augmentation information may include airport information and travel information for the main peripheral information existing at the airport or the destination which the user has photographed through the image capturing module. In addition, additional information such as weather information and safety information can be included in each major peripheral form.

The information output unit 350 receives the augmentation information for each peripheral information from the augmentation server 120, and outputs the augmentation information to a corresponding position in the image currently being output to the terminal. At this time, the information output unit 350 may superimpose the enhancement information of each peripheral information on the position of the corresponding peripheral information in the image.

Meanwhile, the information output unit 350 may output the augmenting information by applying perspective to each peripheral information. That is, based on the distance from the user's position to each peripheral information, the output of the augmenting information to be output becomes smaller as the distance increases.

In addition, the information output unit 350 may output detailed travel information on the selected peripheral information when the user selects the specific peripheral information on which the augmentation information is output from the image currently being output on the display of the terminal 110. [

For example, additional information such as current weather information, safety information, and the like can be output according to the neighboring spot, traffic information, accommodation information, restaurant information, and surrounding information of the selected surrounding information.

When the user arrives at the airport, when the user executes the application installed in the terminal 110, the travel information providing terminal device 300 controls the image capture module and displays the image to the specific surrounding area of the airport When the photographing module is faced, the image of the surrounding area is acquired in real time, and the obtained image information is outputted to the display of the terminal.

Also, the travel information providing terminal 300 controls the GPS sensor, the gyro sensor, and the like to collect user's location information such as the current location of the user and the direction information of the terminal, and provides the collected location information and airport information of the user And transmits the image information of the airport to be received to the travel information providing server device.

When the image information is received from the travel information providing terminal device 300, the travel information providing server device 200 transmits each peripheral information present in the image, for example, an airport entrance, an airport entrance gate number, a bus or a taxi You can check the main surrounding information such as platform, subway station and so on.

At this time, the shape of the surrounding information included in the image is analyzed to determine the surrounding forms such as the airport entrance, the gate number of the airport entrance and exit, the bus or taxi stand, and the subway station. Also, the user can grasp the position of the surrounding information in consideration of the current position of the user, and confirm the surrounding information from the direction of the terminal, the surrounding form, and the position of the surrounding information.

When the main peripheral information is confirmed in the image, the travel information providing server device 200 can transmit the location information of each peripheral information to the travel information server 130 to receive the travel information of the corresponding location.

When the travel information of the identified main peripheral information is received, the travel information providing server 200 can generate "traffic information, bus, or taxi"

The travel information providing server 200 transmits the augmented information to the travel information providing terminal 300 when the augmentation information for each surrounding information is generated as described above.

When the enhancement information on the main peripheral information is received from the travel information providing server device 200, the travel information providing terminal device 300 superimposes the enhancement information on the image being output on the display of the terminal. At this time, the environment of the peripheral information corresponding to the augmentation information may be output, but it may be superimposed immediately on the position of the corresponding peripheral information.

On the other hand, the travel information providing terminal 300 can output the received enhancement information based on the perspective.

That is, when the travel information providing terminal device 300 receives the enhancement information for the main information confirmed from the travel information providing server device 200, it compares the position information of the confirmed peripheral information with the current position of the user, Information can be calculated.

When the distance information between the current position of the user and the surrounding information is calculated, the travel information providing terminal 300 determines the size of the reinforcement information, for example, the letter size, in inverse proportion to the calculated distance information. Then, each enhancement information can be superimposed and output according to the determined character size on an image captured by the image capturing module of the terminal and being output to the display of the terminal.

It can be seen that the peripheral augmentation information of the airport which is the nearest peripheral information from the current position of the user is displayed in the largest size and the augmentation information about the area other than the airport which is peripheral information located farthest from the user's current position is displayed at the smallest .

This is an example of the detailed travel information that is output when the user selects the information about the inside of the airport.

For example, when the user confirms the enhancement information with respect to the main peripheral information and selects the airport peripheral information to confirm the detailed travel information on the peripheral information of the airport, the detailed travel information is outputted to the display of the terminal 110 .

At this time, the detailed travel information may include traffic information, accommodation information, and the like, as illustrated. However, this is not limited to the information that can be provided as detailed travel information as an example.

In addition, the user receives the travel environment information including the current time including the current time, such as the change in the travel environment of the airport or destination before or after the user arrives at the airport, that is, The following configuration is further provided so that the user can recognize the change information or recognize it in advance.

The user terminal 110 sets collection conditions for data including images, images, and messages of an airport or a destination stored in the information storage unit 112 of the user terminal 110, Information is transmitted to the outside through a communication network,

A travel environment record server 400 for receiving data collected through a condition set by the user terminal 110 via a communication network and storing the data in a DB and performing environmental logging using data received in real time during period setting information; , ≪ / RTI >

The travel environment record of the user corresponding to the data collected in accordance with the user's period setting information of the environment record creation information stored in the travel environment record DB of the travel environment record server 400 according to each of the periods during the set period An environment record reproducing unit 122 for receiving data from the travel environment record server 400 via a communication network is further included in the augmentation server 120. [

The environment recording and playback unit 122 sets collection conditions for data including images, images, and messages of an airport or a destination stored in the information storage unit 112 of the user terminal 110, The acquisition condition information is transmitted to the travel environment record server 400 and the environment record of the airport or destination period setting information and the collection condition information is reproduced through the information transmitted to the enhancement server 120.

More specifically, the environment recording / playback unit 122 records the environment setting information in accordance with the user's period setting information for the travel environment record creation information stored in the travel environment record DB of the travel environment record server 400, And receives data from the travel environment record server 400 through transmission / reception to output the travel environment record of the user of the selected airport or the destination corresponding to the collected data.

The travel environment record server 400 may generate image information for reproducing the travel environment of the selected air or destination and transmit the image information to the user terminal 110 through the communication network. The travel environment record server 400 can transmit the travel environment record information of the user so that the travel route or the set travel environment record is slowly output to the user terminal 110 in order and displayed, As shown in FIG.

The environmental record playback unit 122 included in the augmentation server 120 reproduces and generates a record of the travel environment on the condition set for the selected travel environment information of the user and transmits it to the user terminal 110 of the user, A plurality of members registered in the travel environment record server 400 or subscribed to the travel sharing server 140 may transmit the travel environment record information to the environment record server 400, To be shared.

Also, the travel environment record server 400 may be included in the augmentation server 120 and used.

The data providing unit 114 includes a system memory 113 and a data providing unit 114 in the user terminal 110. The data providing unit 114 is connected to the location information of the user included in the travel information providing server 200, (SNS) information with other user's terminal 110 through a transmission / reception module included in the user terminal 110. The message includes information related to the user's terminal 110, And stores the data on the system memory 113 stored in the information storage unit 112 in response to a user's execution request for the travel environment record application that controls the travel environment record server 400. [ As shown in FIG.

Hereinafter, a method of collecting travel environment information from the user terminal 110 and recording the travel environment to the travel environment record server 400 and the augmentation server 120 includes a travel environment period setting process, a travel environment record setting process, , The travel environment record creation process, and the data collection end according to the end of the travel environment recording period.

More specifically, the user terminal 110 loads the travel environment recording application stored in the information storage unit 112 onto the system memory 113 according to a user's execution request for the travel environment recording application, On the travel environment recording app, the user terminal 110 receives the travel environment period setting information from the input / output according to the user's input of the travel environment period setting information from the input / output of the user, and stores the information on the information storage unit 112.

Next, in the travel environment record setting process, the user terminal 110 sets the collection condition for the separated data including the photograph of the airport or the destination, the time, the image, and the message among the data received from the data providing unit 114 The travel environment period setting information and the collection condition information at the later stage are transmitted to the travel environment record server 400 via the communication network and stored in the DB.

Accordingly, the user terminal 110 collects data through the data providing unit 114 under the conditions set in the above step, and transmits the collected data to the travel environment record server 400 via the communication network to store the data in the DB.

In this step, the travel environment record server 400 transmits the travel environment period setting information and the collection condition information stored in the DB to the travel environment record server 400, Create a travel environment record.

More specifically, the travel environment record server 400 creates a travel environment record using data collected from the internal / external storage unit including the data providing unit 114 of the user terminal 110 during a period set as travel environment period setting information Or receives the travel environment information data created by the user terminal 110. [

When the travel environment record creation is directly performed, the travel environment record server 400 stores the "collected data" into the "location information" received from the data providing unit 114 of the user terminal 110, Time information "extracted from the travel environment record application data to generate the travel environment creation information displayed on the map included in the map data among the travel environment record application data and store it in the travel environment record DB, To be displayed on the display.

The user's travel information corresponding to the collected data at the end of each period during the period set according to the travel environment period setting information of the user for the environment record creation information stored in the travel environment record DB of the travel environment record server 400 The environmental record is transmitted to the environmental record reproduction unit 122 of the augmentation server 120 receiving the data from the travel environment record server 400 through the communication network and reproduced as enhancement information for the travel environment record creation, And transmits the image information to the user terminal 110 at the time of requesting the travel environment recording through the user terminal 110 of the user.

FIG. 5 is a flowchart of a travel information providing method performed by the travel information providing system of FIG. 1;

Referring to FIG. 5, the user terminal 110 outputs travel service information such as airport information and travel information to a user on the display of the terminal 110, and provides the user with travel information of a specific airport It can be provided to the user based on the augmented reality.

That is, when the augmented reality-based travel information provision request is received from the user, the user terminal 110 controls the various sensors and modules of the terminal 110 to transmit the image information of the airport to receive the location information and travel information of the user (Step S11).

Then, the location information and the image information of the collected user are transmitted to the augmentation server (step S12).

When the location information and the image information of the user including the current location of the user and the direction information of the terminal are received from the user terminal 110, the augmentation server 120 can confirm the information about the main peripheral information included in the image (Step S13).

Then, the travel information server 130 requests travel information on the confirmed main peripheral information (step S14).

When the travel information server 130 receives the travel information request for the location of the main peripheral information from the augmentation server 120, the travel information server 130 transmits the travel information on the location of the peripheral information to the augmentation server 120 (step S15).

When the travel information is received from the travel information server 130, the augmentation server 120 generates the augmentation information based on the travel information of the confirmed main peripheral information and the received travel information (step S16) (Step S17).

When the augmentation information is received from the augmentation server 120, the user terminal 110 superimposes and displays the augmentation information on the display of the terminal 110 (step S18).

6 is a flowchart of a travel information providing method performed by the travel information providing server apparatus of FIG.

The method for providing travel information based on augmented reality performed by the travel information providing server device 200 has been described in detail with reference to FIG.

Referring to FIG. 5, the location information of the user and the image information being outputted to the display of the current terminal are received from the user terminal 110 (step S21). At this time, the location information of the user may include the current location of the user and the direction information of the terminal.

Then, when the location information of the user is received, it is checked based on the direction indicated by the terminal 110 from the current location of the user to see what peripheral information is included in the received image (step S22).

At this time, the shape of the surrounding information in the image is analyzed, the shape of the surrounding information is determined based on the analysis result, and the surrounding information in the image can be confirmed using the determined surrounding shape.

Then, when the main peripheral information existing in the image is confirmed, the travel information is collected for the main peripheral information that has been confirmed (step S23). For example, when the main peripheral information is confirmed, the request information including the location information of the main peripheral information is transmitted to the travel information server 130, and the travel information on the location of the main peripheral information is received from the travel information server 130 can do.

Next, the augmentation information to be provided to the user is generated using the airport information and the collected travel information for each identified peripheral information (step S24). At this time, as described above, the augmentation information may include basic information including information about nearby airports, traffic information, weather information, accommodation information, and restaurant information, and additional information that can be additionally generated depending on the surrounding form .

Then, when the augmentation information is generated with respect to the main peripheral information, the augmentation information generated is transmitted to the user terminal 110 (step S25).

7 is a flowchart of a travel information providing method performed by the travel information providing terminal 300 of FIG.

The travel information providing method according to the present embodiment has been described in detail with reference to FIG. 3 and subsequent figures.

First, the travel information providing terminal 300 receives a travel information provision request from a user (step S31).

Then, when a request for providing travel information is received from the user, an image of the airport to be provided with travel information is collected by controlling a video image taking module such as a camera, and the current position of the user and the direction of the terminal Information can be collected (step S32).

Then, the acquired image information is output to the display of the terminal (step S33).

Next, the location information and image information of the collected user are transmitted to the augmentation server 120 (step S34), and the augmentation information on the main peripheral information in the image can be received from the augmentation server (step S35). At this time, the received augmentation information may include additional information such as airport information and travel information for the main peripheral information, weather information that can be generated according to the type of the main peripheral information, and safety information.

Then, when the augmentation information for each peripheral information is received from the augmentation server 120, the augmentation information is superimposed on the image being output to the current terminal, and the augmentation information is outputted (step S36).

At this time, the enhancement information of each surrounding information can be superimposed and displayed on the position of the corresponding peripheral information in the image. According to a further embodiment, by applying perspective to each peripheral information, The more information, the smaller the size of the enhancement information can be output.

Next, when the user selects specific peripheral information from which the enhancement information is output from the image currently being output on the display of the terminal 110, the selection information is received (step S37), and detailed travel information on the selected peripheral information is output (Step S38). At this time, the detailed travel information includes traffic information, accommodation information, restaurant information, and the like, and may include additional information such as weather information and stable information according to the form of the surrounding information, if necessary.

Embodiments of the present invention may be implemented in the form of program instructions that can be executed on various computer means and recorded on a computer readable medium. Such computer readable media may include program instructions, data files, data structures, etc., alone or in combination. Program instructions to be recorded on a computer-readable medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Includes all types of hardware devices that are specially configured to store and execute magneto-optical media and program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, and that various changes and modifications may be made without departing from the scope of the invention. .

The user terminal 110 information storage unit 112
System memory 113 Data provider 114
The augmentation server 120 environment recording and playback unit 122
Travel information server 130 Travel sharing server 140
The location information of the travel information providing server 200 and the image information receiving unit 210
Airport information confirmation part 220 Airport information reception part 230
Enhancement Information Generation Unit 240 The enhancement information transmission unit 250
The travel information providing terminal device 300 request receiving section 310
The terminal control unit 320 information transmission unit 330
Information receiving section 340 Information output section 350
Travel Environment Record Server 400

Claims (13)

A location and image information receiver for receiving, in real time, location information of the user from the user terminal and image information being outputted to the display of the terminal in order to provide the user with travel information based on the augmented reality;
An airport information confirmation unit for confirming which airports are included in the received image based on the direction indicated by the terminal from the current position of the user when the current position of the user and the direction information of the terminal are received from the user terminal;
An airport information collecting unit for collecting airport information about the identified major peripheral information when the main peripheral information existing in the image is confirmed using the confirmed airport information;
And generates relatively simple basic information by combining at least some of the peripheral information and the airport information so as to generate the augmentation information to be provided to the user by using the peripheral information and the collected travel information for each of the peripheral information of the identified airport An augmentation information generation unit for generating detailed additional information for each surrounding mode; And
And an augmented information transmitting unit for transmitting the augmented information to the user terminal when the augmented information is generated for each of the peripheral information. Device. The air conditioner of claim 1, wherein the airport information checking unit further receives location information of a user including at least one of a current position of the user and direction information of the terminal from the user terminal, And the information is confirmed based on the received information. 3. The method according to claim 2, wherein the airport information checking unit analyzes the shape of the surrounding information in the image in the image, determines the peripheral shape of the airport based on the analysis result, Wherein the airport information is confirmed using the augmented reality information. The information processing apparatus according to claim 1, wherein the weather information collecting unit transmits request information including the location information of the airport to the travel information server with respect to the identified main peripheral information, Wherein the augmented reality information receiving unit receives the augmented reality information. The method according to claim 1, wherein the augmented information includes basic information generated by combining at least a part of the peripheral information and the airport information, and additional information generated based on the respective peripheral forms. Information service providing apparatus. A request receiver for receiving a user request through an interface for receiving various requests from the user and providing the user with travel information based on the augmented reality;
A terminal control unit for controlling the image capture module to acquire an image including an airport or a destination and outputting the acquired image to a display;
An information receiving unit for receiving the augmentation information including the travel information related to the airport or the destination from the augmentation server; And
And an information output unit for outputting the received augmentation information at a corresponding position in the image, wherein the travel information providing terminal unit is included in the terminal. 7. The method according to claim 6, wherein, when the augmentation information is received for a plurality of airports or destinations in the image, the information output unit outputs the augmentation information corresponding to the selected airport and the destination based on the distance between the selected airport or the destination and the user And outputs the received augmented information according to the determined output size. 7. The navigation system according to claim 6, wherein the information output unit outputs detailed travel information on the selected airport or destination when the selection information of the airport or the destination from which the augmented information is output from the user is received, Information service providing apparatus. 7. The method of claim 6, wherein the terminal control unit further collects location information of a user including at least one of a current location of the user and direction information of the terminal, And an information transmission unit for transmitting the information of the acquired image to the augmentation server. The method of claim 1, wherein the user terminal sets collection conditions for data including images, images, and messages of an airport or a destination stored in an information storage unit of the terminal, and transmits period setting information and collection condition information to a communication network Lt; RTI ID = 0.0 >
And a travel environment record server for receiving data collected through the condition set by the user terminal through a communication network and storing the data in a DB, and performing environment recording using data received in real time during period setting information,
The travel environment record of the user corresponding to the data collected in accordance with the user's period setting information of the environment record creation information stored in the travel environment record DB of the travel environment record server, And an environment record reproducing unit for receiving data from the travel environment record server is further included in the augmented reality server. A step of collecting image information of an airport to receive a location information and a travel information of a user by controlling various sensors and modules of the terminal when a request for provision of augmented reality based travel information is received from the user terminal;
Transmitting the collected location information and image information of the user to the augmentation server;
Wherein the augmentation server comprises: receiving, when a location information and image information of a user including a current position of the user and direction information of the terminal are received from the user terminal, information about the main peripheral information included in the image;
Requesting the travel information server for the confirmed main peripheral information;
Wherein the travel information server transmits travel information on the location of the peripheral information to the augmentation server when the travel information request for the location of the main peripheral information is received from the augmentation server,
Generating the augmented information based on the travel information of the main peripheral information and the received travel information and transmitting the augmented information to the terminal of the user when the travel information is received from the travel information server; And
Wherein the user terminal includes a step of superimposing and displaying the augmented reality information on an image being output on a display of the terminal when the augmentation information is received from the augmentation server. Receiving the location information of the user from the user terminal and the image information being output to the display of the current terminal;
When the location information of the user is received, checking which peripheral information is included in the received video based on the direction indicated by the terminal from the current location of the user;
Collecting travel information about the identified major peripheral information when the main peripheral information existing in the image is confirmed;
Generating augmentation information to be provided to the user using the airport information and the collected travel information for each of the identified peripheral information; And
And transmitting the augmented information to the user terminal when the augmented information is generated for the main peripheral information. The travel information providing terminal receiving the travel information provision request from the user terminal;
When a request for providing travel information is received from a user terminal, an image capturing module such as a camera is controlled to collect an image of an airport for providing travel information, and the current position of the user and the direction information of the terminal are obtained using a GPS, a gyro sensor, Collecting,
Outputting the obtained image information to a display of the terminal;
Transmitting the collected location information and image information of the user to the augmentation server;
Receiving enhancement information on the main peripheral information in the image from the enhancement server;
When the augmentation information for each peripheral information is received from the augmentation server, the augmenting information is superimposed on the image being outputted to the current terminal,
Receiving selection information by selecting specific peripheral information to which the enhancement information is output from an image being output on a display of the terminal; And
And outputting the detailed travel information on the selected peripheral information.

Images