KR20210086834A - System and method for providing AR based tour information via smart glasses - Google Patents

Abstract

The present invention relates to a system for providing augmented reality-based tour information by using smartglasses and a method thereof and, more specifically, to a system for providing augmented reality-based tour information by using smartglasses, which can extract information on local places such as restaurants, cafes, pubs, and tourist attractions that exist within a radius based on the location of a user through big data analysis based on the location by being linked with smartglasses carried by the user, can display the extracted information on the smartglasses in an augmented reality manner, and can provide, at the request of the user, a guide image for a destinated desired by the user on the smartglasses as an augmented reality image including arrow guidance for a traveling direction and an estimated time, thereby providing more accurate and safe guidance while performing support so that the user can check information on local places adjacent to an area where the user is located. The system comprises: a big data processing unit for extracting information on local places adjacent to a user; and an image generating unit for generating an augmented reality image provided through the smartglasses.

Description

Augmented reality-based tourism information providing system and method using smart glasses {System and method for providing AR based tour information via smart glasses}

The present invention relates to a system and method for providing tourism information based on augmented reality using smart glasses, and more particularly, to a user's location based on big data analysis based on the user's location in conjunction with smart glasses possessed by the user. By extracting local place information such as restaurants, cafes, pubs, and tourist destinations within a certain radius, it is displayed and provided as augmented reality on smart glasses, and at the same time, according to the user's request, a navigation video for the destination the user wants to go is provided on smart glasses as an augmented reality screen that includes arrow guidance for the direction of travel and the estimated required time, so that users can more conveniently check local place information in the area where they are located, and at the same time, more accurate And it relates to an augmented reality-based tourism information providing system that provides safe directions.

Augmented reality (AR) is a field of virtual reality (VR). It is a computer graphic technique that synthesizes virtual objects or information in the current world seen by the user to make them appear as if they exist in the original environment. . Due to these characteristics, it can be applied to various real environments, and thus it is attracting attention as a next-generation display technology suitable for ubiquitous environments.

Augmented reality technology is classified into location-based augmented reality, marker-recognized augmented reality, and markerless augmented reality according to tracking technology that accurately recognizes the mapping position of an image or image.

Recently, as the travel population increases, the development of tour guide service contents using such augmented reality technology is increasing, and the tourism guide service using such augmented reality technology mainly uses marker recognition or markerless augmented reality. That is, when a registered marker or a specific object is recognized through the camera, in most cases, an introductory video or audio file for the corresponding marker or object is provided to a smart device.

For example, Korean Patent Application Laid-Open No. 10-2014-0080720 discloses a technology for providing an augmented reality image by detecting an object recognized in a real image matching a preset criterion with a natural marker and providing an augmented reality image. Since the markers are recognized and the stored description of the tourist destination is displayed realistically as an augmented image, there is a limitation that information about the surrounding tourist spots, providing information or directions, etc. by theme cannot be effectively performed, and furthermore, information on nearby local places or There are many shortcomings in the provision of active tour guide services such as support for walking directions.

1. Republic of Korea Patent Publication No. 10-2014-0080720 (published date: July 1, 2014) "Augmented reality image-based tourism guide device"

The present invention is to solve the problems according to the prior art, in conjunction with the smart glasses possessed by the user, through big data analysis based on the user's location, restaurants, cafes, and pubs existing within a certain radius based on the user's location , tourist destinations, etc. are extracted and displayed as augmented reality on smart glasses, and at the same time, according to the user's request, a navigation video for the destination the user wants to go to is provided with arrow guidance for the direction of travel and the estimated required time By providing on smart glasses with an augmented reality screen with Its purpose is to provide a tourism information providing system.

The present invention for achieving the above object is connected to a user's smart glasses through wireless communication, and connected to a plurality of external API servers including a map server and a tourist information providing server through wired and wireless communication networks, A system for providing tour guide information to a user wearing an augmented reality image, comprising: a communication unit for communicating with smart glasses and an external API server; a big data processing unit that receives user location information from smart glasses through the communication unit and extracts local place information around the user from an external API server; a route generator for calculating a route to a set destination based on the map information received from the external API server according to the destination information input from the user through the communication unit; and an image generator for generating an augmented reality image provided through smart glasses; According to the user location information transmitted from the smart glasses, the local place information around the received location is provided to the user as an augmented reality image, and a navigation image according to the destination information input from the user is augmented to the user. It provides a tourism information providing system based on augmented reality using smart glasses, characterized in that it is provided as a real image.

The system for providing tourism information based on augmented reality using smart glasses of the present invention analyzes big data based on the user's location in conjunction with the smart glasses possessed by the user, and local places such as restaurants, cafes, pubs, and tourist destinations within a certain radius By providing the location and detailed information of the location in augmented reality through smart glasses, users can conveniently check local place information that is more practical and useful than the conventional tourist guide service through augmented reality without the hassle of searching for information every time. there is this

In addition, according to the user's request, by providing a navigation image for the destination the user wants to go to on the smart glasses as an augmented reality screen including arrow guidance for the direction of travel and the estimated required time, the user can take a direction from an unfamiliar place. Even if you don't know how to do this, you can easily reach your destination without getting lost if you follow the arrows, and it has the effect of making you safer from the risk of accidents caused by carelessness caused by looking at your smartphone.

1 is a diagram schematically showing a networking structure of an augmented reality-based tourism information providing system using smart glasses according to an embodiment of the present invention.
2 is a block diagram schematically illustrating the configuration of an augmented reality-based tourism information providing system using smart glasses according to an embodiment of the present invention.
3 is a flowchart illustrating a method of providing local place information using an augmented reality-based tourism information providing system using smart glasses according to an embodiment of the present invention.
4 is a flowchart illustrating a method of providing route guidance using an augmented reality-based tourism information providing system using smart glasses according to an embodiment of the present invention.
5 to 6 are diagrams showing an example of a local place information providing screen provided to a user through smart glasses in an augmented reality-based tourism information providing system using smart glasses according to the present invention.
7 is a view showing an example of a walking route guidance service providing screen provided to a user through smart glasses in an augmented reality-based tourism information providing system using smart glasses according to the present invention.

Since the present invention can have various changes and can have various forms, specific embodiments are illustrated in the drawings and described in detail in the text.

However, this is not intended to limit the present invention to the specific disclosed form, it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

The terminology used in the present application is only used to describe specific embodiments, and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification is present, and includes one or more other features or It should be understood that the existence or addition of numbers, steps, operations, components, parts, or combinations thereof does not preclude the possibility of addition.

Hereinafter, preferred embodiments of the present invention will be described in detail based on the accompanying drawings.

1 is a diagram schematically showing a networking structure of an augmented reality-based tourism information providing system using smart glasses according to an embodiment of the present invention.

As shown in FIG. 1 , the augmented reality-based tourism information providing system 100 using smart glasses of the present invention is connected to the smart glasses 200 individually owned by the user through wireless communication, and at the same time It is connected to a plurality of external API servers 300 such as a map server and a tourist information server storing information such as place information, map information, and tourist destination information through wired and wireless communication networks.

Through such a network connection, the tourism information providing system 100 of the present invention collects the user's location information from each smart glasses 200 that the user has individually, and collects information on nearby places for each user's location, Map information, tourist information, etc. are extracted from a plurality of external API servers 300 through big data analysis, and provided in augmented reality on the screen of the smart glasses 200 that the user individually possesses.

At this time, the smart glasses 200 connected to the tourism information providing system 100 of the present invention can transmit and receive data to and from the tourism information providing system 100 of the present invention, and in addition, a device capable of displaying an augmented reality image As such, they may be individually sold to users, or distributed and provided to tourists in tourist destinations.

2 is a block diagram schematically illustrating the configuration of an augmented reality-based tourism information providing system using smart glasses according to an embodiment of the present invention.

As shown in FIG. 2 , the augmented reality based tourism service system 100 using the smart glasses of the present invention includes a communication unit 110 , a big data processing unit 120 , a route generation unit 130 , and an image generation unit ( 140) is included.

The communication unit 110 performs communication with the smart glasses and an external API server.

The big data processing unit 120 extracts local place information around the user from the external API server according to the user location information received from the smart glasses through the communication unit.

In this case, the big data processing unit 120 classifies and extracts local place information by categories such as restaurants, cafes, pubs, and tourist destinations. In addition, since provision of local place information is delayed when the search range is unnecessarily widened, the information extraction range may be preset, such as set to extract local place information within a certain radius of the user's location, for example, 1 km. .

The route generating unit 130 receives the destination information input from the user through the communication unit 110 , calculates a walking route to the set destination based on the map information stored in the external API server, and the real-time location of the user The route from to the destination is matched with the map, and the remaining distance and required time are calculated.

The image generator 140 serves to generate an augmented reality image to be provided to a user. First, it is possible to generate an augmented reality image that briefly expresses the local place information extracted from the big data processing unit 120 in the form of a marker, and the generated augmented reality image is provided to the user's smart glasses screen through the communication unit 110 . . Thereafter, when the user clicks the marker of the augmented reality image displayed on the smart glasses, the augmented reality image providing detailed information of the local place may also be generated so as to provide detailed information of the corresponding local place.

In addition, the image generating unit 140 receives the user's location, the user's gaze direction, the camera image, etc. from the smart glasses in real time through the communication unit 110 , and based on this, the walking path generated by the path generating unit 130 . It is possible to generate an augmented reality image for providing information.

At this time, the markers generated to briefly express the local place information may be generated in different forms for each category so that the big data processing unit 120 classifies categories such as restaurants, cafes, pubs, and tourist destinations, In the augmented reality image for providing walking directions information, an arrow indicating a moving direction for destination guidance may be implemented.

As described above, the augmented reality-based tourism information providing system 100 using the smart glasses of the present invention provides a variety of information such as place information, map information, and tourist destination information from an external API server according to the user's location in the big data processing unit 120 . The local place information extracted by parsing the information can be provided as an augmented reality screen through smart glasses. Also, based on the route generated by the route generator 130 according to the destination input by the user, an arrow indicating the direction of travel may be provided through smart glasses by generating an augmented reality image of a road guidance displayed with .

Through this, the user can be provided with various place information based on the current location when walking in an unfamiliar tourist destination, and there is an effect of accurately and conveniently finding a way even in a complicated alleyway.

Hereinafter, a method of providing local place information to a user in an augmented reality-based tourism information providing system using smart glasses according to the present invention will be described.

3 is a flowchart illustrating a method of providing local place information using an augmented reality-based tourism information providing system using smart glasses according to an embodiment of the present invention.

As shown in FIG. 3, the augmented reality-based tourism service system of the present invention collects user location information from smart glasses (S101), and extracts local place information through big data processing based on the collected user location After (S102), an augmented reality image in which the extracted local place information is briefly displayed with a marker is generated (S103), and the corresponding augmented reality image can be provided to the user through the smart glass screen (S104), as well as , In addition, when the user clicks a marker indicating a local place displayed on the smart glasses screen, detailed information of the local place may be provided ( S105 ).

Here, in the step (S103) of generating an augmented reality image in which the extracted local place information is displayed as a marker, local place information around the user is displayed using different markers for each category such as restaurants, cafes, pubs, and tourist destinations. Of course, the augmented reality image can be generated so that the user can select by category and check by theme.

In addition, in the step of providing detailed local place information ( S105 ), in response to a user's click, that is, a request to provide information on a specific local place, the details of the local place such as the store name, store address, phone number, and business hours Information can be augmented and provided through the screen of smart glasses.

The local place providing screen provided to the user as described above will be described in more detail with reference to FIGS. 5 and 6 to be described later.

In the above way, based on the user's location, local place information within a certain radius is provided to the user in augmented reality through smart glasses, so that the user can obtain various information about local places based on big data without going through a cumbersome search process. It can be provided easily, and it has the advantage of being able to conveniently check information on nearby areas even in situations where it is difficult to carry a lot of luggage while traveling.

Hereinafter, a method for providing directions to a destination to a user in the augmented reality-based tourism information providing system using smart glasses according to the present invention will be described.

4 is a flowchart illustrating a method of providing a route guidance to a destination using an augmented reality-based tourism information providing system using smart glasses according to an embodiment of the present invention.

As shown in FIG. 4 , when a destination is input from the user through smart glasses (S201), the tourism information providing system collects the user's current location information (S202) and creates a walking path to the corresponding destination (S203) At the same time, the image that the user is looking at is collected in real time from the camera mounted on the smart glasses (S204), and the augmented reality image of the road guidance is displayed so that the arrow display for the traveling direction according to the generated walking path matches the user's field of view. After creation (S205), by providing a navigation augmented reality image on the screen on the smart glasses that the user is looking at (S206), it supports the user to look at the surrounding situation in reality while looking for a road, such as a smart phone, etc. It can prevent accidents caused by inattentiveness caused by failing to look around while looking at the camera, and supports to easily reach the destination without getting lost by simply following the direction of the arrow even in an unfamiliar place.

The screen for providing a walking route guidance service for tourists according to the present invention provided in the above manner will be described in more detail with reference to the embodiment of FIG. 7 to be described later.

5 to 6 are diagrams showing an example of a local place information providing screen provided to a user through smart glasses in an augmented reality-based tourism information providing system using smart glasses according to the present invention.

In the augmented reality-based tourism service system using smart glasses according to the present invention, as shown in FIG. 5, local place information such as restaurants, cafes, pubs, and tourist destinations within a certain radius around the user, for example, 1 km, is provided. It is expressed as a marker 141 for each category and provided to the user.

In addition, when the user selects a specific category from the menu bar 142 by displaying the menu bar 142 on one side of the screen, only information on the category desired by the user may be provided to support selective information confirmation.

Furthermore, when the user clicks on the marker 141 displayed on the image, as shown in FIG. 6 , a pop-up screen 143 in which detailed information such as the name, address, phone number, and business hours of the corresponding local place is provided is provided. .

Using the local place information through smart glasses provided through the method as described above, there is an advantage that the user can easily search for a tourist destination while simply looking around 360 degrees without any cumbersome search process.

In addition, as described above, while providing local place information to the user, by highlighting and displaying a specific local place or displaying advertisement information, event information, discount information, etc. together, advertisement revenue can be obtained from companies.

7 is a view showing an example of a walking route guidance service providing screen provided to a user through smart glasses in an augmented reality-based tourism information providing system using smart glasses according to the present invention.

As shown in FIG. 7 , through the smart glass screen, the user can check the guide information 144 such as the remaining distance to the destination and the estimated required time along with the actual surrounding environment image on one side of the screen, and click the arrow 145 You can get directions in real time. Unlike various conventional navigation services, by guiding the direction of the destination through the arrow 145 on the real screen that the user is looking at, there is an effect that can prevent accidents caused by carelessness that occur while looking for a way while looking at a separate terminal. In addition, users can find the correct direction without worrying about getting lost even in complicated alleyways, so it has the advantage of being able to enjoy sightseeing while looking around more leisurely even in unfamiliar places.

As described above, in the augmented reality-based tourism service system using smart glasses according to the present invention, various place information based on big data is provided as augmented reality images through smart glasses to tourists walking in unfamiliar tourist destinations. In addition, by providing augmented arrows on the actual screen displayed through smart glasses so that they can find their way accurately and conveniently even in complex alleyways, tourists can travel without consuming time and physical strength to search for tourist information one by one or to find a way. In addition to being able to focus on , moreover, you can travel to more diverse places and experience the area, and also create a tour course that suits your individual taste without a tour guide, thereby increasing user satisfaction with your trip. It works.

The present invention described above is not limited by the above-described embodiments and the accompanying drawings, and it is in the technical field to which the present invention pertains that various substitutions, modifications and changes are possible within the scope without departing from the technical spirit of the present invention. It will be obvious to those with ordinary knowledge.

100: tourism information providing system 110: Ministry of communication
120: big data processing unit 130: path generation unit
140: image generator 141: marker
142: menu bar 143: pop-up screen
144: guide information 145: arrow
200: smart glasses 300: external API server

Claims (10)

It is connected through wireless communication with the user's smart glasses, and is connected to a number of external API servers including a map server and tourist information providing server through wired and wireless communication networks, and provides users with smart glasses for tourism through augmented reality images. In the system for providing guide information,
a communication unit for communicating with smart glasses and an external API server;
a big data processing unit that receives user location information from smart glasses through the communication unit and extracts local place information around the user from an external API server;
a route generator for calculating a route to a set destination based on the map information received from the external API server according to the destination information input from the user through the communication unit; and
an image generator for generating an augmented reality image provided through smart glasses; consists of,
Providing the local place information around the received location as an augmented reality image to the user according to the user's location information received from the smart glasses, and providing the user with an augmented reality image with a navigation image according to the destination information input from the user. Augmented reality based tourism information providing system using smart glasses
The method of claim 1,
The big data processing unit,
Augmented reality-based tourism information providing system using smart glasses, characterized in that the local place information is classified and extracted by categories including restaurants, cafes, pubs and tourist destinations
The method of claim 1,
The big data processing unit,
Based on the received user's location information, an augmented reality based tourism information providing system using smart glasses, characterized in that the local place information is extracted within a preset distance radius centered on the user's location
3. The method of claim 2,
On one side of the augmented reality image provided to the user,
Augmented reality-based tourism information providing system using smart glasses, characterized in that a menu screen for each category in which the local places are classified is provided
It is connected through wireless communication with the user's smart glasses, and is connected to a number of external API servers including a map server and tourist information providing server through wired and wireless communication networks, and provides users with smart glasses for tourism through augmented reality images. A method of providing tourist information around a user's location based on a system that provides guide information,
collecting location information of a user who uses smart glasses;
extracting local place information around the collected location based on big data;
generating a marker indicating the extracted local place; and
providing a local place image including the generated marker as an augmented reality image through smart glasses;
A method of providing tourism information based on augmented reality using smart glasses, characterized in that it comprises a
6. The method of claim 5,
The marker indicating the extracted local place is,
Augmented reality-based tourism information providing method using smart glasses, characterized in that the local place information is formed in different shapes for each category including restaurants, cafes, pubs and tourist destinations
6. The method of claim 5,
When the user clicks on a local place marker provided through smart glasses,
Augmented reality-based tourism information providing method using smart glasses, characterized in that detailed information including the clicked local place's shop name, shop address, phone number and business hours are provided through a pop-up screen
It is connected through wireless communication with the user's smart glasses, and is connected to a number of external API servers including a map server and tourist information providing server through wired and wireless communication networks, and provides users with smart glasses for tourism through augmented reality images. A method for providing a guide image to a destination to a user based on a system for providing guide information, the method comprising:
receiving a destination input from a user using smart glasses;
collecting the user's location information;
generating a route to the destination based on the received destination and location information of the user;
collecting a real image viewed by a user from a camera mounted on the smart glasses in real time;
generating an augmented reality-based route guidance image that matches the collected real image viewed by the user in order to guide the generated route; and
providing the generated augmented reality-based route guidance image through smart glasses;
A method of providing tourism information based on augmented reality using smart glasses, characterized in that it comprises a
9. The method of claim 8,
In the step of generating the augmented reality-based way guidance image,
Augmented reality-based tourism information providing method using smart glasses, characterized in that the augmented reality image is generated so that the arrow display for the moving direction is implemented in the road guide image
9. The method of claim 8,
In the step of generating the augmented reality-based way guidance image,
A method of providing tourism information based on augmented reality using smart glasses, characterized in that a guide information screen displaying the remaining distance to the destination and the estimated required time is provided on one side of the route guidance image provided through smart glasses.

Images