KR102370007B1 - Real-time travel information provision system based on user location - Google Patents

Abstract

The present invention relates to a user location-based real-time travel information provision system. With the present invention, tourist destination information and facility information can be provided in real time in accordance with a user's movement in an area. The system includes: a determination unit determining whether a user is a tourist based on location information transmitted in real time from a user terminal; a tourist destination information providing unit receiving the selection of a tourist destination of interest by providing the user terminal with a local tourist destination list preset in accordance with the location information in a case where it is determined that the user is a tourist; a facility information providing unit searching a storage DB for a facility list classified in accordance with the tourist destination of interest and providing the list to the user terminal; a feedback unit receiving from the user terminal feedback of review information about local products sold at a facility on the facility list and defective product AR images corresponding to negative evaluation in the review information; an algorithm generating unit classifying damaged objects extracted from the defective product AR images by product type and performing input by machine learning to generate an artificial intelligence-based defect determination algorithm by product type; and a local product determination unit deriving a defect probability with respect to a purchased product by inputting a product object extracted from a purchased product AR image captured in real time through the user terminal to the artificial intelligence-based defect determination algorithm.

Description

Real-time travel information provision system based on user location {REAL-TIME TRAVEL INFORMATION PROVISION SYSTEM BASED ON USER LOCATION}

The present invention relates to a user location-based real-time travel information providing system, and more particularly, to a user location-based real-time travel information providing system that can provide tourist information and facility information in real time according to a user's local movement route. it's about

Recently, location-based service (LBS) is emerging as a new industrial field to target the evolution of mobile communication terminals and a new wireless data service market. The location-based service provides various additional application services required by the user by combining the user's location information on the move with various other useful information in real time.

Among the additional application services using the location-based service, there is a typical service method for providing travel information. The existing service method of providing travel information is a method in which the consumer selects a travel itinerary established by a group of experts such as a travel agency according to their preference, and only provides the itinerary and reservation of travel products. In addition, some travel information sites support the establishment of a travel schedule, but only support the preparation of a plan through simple input, and it is not possible to provide an optimized travel schedule.

In particular, in recent years, as the number of travelers wishing to travel freely in order to escape the uniform travel of travel agencies increases, the uniform travel information provided by professional travel agencies is in a situation that does not satisfy travelers wishing to travel freely. Travelers wishing to travel freely use the Internet and related books to obtain travel information, or meet people who have already traveled to the relevant destination for advice, or go on a trip recklessly.

As such, it is common for people who have decided on a destination they want to visit to collect information necessary to travel through various methods and make a plan based on this. However, despite collecting information and making a plan for the desired destination in their own way, most of them do not fully experience the characteristics of the destination and experience failure in travel. In this case, you may have regrets about a trip that cannot be easily departed and you may suffer financial loss.

Laid-Open Patent Publication 10-2018-0055132 (2018.05.25)

The present invention is to solve the above problems, and it is an object of the present invention to provide tourist information and facility information in real time according to the user's local movement route, and at the same time to provide defective judgment information for local products sold at the facility. is doing

In addition, it is to provide users with facility discount coupons and rewards that reduce facility usage costs by relaying specific response information according to the capture of SNS posts related to facility images and specific phrases related to advertisement products.

These and other objects and advantages of the present invention will become apparent from the following description of preferred embodiments.

In order to achieve the above object, a travel information providing system for storing and managing a plurality of facilities according to an embodiment of the present invention by facility type, region, and tourist destination in advance and storing and managing them in a storage DB, receiving real-time transmission from a user terminal Based on the location information, a determination unit that determines whether the user is a tourist or not, if the traveler is determined, a tourist destination that selects a tourist destination of interest by providing the user terminal with a preset local tourist destination list according to the location information An information providing unit, a facility information providing unit that searches the storage DB for a list of facilities classified according to the interested tourist destination and provides it to the user terminal, A feedback unit that receives feedback from the user terminal on the review information and the AR images of the defective product corresponding to the negative evaluation in the review information, classifies a plurality of damaged objects extracted from the AR images of the defective product according to the product type, and machine learning An algorithm generating unit that generates an artificial intelligence-based defect determination algorithm for each product type by input through , and a local product determination unit for deriving a defective probability for the purchased product, wherein the local product determination unit transmits normal determination information for the AR image of the purchased product to the user terminal when the defective probability is less than a preset value.

When it is determined that the location information of the user is adjacent to the one of the facilities within a predetermined distance, the facility information providing unit provides detailed facility information about the one facility to the user terminal in the form of a push notification, and the facility Detailed information includes internal and external images, map information, travel distance information, reservation information, phone number, room usage price, price for each menu, review information, facility introduction information, and website information for any one of the above facilities.

The determination unit selects any one facility including a facility discount right contracted in advance through a discount contract with facility managers from the facility list, and captures a facility image related SNS post capture corresponding to the one facility from the user terminal and a relay unit for relaying the capture of the SNS posting received from the requesting unit and the user terminal to the facility manager terminals, and receiving the facility discount coupon from the facility manager terminals and relaying it to the user terminal, the request As another facility that does not include the facility discount right is selected from the facility list, the unit requests the user terminal for specific response information according to a specific phrase query related to an advertisement product pre-contracted through a reward compensation contract with advertisers. .

The tourist destination information providing unit includes a tourist destination information classification unit that classifies the tourist destination list into indoor and outdoor tourist destinations, and any one of a specific indoor tourist destination and a specific outdoor tourist destination based on whether the tourist destination list is subject to weather environment changes and epidemic disease-related gathering prohibited areas. A filtering unit for filtering and when the target tourist destination is a specific outdoor tourist destination, schedule a visit to the recommended outdoor tourist destination used most frequently by previous users It includes a scheduling unit that schedules a visit to the recommended indoor tourist destination with the lowest possible cost.

The facility recommendation unit provides a facility recommendation unit that provides a list of recommendations including the facility discount coupon from a facility list located within a certain distance from a tourist destination of interest, a facility photographed image photographed through the user terminal, and a plurality of images previously collected in the storage DB and a facility information identification unit for identifying facility information for facility photographed images based on the similarity between facility images of Retrieves the review information of the user and provides it to the user terminal in the form of a push notification.

According to an embodiment of the present invention, it is possible to provide tourist information and facility information in real time according to the user's local movement route, and at the same time provide information on bad judgment on local products sold in the corresponding facility.

In addition, facility use costs can be reduced by providing the user with a pre-contracted facility discount right through a discount contract with facility managers and a pre-contracted reward through a reward compensation contract with advertisers.

1 is a diagram schematically illustrating a user location-based real-time travel information providing system according to an embodiment of the present invention.
FIG. 2 is a diagram for explaining in detail the operation of the user location-based real-time travel information providing system of FIG. 1 .
FIG. 3 is a diagram specifically illustrating the determination unit of FIG. 1 .
4 is a diagram specifically illustrating the tourist destination information providing unit of FIG. 1 .
FIG. 5 is a diagram specifically illustrating the facility information providing unit of FIG. 1 .

Hereinafter, the present invention will be described in detail with reference to embodiments and drawings of the present invention. It will be apparent to those of ordinary skill in the art that these examples are merely presented by way of example to explain the present invention in more detail, and that the scope of the present invention is not limited by these examples. .

Further, unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, and in case of conflict, this specification, including definitions description will take precedence.

In order to clearly explain the invention proposed in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are assigned to similar parts throughout the specification. And, when a part "includes" a certain component, this means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, "unit" described in the specification means one unit or block that performs a specific function.

In each step, identification numbers (first, second, etc.) are used for convenience of description, and identification numbers do not describe the order of each step, and each step does not clearly describe a specific order in context. It may be performed differently from the order specified above. That is, each step may be performed in the same order as the specified order, may be performed substantially simultaneously, or may be performed in the reverse order.

1 is a diagram schematically showing a user location-based real-time travel information providing system 100 according to an embodiment of the present invention, and FIG. 2 is an operation of the user location-based real-time travel information providing system 100 of FIG. 1 . It is a diagram for explaining in detail.

1 and 2, the user location-based real-time travel information providing system 100 according to an embodiment of the present invention includes a determining unit 110, a tourist destination information providing unit 120, and a facility information providing unit. 130 , a feedback unit 140 , an algorithm generating unit 150 , and a local product determining unit 160 may be included.

Also, the determination unit 110 may determine whether the user is a traveler based on the user location information received from the user terminal 10 in real time through the travel service application.

Here, the travel service application is a program that is provided and installed on a mobile terminal through a web server or an application market, and uses the user location-based real-time travel information providing system ( 100) can be transmitted.

Specifically, the determination unit 110 is transmitted from the user terminal 10 in real time through the travel service application, and when the user location information moves over a preset distance for a certain period of time, it is determined that the user is a traveler (tourist). can

Next, when it is determined that the user is a tourist, the tourist destination information providing unit 120 may select a tourist destination of interest by providing a preset local tourist destination list to the user terminal 10 according to the user's location information.

Here, the tourist destination list may mean at least one or more of cultural assets, arboretums, lakes, mountains, seas, and parks located in a preset area.

The tourist destination information providing unit 120 may search and provide keyword search information related to a tourist destination of interest through a website.

According to an embodiment, the tourist destination information providing unit 120 automatically translates voice information and text information for keyword search information provided to the user terminal 10 to correspond to the language set by the user terminal 10 , can provide

In this case, the user terminal 10 has its own country set according to the user's nationality or language. For example, the tourist destination information providing unit 120 automatically translates voice information and text information for keyword search information according to the language set by the user terminal 10 and provides it to the user terminal 10 . .

Next, the facility information providing unit 130 may search the list of facilities classified according to the tourist destination of interest from the storage DB 200 and provide it to the user terminal 10 .

Here, the facility list may be a list that includes at least one facility available to the user, such as restaurants, cafes, lodging facilities, tourist destinations, amusement facilities, parks, swimming pools, and the like, and is sorted in order of proximity from user location information.

The facility information providing unit 130 may receive each facility information from the facility manager terminals 11_1 to 11_N in advance through a travel service application and store it in the storage DB 200 .

In this case, the storage DB 200 may classify a plurality of facilities by facility type, region, and tourist destination in advance, and store and manage them as a facility list for each facility type, a facility list for each region, and a facility list for each tourist destination.

According to one embodiment, according to an embodiment, when it is determined that the user's location information is adjacent to one of the facilities within a predetermined distance, the facility information providing unit 130 pushes notification of the detailed facility information for one of the facilities It can be provided to the user terminal 10 in the form.

Here, the detailed facility information may include internal and external images of any one facility, map information, travel distance information, reservation information, phone number, room usage price, menu price, review information, facility introduction information, and website information. there is. Such detailed facility information may be provided in the form of audio information, text information, image information, and link information of an image providing service such as YouTube.

According to another embodiment, the facility information providing unit 130 receives a facility image related SNS post from the user terminal 10 and is contracted in advance through a discount contract so that it can be relayed to the facility manager terminals 11_1 to 11_N. The facility manager terminals 11_1 to 11_N may be registered in the storage DB 200 .

According to another embodiment, the facility information providing unit 130 receives the specific response information according to the specific phrase query related to the advertisement product from the user terminal 10 and relays it to the advertiser terminals 12_1 to 12_N. The advertiser terminals 12_1 to 12_N contracted in advance through a contract may be registered in the storage DB 200 .

According to another embodiment, the facility information providing unit 130 corresponds to the language set by the user terminal 10, the voice information and text information for the facility list and facility detailed information provided to the user terminal (10). It can be automatically translated so that it can be provided. For example, the facility information providing unit 130 automatically translates voice information and text information for the facility list and facility detailed information according to the language set by the user terminal 10, and then sends it to the user terminal 10. will provide

Next, the feedback unit 140 is a defective product AR corresponding to a negative evaluation in the review information and the review information on a plurality of local products sold at any one facility in the facility list provided through the facility information providing unit 130 . The images may be fed back from the user terminal 10 and stored in the storage DB 200 .

In addition, the feedback unit 140 may store the AR images of the defective product collected by the manager in advance as big data in the storage DB 200 .

Next, the algorithm generating unit 150 classifies a plurality of damaged objects extracted from the defective product AR images stored in the storage DB 200 according to the product type, and learns them through machine learning to determine AI-based defects Algorithms can be created for each product type.

Here, the damaged object may mean an image object including an abnormal product, such as an object with a damaged product appearance or an object with a discolored product.

In this case, the AI-based defect determination algorithm may be an algorithm for deriving a defective probability value by receiving a damaged object for each product type extracted from the purchased product AR image. Such an artificial intelligence-based failure determination algorithm may be any one of an artificial neural network, a support vector machine (SVM), a decision tree, and a random forest.

For example, artificial neural networks are mainly used in deep learning and are statistical learning algorithms inspired by neural networks in machine learning and biology, and may be convolutional neural networks including feature extraction neural networks and classification neural networks. In particular, the convolutional neural network is a kind of deep, feed-forward artificial neural network used to analyze visual images. Images can be recognized based on the acquired features.

Next, the local product determination unit 160 inputs the product object extracted from the purchased product AR image captured in real time through the travel service application from the user terminal 10 into the defective determination algorithm to derive the probability of defectiveness for the purchased product. can

At this time, when the defective probability is less than a predetermined value, the local product determination unit 160 transmits normal determination information for the purchased product AR image to the user terminal 10 in real time through the travel service application from the user terminal 10 It makes it possible to display the purchased product AR image as a recommended product in real time.

On the other hand, when the defective probability is greater than or equal to a preset value, the local product determination unit 160 transmits abnormal determination information for the purchased product AR image to the user terminal 10 in real time from the user terminal 10 through the travel service application. It enables the AR image of purchased products to be displayed as non-recommended products in real time.

Hereinafter, the configuration of the present invention and its effects will be described in more detail through specific examples and comparative examples. However, these examples are for explaining the present invention in more detail, and the scope of the present invention is not limited to these examples.

3 is a diagram specifically illustrating the determination unit 110 of FIG. 1 .

Referring to FIG. 3 , the determination unit 110 may include a request unit 111 and a relay unit 112 .

First, the request unit 111 selects any one facility including a facility discount right contracted in advance through a discount contract with facility managers from the list of facilities provided through the travel service application from the user terminal 10, A facility image-related SNS post capture corresponding to any one facility may be requested from the user terminal 10 .

According to an embodiment, as another facility that does not include a facility discount right is selected from the user terminal 10 through the travel service application, the requesting unit 111 selects another facility that does not include a facility discount right. It is possible to request specific response information according to a specific phrase query related to an advertisement product contracted to the user terminal 10 .

Next, the relay unit 112 may relay the capture of the facility image related SNS posting received from the user terminal 10 to the facility manager terminals 11_1 to 11_N contracted through a pre-discount contract. In this case, the relay unit 112 may receive the facility discount coupon according to the capture of the facility image related SNS posting from the facility manager terminals 11_1 to 11_N, and relay it to the user terminal 10 through the travel service application.

Also, the relay unit 112 may relay specific response information received from the user terminal 10 to the advertiser terminals 12_1 to 12_N contracted in advance through a reward compensation contract. In this case, the relay unit 112 may receive a reward according to the capture of a facility image related SNS posting from the advertiser terminals 12_1 to 12_N, and relay it to the user terminal 10 through the travel service application.

For example, facility discount coupons and rewards may be in the form of coupons that can be used only in the facility list.

On the other hand, when receiving a request for additional discount by relaying facility discount vouchers and rewards to the user terminal 10 through the travel service application, the requesting unit 111 sends specific response information according to a specific phrase query related to the advertisement product to the user terminal 10 ) can be repeatedly requested.

4 is a diagram specifically illustrating the tourist destination information providing unit 120 of FIG. 1 .

1, 2 and 4 , the tourist destination information providing unit 120 may include a tourist destination information classifying unit 121 and a scheduling unit 123 .

First, the tourist destination information classification unit 121 may classify the tourist destination list stored in the storage DB 200 into indoor and outdoor tourist destinations.

Next, the filtering unit 122 may filter a specific outdoor tourist destination from the tourist destination list based on whether a control area in which tourism is prohibited occurs according to a change in the weather environment provided from the weather control center 301 . Here, filtering may mean removing.

In addition, the filtering unit 122 is provided from the disease control center 301 It is possible to filter specific indoor tourist destinations from the tourist destination list based on whether or not there is an epidemic-related gathering ban target area.

Next, when the target tourist destination is a specific outdoor tourist destination excluded through the filtering unit 122, the scheduling unit 123 receives the first schedule information of scheduling a visit to the recommended outdoor tourist destination used most frequently by previous users. It can be created and provided to the user terminal 10 .

Here, the first schedule information may include map information of a recommended outdoor tourist destination, a movement order, and a time order.

In addition, when the target tourist destination is a specific indoor tourist destination excluded through the filtering unit 122 , the scheduling unit 123 schedules a visit schedule for the lowest cost recommended indoor tourist destination that can be visited from the current time, second schedule information can be created and provided to the user terminal 10 .

Here, the second schedule information may include map information and business hours of each indoor tourist destination.

FIG. 5 is a diagram specifically illustrating the facility information providing unit 130 of FIG. 1 .

1, 2 and 5 , the facility information providing unit 130 may include a facility recommendation unit 131 and a facility information identification unit 132 .

First, the facility recommendation unit 131 may provide a recommendation list including a facility discount coupon from a list of facilities located within a certain distance from a tourist destination of interest selected from the user terminal 10 through the travel service application.

Next, the facility information identification unit 132 is based on the similarity between the facility photographed image taken through the travel service application from the user terminal 10 and a plurality of facility images previously collected in the storage DB 200 to the facility photographed image. Facility information can be identified.

In this case, the facility information identification unit 132 may retrieve the detailed facility information corresponding to the facility information and the review information of the facility of previous users from the storage DB 200 and provide it to the user terminal 10 in the form of a push notification. .

Specifically, the facility information identification unit 132 extracts and stores a vector value for each image from a plurality of facility images previously input by the manager, and learns each facility information by itself based on machine learning. Then, the facility information identification unit 132 receives the facility photographed image taken through the camera device built into the user terminal 10, and then extracts the vector value of the facility image, and then stores a vector for each of the plurality of facility images. By comparing with the value, a facility image having the highest similarity among a plurality of facility images is selected, and facility information for the facility photographed image can be identified. At this time, the facility information identification unit 132 searches the storage DB 200 for detailed facility information corresponding to the facility information and the review information of the facilities of previous users, and then the user in the form of voice information, text information and image information. It is provided to the terminal 10 .

In addition, the facility information identification unit 132 may further include an AR data generation unit (not shown) for generating AR data for detailed facility information.

For example, the AR data generator (not shown) may output a plurality of images related to the facility retrieved from an external image search server (not shown) so as to be output in the form of augmented reality on the facility photographed image captured through the user terminal 10 . By combining the information, 3D image data for the facility is generated, and AR data for the facility is generated based on this. Then, when the facility information identification unit 132 provides the detailed facility information to the user terminal 10, AR data for the facility detailed information through the AR data generator (not shown) is provided to the user terminal 10 can do.

According to an embodiment, the facility information identification unit 132 also additionally includes information on other facilities located within a radius (eg, within 100 m or 500 m) adjacent to the facility photographed image captured by the user terminal 10 . Other facilities adjacent to the user terminal 10 may be recommended to be guided.

According to another embodiment, the facility information identification unit 132 recommends other facilities located within a radius adjacent to the facility photographed image photographed by the user terminal 10, but multiple photographing and It is possible to list a plurality of searched facility photographed images by rank, and provide them to the user terminal 10 . Accordingly, it is possible to inform the user whether a famous facility is near the facility corresponding to the facility photographed image.

According to another embodiment, the facility information identification unit 132 may provide to the user terminal 10 after arranging the facility photographed images previously photographed by the date and location by the user terminal 10 . Accordingly, the user can check the details of the facility photographed images in the future so that he or she can check the facilities that he or she has used again.

According to another embodiment, the facility information identification unit 132 determines the movement of the user terminal 10 based on the location information of the facility photographed by the user terminal 10, and within a certain distance to the corresponding movement line. By matching and storing the located facilities, it is possible for the user to check the facilities that the user has not used later by checking the corresponding movement line.

In this specification, only a few examples among the various embodiments performed by the present inventors are described, but the technical spirit of the present invention is not limited or limited thereto, and it is of course that it may be modified and variously implemented by those skilled in the art.

100: Real-time travel information providing system based on user location
110: judgment unit
120: tourist information provider
130: facility information provision unit
140: feedback unit
150: Algorithm generator
160: local product judgment unit

Claims (5)

As a user location-based real-time travel information providing system that classifies a plurality of facilities in advance by facility type, region, and tourist destination, and stores and manages them in a storage DB,
a determination unit for determining whether the user is a traveler based on the location information received in real time from the user terminal;
a tourist destination information providing unit configured to select a tourist destination of interest by providing a preset local tourist destination list according to the location information to the user terminal when it is determined that the traveler is;
a facility information providing unit that searches for a list of facilities classified according to the interested tourist destination from the storage DB and provides it to the user terminal;
a feedback unit for receiving feedback from the user terminal with review information on a plurality of local products sold at any one facility in the facility list and AR images of defective products corresponding to negative evaluations in the review information;
an algorithm generating unit for classifying a plurality of damaged objects extracted from the defective product AR images according to product types, inputting them through machine learning, and generating an artificial intelligence-based defective determination algorithm for each product type; and
A local product determination unit that inputs a product object extracted from an AR image of a purchased product captured in real time through the user terminal into the artificial intelligence-based defect determination algorithm, and derives a defective probability for the purchased product,
When the defective probability is less than a preset value, the local product determination unit transmits normal determination information for the purchased product AR image to the user terminal,
The determination unit selects any one facility including a facility discount right contracted in advance through a discount contract with facility managers from the facility list, and captures a facility image related SNS post capture corresponding to the one facility to the user terminal. request department to make a request to; and
and a relay unit that relays the SNS posting capture received from the user terminal to facility manager terminals, receives the facility discount right from the facility manager terminals, and relays it to the user terminal,
When another facility that does not include the facility discount right is selected from the facility list, the request unit sends specific response information according to a specific phrase query related to an advertisement product contracted in advance through a reward compensation contract with advertisers to the user terminal. request,
The tourist destination information providing unit includes: a tourist destination information classification unit for classifying the tourist destination list into indoor and outdoor tourist destinations;
a filtering unit configured to filter any one of a specific indoor tourist destination and a specific outdoor tourist destination from the tourist destination list based on a change in the weather environment and whether or not an epidemic-related gathering ban target area; and
If the target tourist destination is a specific outdoor tourist destination, schedule a visit to the recommended outdoor tourist destination used by previous users with the highest frequency. Including a scheduling unit for scheduling visits to indoor tourist destinations,
The facility information providing unit includes: a facility recommendation unit that provides a list of recommendations including the facility discount coupon from a list of facilities located within a certain distance from a tourist attraction of interest; and
A facility information identification unit for identifying facility information on the facility photographed image based on the similarity between the facility photographed image photographed through the user terminal and a plurality of facility images previously collected in the storage DB,
The facility information identification unit fetches detailed facility information corresponding to the facility information and review information of the facility of previous users from the storage DB and provides it to the user terminal in the form of a push notification,
The tourist destination information providing unit automatically translates and provides voice information and text information for keyword search information provided to the user terminal to correspond to a language set by the user terminal,
The facility information providing unit automatically translates and provides voice information and text information for the facility list and the facility detailed information provided to the user terminal to correspond to the language set by the user terminal,
The facility information identification unit identifies the movement line of the user terminal based on the location information of the facility photographed image taken by the user terminal, matches and stores facilities located within a certain distance to the movement line, so that the user later A user location-based real-time travel information provision system that allows you to check facilities that you have not used by checking the movement route. According to claim 1,
When it is determined that the location information of the user is adjacent to the one of the facilities within a predetermined distance, the facility information providing unit provides detailed facility information on the one of the facilities to the user terminal in the form of a push notification,
The facility detailed information includes internal and external images, map information, travel distance information, reservation information, phone number, room usage price, price by menu, review information, facility introduction information, and website information for any one of the facilities, Real-time travel information provision system based on user location.


delete delete delete

Images