KR20200145040A - Apparatus and system for prviding travel information using image search - Google Patents

Abstract

An embodiment of the present invention relates to a device for providing travel information using image search. The device includes: a place image input unit receiving image data transmitted from a user terminal and determining whether the image data is place image data; an image vector conversion unit converting first place image data from the place image input unit into vector image data and generating at least one piece of first feature data included in the first place image data by analyzing the vector image data; a machine learning algorithm execution unit searching for the place image data that corresponds to the first place image data by comparing place image data pre-stored in a database to the first place image data and the first feature data corresponding thereto; and an image search result generation unit generating information on a second place image and at least one piece of second place image data corresponding to the first place image data out of the pre-stored place image data.

Description

Travel information providing device and system using image search {APPARATUS AND SYSTEM FOR PRVIDING TRAVEL INFORMATION USING IMAGE SEARCH}

An embodiment of the present invention relates to a travel information providing device and system employing an image search method, and in particular, to a travel information providing device and system using image search that provides travel product information corresponding to a place image input by a user. will be.

With the rapid increase of Internet users, users who use online travel information sites provided by travel agency servers to acquire travel information or purchase travel products are also rapidly increasing.

Since such an online travel information site provides various travel information and travel products, a user can purchase travel information and/or travel products desired by the user through the online travel information site. Accordingly, there is an advantage in that the user can overcome the inconvenience of obtaining unverified travel information by surfing the Internet web and the inconvenience of having to stop by an offline travel agency to purchase a travel product.

However, in the case of the existing online travel information site, the function of providing travel information and/or travel products corresponding to the location image provided by the user was not provided.

An embodiment of the present invention is to convert a place image data input by a user into a vector, analyze it to extract at least one feature, and perform a machine learning algorithm to perform travel place information corresponding to the features among the stored travel place information. It relates to an apparatus and system for providing travel information using image search that extracts and provides travel product information suitable for a user.

In order to achieve the above object, an apparatus for providing travel information using image search according to an embodiment of the present invention includes: a place image input unit for receiving image data transmitted from a user terminal and determining whether the image data is place image data; An image vector conversion unit converting the first place image data transmitted from the place image input unit into vector image data, analyzing the first place image data, and generating at least one first feature data included in the first place image data; A machine learning algorithm execution unit that compares the first place image data and first feature data corresponding thereto with a plurality of place image data previously stored in a database to search for place image data corresponding to the first place image data; And an image search result generator configured to generate at least one second place image data corresponding to the first place image data among the plurality of previously stored place image data and information about the second place image.

The first feature data may be data corresponding to a partial image specifying a place among images included in the first place image data.

Each of the plurality of place image data stored in the database may include at least one feature data corresponding to the respective place image data.

The feature data may be data corresponding to a partial image specifying a place among images included in each place image data.

If it is determined that the at least one second feature data included in the second place image data among the plurality of place image data stored in the database corresponds to the at least one first feature data, the machine After completing the running algorithm operation, the second place image data including the second feature data may be output as search result data.

According to another embodiment of the present invention, a system for providing travel information using image search includes: a plurality of user terminals; A travel information providing server connected to the plurality of user terminals and providing a location image input interface to the user terminals; And a travel information providing system for transmitting travel place image data corresponding to the place image data input from the user terminal to the travel information providing server in connection with the travel information providing server, wherein the travel information providing system comprises: the user A place image input unit for receiving image data transmitted from a terminal and determining whether the image data is place image data; An image vector conversion unit converting the first place image data transmitted from the place image input unit into vector image data, analyzing the first place image data, and generating at least one first feature data included in the first place image data; A machine that compares the first place image data and first feature data corresponding thereto with a plurality of place image data previously stored in the database of the travel information providing server to search for place image data corresponding to the first place image data A running algorithm execution unit; And an image search result generator configured to generate at least one second place image data corresponding to the first place image data among the plurality of previously stored place image data and information about the second place image.

The first feature data may be data corresponding to a partial image specifying a place among images included in the first place image data.

The database may store travel information held by the travel information providing server and a plurality of travel location information corresponding to travel products.

The database may include a travel place image database including at least one place image information corresponding to each of the travel place information as a separate category.

Each of the plurality of place image data stored in the travel place image database may include at least one or more feature data corresponding to the respective place image data.

The feature data may correspond to a partial image specifying a place among the images included in the respective place image data.

If it is determined that the at least one second feature data included in the second place image data among the plurality of place image data stored in the database corresponds to the at least one first feature data, the machine After completing the running algorithm operation, the second place image data including the second feature data may be output as search result data.

The travel information providing server extracts, from the travel place image database, the second place image data determined to be the image most similar to the first place image through the image search result data received from the image search result generation unit. 2 Travel product information corresponding to the location image data may be extracted from the database.

The travel information providing server may update the travel location image database based on image search result data received from the image search result generator.

When the travel place image database is updated, first place image data input from the user terminal and first feature data of the first place image data are newly stored in the travel place image database, and the first place image data and This may include storing information indicating that the previously stored second place image data is image data for a similar place.

The travel information providing server may transmit second place image data most corresponding to the first place image and travel product information corresponding to the second place image to the user terminal.

The second place image data is plural, and the travel product information transmitted from the travel information providing server may include similarity information between each of the plurality of second place image data and the first place image data.

The travel information providing server may list up the plurality of travel product information in the order of the highest similarity and provide the list of information to the user terminal.

According to such an embodiment of the present invention, by providing travel place information that is most similar to the place image input by the user, the travel information corresponding to the image data is more accurate with only the image data obtained by the user through SNS or media. And get it quickly.

1 is a block diagram showing a network environment including a system for providing travel information according to an embodiment of the present invention.
FIG. 2 is a block diagram showing the configuration of the user terminal shown in FIG. 1;
Figure 3 is a block diagram schematically showing an embodiment of the internal configuration of the travel agency server shown in Figure 1;
4 is a block diagram showing the configuration of an apparatus for providing travel information according to an embodiment of the present invention.
5 is a flowchart illustrating the operation of the travel information providing system according to an embodiment of the present invention.

The content described in the technology column that serves as the background of the present invention is only intended to help understanding the background art of the technical idea of the present invention, and therefore it can be understood as the content corresponding to the prior art known to those skilled in the art. none.

In the description below, for purposes of explanation, many specific details are presented to aid in understanding the various embodiments. However, it is obvious that various embodiments may be practiced without these specific details or in one or more equivalent manners. In other instances, well-known structures and devices are shown in block diagrams in order to avoid unnecessarily obscuring the various embodiments.

Each block in the attached block diagram may be executed by computer program instructions (execution engine), and these computer program instructions may be mounted on a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing equipment. The instructions, executed by the processor of other programmable data processing equipment, generate means for performing the functions described in each block of the block diagram.

These computer program instructions can also be stored in computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement a function in a particular way, so that the computer-usable or computer-readable memory It is also possible to produce an article of manufacture in which the instructions stored in the block diagram contain instruction means that perform the functions described in each block of the block diagram.

In addition, since the computer program instructions may be mounted on a computer or other programmable data processing equipment, a series of operation steps are performed on a computer or other programmable data processing equipment to create a process that is executed by a computer, It is also possible for the instructions to perform the possible data processing equipment to provide a function to perform the functions described in each block of the block diagram.

In addition, each block may represent a module, segment, or part of code including one or more executable instructions for executing specified logical functions, and in some alternative embodiments, the functions mentioned in the blocks or steps are ordered. It is also possible to occur outside of.

That is, the two illustrated blocks may actually be executed at the same time, and the blocks may be executed in the reverse order of corresponding functions as needed.

The terms used herein are for the purpose of describing specific embodiments and not for the purpose of limiting. Throughout the specification, when a certain part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. Unless otherwise defined, terms used herein have the same meaning as commonly understood by those of ordinary skill in the field to which the present invention belongs.

Hereinafter, embodiments of the present invention will be described in more detail with reference to the accompanying drawings.

1 is a block diagram showing a network environment including a system for providing travel information according to an embodiment of the present invention.

Referring to FIG. 1, a network environment including a system for providing travel information according to an embodiment of the present invention includes a plurality of user terminals 110_1, 110_2, ?, 110_n, a network 120, and a travel information providing server 130 And a travel information providing device 140.

The user terminal 110 includes a mobile terminal that the user can carry. For example, the user terminal 110 may be a smart phone, a tablet, a laptop, or the like.

The travel information application provided by the travel information providing server 130 may be installed in the user terminals 110, through which the travel information providing system according to the embodiment of the present invention, that is, the travel information providing server 130 and Various travel location information provided by the travel information providing device 140 may be obtained. The travel location information includes various information on a travel destination desired by the user and various travel products for the location. If the travel information application is not installed in the user terminal, the user may download the application from the travel information providing server 130 and install it in the user terminal.

The network 120 may be implemented as a wireless communication network or a wired communication network. In this case, the communication method is not limited, and not only a communication method using a communication network (eg, a mobile communication network, a wireless LAN network, a wired Internet, a broadcasting network) that the network 120 may include, but also a short-range wireless communication between devices may be included.

The travel information providing server 130 searches for various travel information and/or travel products by accessing the interface provided by the travel information providing server 130 by a plurality of user terminals 110 through the network 120 As a result, as a subject providing an online environment in which a user can purchase a desired travel product, it may be composed of at least one server device that provides commands, codes, files, contents, services, and the like.

In the embodiment of the present invention, the travel information providing server 130 is a travel information providing device 140 connected to the travel information providing server 130 to provide a location image search function using the user terminal 110. It may include.

As an example, when the user terminal 110 accesses the travel information providing server 130 to search for a travel product, various online services provided by the travel information providing server 130 provide a place image stored in the user terminal 110 An interface and/or an image search function of an application installed in the user terminal is used to transmit to the travel information providing server 130, and the travel information providing server 130 and the travel information providing device 140 By analyzing image information, travel product information suitable for the user can be searched.

The travel information providing device 140 vector converts the place image data input by the user, analyzes it to extract at least one feature, and searches whether it corresponds to the stored travel place information by performing a machine learning algorithm. The operation can be performed.

1 illustrates that the travel information providing device 140 is configured to be separated from the travel information providing server 130 as an example, but this is an embodiment of the travel information providing device 140 and the travel information providing server 130 may be implemented as a single device.

The travel information providing server 130 may be implemented in the form of a web server, and the web server is generally connected to an unspecified number of clients and/or other servers through an open computer network such as the Internet. Or, it refers to a computer system that receives a request to perform work from another web server and derives and provides the work result for it, and a computer software (web server program) installed therefor. However, in addition to the above-described web server program, it can be understood as a broad concept including a series of application programs running on the web server and various databases built therein in some cases. For example, the travel information providing server 130 is variously provided according to operating systems such as DOS, Windows, Linux, UNIX, and Macintosh to general server hardware. It can be implemented using a web server program, and representative examples include a website used in a Windows environment, Internet Information Server (IIS), and CERN, NCSA, and APPACH used in a UNIX environment.

2 is a block diagram showing the configuration of the user terminal shown in FIG. 1.

Referring to FIG. 2, each user terminal 110 may include a communication module 111, a memory 112, a display module 113, an audio output module 114, and a control unit 116.

The communication module 111 may communicate and connect with any internal component or at least one external device through the network 120. In this case, an external device may include, for example, the travel information providing server 130 and/or the travel information providing device 140 illustrated in FIG. 1. Here, as the wireless Internet technology, wireless LAN (WLAN), DLNA (Digital Living Network Alliance), Wibro (Wireless Broadband: Wibro), Wimax (World Interoperability for Microwave Access: Wimax), HSDPA (High Speed Downlink Packet Access) ), High Speed Uplink Packet Access (HSUPA), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS), etc. In addition, the communication module 111 transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above.

In addition, short-range communication technologies include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC). , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, Wi-Fi Direct, and the like may be included.

The memory 112 stores various user interfaces (UI), graphic user interfaces (GUI), and the like. In addition, the memory 112 stores data and programs necessary for the user terminal 110 to operate. That is, the memory 112 may store a plurality of application programs (hereinafter referred to as “applications”) driven by the user terminal 110, data for operation of the user terminal 110, and commands. That is, at least one or more applications are stored in the memory 112 of the user terminal 110 according to an embodiment of the present invention. At least some of these applications may be downloaded from an external server through wireless communication. An embodiment of the present invention is characterized by including a travel information application (112a) provided by the travel information providing server 130 shown in FIG.

In addition, the applications include automatic speech recognition (ASR) applications, map applications, media applications (eg QuickTime, MobileMusic.app, or MobileVideo.app), social networking applications (eg, Facebook). , Twitter, etc.), Internet browsing application, and the like. Meanwhile, the applications may be stored in the memory 112, installed in the user terminal 110, and driven by the controller 116 to perform an operation (or function) of the user terminal 110.

In addition, the memory 112 is a flash memory type (Flash Memory Type), a hard disk type (Hard Disk Type), a multimedia card micro type (Multimedia Card Micro Type), a card type of memory (for example, SD or XD memory, etc.) ), magnetic memory, magnetic disk, optical disk, RAM (Random Access Memory: RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory: ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM ( It may include at least one storage medium among (Programmable Read-Only Memory).

The display module 113 displays various contents such as various menu screens using a user interface and/or a graphic user interface stored in the memory 112 under the control of the controller 116, and is controlled by the controller 116. The execution result screen of the travel information application 112a executed by this may be displayed.

For example, when the travel information application 112a is executed, the display module 113 may display an image input window provided by the travel information application 112a on the screen, and the user Stored place images or place image data captured by a user through SNS, Internet surfing, or the like may be input through the image input window.

Here, the content displayed on the display module 113 may include a menu screen indicating various text or image data (including various information data), icons, and list menus. The display module 113 includes a liquid crystal display (LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an electronic ink display (e- ink display), LED (Light Emitting Diode), etc.

The audio output module 114 may output voice information included in a signal processed by a predetermined signal under the control of the controller 116. Here, the audio output module 114 may include a receiver, a speaker, and the like.

3 is a block diagram schematically showing an embodiment of the internal configuration of the travel agency server shown in FIG. 1.

Referring to FIG. 3, the travel information providing server 130 includes a memory 132, a database 133, a processor 134, a communication module 136, and an input/output interface 138.

The memory 132 is a computer-readable recording medium and may include a non-destructive large-capacity recording device such as RAM, ROM, and disk drive. In addition, an operating system and at least one program code may be stored in the memory 132. These software components may be loaded from a computer-readable recording medium separate from the memory 132 using a drive mechanism. The recording medium readable by such a separate computer may include a recording medium such as a floppy drive, a disk, a tape, a DVD/CD-ROM drive, and a memory card. In addition, the software components may be loaded into the memory 132 through the communication module 136.

The database 133 may store and maintain information transmitted and received from the user terminals 110 connected to the travel information providing server 130 according to an embodiment of the present invention. In addition, since the database 133 serves as a travel location information DB, various travel information held by the travel information providing server 130 and a plurality of travel location information corresponding to travel products are stored. The travel place information may include at least one or more place image information corresponding to each travel place, and each of the place image information may include at least one or more feature information. As an example, the features may be implemented as features capable of distinguishing corresponding place image information from other places. That is, the features may correspond to partial images capable of specifying a place among images included in the place image information.

The processor 134 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to the processor 134 by the memory 132 or the communication module 136. For example, the processor 134 may be configured to execute a command received according to a program code stored in a recording device such as the memory 132. That is, the processor 134 may include a program module that is implemented in software by C, C++, Java, Visual Basic, Visual C, etc. to perform various functions.

An embodiment of the present invention is characterized in that the travel information providing server 130 provides an image search function. Through the image search function, the image of a predetermined place that the user desires to search is transmitted to the travel information providing server 130, and the travel information providing server 130 and the travel information providing device 140 transmit the transmitted place image By analyzing the information, it is possible to search for travel product information suitable for the user. The travel product information is information corresponding to the travel product that most matches the travel location requested by the user through image search, and includes detailed information, amount, and various information related to the travel destination (e.g., restaurants, nearby tourist attractions, etc.) ), travel agency information, flight, hotel information, and the like may be provided, and these information may be linked by respective links.

More specifically, the travel information providing device 140 vector converts the place image data transmitted from the travel information providing server 130, analyzes it, extracts at least one feature, and performs a machine learning algorithm. Accordingly, an operation of analyzing whether it corresponds to travel place information stored in the database 133 of the travel information providing server 130 may be performed.

In addition, the travel information providing server 130, which received the result of performing the machine learning algorithm, extracts travel place information corresponding to the characteristics from among the travel place information stored in the database 133 to provide travel product information suitable for the user. You can perform the provided operation. When a plurality of travel places corresponding to the features are selected, the user can intuitively grasp the similarity between the place image input from the user and the selected plurality of travel place images through the deep learning process of the machine learning algorithm. In order to be displayed, a graph or numerical value (eg, %) may be used, and the plurality of travel product information may be listed and provided in the order of similarity.

The operation of the travel information providing server 130 and the travel information providing device 140, that is, the travel information providing system according to an embodiment of the present invention, will be described in more detail with reference to FIGS. 4 and 5 below.

The communication module 136 may provide a function for the user terminals 110 and the travel information providing server 130 to communicate with each other through the network 120. For example, control signals, commands, contents, files, etc. provided under the control of the processor 134 of the travel information providing server 130 are transmitted to the user terminals 110 through the network 120 through the communication module 136 Can be sent to.

The input/output interface 138 may serve to provide an interface between an input device implemented by a keyboard or a mouse and an output device such as a display.

4 is a block diagram showing the configuration of a travel information providing apparatus according to an embodiment of the present invention, and FIG. 5 is a flow chart illustrating an operation of a travel information providing system according to an embodiment of the present invention.

4 and 5, the travel information providing apparatus 140 according to an embodiment of the present invention includes a place image input unit 142, an image vector conversion unit 144, a machine learning algorithm execution unit 146, and an image search. It may include a result generator 148. In addition, the travel information providing device 140 may interwork with the database 133 of the travel information providing server 130.

Since the database 133 more specifically serves as a travel product DB, that is, a travel place information DB, the database 133 includes a plurality of travel information corresponding to various travel information and travel products held by the travel information providing server 130. Travel location information is stored. The travel place information may include at least one place image information corresponding to each travel place. For example, as illustrated in FIG. 4, the database 133 may include a travel place image database 133a as a separate category. Each of the plurality of place image information stored in the travel place image database 133a may include at least one or more features. As an example, the features may be implemented as features capable of distinguishing corresponding place image information from other place image information. That is, the features may correspond to partial images capable of specifying a place among images included in the place image information.

In addition, the travel information providing device 140 shown in FIG. 4 may be implemented as a processor, in this case, a place image input unit 142 and an image vector conversion unit 144 which are components of the travel information providing device 140 , It may be understood that each of the machine learning algorithm execution unit 146 and the image search result generation unit 148 separately expresses different functions performed by the processor. In this case, the processor may be implemented as a separate processor different from the processor 134 included in the travel information providing server 130 as described above, but the embodiment of the present invention is not limited thereto. That is, each component of the travel information providing device 140 may be functional blocks implemented in the processor 134 of the travel information providing server 130.

The place image input unit 142 receives place image input data transmitted from the travel information providing server 130.

The user terminal 110 may access an Internet interface operated by the application 112a installed in the terminal or the travel information providing server 130 and input an image of a desired place through an image input window provided by the user terminal 110. The image may be a place image directly photographed using the camera module of the user terminal 110, place image data stored in the user terminal 110, and place image data captured by the user through SNS, internet surfing, etc. .

Accordingly, when the travel information providing server 130 receives the place image data from the user terminal 100, the travel information providing server 130 transmits it to the place image input unit 142 of the travel information providing device 140.

However, the place image input unit 142 may determine whether the received image data corresponds to a place, and if it is determined that the received image data is not the place image data, it may notify the travel information providing server 130. For example, if the image data is image data for a person or a product other than a place, the analysis of the image data is not performed. In order to determine whether the image data input as described above is a place image, an embodiment of the present invention may check whether the image data includes at least one feature data indicating that the image data is a place image. As an example, the feature data may be partial image data capable of specifying a place such as "building" and "road" included in the image data. That is, the feature data may correspond to partial image data capable of specifying a place among images included in the place image data.

Accordingly, when the input image data is determined to be the place image data, the place image input unit 142 transmits the place image data to the image vector conversion unit 144.

The image vector conversion unit 144 converts the received place image data into vector image data. The vector image data is data generated by a graphic method that represents an image by describing geometric information in mathematical coordinates, and is implemented in graphic file formats such as Bitmap, Jpeg, and Gif that represent an image with color information for each pixel. Unlike Raster Image, which can be used, the quality of the original image can be preserved without causing any errors such as cracking or stepping when zooming in or out, and through this, it is possible to express very detailed parts. There is this. For example, the vector image format includes AI (Adobe Illustrator), SVG (Scalable Vector Graphics), VML (Vector Markup Language), CGM (Computer Graphics Metafile), and Gerber format.

In addition, the image vector conversion unit 144 analyzes the place image data and then extracts at least one feature and uses it as identification information of the place image data. That is, as an example, when first place image data is received, the first place image data is analyzed to generate the 1-1 feature and the 1-2 feature data included in the first place image data, and this corresponds to the first place image data. It is used as identification information. In this case, the first-first feature and the first-second feature data are objects having a unique shape capable of specifying the location of the first place image data, such as “building”, “road”, “statue”, etc. May contain partial image data.

Accordingly, the image vector conversion unit 144 converts the first place image data received from the place image input unit 142 into vector image data, analyzes it, and analyzes at least one or more features (e.g.: Characteristic data 1-1 and 1-2) are generated, and as a result, the vector-converted place image data and the detected feature data are output to the machine learning algorithm execution unit 146.

The machine learning algorithm execution unit 146 interworks with the database 133 of the travel information providing server 130 and performs a machine learning algorithm using the travel location information stored in the database 133. As an example, an operation of collecting the received first place image data and at least one feature data included in the place image data, and comparing and analyzing this with travel place information stored in the database 133 may be performed. have.

As described above, the database 133 of the travel information providing server 130 may include the travel place image database 133a as a separate category. Each of the plurality of place image information stored in the travel place image database 133a may include at least one or more feature data. For example, the feature data may be implemented as feature data capable of distinguishing corresponding place image information from other place image information.

Accordingly, the machine learning algorithm execution unit 146 may convert the received first place image data and at least one feature (character 1-1, feature 1-2) data included in the first place image data. Each of the plurality of place image data stored in the travel place image database 133a may be compared and analyzed.

With respect to the second place image data stored in the travel place image database 133a through such comparative analysis, at least one feature included in the second place image data (a 2-1 feature, a 2-2 feature) When it is determined that the data correspond most similarly to the 1-1 feature and 1-2 feature data, the machine learning algorithm operation is completed and the result is output to the image search result generation unit 148.

In an embodiment, a plurality of travel place images corresponding to at least one feature (1-1 feature, 1-2 feature) included in the first place image data, that is, the second place image may be selected as a plurality. In this case, through the deep learning process of the machine learning algorithm, the similarity between each of the selected plurality of second travel place images and the first place image is identified, and the result is image searched including the similarity information. It can be output to the result generator 148.

The image search result generation unit 148 analyzes the result output from the machine learning algorithm execution unit 146 to generate and output image search result data corresponding to the place image search input through the first user terminal 110. Perform the action.

For example, in the machine learning algorithm execution unit 146, feature data most corresponding to the 1-1 feature data and the 1-2 feature data included in the first place image data, If it is determined as 2-2 feature data, the second place image data including the 2-1 and 2-2 feature data is determined as the place image most similar to the first place image input from the first user terminal 110 Accordingly, information about this may be transmitted to the travel information providing server 130. In another embodiment, when a plurality of second place images and the similarity information are received from the machine learning algorithm execution unit 146, the plurality of second place images are similar to the first place image input from the user terminal 110. Place images and the similarity information may be collected and transmitted to the travel information providing server 130. Thereafter, when the travel information providing server 130 receives one image search result data from the image search result generation unit 148, the second place image determined to be the most similar image to the first place image through this Data may be extracted from the travel place image database 133a, and various travel product information corresponding to the second place image data may also be extracted from the database 133. In addition, when a plurality of image search result data is received from the image search result generation unit 148, the plurality of second place image data are extracted from the travel place image database 133a, and the respective Various travel product information corresponding to second place image data may also be extracted from the database 133. In addition, the travel information providing server 130 searches for images received from the image search result generation unit 148. The travel place image database 133a may be updated based on the result data. For example, first place image data and feature data of the first place image data input from the user terminal 110 are newly stored in the travel place image database 133a, and the newly stored first place image data and Information indicating that the stored second place image data is image data for a similar place may also be stored.

Thereafter, the travel information providing server 130 may transmit the second place image most corresponding to the first place image input by the user and travel product information corresponding to the second place image to the user terminal 110. The travel product information is information corresponding to a travel product that most matches the travel place requested by the user through image search, that is, the first place image data, and includes detailed information about the travel product, an amount, and various information related to the travel destination ( For example, restaurants, nearby tourist attractions, etc.), travel agency information, flight information, hotel information, etc. may be provided, and these information may be linked by respective links.

When there are multiple images of the second place, a graph or numerical value (e.g., %) is generated so that the user can intuitively grasp the similarity between the first place image input from the user and the selected plurality of second place images. The plurality of travel product information may be listed and provided to the user terminal 110 in the order of utilization and similarity. In this case, the list-up order may be adjusted based on a criterion selected by a user, such as product price order, latest order, and so on.

In addition, a reference value for the degree of similarity is set in advance, and a second place image having a degree of similarity that is less than a set reference value among the plurality of second place images will be excluded from the information transmitted to the user terminal 110. Accordingly, the travel information providing server 130 and the travel information providing device 140, that is, the travel information providing system according to an embodiment of the present invention, can provide more accurate search information to the user. Place image data input through (110) is received and converted into a vector image, analyzed to extract at least one feature, and a machine learning algorithm is performed to correspond to the features of the stored travel place image information. As a result of extracting the travel place image information, travel product information corresponding to the place image most similar to the place image data input by the user may be provided. According to such an embodiment of the present invention, by providing travel place information that is most similar to the place image input by the user, the travel information corresponding to the image data is more accurate and more accurate with the image data obtained by the user through SNS or media. You can get it quickly.

As described above, in the present invention, specific matters such as specific components, etc., and limited embodiments and drawings have been described, but this is provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , If a person of ordinary skill in the field to which the present invention belongs, various modifications and variations are possible from these descriptions.

Therefore, the spirit of the present invention is limited to the described embodiments and should not be defined, and all things that are equivalent or equivalent to the claims as well as the claims to be described later fall within the scope of the spirit of the present invention. .

Claims (18)

A place image input unit that receives image data transmitted from a user terminal and determines whether the image data is place image data;
An image vector conversion unit converting the first place image data transmitted from the place image input unit into vector image data, analyzing the first place image data, and generating at least one first feature data included in the first place image data;
A machine learning algorithm execution unit that compares the first place image data and first feature data corresponding thereto with a plurality of place image data previously stored in a database to search for place image data corresponding to the first place image data; And
Using an image search including an image search result generator that generates at least one second place image data corresponding to the first place image data among the plurality of pre-stored place image data and information about the second place image Travel information providing device. The method of claim 1,
The first feature data is data corresponding to a partial image specifying a place among images included in the first place image data. The method of claim 1,
Each of the plurality of place image data stored in the database includes at least one or more feature data corresponding to the respective place image data. An apparatus for providing travel information using image search. The method of claim 3,
The characteristic data is data corresponding to a partial image specifying a place among images included in the image data of each place. The method of claim 3,
If it is determined that the at least one second feature data included in the second place image data among the plurality of place image data stored in the database corresponds to the at least one first feature data, the machine An apparatus for providing travel information using image search for completing a running algorithm operation and outputting second place image data including the second feature data as search result data. A plurality of user terminals;
A travel information providing server connected to the plurality of user terminals and providing a location image input interface to the user terminals;
And a travel information providing system for transmitting travel place image data corresponding to the place image data input from the user terminal to the travel information providing server in connection with the travel information providing server,
The travel information providing system,
A place image input unit receiving image data transmitted from the user terminal and determining whether the image data is place image data;
An image vector conversion unit converting the first place image data transmitted from the place image input unit into vector image data, analyzing the first place image data, and generating at least one first feature data included in the first place image data;
A machine that compares the first place image data and first feature data corresponding thereto with a plurality of place image data previously stored in the database of the travel information providing server to search for place image data corresponding to the first place image data A running algorithm execution unit; And
Using an image search including an image search result generator that generates at least one second place image data corresponding to the first place image data among the plurality of pre-stored place image data and information about the second place image Travel information provision system. The method of claim 6,
The first feature data is data corresponding to a partial image specifying a place among images included in the first place image data. A system for providing travel information using image search. The method of claim 6,
The database is a travel information providing system using image search in which travel information held by the travel information providing server and a plurality of travel location information corresponding to travel products are stored. The method of claim 8,
The database is a travel information providing system using image search including a travel place image database including at least one place image information corresponding to each of the travel place information as a separate category. The method of claim 9,
Each of the plurality of place image data stored in the travel place image database includes at least one feature data corresponding to the respective place image data. The method of claim 10,
The feature data is data corresponding to a partial image specifying a place among images included in the image data of each place. A system for providing travel information using image search. The method of claim 10,
If it is determined that the at least one second feature data included in the second place image data among the plurality of place image data stored in the database corresponds to the at least one first feature data, the machine A system for providing travel information using image search for completing a running algorithm operation and outputting image data of a second place including the second feature data as search result data. The method of claim 6,
The travel information providing server extracts, from the travel place image database, the second place image data determined to be the image most similar to the first place image through the image search result data received from the image search result generation unit. 2 Travel information providing system using image search for extracting travel product information corresponding to place image data from the database. The method of claim 13,
The travel information providing server is a system for providing travel information using image search for updating the travel location image database based on image search result data received from the image search result generating unit. The method of claim 14,
When the travel place image database is updated, first place image data input from the user terminal and first feature data of the first place image data are newly stored in the travel place image database, and the first place image data and A system for providing travel information using image search, including information that the pre-stored second place image data is also stored as image data for similar places. The method of claim 15,
The travel information providing server transmits the second place image data most corresponding to the first place image and travel product information corresponding to the second place image to the user terminal using image search. The method of claim 16,
The second place image data is plural, and the travel product information transmitted from the travel information providing server performs an image search including similarity information between each of the plurality of second place image data and the first place image data. Travel information provision system used. The method of claim 17,
The travel information providing server lists up the plurality of travel product information in the order of the highest similarity and provides the travel information providing system to the user terminal using image search.

Images