KR20140144377A - Method and Apparatus for Providing Product Information by Using Store and Image Information - Google Patents

Abstract

An embodiment of the present invention provides an apparatus for providing product information, which includes: a store information receiving part for receiving visit store information from a terminal; an image information acquisition part for acquiring image information from the terminal; a product information extraction part which extracts specific store information corresponding to the visit store information from previously stored information per offline store, and extracts specific product information matching to the feature information extracted from the image information of the specific store information; and a data combining part which generates combined data by matching the visit store information and the specific product information to the image information.

Description

Technical Field [0001] The present invention relates to an apparatus and a method for providing product information using offline store information and image information,

The present embodiment relates to an apparatus and method for providing goods information using offline store information and image information. More specifically, the present invention extracts specific merchandise information from pre-stored in-store information based on the store information received from the terminal and the video information shot by the user at the in-store, and stores the extracted specific merchandise information and the store- The present invention relates to an apparatus and method for providing merchandise information using offline store information and image information that can link shopping information in offline shopping with a shopping map by generating combined data that matches the merchandise information.

The contents described in this section merely provide background information on the present embodiment and do not constitute the prior art.

Along with the rapid increase of Internet users, the demand of users who purchase goods through online shopping malls is also continuously increasing. Purchasing products through such an online shopping mall is advantageous in that it is possible to search for and purchase desired products quickly and conveniently at home or at a company without actually being heard at an offline store. However, in the case of purchasing a product through an online shopping mall, there is often a difference between the image on the monitor and the actual product delivered, so that it is inconvenient to cancel the purchase or return the product.

Due to these problems, there is an increase in the number of showrooming groups that conduct actual purchases through other channels such as online shopping malls after viewing the products through offline shopping. However, in this case, there is the inconvenience that the detailed information about the products examined through the offline shopping and the online shopping mall that sells the relevant products must be researched directly online, and the offline stores are also seriously damaged. Accordingly, users' demand for an on-off combined shopping map that adds convenience and fun of online shopping to offline shopping by continuously linking offline shopping information to online is continuously increasing.

The present embodiment extracts specific merchandise information from pre-stored in-store information based on the store information received from the terminal and the video information photographed by the user at the off-line store, and stores the extracted specific merchandise information and the store- The present invention has a main purpose of performing offline shopping as conveniently as online shopping by applying the generated combined data to an offline shopping map implemented beforehand.

Also, the specific store information corresponding to the store information is extracted from the previously stored in-store information using the store information, and the product information matching the feature information among the specific store information is extracted using the feature information extracted from the image information In order to improve the recognition rate and accuracy in the process of extracting product information, there is a main purpose.

This embodiment includes: a store information receiving unit for receiving store store information from a terminal; An image information obtaining unit obtaining image information from the terminal; A product information extracting unit for extracting specific store information corresponding to the visited store information from the previously stored offline store information and extracting specific product information matched with the feature information extracted from the image information among the specific store information; And a data combining unit for generating combined data in which the image information is matched with the store information and the specific product information.

According to another aspect of the present invention, there is provided a method of providing merchandise information, the merchandise information providing apparatus comprising: a step of receiving a store information from a terminal; Acquiring image information from the terminal; Extracting specific store information corresponding to the visited store information from previously stored offline store information and extracting specific product information matched with the feature information extracted from the image information among the specific store information; And generating combined data in which the image information is matched with the store information and the specific product information.

According to the present embodiment, specific merchandise information is extracted from previously stored in-store information based on the store information received from the terminal and the video information photographed by the user in the offline store, and the extracted specific merchandise information and the store- The present invention is advantageous in that offline shopping can be performed as conveniently as online shopping by generating combined data matched with information and applying it to an offline shopping map implemented before.

In addition, specific store information corresponding to the store information is extracted from the stored information of the store, using the store information, and the specific product information matching the feature information among the specific store information is extracted using the feature information extracted from the image information It is possible to improve the recognition rate and accuracy in the process of extracting the product information.

1 is a diagram illustrating a system for providing an offline shopping map using offline store information and image information according to the present embodiment.
2 is a block diagram schematically showing an apparatus for providing goods information using offline store information and image information according to the present embodiment.
FIG. 3 is a flowchart for explaining a process in which the goods information providing apparatus according to the present embodiment extracts specific goods information using offline store information and image information.
4 is a diagram illustrating an example of a method of extracting feature information from image information by the product information providing apparatus according to the present embodiment.
5 is an exemplary view illustrating an offline shopping map to which the combined data according to the present embodiment is applied.

Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings.

1 is a diagram showing a system 100 for providing an offline shopping map using offline store information and image information according to the present embodiment.

The offline shopping map providing system 100 according to the present embodiment includes a photographing apparatus 110, a terminal 120, an offline shopping map application 122, a store information managing apparatus 130, an associated information providing apparatus 140, First to Nth stores 160, 162, and 164, respectively. In this embodiment, the offline shopping map providing system includes the photographing apparatus 100, the terminal 120, the offline shopping map application 122, the store information managing apparatus 130, the related information providing apparatus 140, the database 150, It is described that only the first to Nth boutiques 160, 162, and 164 are included. However, this is merely an illustrative description of the technical idea of the present embodiment. If a person skilled in the art is familiar with the present invention It is possible to variously modify and adapt the components included in the offline shopping map providing system 100 without departing from the essential characteristics of the present embodiment.

The photographing apparatus 110 is separately provided in the off-line store, and photographs the image according to the control of the user who visited the store. Then, the photographing apparatus 110 transmits the photographed image information to the terminal 120 according to the user's selection. That is, if there is a product of interest among the products provided in the off-line store, the user can shoot the image of the corresponding product using the photographing apparatus 110, and transmit the photographed image information to the terminal 120. At this time, the photographed image information may be the image of the user wearing the product or the image of only the product. Meanwhile, the photographing apparatus 100 according to the present embodiment is preferably implemented as a tablet PC implemented with a video photographing function and a display function, but is not limited thereto.

1, the image capturing apparatus 110 is implemented as a separate apparatus to capture an image, but the present invention is not limited thereto. The image capturing apparatus may be used to capture an image using the image capturing apparatus included in the terminal 120. [

Meanwhile, the photographing apparatus 110 may be provided with a user application for controlling the functions of the photographing apparatus 110, and the user can control the photographing apparatus 110 using the corresponding user application. That is, the user can operate the photographing apparatus 110 using a user application, and can photograph an image by selecting an auxiliary function such as a timer and pixel adjustment.

In addition, the photographing apparatus 110 may provide a predetermined guide line to the user, and the user may select a guide line matching the user-selected line out of predetermined guide lines based on the type of the product selected by the user. That is, the image information transmitted to the terminal 120 due to the guideline can clearly include the characteristics of the commodity. When the commodity information matching the image information is extracted from the related information providing apparatus 140, The product information can be extracted more accurately. In addition, a specific area can be selected from the photographed image of the photographing apparatus 110, and in this case, the selected image information is transmitted to the terminal 120.

On the other hand, the photographing apparatus 110 stores the photographed image information in a database in the photographing apparatus 110, and receives user input information such as selection information on at least one of the images photographed by the user and a terminal number The selected video information is transmitted to the terminal 120.

The terminal 120 is a terminal capable of transmitting and receiving various data by using a communication intermediary device including an AP according to a key operation of a user. The terminal 120 may be a tablet PC, a laptop, a personal computer Computer, a smart phone, a personal digital assistant (PDA), and a mobile communication terminal. That is, the terminal 120 is a terminal for performing voice or data communication using an AP and a communication network, and is a memory for storing a program or a protocol for communicating with an external device via an AP and a communication network, And a microprocessor for controlling the microprocessor.

On the other hand, the terminal 120 according to the present embodiment can provide the offline shopping map in which the shopping information in the offline shopping is interlocked by mounting the offline shopping map application 122. That is, the terminal 120 drives the offline shopping map application 122 by a user's operation or command, and can provide the offline shopping map linked with the shopping information in the offline shopping through the offline shopping map application 122 have. More specifically, the offline shopping map application 122 refers to an installed application after being downloaded through the application store if the terminal 120 is a smart phone, and the terminal 120 In the case of a feature phone, it refers to an application running on a VM (Virtual Machine) downloaded through a communication company server.

The offline shopping map application 122 is installed in the terminal 120 according to the present embodiment. The terminal 120 stores the offline shopping map application 122 in an embedded form Or may be mounted in an OS (Operating System) mounted in the terminal 120 or installed in an OS in the terminal 120 by a user's operation or command. The offline shopping map application 122 installed in the terminal 120 in the manner described above is interlocked with the basic application (e.g., a character sending application, a voice call transmitting / receiving application, a data transmitting / receiving application, a messenger application, However, the present invention is not limited thereto, and it can be implemented to operate as a function independently of the basic application.

The offline shopping map application 122 may be implemented to operate independently in a form having separate software functions or hardware functions performed by the terminal 120 or may be implemented as separate software functions or hardware functions performed by the terminal 120 Function may be implemented in a form linked with the function.

The offline shopping map application 122 is preferably installed in the terminal 120 and operated using various hardware provided in the terminal 120. However, the offline shopping map application 122 may be implemented as a separate device and operated . In addition, the offline shopping map application 122 may operate in conjunction with pre-installed applications in the terminal 120. [

The offline shopping map application 122 is a kind of program that is installed in the terminal 120 and provides an offline shopping map in which shopping information in offline shopping is interlocked .

More specifically, the offline shopping map application 122 receives the image information from the photographing apparatus 110 and transmits the received image information to the associated information To the providing device (140). Meanwhile, the image information received from the photographing apparatus 110 may include at least one of product image information, QR code image information, and barcode image, and may include a selection region selected by the user.

The offline shopping map application 122 receives the store information on the store visited by the user from the store information stored in the store information management device 130 and transmits the received store information to the associated information providing device 140 using the network send. That is, when the terminal 120 enters a wireless signal range of a beacon device installed in an off-line store (a landing store) in a state where the offline shopping map application 122 is being executed, Detects the radio signal strength of the beacon device. Then, the offline shopping map application 122 identifies the beacon device installed in the offline store based on the wireless signal strength, and performs short-range communication with the beacon device. The offline shopping map application 122 receives the store information stored in the store information management device 130 by using the beacon device. On the other hand, the visited store information received by the terminal 120 includes at least one or more information of the store store mutual information, the store location information, and the telephone number information, but is not limited thereto. Information may also be included.

On the other hand, a unique ID for each store is assigned to the beacon device installed in the offline store. In the store information management device 130, the store ID of each beacon device installed in each store and store information matching the unique ID of each store Is stored. When the terminal 120 enters the wireless signal range of the beacon device, the beacon device performs short-range communication with the terminal 120 and stores the store information matching the beacon device with the beacon device from the store information management device 130 And provides it to the terminal 120. In this embodiment, a beacon device for generating a Bluetooth signal is used, but the present invention is not limited thereto.

In addition, the offline shopping map application 122 receives the association data from the association information providing device 140. [ In other words, the offline shopping map application 122 receives the combination data in which the specific merchandise information and the visit store information are matched to the video information from the association information providing device 140. [ The specific product information is product information extracted from the database 150 based on the video information and the visit store information received from the terminal 120 by the associated information providing apparatus 140. The detailed description of the specific product information will be described later in the process of describing the associated information providing apparatus 140. [

Thereafter, the offline shopping map application 122 applies the combined data to the offline shopping map that has been implemented, and provides the offline shopping map in which the shopping information in the offline shopping is interlocked. On the other hand, the user can easily confirm the product information of interest in the offline shopping using the provided offline shopping map, and purchase the corresponding product. Therefore, offline shopping can be conveniently performed as in online shopping.

On the other hand, in FIG. 1, the offline shopping map application 122 receives the binding data from the associated information providing device 140 and applies the combined data to the offline shopping map implemented thereby, However, the present invention is not limited to this, and the offline shopping map in which the shopping information in the offline shopping is linked directly from the associated information providing device 140 may be provided.

The store information management device 130 stores store information for a plurality of offline stores. On the other hand, in the store information management device 130, the unique IDs of the beacon devices installed in the respective off-line stores are additionally stored, and the store information for the stores in which the beacon devices are located is stored in each unique ID . Accordingly, the store information management device 130 can transmit the store information matching the specific ID to the beacon device having the specific unique ID. Then, the beacon device provides the store information received from the store information management device 130 to the terminal 120 through the short distance communication.

The association information providing device 140 extracts feature information from the image information acquired from the terminal 120. On the other hand, the image information may include at least one of product image information, QR code image information, and barcode image, and may further include information on a selected region selected by the user. Also, when the image information is product image information, the product image information may be a video of a user wearing the product or an image of only the product.

Meanwhile, the association information providing device 140 recognizes an object included in the image information, that is, a product image, before extracting the feature information from the image information. At this time, the association information providing device 140 can recognize the area occupancy rate of a plurality of images included in the image information, and recognize the image having a high area occupancy rate as an object to extract the feature information. Also, the association information providing device 140 may recognize an image of a selected guideline area or a selected area selected by the user as an object to extract the feature information. Meanwhile, the method by which the association information providing apparatus 140 recognizes the object included in the image information is not limited to the specific method, and a plurality of methods can be used.

The association information providing device 140 extracts minutia information from the recognized object. That is, the association information providing device 140 grasps the line information such as the outer line, the inner line, and the edge of the recognized object, arranges the feature point of a predetermined shape and a predetermined size along the line, Information is extracted. On the other hand, the types and arrangement methods of the minutiae arranged on the lines of the object are not limited to specific types and arrangement methods, and any shape and arrangement method can be used as long as the characteristics of the lines can be clearly expressed.

Also, the association information providing device 140 extracts outline information for the object, and recognizes a specific pattern based on the outline information. Meanwhile, the association information providing device 140 stores various patterns according to the type and shape of the product, and extracts a pattern matching the corresponding outline information by comparing the extracted outline information with various pre-stored patterns. In this way, the feature information contained in the object can be grasped clearly.

In addition, the association information providing device 140 extracts color information on the object based on the stored color histogram information. That is, the association information providing device 140 extracts the color of the object, and extracts the color information of the object by comparing the extracted color with the stored color histogram information.

On the other hand, the association information providing device 140 generates feature information on an object by assigning weights to at least one of minutia information, pattern, and color information. That is, the association information providing device 140 may generate feature information on an object by merging the recognized pattern and the minutia information, and weighting the minutia information disposed around the pattern and the corresponding pattern. In addition, color information may be further merged to generate feature information for the object. 1, the association information providing apparatus 140 specifies that the feature information is generated from the image information. However, the present invention is not limited to this, and the terminal 120 may transmit the feature information from the image information using the offline shopping map application 122 And transmit it to the association information providing device 140 together with the image information.

The association information providing device 140 is interlocked with the database 150 including the first to Nth store databases 152, 154 and 156 and stores the related information in the database 150 And stores the database of the specific store corresponding to the corresponding store information in the first to Nth store databases 152, 154, Accordingly, the association information providing device 140 can improve the recognition rate and accuracy in the process of extracting the product information.

Also, the association information providing device 140 extracts product information matching the feature information from the database of the specific store based on the feature information extracted from the image information. That is, the association information providing device 140 compares the feature information extracted from the image information with a plurality of product information stored in the database of the specific store, and extracts product information matching the feature information among the plurality of product information.

1, the related information providing apparatus 140 extracts feature information from the image information, extracts product information matching a specific store database and specific information from the database 150 based on the feature information and the visit store information However, the present invention is not limited thereto, and the database 150 may perform the corresponding function.

The association information providing device 140 generates association data that matches the store information and the specific product information in the image information. That is, the association information providing device 140 generates binding data matching the visited store information and specific product information in the image information, so that at least one of the visit store information and the specific product information is displayed together with the image information in the image information can do. Also, by linking the store information and the specific product information to the image information, it is possible to display the store information and the specific product information when the user clicks the image information. On the other hand, the method of displaying the store information and the specific product information in the image information is not limited to the specific method, and various display methods can be used.

Thereafter, the association information providing device 140 provides the created combined data to the terminal 120, or applies the combined data on the implemented offline shopping map so that the offline shopping map in which the shopping information in the offline shopping is interlocked And provide it to the terminal 120. On the other hand, the association information providing device 140 applies the corresponding combination data to the same store as the store information included in the combined data among a plurality of stores located on the implemented offline shopping map, so that the shopping information in the offline shopping is interlocked And creates an offline shopping map.

On the other hand, when QR code image information or barcode image information is included in the image information, the association information providing device 140 can extract specific product information using QR code image information or barcode image information. That is, the QR code image information or the barcode image information may include representative image information and store information for a specific product, and the association information providing device 140 may recognize the information from the database 150, Information can be extracted.

A gateway server (not shown) may be additionally provided between the terminal 120 and the association information providing apparatus 140. The gateway server receives store information and image information from the terminal 120, (140) or perform functions such as an authentication procedure and traffic control.

The database 150 stores a database (first to Nth store databases 152, 154 and 156) for a plurality of offline stores (first to Nth stores 160, 162 and 164) And merchandise information for each of the off-line stores 160, 162, 164) is stored in the databases 152, 154, 156 for the respective offline stores 160, 162, 164). The merchandise information for each of the off-line stores 160, 162, and 164 may include representative image information, price information, quantity information, discount information, , Coupon information, event information, and the like, but is not limited thereto and may include a plurality of pieces of information. That is, the database 150 stores the information for each offline store in a database, stores information for each store in the store, stores product information for each store identification information, and stores the information.

The database 150 is interlocked with a store terminal (not shown) provided in each of the offline stores 160, 162, and 164, and when the product information of each of the offline stores 160, 162, The change information can be received from the store terminal in real time.

2 is a block diagram schematically showing an apparatus 200 for providing goods information using offline store information and image information according to the present embodiment. Meanwhile, the product information providing apparatus 200 shown in FIG. 2 is an embodiment in which the related information providing apparatus 140 and the database 150 shown in FIG. 1 are implemented as a single apparatus. However, A plurality of devices in the map providing system 100 may be implemented as one device. The goods information providing apparatus 200 according to the present embodiment includes a store information receiving unit 210, an image information obtaining unit 220, a feature information extracting unit 230, a store database 240, a product information extracting unit 250, Data combining unit 260 and the data applying unit 270. However, this is merely an exemplary description of the technical idea of the present embodiment, and if a person skilled in the art is familiar with the present invention, It is possible to variously modify and adapt the constituent elements included in the product information providing apparatus 200 without departing from the essential characteristics of the present embodiment.

The store information receiving unit 210 receives the store information from the terminal 120. On the other hand, the visit store information includes at least one of the visit shop mutual information, the visit shop location information, and the telephone number information, but is not limited thereto and any information may be included as long as the information can identify the store. Meanwhile, the terminal 120 receives the store information from the beacon device installed in the offline store. That is, when the terminal 120 enters the radio signal range of the beacon device installed in the off-line store, it detects the radio signal strength of the beacon device. Then, the terminal 120 identifies the beacon device installed in the off-line store based on the radio signal strength, and performs near-field communication with the beacon device. The terminal 120 receives the store information stored in the store information management device 130 using the beacon device. The method by which the terminal 120 receives the visit store information is the same as that shown in FIG. 1, and a detailed description thereof will be omitted. On the other hand, if the terminal 120 can not receive the store information, the terminal 120 receives the input information for the offline store using the UI provided in the terminal 120, and transmits the received input information to the store information receiving unit 210 send.

The image information obtaining unit 220 obtains image information from the terminal 120. [ On the other hand, the image information transmitted to the image information obtaining unit 220 may include at least one of product image information, QR code image information, and barcode image information, and further includes information on a selected region selected by the user Can be. Also, when the image information is product image information, the product image information may be a video of a user wearing the product or an image of only the product. Meanwhile, the terminal 120 can receive image information from the photographing apparatus 110 separately provided in the off-line store, or photographs the image using the photographing apparatus included in the terminal 120, thereby generating image information .

The feature information extracting unit 230 extracts feature information from the image information. The feature information extracting unit 230 includes a feature extracting unit 232, a pattern recognizing unit 234, a color extracting unit 236, and a feature information generating unit 238.

On the other hand, the feature information extracting unit 230 recognizes an object included in the image information, that is, a product image, before extracting the feature information. At this time, the feature information extracting unit 230 can recognize the area occupancy of a plurality of images included in the image information, and recognize the image having a high area occupancy rate as an object to extract the feature information. In addition, the feature information extracting unit 230 may recognize an image of the selected guide region or the selected region selected by the user as an object to extract the feature information. Meanwhile, the method by which the feature information extracting unit 230 recognizes the object included in the image information is not limited to the specific method, and a plurality of methods can be used.

The feature point extracting unit 232 recognizes the object from the image information and extracts the feature point information about the object. That is, the feature point extracting unit 232 recognizes line information such as an outer line, an inner line, and an edge of the recognized object, arranges feature points of a predetermined shape and a predetermined size along the line, . On the other hand, the types and arrangement methods of the minutiae arranged on the lines of the object are not limited to specific types and arrangement methods, and any shape and arrangement method can be used as long as the characteristics of the lines can be clearly expressed.

The pattern recognition unit 234 extracts outline information for the object, and recognizes the pattern based on the outline information. Meanwhile, the pattern recognition unit 234 stores various patterns according to the type and shape of the product, and compares the extracted outline information with previously stored various patterns to extract a pattern matching the outline information. In this way, the feature information contained in the object can be grasped clearly.

The color extracting unit 236 extracts color information on the object based on the stored color histogram information. That is, the color extracting unit 236 extracts the color of the object, and compares the extracted color with the stored color histogram information to extract color information about the object.

The feature information generation unit 238 generates feature information on the object by assigning weights to at least one of the minutia information, the pattern, and the color information. That is, the feature information generation unit 238 may generate feature information on the object by merging the recognized pattern and the feature point information, and assigning weight values to the feature point information disposed around the pattern and the corresponding pattern. In addition, color information may be further merged to generate feature information for the object.

2, the feature information generation unit 238 specifies that the feature information is generated from the image information. However, the present invention is not limited to this, and the terminal 120 may use the offline shopping map application 122 to specify the feature information And transmits it to the product information providing apparatus 200 together with the image information.

The store database 240 stores the offline store-specific information in a database. On the other hand, the offline store-specific information includes each store identification information, and stores and stores the product information for each store identification information. At this time, the merchandise information may include representative image information, price information, quantity information, discount information, coupon information, event information, and the like of all the goods held in each of the off-line stores, but is not limited thereto and may include a plurality of pieces of information .

In addition, the store database 240 is interlocked with the store terminals provided in the respective offline stores, and when fluctuations occur in the merchandise information of the respective offline stores, the store database 240 receives and updates the fluctuation information from the store terminals in real time. Accordingly, the latest product information is always stored in the store database 240.

The product information extracting unit 250 extracts specific store information corresponding to the visit store information from the store database 240 and extracts specific product information matching the feature information among the specific store information. That is, the product information extracting unit 250 extracts specific store information corresponding to the visit store information from the offline store information, and extracts specific product information matching the feature information among the specific store information. Accordingly, the product information extracting unit 250 can improve the recognition rate and accuracy in the process of extracting the product information.

On the other hand, if the image information includes QR code image information or barcode image information, the product information extracting unit 250 can extract specific product information using QR code image information or barcode image information. That is, the QR code image information or the barcode image information may include representative image information and store information for a specific product, and the product information extracting unit 250 may recognize the information from the store database 240 Product information can be extracted.

On the other hand, the goods information extracting unit 250 can calculate shopping shopping line information based on the reception times of the store information and the store information received from the store information receiving unit 210. [

The data combining unit 260 generates combined data by matching the store information and the specific product information to the image information. Then, the data combining unit 260 transmits the generated combined data to the terminal 120 or the data application unit 270. That is, the data combining unit 260 generates combined data in which the store information and the specific product information are matched to the image information, so that at least one of the store information and the specific product information is displayed together with the image information in the image information . Also, by linking the store information and the specific product information to the image information, it is possible to display the store information and the specific product information when the user clicks the image information. On the other hand, the method of displaying the store information and the specific product information in the image information is not limited to the specific method, and various display methods can be used.

Meanwhile, the product information providing apparatus 200 according to the present embodiment may further include a data application unit 270. The data application unit 270 applies the combined data to the offline shopping map, which is already implemented, and creates an offline shopping map in which the shopping information in the offline shopping is interlocked. Thereafter, the generated offline shopping map is transmitted to the terminal 120. That is, the data application unit 270 applies the combined data to the same store as the store information included in the combined data among the plurality of stores located on the offline shopping map, And creates an offline shopping map.

FIG. 3 is a flowchart for explaining a process in which the product information providing apparatus 200 according to the present embodiment extracts specific product information using offline store information and image information.

3, the process of extracting specific product information using the offline store information and the image information is first performed by the product information providing apparatus 200 using the terminal 120 (Step S300). In step S300, the in-store information is received. On the other hand, the visit store information includes at least one of the visit shop mutual information, the visit shop location information, and the telephone number information, but is not limited thereto and any information may be included as long as the information can identify the store. Meanwhile, the terminal 120 receives the store information from the beacon device installed in the offline store. That is, when the terminal 120 enters the radio signal range of the beacon device installed in the off-line store, it detects the radio signal strength of the beacon device. Then, the terminal 120 identifies the beacon device installed in the off-line store based on the radio signal strength, and performs near-field communication with the beacon device. The terminal 120 receives the store information stored in the store information management device 130 using the beacon device.

The goods information providing apparatus 200 acquires image information from the terminal 120 (S310). Meanwhile, the image information acquired by the product information providing apparatus 200 may include at least one of product image information, QR code image information, and barcode image, and may further include information on a selected region selected by the user . Also, when the image information is product image information, the product image information may be a video of a user wearing the product or an image of only the product.

The product information providing device 200 extracts specific store information corresponding to the store information from the pre-stored offline store information, and extracts specific product information matching the specific information extracted from the video information of the specific store information (S320 ). On the other hand, the offline store-specific information includes each store identification information, and stores and stores the product information for each store identification information. At this time, the merchandise information may include representative image information, price information, quantity information, discount information, coupon information, event information, and the like of all the goods held in each of the off-line stores, but is not limited thereto and may include a plurality of pieces of information .

That is, the merchandise information providing apparatus 200 extracts a database of a specific store corresponding to the corresponding store information from the database for each offline store that is stored based on the received store information. Then, the product information providing apparatus 200 compares the feature information extracted from the image information with a plurality of product information stored in the database of the specific store, and extracts product information matching the feature information among the plurality of product information.

The process of extracting the feature information from the image information will be described. The product information providing apparatus 200 recognizes an object included in the image information, that is, a product image. At this time, the product information providing apparatus 200 can recognize the area occupancy of a plurality of images included in the image information, and recognize the image having a high area occupancy rate as an object to extract the feature information. In addition, the product information providing apparatus 200 may recognize an image of a predetermined guideline area or a selection area selected by the user as an object to extract the feature information.

Further, the product information providing apparatus 200 extracts the minutia information from the recognized object. That is, the product information providing apparatus 200 grasps the line information such as the outer line, the inner line, and the edge of the recognized object, arranges the feature point of a predetermined shape and a predetermined size along the line, Information is extracted.

Also, the product information providing apparatus 200 extracts outline information on the object, and recognizes a specific pattern based on the outline information. On the other hand, the product information providing apparatus 200 stores various patterns according to the type and shape of the goods, and compares the extracted outline information with previously stored various patterns to extract a pattern matching the outline information.

In addition, the product information providing apparatus 200 extracts color information on the object based on the stored color histogram information. That is, the product information providing apparatus 200 extracts the color of the object and compares the extracted color with the stored color histogram information to extract color information about the object.

On the other hand, the product information providing apparatus 200 generates feature information on an object by assigning a weight to at least one of the minutia information, the pattern, and the color information. That is, the association information providing device 140 may generate feature information on an object by merging the recognized pattern and the minutia information, and weighting the minutia information disposed around the pattern and the corresponding pattern. In addition, color information may be further merged to generate feature information for the object.

3, the feature information is extracted from the product information providing apparatus 200, but the present invention is not limited thereto. The feature information may be extracted from the terminal 120 and transmitted to the product information providing apparatus 200.

The goods information providing apparatus 200 generates combined data in which the store information and the specific product information are matched with the image information (S330). That is, the merchandise information providing apparatus 200 generates combining data that matches the store information and the specific merchandise information in the video information, so that at least one of the store information and the specific merchandise information is displayed together with the video information in the video information can do. Also, by linking the store information and the specific product information to the image information, it is possible to display the store information and the specific product information when the user clicks the image information.

The merchandise information providing apparatus 200 applies the combined data to the implemented offline shopping map, and creates an offline shopping map in which the shopping information in the offline shopping is interlocked (S340). Then, the product information providing apparatus 200 transmits the generated offline shopping map to the terminal 120. That is, the merchandise information providing apparatus 200 applies the combined data to the same store as the store information included in the combined data among a plurality of stores located on the implemented offline shopping map, so that the shopping information in the offline shopping is interlocked And creates an offline shopping map.

In FIG. 3, the product information providing apparatus 200 specifies that an offline shopping map linked with shopping information in offline shopping is generated by applying the combined data to the implemented offline shopping map. However, the present invention is not limited thereto Only the combined data may be transmitted to the terminal 120.

3, steps S300 to S340 are sequentially executed. However, this is merely an example of the technical idea of an embodiment of the present invention, and it is to be understood that the technical knowledge of the technical field to which the embodiment of the present invention belongs, Those skilled in the art will appreciate that various modifications and adaptations may be made to those skilled in the art without departing from the essential characteristics of one embodiment of the present invention or by executing one or more of steps S300 through S340 in parallel, And therefore, Fig. 3 is not limited to the time-series order.

4 is an exemplary diagram illustrating a method of extracting feature information from image information by the product information providing apparatus 200 according to the present embodiment. 4, the product information providing apparatus 200 specifies that the feature information should be extracted from the image information. However, the present invention is not limited thereto, and the terminal 120 may extract the feature information from the image information, To the device 200.

FIG. 4A is an exemplary diagram illustrating a method of extracting minutia information from image information by the product information providing apparatus 200 according to the present embodiment.

As shown in FIG. 4A, the product information providing apparatus 200 recognizes an object included in the image information, that is, a product image, before extracting the feature information from the image information. At this time, the association information providing device 140 can recognize the area occupancy rate of a plurality of images included in the image information, and recognize the image having a high area occupancy rate as an object to extract the feature information. Also, the association information providing device 140 may recognize an image of a selected guideline area or a selected area selected by the user as an object to extract the feature information. Meanwhile, although FIG. 4A exemplifies the case where the object recognized from the image information is a bag, the present invention is not limited thereto and various goods can be recognized as objects.

On the other hand, the association information providing device 140 grasps line information such as an inner line and an edge of an outer line in the image of the bag recognized as an object, and arranges the characteristic point along the line, so that the overall shape of the bag is expressed through the characteristic points .

Thereafter, the association information providing device 140 extracts the corresponding feature point information as feature information, and extracts feature information from among the plurality of bag information stored in the database of the specific store using the extracted feature information and store information, Information is extracted.

FIG. 4B is a diagram illustrating an example of a method in which the product information providing apparatus 200 according to the present embodiment recognizes a pattern from image information.

As shown in FIG. 4B, the product information providing apparatus 200 extracts outline information from an image of a bag recognized as an object, and recognizes a pattern based on the outline information. On the other hand, the product information providing apparatus 200 stores various patterns according to the type and the form of the product, and extracts a pattern matching with the corresponding outline information among various patterns based on the relatively long outline information among the extracted outline information .

Meanwhile, the association information providing apparatus 140 may extract the recognized pattern as the feature information, but merely merges the recognized pattern and the minutia information extracted in Fig. 4A, and adds the minutia information, which is arranged around the pattern and the corresponding pattern, So that the feature information on the object can be generated.

4C is an exemplary diagram illustrating a method of extracting color information from image information by the product information providing apparatus 200 according to the present embodiment.

As shown in FIG. 4C, the color of the bag is extracted from the bag image of the product information providing apparatus 200, and the extracted color is compared with the stored color histogram information to extract color information of the bag. Then, the product information providing apparatus 200 extracts the corresponding color information as the feature information, and extracts the bag information matching the corresponding color information from the plurality of bag information stored in the database of the specific store.

FIG. 4D is a diagram illustrating an example of a process in which the product information providing apparatus 200 according to the present embodiment generates feature information using minutia information, pattern, and color information.

As shown in FIG. 4D, the merchandise information providing apparatus 200 adds weight to at least one of the minutia information, the pattern, and the color information to generate characteristic information about the bag. That is, the feature information generation unit 238 can generate feature information on the object by merging the recognized pattern and the feature point information, assigning the weight to the feature point information disposed around the pattern and the corresponding pattern, The information on the bag can be generated by merging the information.

5 is an exemplary view illustrating an offline shopping map to which the combined data according to the present embodiment is applied. Meanwhile, in FIG. 5, the combined data is implemented in such a manner that the store information and the specific product information are linked to the image information.

As shown in FIG. 5, the offline shopping map to which the combined data is applied is provided in a form in which the combined data is displayed in the same store as the visited store information included in the combined data among the plurality of stores located on the implemented offline shopping map do. That is, on the offline shopping map, the video information that the user has photographed in the same store as the visit store information included in the combined data is displayed, and when the user clicks the corresponding video information, the visit shop information and specific product information are displayed together . On the other hand, on the offline shopping map, a line of the offline store visited by the user can be provided together. Thus, the user can know the information of the store visited during the offline shopping process, information of the store selling the interested goods, Information can be easily checked, and offline shopping can be conveniently performed as in online shopping.

The foregoing description is merely illustrative of the technical idea of the present embodiment, and various modifications and changes may be made to those skilled in the art without departing from the essential characteristics of the embodiments. Therefore, the present embodiments are to be construed as illustrative rather than restrictive, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The scope of protection of the present embodiment should be construed according to the following claims, and all technical ideas within the scope of equivalents thereof should be construed as being included in the scope of the present invention.

100: Offline shopping map providing apparatus 200: Product information providing apparatus
210: store information receiving unit 220:
230: Feature information extracting unit 232:
234: pattern recognition unit 236: color extraction unit
238: Feature information generation unit 240: Store database
250: product information extracting unit 260: data combining unit
270:

Claims (11)

A store information receiver for receiving store store information from a terminal;
An image information obtaining unit obtaining image information from the terminal;
A product information extracting unit for extracting specific store information corresponding to the visited store information from the previously stored offline store information and extracting specific product information matched with the feature information extracted from the image information among the specific store information;
A data combining unit for generating combined data obtained by matching the visited store information and the specific product information to the image information,
And the goods information providing device. The method according to claim 1,
Further comprising a data application unit configured to apply the combined data to a store corresponding to the visited store information among a plurality of stores located on the offline shopping map. The method according to claim 1,
Recognizing an object from the image information, extracting minutia information about the object,
Extracting outline information for the object, recognizing a pattern based on the outline information,
Extracting color information for the object based on the stored color histogram information,
A feature information extracting unit for assigning weights to at least one of the minutia information, the pattern, and the color information to generate the feature information,
The product information providing apparatus further comprising: The method of claim 3,
Wherein the feature information extracting unit extracts the feature information for a selected region selected from a user in the image information. The method according to claim 1,
And a store database for storing the offline store-specific information in a database,
The offline store-specific information includes respective store identification information, stores product information for each store identification information and stores the same,
Wherein the product information includes some or all of representative image information, price information, quantity information, discount information, coupon information, and event information for all the stored goods in each of the offline stores. The method according to claim 1,
Wherein the visited store information includes at least one or more information of the visited store mutual information, the visited store location information, and the telephone number information,
Wherein the terminal receives the visited store information using local communication when the terminal enters the range of the beacon device installed in the off-line store. The method according to claim 6,
Wherein the store information receiving unit recognizes the input information as the visit store information when receiving the input information from the terminal. The method according to claim 1,
Wherein the image information includes at least one of product image information, QR code image information, and barcode image information,
Wherein the product information extracting unit extracts the specific product information using the QR code image information or the bar code image information when the image information includes the QR code image information or the barcode image information. . The method according to claim 1,
And the product information extracting unit calculates the shopping bus information based on the reception time of the visit shop information. A method for providing product information by a product information providing apparatus,
Receiving the store information from the terminal;
Acquiring image information from the terminal;
Extracting specific store information corresponding to the visited store information from previously stored offline store information and extracting specific product information matched with the feature information extracted from the image information among the specific store information;
A step of generating combined data obtained by matching the visited store information and the specific merchandise information to the image information
The method comprising the steps of: 11. The method of claim 10,
Further comprising the step of applying the combined data to a store corresponding to the visited store information among a plurality of stores located on the offline shopping map.

Images