KR20110114843A - System and method for providing information according to image data - Google Patents

Abstract

When the first image data is received from the portable terminal, the present invention recognizes image pattern information from the first image data, and searches for a plurality of web servers to retrieve second image data including the recognized image pattern information. A method and system for providing information corresponding to image data capable of providing an item identical or similar to first image data selected by a user by providing search information associated with the retrieved second image data to the portable terminal.

Description

Method and system for providing information corresponding to image data {SYSTEM AND METHOD FOR PROVIDING INFORMATION ACCORDING TO IMAGE DATA}

One embodiment of the invention relates to a method and system for providing the same or similar items using image data selected by a user.

The Internet can be easily used in portable terminals such as mobile phones and smart phones, and the service industry using the Internet is increasing. As part of the service industry using the Internet, Internet shopping malls offer various products at different prices, giving consumers the opportunity to purchase cheap and quality products.

That is, the consumer may receive product information for each Internet shopping mall selling the product by inputting a product name or a product code of the product to be purchased as a keyword. Since each Internet shopping mall has a different fee, different prices are provided for the same product. Therefore, the consumer can purchase the same product at a cheaper Internet shopping mall.

However, comparing and providing a price for a product as described above may be effective in providing a variety of information on the product to a consumer and allowing the product to be purchased at a low price. There is a disadvantage that you need to know the brand name or model name of.

That is, in order to know the exact brand name or model name of the product to be purchased, the consumer has to inconvenience several times.

Therefore, even if you do not know the information on the exact product, there is a need for a method that can provide the same or similar product information to the consumer desired product.

One embodiment of the present invention by recognizing the image pattern information from the image data selected by the user to search for the second image data that is the same or similar to the recognized image pattern information, by providing the search information associated with the retrieved second image data The present invention provides an information providing method and system corresponding to image data that can easily provide information on a web server selling a specific product.

According to an embodiment of the present invention, by recognizing color, line, and shape of an object in the first image data as image pattern information, information corresponding to image data for easily searching for second image data similar to the image pattern information. Provides a method and system.

According to an embodiment of the present invention, by searching for the second image data by using meta information about the first image data, the image data corresponding to the image data capable of easily searching for the second image data that is the same as or similar to the first image data may be used. Provide information methods and systems.

An embodiment of the present invention provides a method and system for providing an information corresponding to image data that can identify information provided by a user's preferred web server by searching second image data similar to image pattern information only in a selected web server. to provide.

In order to achieve the above object, an information providing system corresponding to image data includes an interface for receiving a search request including first image data from a portable terminal, recognizing image pattern information from the first image data, and a plurality of web servers. A processor for retrieving second image data including the recognized image pattern information from the controller, and a controller providing retrieval information associated with the retrieved second image data to the portable terminal through the interface in response to the retrieval request. It includes.

In order to achieve the above object, an information providing method corresponding to image data may include: receiving a search request including first image data from a portable terminal; recognizing image pattern information from the first image data; Retrieving second image data including the recognized image pattern information from a server, and providing search information associated with the retrieved second image data to the portable terminal in response to the search request. .

According to an embodiment of the present invention, by recognizing the image pattern information from the image data selected by the user, retrieves the second image data that is the same or similar to the recognized image pattern information, and the search information associated with the retrieved second image data By providing it, information about the web server selling a specific product can be easily provided.

According to an embodiment of the present invention, by recognizing the color, the line, and the shape of the object in the first image data as the image pattern information, the second image data similar to the image pattern information can be easily searched.

According to an embodiment of the present invention, by searching for the second image data by using the meta information about the first image data, it is possible to easily search for the second image data that is the same as or similar to the first image data.

According to an embodiment of the present invention, by searching the second image data similar to the image pattern information only in the selected web server, the information provided by the user's preferred web server can be confirmed.

1 is a diagram illustrating a network connection relationship of an information providing system corresponding to image data according to an embodiment of the present invention.
2 is a block diagram illustrating a configuration of an information providing system corresponding to image data according to an embodiment of the present invention.
3 is a diagram illustrating an example of first image data.
4 is a diagram illustrating an example of recognizing image pattern information from first image data.
5 is a diagram illustrating an example of providing search information associated with second image data.
6 is a flowchart illustrating a procedure of an information providing method corresponding to image data according to an embodiment of the present invention.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings and accompanying drawings, but the present invention is not limited to or limited by the embodiments.

1 is a diagram illustrating a network connection relationship of an information providing system corresponding to image data according to an embodiment of the present invention.

Referring to FIG. 1, the portable terminal 110 receives first image data from a user and transmits the first image data to the information providing system 100 corresponding to the image data. The first image data may be 'web image data' included in a web page or 'photo data' taken by the portable terminal 110. For example, the user may select a favorite web image data as the first image data while surfing the web with the portable terminal 110. Alternatively, the user may select photograph data photographing a celebrity appearing on a television or photographing people wearing clothes of a favorite style on the street as the first image data.

The information providing system 100 (hereinafter, referred to as an “information providing system”) corresponding to the image data receives a search request including the first image data from the portable terminal 110. In this case, the information providing system 100 recognizes image pattern information from the first image data, and retrieves second image data including the recognized image pattern information from the plurality of web servers 120.

For example, when the first image data is web image data, the information providing system 100 identifies web data from the web page, identifies a web server that provides the identified web data, and identifies the identified web server. The second image data including the image pattern information may be retrieved from. Alternatively, when the first image data is photo data, the information providing system 100 may search for second image data similar to image pattern information recognized from the photo data.

If the meta information about the first image data is included and received, the information providing system 100 may search for the second image data having the same meta information. The meta information is information on the attribute of the first image data and may include size, pixels, contents, date of creation, storage location or address information.

In addition, the information providing system 100 recognizes the image pattern information using at least one of color, line, or shape of the object in the first image data. Therefore, the information providing system 100 may search the plurality of web servers 120 for second image data having similar colors, lines, or shapes.

In an embodiment, the information providing system 100 compares the representative image data provided from the plurality of web servers 120 with the image pattern information, and as a result of the comparison, similar representative image data having a similarity in the allowed range is second to the second. Identifies as image data. For example, the information providing system 100 may determine that representative image data having different colors but similar lines or shapes have similarities in the allowed range.

The plurality of web servers 120 may be interpreted as internet shopping malls as all websites including image data. For example, the plurality of web servers 120 includes "www.gmarket.co.kr (Gmarket)", "www.lotte.com (Lotte.com)", and "www.11st.co.kr (11th Avenue)". can do.

In another embodiment, the information providing system 100, when receiving the first image data from the portable terminal 110, when the address information is also received, in the web server identified by the address information, the recognized image pattern The second image data including the information may be retrieved. For example, the information providing system 100, as the address information, 'www.dnshop.daum.net (D & shop)', "www.gmarket.co.kr (Gmarket)", "www.lotte.com (Lotte.com) ", The second image data can be retrieved only from the web servers of D.shop, Gmarket, and Lotte.com.

The information providing system 100 provides the portable terminal 110 with search information associated with the searched second image data in response to the search request. The search information may be address information about a web server providing second image data, or display second image together with address information.

If there is a plurality of search information, the information providing system 100 determines the display order of the plurality of search information according to the degree of association with the image pattern information or the degree of association with a previously selected web server. . The degree of association with the image pattern information may be a degree of association with each of the colors, lines, or shapes, or a combination of weights assigned to the colors, lines, and shapes, and the degree of association with each of the colors, lines, and shapes. The degree of association with the web server may be a web server previously selected by the user, or may be related to a web server frequently accessed by the user. Therefore, the information providing system 100 may determine the display order of the search information with high relevance.

The information providing system 100 arranges the plurality of pieces of search information according to the determined display order and provides them to the portable terminal 110. That is, the information providing system 100 may provide the same search information differently depending on the propensity of the user of the portable terminal 110.

The portable terminal 110 may provide the transmitted search information to the user through a screen.

2 is a block diagram illustrating a configuration of an information providing system corresponding to image data according to an embodiment of the present invention.

Referring to FIG. 2, the information providing system 200 may include an interface 210, a processor 220, and a controller 230.

The interface 210 receives a search request including the first image data from the portable terminal 110. Here, the first image data may be 'web image data' included in the web page or 'photo data' photographed by the portable terminal 110. For example, when the user clicks on the web image data included in the web page and selects a 'search request', the portable terminal 110 may transmit the clicked web image data to the interface 210. Alternatively, the portable terminal 110 may transmit the clicked photo data to the interface 210 by clicking the photo data stored in the camera album or the photo taken in real time by the user and selecting 'search request'. .

3 is a diagram illustrating an example of first image data.

Referring to FIG. 3, the interface 210 may receive web image data included in a web page or photo data generated by the portable terminal 110 as first image data.

The interface 210 delivers the search requested first image data to the processor 220.

The processor 220 recognizes image pattern information from the first image data, and retrieves second image data including the recognized image pattern information from the plurality of web servers 120.

In an embodiment, the processor 220 may recognize the image pattern information using at least one of a color, a line, or a shape of an object in the first image data. Referring to FIG. 3, the processor 220 may recognize, as image pattern information, colors, lines, or shapes of the upper jacket from the first drawing (upper left). Alternatively, the processor 220 may recognize, as image pattern information, the color, line, or shape of the female short-sleeved long T-shirt from the second drawing (upper right). Alternatively, the processor 220 may recognize, as image pattern information, the color, line, or shape for the female short sleeve knit from the third drawing (lower left). Therefore, the processor 220 may retrieve second image data similar to the image pattern information from the plurality of web servers 120.

4 is a diagram illustrating an example of recognizing image pattern information from first image data.

Referring to FIG. 4, the processor 220 may recognize any one of color, line, or shape from the object (female) in the first image data 410 as the image pattern information 420. The processor 220 recognizes the color, the line, or the shape of the top, the bottom, and the bag worn by the woman as the image pattern information 420, or images the color, the line, or the shape of the top, the bottom, or the bag. It may be recognized as the pattern information 420.

In order to increase the success rate of retrieving second image data similar to the image pattern information, the processor 220 may identify meta information from the first image data and retrieve second image data having the same identified meta information. have. In general, meta information, also called attribute information, is structured data about data and is data that describes other data. Here, the meta information may include any one of a size, a pixel, content, a created date, a storage location, or address information provided to the first image data.

For example, when the first image data is web image data, the web image data includes meta information such as image type, address information, size, pixel, content, date of creation, and the like. Accordingly, the processor 220 may search for second image data having the same meta information such as image type, address information, size, pixel, content, date of creation, and the like.

Alternatively, when the first image data is web image data, the web page including the web image data may include 'web data' constituting the web page. The web data may include instructions, text, layout, and the like necessary for constructing the web page. Accordingly, the processor 220 identifies the web data from the web page and identifies a web server that provides the identified web data, thereby retrieving second image data including the image pattern information from the identified web server. Can be. For example, in a web page providing first image data as shown in FIGS. 3 and 4, text such as "female", "top", and "clothing" may be included as web data. Accordingly, processor 220 identifies a web server of a web page that provides text such as "female", "top", "clothing", and second image data that is the same as or similar to the image pattern information from the identified web server. You can search for

Alternatively, when the first image data is photo data, the processor 220 extracts meta information such as an image type, a storage location, a size, a pixel, and a date created in the photo data. Thereafter, the processor 220 may retrieve second image data similar to the extracted meta information.

In an embodiment, the processor 220 compares the representative image data provided from the plurality of web servers 120 with the image pattern information, and, as a result of the comparison, similar representative image data having similarities in the allowed range, and the second image data. Identifies as. For example, for one product, the web server 120 may provide one or more image data to a web page. In this case, since it is more efficient to compare a single representative image data representing a product with the image pattern information than to compare the plurality of image data with the image pattern information, the processor 220 is a plurality of web server 120 Representative image data provided at) may be compared with the image pattern information. Subsequently, the processor 220 determines that the second image data includes representative image data having similarities, that is, colors, but similar in shape to lines but different in line and shape, although the lines are different from each other. Can be identified as. The similarity of the allowed range may be set such that the error rate of the second image data retrieved by the administrator of the information providing system 200 is low.

In another embodiment, the processor 220 may receive address information from the portable terminal 110 through the interface 210 together with the first image data. Here, the address information is the address of the web server, 'www.dnshop.daum.net (D & shop)', 'www.gmarket.co.kr (Gmarket)', 'www.lotte.com (Lotte.com)', day That is, the user of the mobile terminal 110 may receive only the second image data corresponding to the selected address information from the information providing system 200 by selecting address information regarding a shopping mall that he / she trusts or prefers. Accordingly, the processor 220 retrieves the second image data including the recognized image pattern information from the web server identified by the address information, that is, the processor 220 selects the selected web server. Even if the second image data including the image pattern information is searched by another web server other than the web server, the second image data may not be included as the search information.

The controller 230 provides search information associated with the searched second image data to the portable terminal 110 through the interface 210 in response to the search request. In this case, when there is a plurality of search information, the controller 230 determines the display order of the plurality of search information according to the degree of association with the image pattern information or the degree of association with a previously selected web server. The plurality of pieces of search information are sorted and provided to the portable terminal 110 according to the determined display order.

5 is a diagram illustrating an example of providing search information associated with second image data.

Referring to FIG. 5, the controller 230 may display second image data and provide address information regarding a web server providing second image data as search information (510).

Here, when the search information is one or more (that is, plural numbers), the controller 230 determines a display rank of the search information having a high degree of association with the image pattern information or a high degree of association with a previously selected web server. In operation 520, the search information having the determined display order having high ranking may be sorted upward and provided to the portable terminal 110.

The degree of association with the image pattern information may be a degree of association with each of the colors, lines, or shapes, or a combination of weights assigned to the colors, lines, and shapes, and the degree of association with each of the colors, lines, and shapes. For example, the weight of the color may be set to 20%, the weight of the line to 35%, the weight of the shape to 45%, and the like. In this case, if the total degree of association is 100, the degree of association for color may be 30, the association 20 for lines, and the association for shape. Accordingly, the degree of association with the image pattern information may be determined by the shape 22.5, the line 7, and the color 6 by combining the weight and the degree of association. Therefore, the controller 230 may sequentially set the display order of search information including second image data similar to image pattern information in the order of shape, line, and color among the plurality of second image data.

In addition, the degree of association with the web server may be a web server previously selected from the user, or may be related to a web server frequently accessed by the user. Accordingly, the controller 230 may sequentially set the display order of the search information having a high relation with the web server among the search information including the plurality of second image data.

Comparing 510 and 520, it can be seen that in 520, the third search information in 510 is in the first display rank, the first search information in 510 is in the second display rank, and the second search information is in the third display rank. . That is, the controller 230 may provide the same search information differently depending on the degree of association with the image pattern information or the degree of association with the web server previously selected.

6 is a flowchart illustrating a procedure of an information providing method corresponding to image data according to an embodiment of the present invention.

Referring to FIG. 6, in operation 610, the portable terminal 110 may receive first image data from a user. The first image data may be web image data included in a web page or photo data generated by the portable terminal 110.

In operation 620, the portable terminal 110 requests the information providing system 200 to search for the selected first image data. The portable terminal 110 may transmit the address information selected by the user to the information providing system 200 together with the first image data.

In operation 630, the information providing system 200 recognizes image pattern information from the first image data. For example, the information providing system 200 may recognize the image pattern information using at least one of a color, a line, or a shape of an object in the first image data.

In operation 640, the information providing system 200 retrieves second image data including the recognized image pattern information from a plurality of web servers. In this case, when the meta information about the first image data is included and received, the information providing system 200 may search for the second image data having the same meta information.

Alternatively, when the web image data included in the web page is received as the first image data, the information providing system 200 identifies the web data from the web page and identifies a web server that provides the identified web data. The second image data including the image pattern information may be retrieved from the identified web server.

Alternatively, the information providing system 200 compares the representative image data provided from the plurality of web servers with the image pattern information, and identifies similar representative image data having similarity in the allowed range as second image data as a result of the comparison. You may.

Alternatively, when the information providing system 200 receives the address information from the portable terminal 110, the information providing system 200 may search for the second image data including the recognized image pattern information in the web server identified by the address information. have.

In operation 650, the information providing system 200 provides the portable terminal 110 with search information associated with the searched second image data in response to the search request. In this case, when there is a plurality of search information, the information providing system 200 determines the display order of the plurality of search information according to the degree of association with the image pattern information or the degree of association with a previously selected web server. The plurality of search information may be arranged and provided to the portable terminal according to the determined display order.

The portable terminal 110 may provide the transmitted search information to the user through a screen.

Methods according to an embodiment of the present invention can be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

100: information providing system corresponding to image data
110: portable terminal
120: web server

Claims (16)

An interface for receiving a search request including first image data from a portable terminal;
A processor recognizing image pattern information from the first image data and retrieving second image data including the recognized image pattern information from a plurality of web servers; And
A controller that provides search information associated with the retrieved second image data to the portable terminal through the interface in response to the search request.
Information providing system corresponding to the image data comprising a. The method of claim 1,
When the web image data included in the web page is received as the first image data by the interface,
The processor comprising:
Identifying web data from the web page, identifying a web server that provides the identified web data, and retrieving second image data including the image pattern information from the identified web server. Informational system. The method of claim 1,
When the search request is received with the meta information about the first image data,
The processor comprising:
And search for second image data having the same received meta information. The method of claim 1,
The interface is,
An information providing system corresponding to the image data, receiving the photo data generated in the portable terminal as the first image data. The method of claim 1,
The processor comprising:
And at least one of a color, a line, or a shape of an object in the first image data is recognized as the image pattern information. The method of claim 1,
The processor comprising:
Comparing the representative image data provided by the plurality of web servers with the image pattern information, and providing the information corresponding to the image data, identifying similar representative image data having similarity in the allowed range as second image data as a result of the comparison. system. The method of claim 1,
When the address information is received from the portable terminal by the interface,
The processor comprising:
And searching for the second image data including the recognized image pattern information in the web server identified by the address information. The method of claim 1,
If the search information is plural,
The controller,
The display order of the plurality of pieces of search information is determined according to the degree of association with the image pattern information or the degree of association with a previously selected web server.
And providing the portable terminal with the plurality of pieces of search information according to the determined display order. Receiving a search request including first image data from a portable terminal;
Recognizing image pattern information from the first image data;
Retrieving second image data including the recognized image pattern information from a plurality of web servers; And
Providing search information associated with the retrieved second image data to the portable terminal as a response to the search request.
Information providing method corresponding to the image data comprising a. 10. The method of claim 9,
When the first image data is web image data included in a web page,
The searching of the second image data may include:
Identifying web data from the web page;
Identifying a web server that provides the identified web data; And
Retrieving second image data including the image pattern information from the identified web server.
Information providing method corresponding to the image data comprising a. 10. The method of claim 9,
When the search request is received with the meta information about the first image data,
The searching of the second image data may include:
Retrieving second image data equally having the received meta information
Information providing method corresponding to the image data comprising a. 10. The method of claim 9,
Receiving a search request including the first image data,
Receiving the photo data generated by the portable terminal as the first image data
Information providing method corresponding to the image data comprising a. 10. The method of claim 9,
Recognizing image pattern information from the first image data,
Recognizing as the image pattern information using at least one of a color, a line, or a shape of an object in the first image data.
Information providing method corresponding to the image data comprising a. 10. The method of claim 9,
The searching of the second image data may include:
Comparing representative image data provided from the plurality of web servers with the image pattern information; And
As a result of the comparison, identifying similar representative image data having similarity in the allowed range as second image data
Information providing method corresponding to the image data comprising a. 10. The method of claim 9,
When address information is received from the portable terminal,
The searching of the second image data may include:
Retrieving second image data including the recognized image pattern information in the web server identified by the address information;
Information providing method corresponding to the image data comprising a. 10. The method of claim 9,
If the search information is plural,
Providing search information associated with the retrieved second image data to the portable terminal,
Determining a display order of the plurality of pieces of search information according to the degree of association with the image pattern information or the degree of association with a predetermined web server; And
Sorting the plurality of pieces of search information according to the determined display order and providing the plurality of pieces of search information to the portable terminal;
Information providing method corresponding to the image data comprising a.

Images