KR20160120674A - Clothes recommendation system using gpu - Google Patents
Clothes recommendation system using gpu Download PDFInfo
- Publication number
- KR20160120674A KR20160120674A KR1020160042321A KR20160042321A KR20160120674A KR 20160120674 A KR20160120674 A KR 20160120674A KR 1020160042321 A KR1020160042321 A KR 1020160042321A KR 20160042321 A KR20160042321 A KR 20160042321A KR 20160120674 A KR20160120674 A KR 20160120674A
- Authority
- KR
- South Korea
- Prior art keywords
- garment
- image file
- tag information
- information
- image
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/335—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0269—Targeted advertisements based on user profile or attribute
- G06Q30/0271—Personalized advertisement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Item recommendations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
Abstract
A garment recommendation system using a graphic processing apparatus according to the present invention includes a separation unit for recognizing garment from a first image file and generating garment region information by determining a degree of a body part of a person in the first image file; An extracting unit for extracting first tag information including a feature vector of the garment from the garment area information; A recommendation unit for retrieving second tag information matched with the first tag information from a database and selecting and presenting a second image file having the second tag information; And the separating unit generates the garment area information using the graphic processing apparatus.
Description
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a recommendation system, and more particularly, to a recommendation system for clothes using a graphic processing apparatus that analyzes an image file and recommends clothes suitable for a user.
With the development of video technology, services that use images in various forms in various industrial fields are being used.
As an example of such an image-based service, a clothing recommendation system used for recommendation of clothes may be presented among image-based recommendation systems.
The clothing recommendation system is required to extract tag information from a selected image, classify the extracted tag information, and search for a product having tag information matched.
In the conventional clothing recommendation system, it is necessary to input tag information such as color, pattern, and type for an image when searching for a product matching the selected image. However, the tag information must visually recognize the image selected by the searcher and manually input the tag information of the image directly. Therefore, the conventional garment recommendation system has a problem that requires a considerably cumbersome process such as visual recognition of images and input of tag information.
For example, in the case of the garment recommending system image-based garment recommending system, in which garments matched with the image file displayed by the user such as the online garment shopping mall are recommended from the garment shopping mall server, visual recognition is required for the image selected by the user , There is a problem that the user must manually input the tag information of the selected image.
In order to solve the above problem, when a user transmits an image to a server, excessive network traffic may occur during transmission. In particular, when a large number of clients access the server at the same time and request extraction of the tag information, excessive network traffic and congestion of the server may arise. In this case, there is a problem that the server can not properly respond to all requests.
Also, the central processing unit (CPU) used in the process of extracting the tag information from the image file is not suitable for the image processing due to the limited number of cores for the arithmetic processing due to the structural limitations, There is a problem that the construction cost of the system increases when a plurality of CPUs are used to solve the problem.
In addition, when the user transmits the image itself to the server, the image file presented by the user is not only displayed as garments but includes images irrelevant to the result of searching the user such as the person wearing the clothing or the background, There is a problem that it is difficult to obtain.
SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and it is an object of the present invention to provide a graphic processing device capable of easily extracting tag information of an input image file and outputting a search result, And a clothes recommendation system using the clothes.
Another problem to be solved by the present invention is that a server and a client share a function of preprocessing an image file selected for a garment to be recommended, thereby reducing traffic burden, server burden, cost reduction, and system efficiency And a clothes recommendation system using the processing apparatus.
In addition, the speed of extracting the tag information from the image file is accelerated, and the system construction cost is reduced by smoothly extracting the tag information with only a small amount of CPU.
In order to solve the above problems, a garment recommendation system using a graphic processing apparatus according to the present invention recognizes garments from a first image file and determines a degree to which a body part of a person is displayed in the first image file, ; An extracting unit for extracting first tag information including a feature vector of the garment from the garment area information; A recommendation unit for retrieving second tag information matched with the first tag information from a database and selecting and presenting a second image file having the second tag information; And the separating unit generates the garment area information using the graphic processing apparatus.
The tag information is extracted from the image file through the garment recommendation system using the graphic processing apparatus according to the present invention, and the tag information is input through the series of processes for recommending the garment to the user through the extracted tag information, And can increase the network traffic to the server and increase the amount of computation.
Also, the speed of extracting the tag information from the image file is accelerated, and the tag information can be extracted smoothly with only a small amount of CPU, thereby reducing the system construction cost.
1 is a block diagram showing an embodiment of a clothes recommendation system according to the present invention.
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It is to be understood that the terminology used herein is for the purpose of description and should not be interpreted as limiting the scope of the present invention.
The embodiments described in the present specification and the configurations shown in the drawings are preferred embodiments of the present invention and are not intended to represent all of the technical ideas of the present invention and thus various equivalents and modifications Can be.
1 is a block diagram showing an embodiment of a clothes recommendation system using the graphic processing apparatus of the present invention.
Referring to FIG. 1, the present invention includes a
The separating
Here, clothes refers to various kinds of clothing that a person wears, and means any thing worn on a body such as a hat, a glove, and a god as well as a top and a bottom made of various materials.
The image file is a file of various image formats in which the clothing is displayed when the image file is displayed on the screen, and a photograph of the model wearing the clothing or clothes is stored so that the photographed image can be displayed through the electronic device. The garment displayed in the image file can be displayed in various forms, such as a garment only, or a person wearing the garment may be displayed together. When a person wearing the garment is displayed together, the whole body of the person wearing the garment may be displayed or only a part thereof may be displayed. In the present invention, the first image file can be regarded as an image file that the user inputs through the terminal of the client to receive clothing from the clothing recommendation system. The second image file is an image file stored in the
The separating
When the separating
The
When the separating
The posture measuring method is a method of determining the posture of a person wearing the garment by calculating a probability distribution of probability that a body part of a person wearing the garment exists at a specific position on the first image file through a machine learning algorithm have.
More specifically, the steps of the attitude measuring method will be described as follows. The
For example, the separating
If the separating
The object recognition method is a method of identifying what kind of object an object on a first image file is. In the present invention, an object recognition method using a convolutional neural network algorithm is exemplified as a machine learning algorithm.
Spiral neural network is a type of artificial neural network for object recognition, and it can perform convolution operation used in computer vision field. An object recognition method using a spiral neural network algorithm operates by a method of extracting features from an image through various filtering on a first image file to identify an object.
When the separating
More specifically, a process in which the separating
The separating
More specifically, the separating
Then, the
Here, the color histogram is a histogram that divides the color of each pixel on the image into several groups and obtains the number of pixels corresponding to each group. The separating
The LBP histogram means that adjacent pixels centered on each pixel on the image are determined to be brighter or darker to represent the characteristics of the pixel. For example, when analyzing the brightness of eight pixels in eight adjacent directions centering on one pixel, 256 kinds of values may be obtained. Of these, some values important for determining a pattern count the number of pixels to obtain a histogram .
The AGM algorithm is a kind of GM (Gaussian Mixture) algorithm that is used to classify information. It is an algorithm used for clustering. The GM algorithm is an algorithm that calculates the mean and covariance of each distribution after assuming that the data to be classified consists of the sum of several Gaussian distributions. Although the general GM algorithm is difficult to use for clustering because it decides whether there are a small number of Gaussian distributions or not and determines the parameters for it, AGM algorithm can be applied to clustering by adding the process of merging if certain Gaussian distributions are close enough. Respectively.
When the segment is formed through the above process, the separating
On the other hand, if the
The graph cut algorithm is an algorithm that transforms an image into a graph form and divides it into a minimum cost in order to separate the image into distinct boundaries. More specifically, the graph cut algorithm regards each pixel as a vertex on the graph and constructs a graph in which adjacent pixels are connected by an edge. Then, based on the color similarity between the pixels, Lt; / RTI > The graph cut algorithm divides the graph into two parts by eliminating the edges of the graph composed of weighted edges in this way, and selects and removes the edges so that the weighted sum of the removed edges becomes as small as possible.
More specifically, the process of generating the garment region information using the image segmentation method by the
The
Thereafter, the separating
Various image processing algorithms used in the process of determining the degree of body part display of the person wearing the garment in the first image file and separating the area in which the garment is displayed to generate garment area information, , And in particular, parallel processing of computation is important. However, when such an image processing operation is processed using a CPU, there is a problem that the processing speed is slowed down due to a small number of cores of the CPU. Accordingly, when the
More specifically, when a garment of an image file is recognized by the object recognition method described above, when processing a large number of matrix multiplication operations required in an attitude measurement method, a graph cut algorithm So that the processing speed of the operation can be improved.
The extracting
The tag information is a word or a keyword to be used for searching for information on clothes. In the present invention, the tag information is one of various categories for classifying the garment displayed in the garment area information, and may have a feature vector for a type, a color, a pattern, and the like. The
The tag information may include a category vector denoting the type of clothing, a color vector denoting the color of the clothing, and a pattern vector denoted by a pattern vector denoting a pattern of clothing, and the tag information may include at least one of the feature vectors Or more.
The first tag information is tag information for a feature vector of a first image file input by a user through a terminal of a client and the second tag information is tag information for a feature vector of a second image file stored in the
More specifically, the category vector refers to a value for a type of garment determined in consideration of the position or form of the garment. For example, a value associated with the type of garment, such as top, bottom, dress, etc., may be stored as a value of the category vector. The color vector means a value for a color which is displayed in the largest ratio among colors of the corresponding garment. For example, a value associated with the color of the garment, such as yellow, red, etc., may be stored as the value of the color vector. The pattern vector means a value for a pattern having a high specific gravity in consideration of the repeated or uniform color arrangement in the garment. For example, a value associated with a pattern such as a checkered pattern, a stripe pattern, or a non-patterned pattern may be stored as a value of a pattern vector.
Of the vectors, in the case of a category vector, the information may be generated using the information included in the apparel area information provided by the
The process of extracting the first tag information from the first image file through the
For example, if the first image file has a model wearing a red checkered dress, the separating
The extracting
The separating
That is, the first image file is processed as the first tag information through the
By allowing the terminal of the client to process the separation and extraction of the first image file, it is possible to reduce the computation amount according to the image processing of the server selecting and presenting the second image file and the network traffic due to the uploading of the first image file As a result, it is possible to provide an environment in which the server can respond more quickly to a garment recommendation request through a plurality of clients.
The
In this case, the
More specifically, the
The user may be recommended from the second image file presented by the
The
Claims (11)
An extracting unit for extracting first tag information including a feature vector of the garment from the garment area information; And
A recommendation unit for retrieving second tag information matched with the first tag information from a database and selecting and presenting a second image file having the second tag information; Lt; / RTI >
Wherein the separating unit generates the clothing area information using the graphic processing unit.
And the garment region information is generated by identifying the body part of the person using the attitude measurement method when it is recognized that all the body parts of the person are displayed in the first image file.
And determining a posture of the person by calculating a probability distribution of a probability that the body part of the person exists at a specific position on the first image file through a machine learning algorithm.
The first image file is divided into superpixels which are a set of pixels and the superpixel having the feature of matching among the adjacent superpixels through a color histogram and a local binary pattern (LBP) histogram is selected, CLAIMS 1. A garment recommendation system using a graphics processing device that generates segments by clustering using an Approximated Gaussian Mixture (AGM) algorithm, and generates garment region information using the segments and the attitude measurement method.
And the garment region information is generated from the first image file by using an object recognition method when only a part of the body part of the person is recognized in the first image file.
The first image file is divided into superpixels which are a set of pixels and the superpixel having the feature of matching among the adjacent superpixels through a color histogram and a local binary pattern (LBP) histogram is selected, CLAIMS 1. A garment recommendation system using a graphics processing device that generates segments by clustering using an Approximated Gaussian Mixture (AGM) algorithm, and generates garment region information using the segments and the object recognition method.
Generating garment region information for an area in which the garment is displayed from the first image file by using an image dividing method when it is recognized that only the garment is displayed in the first image file,
Wherein the image dividing method uses a graph cut algorithm.
And the garment region information is generated using a terminal of a client that inputs the first image file.
And the extracting unit extracts the first tag information using the terminal of the client.
A garment recommendation system using a graphic processing device including at least one of a category vector denoting a category, a color vector denoting a color of the apparel, and a pattern vector denoting a pattern of the apparel, .
When the feature vectors of the first tag information and the second tag information match within a predetermined vector distance, it is determined that the matching is performed.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR20150049774 | 2015-04-08 | ||
KR1020150049774 | 2015-04-08 |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20160120674A true KR20160120674A (en) | 2016-10-18 |
Family
ID=57244454
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160042321A KR20160120674A (en) | 2015-04-08 | 2016-04-06 | Clothes recommendation system using gpu |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20160120674A (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106874344A (en) * | 2016-12-25 | 2017-06-20 | 惠州市蓝微电子有限公司 | A kind of method and terminal for recognizing clothing material |
KR20180051449A (en) * | 2018-03-16 | 2018-05-16 | 오드컨셉 주식회사 | Method, apparatus and computer program for providing shopping informations |
KR20180051448A (en) * | 2018-03-16 | 2018-05-16 | 오드컨셉 주식회사 | Method, apparatus and computer program for providing shopping informations |
KR20180098098A (en) * | 2017-02-24 | 2018-09-03 | 권오민 | Online delivery method using image advertiging |
KR20200076224A (en) | 2018-12-19 | 2020-06-29 | 이정재 | Method and user terminal device for recommending clothing store |
WO2020141907A1 (en) * | 2019-01-04 | 2020-07-09 | 삼성전자주식회사 | Image generation apparatus for generating image on basis of keyword and image generation method |
KR20210030190A (en) | 2019-09-09 | 2021-03-17 | 주식회사 웨얼리 | Method, apparatus and computer program for analyzing fashion image using artificial intelligence model of hierarchy structure |
KR20220005323A (en) * | 2020-07-06 | 2022-01-13 | 아주대학교산학협력단 | Apparatus and method for classifying style based on deep learning using fashion attribute |
KR20220046411A (en) * | 2020-10-06 | 2022-04-14 | 주식회사 스마일벤처스 | Product information tag device and method |
KR20220111592A (en) * | 2021-02-02 | 2022-08-09 | 주식회사 패션에이드 | Fashion coordination style recommendation system and method by artificial intelligence |
-
2016
- 2016-04-06 KR KR1020160042321A patent/KR20160120674A/en not_active Application Discontinuation
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106874344A (en) * | 2016-12-25 | 2017-06-20 | 惠州市蓝微电子有限公司 | A kind of method and terminal for recognizing clothing material |
KR20180098098A (en) * | 2017-02-24 | 2018-09-03 | 권오민 | Online delivery method using image advertiging |
KR20180051449A (en) * | 2018-03-16 | 2018-05-16 | 오드컨셉 주식회사 | Method, apparatus and computer program for providing shopping informations |
KR20180051448A (en) * | 2018-03-16 | 2018-05-16 | 오드컨셉 주식회사 | Method, apparatus and computer program for providing shopping informations |
KR20200076224A (en) | 2018-12-19 | 2020-06-29 | 이정재 | Method and user terminal device for recommending clothing store |
WO2020141907A1 (en) * | 2019-01-04 | 2020-07-09 | 삼성전자주식회사 | Image generation apparatus for generating image on basis of keyword and image generation method |
KR20210030190A (en) | 2019-09-09 | 2021-03-17 | 주식회사 웨얼리 | Method, apparatus and computer program for analyzing fashion image using artificial intelligence model of hierarchy structure |
KR20220005323A (en) * | 2020-07-06 | 2022-01-13 | 아주대학교산학협력단 | Apparatus and method for classifying style based on deep learning using fashion attribute |
KR20220046411A (en) * | 2020-10-06 | 2022-04-14 | 주식회사 스마일벤처스 | Product information tag device and method |
KR20220111592A (en) * | 2021-02-02 | 2022-08-09 | 주식회사 패션에이드 | Fashion coordination style recommendation system and method by artificial intelligence |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR20160120238A (en) | Clothes recommendation system | |
KR20160120674A (en) | Clothes recommendation system using gpu | |
US10049308B1 (en) | Synthesizing training data | |
CN110399890B (en) | Image recognition method and device, electronic equipment and readable storage medium | |
US9460518B2 (en) | Visual clothing retrieval | |
JP6825141B2 (en) | Fashion coordination recommendation methods and devices, electronic devices, storage media | |
JP2022093550A (en) | Information processing apparatus, information processing method, and program | |
US9817900B2 (en) | Interactive clothes searching in online stores | |
US20110142335A1 (en) | Image Comparison System and Method | |
WO2017114237A1 (en) | Image query method and device | |
CN109614925A (en) | Dress ornament attribute recognition approach and device, electronic equipment, storage medium | |
US9959480B1 (en) | Pixel-structural reference image feature extraction | |
KR20150058663A (en) | Apparatus and Method Searching Shoes Image Using Matching Pair | |
CN114937232B (en) | Wearing detection method, system and equipment for medical waste treatment personnel protective appliance | |
CN107533547B (en) | Product indexing method and system | |
CN112330383A (en) | Apparatus and method for visual element-based item recommendation | |
US10474919B2 (en) | Method for determining and displaying products on an electronic display device | |
JP2017084078A (en) | Style search apparatus, method, and program | |
Roychowdhury | Classification of large-scale fundus image data sets: a cloud-computing framework | |
JP2019109843A (en) | Classification device, classification method, attribute recognition device, and machine learning device | |
US9785835B2 (en) | Methods for assisting with object recognition in image sequences and devices thereof | |
CN108764232B (en) | Label position obtaining method and device | |
Lezoray et al. | A color object recognition scheme: application to cellular sorting | |
CN113392741A (en) | Video clip extraction method and device, electronic equipment and storage medium | |
US11527090B2 (en) | Information processing apparatus, control method, and non-transitory storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E601 | Decision to refuse application |