JP2009288928A - Clothing and accessory retrieval method and device, clothing and accessory retrieval program, and clothing and accessory registration device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a clothing and accessory retrieval method and device for supporting the purchase/selling of clothing and accessories, to provide a clothing and accessory retrieval program, and to provide a clothing and accessory registration device for registering clothing and accessories to be retrieved. <P>SOLUTION: An image on which clothing and accessories are projected, the category of the clothing and accessories, and a target age/sex are input to a server 11. A feature extraction part 36 analyzes an image, and extracts the representative color/pattern of the clothing and accessories. A coordinate retrieval part 37 narrows down the combination of the clothing and accessories stored in a coordinate list table 42 based on qualitative items (the category of clothing and accessories, target sex, and the pattern of the clothing and accessories) whose similarity can not be expressed with any numerical value, and selects the combination of the clothing and accessories whose similarity is the highest for the clothing and accessories input to the server 11 based on the quantitative items (target sexes, the representative color of the clothing and accessories) which can be expressed with numerical values. The clothing and accessories stored in a clothing and accessory list table 41 are narrowed down to the qualitative items (the category of the clothing and accessories, the pattern of the clothing and accessories) based on the other clothing and accessories related with the selected combination, and the clothing and accessories whose similarity is the highest to the other clothing and accessories related with the previously selected combination are selected based on the quantitative items (the representative color of the clothing and accessories). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a clothing search method and apparatus for searching for clothing via a network, a clothing search program, and a clothing registration device for registering searched clothing.

  On the Internet, apparel mail order sites such as World (WORLD, registered trademark) Direct Style, ONWARD (registered trademark) Easta (e-store), etc. There are apparel e-commerce sites such as UNIQLO ONLINE STORE for mail order sales of the product clothing. At mail order sites and EC sites, it is impossible to see, touch and try on actual products. In order to compensate for such shortcomings as much as possible, techniques for supporting the purchase and sale of clothing have been widely developed (see, for example, Patent Documents 1 and 2).

  The invention described in Patent Literature 1 presents clothing based on customer information registered in advance, and further presents clothing that is highly compatible with the selected clothing. In the invention described in Patent Literature 2, the user coordinates the clothing while referring to the clothing coordination information presented from the store side. If coordinated clothing is purchased in bulk, the profits of the publisher will increase.

Moreover, although it is not a technique which supports the purchase and sale of clothing, Patent Documents 3 and 4 disclose a technology for coordinating clothing. The inventions described in Patent Literatures 3 and 4 coordinate the clothing owned by the user, and present the registered clothing after coordinating.
JP 2002-183533 A JP 2006-133981 A JP 2002-339135 A JP 2003-099510 A

  However, the invention described in Patent Document 1 requires user information to be registered in advance and cannot be used easily. In addition, a specific algorithm is not disclosed, and it is unclear what kind of processing is being performed. In the invention described in Patent Document 2, although coordinate information to be referred to by the user is presented, the user must eventually coordinate the clothing.

  The inventions described in Patent Documents 3 and 4 do not present a clothing coordinated with a particular clothing. For this reason, even if it is applied to a mail order site or an EC site, it is not coordinated with the clothes that consumers want to purchase.

  The present invention has been made in view of the above problems, and provides a clothing search method and device that supports the purchase and sale of clothing, a clothing search program, and a clothing registration device that registers the searched clothing. Objective.

  In order to achieve the above object, a clothing search apparatus according to the present invention includes an input unit that receives an image of clothing and information about the clothing, a feature extraction unit that extracts clothing features from the image, and a coordination list table. Coordinating the clothing stored in pairs, and one of the clothing has the same information as the qualitative information input from the input unit, and extracted by the feature extraction unit After narrowing down to the features that have the same characteristics as the qualitative ones, the one piece of clothing is the information input from the input unit and is the information of the clothing out of the narrowed down coordination While selecting the quantitative thing which can represent similarity with a numerical value, and the characteristic extracted by the said feature extraction part, and the thing with the highest similarity with the said quantitative thing, it is in a clothing list table. The memorized apparel is narrowed down to the one that has the same information as the qualitative information of the other apparel of the coordinator selected earlier, and then the selected apparel is selected first The coordinate search unit that selects the information on the other clothing of the coordinated that has the highest similarity with the quantitative one is selected by the coordinate search unit, and the coordinate search unit And an output unit for outputting information on the fashioned clothes.

  In invention of Claim 2, it is used in an apparel shop. In invention of Claim 3, it is used in a mail order site or EC site.

  In the invention according to claim 4, the clothing list already stored by the consumer is stored in the clothing list table. In the invention according to claim 5, clothes that become products are stored in the clothes list table.

  In the invention according to claim 6, the information on the clothing input from the input unit includes information specifying the range of the clothing shown in the image. In addition, the feature extraction unit extracts the feature of the clothing from the specified range.

  In the invention according to claim 7, the feature of the clothing extracted by the feature extraction unit includes a color. The color is quantitative.

  In the invention described in claim 8, a pattern is included in the feature of the clothing extracted by the feature extraction unit. The pattern is qualitative.

  In the invention described in claim 9, the clothing information input from the input unit includes the sex of interest. In addition, the target gender is qualitative.

  In the invention described in claim 10, the clothing age information input from the input unit includes the target age. The target age is quantitative.

  In the invention according to claim 11, a registration date in which the coordination is stored is stored in the coordination list table. Further, the information on the clothing input from the input unit includes the search date being searched. Further, the search date is quantitative based on the registration date.

  The apparel registration apparatus of the present invention is based on the apparel search device according to any one of claims 1 to 11, the information input from the input unit, and the features extracted by the feature extraction unit. A data registration unit is provided for registering clothing coordinates in the table and registering clothing in the clothing list table.

  The clothing search method of the present invention includes an input step in which an image of clothing and information on the clothing are input from an input unit, a feature extraction step in which a feature extraction unit extracts a feature of the clothing from the image, and a coordinate list table Coordination of clothing stored in pairs, one of the clothing has the same information as the qualitative information input from the input unit, and is extracted by the feature extraction unit A coordinate narrowing-down step that narrows down to a feature having the same characteristics as a qualitative one, and the one outfit among the coordinates narrowed down in the coordinate narrowing-down step is the input step Quantitative information that can be expressed in numerical form, and the feature extraction step. The coordinate selection step for selecting the feature that is the highest in similarity with the quantitative one in the coordinate search unit, and the clothing stored in the clothing list table were selected in the coordinate selection step The coordination narrowing step to narrow down by the coordinate search unit to the qualitative information that is information on the other clothing of the coordination, and the coordination from the clothing narrowed down in the clothing narrowing step Apparel selection for selecting information on the other apparel of the coordinate selected in the selection step and having the highest similarity to the quantitative one in the coordinate search unit as harmonized with the apparel reflected in the image Step and information on the clothing selected in the clothing selection step. And an output step of outputting from the parts.

  The clothing retrieval program of the present invention includes an input step in which an image of clothing and information on the clothing are input to a computer of the clothing retrieval device, a feature extraction step of extracting clothing features from the image, and a coordination list table Coordination of clothing stored in pairs, one of the clothing has the same information as the qualitative information input from the input unit, and is extracted by the feature extraction unit One of the outfits is input in the input step from the coordinate narrowing-down step of narrowing down to those having the same characteristics as the qualitative ones, and the coordination narrowed down in the coordinate narrowing-down step Quantitative information that can represent the similarity of clothes with numerical values, and extracted in the feature extraction step A coordinate selection step for selecting a feature that is the most similar to the quantitative one, and a clothing stored in the clothing list table, and information on the other clothing of the coordinate selected in the coordination selection step The clothing narrowing step that narrows down to the one having the same information as the qualitative one, and the other clothing of the coordinate selected in the coordinate selection step from the clothing narrowed down in the clothing narrowing step A clothing selection step for selecting information having the highest degree of similarity with the quantitative one as harmonized with the clothing in the image, and outputting information on the clothing selected in the clothing selection step It is for output step and execution.

  Another apparel search device of the present invention includes an input unit for inputting an image of apparel and information about the apparel, a feature extraction unit for extracting the apparel features from the image, and apparel stored in the apparel list table. The information input from the input unit has the same information as the qualitative information, and the features extracted by the feature extraction unit have the same characteristics as the qualitative information. From the narrowed down clothing, it is information input from the input unit that is a quantitative one that can represent the similarity of the clothing with a numerical value, and a feature that is extracted by the feature extraction unit. An apparel search unit that selects an item that has the highest similarity to the quantitative one as an item that is similar to the apparel in the image, and an output unit that outputs information about the apparel selected by the apparel search unit And.

  In the invention described in claim 16, the clothing information input from the input unit includes information for specifying the range of the clothing shown in the image. In addition, the feature extraction unit extracts the feature of the clothing from the specified range.

  In invention of Claim 17, the feature of the clothing which the said feature extraction part extracts contains the color. The color is quantitative.

  In the invention described in claim 18, a pattern is included in the feature of the clothing extracted by the feature extraction unit. The pattern is qualitative.

  Another apparel registration apparatus of the present invention is based on the apparel search device according to any one of claims 15 to 18, information input from the input unit, and features extracted by the feature extraction unit, A data registration unit for registering clothing in the clothing list table;

  Another clothing retrieval method of the present invention includes an input step in which an image of clothing and the information on the clothing are input from an input unit, a feature extraction step in which a feature extraction unit extracts a feature of the clothing from the image, and a clothing list The clothes stored in the table have the same information as the qualitative information input in the input step, and are the same as the qualitative features extracted in the feature extraction step. The clothing refinement step narrowed down by the clothing search unit to those having the characteristics of the above, and the information input in the input step from among the clothing refined in the clothing refinement step, and expressing the similarity of the clothing as a numerical value And those that are extracted in the feature extraction step and that have the highest similarity to the quantitative one are similar to the clothing that appears in the image. Wherein it comprises a clothing selection step of selecting at clothing search unit, and an output step of outputting the said clothing of information selected by the clothing selection step from the output section Te.

  Another apparel search program of the present invention includes an input step in which an image of apparel and information on the apparel are input to a computer of the apparel search device, a feature extraction step of extracting apparel features from the image, and a apparel list The clothes stored in the table have the same information as the qualitative information input in the input step, and are the same as the qualitative features extracted in the feature extraction step. The clothing narrowing step to narrow down to those having the characteristics of the above, and from the clothing narrowed down in the clothing narrowing step, it is the information inputted in the input step and can quantitatively represent the similarity of the clothing And the features extracted in the feature extraction step, which have the highest similarity to the quantitative ones, and are similar to the clothing in the image And clothing selection step of selecting by the is for executing an output step of outputting the clothing of information selected by the clothing selection step.

  According to the clothing retrieval method and apparatus and the clothing retrieval program of the present invention, it is possible to output clothing information in harmony with the clothing designated by the user. As a result, it is possible to support the purchase and sale of clothing.

  Further, according to another clothing retrieval method and apparatus and a clothing retrieval program, it is possible to output clothing information similar to the clothing designated by the user. As a result, it is possible to support the purchase and sale of clothing.

[First Embodiment]
In FIG. 1, the clothing search device according to the first embodiment is realized in a format constructed in the server 11 by installing a clothing search program 38 (see FIG. 3). The clothing search device searches for clothing in harmony with the clothing shown in the selected image.

  The server 11 and the client terminal 13 connected via the Internet 12 constitute a network system 14. The client terminal 13 is, for example, a known personal computer or workstation, and includes a monitor 15 that displays various operation screens, and an operation unit 18 including a mouse 16 and a keyboard 17 that output operation signals.

  To the client terminal 13, an image obtained by photographing with the digital camera 19, an image recorded on a recording medium 20 such as a memory card or a CD-R is transmitted, or the image is transferred via the Internet 12. Is done.

  The digital camera 19 is connected to the client terminal 13 by a communication cable compliant with, for example, IEEE 1394, USB (Universal Serial Bus), a wireless LAN, or the like, and data communication with the client terminal 13 is possible. Similarly, the recording medium 20 can exchange data with the client terminal 13 via a dedicated driver.

  As shown in FIG. 2, the CPU 21 constituting the client terminal 13 comprehensively controls the entire client terminal 13 according to an operation signal input from the operation unit 18. In addition to the operation unit 18, a RAM 23, a hard disk drive (HDD) 24, a communication interface (communication I / F) 25, a display control unit 26, and a monitor 15 are connected to the CPU 21 via a data bus 22. .

  The RAM 23 is a working memory for the CPU 21 to execute processing. In addition to storing various programs and data for operating the client terminal 13, the HDD 24 stores image data captured from the digital camera 19, the recording medium 20, or the Internet 12. The CPU 21 reads a program from the HDD 24 and develops it in the RAM 23, and sequentially processes the read program.

  The communication I / F 25 is, for example, a modem or a router, controls a communication protocol suitable for the Internet 12, and mediates exchange of data via the Internet 12. The communication I / F 25 also performs data communication with external devices such as the digital camera 19 and the recording medium 20. The display control unit 26 controls the display of the monitor 15 and causes the monitor 15 to display a search window 51 (see, for example, FIG. 6).

  As shown in FIG. 3, the CPU 31 configuring the server 11 comprehensively controls the entire server 11 according to an operation signal input from the client terminal 13 via the Internet 12. A RAM 33, a hard disk drive (HDD) 34, a communication interface (communication I / F) 35, a feature extraction unit 36, and a coordinate search unit 37 are connected to the CPU 31 via a data bus 32.

  The RAM 33 is a working memory for the CPU 31 to execute processing. The HDD 34 stores various programs and data for operating the server 11. The HDD 34 stores a clothing search program 38. The CPU 31 reads a program from the HDD 34 and develops it in the RAM 33, and sequentially processes the read program.

  The HDD 34 is provided with a clothing database (clothing DB) 39 and a coordinate database (coordinate DB) 40. In the clothing DB 39, together with data of clothing images (for example, the image 56 (see FIG. 6)), an image list table (not shown), a clothing list table 41 shown in FIG. 4, and a product information list table (not shown). Is stored.

  The image list table stores the file name of an image with the ID (serial number assigned in the order of registration) automatically assigned at the time of registration as a heading. The clothing list table 41 stores the name (product name), category, representative color, and pattern of clothing appearing in the image with the ID corresponding to the image list table as a headline. The category of clothing is, for example, a skirt, pants and the like. In FIG. 4, the representative color of the clothing is represented by RGB in the HTML format such as “# 4fce00”. However, the format is not limited to this format as long as the color can be specified. Moreover, although the pattern of clothing was represented by a name like “check”, it is not limited to this format as long as the pattern can be specified.

  The merchandise information list table stores merchandise information relating to clothes appearing in the image with the ID corresponding to the image list table as a heading. The product information is product price and other information necessary for sales. The image list table and the clothing list table 41 may be integrated into one data table (the clothing list table 83 (see FIG. 12)). Further, the product information list table may be integrated.

  The coordination DB 40 stores a coordination list table 42 shown in FIG. The coordination list table 42 stores the combination of clothing (coordination), the sex / age of interest, and the date of data registration, with the ID (serial number assigned in the order of storage) automatically given at the time of registration as a headline. For each piece of clothing constituting the combination, a category, a representative color, and a pattern are stored. The ID of the coordination list table 42 does not correspond to the ID of the image list table or the clothing list table 41.

  The communication I / F 35 is, for example, a modem or a router, controls a communication protocol suitable for the Internet 12, and mediates exchange of data via the Internet 12. The communication I / F 35 functions as an input unit to which an image of clothing and various types of information are input, and also functions as an output unit that outputs various types of clothing information searched by the coordinate search unit 37. Data input via the communication I / F 35 is temporarily stored in the RAM 33.

  When the user performs a search, the operation unit 18 is operated to start a web browser and access the search web page of the server 11. When accessing the search web page, the display control unit 26 starts up the search window 51 shown in FIG. 6 on the monitor 15 and displays a search screen 52 for performing a search. On the search window 51, a pointer 53 used for the selection operation is displayed. The pointer 53 moves on the search window 51 when the mouse 16 is operated.

  On the search screen 52, a blank 54 for inputting an image used for the search and a selection button 55 for searching an image to be input to the blank 54 from a folder in the HDD 24 are arranged. When the pointer 53 is placed on the selection button 55 and clicked with the mouse 16, a sub-window (not shown) for hierarchically displaying folders in the HDD 24 is displayed on the monitor 15. The images stored in the hierarchically displayed folders are selected by operating the pointer 53 with the mouse 16.

  When an image is selected, the file name / storage folder name (in this case, D: \ My documents \ My Picture \ ebi.jpg) of the selected image is displayed in the blank 54. Further, the selected image 56 is displayed on the search screen 52. It is also possible to directly input the file name / storage folder name of the image by placing the pointer 53 on the blank 54 and clicking with the mouse 16 and inputting the character string with the keyboard 17.

  When the image 56 is displayed, a rectangular frame 57 for selecting clothing that appears in the image 56 is displayed. The frame 57 can be moved and deformed by operating the pointer 53 with the mouse 16. A range surrounded by the frame 57 is a selection target. The range selection method is not limited to this, and a range may be automatically acquired around a selected point as in the invention described in Japanese Patent Application Laid-Open No. 09-31944. In this case, the frame 57 for selecting the range is not necessary. Further, the range may be selected freehand.

  The search screen 52 includes a pop-up menu 58 for selecting a clothing category, a blank 59 for inputting a clothing age, a pop-up menu 60 for selecting a gender targeted for clothing, A coordinate button 61 for searching for a coordinate is arranged.

  By placing the pointer 53 on the pop-up menu 58 and clicking with the mouse 16, a list of categories is displayed. A category is selected by placing the pointer 53 on one category from the displayed list and clicking with the mouse 16.

  The target age of clothing is input by putting the pointer 53 on the blank 59 and clicking with the mouse 16 and inputting a character string with the keyboard 17.

  By placing the pointer 53 on the pop-up menu 60 and clicking with the mouse 16, a gender list (male / female) is displayed. A gender is selected by placing the pointer 53 on one gender and clicking with the mouse 16 from the displayed list.

  After completion of various operations, the range enclosed by the frame 57 is selected by placing the pointer 53 on the coordinate button 61 and clicking with the mouse 16, and various information (image, selection range, clothing category, target Are sent to the server 11.

  A scroll bar 62 for scrolling the screen is provided at the right end of the search window 51. The scroll bar 62 can be scrolled by operating the mouse 16 and dragging with the pointer 53.

  Returning to FIG. 3, when an image or other information is input to the server 11, the feature extraction unit 36 analyzes the image and extracts the feature of the clothing. For example, the representative color of clothing is extracted from the selection range. The representative color is extracted by selecting a color with a large number of pixels, a color with the highest density, or the like as in the invention described in Japanese Patent Laid-Open No. 2003-216948. In addition, a pattern of clothes is extracted from the selection range. In this case, the pattern (pattern) is extracted by obtaining it based on the feature amount of the projection histogram as in the invention described in Japanese Patent Laid-Open No. 06-221831.

  The coordinate search unit 37 selects the image selected on the search screen 52 based on the category of clothing transmitted from the client terminal 13, the target age / sex, and the representative color / pattern of the clothing extracted by the feature extraction unit 36. Search for clothing in harmony with the clothing shown in 56.

  Specifically, the coordinate search unit 37 is a qualitative item in which first, the combination of clothes stored in the coordinate list table 42 (see FIG. 5) cannot be expressed numerically. Narrow down. As qualitative items that cannot express the similarity between clothes as numerical values, there are clothes categories, genders, and clothes patterns. The qualitative items that cannot be expressed numerically are not limited to the above.

  For example, when the category of clothing transmitted from the client terminal 13 is “skirt”, the combination of clothing that does not include “skirt” in the category is excluded, and the combination of clothing that includes “skirt” in the category is narrowed down. In the case of the coordinate list table 42 shown in FIG. 5, the combinations of ID “0002” are excluded, and the combinations of IDs “0001” and “0003” are narrowed down. Similarly, the combination of clothing is narrowed down based on the target gender and clothing pattern.

  Secondly, the coordinate search unit 37 has the largest numerical distance for the clothing shown in the image 56 selected on the search screen 52 from among the combinations narrowed down by qualitative items that cannot be expressed numerically. Select a combination with similar clothing (pattern). Note that “the closest numerical distance” is synonymous with “the highest similarity between clothes”. The quantitative items that can represent the degree of similarity between clothes as numerical values include the representative color of clothes, the age of interest, and the registration date. Note that the quantitative items that can be expressed numerically are not limited to the above. When the registration date is digitized, it is possible to search for clothing that is close to fashion by setting the difference in the number of days from the search date. The numerical distance is represented by the root mean square of the numerical value representing each item. The root mean square may be taken after weighting each item.

  As conceptually shown in FIG. 7, for example, the clothes shown in the image 56 selected on the search screen 52 is 64, and the combinations of clothes that are narrowed down by qualitative items that cannot be expressed numerically are 65, 66, Assuming that 67, the coordinate search unit 37 selects the combination 65 having the clothing 68 having the closest numerical distance to the clothing 64.

  Thirdly, the coordinate search unit 37 is a qualitative item that cannot represent the clothing stored in the clothing list table 41 (see FIG. 4) based on the other clothing related to the selected combination. Narrow down. Qualitative items that cannot be expressed numerically include clothing categories and clothing patterns. The qualitative items that cannot be expressed numerically are not limited to the above.

  For example, when the category of the other clothing related to the selected combination is “one piece”, the clothing that does not include “one piece” in the category is excluded and the clothing that includes “one piece” in the category is narrowed down. In the case of the clothing list table 41 shown in FIG. 4, the clothing with IDs “0001” and “0003” is excluded and the clothing with the ID “0002” is narrowed down. Similarly, the clothing items are narrowed down based on the clothing pattern.

  Fourth, the coordinate search unit 37 numerically evaluates the other apparel associated with the combination previously selected from the coordinate list table 42 from the apparel that has been narrowed down by qualitative items that cannot be expressed numerically. Choose clothing that is closest to you. Quantitative items that can be expressed numerically include the representative colors of clothing. The quantitative items that can be expressed numerically are not limited to the above. When there are a plurality of quantitative items that can be expressed numerically, the numerical distance is expressed by the root mean square of the numerical values that represent each item. The root mean square may be taken after weighting each item.

  If it continues and demonstrates using the conceptual diagram shown in FIG. 7, if the clothing refined by the qualitative item which cannot be expressed with a numerical value is set to 70, 71, 72, 73, 74, the coordination search part 37 will be set to the combination 65. The clothing 70 having the closest numerical distance to the other clothing 69 is selected.

  The clothing image / commodity information searched by the coordinate search unit 37 is transmitted to the client terminal 13 via the Internet 12.

  When the clothing image / commodity information searched by the coordinate search unit 37 is transmitted to the client terminal 13, the display control unit 26 searches the display of the monitor 15 from the search screen 52 (see FIG. 6) as shown in FIG. Switch to the result display screen 77. On the search result display screen 77, an image 56 and product information 79 are displayed for the clothing in harmony with the clothing shown in the image 56 together with the image 56 selected on the search screen 52. A purchase button 80 is arranged below the product information 79. When the pointer 53 is placed on the purchase button 80 and the mouse 16 is clicked, the display control unit 26 switches the display on the monitor 15 from the search result display screen 77 to a product purchase screen (not shown). On the product purchase screen, a product can be ordered by performing a predetermined operation using the operation unit 18.

  Next, a processing procedure when the server 11 (see FIGS. 1 and 3) configured as described above functions as a clothing search device will be described with reference to the flowchart of FIG. The user operates the operation unit 18 to start a web browser and access the search web page of the server 11. When the search web page is accessed, a search window 51 is launched on the monitor 15 and a search screen 52 (see FIG. 4) is displayed. The user operates the operation unit 18 in accordance with the displayed search screen 52.

  First, an image 56 is selected from a folder in the HDD 24. The selected image 56 is stored in the RAM 23. The selected image 56 is read from the RAM 23 to the display control unit 26. The display control unit 26 displays the read image 56 on the search screen 52. In addition, a frame 57 for selecting clothing that appears in the image 56 is displayed.

  Secondly, the frame 57 is moved and deformed to select a range of clothing that appears in the image 56. Third, select a clothing category. Fourth, enter the target age for clothing. Fifth, select the gender that will be the subject of clothing. When the coordination button 61 is clicked after completion of various operations, the client terminal 13 inputs various information (image, selection range, clothing category, target age / sex) to the server 11. Various information input to the server 11 is stored in the RAM 33.

  The image input to the server 11 is read from the RAM 33 to the feature extraction unit 36 together with the selection range information. In the feature extraction unit 36, the image is analyzed, and the features (representative colors / patterns) of the clothing appearing in the selected range are extracted. The extracted representative color / pattern of the clothing is stored in the RAM 33.

  The category of clothing input to the server 11 and the target age / sex are read from the RAM 33 to the coordinate search unit 37 together with the representative color / pattern of the clothing extracted by the feature extraction unit 36. In the coordinate search unit 37, the image 56 selected on the search screen 52 based on the category of clothing input to the server 11, the target age / sex, and the representative color / pattern of the clothing extracted by the feature extraction unit 36. Apparel that is in harmony with the apparel shown in is searched.

  The search for clothing in the coordinate search unit 37 will be specifically described with reference to the flowchart of FIG. The coordinate search unit 37 refers to the coordinate list table 42 (see FIG. 5), and qualitative items (apparel categories and targets) for which the combination of the costumes stored in the coordinate list table 42 cannot be expressed numerically. Narrow down by gender, clothing pattern). The narrowed combination of clothes is stored in the RAM 33.

  The combination of clothes narrowed down by qualitative items that cannot be expressed by numerical values is read from the RAM 33 to the coordinate search unit 37. In the coordinate search unit 37, the combination having the clothing whose numerical distance is closest to the clothing shown in the image 56 selected on the search screen 52 is selected. The selected combination of clothes is stored in the RAM 33.

  The selected combination of clothes is read from the RAM 33 to the coordinate search unit 37. The coordinate search unit 37 refers to the clothing list table 41 (see FIG. 4), and based on the other clothing related to the selected combination, the clothing stored in the clothing list table 41 cannot be expressed numerically. By specific items (clothing category, clothing pattern). The refined clothing is stored in the RAM 33.

  The narrowed down clothing is read from the RAM 33 to the coordinate search unit 37. In the coordinate search unit 37, the clothing that has the closest numerical distance to the other clothing related to the combination previously selected from the coordinate list table 42 is selected. The selected clothing is stored in the RAM 33.

  The clothing image / commodity information searched by the coordinate search unit 37 is read by the communication I / F 35 and output from the server 11.

  The clothing image / commodity information output from the server 11 is transmitted to the client terminal 13 via the Internet 12. The clothing image / product information transmitted to the client terminal 13 is stored in the RAM 23.

  The clothing image / product information transmitted to the client terminal 13 is read from the RAM 23 to the display control unit 26. The display control unit 26 switches the display on the monitor 15 from the search screen 52 (see FIG. 6) to the search result display screen 77 (see FIG. 8) based on the read out clothing image / product information.

  As described above, since the coordinate search unit 37 is provided, it is possible to display the clothing in harmony with the clothing (image / various information) input by the user on the monitor 15 and present it to the user. In addition, since the search is performed using the coordinate list table 42, when adding and registering new clothing data, it is only necessary to register the clothing data in the clothing list table 41. There is no need to register any data about the correspondence relationship. Furthermore, since the search is performed based on the registration date of the data stored in the coordinate list table 42, it is possible to present clothing that takes into account the fashion.

[Second Embodiment]
In the first embodiment, the case of searching for clothing in harmony with the clothing shown in the selected image has been described as an example, but clothing similar to the clothing shown in the selected image may be searched. .

  In FIG. 11, the clothing search device according to the second embodiment is realized in a format constructed in the server 11 by installing the clothing search program 38. The clothing search device searches for clothing similar to the clothing shown in the selected image.

  The CPU 31 is connected to the HDD 34, the clothing search unit 82, and the like via the data bus 32.

  A clothing list table 83 shown in FIG. 12 is stored in the clothing DB 39 provided in the HDD 34 together with data of an image relating to clothing (for example, the image 56 (see FIG. 6)). The clothing list table 41 stores the file name of the image, the name of the clothing, the category, the representative color, and the pattern that appear in the image, with the ID (serial number assigned in the order of registration) automatically assigned at the time of registration as a heading.

  When the operation unit 18 is operated and a search web page of the server 11 is accessed, the display control unit 26 opens a search window 51 shown in FIG. 13 on the monitor 15 and displays a search screen 52 for performing a search. Display.

  On the search screen 52, a search button 84 for searching for similar clothing is arranged. After completion of various operations, the range enclosed by the frame 57 is selected by placing the pointer 53 on the search button 84 and clicking with the mouse 16, and various information (image, selection range, clothing category) is stored in the server. 11 is transmitted.

  Returning to FIG. 11, the clothing search unit 82 selects the image 56 selected on the search screen 52 based on the category of clothing transmitted from the client terminal 13 and the representative color / pattern of the clothing extracted by the feature extraction unit 36. Search for clothing that is similar to clothing that appears in.

  Specifically, the clothing search unit 82 first narrows down the clothing stored in the clothing list table 83 (see FIG. 12) with qualitative items that cannot be expressed numerically. Qualitative items that cannot be expressed numerically include clothing categories and clothing patterns. The qualitative items that cannot be expressed numerically are not limited to the above.

  For example, when the category of the clothing transmitted from the client terminal 13 is “one piece”, the clothing that does not include “one piece” in the category is excluded and the clothing that includes “one piece” in the category is narrowed down. In the case of the clothing list table 83 shown in FIG. 12, the clothing with IDs “0001” and “0003” is excluded and the clothing with IDs “0002” and “0004” is narrowed down. Similarly, the clothing items are narrowed down based on the clothing pattern.

  Secondly, the clothing search unit 82 has the largest numerical distance with respect to the clothing shown in the image 56 selected on the search screen 52 from the clothing qualitatively narrowed down by the qualitative items that cannot be expressed numerically. Select the closest clothing (pattern). Quantitative items that can be expressed numerically include the representative colors of clothing. The quantitative items that can be expressed numerically are not limited to the above. When there are a plurality of quantitative items that can be expressed numerically, the numerical distance is expressed by the root mean square of the numerical values that represent each item. The root mean square may be taken after weighting each item.

  As conceptually shown in FIG. 14, for example, the clothes shown in the image 56 selected on the search screen 52 is 86, and the clothes that are narrowed down by qualitative items that cannot be expressed numerically are 87, 88, 89, Assuming 90 and 91, the clothing search unit 82 selects the clothing 87 having the closest numerical distance to the clothing 86.

  The clothing image and name searched by the clothing search unit 82 are transmitted to the client terminal 13 via the Internet 12.

When the image and name of the clothing searched by the clothing search unit 82 are transmitted to the client terminal 13, the display control unit 26 displays the display on the monitor 15 from the search screen 52 (see FIG. 13) as a search result shown in FIG. Switch to the display screen 77. The search result display screen 77 displays an image 92 and a name 93 for the clothing similar to the clothing shown in the image 56 together with the image 56 selected on the search screen 52. Note that the description of the same configuration as in the first embodiment is omitted.

  Next, a processing procedure when the server 11 (see FIG. 11) configured as described above functions as a clothing search device will be described with reference to the flowchart of FIG. When the operation unit 18 is operated and the search web page of the server 11 is accessed, a search window 51 is launched on the monitor 15 and a search screen 52 (see FIG. 13) is displayed. The user operates the operation unit 18 in accordance with the displayed search screen 52.

  First, the image 56 is selected. Second, select a range of clothing. Third, select a clothing category. When the search button 84 is clicked after completion of various operations, the client terminal 13 inputs various information (image, selection range, clothing category) to the server 11.

  In the feature extraction unit 36, the image is analyzed, and the features (representative colors / patterns) of the clothing appearing in the selected range are extracted. In the clothing search unit 82, the clothing similar to the clothing reflected in the image 56 selected on the search screen 52 based on the clothing category input to the server 11 and the representative color / pattern of the clothing extracted by the feature extraction unit 36. Is searched.

  The retrieval of clothing in the clothing retrieval unit 82 will be specifically described with reference to the flowchart of FIG. The clothing search unit 82 refers to the clothing list table 83 (refer to FIG. 12), and is a qualitative item (clothing category, clothing pattern) in which the clothing stored in the clothing list table 83 cannot be represented by a numerical value. It is narrowed down. The refined clothing is stored in the RAM 33.

  Apparel that has been narrowed down by qualitative items that cannot be expressed numerically is read from the RAM 33 to the apparel search unit 82. In the clothing search unit 82, the clothing having the closest numerical distance to the clothing shown in the image 56 selected on the search screen 52 is selected. The selected clothing is stored in the RAM 33.

  The clothing image / name searched by the clothing search unit 82 is read out to the communication I / F 35 and output from the server 11.

  The clothing image / name output from the server 11 is transmitted to the client terminal 13 via the Internet 12. The clothing image / name transmitted to the client terminal 13 is stored in the RAM 23.

  The drawing / name of the clothing transmitted to the client terminal 13 is read from the RAM 23 to the display control unit 26. The display control unit 26 switches the display on the monitor 15 from the search screen 52 (see FIG. 13) to the search result display screen 77 (see FIG. 15) based on the read out clothing image / name.

  As described above, since the apparel search unit 82 is configured, if the apparel is similar to the apparel (image / various information) input by the user, the apparel is similar to the apparel 15. Can be displayed and presented to the user. Thereby, the user can refrain from the purchase, when he is going to purchase the input clothing.

[Third Embodiment]
In addition, in the said 1st Embodiment, although only the case where the clothing in harmony with the selected clothing was searched was demonstrated, by setting it as the following structures, an image list table (illustration omitted) and the clothing list table 41 (refer FIG. 4). ) And the data of clothing can be registered in the coordination list table 42 (see FIG. 5).

  In FIG. 18, the clothing registration apparatus according to the third embodiment is realized in a format constructed in the server 11 by installing the clothing registration program 38. The clothing registration device registers data in the image list table, the clothing list table 41, and the coordinate list table 42 in the clothing search device of the first embodiment.

  A data registration unit 95 and the like are connected to the CPU 31 via the data bus 32.

  When the user performs registration, the user operates the operation unit 18 to activate the web browser and access the registration web page of the server 11. When accessing the registration web page, the display control unit 26 starts up a registration window 96 shown in FIG. 19 on the monitor 15 and displays a registration screen 97 for performing registration.

  When the selection button 55 is operated and the image 98 is displayed, rectangular frames 99 and 100 for selecting clothing that appears in the image 98 are displayed. The frames 99 and 100 can be moved and deformed by operating the pointer 53 with the mouse 16. A range surrounded by the frames 99 and 100 is a selection target. Note that the range selection method is not limited to this, and may be the method shown in the first embodiment.

  In the registration screen 97, a pop-up menu 101 for selecting a first clothing category, a blank 102 for inputting the name of the first clothing, and a second clothing category are selected. Pop-up menu 103, a blank 104 for inputting the name of the second clothing, and a registration button 105 for registering clothing data.

  The first piece of clothing is clothing in a range surrounded by the frame 99. The pop-up menu 101 and the blank 102 relating to the first clothing are surrounded by a frame 106 of the same color (for example, red) as the frame 99 in order to make the correspondence relationship with the frame 99 visible. The second clothing is clothing in a range surrounded by the frame 100. The pop-up menu 103 and the blank 104 related to the second clothing are surrounded by a frame 107 having the same color (for example, blue) as the frame 100 in order to make the correspondence relationship with the frame 100 visible.

  A list of categories is displayed by placing the pointer 53 on the pop-up menu 101 and clicking with the mouse 16. A category is selected by placing the pointer 53 on one category from the displayed list and clicking with the mouse 16. The pop-up menu 103 has the same configuration as the pop-up menu 101.

  By putting the pointer 53 on the blank 102 and clicking with the mouse 16 and inputting a character string with the keyboard 17, the name of the clothing (item name, product name) is input. The blank 104 has the same configuration as the blank 102.

  After completion of various operations, the range enclosed by the frames 99 and 100 is selected by placing the pointer 53 on the registration button 105 and clicking with the mouse 16, and various information (image, selection range, clothing category) is selected. (Name, target age / sex) are transmitted to the server 11.

  Returning to FIG. 18, the data registration unit 95 stores the two clothing images input from the client terminal 13 in the image list table with different IDs. In addition, the data registration unit 95 sets the name / category of the two pieces of clothing input from the client terminal 13 together with the representative color / pattern of the clothing extracted by the feature extraction unit 36, and the clothing list table 41 with a different ID. (See FIG. 4). Furthermore, the data registration unit 95 includes two categories of clothing input from the client terminal 13, the target sex and age, the input date (registration date), and the representative of the clothing extracted by the feature extraction unit 36. Together with the color / pattern, it is combined with one ID and stored in the coordinate list table 42 (see FIG. 5).

  For example, various pieces of information shown in FIG. 19 are input on October 3, 2010, the color of the clothing surrounded by the frame 99 is pink (# ff99ff), and the color of the clothing enclosed by the frame 100 is light blue (# 3399ff). In this case, the data registration unit 95 stores the product name “mote tops”, the category “tops”, the representative color “# ff99ff”, and the pattern “plain color” as the first ID in the clothing list table 41. As the second ID, the product name “beautiful leg denim”, category “denim”, representative color “# 3399ff”, and pattern “plain” are stored. Further, the data registration unit 95 sets the category “tops” as the first (pattern 1), the representative color “# ff99ff”, the pattern “plain”, and the second (pattern 2) as to the coordinate list table 42. The category “denim”, representative color “# 3399ff”, pattern “plain”, target sex “female”, target age “31”, and registration date “2010/10/03” are stored. Note that the description of the same configuration as in the first embodiment is omitted.

  Next, a processing procedure when the server 11 (see FIG. 18) configured as described above functions as a clothing registration apparatus will be described with reference to the flowchart of FIG. The user operates the operation unit 18 to start the web browser and access the registration web page of the server 11. When the registration web page is accessed, a registration window 96 is launched on the monitor 15 and a registration screen 97 (see FIG. 19) is displayed. The user operates the operation unit 18 in accordance with the displayed registration screen 97.

  First, an image 98 is selected from a folder in the HDD 24. The selected image 98 is stored in the RAM 23. The selected image 98 is read from the RAM 23 to the display control unit 26. The display control unit 26 displays the read image 98 on the registration screen 97. In addition, frames 99 and 100 are displayed for selecting clothes that appear in the image 98.

  Second, the frames 99 and 100 are moved and deformed, and two clothing ranges shown in the image 98 are selected. Third, select a clothing category. Fourth, enter the name of each piece of clothing. Fifth, enter the target age for clothing. Sixth, select the gender to be dressed. When the registration button 105 is clicked after completion of various operations, the client terminal 13 inputs various information (image, selection range, clothing category / name, target age / sex) to the server 11. Various information input to the server 11 is stored in the RAM 33.

  The image input to the server 11 is read from the RAM 33 to the feature extraction unit 36 together with the selection range information. In the feature extraction unit 36, the image is analyzed, and the features (representative positions / patterns) of the clothing appearing in the selected range are extracted. The extracted representative color / pattern of the clothing is stored in the RAM 33.

  The category / name of clothing and the age / sex of the target inputted to the server 11 are read from the RAM 33 to the data registration unit 95 together with the representative color / pattern of the clothing extracted by the feature extraction unit 36. The data registration unit 95 stores the clothing image input to the server 11 in the image list table, and extracts the category / name of the clothing input to the server 11, the target age / sex, and the feature extraction unit 36. The representative colors and patterns of the fashioned clothing are stored in the clothing list table 41 (see FIG. 4) and the coordinate list table 42 (see FIG. 5).

[Fourth Embodiment]
In the second embodiment, only the case of searching for clothing similar to the selected clothing has been described. However, by setting the following configuration, the clothing data is registered in the clothing list table 83 (see FIG. 12). be able to.

  In FIG. 21, the clothing registration apparatus according to the fourth embodiment is realized in a format constructed in the server 11 by installing the clothing registration program 38. The clothing registration device registers data in the clothing list table 83 in the clothing search device of the second embodiment.

  A data registration unit 95 and the like are connected to the CPU 31 via the data bus 32.

  When the operation unit 18 is operated and the registration web page of the server 11 is accessed, the display control unit 26 launches a registration window 96 shown in FIG. Display.

  After the completion of various operations, the range enclosed by the frame 99 is selected by placing the pointer 53 on the registration button 105 and clicking with the mouse 16, and various information (image, selection range, clothing category / name) Is transmitted to the server 11.

  Returning to FIG. 21, the data registration unit 95 displays the name / category of the clothing input from the client terminal 13 together with the image and the representative color / pattern of the clothing extracted by the feature extraction unit 36. 83 (see FIG. 12). The description of the same configuration as that of the second or third embodiment is omitted.

  Next, a processing procedure when the server 11 (see FIG. 21) configured as described above functions as a clothing registration apparatus will be described with reference to the flowchart of FIG. When the operation unit 18 is operated to access the registration web page of the server 11, a registration window 96 is displayed on the monitor 15 and a registration screen 97 (see FIG. 22) is displayed. The user operates the operation unit 18 in accordance with the displayed registration screen 97.

  First, the image 98 is selected. Second, select a range of clothing. Third, select a clothing category. Fourth, enter the name of the outfit. When the registration button 105 is clicked after completion of various operations, the client terminal 13 inputs various information (image, selection range, clothing category / name) to the server 11.

  In the feature extraction unit 36, the image is analyzed, and the features (representative colors / patterns) of the clothing appearing in the selected range are extracted. The data registration unit 95 stores the category / name and image of the clothing input to the server 11 and the representative color / pattern of the clothing extracted by the feature extraction unit 36 in the clothing list table 83 (see FIG. 12).

  In each of the above embodiments, the client terminal 13 has been described as an example of a terminal for inputting various information to the server 11. However, any terminal capable of Internet communication may be used, for example, a mobile phone. When a mobile phone with a camera is used, it is possible to immediately search for clothing that harmonizes with the captured clothing or similar clothing, which is convenient when purchasing clothing at an apparel shop. Further, even if the cellular phone does not have an Internet communication function, the present invention can be applied as long as it has a mail function.

  In each of the above embodiments, the case of searching for clothing based on an image stored in the HDD 24 of the client terminal 13 has been described as an example, but a mail order site (for example, amazon.com (registered trademark)) or an EC site You may make it search clothing based on the image published on web pages, such as (site selling focusing on an in-house product).

  Further, in each of the above embodiments, the case of applying to a mail order site or an EC site and shifting to a product purchase screen has been described as an example.

  In addition, the client terminal 13 in each of the above embodiments may be owned by an individual consumer, or may be installed in an apparel shop. If the client terminal 13 is owned by the individual consumer, the HDD 24 stores an image showing the clothing owned by the individual consumer, thereby searching for clothing in harmony with the owned clothing or searching for similar clothing. You can do it. In the case where the client terminal 13 is installed in an apparel shop, by storing an image showing the clothes sold at the apparel shop in the HDD 24, the clothes that are harmonized with each other among the clothes sold at the apparel shop are stored. The combination can be presented, and the combination sale of clothes can be supported. Eventually, bulk purchases can be promoted and apparel shop sales can increase.

  In addition, by combining the first and second embodiments, or the third and fourth embodiments, a function for searching for clothing in harmony with the clothing that appears in the selected image, and similar to the clothing that appears in the selected image You may make it have the function to search the clothing to do.

  Moreover, in the said 2nd and 4th embodiment, the clothing search part 82 is based on the quantitative item which can be represented by a numerical value from the qualitative items which cannot be expressed by a numerical value. Although only one piece of clothing having the closest numerical distance to the piece of clothing shown in the image 56 selected on the search screen 52 has been selected, the number is not limited to one, and the predetermined number is the closest in numerical order. You may make it select the number of clothing. Moreover, you may make it select all the clothing whose numerical distance is less than predetermined value.

  Moreover, the clothing search device and the clothing registration device shown in the above embodiments are merely examples, and can be appropriately changed to any form without departing from the gist of the present invention.

It is the schematic which shows the structure of the network system of 1st Embodiment. It is a block diagram which shows the internal structure of the client terminal of 1st Embodiment. It is a block diagram which shows the internal structure of the server of 1st Embodiment. It is explanatory drawing which shows the structure of the clothing list table of 1st Embodiment. It is explanatory drawing which shows the structure of the coordination list table of 1st Embodiment. It is explanatory drawing which shows the search screen of 1st Embodiment. It is a conceptual diagram explaining the search method of 1st Embodiment. It is explanatory drawing which shows the search result display screen of 1st Embodiment. It is a flowchart explaining the operation procedure in 1st Embodiment. It is a flowchart explaining the search processing procedure in 1st Embodiment. It is a block diagram which shows the internal structure of the server of 2nd Embodiment. It is explanatory drawing which shows the structure of the clothing list table of 2nd Embodiment. It is explanatory drawing which shows the search screen of 2nd Embodiment. It is a conceptual diagram explaining the search method of 2nd Embodiment. It is explanatory drawing which shows the search result display screen of 2nd Embodiment. It is a flowchart explaining the operation procedure in 2nd Embodiment. It is a flowchart explaining the search processing procedure in 2nd Embodiment. It is a block diagram which shows the internal structure of the server of 3rd Embodiment. It is explanatory drawing which shows the registration screen of 3rd Embodiment. It is a flowchart explaining the procedure until registering the clothing in 3rd Embodiment. It is a block diagram which shows the internal structure of the server of 4th Embodiment. It is explanatory drawing which shows the registration screen of 4th Embodiment. It is a flowchart explaining the procedure until registering the clothing in 4th Embodiment.

Explanation of symbols

11 Server (Apparel search device, Apparel registration device)
35 Communication interface (communication I / F, input unit, output unit)
36 Feature Extraction Unit 37 Coordinate Search Unit 38 Apparel Search Program 39 Apparel Database (Apparel DB)
40 Coordinate database (Coordinate DB)
41, 83 Clothing list table 42 Coordinate list table 56, 98 Image 57 Frame

Claims (21)

An input part for inputting an image of clothing and information on the clothing;
A feature extraction unit for extracting features of clothing from the image;
Coordination of clothes stored in pairs in the coordinate list table, one of the clothes has the same information as the qualitative information input from the input unit, and the feature extraction After narrowing down to the features extracted in the section and having the same characteristics as the qualitative one, the one piece of clothing out of the narrowed down coordinates is the information input from the input section. And a clothing list table that selects a quantitative one that can represent the similarity of clothing by a numerical value and a feature that is extracted by the feature extraction unit and has the highest similarity to the quantitative one. Narrow down the clothes stored in the above-mentioned information on the other clothes of the coordinator previously selected and having the same information as the qualitative one. From among the coordinate retrieval section for selecting as those high the quantitative ones most similarity to a other clothing information of the coordinates of the previously selected, in harmony with the clothing caught on the image,
An apparel search device comprising: an output unit that outputs information on the apparel selected by the coordinate search unit.   The apparel search device according to claim 1, wherein the apparel search device is used in an apparel shop.   2. The apparel retrieval apparatus according to claim 1, wherein the apparel retrieval apparatus is used at a mail order site or an EC site.   The clothing search device according to any one of claims 1 to 3, wherein the clothing list table stores clothing already owned by a consumer.   The clothing search device according to any one of claims 1 to 3, wherein the clothing list table stores clothing that is a product. The information on the clothing input from the input unit includes information for specifying the range of clothing that appears in the image,
The said feature extraction part extracts the feature of clothing from the specified range, The clothing search apparatus in any one of Claims 1-5 characterized by the above-mentioned. The feature of the clothing that the feature extraction unit extracts includes color,
The clothing search device according to claim 1, wherein the color is quantitative. The feature of the clothes extracted by the feature extraction unit includes a pattern,
The clothing search device according to claim 1, wherein the pattern is qualitative. The information on the clothing input from the input unit includes the target gender,
The clothing search device according to any one of claims 1 to 8, wherein the target sex is qualitative. Apparel information input from the input unit includes the target age,
The clothing search device according to claim 1, wherein the target age is the quantitative one. In the coordination list table, a registration date in which the coordination is stored is stored,
The clothing information input from the input unit includes the search date being searched,
The said search date is the said quantitative thing on the basis of the said registration date, The clothing search apparatus in any one of Claims 1-10 characterized by the above-mentioned. A clothing search device according to any one of claims 1 to 11,
Based on the information input from the input unit and the feature extracted by the feature extraction unit, a data registration unit for registering the coordination of clothing in the coordination list table and registering the clothing in the clothing list table; A clothing registration device characterized by comprising. An input step in which an image of clothing and information on the clothing are input from the input unit;
A feature extraction step of extracting the features of clothing from the image by a feature extraction unit;
Coordination of clothes stored in pairs in the coordinate list table, one of the clothes has the same information as the qualitative information input from the input unit, and the feature extraction A coordinate refinement step of narrowing down by a coordinate search unit to features that are extracted in a part and have the same characteristics as qualitative ones;
Among the coordinates narrowed down in the coordinate narrowing step, the one piece of clothing is information inputted in the input step and is quantitative and can represent the degree of similarity of the clothing numerically, and the feature A coordinate selection step of selecting the feature extracted in the extraction step and having the highest similarity with the quantitative one in the coordinate search unit;
The clothing refinement step of narrowing down the clothing stored in the clothing list table to the clothing having the same information as the information of the other clothing of the coordinate selected in the coordinate selection step by the coordinate search unit When,
Among the clothes narrowed down in the clothes narrowing down step, information on the other clothes of the coordinate selected in the coordinate selection step, which has the highest similarity with the quantitative one, is displayed on the image. Clothing selection step to select in the coordinate search unit as harmonized with the reflected clothing,
A clothing retrieval method comprising: an output step of outputting information on the clothing selected in the clothing selection step from an output unit. To the computer of the apparel search device,
An input step in which an image of clothing and information on the clothing are input;
A feature extraction step of extracting clothing features from the image;
Coordination of clothing stored in pairs in the coordinate list table, one of the clothing has the same information as the qualitative information input from the input unit, and the feature extraction A coordinate narrowing-down step that narrows down to features that are the same as qualitative features extracted from
Among the coordinates narrowed down in the coordinate narrowing step, the one piece of clothing is information inputted in the input step and is quantitative and can represent the degree of similarity of the clothing numerically, and the feature A coordinate selection step for selecting the feature extracted in the extraction step and having the highest similarity to the quantitative one;
A clothing refinement step for narrowing down the clothing stored in the clothing list table to one having the same information as the qualitative information of the other clothing of the coordinate selected in the coordinate selection step;
Among the clothes narrowed down in the clothes narrowing down step, information on the other clothes of the coordinate selected in the coordinate selection step that has the highest similarity to the quantitative one is displayed in the image. A clothing selection step for selecting clothing in harmony with the reflected clothing;
A clothing search program for executing the output step of outputting information of the clothing selected in the clothing selection step. An input part for inputting an image of clothing and information on the clothing;
A feature extraction unit for extracting features of clothing from the image;
The garments stored in the garment list table have the same information as the qualitative information input from the input unit, and are the qualitative features extracted by the feature extraction unit. Narrowed down to those having the same characteristics as the above, from the narrowed down clothing, the information input from the input unit, the quantitative one that can represent the similarity of clothing in numerical values, and the A clothing search unit that selects the feature extracted by the feature extraction unit and having the highest similarity to the quantitative one as being similar to the clothing shown in the image;
An apparel search apparatus comprising: an output unit that outputs information on the apparel selected by the apparel search unit. The information on the clothing input from the input unit includes information for specifying the range of clothing that appears in the image,
The clothing search device according to claim 15, wherein the feature extraction unit extracts a feature of the clothing from the specified range. The feature of the clothing that the feature extraction unit extracts includes color,
The clothing search device according to claim 15 or 16, wherein the color is the quantitative one. The feature of the clothes extracted by the feature extraction unit includes a pattern,
The clothing search device according to claim 15, wherein the pattern is qualitative. A clothing search device according to any one of claims 15 to 18,
An apparel registration apparatus comprising: a data registration unit that registers apparel in the apparel list table based on information input from the input unit and features extracted by the feature extraction unit. An input step in which an image of clothing and information on the clothing are input from the input unit;
A feature extraction step of extracting the features of clothing from the image by a feature extraction unit;
The garments stored in the garment list table have the same information as the qualitative information input in the input step, and the qualitative features extracted in the feature extraction step Clothing refinement step to narrow down to the one having the same characteristics as the clothing search part,
Quantitative information that is input in the input step and can represent the degree of similarity of clothes in numerical values, and extracted in the feature extraction step from the clothes narrowed down in the clothes narrowing down step A clothing selection step for selecting a clothing that has the highest similarity to the quantitative one as a feature similar to the clothing reflected in the image, in the clothing search unit;
A clothing retrieval method comprising: an output step of outputting information on the clothing selected in the clothing selection step from an output unit. To the computer of the apparel search device,
An input step in which an image of clothing and information on the clothing are input;
A feature extraction step of extracting clothing features from the image;
The garments stored in the garment list table have the same information as the qualitative information input in the input step, and the qualitative features extracted in the feature extraction step The clothing refinement step to narrow down to those having the same characteristics as,
Quantitative information that is input in the input step and can represent the degree of similarity of clothes in numerical values, and extracted in the feature extraction step from the clothes narrowed down in the clothes narrowing down step A clothing selection step for selecting a feature that is most similar to the quantitative one as a clothing similar to the clothing shown in the image;
A clothing retrieval program for executing the output step of outputting information on the clothing selected in the clothing selection step.

Images