JP2016071610A - Coordination proposing apparatus and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a coordination proposing apparatus and method, which allow for appropriately coordinating colors of products regardless of the number of colors of each product to be combined.SOLUTION: Second color information obtained by analyzing images of pre-coordinated first and second products is registered in a coordinated color DB 44, the second color information being registered for each of color combinations with different number of colors, such as a two-color combination, three-color combination, four-color combination, etc. When a first product (top) requested to be coordinated is received, first color information (black) of an image of the first product is obtained. The second color information (black, red) containing the obtained first color information (black) is obtained from the coordinated color DB 44. A second product (bottom) having differential color information (red) between the first color information and second color information is searched from a product DB 46 and the retrieved second product is proposed.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a coordination proposal apparatus and method, and in particular, coordinates that proposes to a user a coordinated product that is a product obtained by appropriately combining (coordinated) two or more products included in a product group to be electronic commerce (EC). The present invention relates to a proposed apparatus and method.

  When purchasing products such as clothing items on the Internet electronic commerce site (EC site), combine (coordinate) and coordinate products (hereinafter referred to as “coordinated products”) so that two or more types of products are in harmony. There is a case where a plurality of commodities to be configured or one of the plurality of commodities (a merchandise that he does not have) is selected to purchase the merchandise.

  However, there is a problem that it is troublesome for a user to search for a coordinated product suitable for him / her on the EC site.

  Conventionally, in order to solve the above-described problem, a coordination support method for presenting product candidates suitable for coordination has been proposed (Patent Document 1).

  The coordinate support method described in Patent Literature 1 extracts key product information, which is product information about a specified key product, from a product information database in which product information including product attribute information is stored, and extracts key product information. Based on the attribute information contained in the product, the product attribute information (coordinated attribute information) suitable for coordination with the key product is extracted from the coordinated information database having information on the combination of the attribute information suitable for coordination, and the coordinated data is extracted. Product information including attribute information is extracted and displayed as coordinated product information from the product information database.

  Coordinate attribute information is specified based on the attribute information of the product included in the key product information, and the attribute information of the corresponding product is coordinated from the attribute combination information having a combination of products suitable for coordination as a combination of the attribute information of the product. Identified as attribute information.

  For example, when the attribute information of the key product is red, and the color of the coordinated product (coordinate attribute information) is black, a combination of attribute information such as (red, black) is stored in the database. Then, product information including coordinate attribute information (black) is extracted and displayed as coordinated product information from the product information database.

  Japanese Patent Application Laid-Open No. 2004-228561 describes that color harmony can be classified into three types: harmony of similarities, harmony of similarities (harmony due to similarity of hue, harmony due to similarity of tone), and harmony of contrast. In the coordinate information database, attribute combination information for colors, which is one of the attribute information, is registered in advance for the harmony of these colors. For example, as attribute combination information related to harmony in the same system, the same hue number or a combination of adjacent hue numbers in the hue circle [{(hue, 1), (hue, 1)}, {(hue, 1), (hue) , 2)}, {(hue, 1), (hue, 24)}, ..., {(hue, 23), (hue, 24)}] are registered.

JP 2003-91683 A

  The coordination support method described in Patent Literature 1 is a method for searching for other products coordinated with key products (coordinated products) based on, for example, color coordination (color harmony). In the case of searching based on the harmony of any of the harmony of the color and the harmony of the contrast, the colors of the key product and the coordinated product are limited to single colors.

  That is, the invention described in Patent Document 1 cannot search for coordinated products having two or more colors based on a single color key product, and is based on a key product having two or more colors. Alternatively, there is a problem that a coordinated product having two or more colors cannot be searched.

  The present invention has been made in view of such circumstances, and it is an object of the present invention to provide a coordination proposal apparatus and method capable of appropriately coordinating colors between products regardless of the number of colors of each product to be combined. And

  In order to achieve the above object, a coordination suggestion device according to an aspect of the present invention is a product database in which product information about a product group to be electronically commerce is registered, and the product and product images for each registered product. A product database registered in association with product information including first color information indicating each color of a single color or a plurality of colors obtained by analyzing the product, and a product reception for receiving a first product desired to be coordinated from a user terminal A first color information acquisition unit that acquires first color information obtained by analyzing an image of the first product based on the first product received by the product reception unit, and a first coordinated first The second color information indicating each color of a plurality of colors obtained by analyzing the images of the first product and the second product, and a plurality of second color information having different colors are registered. The first color information is included on the basis of the color database for tain and the first color information acquired by the first color information acquisition unit, and the number of colors is larger than the number of colors of the first color information. The second color information acquired by the second color information acquisition unit, the first color information acquired by the first color information acquisition unit, and the second color information acquired by the second color information acquisition unit. The third color information indicating a difference from the color information of the second color information is obtained, and the second color information having the first color information which is the same color information as the third color information is obtained from the product database based on the obtained third color information. A product search unit for searching for a product, and a product display unit for presenting the second product searched for by the product search unit to the user terminal as a second product coordinated with the first product received by the user terminal; .

  According to one aspect of the present invention, when the first product desired to be coordinated is received from the user terminal, the first color information indicating each color of a single color or a plurality of colors obtained by analyzing the image of the first product To get. Accordingly, when the first product is a single color, the first color information indicating a single color (one color) is acquired, and when the first product has two or more colors, each color of a plurality of colors is selected. The first color information shown is acquired. Then, based on the acquired first color information, second color information including the first color information and having a number of colors larger than the number of colors of the first color information is obtained from the coordination color arrangement database. get. That is, the coordinate color arrangement database includes second color information indicating each color of a plurality of colors obtained by analyzing the images of the first product and the second product coordinated in advance, and the number of colors For example, when the number of colors of the obtained first color information is one, two colors having the same color as the first color information are registered. If the second color information having the above number of colors is acquired from the coordinate color arrangement database and the number of colors of the acquired first color information is two, the same color as the two colors of the first color information is obtained. Second color information having three or more colors is obtained from the coordinate color arrangement database. Then, the third color information indicating the difference between the first color information and the second color information is obtained, and the second color information having the same color information as the third color information is obtained from the product database based on the third color information. And the second product searched for is displayed on the user terminal. The first product and the second product proposed to be coordinated have the second color information registered in the color scheme database for coordination, and the first product and the second product are appropriately colored. Coordinated. This is because two color information obtained by analyzing the images of the first product and the second product coordinated in advance is registered in the coordinate color arrangement database.

  In the coordination proposal device according to another aspect of the present invention, the first color information is color information corresponding to a single color or a plurality of colors representing the color of the image of the first product, and the number of colors set in advance. Color information indicating each color of a single color or a plurality of colors selected from the basic color palette having the second color information, and the second color information is a plurality of colors representing the colors of the images of the first product and the second product. The corresponding color information is preferably color information indicating each of a plurality of colors selected from the basic color palette.

  Originally, even if the color of one product itself is a single color, the color feature amount (physical measurement value) obtained by analyzing the product image can be recognized as multiple colors, but represents the color of the product image. By selecting the color, it can be matched with the original number of colors of the product, and color information corresponding to the representative color can be appropriately reduced by selecting from the basic color palette. Can be eliminated.

  In the coordination proposal device according to still another aspect of the present invention, second color information is registered for each color scheme of a plurality of color schemes having different numbers of colors in the coordinate color scheme database, and the second color information acquisition unit is The second color information for each color arrangement that includes the first color information acquired by the first color information acquisition unit and has a larger number of colors than the first color information is acquired from the coordinate color arrangement database. It is preferable to do. For example, if the number of colors of the acquired first color information is 1, the second color information of the two color arrangements, the three color arrangements, and the like having the same color as the first color information are coordinated. When the number of colors of the acquired first color information is two colors (two-color combination), the three-color combination and the four-color combination having the same color as the two colors of the first color information ,... Are obtained from the coordinate color arrangement database.

  In the coordination proposal device according to still another aspect of the present invention, the product presentation unit can simultaneously observe the image of the first product received by the product reception unit and the image of the second product searched by the product search unit. It is preferable to include a coordinated image generation unit that generates a coordinated image and present the coordinated image generated by the coordinated image generation unit to the user terminal.

  In the coordination proposing device according to still another aspect of the present invention, when there are a plurality of searched second products, the image alignment for aligning the images of the searched second products according to lightness or saturation Preferably, the product presentation unit presents images of a plurality of second products aligned by the image alignment unit sequentially or two or more simultaneously. When there are a plurality of searched second products, the images of the second products are aligned according to lightness, or are aligned according to the saturation of the image of the second product, and the plurality of aligned second products Presenting images of the products sequentially or two or more at the same time makes it easy for the user to select the second product.

  In the coordination proposal device according to still another aspect of the present invention, when there are a plurality of searched second products, images of the plurality of searched second products are displayed with the size and price of the second product. It is preferable to have an image aligning unit that aligns on a space with coordinate axes, and the product presenting unit presents images of a plurality of second products aligned by the image aligning unit. Thereby, it is possible to search for a desired second product by size and price from the images of the arranged second products.

  In the coordination proposing device according to still another aspect of the present invention, a search is performed when there are a plurality of searched second products and the second product has a plurality of first color information having different numbers of colors. An image alignment unit that aligns images of a plurality of second products for each number of colors, and the product presentation unit presents images of the second products that are aligned for each number of colors aligned by the image alignment unit. It is preferable. Thereby, it is possible to search for a desired second product by specifying the number of colors of the second product (single color, two colors, three colors, etc.).

  The invention according to yet another aspect is a product database in which product information related to a product group to be electronically traded is registered, and is obtained by analyzing a product and an image of the product for each registered product. A plurality of colors obtained by analyzing a product database in which product information including first color information indicating each color is associated and registered, and images of the first product and the second product coordinated in advance This is a coordinate proposal method for proposing coordinated products using a coordinate color arrangement database in which a plurality of second color information having different numbers of colors is registered. And receiving a first product desired to be coordinated from the user terminal, and analyzing an image of the first product based on the received first product. A step of acquiring one color information, and a second color information including the first color information based on the acquired first color information and having a number of colors larger than the number of colors of the first color information Is obtained from the coordinate color arrangement database and third color information indicating a difference between the obtained first color information and the obtained second color information is obtained, and based on the obtained third color information. A step of searching for a second product having the first color information that is the same color information as the third color information from the product database, and the searched second product for the first product received by the user terminal And presenting it to the user terminal as a second product coordinated with each other.

  In the coordination proposal method according to still another aspect of the present invention, the first color information is color information corresponding to a single color or a plurality of colors representing the color of the image of the first product, and is a preset color. Color information indicating each color of a single color or a plurality of colors selected from a basic color palette having a number, and the second color information is a plurality of colors representing the colors of the images of the first product and the second product. It is preferable that the color information corresponds to the color information indicating each color of a plurality of colors selected from the basic color palette.

  In the coordination proposal method according to still another aspect of the present invention, the second color information is registered for each color scheme of a plurality of color schemes having different numbers of colors in the coordination color scheme database, and the second color information is acquired. Preferably, the second color information for each color arrangement that includes the obtained first color information and has a larger number of colors than the first color information is obtained from the coordinated color arrangement database.

  According to the present invention, when receiving the first product for which coordination is desired, the first product and the first product regardless of the number of colors of each product of the second product coordinated with the first product, It is possible to search for and propose a second product whose color is appropriately coordinated with the color of the product.

1 is a conceptual diagram of a client / server system including a coordination proposal device according to the present invention. It is a block diagram which shows the function structural example of a user terminal. It is a figure which shows an example of the input screen of the user identification data displayed on the display part of a user terminal. It is a figure which shows an example of the display part of the user terminal by which a several sensitivity word (search word candidate) is displayed. It is a figure which shows the procedure which produces the color arrangement database for coordination based on this invention. It is the figure used in order to demonstrate the outline | summary of this invention. It is a block diagram which shows the function structural example of embodiment of a coordination proposal apparatus. It is a figure which shows the structural example of a goods database. It is a figure which shows the example of a display mode of the image data of the goods which the goods search part acquired. It is the figure used in order to demonstrate the image analysis part which analyzes the image of goods and acquires the color information which shows each color of a single color or multiple colors as a color feature-value. It is a flowchart which shows an example of the processing content of an image analysis part. It is a figure which shows the structural example of the color scheme database for coordination. It is a flowchart which shows embodiment of the coordination proposal method which concerns on this invention. It is a figure which shows the screen which displays the image of the 1st goods displayed on the display part of a user terminal, and the screen which displays a coordination image.

  Embodiments of a coordination proposal device and method according to the present invention will be described below with reference to the accompanying drawings. In the following embodiment, an example in which “apparel, especially clothes” is a product to be coordinated will be described. However, the present invention is not limited to this, and the present invention can be applied to coordinate other arbitrary products. Is possible.

  FIG. 1 is a conceptual diagram of a client / server system 1 including a coordination proposal device according to the present invention. In the client / server system 1 according to the present embodiment, a coordination proposal device 10, a plurality of general consumer (user) user terminals 11, and a plurality of electronic commerce sites (EC sites) EC0 to ECn are connected to a network such as the Internet. 12 and connected.

  The coordination proposal device 10 corresponds to a server in the client / server system 1, and the user terminal 11 and the EC sites EC0 to ECn correspond to clients in the client / server system 1. The coordination proposal device 10 proposes to the user a coordinated product that is a product obtained by appropriately combining (coordinated) two or more products, or introduces the products handled by the EC sites EC0 to ECn to the user. It functions as an affiliate site that receives rewards for services from the operators of the sites EC0 to ECn.

  The user terminal 11 is a terminal that is operated when the user searches for products such as clothing (including coordinated products), and may take the form of a portable terminal such as a smartphone or a tablet device or a personal computer.

  The EC sites EC0 to ECn provide information relating to the product (for example, product image, brand, inventory, price, size, recommended product, purchase information, etc.) to the coordination proposal device 10 or from the user terminal 11 to the coordination proposal device. 10, a function of providing information related to a product handled by the EC site to a user who has accessed through 10 or a user who has accessed without going through the coordination proposal device 10.

  In the client / server system 1, the functional configuration of the user terminal 11 will be described first.

  FIG. 2 is a block diagram illustrating a functional configuration example of the user terminal 11.

  The user terminal 11 of this example mainly includes an input unit 20, a communication unit 23 (a transmission unit 21 and a reception unit 22), a display control unit 25, a display unit 27, and a system controller 28.

  The input unit 20 selects user identification information (user ID), data such as a password and a search word, an icon displayed on the display unit 27, an operation of the screen of the display unit 27 (tap, swipe, pinch, stretch, etc.) ), And an information specifying unit that specifies data such as a user ID, a password, and a search word input via the operation unit.

  The user ID and password are data for specifying a user who operates the user terminal 11, and hereinafter, either one of the user ID and the password or a combination of both is also referred to as “user identification data”. The “search word” is a term that represents the feature of the product desired by the user, and a product category, a design feature, or a sensitivity word can be used.

  The category of merchandise indicates the category of merchandise (clothing), and includes tops, bottoms, pants, blouse, skirt, T-shirt, dress, and the like. The product design feature amount includes at least a color feature amount among a color feature amount, a pattern feature amount, a shape feature amount, and a texture feature amount. A sensitivity word is a sensory term, and a sensitivity word as a search word represents an impression that a user expects from a search product.

  When the user terminal 11 is a portable terminal such as a smartphone, buttons and a touch panel provided on the user terminal 11 can be used as an operation unit, and the information specifying unit selects the category of the product selected by the operation unit. Identify design features. The user can input data using an arbitrary method via the operation unit, and may input the data directly, or one or more desired ones from a plurality of candidates displayed on the display unit 27. It may be input by selecting the data types.

  FIG. 3 shows an example of an input screen for user identification data displayed on the display unit 27 of the user terminal 11. In this example, a portable terminal whose user operation unit (input unit 20) is a touch panel provided on the display unit 27 is a user terminal 11.

  In order to authenticate that the user is an appropriate user, the user inputs a user ID and a password set for each user to the user terminal 11. In the example shown in FIG. 3, the display unit 27 displays a user ID data input field 27a, a password input field 27b, and a software keyboard 27c. The user ID data input field 27a is a field for the user to input a user ID, and the password input field 27b is a field for the user to input a password. Using the software keyboard 27c, the user inputs the assigned user ID into the user ID data input field 27a and enters the password into the password input field 27b.

  The software keyboard 27c is composed of an arbitrary character palette displayed on the display unit 27 and a touch panel (display unit 27), and the user touches a location corresponding to each character palette displayed on the display unit 27 on the touch panel. Thus, characters corresponding to the touch position are input to the user ID data input field 27a or the password input field 27b. The character palette displayed on the display unit 27 using the software keyboard 27c is not particularly limited, and not only input characters such as hiragana, alphabet, numbers, and symbols, but also the space key, enter key, delete key, and display switching key. The function keys such as can be displayed on the display unit 27 as the software keyboard 27c.

  For example, when the touch panel (display unit 27) at the position corresponding to the user ID data input field 27a is touched by the user, the user terminal 11 shifts to the user ID input mode, and the user uses the software keyboard 27c to change the user ID. Can be entered in the user ID data entry field 27a. Similarly, for example, when the touch panel at a position corresponding to the password input field 27b is touched by the user, the user terminal 11 shifts to the password input mode, and the user inputs the password into the password input field 27b using the software keyboard 27c. can do. When the user touches the position corresponding to the enter key of the software keyboard 27c in a state where the user identification data and the password are input, the authentication process is performed. As a result of the authentication, when the user identification data and the password are appropriate, The display on the display unit 27 shifts to the search processing screen.

  FIG. 4 shows an example of the display unit 27 of the user terminal 11 on which a plurality of sensitivity words (search word candidates) are displayed.

  The input unit 20 (touch panel) of this example functions as a sensitivity word selection unit that receives an instruction from a user and identifies at least one of a plurality of sensitivity words displayed on the display unit 27 in accordance with the instruction. Then, the sensitivity word data indicating the specified sensitivity word is specified as the sensitivity word data input via the input unit 20. More specifically, a plurality of sensitivity words as search word candidates are displayed on the display unit 27 (touch panel), and the user selects a location corresponding to one of the plurality of sensitivity words displayed on the display unit 27. By touching, a sensitivity word corresponding to the touch position is input as a search word.

  The display mode of the plurality of sensitivity words on the display unit 27 is not particularly limited, and the plurality of sensitivity words may be displayed in order on the display unit 27 according to a predetermined rule, or may be displayed randomly. The display of a plurality of sensitivity words on the display unit 27 may be a so-called “tag cloud” display, and the display sizes of the sensitivity words on the display unit 27 may be different from each other. In the example of FIG. 4, the sensitivity word “Pretty” is displayed the largest, followed by the sensitivity words “Casual” and “Gorgeous”, and then “Chic”, “Natural” and “Elegant”. The sensitivity word “formal” is displayed in the smallest size.

  The plurality of sensitivity words displayed on the display unit 27 may be determined in advance or may be changed for each search process. Moreover, the several sensitivity word data displayed on the display part 27 may be memorize | stored previously in the user terminal 11, and the user terminal 11 (display control part 25 (refer FIG. 2)) from the coordination proposal apparatus 10 is used. May be sent. In this case, the display control unit 25 uses a plurality of search word candidates (in the form of a tag cloud) based on the sensitivity word data sent from the coordination proposal device 10 via the communication unit 23 (reception unit 22) for each search process. May be displayed on the display unit 27. The plurality of sensitivity word data sent from the coordination proposal device 10 to the user terminal 11 is not particularly limited. For example, according to the frequency specified as a search word in the search processing in the coordination proposal device 10, user attributes, and the like. May be changed.

  The transmitting unit 21 (see FIG. 2) proposes coordinated data such as user identification data and sensitivity word data (search word) specified by the user via the input unit 20 via the network 12 (see FIG. 1). Transmit to device 10. Further, the receiving unit 22 transmits “image data indicating a product group of search results, images of a plurality of coordinated products (coordinated images)” and “display information” transmitted from the coordination proposal device 10 via the network 12. Receive data such as “data”. The communication unit 23 is configured by the transmission unit 21 and the reception unit 22, and the transmission unit 21 and the reception unit 22 may be configured by the same device.

  The display control unit 25 controls the display unit 27 to control the overall display of the display unit 27. For example, the screen display of the user identification data designation mode on the display unit 27 (see FIG. 3) and the sensitivity word data (search word). The screen display of the designated mode (see FIG. 4) is switched. Further, the display control unit 25 causes the display unit 27 to display the product image data received by the receiving unit 22 according to the display information data received by the receiving unit 22.

  The system controller 28 (see FIG. 2) controls the communication unit 23 (the transmission unit 21 and the reception unit 22), the input unit 20, and the display control unit 25 to cause each unit to execute the above-described processing or other processing. Each part (not shown) of the user terminal 11 is also controlled. For example, in the user authentication process (see FIG. 3), the system controller 28 controls the input unit 20 and the communication unit 23, and user identification data input by the user via the input unit 20 is transmitted via the transmission unit 21 and the network 12. To the coordination proposal device 10. Further, the system controller 28 controls the input unit 20, the receiving unit 22, and the display control unit 25, and as a result of user authentication transmitted from the coordination proposal device 10, search word candidates (multiple sensitivity word data) (see FIG. 4). ), The search result data D5, the display information data D6, etc. are received, whether or not the user authentication is appropriate on the display unit 27, the tag cloud display of the search word (see FIG. 4), and the display of the searched product image 66 (FIG. 9). Etc.).

  As described above, when the user performs a product search by operating the user terminal 11 having the above-described configuration, the search data D2 such as the user identification data D1 (user ID and password) and the design feature amount (including the sensitivity word). Is input using the input unit 20 (touch panel). User identification data D1 and search data D2 that are input and specified by the user via the input unit 20 are transmitted from the input unit 20 to the transmission unit 21 and transmitted to the coordination proposal device 10 via the network 12 by the transmission unit 21. Is done.

  Further, the input unit 20 of the user terminal 11 inputs action information (operation history information) indicating an action such as purchase for any product from the product group displayed as the product image 66 shown in FIG. It functions as an operation unit that inputs action information for a coordinated product displayed as a coordinated image shown in FIG. 14B and transmits (outputs) the input action information to the coordination proposal device 10 via the transmission unit 21.

  Here, as action information (operation history information) for a product, for example, a product purchase operation, an operation of bringing a product into a virtual fitting room, an operation of registering a product in a try-on list, and registration of a product in a virtual microsette ( Holding), registering a product as a favorite, recommending a product, browsing request operation for detailed product information, request for delivery date, request for delivery date confirmation, small (S), medium (M), large (L) , A size selection request such as free, an evaluation indicating a high evaluation such as “Like”, and a mail transfer. The virtual micro closet is a storage area allocated for each user prepared on the coordination proposal device 10 side, and stores information such as products purchased by the user in the past and products that the user has shown interest in. A registered storage area. The virtual fitting room refers to a screen (fitting screen) for virtually trying on a product. When the product is brought into the fitting room, for example, an image of the product is displayed in a specific area in the fitting room, Alternatively, the product image is displayed on the mannequin image in the fitting room.

[Outline of the present invention]
Next, the outline of the present invention will be described with reference to FIGS.

  FIG. 5 is a diagram showing a procedure for creating a coordinate color arrangement database according to the present invention.

  As shown in FIG. 5, an image of a coordinated product previously coordinated by a coordinator of clothing is analyzed to obtain a design feature value (second design feature value). That is, a color feature indicating a representative color of an image of each area obtained by cutting out an area including a color representative of the image of the coordinated product from the image of the coordinated product, smoothing the image of each area with a smoothing filter Get the quantity.

  In this example, each value (hereinafter referred to as “HSV value”) of three attributes (H (hue), S (saturation), and V (brightness)) in the HSV color space is acquired as the color feature amount. Further, since the coordinated products are products of a plurality of categories (tops and bottoms in the example shown in FIG. 5), two or more color feature amounts (HSV values) are acquired.

  Subsequently, corresponding color information is selected from the basic color palette 60 having 130 colors for each acquired color feature amount (HSV value). Here, the 130 colors have 120 chromatic colors and 10 achromatic colors, and the 120 chromatic colors are combinations of 10 hues and 12 tones, and 10 achromatic colors. Consists of 10 tones from white to black. The number of colors and the classification method of the basic color palette are not limited to this embodiment.

  When one color feature amount (HSV value) is measured, one color (color information) of 130 colors in the basic color palette 60 corresponding to the measured color feature amount can be determined.

  Now, when the representative color of the image of the coordinated product is two colors, two colors (two color schemes) on the basic color palette can be specified. Similarly, when the representative color of the image of the coordinated product is three colors, three colors (three color schemes) on the basic color palette can be specified, and the representative color of the coordinated product image is N colors (N : Integer of 4 or more), it is possible to specify N colors (N color scheme) on the basic color palette.

  As described above, images of a number of coordinated products previously coordinated by the coordinator of clothing are analyzed, the color scheme and color information (second color information) of each coordinated product are identified, and the second color information of the identified color scheme is obtained. Each color arrangement (two-color arrangement, three-color arrangement, four-color arrangement,...) Is registered in the coordination color arrangement database (coordination color arrangement DB) 44.

  Now, as shown in FIG. 6, as the first color information, search for bottoms (second product having a different category from the first product) coordinated with “black” tops (first product). In this case, second color information (two-color color scheme, three-color color scheme,...) Having the first color information “black” of the tops is extracted from the coordinate color scheme DB 44. In the example illustrated in FIG. 6, two color schemes of “black and red” are extracted as the color scheme having “black”. Note that the two-color arrangement having “black” is not limited to one of “black and red”, and a plurality of colors may exist.

  When the two color schemes “black and red” are extracted as described above, the top “black” (first color information) and the extracted two colors “black and red” (second color scheme) “Red” (third color information) indicating a difference from the color information) is obtained, and bottoms having this “red” are searched from the product database (product DB) 46. Details of the configuration of the product DB 46 will be described later.

  The searched “red” bottoms (second product) are presented (suggested) to the user via the user terminal 11 as products that match the tops (first product) of this example.

  Here, the two color schemes of “Black, Red” of the coordinated product combining “Black” tops and “Red” bottoms are created based on coordinated products coordinated by the coordinator of clothing and coordinated Coordinated products that are one of the two color schemes registered in the DB 44 and are a combination of “black” tops and “red” bottoms can be said to be appropriately coordinated.

  In the above example, the case where the two-color combination of “black and red” is extracted as the second color information based on the first color information of the single color “black” has been described. It is also possible to extract from the color scheme, the four color scheme, and so on. In this case, the bottoms of the two-color scheme and the three-color scheme are searched. Further, second color information of three or more color schemes can be acquired based on the first color information of the two color schemes.

  The number of colors of the first color information of the image of the first product, the number of colors of the second color information extracted from the coordination color arrangement DB 44 based on the first color information, and the first color information and the first color information Table 1 below shows the relationship with the third color information indicating the difference from the second color information.

[Embodiment of Coordination Proposal Device]
Next, the functional configuration of the coordination proposal device 10 will be described.

  FIG. 7 is a block diagram illustrating a functional configuration example of the embodiment of the coordination proposal device 10.

  The coordination proposal device 10 of the present example includes a portion that functions as a coordination proposal device that proposes coordinated products to the user, and a portion that functions as a product search device that searches for products based on operations on the user terminal 11. . In addition, the coordination proposal device 10 functions as an affiliate site that provides services for introducing the products handled by the EC sites EC0 to ECn (FIG. 1) in the client / server system 1 to the user, or the EC site EC0 to EC0. It has a function of performing electronic commerce with the user terminal 11 on behalf of ECn.

  As shown in FIG. 7, the coordination proposal device 10 mainly includes a communication unit 33 (a transmission unit 31 and a reception unit 32), a product reception unit 34, a coordinated image presentation unit 36, a first color information acquisition unit 40, and a second color. The information acquisition unit 42, the coordinate color arrangement DB 44, the product DB 46, the product search units 48 and 50, and the image alignment unit 52 are configured.

  The receiving unit 32 receives data such as user identification data D1 and search data D2 transmitted from the user terminal 11 via the network 12, and action information such as purchase from the user, and stores the search data D2 as a product search unit. 48, and the user identification data D1 is transmitted to the user ID acquisition unit 54.

  The product search unit 48 searches for the first product that the user desires to coordinate, accesses the product DB 46, and based on the search data D2 received by the receiving unit 32 from the user terminal 11 via the network 12. The product is narrowed down from the product group stored in the product DB 46, and one or more products are searched.

  Here, the product DB 46 will be described with reference to FIG.

  As shown in FIG. 8, the product DB 46 registers and manages product information for each product, and stores product category information, product image data, and product images using a product ID that uniquely identifies the product as a key. Analyzed design feature values (physical measurement values such as color feature values, pattern feature values, shape feature values, and texture feature values), sensitivity words, site information indicating EC sites (stores), brand information, inventory information , Function as a storage unit that stores size (SML, free) information and price information in association with each other. Here, the product ID is unique identification information that uniquely identifies the product for each product, each EC site, and each size. Different EC sites and sizes handled by the same product are assigned different IDs. It shall be. The category information indicates the category of the product (apparel), and includes information such as tops, bottoms, pants, blouse, skirt, T-shirt, and one piece. When the user terminal 11 narrows down the product category to be searched. used.

  The product information registered in the product DB 46 can be collected from the EC site except for the design feature value and the sensitivity word, and the design feature value can be obtained from the image analysis unit 62 (FIG. 10) on the coordination proposal device 10 side. ) Is obtained by analyzing product image data, and is provided as a part of product information.

  In the example shown in FIG. 8, the HSV value and color information corresponding to the HSV value selected from the basic color palette corresponding to the HSV value (first color information) are recorded as the color feature amount. The first color information is information indicating the color numbers (# 1 to # 130) of the 130 basic color palette. Further, when the product image is a single color, a set of HSV values and color information is recorded, and when a product has a plurality of colors, a plurality of sets of HSV values and color information are recorded.

  As the pattern feature amount, for example, a feature amount defined by a pattern density and a pattern size can be considered. The shape feature amount depends on, for example, the overall width (thin-thick), sleeve size (short-long), length size (short-long), neckline width and height, and neckline. A feature amount defined by a cross-sectional area (small-large), a V-neck angle (small-large), a U-neck curvature (small-large), etc. that is defined and passed through the user's head can be considered. . As the texture feature amount, for example, a feature amount defined by glossiness and transparency is conceivable.

  When the design features obtained by analyzing product image data are acquired, the sensitivity terms are converted into the conversion table (for example, sentiment words and designs created based on questionnaire surveys by many designers, etc.) It can be obtained by conversion using a conversion table showing the relationship with the feature quantity.

  The product search unit 48 searches for one or a plurality of products by narrowing down the products from the product group stored in the product DB 46 based on the search data D2 indicating the sensitivity word and the design feature amount, and information on the searched products (Image data or the like) is output to the image alignment unit 52. Needless to say, the product category, EC site, brand, size, price, and the like can also be used as the search data D2.

  The image alignment unit 52 determines the display mode of the image data of the product acquired by the product search unit 48 by the search, and generates display information data indicating the determined display mode. That is, the image alignment unit 52 determines the display mode of the product image data searched by the product search unit 48 as the display of the product image data according to the product characteristic data, and shows the determined display mode. Display information data is generated.

  The display information data generated by the image alignment unit 52 indicates a display mode in which at least a part of the image data of the product searched by the product search unit 48 is displayed on the coordinate system representing the characteristic data of the product. The “characteristic data of the product” here is based on a characteristic different from the search data D2 specified by the user via the user terminal 11 among the characteristics of the product. For example, “product characteristic data” may be determined based on at least one of the product price and the product size.

  FIG. 9 shows a display mode example of the image data of the product searched by the product search unit 48. In FIG. 9A, the horizontal axis indicates the “size (large / small)” of the product, and the vertical axis indicates the “price (price)” of the product. In FIG. 9B, the horizontal axis indicates the “shape (thick / thin)” of the product, and the vertical axis indicates the “price” of the product. In FIG. 9C, the horizontal axis indicates the “tone (dark / light)” of the product image, and the vertical axis indicates the “price” of the product. In FIG. 9D, the horizontal axis indicates “pattern density (dense / sparse)” of the product image, and the vertical axis indicates “tone (dark / light)” of the product. A coordinate system 64 shown in each of FIGS. 9A to 9D shows a plurality of product images 66 (product group) (a total of nine images in FIG. 6 including three in the horizontal direction and three in the vertical direction). Has been.

  As described above, the image alignment unit 52 (see FIG. 7) displays the display mode (FIG. 9A to FIG. 9A) displayed on the coordinate system 64 from the product image data (product image 66) acquired by the product search unit 48 through the search. Display information data indicating (see (d)) is generated.

  The transmission unit 31 transmits the search result (including product image data) acquired by the product search unit 48 and the display information data generated by the image alignment unit 52 to the user terminal 11 via the network 12. The search result and the display information data transmitted by the transmission unit 31 are received by the reception unit 22 (see FIG. 2) of the user terminal 11. Then, the display control unit 25 determines the display mode of the product image data (product image 66) acquired by the search by the product search unit 48 based on the received display information data, and displays the display unit 27 according to the determined display mode. Product image data (product image 66) is displayed (see FIGS. 9A to 9D).

  The input unit 20 of the user terminal 11 inputs action information such as purchase for one of the products from the product group displayed as the product image 66, and the input action information is sent to the coordination proposal device 10 via the transmission unit 21. Send (output) to. Thereby, electronic commerce with an action such as searching for a product by the client / server system 1 including the user terminal 11 and the coordination proposal device 10 and purchasing the searched product is performed.

  The user ID acquisition unit 54 acquires user identification data D1 transmitted from the user terminal 11 via the network 12 and the reception unit 32, registers the acquired user identification data D1 in the user DB 56, or uses the user identification data D1. The user ID of the identified user is acquired from the user DB 56. In addition, when information such as a product purchased by the user in the past in association with the user ID or a product viewed by the user is registered in the user DB 56 or the like, the information is registered in association with the user ID based on the acquired user ID. The product may be read out and the read out product may be sent to the image alignment unit 52. According to this, the product purchased by the user, the viewed product, and the like can be set as a product (first product) that the user desires to coordinate.

  The product reception unit 34 is a part that acquires a product (first product) that the user desires to coordinate based on the operation of the user terminal 11. The first product is one product in the product group registered in the product DB 46, and is based on one product searched by the product search unit 48 based on the search data D2 or a plurality of searched products. This is one item selected by the user. The first product may be a product specified from current or past operation history information indicating interest in the product at the user terminal 11. For example, when the user searches for a desired product using the user terminal 11 and performs an operation of bringing the searched product into a virtual fitting room to be described later, the product brought into the virtual fitting room is displayed. It can be a first product. Moreover, when a user purchases a product in the past from the coordination proposal device 10 or the EC sites EC0 to ECn, the purchased product can be set as the first product. Furthermore, when an image of an EC site recommended product handled by a specific EC site is displayed on the display unit 27 of the user terminal 11, the product recommended by the specific EC site may be the first product. . Further, when the product reception unit 34 logs in to the site (coordination proposal device 10) by the user terminal 11, the product reception unit 34 selects a product specified from the past operation history information of the user having the user ID acquired from the logged-in user terminal 11. It can be automatically set as the first product.

  Information indicating the first product acquired by the product reception unit 34 is output to the coordinated image presentation unit 36 and the first color information acquisition unit 40, respectively.

  When information indicating the first product is input, the first color information acquisition unit 40 analyzes color information (first value) corresponding to the color feature amount (HSV value) obtained by analyzing the image of the first product. Color information) is acquired from the product DB 46. That is, in the product DB 46, a design feature amount obtained by analyzing the image of the first product in advance in association with the product ID (information indicating the first product) is registered (see FIG. 8). The color information acquisition unit 40 acquires corresponding color information (first color information) from the product DB 46 based on the input information indicating the first product.

  The first color information acquisition unit 40 may include the image analysis unit 62 illustrated in FIG. 10, and may acquire the first color information by analyzing an image of a product (first product). In this example, the first color information acquisition unit 40 is color information corresponding to the color feature amount (HSV value) of the image of the first product, and is converted into a single color or a plurality of colors on the basic color palette 60. Corresponding color information (first color information) is acquired.

  Next, a method for acquiring color feature amounts and color information from an image of a product will be described with reference to FIGS.

  FIG. 11 is a flowchart showing an example of processing contents of the image analysis unit 62 shown in FIG.

  In FIG. 11, first, an image of a product is input (step S10). In this case, an entire image of the product may be input, or an appropriate region (a region for each color when there are a plurality of colors) may be cut out and input from the entire image of the product.

  Next, the parameter i indicating the number of colors of the product image is set to 0 (i = 0) (step S12), and then the input image is analyzed (step S14). In this example, the input image is analyzed, and a value (HSV value) indicating H (hue), S (saturation), and V (lightness) in the HSV color space is acquired as a color feature amount of the image.

  The number n of representative colors of the product image is determined from the HSV value indicating the color feature amount of the acquired image (step S16). Here, the representative color refers to a color having a certain area or more that can be sufficiently visually recognized from a distant position. For example, the representative color is not limited to the “base color” having a large area, and the “assorted color” occupying the next largest area. A small area “accent color” may be used as a representative color.

  Subsequently, the HSV value of one representative color of the representative colors determined in step S16 is acquired (step S18).

  Next, the acquired HSV value is converted into color information indicating any one of the 130 colors of the basic color palette 60 using the information of the basic color palette 60 (step S20). As a result, the HSV values representing all the colors are converted into any one of the 130 colors, and the colors are reduced.

  Next, the parameter i indicating the number of colors is incremented by 1 (step S22), and it is determined whether or not the parameter i matches the number of colors n (i = n) (step S24). When the parameter i does not match the number of colors n (in the case of “No”), the process proceeds to step S18, and the processing from step S18 to step S24 is repeated for another representative color.

  On the other hand, when the parameter i matches the number of colors n (“Yes”), the color information converted in step S20 is output as the color information of the input image (step S26).

  That is, as shown in FIG. 10, when an image of a product is input, the image analysis unit 62 analyzes the image as described above, and uses the information of the basic color palette 60 to indicate color information indicating a single color or a plurality of colors. Is output.

  Returning to FIG. 7, the first color information acquired by the first color information acquisition unit 40 is added to the second color information acquisition unit 42 and the product search unit 50, respectively.

  The second color information acquisition unit 42 obtains the second color obtained by analyzing the images of the first product and the second product from the coordination color arrangement DB 44 based on the input first color information. Get information.

  Here, an example of the configuration of the coordinate color arrangement DB 44 is shown in FIG.

  As shown in FIG. 12, in the coordinate color arrangement DB 44 of this example, as described above, images of a large number of coordinated products coordinated in advance by the coordinator of clothing are analyzed, and the color scheme and color information (second Color information) is specified, and the second color information of the specified color arrangement is classified and registered for each of a plurality of color arrangements (two color arrangement, three color arrangement, four color arrangement,...) Having different numbers of colors.

  In the example shown in FIG. 12, (# 7, # 10), (# 32, # 61),... Are registered as the color information of the two color schemes. In FIG. 12, (# + number) indicates the color numbers (# 1 to # 130) of the basic color palette 60 of 130 colors. Further, the color information of each color scheme is for convenience of explanation, and is not necessarily color information of a color scheme suitable as a coordinated color combination (color scheme).

When the number of colors is 130, there are 8385 (= ₁₃₀ C ₂ ) combinations of two color schemes, but there are fewer than 8385 appropriately coordinated color combinations. This is because the 8385 combinations include inappropriate color combinations that are not coordinated by the clothing coordinator.

  A combination of two color schemes of coordinated products (first product and second product) coordinated by a clothing coordinator is registered in the coordinated color scheme DB 44. Similarly, the three color arrangement, the four color arrangement, and so on are registered in the coordination color arrangement DB 44.

  Therefore, the registered color information includes two color schemes, three color schemes, four color schemes, and so on, and a number of combinations of color schemes are registered for each color scheme having a different number of colors. The

  Returning to FIG. 7, the second color information acquisition unit 42 is based on the input first color information (color information corresponding to a single color or a plurality of colors (first color information) on the basic color palette 60). Second color information that includes the first color information and has a larger number of colors than the first color information is acquired from the coordinated color arrangement DB 44.

  For example, when the input first color information indicates the single color “black”, the second color information acquisition unit 42 includes “black” among the two-color arrangement, the three-color arrangement, the four-color arrangement,. Second color information indicating two-color arrangement, three-color arrangement, four-color arrangement,... Is acquired.

  When the input first color information indicates the two-color color scheme “black, red”, the second color information acquisition unit 42 selects the two-color color scheme “black” among the three-color color scheme, the four-color color scheme,. Second color information indicating three color arrangements including “, red”, four color arrangements,...

  The second color information acquired by the second color information acquisition unit 42 is added to the product search unit 50. The first color information is added from the first color information acquisition unit 40 to the other input of the product search unit 50, and the product search unit 50 receives the first color information and the second color information. The second product coordinated with respect to the first product is searched from the product DB 46 based on the above.

  That is, the product search unit 50 has a third difference indicating the difference between the first color information acquired by the first color information acquisition unit 40 and the second color information acquired by the second color information acquisition unit 42. The second product having the first color information that is the same color information as the third color information from the product DB 46 based on the obtained third color information (the category is different from the first product). The second product (combined with the first product) is searched.

  Specifically, the product search unit 50 is acquired by the first color information indicating the single color or the plurality of colors acquired by the first color information acquisition unit 40 and the second color information acquisition unit 42. The third color information obtained by obtaining third color information indicating a difference from the second color information indicating each color of the plurality of colors (the number of colors of the second color information> the number of colors of the first color information). The second product having the same color information as the third color information is searched from the product DB 46 based on the above.

  For example, as described with reference to FIG. 6, the product search unit 50 includes the first color information (black) of the first product (tops) and the second color information (black) acquired from the coordination color arrangement DB 44. , Red). The product search unit 50 obtains third color information (red) indicating a difference between the first color information (black) and the second color information (black, red), and obtains the third color information (red). The second product (bottoms) to be searched is searched. Note that the product search unit 50 normally searches for a plurality of second products, and searches for more second products as the number of colors in the first color information is smaller.

  The product search unit 50 outputs information (image data or the like) of the searched second product to the coordinated image presentation unit 36 and the image alignment unit 52, respectively.

  The coordinated image presentation unit 36, based on the information on the first product received by the product reception unit 34 and the information on the second product searched by the product search unit 50, the second product image and the second product. Are output so that they can be simultaneously observed on the user terminal 11. At this time, for example, when the first product is tops and the second product is bottoms, the coordinated image presentation unit 36 adjusts the image size, position, orientation, and the like of the tops image and the bottoms image, A coordinate image generation unit that generates a coordinate image in which the image of the bottom and the bottoms are continuous, and may output image data of the generated coordinate image, or the image of the first product and the image of the second product May be output as individual images indicating coordinated products.

  When a plurality of second products are searched by the product search unit 50, the coordinated image presentation unit 36 outputs a plurality of coordinated images sequentially or two or more simultaneously.

  The image aligning unit 52 can also function as a product presentation unit that presents an image of the second product instead of the coordinated image presentation unit 36. In other words, when a plurality of second products are searched by the product search unit 50, the image alignment unit 52 aligns the images of the plurality of second products according to lightness or saturation, and aligns the images. The images of the second product are presented sequentially or two or more simultaneously. Note that the color feature value (HSV value) registered in the product DB 46 can be used as the brightness or saturation of the image of the second product.

  The image aligning unit 52 aligns the searched images of the plurality of second products on a space having the size and price of the second product as coordinate axes (see FIG. 9A). A plurality of images of the second product can be presented. As the size and price (price) of the second product, the size and price registered in the product DB 46 can be used.

  Further, the image aligning unit 52 classifies the plurality of second products searched for into products having different numbers of colors (products having a single color, two colors, three colors, etc.), and second classified products having different numbers of colors. You may make it show the image of 2nd goods sequentially or 2 or more simultaneously for every goods.

  The image data of the coordinated image output from the coordinated image presentation unit 36 is transmitted via the transmission unit 31 to the user terminal 11 of the user who has designated the product (first product) desired to be coordinated. Thereby, a coordinate image can be displayed on the display unit 27 of the user terminal 11.

  While viewing the coordinated image displayed on the display unit 27 of the user terminal 11, the user inputs action information such as purchase of coordinated products through the input unit 20, and the input action information is transmitted via the transmission unit 21 to the coordinate proposal device. 10 to send.

[Coordination proposal method]
Next, an embodiment of a coordination proposing method according to the present invention will be described with reference to FIGS.

  In FIG. 13, the coordination proposal device 10 (the product search unit 48, the image alignment unit 52, etc.) displays product images on the display unit 27 of the user terminal 11 in response to a product search request from the user terminal 11 ( Step S50).

  The user selects one or a plurality of products (first products) by operating the input unit 20 of the user terminal 11 and inputting action information such as purchase on the product image displayed on the display unit 27. can do.

  Subsequently, the coordination proposal device 10 determines whether or not the selection of the first product by the user terminal 11 has been completed (step S52). For example, the coordination proposal device 10 uses the input unit 20 of the user terminal 11 to put the first product (one product selected by touching or the like when a plurality of products are selected) into a virtual fitting room. When an operation to bring in is performed, it can be determined that the selection of the first product has been completed.

  Specifically, as shown in FIG. 14A, by touching the image of the first product displayed on the display unit 27 of the user terminal 11 and swiping right as shown in FIG. The first product can be brought into the virtual fitting room, and the screen changes from the screen displaying only the image of the first product shown in FIG. 14B to the virtual fitting room screen (fitting screen). Can be made. Also, select the image of the first product you want to try on from the products held in the microsette, display the image details in a pop-up, and change to the try-on screen by pressing the try-on button (icon button not shown) after selecting the category. be able to. It is possible to return to the pre-transition screen by swiping left on the fitting screen.

  Next, the first color information acquisition unit 40 acquires the first color information of the image of the first product from the product DB 46 based on the product ID of the first product (step S54).

  Subsequently, the second color information acquisition unit 42 acquires the corresponding second color information from the coordination color arrangement DB 44 based on the first color information of the acquired image of the first product (step S56). ). That is, the second color information including the acquired first color information and having a number of colors larger than the number of colors of the first color information is acquired from the coordinated color arrangement DB 44.

  Next, the product search unit 50 searches the product DB 46 for the second product coordinated with the first product based on the acquired first color information and second color information (step S58). . That is, the third color information indicating the difference between the first color information and the second color information is obtained, and the same color information as the third color information is obtained from the product DB 46 based on the obtained third color information. Search for a second product.

  The coordinated image presentation unit 36, based on the information on the first product received by the product reception unit 34 and the information on the second product searched by the product search unit 50, the second product image and the second product. The product image is output to the user terminal 11 so that it can be simultaneously observed on the user terminal 11 (step S60). In this example, as shown in FIG. 14B, a coordinated image in which the image size, position, and orientation of the first image (tops image) and the second image (bottoms image) are adjusted is output. However, the first image (tops image) and the second image (pants image) are simply output separately, and the first image (tops image) and the second image are output by the application on the user terminal 11 side. The image size, position and orientation with (pants image) may be automatically adjusted and displayed, or the user terminal 11 may be operated to manually adjust the image size, position and orientation for display. .

  The image data of the coordinated image output from the coordinated image presentation unit 36 is transmitted via the transmission unit 31 to the user terminal 11 of the user who has designated a product (first product) for which automatic coordination is desired. Thereby, a coordinate image can be displayed (presented) on the display unit 27 of the user terminal 11 (step S62).

  The coordination proposal device 10 determines whether or not a coordinated image presentation end operation has been performed during the presentation of the coordinated image (step S64), and if the termination operation has been performed, the process ends. For example, on the try-on screen shown in FIG. 14B, a left swipe operation is performed and the screen transitions to the screen shown in FIG. 14A, or there is an action such as purchasing a coordinated second product. In this case, the process ends.

  In the present embodiment, the first product and the second product (coordinated products) coordinated in advance are coordinated by a specialized coordinator. However, the present invention is not limited to this, and general users can purchase products in the product DB. You may use what has been coordinated by using or that has been coordinated and purchased.

  Moreover, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Client server system, 10 ... Coordination proposal apparatus, 11 ... User terminal, 12 ... Network, 20 ... Input part, 23, 33 ... Communication part, 25 ... Display control part, 27 ... Display part, 28 ... System controller, 34 ... Product reception unit, 36 ... Coordinated image presentation unit, 40 ... First color information acquisition unit, 42 ... Second color information acquisition unit, 44 ... Coordination color arrangement database, 46 ... Product database, 48, 50 ... Product Retrieval part 52 ... Image alignment part 60 ... Basic color palette 62 ... Image analysis part

Claims (10)

1st color information which shows each color of the single color or multiple colors obtained by analyzing the product and the image of the product for each registered product. A product database registered in association with product information including
A product accepting unit that accepts a first product desired to be coordinated from the user terminal;
A first color information acquisition unit that acquires the first color information obtained by analyzing an image of the first product based on the first product received by the product reception unit;
Second color information indicating a plurality of colors obtained by analyzing the images of the first product and the second product coordinated in advance, and a plurality of second color information having different numbers of colors Coordination color scheme database with registered,
A second color that includes the first color information based on the first color information acquired by the first color information acquisition unit and has a larger number of colors than the number of colors of the first color information; A second color information acquisition unit for acquiring color information from the coordination color arrangement database;
Determining third color information indicating a difference between the first color information acquired by the first color information acquisition unit and the second color information acquired by the second color information acquisition unit; A product search unit for searching for a second product having the first color information which is the same color information as the third color information from the product database based on the third color information;
A product presentation unit for presenting the second product searched by the product search unit to the user terminal as a second product coordinated with the first product received by the user terminal;
Coordination proposal device with The first color information is color information corresponding to a single color or a plurality of colors representing the color of the image of the first product, and the single color selected from a basic color palette having a preset number of colors or Color information indicating each color of a plurality of colors,
The second color information is color information corresponding to a plurality of colors representing the colors of the images of the first product and the second product, and a plurality of colors selected from the basic color palette. The coordinate suggestion device according to claim 1, wherein the information is color information indicating each color. In the coordination color arrangement database, the second color information is registered for each of a plurality of color arrangements having different numbers of colors,
The second color information acquisition unit includes the first color information acquired by the first color information acquisition unit, and has a larger number of colors than the number of colors of the first color information. The coordination proposal device according to claim 1, wherein the second color information is acquired from the coordination color arrangement database.   The product presentation unit generates a coordinated image for generating a coordinated image capable of simultaneously observing the image of the first product received by the product reception unit and the image of the second product searched by the product search unit. The coordination proposal apparatus according to any one of claims 1 to 3, wherein the coordinated image generated by the coordinated image generation unit is presented to the user terminal. When there are a plurality of searched second products, an image alignment unit that aligns images of the searched second products according to lightness or saturation,
The coordinate proposal device according to any one of claims 1 to 4, wherein the product presentation unit presents images of a plurality of second products aligned by the image alignment unit sequentially or two or more simultaneously. An image aligning unit that aligns images of the plurality of second products searched for on a space having the size and price of the second products as coordinate axes when there are a plurality of the second products searched; Have
The coordinate suggestion device according to any one of claims 1 to 4, wherein the product presentation unit presents images of a plurality of second products arranged by the image alignment unit. When there are a plurality of searched second products and the second product has a plurality of first color information having different colors, images of the searched second products are displayed for each number of colors. Having an image alignment section to align with
The coordinate proposal device according to any one of claims 1 to 4, wherein the product presentation unit presents images of second products arranged for each of the number of colors arranged by the image alignment unit. 1st color information which shows each color of the single color or multiple colors obtained by analyzing the product and the image of the product for each registered product. A product database that is registered in association with product information including the second color indicating a plurality of colors obtained by analyzing images of the first product and the second product coordinated in advance A coordinate proposal method for proposing a coordinated product using a coordinate color arrangement database in which a plurality of second color information with different numbers of colors is registered,
Receiving a first product for which coordination is desired from the user terminal;
Obtaining the first color information obtained by analyzing an image of the first product based on the received first product;
Based on the acquired first color information, second color information including the first color information and having a number of colors larger than the number of colors of the first color information is used as the color arrangement for coordination. Retrieving from the database;
Third color information indicating a difference between the acquired first color information and the acquired second color information is obtained, and the third color information is obtained from the product database based on the obtained third color information. Searching for a second product having the first color information which is the same color information as the color information;
Presenting the searched second product to the user terminal as a second product coordinated with respect to the first product received by the user terminal;
Coordination proposal method including The first color information is color information corresponding to a single color or a plurality of colors representing the color of the image of the first product, and the single color selected from a basic color palette having a preset number of colors or Color information indicating each color of a plurality of colors,
The second color information is color information corresponding to a plurality of colors representing the colors of the images of the first product and the second product, and a plurality of colors selected from the basic color palette. The coordinate proposal method according to claim 8, wherein the coordinate information is color information indicating each color. In the coordination color arrangement database, the second color information is registered for each of a plurality of color arrangements having different numbers of colors,
The step of acquiring the second color information includes second color information for each color arrangement that includes the acquired first color information and has a larger number of colors than the number of colors of the first color information. The coordination proposal method according to claim 8, wherein the coordinate is acquired from the coordination color arrangement database.