JP6195550B2 - Coordinate suggestion apparatus and method - Google Patents

Description

  The present invention relates to a coordination proposal apparatus and method, and in particular, coordinates that proposes to a user a coordinated product that is a product obtained by appropriately combining (coordinated) two or more products included in a product group to be electronic commerce (EC). The present invention relates to a proposed apparatus and method.

  When purchasing products such as clothing items on the Internet electronic commerce site (EC site), combine (coordinate) and coordinate products (hereinafter referred to as “coordinated products”) so that two or more types of products are in harmony. There is a case where a plurality of commodities to be configured or one of the plurality of commodities (a merchandise that he does not have) is selected to purchase the merchandise.

  However, there is a problem that it is troublesome for a user to search for a coordinated product suitable for him / her on the EC site.

  Conventionally, in order to solve the above problem, a coordinate recommendation device that recommends an appropriate coordinate has been proposed (Patent Document 1).

  The coordinate recommendation device described in Patent Literature 1 extracts a whole body photo composed of a combination of a plurality of types of items from a magazine photo set which is an image set, specifies a region of each item for each whole body photo, and A full body photo feature extraction unit that extracts feature values and stores them as a full body photo feature set of magazines, and extracts full body photos from an owned photo set, which is an image set, and identifies various item areas for each full body photo. A feature amount extraction unit for each region, a feature amount for an image composed of one kind of item in the owned photo set, and an extracted feature amount stored as an owned photo feature set; Learning the relationship between the areas of each item using the magazine whole body photo feature set and the possession photo feature set, and another type suitable for combination with the input item And a recommendation section for presenting the items.

  Specifically, the coordinate recommendation device extracts a magazine photo (a photo that serves as a reference for coordination) similar to one type of item (for example, upper garment) in the owned photo set, and below the extracted photo Present clothes owned by users similar to clothes.

  Extraction of a magazine photo similar to an upper garment means that a magazine photo including the upper garment having the same feature amount as the feature amount (color, texture, shape, etc.) of the upper garment is extracted from the magazine photo set.

JP 2012-14544 A

  The coordinate recommendation device described in Patent Literature 1 is a reference photo set (magazine photo set) that serves as a reference for model coordinates, and a magazine photo similar to one kind of item (eg, upper garment) in the owned photo set. Then, an item similar to an item of another type (for example, a lower garment) of the extracted photograph is retrieved from the recommended photo set and presented to the user as a recommended item.

  Therefore, another type of item that is coordinated with one type of item in the owned photo set (the item to be searched) depends on the coordinates in the reference photo set, and an item that suits the user's preference is always recommended. Not necessarily. For example, with respect to a casual upper garment, not only a casual garment, but also an elegant garment, a natural garment, a classic garment, or the like may be recommended. This is to use a reference photo set that is a reference for coordination. Moreover, what coordinated a casual upper garment and a casual garment does not necessarily have a casual overall impression.

  The present invention has been made in view of such circumstances, and it is an object of the present invention to provide a coordination proposal apparatus and method that can automatically perform coordination that suits the user's preference and propose it to the user.

  In order to achieve the above object, a coordination suggestion device according to an aspect of the present invention is a product database in which product information about a product group to be electronically commerce is registered, and the product and product images for each registered product. A product database registered in association with product information including the first design feature value obtained by analyzing the product, a product reception unit that receives a first product desired to be coordinated from the user terminal, and a product reception unit A first design feature amount acquisition unit that acquires a first design feature amount obtained by analyzing an image of the first product based on the received first product, and a first product received by the product reception unit A sensitivity word acquisition unit for acquiring a sensitivity word representing the characteristics of the image of the image, and a first obtained by analyzing each image of the first product and the second product coordinated in advance Coordinate database in which the design feature amount of the coordinated information and the sensitivity word representing the characteristics of the entire image of the coordinated first product and second product are associated with each other, and the sensitivity acquired by the sensitivity word acquisition unit A second design feature amount registered in association with the sensitivity word from the database for coordination based on the word, including the first design feature amount acquired by the first design feature amount acquisition unit, and the first design feature amount A second design feature quantity acquisition unit that acquires a second design feature quantity that has more design feature quantities than the design feature quantity from the coordination database, and a first design feature quantity acquisition unit that acquires the first design feature quantity acquisition unit. The third design feature indicating the difference between the design feature value of the second design feature value acquired by the second design feature value acquisition unit A product search unit for obtaining a quantity and searching for a second product having a first design feature quantity that is the same design feature quantity as the third design feature quantity from the product database based on the obtained third design feature quantity; A product presenting unit that presents the second product retrieved by the product retrieval unit to the user terminal as a second product coordinated with the first product received by the user terminal.

  According to one aspect of the present invention, when the first product desired to be coordinated is received from the user terminal, the first design feature amount obtained by analyzing the image of the first product, and the first product A sensitivity word representing the feature of the image is acquired. Based on the acquired first design feature quantity and the sensitivity word, from the database for coordination, the same sensitivity word as the first product is included, the first design feature quantity is included, and from the first design feature quantity A second design feature amount having a large number of design feature amounts is acquired. Then, a second product having the same design feature quantity as the third design feature quantity is obtained from the product database based on the third design feature quantity indicating a difference between the first design feature quantity and the second design feature quantity. Search and present the searched second product on the user terminal. The sensitivity word that represents the characteristics of the image of the entire product of the first product and the proposed second product represents the same sensitivity word that represents the characteristics of the image of the first product alone. It is possible to propose a coordinated product having an impression similar to the impression received from the first product.

  In the coordination proposal device according to another aspect of the present invention, the product information registered in the product database includes a sensitivity word that represents the feature of the image of the registered product, and the sensitivity word acquisition unit has received the product reception unit. A sensitivity word corresponding to the first product can be acquired from the product database based on the first product.

  The coordination suggestion device according to still another aspect of the present invention includes a sensitivity word conversion table that stores the first design feature value and the sensitivity word in association with each other, and the sensitivity word acquisition unit receives the first received by the product reception unit. The sensitivity word corresponding to the first design feature value can be acquired from the sensitivity word conversion table based on the first design feature value obtained by analyzing the image of the product.

  In the coordination proposing device according to still another aspect of the present invention, the first design feature value is a first color feature value of an image of the first product, and the second design feature value is the first product. It is preferable that the second color feature amount of each image of the second product. As the color feature amount, for example, three attributes (H (hue), S (saturation), and V (brightness)) of the representative color in the product image in the HSV color space are defined by the International Electrotechnical Commission (IEC). The RGB values in the RGB color system, the tristimulus values (X, Y, Z) in the CIE XYZ color system adopted by the International Commission on Illumination (CIE), etc. are conceivable.

  In the coordination proposal device according to still another aspect of the present invention, the first color feature amount is first color information corresponding to a single color or a plurality of colors representing the color of the image of the first product, It is first color information indicating each color of a single color or a plurality of colors selected from a basic color palette having a set number of colors, and the second color feature amount is a value of each of the first product and the second product. The second color information corresponding to a plurality of colors representing the colors of the image is preferably second color information indicating each color of the plurality of colors selected from the basic color palette.

  Originally, even if the color of one product itself is a single color, the color feature amount (physical measurement value) obtained by analyzing the image can be recognized as multiple colors, but it is a color that represents the color of the product image. By doing so, it is possible to match the number of original colors of the product, and color information corresponding to the representative color can be appropriately reduced by selecting from the basic color palette, eliminating the overlap of approximate colors can do.

  In the coordination proposing device according to still another aspect of the present invention, a sensitivity word and second color information are associated and registered in the coordination database for each number of colors of a plurality of colors, and a second design feature amount is acquired. The unit acquires the second color information including the first color information acquired by the first design feature amount acquisition unit and having a larger number of colors than the first color information from the coordination database. That is, in the coordination database, the sensitivity word and the second color information are registered in association with each number of colors such as the two-color arrangement, the three-color arrangement, and the like, which is acquired by the first design feature amount acquisition unit. When the number of colors in one color information is a single color, the second color information is acquired from a color scheme such as a two-color scheme or a three-color scheme having a larger number of colors than the single color, and the number of colors in the first color information is In the case of a two-color color scheme, second color information is acquired from a color scheme such as a three-color color scheme having a larger number of colors than two colors.

  In the coordination proposal device according to still another aspect of the present invention, the product search unit includes the first color information acquired by the first design feature amount acquisition unit and the second color acquired by the second design feature amount acquisition unit. It is preferable that third color information indicating a difference from the color information is obtained, and a second product having the same color information as the third color information is searched from the product database based on the obtained third color information.

  For example, when the first color information is a single color and the second color information is a three-color arrangement, the third color information indicating the difference between the first color information and the second color information is a two-color arrangement. become. And the 2nd goods which have the color information of this 2 color scheme are searched.

  In the coordination proposal device according to still another aspect of the present invention, the product presentation unit can simultaneously observe the image of the first product received by the product reception unit and the image of the second product searched by the product search unit. It is preferable to include a coordinated image generation unit that generates a coordinated image and present the coordinated image generated by the coordinated image generation unit to the user terminal.

  In the coordination proposal device according to still another aspect of the present invention, the first design feature value registered in the product database includes the first color feature value, the first pattern feature value, and the first pattern feature value of the image of the first product. It is preferable that two or more feature amounts including at least the first color feature amount among the one shape feature amount and the first texture feature amount. By using feature quantities other than the first color feature quantity, it is possible to appropriately narrow down the second products when there are many second products.

  In the coordination proposing device according to still another aspect of the present invention, when there are a plurality of searched second products, the image alignment for aligning the images of the searched second products according to lightness or saturation Preferably, the product presentation unit presents images of a plurality of second products aligned by the image alignment unit sequentially or two or more simultaneously. When there are a plurality of searched second products, the images of the second products are aligned according to lightness, or are aligned according to the saturation of the image of the second product, and the plurality of aligned second products Presenting images of the products sequentially or two or more at the same time makes it easy for the user to select the second product.

  In the coordination proposal device according to still another aspect of the present invention, when there are a plurality of searched second products, images of the plurality of searched second products are displayed with the size and price of the second product. It is preferable to have an image aligning unit that aligns on a space with coordinate axes, and the product presenting unit presents images of a plurality of second products aligned by the image aligning unit. Thereby, it is possible to search for a desired second product by size and price from the images of the arranged second products.

  The invention according to yet another aspect is a product database in which product information related to a product group to be electronically traded is registered, and is a first design feature obtained by analyzing products and product images for each registered product. A product database registered in association with product information including quantity, a second design feature value obtained by analyzing each image of the first product and the second product coordinated in advance, and coordination A coordinate proposal method for proposing a coordinated product using a coordinate database registered in association with a sensitivity word representing the characteristics of the entire image of the first product and the second product. And receiving a first product desired to be coordinated from the user terminal and the first product based on the received first product. A step of acquiring a first design feature obtained by analyzing the image, a step of acquiring a sensitivity word representing the feature of the image of the received first product, and a database for coordination based on the acquired sensitivity word A second design feature value registered in association with the sensitivity word, the second design feature value including the acquired first design feature value and having a larger design feature value than the first design feature value Obtaining a feature quantity from the database for coordination and obtaining a third design feature quantity indicating a difference between the obtained first design feature quantity and the obtained second design feature quantity, and obtaining the third design Based on the feature quantity, a second product having the first design feature quantity that is the same design feature quantity as the third design feature quantity is searched from the product database. Comprising the steps, the second item retrieved, and presenting to the user terminal as a second product which is coordinated to the first item accepted by the user terminal.

  In the coordination suggestion method according to still another aspect of the present invention, the first design feature amount is a first color feature amount of an image of the first product, and the second design feature amount is the first product. It is preferable that the second color feature amount of each image of the second product.

  In the coordination proposal method according to still another aspect of the present invention, the first color feature amount is first color information corresponding to a single color or a plurality of colors representing the color of the image of the first product, It is first color information indicating each color of a single color or a plurality of colors selected from a basic color palette having a set number of colors, and the second color feature amount is a value of each of the first product and the second product. The second color information corresponding to a plurality of colors representing the colors of the image is preferably second color information indicating each color of the plurality of colors selected from the basic color palette.

  In the coordination suggestion method according to still another aspect of the present invention, a sensitivity word and second color information are associated and registered in the coordination database for each number of colors of a plurality of colors, and the second design feature amount is stored. In the obtaining step, second color information including the obtained first color information and having a larger number of colors than the first color information is obtained from the coordination database.

  In the coordination proposal method according to still another aspect of the present invention, the step of searching for a product obtains and obtains third color information indicating a difference between the acquired first color information and the acquired second color information. It is preferable to search for a second product having the same color information as the third color information from the product database based on the third color information.

  According to the present invention, the first product desired to be coordinated, the coordinated first product and the second product, the first based on the first product via the design feature value and the sensitivity word. The second product coordinated with the product of the product is searched and presented to the user, so the sensitivity word representing the image characteristics of the first product, the coordinated first product and the second product Sensitivity words representing the characteristics of the entire image can be matched with each other, and appropriate coordination that suits the user's preference can be proposed to the user.

1 is a conceptual diagram of a client / server system including a coordination proposal device according to the present invention. It is a block diagram which shows the function structural example of a user terminal. It is a figure which shows an example of the input screen of the user identification data displayed on the display part of a user terminal. It is a figure which shows an example of the display part of the user terminal by which a several sensitivity word (search word candidate) is displayed. It is a figure which shows the procedure which produces the color arrangement database for coordination based on this invention. It is a figure which shows the language image scale which shows the sensitivity word arrange | positioned in the sensitivity space. It is a figure which shows the monochrome image scale of the monochrome (130 colors) arrange | positioned in the sensitivity space. It is a figure which shows the image scale of the 3 color scheme arrange | positioned in the sensitivity space. It is the figure used in order to demonstrate the outline | summary of this invention. It is a block diagram which shows the function structural example of embodiment of a coordination proposal apparatus. It is a figure which shows the structural example of a goods database. It is a figure which shows the example of a display mode of the image data of the goods which the goods search part acquired. It is the figure used in order to demonstrate the image analysis part which analyzes the image of goods and acquires the color information which shows each color of a single color or multiple colors as a color feature-value. It is a flowchart which shows an example of the processing content of an image analysis part. It is a figure which shows the structural example of the database for coordination. It is a flowchart which shows embodiment of the coordination proposal method which concerns on this invention. It is a figure which shows the screen which displays the image of the 1st goods displayed on the display part of a user terminal, and the screen which displays a coordination image.

  Embodiments of a coordination proposal device and method according to the present invention will be described below with reference to the accompanying drawings. In the following embodiment, an example in which “apparel, especially clothes” is a product to be coordinated will be described. However, the present invention is not limited to this, and the present invention can be applied to coordinate other arbitrary products. Is possible.

  FIG. 1 is a conceptual diagram of a client / server system 1 including a coordination proposal device according to the present invention. In the client / server system 1 according to the present embodiment, a coordination proposal device 10, a plurality of general consumer (user) user terminals 11, and a plurality of electronic commerce sites (EC sites) EC0 to ECn are connected to a network such as the Internet. 12 and connected.

  The coordination proposal device 10 corresponds to a server in the client / server system 1, and the user terminal 11 and the EC sites EC0 to ECn correspond to clients in the client / server system 1. The coordination proposal device 10 proposes to the user a coordinated product that is a product obtained by appropriately combining (coordinated) two or more products, or introduces the products handled by the EC sites EC0 to ECn to the user. It functions as an affiliate site that receives rewards for services from the operators of the sites EC0 to ECn.

  The user terminal 11 is a terminal that is operated when the user searches for products such as clothing (including coordinated products), and may take the form of a portable terminal such as a smartphone or a tablet device or a personal computer.

  The EC sites EC0 to ECn provide information relating to the product (for example, product image, brand, inventory, price, size, recommended product, purchase information, etc.) to the coordination proposal device 10 or from the user terminal 11 to the coordination proposal device. 10, a function of providing information related to a product handled by the EC site to a user who has accessed through 10 or a user who has accessed without going through the coordination proposal device 10.

  In the client / server system 1, the functional configuration of the user terminal 11 will be described first.

  FIG. 2 is a block diagram illustrating a functional configuration example of the user terminal 11.

  The user terminal 11 of this example mainly includes an input unit 20, a communication unit 23 (a transmission unit 21 and a reception unit 22), a display control unit 25, a display unit 27, and a system controller 28.

  The input unit 20 selects user identification information (user ID), data such as a password and a search word, an icon displayed on the display unit 27, an operation of the screen of the display unit 27 (tap, swipe, pinch, stretch, etc.) ), And an information specifying unit that specifies data such as a user ID, a password, and a search word input via the operation unit.

  The user ID and password are data for specifying a user who operates the user terminal 11, and hereinafter, either one of the user ID and the password or a combination of both is also referred to as “user identification data”. The “search word” is a term that represents the feature of the product desired by the user, and a product category, a design feature, or a sensitivity word can be used.

  The category of merchandise indicates the category of merchandise (clothing), and includes tops, bottoms, pants, blouse, skirt, T-shirt, dress, and the like. The product design feature amount includes at least a color feature amount among a color feature amount, a pattern feature amount, a shape feature amount, and a texture feature amount. A sensitivity word is a sensory term, and a sensitivity word as a search word represents an impression that a user expects from a search product. Details of the design feature amount and the sensitivity word will be described later.

  When the user terminal 11 is a portable terminal such as a smartphone, buttons and a touch panel provided on the user terminal 11 can be used as an operation unit, and the information specifying unit selects the category of the product selected by the operation unit. Identify design features. The user can input data using an arbitrary method via the operation unit, and may input the data directly, or one or more desired ones from a plurality of candidates displayed on the display unit 27. It may be input by selecting the data types.

  FIG. 3 shows an example of an input screen for user identification data displayed on the display unit 27 of the user terminal 11. In this example, a portable terminal whose user operation unit (input unit 20) is a touch panel provided on the display unit 27 is a user terminal 11.

  In order to authenticate that the user is an appropriate user, the user inputs a user ID and a password set for each user to the user terminal 11. In the example shown in FIG. 3, the display unit 27 displays a user ID data input field 27a, a password input field 27b, and a software keyboard 27c. The user ID data input field 27a is a field for the user to input a user ID, and the password input field 27b is a field for the user to input a password. Using the software keyboard 27c, the user inputs the assigned user ID into the user ID data input field 27a and enters the password into the password input field 27b.

  The software keyboard 27c is composed of an arbitrary character palette displayed on the display unit 27 and a touch panel (display unit 27), and the user touches a location corresponding to each character palette displayed on the display unit 27 on the touch panel. Thus, characters corresponding to the touch position are input to the user ID data input field 27a or the password input field 27b. The character palette displayed on the display unit 27 using the software keyboard 27c is not particularly limited, and not only input characters such as hiragana, alphabet, numbers, and symbols, but also the space key, enter key, delete key, and display switching key. The function keys such as can be displayed on the display unit 27 as the software keyboard 27c.

  For example, when the touch panel (display unit 27) at the position corresponding to the user ID data input field 27a is touched by the user, the user terminal 11 shifts to the user ID input mode, and the user uses the software keyboard 27c to change the user ID. Can be entered in the user ID data entry field 27a. Similarly, for example, when the touch panel at a position corresponding to the password input field 27b is touched by the user, the user terminal 11 shifts to the password input mode, and the user inputs the password into the password input field 27b using the software keyboard 27c. can do. When the user touches the position corresponding to the enter key of the software keyboard 27c in a state where the user identification data and the password are input, the authentication process is performed. As a result of the authentication, when the user identification data and the password are appropriate, The display on the display unit 27 shifts to the search processing screen.

  FIG. 4 shows an example of the display unit 27 of the user terminal 11 on which a plurality of sensitivity words (search word candidates) are displayed.

  The input unit 20 (touch panel) of this example functions as a sensitivity word selection unit that receives an instruction from a user and identifies at least one of a plurality of sensitivity words displayed on the display unit 27 in accordance with the instruction. Then, the sensitivity word data indicating the specified sensitivity word is specified as the sensitivity word data input via the input unit 20. More specifically, a plurality of sensitivity words as search word candidates are displayed on the display unit 27 (touch panel), and the user selects a location corresponding to one of the plurality of sensitivity words displayed on the display unit 27. By touching, a sensitivity word corresponding to the touch position is input as a search word.

  The display mode of the plurality of sensitivity words on the display unit 27 is not particularly limited, and the plurality of sensitivity words may be displayed in order on the display unit 27 according to a predetermined rule, or may be displayed randomly. The display of a plurality of sensitivity words on the display unit 27 may be a so-called “tag cloud” display, and the display sizes of the sensitivity words on the display unit 27 may be different from each other. In the example of FIG. 4, the sensitivity word “Pretty” is displayed the largest, followed by the sensitivity words “Casual” and “Gorgeous”, and then “Chic”, “Natural” and “Elegant”. The sensitivity word “formal” is displayed in the smallest size.

  The plurality of sensitivity words displayed on the display unit 27 may be determined in advance or may be changed for each search process. Moreover, the several sensitivity word data displayed on the display part 27 may be memorize | stored previously in the user terminal 11, and the user terminal 11 (display control part 25 (refer FIG. 2)) from the coordination proposal apparatus 10 is used. May be sent. In this case, the display control unit 25 uses a plurality of search word candidates (in the form of a tag cloud) based on the sensitivity word data sent from the coordination proposal device 10 via the communication unit 23 (reception unit 22) for each search process. May be displayed on the display unit 27. The plurality of sensitivity word data sent from the coordination proposal device 10 to the user terminal 11 is not particularly limited. For example, according to the frequency specified as a search word in the search processing in the coordination proposal device 10, user attributes, and the like. May be changed.

  The transmitting unit 21 (see FIG. 2) proposes coordinated data such as user identification data and sensitivity word data (search word) specified by the user via the input unit 20 via the network 12 (see FIG. 1). Transmit to device 10. Further, the receiving unit 22 transmits “image data indicating a product group of search results, images of a plurality of coordinated products (coordinated images)” and “display information” transmitted from the coordination proposal device 10 via the network 12. Receive data such as “data”. The communication unit 23 is configured by the transmission unit 21 and the reception unit 22, and the transmission unit 21 and the reception unit 22 may be configured by the same device.

  The display control unit 25 controls the display unit 27 to control the overall display of the display unit 27. For example, the screen display of the user identification data designation mode on the display unit 27 (see FIG. 3) and the sensitivity word data (search word). The screen display of the designated mode (see FIG. 4) is switched. Further, the display control unit 25 causes the display unit 27 to display the product image data received by the receiving unit 22 according to the display information data received by the receiving unit 22.

  The system controller 28 (see FIG. 2) controls the communication unit 23 (the transmission unit 21 and the reception unit 22), the input unit 20, and the display control unit 25 to cause each unit to execute the above-described processing or other processing. Each part (not shown) of the user terminal 11 is also controlled. For example, in the user authentication process (see FIG. 3), the system controller 28 controls the input unit 20 and the communication unit 23, and user identification data input by the user via the input unit 20 is transmitted via the transmission unit 21 and the network 12. To the coordination proposal device 10. Further, the system controller 28 controls the input unit 20, the receiving unit 22, and the display control unit 25, and as a result of user authentication transmitted from the coordination proposal device 10, search word candidates (multiple sensitivity word data) (see FIG. 4). ), The search result data D5, the display information data D6, etc. are received, the display unit 27 displays whether the user authentication is appropriate, the search word tag cloud display (see FIG. 4), and the searched product image 66 (see FIG. 12). Etc.).

  As described above, when the user performs a product search by operating the user terminal 11 having the above-described configuration, the search data D2 such as the user identification data D1 (user ID and password) and the design feature amount (including the sensitivity word). Is input using the input unit 20 (touch panel). User identification data D1 and search data D2 that are input and specified by the user via the input unit 20 are transmitted from the input unit 20 to the transmission unit 21 and transmitted to the coordination proposal device 10 via the network 12 by the transmission unit 21. Is done.

  Further, the input unit 20 of the user terminal 11 inputs action information (operation history information) indicating an action such as purchase for any product from the product group displayed as the product image 66 shown in FIG. It functions as an operation unit that inputs action information for a coordinated product displayed as a coordinated image shown in FIG. 17B and transmits (outputs) the input action information to the coordination proposal device 10 via the transmission unit 21.

  Here, as action information (operation history information) for a product, for example, a product purchase operation, an operation of bringing a product into a virtual fitting room, an operation of registering a product in a try-on list, and registration of a product in a virtual microsette ( Holding), registering a product as a favorite, recommending a product, browsing request operation for detailed product information, request for delivery date, request for delivery date confirmation, small (S), medium (M), large (L) , A size selection request such as free, an evaluation indicating a high evaluation such as “Like”, and a mail transfer. The virtual micro closet is a storage area allocated for each user prepared on the coordination proposal device 10 side, and stores information such as products purchased by the user in the past and products that the user has shown interest in. A registered storage area. The virtual fitting room refers to a screen (fitting screen) for virtually trying on a product. When the product is brought into the fitting room, for example, an image of the product is displayed in a specific area in the fitting room, Alternatively, the product image is displayed on the mannequin image in the fitting room.

[Outline of the present invention]
Next, the outline of the present invention will be described with reference to FIGS.

  FIG. 5 is a diagram showing a procedure for creating a coordination database according to the present invention.

  As shown in FIG. 5, an image of a coordinated product previously coordinated by a coordinator of clothing is analyzed to obtain a design feature value (second design feature value). That is, a color feature indicating a representative color of an image of each area obtained by cutting out an area including a color representative of the image of the coordinated product from the image of the coordinated product, smoothing the image of each area with a smoothing filter Get the quantity.

  In this example, each value (hereinafter referred to as “HSV value”) of three attributes (H (hue), S (saturation), and V (brightness)) in the HSV color space is acquired as the color feature amount. Further, since the coordinated products are products of a plurality of categories (tops and bottoms in the example shown in FIG. 5), two or more color feature amounts (HSV values) are acquired.

  Subsequently, corresponding color information is selected from the basic color palette 60 having 130 colors for each acquired color feature amount (HSV value). Here, the 130 colors have 120 chromatic colors and 10 achromatic colors, and the 120 chromatic colors are combinations of 10 hues and 12 tones, and 10 achromatic colors. Consists of 10 tones from white to black. The number of colors and the classification method of the basic color palette are not limited to this embodiment.

  When one color feature amount (HSV value) is measured, one color (color information) of 130 colors in the basic color palette 60 corresponding to the measured color feature amount can be determined.

  Now, when the representative color of the image of the coordinated product is two colors, two colors (two color schemes) on the basic color palette can be specified. Similarly, when the representative color of the image of the coordinated product is three colors, three colors (three color schemes) on the basic color palette can be specified, and the representative color of the coordinated product image is N colors (N : Integer of 4 or more), it is possible to specify N colors (N color scheme) on the basic color palette.

  Further, when the color arrangement of the coordinated product is specified as described above, a sensitivity word corresponding to the specified color arrangement can be specified.

  FIG. 6 is a language image scale showing sensitivity words arranged in the sensitivity space, and FIG. 7 is a monochrome image scale of single colors (130 colors of the basic color palette) arranged in the sensitivity space. FIG. 8 shows an image scale of three colors arranged in the sensitivity space. The image scales shown in FIGS. 6, 7 and 8 are those disclosed by Nippon Color Design Laboratory Co., Ltd. (Shigetsu Kobayashi, “Color System” (Kodansha), and http: // www see .ncd-ri.co.jp / about / image_system.html).

  The sensitivity space shown in FIGS. 6 to 8 is a space defined by a horizontal axis indicating the degree of WARM (warm) / COOL (cold) and a vertical axis indicating the degree of HARD (soft) / SOFT (soft). is there.

  In the language image scale shown in FIG. 6, 64 sensitivity words are arranged in the sensitivity space. In the single-color image scale shown in FIG. 7, 130 single colors are arranged in the sensitivity space. The symbols shown in FIG. 7 are V (bibit), S (strong), B (bright), P (pale), Vp (berry pale), Lgr (light grayish), L (light), Gr ( The positions of twelve tones are shown: grayish), Dl (dull), Dp (deep), Dk (dark), and Dgr (dark grayish). In addition, as representative examples of 130 colors indicated by numerals, 1 to 10 indicate positions of typical hues, 1 is red, 2 is orange, 3 is yellow, 4 is yellow-green, 5 Is green, 6 is blue-green, 7 is blue, 8 is blue-violet, 9 is purple, and 10 is red-purple. 121 is white and 130 is black.

  The image scale of the three color scheme shown in FIG. 8 shows one three color scheme corresponding to each of the 64 sensitivity words, but there are a plurality of three color schemes corresponding to one sensitivity word.

  As shown in FIGS. 6 to 8, it can be seen that there is a correlation between the sensitivity word and the color feature amount (single color, three color scheme). Note that there is a correlation with the sensitivity word not only in the three color scheme shown in FIG. 8 but also in the two color scheme and the N color scheme.

  Therefore, if a conversion table or a conversion expression indicating the relationship between the color feature amount (single color, color combination (two colors, three colors, N color)) and the sensitivity word is prepared in advance and the color information of the single color and color combination is acquired, the color Information can be converted into a sensitivity word by using a conversion table or the like.

  In the example shown in FIG. 5, the sensitivity words “casual” and “elegant” are associated with two two-color color schemes, respectively, and the “pretty” sensitivity word is associated with one three-color color scheme.

  Analyzing the images of coordinated products coordinated in advance by the coordinator of clothing as described above, specifying the color scheme of each coordinated product, the coordinated database (coordinate DB) 44 is associated with the identified color scheme and the sensitivity word be registered.

  Now, as shown in FIG. 9, when searching for bottoms (second product having a different category from the first product) coordinated with black (first color information) tops (first product). The color scheme having the same sensitivity word as the top sensitivity word (casual in this example) and the black color scheme (second color information) are extracted from the coordination DB 44.

  Here, if two color schemes are associated with the same sensitivity word as the tops sensitivity word (casual), and black and red color schemes are extracted as black, the tops black color (first color) Information) and the red (third color information) indicating the difference between the extracted black and red color scheme (second color information), and the bottoms having this red (third color information) Search from the database (product DB) 46. Details of the configuration of the product DB 46 will be described later.

  The red bottoms (second product) searched as described above are presented (suggested) to the user via the user terminal 11 as a product that matches the tops (first product) of this example.

  In other words, black tops have a “casual” sensitivity word, but coordinated products that combine black tops and red bottoms also have a “casual” sensitivity word, and the coordination DB 44 is a coordinator for clothing. Coordinated products that combine black tops and red bottoms can be said to be appropriately coordinated because they are created based on coordinated products coordinated by.

  In the above example, for convenience of explanation, the sensitivity words of the black single color and the black and red two-color combination are both “casual”, but these single-color and two-color color sensitivity words are actually “Casual” is not always true. For example, according to the image scale shown in FIGS. 6 and 7, the sensitivity word “formal” is applied to the black single color.

[Embodiment of Coordination Proposal Device]
Next, the functional configuration of the coordination proposal device 10 will be described.

  FIG. 10 is a block diagram illustrating a functional configuration example of the embodiment of the coordination proposal device 10.

  The coordination proposal device 10 of the present example includes a portion that functions as a coordination proposal device that proposes coordinated products to the user, and a portion that functions as a product search device that searches for products based on operations on the user terminal 11. . In addition, the coordination proposal device 10 functions as an affiliate site that provides services for introducing the products handled by the EC sites EC0 to ECn (FIG. 1) in the client / server system 1 to the user, or the EC site EC0 to EC0. It has a function of performing electronic commerce with the user terminal 11 on behalf of ECn.

  As shown in FIG. 10, the coordination proposal device 10 mainly includes a communication unit 33 (a transmission unit 31 and a reception unit 32), a product reception unit 34, a coordinate image presentation unit 36, a sensitivity word acquisition unit 38, and a first design feature amount acquisition. A unit 40, a second design feature amount acquisition unit 42, a coordination DB 44, a product DB 46, product search units 48 and 50, and an image alignment unit 52.

  The receiving unit 32 receives data such as user identification data D1 and search data D2 transmitted from the user terminal 11 via the network 12, and action information such as purchase from the user, and stores the search data D2 as a product search unit. 48, and the user identification data D1 is transmitted to the user ID acquisition unit 54.

  The product search unit 48 searches for the first product that the user desires to coordinate, accesses the product DB 46, and based on the search data D2 received by the receiving unit 32 from the user terminal 11 via the network 12. The product is narrowed down from the product group stored in the product DB 46, and one or more products are searched.

  Here, the product DB 46 will be described with reference to FIG.

  As shown in FIG. 11, the product DB 46 registers and manages product information for each product, and stores product category information, product image data, and product images using a product ID that uniquely identifies the product as a key. Analyzed design feature values (physical measurement values such as color feature values, pattern feature values, shape feature values, and texture feature values), sensitivity words, site information indicating EC sites (stores), brand information, inventory information , Function as a storage unit that stores size (SML, free) information and price information in association with each other. Here, the product ID is unique identification information that uniquely identifies the product for each product, each EC site, and each size. Different EC sites and sizes handled by the same product are assigned different IDs. It shall be. The category information indicates the category of the product (apparel), and includes information such as tops, bottoms, pants, blouse, skirt, T-shirt, and one piece. When the user terminal 11 narrows down the product category to be searched. used.

  The product information registered in the product DB 46 can be collected from the EC site except for the design feature value and the sensitivity word, and the design feature value is obtained from the image analysis unit 62 (see FIG. 13) on the coordination proposal device 10 side. ) Is obtained by analyzing product image data, and is provided as a part of product information.

  In the example shown in FIG. 11, the HSV value and the color information (first color information) corresponding to the HSV value selected from the basic color palette corresponding to the HSV value are recorded as the color feature amount. The first color information is information indicating the color numbers (# 1 to # 130) of the 130 basic color palette. Further, when the product image is a single color, a set of HSV values and color information is recorded, and when a product has a plurality of colors, a plurality of sets of HSV values and color information are recorded.

  As the pattern feature amount, for example, a feature amount defined by a pattern density and a pattern size can be considered. The shape feature amount depends on, for example, the overall width (thin-thick), sleeve size (short-long), length size (short-long), neckline width and height, and neckline. A feature amount defined by a cross-sectional area (small-large), a V-neck angle (small-large), a U-neck curvature (small-large), etc. that is defined and passed through the user's head can be considered. . As the texture feature amount, for example, a feature amount defined by glossiness and transparency is conceivable.

  Sensitivity words are based on the design features (in this example, single color or color scheme) obtained by analyzing product image data as described above, and the single color and color image scales (see FIGS. 7 and 8). Can be sought.

  The product search unit 48 searches for one or a plurality of products by narrowing down the products from the product group stored in the product DB 46 based on the search data D2 indicating the sensitivity word and the design feature amount, and information on the searched products (Image data or the like) is output to the image alignment unit 52. Needless to say, the product category, EC site, brand, size, price, and the like can also be used as the search data D2.

  The image alignment unit 52 determines the display mode of the image data of the product acquired by the product search unit 48 by the search, and generates display information data indicating the determined display mode. That is, the image alignment unit 52 determines the display mode of the product image data searched by the product search unit 48 as the display of the product image data according to the product characteristic data, and shows the determined display mode. Display information data is generated.

  The display information data generated by the image alignment unit 52 indicates a display mode in which at least a part of the image data of the product searched by the product search unit 48 is displayed on the coordinate system representing the characteristic data of the product. The “characteristic data of the product” here is based on a characteristic different from the search data D2 specified by the user via the user terminal 11 among the characteristics of the product. For example, “product characteristic data” may be determined based on at least one of the product price and the product size.

  FIG. 12 shows an example of the display mode of the image data of the product searched by the product search unit 48. In FIG. 12A, the horizontal axis indicates the “size (large / small)” of the product, and the vertical axis indicates the “price (price)” of the product. In FIG. 12B, the horizontal axis indicates the “shape (thick / thin)” of the product, and the vertical axis indicates the “price” of the product. In FIG. 12C, the horizontal axis indicates the “tone (dark / light)” of the product image, and the vertical axis indicates the “price” of the product. In FIG. 12D, the horizontal axis indicates the “pattern density (dense / sparse)” of the product image, and the vertical axis indicates the “tone (dark / light)” of the product. A coordinate system 64 shown in each of FIGS. 12A to 12D shows a plurality of product images 66 (product group) (a total of nine images in FIG. 9 including three in the horizontal direction and three in the vertical direction). Has been.

  Thus, the image alignment unit 52 (see FIG. 10) displays the display mode (FIG. 12A to FIG. 12A) displayed on the coordinate system 64 from the product image data (product image 66) acquired by the product search unit 48 through the search. Display information data indicating (see (d)) is generated.

  The transmission unit 31 transmits the search result (including product image data) acquired by the product search unit 48 and the display information data generated by the image alignment unit 52 to the user terminal 11 via the network 12. The search result and the display information data transmitted by the transmission unit 31 are received by the reception unit 22 (see FIG. 2) of the user terminal 11. Then, the display control unit 25 determines the display mode of the product image data (product image 66) acquired by the search by the product search unit 48 based on the received display information data, and displays the display unit 27 according to the determined display mode. Product image data (product image 66) is displayed (see FIGS. 12A to 12D).

  The input unit 20 of the user terminal 11 inputs action information such as purchase for one of the products from the product group displayed as the product image 66, and the input action information is sent to the coordination proposal device 10 via the transmission unit 21. Send (output) to. Thereby, electronic commerce with an action such as searching for a product by the client / server system 1 including the user terminal 11 and the coordination proposal device 10 and purchasing the searched product is performed.

  The user ID acquisition unit 54 acquires user identification data D1 transmitted from the user terminal 11 via the network 12 and the reception unit 32, registers the acquired user identification data D1 in the user DB 56, or uses the user identification data D1. The user ID of the identified user is acquired from the user DB 56. In addition, when information such as a product purchased by the user in the past in association with the user ID or a product viewed by the user is registered in the user DB 56 or the like, the information is registered in association with the user ID based on the acquired user ID. The product may be read out and the read out product may be sent to the image alignment unit 52. According to this, the product purchased by the user, the viewed product, and the like can be set as a product (first product) that the user desires to coordinate.

  The product reception unit 34 is a part that acquires a product (first product) that the user desires to coordinate based on the operation of the user terminal 11. The first product is one product in the product group registered in the product DB 46, and is based on one product searched by the product search unit 48 based on the search data D2 or a plurality of searched products. This is one item selected by the user. The first product may be a product specified from current or past operation history information indicating interest in the product at the user terminal 11. For example, when the user searches for a desired product using the user terminal 11 and performs an operation of bringing the searched product into a virtual fitting room to be described later, the product brought into the virtual fitting room is displayed. It can be a first product. Moreover, when a user purchases a product in the past from the coordination proposal device 10 or the EC sites EC0 to ECn, the purchased product can be set as the first product. Furthermore, when an image of an EC site recommended product handled by a specific EC site is displayed on the display unit 27 of the user terminal 11, the product recommended by the specific EC site may be the first product. . Further, when the product reception unit 34 logs in to the site (coordination proposal device 10) by the user terminal 11, the product reception unit 34 selects a product specified from the past operation history information of the user having the user ID acquired from the logged-in user terminal 11. It can be automatically set as the first product.

  Information indicating the first product acquired by the product reception unit 34 is output to the coordinate image presentation unit 36, the sensitivity word acquisition unit 38, and the first design feature amount acquisition unit 40, respectively.

  The sensitivity word acquisition part 38 will acquire the sensitivity word showing the characteristic of the image of the 1st goods from goods DB46, if the information which shows the 1st goods is inputted. That is, in the product DB 46, a sensitivity word representing the feature of the image of the first product is registered in association with the product ID (information indicating the first product) (see FIG. 11). The corresponding sensitivity word is acquired from the product DB 46 based on the input information indicating the first product.

  In addition, a sensitivity word conversion table (for example, the image scale shown in FIGS. 7, 8, etc.) for storing the design feature value (first design feature value) and the sensitivity word in association with each other is provided. Reference numeral 38 denotes a first word from the sensitivity word conversion table based on a first design feature amount (for example, color information indicating a single color or a color scheme) obtained by analyzing an image of the first product received by the product receiving unit 34. Sensitivity words corresponding to design feature values may be acquired.

  When the information indicating the first product is input, the first design feature value acquisition unit 40 analyzes the design feature value (first design feature value) obtained by analyzing the image of the first product, and the product DB 46. Get from. That is, in the product DB 46, design feature values obtained by analyzing the image of the first product in advance in association with the product ID (information indicating the first product) are registered (see FIG. 11). The design feature value acquisition unit 40 acquires a corresponding design feature value (first design feature value) from the product DB 46 based on the input information indicating the first product.

  The first design feature quantity acquisition unit 40 may include the image analysis unit 62 illustrated in FIG. 13, and may acquire a first design feature quantity by analyzing an image of a product (first product). In this example, the first design feature quantity acquisition unit 40 is the color feature quantity (first color feature quantity) of the image of the first product, which is a single color or a plurality of colors on the basic color palette 60. Corresponding color information (first color information) is acquired.

  Next, a method for acquiring the first design feature value (particularly the color feature value and color information) from the product image will be described with reference to FIGS. 13 and 14.

  FIG. 14 is a flowchart illustrating an example of processing contents of the image analysis unit 62 illustrated in FIG.

  In FIG. 14, first, an image of a product is input (step S10). In this case, an entire image of the product may be input, or an appropriate region (a region for each color when there are a plurality of colors) may be cut out and input from the entire image of the product.

  Next, the parameter i indicating the number of colors of the product image is set to 0 (i = 0) (step S12), and then the input image is analyzed (step S14). In this example, the input image is analyzed, and a value (HSV value) indicating H (hue), S (saturation), and V (lightness) in the HSV color space is acquired as a color feature amount of the image.

  The number n of representative colors of the product image is determined from the HSV value indicating the color feature amount of the acquired image (step S16). Here, the representative color refers to a color having a certain area or more that can be sufficiently visually recognized from a distant position. A small area “accent color” may be used as a representative color.

  Subsequently, the HSV value of one representative color of the representative colors determined in step S16 is acquired (step S18).

  Next, the acquired HSV value is converted into color information indicating any one of the 130 colors of the basic color palette 60 using the information of the basic color palette 60 (step S20). As a result, the HSV values representing all the colors are converted into any one of the 130 colors, and the colors are reduced.

  Next, the parameter i indicating the number of colors is incremented by 1 (step S22), and it is determined whether or not the parameter i matches the number of colors n (i = n) (step S24). When the parameter i does not match the number of colors n (in the case of “No”), the process proceeds to step S18, and the processing from step S18 to step S24 is repeated for another representative color.

  On the other hand, when the parameter i matches the number of colors n (“Yes”), the color information converted in step S20 is output as the color information of the input image (step S26).

  That is, as shown in FIG. 13, when an image of a product is input, the image analysis unit 62 analyzes the image as described above, and uses the information of the basic color palette 60 to indicate color information indicating a single color or a plurality of colors. Is output.

  Returning to FIG. 10, the sensitivity word of the image of the first product acquired by the sensitivity word acquisition unit 38 and the first design feature amount acquired by the first design feature amount acquisition unit 40 are respectively The second design feature quantity acquisition unit 42 adds the first product and the second design feature quantity from the coordination DB 44 based on the input sensitivity word and the first design feature quantity. A second design feature amount obtained by analyzing each image of the product is acquired.

  An example of the configuration of the coordination DB 44 is shown in FIG.

  As shown in FIG. 15, the coordination DB 44 of this example is a second design feature amount (color feature amount), a plurality of color schemes having different numbers of colors (two color schemes, three color schemes, four color schemes,...). ) And the color information of the color scheme are registered in association with each other.

  For example, (# 7, # 10), (# 32, # 61),... Are registered as the color information of the two color schemes to which the “casual” sensitivity word is assigned.

  In FIG. 15, (# + number) indicates the color numbers (# 1 to # 130) of the basic color palette 60 of 130 colors. Further, FIG. 15 shows color information (combination of color numbers in the basic color palette 60) corresponding to these sensitivity words for sensitivity words such as “casual” and “elegant”. The relationship between the sensitivity word and the color information of the color scheme shown in FIG. 15 is for convenience of explanation, is suitable as a coordinated color combination (color scheme), and is a color scheme reminiscent of an actual sensitivity word It is not necessarily information.

When the number of colors is 130, there are 8385 (= ₁₃₀ C ₂ ) combinations of two color schemes, but there are fewer than 8385 appropriately coordinated color combinations. This is because the 8385 combinations include inappropriate color combinations that are not coordinated by the clothing coordinator.

  Combinations of two color schemes of coordinated products (first product and second product) coordinated by the clothing coordinator are classified for each sensitivity word and registered in the coordination DB 44 in association with the sensitivity word.

  Similarly, in the case of three color schemes, four color schemes,..., They are classified for each sensitivity word and registered in the coordination DB 44 in association with the sensitivity word.

  Accordingly, the color information registered in association with the “casual” sensitivity word includes two color schemes, three color schemes, four color schemes, and so on, and for each color scheme having a different number of colors. A number of combinations of color schemes are registered.

  Returning to FIG. 10, the second design feature quantity acquisition unit 42 inputs the sensitivity word and the first design feature quantity (color information corresponding to a single color or a plurality of colors on the basic color palette 60 (first color information )) Based on the second design feature amount (color information indicating color arrangement (second color information)) registered in association with the same sensitivity word as the input sensitivity word, and the first design feature amount A second design feature amount (second color information) that includes (first color information) and has more design feature amounts than the first design feature amount is acquired from the coordination DB 44.

  For example, if the input sensitivity word is “casual” and the input first design feature quantity (first color information) indicates a single color “black”, the second design feature quantity acquisition unit 42 Color information indicating two color schemes, three color schemes, four color schemes, etc. registered in association with the sensibility word “casual”, including two color schemes including “black”, three color schemes, four color schemes,. Second color information) is acquired.

  Further, when the input sensitivity word is “casual” and the input first design feature quantity (first color information) indicates the two-color color combination “black and red”, the second design feature quantity acquisition unit 42, color information indicating a three-color arrangement, a four-color arrangement, etc., including the two-color arrangement “black and red” among the three-color arrangement, the four-color arrangement,... Registered in association with the sensitivity word “casual”. (Second color information) is acquired.

  The first design feature value acquired by the first design feature value acquisition unit 40 and the second design feature value acquired by the second design feature value acquisition unit 42 are added to the product search unit 50, respectively. The product search unit 50 searches the product DB 46 for the second product coordinated with the first product based on the input first design feature quantity and second design feature quantity.

  That is, the product search unit 50 indicates the difference between the first design feature value acquired by the first design feature value acquisition unit 40 and the second design feature value acquired by the second design feature value acquisition unit 42. A third product feature amount is obtained, and a second product (first product) having a first design feature amount that is the same design feature amount as the third design feature amount from the product DB 46 based on the obtained third design feature amount. The second product (combined with the first product having a category different from that of the first product) is searched.

  Specifically, the product search unit 50 includes first color information indicating each color of a single color or a plurality of colors, which is the first color feature amount acquired by the first design feature amount acquisition unit 40, and the second color feature amount. The second color information (the number of colors of the second color information> the number of colors of the first color information) indicating the plurality of colors, which is the second color feature quantity acquired by the design feature quantity acquisition unit 42. The third color information indicating the difference is obtained, and the second product having the same color information as the third color information is searched from the product DB 46 based on the obtained third color information.

  For example, as described with reference to FIG. 9, the product search unit 50 includes the first color information (black) of the first product (tops) and the second color information (black and black) acquired from the coordination DB 44. (Red) is entered. The first color information (black) and the second color information (black and red) have the same sensitivity word (casual), and the second color information (black and red) includes the first color information (black and red). Color information (black) is included. The product search unit 50 obtains third color information (red) indicating a difference between the first color information (black) and the second color information (black and red), and obtains the third color information (red). The second product (bottoms) to be searched is searched.

  The product search unit 50 outputs information (image data or the like) of the searched second product to the coordinated image presentation unit 36 and the image alignment unit 52, respectively. In addition, when searching for a plurality of second products, the product search unit 50 outputs information on the plurality of products to the coordinated image presentation unit 36 and the image alignment unit 52, respectively.

  The coordinated image presentation unit 36, based on the information on the first product received by the product reception unit 34 and the information on the second product searched by the product search unit 50, the second product image and the second product. Are output so that they can be simultaneously observed on the user terminal 11. At this time, for example, when the first product is tops and the second product is bottoms, the coordinated image presentation unit 36 adjusts the image size, position, orientation, and the like of the tops image and the bottoms image, A coordinated image generation unit that generates a coordinated image in which the image of the bottom and the bottoms are continuous, and may output image data of the generated coordinated image, and the image of the first product and the image of the second product May be output as an individual image showing a coordinated product.

  When a plurality of second products are searched by the product search unit 50, the coordinated image presentation unit 36 outputs a plurality of coordinated images sequentially or two or more simultaneously.

  The image aligning unit 52 can also function as a product presentation unit that presents an image of the second product instead of the coordinated image presentation unit 36. In other words, when a plurality of second products are searched by the product search unit 50, the image alignment unit 52 aligns the images of the plurality of second products according to lightness or saturation, and aligns the images. The images of the second product are presented sequentially or two or more simultaneously. Note that the color feature value (HSV value) registered in the product DB 46 can be used as the brightness or saturation of the image of the second product.

  The image aligning unit 52 aligns the searched images of the second products on a space having the coordinate and the size and price of the second product (see FIG. 12A). A plurality of images of the second product can be presented. As the size and price (price) of the second product, the size and price registered in the product DB 46 can be used.

  Further, the image aligning unit 52 classifies the plurality of second products searched for into products having different numbers of colors (products having a single color, two colors, three colors, etc.), and second classified products having different numbers of colors. You may make it show the image of 2nd goods sequentially or 2 or more simultaneously for every goods.

  The image data of the coordinated image output from the coordinated image presentation unit 36 is transmitted via the transmission unit 31 to the user terminal 11 of the user who has designated the product (first product) desired to be coordinated. Thereby, a coordinate image can be displayed on the display unit 27 of the user terminal 11.

  While viewing the coordinated image displayed on the display unit 27 of the user terminal 11, the user inputs action information such as purchase of coordinated products through the input unit 20, and the input action information is transmitted via the transmission unit 21 to the coordinate proposal device. 10 to send.

[Coordination proposal method]
Next, an embodiment of the coordination proposal method according to the present invention will be described with reference to FIGS.

  In FIG. 16, the coordination proposal device 10 (the product search unit 48, the image alignment unit 52, etc.) displays product images on the display unit 27 of the user terminal 11 in response to a product search request from the user terminal 11 ( Step S50).

  The user selects one or a plurality of products (first products) by operating the input unit 20 of the user terminal 11 and inputting action information such as purchase on the product image displayed on the display unit 27. can do.

  Subsequently, the coordination proposal device 10 determines whether or not the selection of the first product by the user terminal 11 has been completed (step S52). For example, the coordination proposal device 10 uses the input unit 20 of the user terminal 11 to put the first product (one product selected by touching or the like when a plurality of products are selected) into a virtual fitting room. When an operation to bring in is performed, it can be determined that the selection of the first product has been completed.

  Specifically, as shown in FIG. 17B, the user touches the image of the first product displayed on the display unit 27 of the user terminal 11 and swipes right as shown in FIG. The first product can be brought into the virtual fitting room, and the screen changes from the screen displaying only the first product image shown in FIG. 17B to the virtual fitting room screen (fitting screen). Can be made. Also, select the image of the first product you want to try on from the products held in the microsette, display the image details in a pop-up, and change to the try-on screen by pressing the try-on button (icon button not shown) after selecting the category be able to. It is possible to return to the pre-transition screen by swiping left on the fitting screen.

  Next, the sensitivity word acquisition unit 38 and the first design feature amount acquisition unit 40 respectively convert the sensitivity word of the image of the first product and the first design feature amount based on the product ID of the first product. Obtained from the DB 46 (step S54).

  Subsequently, the second design feature quantity acquisition unit 42 obtains the corresponding second design feature quantity from the coordination DB 44 based on the sensitivity word of the acquired image of the first product and the first design feature quantity. Obtain (step S56). That is, the second design feature quantity registered in association with the same sensitivity word as the acquired sensitivity word, including the acquired first design feature quantity, and more designs than the first design feature quantity The second design feature value having the feature value is acquired from the coordination DB 44.

  Next, the product search unit 50 searches the product DB 46 for the second product coordinated with the first product based on the acquired first design feature quantity and second design feature quantity (step S58). That is, a third design feature value indicating a difference between the first design feature value and the second design feature value is obtained, and the third design feature value is obtained from the product DB 46 based on the obtained third design feature value. A second product having the same design feature value is searched.

  The coordinated image presentation unit 36, based on the information on the first product received by the product reception unit 34 and the information on the second product searched by the product search unit 50, the second product image and the second product. The product image is output to the user terminal 11 so that it can be simultaneously observed on the user terminal 11 (step S60). In this example, as shown in FIG. 17B, a coordinated image in which the image size, position, and orientation of the first image (tops image) and the second image (bottoms image) are adjusted is output. However, the first image (tops image) and the second image (pants image) are simply output separately, and the first image (tops image) and the second image are output by the application on the user terminal 11 side. The image size, position and orientation with (pants image) may be automatically adjusted and displayed, or the user terminal 11 may be operated to manually adjust the image size, position and orientation for display. .

  The image data of the coordinated image output from the coordinated image presentation unit 36 is transmitted via the transmission unit 31 to the user terminal 11 of the user who has designated a product (first product) for which automatic coordination is desired. Thereby, a coordinate image can be displayed (presented) on the display unit 27 of the user terminal 11 (step S62).

  The coordination proposal device 10 determines whether or not a coordinated image presentation end operation has been performed during the presentation of the coordinated image (step S64), and if the termination operation has been performed, the process ends. For example, on the try-on screen shown in FIG. 17B, a left swipe operation is performed, and a transition to the screen shown in FIG. 17A occurs, or there is an action such as purchasing a coordinated second product. In this case, the process ends.

[Others]
In the present embodiment, the first color information (color information of each color of a single color or a plurality of colors) that is the first color feature amount of the design feature amounts of the image of the first product and the first coordinate coordinated in advance. Second color information (color of each color of a plurality of colors (color schemes)) that is a second color feature amount of the second design feature amount obtained by analyzing the respective images of the product and the second product Information) and using the color information (third color information) indicating the difference between the first color information and the second color information, the product having the third color information (second product) However, the present invention is not limited to this, and the second product may be searched by using a design feature amount other than the color feature amount.

  For example, at least the first color among the first color feature value, the first pattern feature value, the first shape feature value, and the first texture feature value, which is the design feature value of the image of the first product. A second color feature amount, which is a second design feature amount obtained by analyzing two or more feature amounts including the feature amount, and images of the first product and the second product coordinated in advance; Two or more feature quantities including at least a second color feature quantity among the second pattern feature quantity, the second shape feature quantity, and the second texture feature quantity, and these two or more feature quantities The second product having the difference feature amount is searched based on the feature amount indicating the difference. In this case, in the coordination DB, in addition to the second color information that is the second color feature amount, the second design obtained by analyzing the respective images of the first product and the second product. Two or more feature amounts including at least the second color feature amount among the second color feature amount, the second pattern feature amount, the second shape feature amount, and the second texture feature amount, which are feature amounts. It is necessary to register.

  In the present embodiment, the first product and the second product (coordinated products) coordinated in advance are coordinated by a specialized coordinator. However, the present invention is not limited to this, and general users can purchase products in the product DB. You may use what has been coordinated by using or that has been coordinated and purchased.

  Furthermore, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Client server system, 10 ... Coordination proposal apparatus, 11 ... User terminal, 12 ... Network, 20 ... Input part, 23, 33 ... Communication part, 25 ... Display control part, 27 ... Display part, 28 ... System controller, 34 ... Product reception unit, 36 ... Coordinated image presentation unit, 38 ... Sensitivity word acquisition unit, 40 ... First design feature quantity acquisition unit, 42 ... Second design feature quantity acquisition unit, 44 ... Coordinate database, 46 ... Product database, 48, 50 ... Product search unit, 52 ... Image alignment unit, 60 ... Basic color palette, 62 ... Image analysis unit

Claims (16)

A product database in which product information about a product group to be electronically commerce is registered, and for each registered product, the product is associated with product information including a first design feature obtained by analyzing an image of the product Registered product database,
A product accepting unit that accepts a first product desired to be coordinated from the user terminal;
A first design feature amount acquisition unit for acquiring a first design feature amount obtained by analyzing an image of the first product based on the first product received by the product reception unit;
A sensitivity word acquisition unit that acquires a sensitivity word representing the characteristics of the image of the first product received by the product reception unit;
The second design feature amount obtained by analyzing the images of the first product and the second product coordinated in advance, and the whole of the coordinated first product and the second product. A database for coordination that is registered in association with a sensitivity word representing the characteristics of the image;
A second design feature amount registered in association with the sensitivity word from the coordination database based on the sensitivity word acquired by the sensitivity word acquisition unit, wherein the first design feature amount acquisition unit A second design feature quantity that includes the acquired first design feature quantity and has a second design feature quantity that has more design feature quantities than the first design feature quantity from the coordination database. An acquisition unit;
A third design feature value indicating a difference between the first design feature value acquired by the first design feature value acquisition unit and the second design feature value acquired by the second design feature value acquisition unit. And searching for a second product having the first design feature quantity that is the same design feature quantity as the third design feature quantity from the product database based on the obtained third design feature quantity. A search section;
A product presentation unit for presenting the second product searched by the product search unit to the user terminal as a second product coordinated with the first product received by the user terminal;
Coordination proposal device with The product information registered in the product database includes a sensitivity word representing the characteristics of the image of the registered product,
The coordination suggestion device according to claim 1, wherein the sensitivity word acquisition unit acquires a sensitivity word corresponding to the first product from the product database based on the first product received by the product reception unit. A sensitivity word conversion table for storing the first design feature value and the sensitivity word in association with each other;
The sensitivity word acquisition unit converts the sensitivity word conversion table into the first design feature value based on the first design feature value obtained by analyzing the image of the first product received by the product reception unit. The coordination suggestion device according to claim 1 which acquires a corresponding sensitivity word.   The first design feature value is a first color feature value of an image of the first product, and the second design feature value is an image of each of the first product and the second product. The coordination suggestion apparatus according to claim 1, wherein the coordinate suggestion apparatus is a second color feature amount. The first color feature amount is first color information corresponding to a single color or a plurality of colors representing the color of the image of the first product, and is selected from a basic color palette having a preset number of colors. First color information indicating each color of a single color or a plurality of colors,
The second color feature amount is second color information corresponding to a plurality of colors representing colors of images of the first product and the second product, and is selected from the basic color palette. The coordination proposal device according to claim 4, which is second color information indicating each of a plurality of colors. In the coordination database, the sensitivity word and the second color information are registered in association with each other for each number of colors of the plurality of colors.
The second design feature quantity acquisition unit includes the first color information acquired by the first design feature quantity acquisition unit and has a larger number of colors than the first color information. The coordination proposal device according to claim 5, wherein information is acquired from the coordination database.   The product search unit includes a third color indicating a difference between the first color information acquired by the first design feature value acquisition unit and the second color information acquired by the second design feature value acquisition unit. The coordinate suggestion device according to claim 6, wherein color coordination information is obtained, and a second product having the same color information as the third color information is searched from the product database based on the obtained third color information.   The product presentation unit generates a coordinated image for generating a coordinated image capable of simultaneously observing the image of the first product received by the product reception unit and the image of the second product searched by the product search unit. The coordinate proposal apparatus of any one of Claim 1 to 7 which presents the said coordinate image produced | generated by the said coordinate image production | generation part to the said user terminal.   The first design feature value registered in the product database includes a first color feature value, a first pattern feature value, a first shape feature value, and a first texture of the image of the first product. The coordinate proposal device according to any one of claims 1 to 8, wherein the coordinate suggestion apparatus includes two or more feature amounts including at least a first color feature amount among the feature amounts. When there are a plurality of searched second products, an image alignment unit that aligns images of the searched second products according to lightness or saturation,
The coordinate proposal device according to any one of claims 1 to 9, wherein the product presentation unit presents images of a plurality of second products aligned by the image alignment unit sequentially or two or more simultaneously. An image aligning unit that aligns images of the plurality of second products searched for on a space having the size and price of the second products as coordinate axes when there are a plurality of the second products searched; Have
The coordinate proposal device according to any one of claims 1 to 9, wherein the product presentation unit presents images of a plurality of second products aligned by the image alignment unit. A product database in which product information about a product group to be electronically commerce is registered, and for each registered product, the product is associated with product information including a first design feature obtained by analyzing an image of the product The registered product database, the second design feature obtained by analyzing the images of the first and second products coordinated in advance, and the coordinated first product and using coordinated proposed device and a database for coordinating registered the second of the sensitivity words representing the characteristics of the entire image is associated with the product, a coordination proposed to propose a coordinated product ,
A step of receiving a first product desired to be coordinated from a user terminal by a product receiving unit of the coordination proposal device ;
A step in which a first design feature quantity acquisition unit of the coordination proposal device acquires a first design feature quantity obtained by analyzing an image of the first product based on the received first product; ,
A sensitivity word acquisition unit of the coordination proposal device acquires a sensitivity word representing a feature of the received image of the first product;
The second design feature quantity acquisition unit of the coordination proposal device is a second design feature quantity registered in association with the sensitivity word from the coordination database based on the acquired sensitivity word, Obtaining a second design feature quantity including the obtained first design feature quantity and having more design feature quantities than the first design feature quantity from the coordination database;
The product search unit of the coordination proposal device obtains a third design feature value indicating a difference between the acquired first design feature value and the acquired second design feature value, and the obtained third design feature value is obtained. Searching for a second product having the first design feature quantity that is the same design feature quantity as the third design feature quantity from the product database based on a design feature quantity;
A step of presenting the searched second product to the user terminal as a second product coordinated with respect to the first product received by the user terminal;
Coordination proposal method including   The first design feature value is a first color feature value of an image of the first product, and the second design feature value is an image of each of the first product and the second product. The coordinate suggestion method according to claim 12, wherein the second color feature amount is the second color feature amount. The first color feature amount is first color information corresponding to a single color or a plurality of colors representing the color of the image of the first product, and is selected from a basic color palette having a preset number of colors. First color information indicating each color of a single color or a plurality of colors,
The second color feature amount is second color information corresponding to a plurality of colors representing colors of images of the first product and the second product, and is selected from the basic color palette. The coordinate proposal method according to claim 13, which is second color information indicating each color of a plurality of colors. In the coordination database, the sensitivity word and the second color information are registered in association with each other for each number of colors of the plurality of colors.
The step of acquiring the second design feature amount includes, from the coordinate database, the second color information including the acquired first color information and having a larger number of colors than the first color information. The coordination proposal method according to claim 14 to be acquired.   The step of searching for the product obtains third color information indicating a difference between the obtained first color information and the obtained second color information, and based on the obtained third color information The coordinate proposal method according to claim 15, wherein a second product having the same color information as the third color information is searched from the product database.