WO2023207681A1 - Method and apparatus for intelligent clothing matching, and electronic device and storage medium - Google Patents

Method and apparatus for intelligent clothing matching, and electronic device and storage medium Download PDF

Info

Publication number
WO2023207681A1
WO2023207681A1 PCT/CN2023/089038 CN2023089038W WO2023207681A1 WO 2023207681 A1 WO2023207681 A1 WO 2023207681A1 CN 2023089038 W CN2023089038 W CN 2023089038W WO 2023207681 A1 WO2023207681 A1 WO 2023207681A1
Authority
WO
WIPO (PCT)
Prior art keywords
clothing
image
matching
target
compatibility
Prior art date
Application number
PCT/CN2023/089038
Other languages
French (fr)
Chinese (zh)
Other versions
WO2023207681A9 (en
Inventor
黄伟强
邹星星
庞楷成
Original Assignee
人工智能设计研究所有限公司
香港理工大学
皇家艺术学院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 人工智能设计研究所有限公司, 香港理工大学, 皇家艺术学院 filed Critical 人工智能设计研究所有限公司
Publication of WO2023207681A1 publication Critical patent/WO2023207681A1/en
Publication of WO2023207681A9 publication Critical patent/WO2023207681A9/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/535Filtering based on additional data, e.g. user or group profiles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0631Item recommendations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging

Definitions

  • the present disclosure relates to the field of image processing technology, and in particular, to a method, device, electronic device and storage medium for intelligent matching of clothing.
  • the clothing image input by the user is usually obtained, and similar clothing images are recommended to the user based on the clothing image.
  • the recommended clothing image and the clothing image input by the user cannot be matched in a complete set, or The matching effect is poor.
  • the purpose of this disclosure is to provide a method, device, electronic device and storage medium for intelligent clothing matching.
  • This method can automatically generate clothing matching combinations with better matching effects based on the clothing matching compatibility and matching levels of clothing images, and improve It improves the efficiency of generating clothing matching combinations, thereby improving user experience.
  • Embodiments of the present disclosure provide a method for intelligent matching of clothing, including: obtaining a first clothing image of a first clothing category and a second clothing image of a second clothing category; and separately comparing the first clothing image and the second clothing image. Perform feature extraction on two clothing images to obtain the characteristic value of the first clothing element of the first clothing image, the characteristic value of the second clothing element of the first clothing image, and the first clothing element of the second clothing image. and the characteristic value of the second clothing element of the second clothing image; determining the first characteristic value between the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image.
  • Matching compatibility and determining the second matching compatibility between the characteristic value of the second clothing element of the first clothing image and the characteristic value of the second clothing element of the second clothing image; according to the first matching compatibility and the second matching Compatibility, generating clothing matching compatibility and matching level of the first clothing image and the second clothing image; according to the clothing matching compatibility of the first clothing image and the second clothing image Compatibility and matching level, generate clothing matching combinations.
  • the method further includes: according to the first matching compatibility, the second matching compatibility and the clothing matching compatibility, from the first clothing element and the The target clothing element is determined among the second clothing elements; and the reason for generating the matching level is obtained according to the target clothing element and the matching level.
  • generating a clothing matching combination based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image includes: if the first clothing image and the second clothing image If the matching level of the second clothing image belongs to the first matching level, a first clothing matching combination is generated based on the first clothing image and the second clothing image.
  • generating a clothing matching combination based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image also includes: if the first clothing image and the second clothing image If the matching level of the second clothing image belongs to the second matching level, then a matching suggestion for replacing the second clothing image is generated according to the target clothing element, wherein the first matching level is better than the second matching level. ;Acquire a third clothing image of the second clothing category according to the matching suggestion, wherein the target clothing element of the third clothing image is different from the target clothing element of the second clothing image; According to the first clothing The image and the third clothing image generate a second clothing matching combination.
  • the method further includes: determining suitable body feature tags for the clothing matching combination; training to obtain a clothing matching model based on the clothing matching combination and its suitable body feature tags; and obtaining the target object
  • the physical characteristic data of the target object is input into the clothing matching model to obtain a target clothing matching combination suitable for the target object.
  • the target clothing matching combination includes a first target clothing image and a second target clothing image; wherein the method further includes: generating the target according to the body characteristic data of the target object. a virtual image of an object; determining the dressing order of the first target clothing image and the second target clothing image; and combining the first target clothing image and the second target clothing image based on the dressing order and the The above virtual images are fused to generate the target outfit image.
  • fusing the first target clothing image and the second target clothing image with the virtual image based on the dressing order to generate a target outfit image includes: respectively The clothing structures of the first target clothing image and the second target clothing image are analyzed to obtain the first clothing front image of the first target clothing image and the second clothing front image of the second target clothing image. According to the dressing order, the virtual image is sequentially fused with the first clothing front image and the second clothing front image to generate the target outfit image.
  • the present disclosure provides a device for intelligent matching of clothing, including: an image acquisition module for acquiring a first clothing image of a first clothing category and a second clothing image of a second clothing category; a feature extraction module for respectively The first clothing image and the second clothing image perform feature extraction to obtain the characteristic value of the first clothing element of the first clothing image, the characteristic value of the second clothing element of the first clothing image, and the the characteristic value of the first clothing element of the second clothing image and the characteristic value of the second clothing element of the second clothing image; a determination module for determining the characteristic value of the first clothing element of the first clothing image and the second Characteristic value of the first clothing element of the clothing image the first matching compatibility between them, and determining the second matching compatibility between the characteristic value of the second clothing element of the first clothing image and the characteristic value of the second clothing element of the second clothing image; the first generation module, Used to generate the clothing matching compatibility and matching level of the first clothing image and the second clothing image according to the first matching compatibility and the second matching compatibility; a second generation module used to generate the
  • An embodiment of the present disclosure provides an electronic device, including: at least one processor; a storage device configured to store at least one program, and when the at least one program is executed by the at least one processor, the at least one processor Implement any of the above methods for intelligent matching of clothing.
  • Embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored.
  • the computer program When the computer program is executed by a processor, the computer program implements any of the above methods for intelligent matching of clothing.
  • the method for intelligent matching of clothing obtains the feature values of each clothing element of the first clothing image and the second clothing image by performing feature extraction on the first clothing image and the second clothing image of different categories,
  • the clothing matching compatibility and matching level of the first clothing image and the second clothing image are automatically generated based on the matching compatibility between various clothing elements, so that the reason for generating the clothing matching compatibility and matching level can be localized to specific clothing elements, thereby This makes the generated clothing matching compatibility and matching level more accurate; in addition, the clothing matching effect in the clothing matching combination automatically generated based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image is better, improving the generation The efficiency of clothing matching and combination, thereby improving user experience.
  • FIG. 1 shows a schematic diagram of an exemplary system architecture to which the method for intelligent matching of clothing according to the embodiment of the present disclosure can be applied.
  • FIG. 2 is a flow chart of a method for intelligent matching of clothing according to an exemplary embodiment.
  • FIG. 3 is a schematic structural diagram of a fashion compatibility model according to an exemplary embodiment.
  • FIG. 4 is a schematic diagram showing the application of the fashion compatibility model according to an exemplary embodiment.
  • FIG. 5 is a schematic diagram of a clothing database with discrimination labels according to an example.
  • FIG. 6 is a flow chart of a method for intelligent matching of clothing according to an exemplary embodiment.
  • FIG. 7 is a schematic diagram illustrating determining physical characteristic tags suitable for clothing matching combinations according to an example.
  • Figure 8 is a schematic diagram of multi-level virtual dressing according to an example.
  • Figure 9 is a schematic diagram of an intelligent clothing matching system according to an exemplary embodiment.
  • Figure 10 is a block diagram of a device for intelligent matching of clothing according to an exemplary embodiment.
  • Figure 11 is a schematic structural diagram of an electronic device according to an exemplary embodiment.
  • Example embodiments will now be described more fully with reference to the accompanying drawings.
  • Example embodiments may, however, be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concepts of the example embodiments. To those skilled in the art.
  • the described features, structures or characteristics may be combined in any suitable manner in one or more embodiments.
  • plural means at least two, such as two, three, etc., unless otherwise expressly and specifically limited.
  • the terms “first” and “second” are used for descriptive purposes only and shall not be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as “first” and “second” may explicitly or implicitly include one or more of these features.
  • FIG. 1 shows a schematic diagram of an exemplary system architecture to which the method for intelligent matching of clothing according to the embodiment of the present disclosure can be applied.
  • the system architecture may include a server 101, a network 102 and a terminal device 103.
  • the network 102 is a medium used to provide a communication link between the terminal device 103 and the server 101 .
  • Network 102 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
  • the server 101 may be a server that provides various services, such as a background management server that provides support for devices operated by users using the terminal device 103 .
  • the background management server can analyze and process the received request and other data, and feed back the processing results to the terminal device 103 .
  • the terminal device 103 may be a mobile phone, a tablet computer, an e-book reader, smart glasses, a smart home device, an AR (Augmented Reality, augmented reality) device, a VR (Virtual Reality, virtual reality) device, etc.
  • the terminal, or the terminal 120 may also be a personal computer (Personal Computer, PC), such as a laptop computer, a desktop computer, etc.
  • the server 101 may, for example: obtain a first clothing image of a first clothing category and a second clothing image of a second clothing category; perform feature extraction on the first clothing image and the second clothing image respectively to obtain the first clothing image.
  • the clothing matching compatibility and matching level of the first clothing image and the second clothing image generating a clothing matching combination based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image.
  • the server 101 may, for example, send the generated clothing matching combination to the terminal device 103 for display.
  • the target object can, for example, input his or her own physical characteristic data through the terminal device 103; the server 101 can, for example, obtain the physical characteristic data of the target object; input the physical characteristic data of the target object into a clothing matching model to obtain a suitable The target clothing matching combination of the target object; for example, the server 101 can send the target clothing matching combination to the terminal device 103 for display, for the target object to view and select.
  • the server 101 can be a physical server, a server cluster composed of multiple servers, or a cloud server. You can have any number of end devices, networks, and servers based on actual needs.
  • FIG. 2 is a flow chart of a method for intelligent matching of clothing according to an exemplary embodiment.
  • the method for intelligent matching of clothing may include the following steps.
  • step S202 a first clothing image of a first clothing category and a second clothing image of a second clothing category are obtained.
  • clothing can be clothing, accessories, shoes, etc.; clothing can be tops, pants, skirts, dresses, etc.; accessories can be glasses, earrings, necklaces, bracelets, hats, bags (handbags, shoulder bags, etc.) , backpack, cross-body bag), etc., the shoes can be leather shoes, sports shoes, canvas shoes, boots, etc., but the disclosure is not limited thereto.
  • the clothing category is used to represent a specific category of clothing, such as tops, bottoms, shoes, bags, accessories, etc.
  • multiple clothing images can be obtained, in which each clothing image corresponds to a different clothing category. Multiple clothing corresponding to these multiple clothing images can form a clothing matching combination.
  • a top image, a bottom image, a bag image, a shoe image, and an accessory image you can obtain a top image, a bottom image, a bag image, a shoe image, and an accessory image, and the clothing corresponding to these images can form a clothing matching combination.
  • the description is based on the example of acquiring two clothing images (ie, the first clothing image and the second clothing image) and processing the two clothing images, but the disclosure is not limited thereto.
  • the clothing category of the first clothing image is different from the clothing category of the second clothing image.
  • the first clothing corresponding to the first clothing image and the second clothing corresponding to the second image can form a clothing matching combination.
  • the first clothing image of the first clothing category is a top image
  • the second clothing image of the second clothing category is a bottom clothing image
  • Both the first clothing image and the second clothing image in the embodiment of the present disclosure may be images of single items of clothing, or may be images of clothing combinations, which the disclosure is not limited to.
  • step S204 feature extraction is performed on the first clothing image and the second clothing image respectively to obtain the feature value of the first clothing element of the first clothing image, the feature value of the second clothing element of the first clothing image, and the second clothing element.
  • Clothing pictures The characteristic value of the first clothing element of the image and the characteristic value of the second clothing element of the second clothing image.
  • clothing elements may include but are not limited to color, print, material, silhouette and design.
  • the feature values of multiple clothing elements of the first clothing image and the second clothing image can be extracted respectively.
  • the following description takes the extraction of two clothing elements (ie, the first clothing element and the second clothing element) as an example. , but the present disclosure is not limited thereto.
  • the fashion compatibility model can be used to perform feature extraction on the first clothing image to obtain the feature value of the first clothing element of the first clothing image and the feature value of the second clothing element of the first clothing image; you can use The fashion compatibility model performs feature extraction on the second clothing image, and obtains the feature value of the first clothing element of the second clothing image and the feature value of the second clothing element of the second clothing image.
  • the first clothing image of the first clothing category is a top image
  • the second clothing image of the second clothing category is a bottom image
  • the first clothing element is color
  • the second clothing element is print
  • feature extraction is performed on the top image , it can be obtained that the color of the top image is red and the print is plant printing; by feature extraction of the bottom image, it can be obtained that the color of the bottom image is orange and the print is floral print.
  • FIG. 3 is a schematic structural diagram of a fashion compatibility model according to an exemplary embodiment.
  • a fashion compatibility model (also known as an interpretable deep neural network model) may include a feature extraction network and an internal factor compatibility network, where the feature extraction network is used to extract features from clothing images to obtain The eigenvalues of clothing elements of clothing images, and the internal factor compatibility network is used to analyze the compatibility between clothing elements of clothing images.
  • the top image 301 and the bottom image can be input into the feature extraction network of the fashion compatibility model.
  • the feature extraction network characterizes the color elements, printing elements, material elements, outline elements and design elements of the top image 301. Extract and obtain the color information 3011, printing information 3012, material information 3013, outline information 3014 and design information 3015 of the top image 301; the feature extraction network extracts the color elements, printing elements, material elements, outline elements and design elements of the bottom image 302 Feature extraction is performed to obtain the color information 3021, print information 3022, material information 3023, outline information 3024 and design information 3025 of the underwear image 302.
  • step S206 a first matching compatibility between the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image is determined, and the second clothing of the first clothing image is determined. Second matching compatibility between the feature value of the element and the feature value of the second clothing element of the second clothing image.
  • the first matching compatibility and the second matching compatibility are used to evaluate the degree of suitable matching between clothing elements, and the clothing matching compatibility is used to evaluate the degree of suitable matching between clothing elements.
  • the first matching compatibility, the second matching compatibility and the clothing matching compatibility can all be expressed by numerical values. The larger the value, the more suitable the clothing elements or clothing are to be matched together.
  • the collocation compatibility between the color of the upper garment image and the color of the lower garment image may be determined as the first collocation compatibility
  • the collocation compatibility between the print of the upper garment image and the print of the lower garment image may be determined as the second collocation compatibility. sex.
  • the first matching compatibility between the color of the top image and the color of the bottom image is larger; if plant printing and floral printing are not suitable for matching together, then Can be sure The numerical value corresponding to the second matching compatibility between the printing of the upper garment image and the printing of the lower garment image is determined to be smaller.
  • the color information 3011 of the top image 301 and the color information 3021 of the bottom image 302 are input to the internal factor compatibility network, and the first color information 3011 of the top image 301 and the color information 3021 of the bottom image 302 are obtained.
  • Compatibility 303 input the printing information 3012 of the top image 301 and the printing information 3022 of the bottom image 302 into the internal factor compatibility network to obtain the second compatibility of the printing information 3012 of the top image 301 and the printing information 3022 of the bottom image 302 304; Input the material information 3013 of the top image 301 and the material information 3023 of the bottom image 302 into the internal factor compatibility network to obtain the third compatibility of the material information 3013 of the top image 301 and the material information 3023 of the bottom image 302 305; Input the outline information 3014 of the top image 301 and the outline information 3024 of the bottom image 302 into the internal factor compatibility network to obtain the fourth compatibility 306 of the outline information 3014 of the top image 301 and the outline information 3024 of the bottom image 302 ; Input the design information 3015 of the top image 301 and the design information 3025 of the bottom image 302 into the internal factor compatibility network to obtain the fifth compatibility 307 of the design information 3015 of the top image 301 and the
  • step S208 the clothing matching compatibility and matching level of the first clothing image and the second clothing image are generated based on the first matching compatibility and the second matching compatibility.
  • the matching level is a level used to evaluate suitable matching between clothing items.
  • the matching level may include three levels: good, medium, and poor.
  • the clothing matching compatibility between the first clothing image and the second clothing image, and the clothing matching compatibility between the first clothing image and the second clothing image can be generated based on the matching compatibility between the clothing elements of the first clothing image and the second clothing image. 2. Matching level of clothing images.
  • the average of the matching compatibility between the clothing elements of the first clothing image and the second clothing image can be used as the clothing matching compatibility of the first clothing image and the second clothing image; for example, each of the clothing matching compatibility can also be Set weights for the clothing elements, and calculate the clothing matching compatibility of the first clothing image and the second clothing image based on the matching compatibility and weight of each clothing element of the first clothing image and the second clothing image; for example, fashion compatibility can also be used
  • the sex model generates clothing matching compatibility of the first clothing image and the second clothing image.
  • the clothing matching compatibility can be represented by a numerical value.
  • the clothing matching compatibility can be a numerical value between 0 and 1; the first clothing image and the second clothing image are determined according to the clothing matching compatibility of the first clothing image and the second clothing image.
  • the matching level of the second clothing image for example, when the clothing matching compatibility falls within the first numerical range, the matching level is the first matching level, and when the clothing matching compatibility falls within the second numerical range, the matching level is the second matching level.
  • the first compatibility 303 of the color information 3011 of the upper garment image 301 and the color information 3021 of the lower garment image 302 may be based on the second compatibility 302 of the printing information 3012 of the upper garment image 301 and the lower garment image 302 .
  • the method may further include: based on the first collocation compatibility, the second collocation compatibility and the service According to the compatibility of clothing matching, the target clothing element is determined from the first clothing element and the second clothing element; the reason for generating the matching level is obtained based on the target clothing element and the matching level.
  • the target clothing element may be the clothing element that has the greatest impact on clothing matching compatibility among various clothing elements.
  • the clothing element corresponding to the matching compatibility with the largest difference in clothing matching compatibility can be used as the target clothing element.
  • the printing element is used as the target clothing element.
  • the specific reason for generating the matching level can be obtained based on the determined target clothing element and matching level.
  • the matching level of the top image 301 and the bottom image 302 is “poor”, and the reason 308 for generating the matching level “poor” can be traced to: "The printing of the top image and the printing of the bottom image do not match. ".
  • each clothing element corresponds to an internal factor compatibility network.
  • its corresponding internal factor compatibility network can output clothing element A of the first clothing image and the second clothing image. The probability of belonging to each collocation level.
  • the reason for generating the matching level can also be automatically obtained, that is, the fashion compatibility in the embodiment of the present disclosure.
  • the gender model is an interpretable neural network model that allows users to more intuitively know the reasons for generating matching levels, making it easier to adjust clothing matching later.
  • step S210 a clothing matching combination is generated based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image.
  • the first clothing image and the second clothing image can be directly formed into a clothing matching combination according to the clothing matching compatibility and matching level of the first clothing image and the second clothing image, or the second clothing image can be replaced In order to make the third clothing image more suitable for the first clothing image, the first clothing image and the third clothing image are formed into a clothing matching combination.
  • the first clothing matching combination is generated based on the first clothing image and the second clothing image.
  • a matching suggestion for replacing the second clothing image is generated according to the target clothing element, wherein the first matching level is better than The second matching level; according to the matching suggestions, the third clothing image of the second clothing category is obtained, wherein the target of the third clothing image The clothing element and the target clothing element of the second clothing image are different; the second clothing matching combination is generated based on the first clothing image and the third clothing image.
  • the first matching level may be "good", for example, and the second matching level may be “poor”, for example.
  • the matching level of the first clothing image and the second clothing image is "good"
  • the first clothing corresponding to the first clothing image and the second clothing corresponding to the second clothing image can be directly formed into a clothing matching combination.
  • a matching suggestion for replacing the second clothing image can be generated based on the target clothing element (for example, if the target clothing element is "color”, then The matching suggestion can be "change the color of the second clothing”).
  • the second clothing image is replaced with a third clothing image, and the first clothing corresponding to the first clothing image and the third clothing corresponding to the third clothing image are composed.
  • FIG. 4 is a schematic diagram showing the application of the fashion compatibility model according to an exemplary embodiment.
  • a set of clothing outfits (which may include a first clothing image, a second clothing image, a third clothing image, and a fourth clothing image) can be input into the interpretable fashion compatibility model, and the obtained output result can be Including compatibility score (i.e., the compatibility of the above-mentioned clothing matching), overall evaluation (i.e., the above-mentioned matching grade), reasons (i.e., the reasons for generating the above-mentioned matching grade) and suggestions (i.e., the above-mentioned matching suggestions).
  • compatibility score i.e., the compatibility of the above-mentioned clothing matching
  • overall evaluation i.e., the above-mentioned matching grade
  • reasons i.e., the reasons for generating the above-mentioned matching grade
  • suggestions i.e., the above-mentioned matching suggestions.
  • the output result 405 obtained is: "Compatibility score: 0.24; Overall evaluation: bad; Reason: The color of the bag is caused by the excessive colors of the clothes. The entire outfit has lost its color balance; suggestion: change the bag to black.”
  • the output result 406 obtained is; "Compatibility score: 0.59; Overall evaluation: normal; reason: there are no matching errors and no highlights.”
  • the output result 407 is: "Compatibility score: 0.87; Overall rating: Good; Reason: The pants and shoes are of the same color and are harmonious, while the bright colors bring a bright atmosphere to the entire outfit.”
  • the explainable fashion compatibility model provided by the embodiments of the present disclosure can automatically generate the clothing matching compatibility and matching level of the first clothing image and the second clothing image, and can also automatically obtain the generation reason and matching of the matching level. Suggestions, that is, on the basis of giving the compatibility score of clothing, a clear judgment can also be given, the reasons for making the conclusion and suggestions for improvement.
  • a deep neural network model can be obtained as an interpretable fashion compatibility model based on data-driven algorithm and corresponding database training.
  • a large amount of clothing combination data can be collected and multi-dimensional attribute annotation can be performed on the clothing combination data.
  • the multi-dimensional attributes can include but are not limited to identification labels, fabrics, colors, prints, clothing categories, etc.
  • the discriminant label is used to evaluate the degree of suitability of matching between the clothing in the clothing combination.
  • the discriminant label can include but is not limited to "good”, "normal”, and "poor”.
  • the discriminant label can be judged by people with a fashion background.
  • the annotations are obtained, and a database for training the compatibility of fashion items can be constructed based on the clothing combination data and its annotations.
  • the database with discriminant labels is shown in Figure 5, for example.
  • an interpretable deep neural network framework is designed (refer to Figure 3).
  • the annotated labels and corresponding clothing pictures are input into the deep neural network.
  • the corresponding fashion item compatibility model can be obtained. type.
  • the method for intelligent matching of clothing obtains the feature values of each clothing element of the first clothing image and the second clothing image by performing feature extraction on the first clothing image and the second clothing image of different categories,
  • the clothing matching compatibility and matching level of the first clothing image and the second clothing image are automatically generated based on the matching compatibility between various clothing elements, so that the reason for generating the clothing matching compatibility and matching level can be localized to specific clothing elements, thereby This makes the generated clothing matching compatibility and matching level more accurate; in addition, the clothing matching effect in the clothing matching combination automatically generated based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image is better, improving the generation The efficiency of clothing matching and combination, thereby improving user experience.
  • the reason for generating the matching level can also be automatically obtained, that is, the fashion compatibility in the embodiments of the present disclosure.
  • the gender model is an interpretable neural network model that allows users to more intuitively know the reasons for generating matching levels, making it easier to adjust clothing matching later.
  • FIG. 6 is a flow chart of a method for intelligent matching of clothing according to an exemplary embodiment.
  • the method for intelligent matching of clothing may also include the following steps.
  • step S602 physical feature tags suitable for the clothing matching combination are determined.
  • physical characteristic tags may include but are not limited to skin color, body shape, height, hairstyle, personality, etc.
  • a large number of high-quality clothing matching combinations can be automatically generated according to the method provided in the embodiment of Figure 2. After generating the clothing matching combinations according to the embodiment of Figure 2, it can be determined whether each clothing matching combination is suitable or not. physical characteristics label.
  • FIG. 7 is a schematic diagram illustrating determining physical characteristic tags suitable for clothing matching combinations according to an example.
  • the clothing matching combination 701 and the body feature tags can be displayed on the designer's client.
  • the body feature tags can include but are not limited to: Factor 1: Body shape (straight-cylindrical, funnel-shaped with wide top and narrow bottom, hourglass shape, Large frame (sporty, inverted triangle), pear-shaped (triangular, spoon-shaped, hourglass-shaped with narrow top and wide bottom), apple-shaped, (round, diamond-shaped)), factor 2: skin color (yellowish, dark) , fair skin, bronze), Factor 3: Hair style (long curly hair, long straight hair, medium-long curly hair, medium-long straight hair, short curly hair, short straight hair), Factor 4: Hair color (ginger, black, dark brown, light Brown, grey/silver, gold), Factor 5: Height (tall, medium, short), Factor 6: Breasts (large, medium, small), Factor 7: Contrast of hair color and skin tone (high contrast (dark) Hair color/dark eyes
  • the designer can click on the physical feature tag that is suitable for the clothing matching combination 701 on the client, or click the physical feature tag that is not suitable for the clothing matching combination 701, as the physical feature tag of the clothing matching combination 701, for training the clothing matching model .
  • step S604 a clothing matching model is obtained through training based on clothing matching combinations and their suitable body feature labels.
  • a deep neural network model can be trained based on each clothing matching combination and its suitable or unsuitable body feature labels to obtain a clothing matching model.
  • step S606 the body characteristic data of the target object is obtained.
  • the target object may be, for example, a user of a shopping platform
  • the physical characteristic data of the target object may be, for example, the user's skin color, body shape, height, hairstyle, personality, etc.
  • step S608 the target object's physical characteristic data is input into the clothing matching model to obtain a target clothing matching combination suitable for the target object.
  • a personalized target clothing matching combination suitable for the user can be obtained.
  • the clothing matching model provided by the embodiment of the present disclosure can be a model with various physical characteristics. Users of the data recommend suitable target clothing combinations.
  • the target clothing matching combination may include multiple target clothing images.
  • the following description takes the target clothing matching combination including two target clothing images (ie, the first target clothing image and the second target clothing image) as an example. However, this disclosure does not Limited to this.
  • the method may further include: generating a virtual image of the target object according to the physical characteristic data of the target object; determining the dressing order of the first target clothing image and the second target clothing image; and converting the first target clothing image into The second target clothing image is fused with the virtual image based on the dressing order to generate the target clothing image.
  • a virtual image of the user can be generated based on the user's physical characteristic data.
  • a virtual image template can be obtained first, and the virtual image template can be deformed according to the user's physical characteristic data (such as height, weight, skin color, etc.) to obtain the user's virtual image. Since the user's virtual image is based on the user's Body feature data is generated, so each user's virtual image is specific and personalized.
  • the dressing order can be set for each target clothing image.
  • the dressing order of the first target clothing image can be set to the first dressing order
  • the dressing order of the second target clothing image can be set to
  • the second dressing order when fusing the first target clothing image and the second target clothing image with the virtual image based on the dressing order, first fuse the first target clothing image and the virtual image to generate an intermediate fusion image, and then fuse the first target clothing image and the virtual image, and then fuse the first target clothing image and the second target clothing image with the virtual image.
  • the two target clothing images are fused with the intermediate fusion image to generate the target outfit image.
  • the target clothing matching combination includes multiple target clothing images
  • a dressing order is set for each target clothing image, and each target clothing image and the virtual image are fused according to the dressing order to generate a target clothing image. That is, the method provided by the embodiment of the present disclosure can realize multi-level virtual dressing.
  • the above dressing sequence can be preset according to dressing logic, or can be adjusted according to user instructions.
  • the dressing logic may include, for example: wearing a skirt inside a shirt, wearing a jacket outside a vest, wearing a sweater outside a shirt, etc.
  • the dressing logic can be preset to "wear a shirt first and then a skirt", then first fuse the shirt with the user's virtual image, and then fuse the skirt with the user's virtual image to generate the target outfit image; After generating the target outfit image, if the user wants to adjust the order of outfits, they can select the skirt and drag it, and then the skirt can be superimposed on the outside of the shirt to regenerate the target outfit image.
  • the fusion process of the above target clothing image and the user's virtual image can be performed through deep neural Network model is processed.
  • a deep neural network model can be used to detect key points on the target clothing image and the user's virtual image respectively. Based on the key points obtained through the detection, the target clothing image is superimposed on the user's virtual image to generate a target outfit image.
  • Figure 8 is a schematic diagram of multi-level virtual dressing according to an example.
  • the target clothing matching combination includes a first target clothing image 801, a second target clothing image 802, a third target clothing image 803, and a fourth target clothing image 804.
  • the order of dressing is the first target clothing image. 801, the third target clothing image 803, the second target clothing image 802 and the fourth target clothing image 804, then the first target clothing image 801, the third target clothing image 803, the second target clothing image 802 and the fourth target clothing image are sequentially
  • the four target clothing images of clothing image 804 are fused with the user's virtual image to generate target outfit image 805.
  • fusing the first target clothing image and the second target clothing image with the virtual image based on the dressing order to generate the target outfit image may include: separately merging the first target clothing image and the second target clothing image. Analyze the clothing structure of the image to obtain the first clothing front image of the first target clothing image and the second clothing front image of the second target clothing image; according to the dressing order, the virtual image is sequentially matched with the first clothing front image The image is fused with the second clothing front image to generate a target outfit image.
  • both the front and part of the back part of the clothing may be displayed.
  • part of the back part may be blocked by the virtual image. That is, in the generated target
  • the above-mentioned back part does not need to be shown in the outfit image.
  • the round-neck T-shirt image is displayed alone, the back piece around the collar will be displayed.
  • the round-neck T-shirt is worn on the virtual image of the target object, the back piece around the collar will be hidden by the target object.
  • the virtual image is blocked, so before fusing the target clothing image with the virtual image, the segmentation model can be used to segment the target clothing image, that is, to distinguish the front and back pieces of the target clothing image.
  • the clothing structure of the first target clothing image can be analyzed to obtain the first clothing front piece image and the first clothing back piece image of the first target clothing image; and the clothing structure of the second target clothing image can be analyzed. Analyze and obtain the second clothing front image and the second clothing back image of the second target clothing image; according to the dressing order, fuse the virtual image with the first clothing front image and the second clothing front image in turn to generate Target outfit images.
  • the clothing back piece image of the target clothing image also needs to be superimposed on the virtual image (such as a tuxedo). Then, the first target clothing image is analyzed to obtain the first clothing front piece image and the first clothing back piece image. , and after analyzing the second target clothing image to obtain the second clothing front image and the second clothing back image, the first clothing front image, the first clothing back image, the second clothing front image and the second clothing front image are determined.
  • the sub-dressing order of the two clothing back piece images is based on the sub-dressing order of the first clothing front piece image, the first clothing back piece image, the second clothing front piece image and the second clothing back piece image.
  • the sub-dressing image, the first clothing back piece image, the second clothing front piece image and the second clothing back piece image are sequentially superimposed on the virtual image of the target object to generate a target outfit image.
  • the method for intelligent matching of clothing provided by the embodiments of the present disclosure is to obtain a clothing matching model based on clothing matching combinations and their suitable body feature labels through training, and input the physical feature data of the target object into the clothing matching model to obtain a suitable target
  • a body image that can intuitively express the target object can be generated based on the physical characteristic data of the target object.
  • the virtual image of the body features makes the generated target outfit image closer to the real effect of the target object wearing the target clothing.
  • the target clothing image and the virtual image of the target object are fused according to the dressing order of the target clothing image, which can reflect a multi-level clothing matching effect, thereby enhancing the fashion sense of clothing matching.
  • Figure 9 is a schematic diagram of an intelligent clothing matching system according to an exemplary embodiment.
  • the clothing intelligent matching system may include an interpretable compatibility learning and understanding module of fashion items (ie, the above-mentioned fashion compatibility model), a personalized fashion matching module with aesthetic cognition, and multiple Hierarchical virtual dressing module.
  • an interpretable compatibility learning and understanding module of fashion items ie, the above-mentioned fashion compatibility model
  • a personalized fashion matching module with aesthetic cognition ie, the above-mentioned fashion compatibility model
  • multiple Hierarchical virtual dressing module ie, the above-mentioned fashion compatibility model
  • the interpretable compatibility learning and understanding module of fashion items can perform clothing matching recommendation, clothing matching evaluation and clothing matching generation.
  • the purchased goods can be input into the fashion compatibility model, and the fashion compatibility model can determine the purchased items.
  • the clothing matching compatibility and matching level between the product and each clothing image in the database will recommend clothing with higher clothing matching compatibility with the purchased product to the user who purchased the product.
  • the fashion compatibility model can determine The clothing matching compatibility and matching level of each clothing image in a set of clothing, as well as the reasons for generating the matching level, find unreasonable places and give matching suggestions; for another example, a large number of high-quality can be automatically generated through the fashion compatibility model clothing combinations.
  • the body characteristic information input by target objects with different body shapes, different skin colors and different hair colors can be input to a personalized fashion matching module with aesthetic cognition, and a personalized fashion matching suitable for the target object can be output.
  • the multi-level virtual dressing module can superimpose clothing matching combinations onto the virtual image of the target object in order.
  • the embodiment in Figure 6, and the disclosure will not be repeated here.
  • Figure 10 is a block diagram of a device for intelligent matching of clothing according to an exemplary embodiment.
  • the device 1000 for intelligent matching of clothing may include an image acquisition module 1002, a feature extraction module 1004, a determination module 1006, a first generation module 1008 and a second generation module 1010.
  • the image acquisition module 1002 is used to acquire the first clothing image of the first clothing category and the second clothing image of the second clothing category;
  • the feature extraction module 1004 is used to obtain the first clothing image and the second clothing image respectively. Perform feature extraction to obtain the characteristic value of the first clothing element of the first clothing image, the characteristic value of the second clothing element of the first clothing image, and the characteristic value of the first clothing element of the second clothing image. and the characteristic value of the second clothing element of the second clothing image;
  • the determination module 1006 is used to determine the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image.
  • the clothing matching compatibility and matching level of the first clothing image and the second clothing image generate a clothing matching combination.
  • the device 1000 for intelligent matching of clothing may further include: an element determination module configured to determine the first matching compatibility, the second matching compatibility, and the clothing matching compatibility. property, determining a target clothing element from the first clothing element and the second clothing element; and a reason obtaining module, configured to obtain a reason for generating the matching level based on the target clothing element and the matching level.
  • the second generation module 1010 is configured to, if the matching level of the first clothing image and the second clothing image belongs to the first matching level, generate the first clothing image and the second clothing image according to the first matching level.
  • the two clothing images generate a first clothing matching combination.
  • the second generation module 1010 is configured to generate, if the matching level of the first clothing image and the second clothing image belongs to the second matching level, according to the target clothing element. Replace the matching suggestions of the second clothing image, wherein the first matching level is better than the second matching level; obtain a third clothing image of the second clothing category according to the matching suggestions, wherein the third clothing image is The target clothing element of the third clothing image is different from the target clothing element of the second clothing image; a second clothing matching combination is generated based on the first clothing image and the third clothing image.
  • the device 1000 for intelligent matching of clothing may further include: a label determination module for determining suitable body feature labels for the clothing matching combination; and a model training module for determining the appropriate body feature labels for the clothing matching combination.
  • the matching combination and its suitable body feature label training are used to obtain a clothing matching model;
  • the data acquisition module is used to obtain the body feature data of the target object;
  • the combination acquisition module is used to input the body feature data of the target object into the clothing matching model to obtain the target clothing matching combination suitable for the target object.
  • the target clothing matching combination includes a first target clothing image and a second target clothing image; wherein, the device 1000 for intelligent clothing matching may further include: an image generation module, configured to The physical characteristic data of the target object generates a virtual image of the target object; an order determination module is used to determine the dressing order of the first target clothing image and the second target clothing image; an image fusion module is used to The first target clothing image and the second target clothing image are fused with the virtual image based on the dressing order to generate a target outfit image.
  • an image generation module configured to The physical characteristic data of the target object generates a virtual image of the target object
  • an order determination module is used to determine the dressing order of the first target clothing image and the second target clothing image
  • an image fusion module is used to The first target clothing image and the second target clothing image are fused with the virtual image based on the dressing order to generate a target outfit image.
  • the image fusion module is configured to analyze the clothing structure of the first target clothing image and the second target clothing image respectively, and obtain the first target clothing image of the first target clothing image.
  • the image is fused to generate the target outfit image.
  • FIG. 11 is a schematic structural diagram of an electronic device according to an exemplary embodiment. It should be noted that the electronic device shown in FIG. 11 is only an example and should not have any influence on the functions and scope of use of the embodiments of the present disclosure. limit.
  • the electronic device 1100 includes a central processing unit (CPU) 1101 that can operate according to a program stored in a read-only memory (ROM) 1102 or loaded from a storage portion 1108 into a random access memory (RAM) 1103 And perform various appropriate actions and processing.
  • CPU central processing unit
  • RAM random access memory
  • various programs and data required for the operation of the system 1100 are also stored.
  • CPU 1101, ROM 1102 and RAM 1103 are connected to each other through bus 1104.
  • An input/output (I/O) interface 1105 is also connected to bus 1104.
  • the following components are connected to the I/O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., speakers, etc.; and a storage section 1108 including a hard disk, etc. ; and a communication section 1109 including a network interface card such as a LAN card, a modem, etc.
  • the communication section 1109 performs communication processing via a network such as the Internet.
  • Driver 1110 is also connected to I/O interface 1105 as needed.
  • Removable media 1111 such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive 1110 as needed, so that a computer program read therefrom is installed into the storage portion 1108 as needed.
  • embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart.
  • the computer program may be downloaded and installed from the network via communication portion 1109 and/or installed from removable media 1111 .
  • the central processing unit CPU
  • the above-described functions defined in the system of the present disclosure are performed.
  • the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
  • the computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmd read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above.
  • a computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
  • Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the foregoing.
  • each box in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more An executable instruction used to implement specified logical functions.
  • each box in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more An executable instruction used to implement specified logical functions.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved.
  • each block in the block diagram or flowchart illustration, and combinations of blocks in the block diagram or flowchart illustration can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or may be implemented by special purpose hardware-based systems that perform the specified functions or operations. Achieved by a combination of specialized hardware and computer instructions.
  • the units involved in the embodiments of the present disclosure can be implemented in software or hardware.
  • the described unit may also be provided in a processor.
  • a processor includes a sending unit, an acquisition unit, a determining unit and a first processing unit.
  • the names of these units do not constitute a limitation on the unit itself under certain circumstances.
  • the sending unit can also be described as "a unit that sends a picture acquisition request to the connected server.”
  • the present disclosure also provides a computer-readable storage medium.
  • the computer-readable storage medium may be included in the electronic device described in the above embodiments; it may also exist independently without being assembled into the electronic device. in electronic equipment.
  • the computer-readable storage medium carries one or more programs. When the one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiments. For example, the electronic device can implement various steps as shown in Figure 2.
  • a computer program product or computer program including computer instructions stored in a computer-readable storage medium.
  • the processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the methods provided in various optional implementations of the above embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • General Engineering & Computer Science (AREA)
  • Library & Information Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Development Economics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)

Abstract

Provided in the present application are a method and apparatus for intelligent clothing matching, and an electronic device and a storage medium. The method comprises: acquiring a first clothing image and a second clothing image; performing feature extraction on the first clothing image and the second clothing image, so as to obtain a feature value of a first clothing element of the first clothing image, a feature value of a second clothing element of the first clothing image, a feature value of a first clothing element of the second clothing image and a feature value of a second clothing element of the second clothing image; determining a first matching compatibility and a second matching compatibility between the first clothing image and the second clothing image; generating a clothing matching compatibility and a matching level between the first clothing image and the second clothing image according to the first matching compatibility and the second matching compatibility; and generating a clothing matching combination. By means of the method, a clothing matching combination having a better matching effect can be automatically generated according to a clothing matching compatibility and a matching level of clothing images, thereby improving the efficiency of generating the clothing matching combination, and improving the user experience.

Description

用于服饰智能搭配的方法、装置、电子设备及存储介质Methods, devices, electronic equipment and storage media for intelligent matching of clothing
相关申请的交叉引用Cross-references to related applications
本公开要求于2022年4月28日提交的申请号为202210470116.6、名称为“用于服饰智能搭配的方法、装置、电子设备及存储介质”的中国专利申请的优先权,该中国专利申请的全部内容通过引用全部并入本文。This disclosure requests the priority of the Chinese patent application with application number 202210470116.6 and titled "Method, device, electronic device and storage medium for intelligent matching of clothing" submitted on April 28, 2022. All the Chinese patent applications The contents are incorporated herein by reference in their entirety.
技术领域Technical field
本公开涉及图像处理技术领域,尤其涉及一种用于服饰智能搭配的方法、装置、电子设备及存储介质。The present disclosure relates to the field of image processing technology, and in particular, to a method, device, electronic device and storage medium for intelligent matching of clothing.
背景技术Background technique
随着计算机技术和人工智能技术的发展,越来越多的数据驱动技术被应用于各种实际产品与日常生活中。在服装行业随着数字化时代来临,服装的数字化也得到越来越多人的关注。With the development of computer technology and artificial intelligence technology, more and more data-driven technologies are being applied to various practical products and daily life. In the clothing industry, with the advent of the digital era, the digitization of clothing has attracted more and more attention.
在相关技术的服装搭配过程中,通常是获取用户输入的服装图像,根据该服装图像,向其推荐类似的服装图像,但是,推荐的服装图像和用户输入的服装图像之间不能成套搭配,或者搭配效果差。In the clothing matching process of related technologies, the clothing image input by the user is usually obtained, and similar clothing images are recommended to the user based on the clothing image. However, the recommended clothing image and the clothing image input by the user cannot be matched in a complete set, or The matching effect is poor.
需要说明的是,在上述背景技术部分公开的信息仅用于加强对本公开的背景的理解,因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。It should be noted that the information disclosed in the above background section is only used to enhance understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to those of ordinary skill in the art.
发明内容Contents of the invention
本公开的目的在于提供一种用于服饰智能搭配的方法、装置、电子设备及存储介质,该方法可以根据服饰图像的服饰搭配兼容性以及搭配等级自动生成搭配效果更好的服饰搭配组合,提高了生成服饰搭配组合的效率,从而提升用户体验。The purpose of this disclosure is to provide a method, device, electronic device and storage medium for intelligent clothing matching. This method can automatically generate clothing matching combinations with better matching effects based on the clothing matching compatibility and matching levels of clothing images, and improve It improves the efficiency of generating clothing matching combinations, thereby improving user experience.
本公开的其他特性和优点将通过下面的详细描述变得显然,或部分地通过本公开的实践而习得。Additional features and advantages of the disclosure will be apparent from the following detailed description, or, in part, may be learned by practice of the disclosure.
本公开实施例提供一种用于服饰智能搭配的方法,包括:获取第一服饰类别的第一服饰图像和第二服饰类别的第二服饰图像;分别对所述第一服饰图像和所述第二服饰图像进行特征提取,获得所述第一服饰图像的第一服饰元素的特征值和所述第一服饰图像的第二服饰元素的特征值、以及所述第二服饰图像的第一服饰元素的特征值和所述第二服饰图像的第二服饰元素的特征值;确定第一服饰图像的第一服饰元素的特征值和第二服饰图像的第一服饰元素的特征值之间的第一搭配兼容性,以及确定第一服饰图像的第二服饰元素的特征值和第二服饰图像的第二服饰元素的特征值之间的第二搭配兼容性;根据第一搭配兼容性和第二搭配兼容性,生成所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级;根据所述第一服饰图像和所述第二服饰图像的服饰搭配兼 容性及搭配等级,生成服饰搭配组合。Embodiments of the present disclosure provide a method for intelligent matching of clothing, including: obtaining a first clothing image of a first clothing category and a second clothing image of a second clothing category; and separately comparing the first clothing image and the second clothing image. Perform feature extraction on two clothing images to obtain the characteristic value of the first clothing element of the first clothing image, the characteristic value of the second clothing element of the first clothing image, and the first clothing element of the second clothing image. and the characteristic value of the second clothing element of the second clothing image; determining the first characteristic value between the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image. Matching compatibility, and determining the second matching compatibility between the characteristic value of the second clothing element of the first clothing image and the characteristic value of the second clothing element of the second clothing image; according to the first matching compatibility and the second matching Compatibility, generating clothing matching compatibility and matching level of the first clothing image and the second clothing image; according to the clothing matching compatibility of the first clothing image and the second clothing image Compatibility and matching level, generate clothing matching combinations.
在本公开一些示例性实施例中,所述方法还包括:根据所述第一搭配兼容性、所述第二搭配兼容性和所述服饰搭配兼容性,从所述第一服饰元素和所述第二服饰元素中确定目标服饰元素;根据所述目标服饰元素和所述搭配等级获得所述搭配等级的生成原因。In some exemplary embodiments of the present disclosure, the method further includes: according to the first matching compatibility, the second matching compatibility and the clothing matching compatibility, from the first clothing element and the The target clothing element is determined among the second clothing elements; and the reason for generating the matching level is obtained according to the target clothing element and the matching level.
在本公开一些示例性实施例中,根据所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合,包括:若所述第一服饰图像和所述第二服饰图像的搭配等级属于第一搭配等级,则根据所述第一服饰图像和第二服饰图像生成第一服饰搭配组合。In some exemplary embodiments of the present disclosure, generating a clothing matching combination based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image includes: if the first clothing image and the second clothing image If the matching level of the second clothing image belongs to the first matching level, a first clothing matching combination is generated based on the first clothing image and the second clothing image.
在本公开一些示例性实施例中,根据所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合,还包括:若所述第一服饰图像和所述第二服饰图像的搭配等级属于第二搭配等级,则根据所述目标服饰元素生成用于更换所述第二服饰图像的搭配建议,其中所述第一搭配等级优于所述第二搭配等级;根据所述搭配建议获取所述第二服饰类别的第三服饰图像,其中,所述第三服饰图像的目标服饰元素和所述第二服饰图像的目标服饰元素不同;根据所述第一服饰图像和所述第三服饰图像生成第二服饰搭配组合。In some exemplary embodiments of the present disclosure, generating a clothing matching combination based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image also includes: if the first clothing image and the second clothing image If the matching level of the second clothing image belongs to the second matching level, then a matching suggestion for replacing the second clothing image is generated according to the target clothing element, wherein the first matching level is better than the second matching level. ;Acquire a third clothing image of the second clothing category according to the matching suggestion, wherein the target clothing element of the third clothing image is different from the target clothing element of the second clothing image; According to the first clothing The image and the third clothing image generate a second clothing matching combination.
在本公开一些示例性实施例中,所述方法还包括:确定所述服饰搭配组合适合的身体特征标签;根据所述服饰搭配组合及其适合的身体特征标签训练获得服饰搭配模型;获取目标对象的身体特征数据;将所述目标对象的身体特征数据输入至所述服饰搭配模型,获得适合所述目标对象的目标服饰搭配组合。In some exemplary embodiments of the present disclosure, the method further includes: determining suitable body feature tags for the clothing matching combination; training to obtain a clothing matching model based on the clothing matching combination and its suitable body feature tags; and obtaining the target object The physical characteristic data of the target object is input into the clothing matching model to obtain a target clothing matching combination suitable for the target object.
在本公开一些示例性实施例中,所述目标服饰搭配组合包括第一目标服饰图像和第二目标服饰图像;其中,所述方法还包括:根据所述目标对象的身体特征数据生成所述目标对象的虚拟图像;确定所述第一目标服饰图像和所述第二目标服饰图像的穿衣顺序;将所述第一目标服饰图像和所述第二目标服饰图像基于所述穿衣顺序与所述虚拟图像进行融合,生成目标穿搭图像。In some exemplary embodiments of the present disclosure, the target clothing matching combination includes a first target clothing image and a second target clothing image; wherein the method further includes: generating the target according to the body characteristic data of the target object. a virtual image of an object; determining the dressing order of the first target clothing image and the second target clothing image; and combining the first target clothing image and the second target clothing image based on the dressing order and the The above virtual images are fused to generate the target outfit image.
在本公开一些示例性实施例中,将所述第一目标服饰图像和所述第二目标服饰图像基于所述穿衣顺序与所述虚拟图像进行融合,生成目标穿搭图像,包括:分别对所述第一目标服饰图像和所述第二目标服饰图像的服饰结构进行解析,获得所述第一目标服饰图像的第一服饰前片图像、以及所述第二目标服饰图像的第二服饰前片图像;根据所述穿衣顺序,将所述虚拟图像依次与所述第一服饰前片图像和所述第二服饰前片图像进行融合,生成所述目标穿搭图像。In some exemplary embodiments of the present disclosure, fusing the first target clothing image and the second target clothing image with the virtual image based on the dressing order to generate a target outfit image includes: respectively The clothing structures of the first target clothing image and the second target clothing image are analyzed to obtain the first clothing front image of the first target clothing image and the second clothing front image of the second target clothing image. According to the dressing order, the virtual image is sequentially fused with the first clothing front image and the second clothing front image to generate the target outfit image.
本公开提供一种用于服饰智能搭配的装置,包括:图像获取模块,用于获取第一服饰类别的第一服饰图像和第二服饰类别的第二服饰图像;特征提取模块,用于分别对所述第一服饰图像和所述第二服饰图像进行特征提取,获得所述第一服饰图像的第一服饰元素的特征值和所述第一服饰图像的第二服饰元素的特征值、以及所述第二服饰图像的第一服饰元素的特征值和所述第二服饰图像的第二服饰元素的特征值;确定模块,用于确定第一服饰图像的第一服饰元素的特征值和第二服饰图像的第一服饰元素的特征值 之间的第一搭配兼容性,以及确定第一服饰图像的第二服饰元素的特征值和第二服饰图像的第二服饰元素的特征值之间的第二搭配兼容性;第一生成模块,用于根据第一搭配兼容性和第二搭配兼容性,生成所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级;第二生成模块,用于根据所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合。The present disclosure provides a device for intelligent matching of clothing, including: an image acquisition module for acquiring a first clothing image of a first clothing category and a second clothing image of a second clothing category; a feature extraction module for respectively The first clothing image and the second clothing image perform feature extraction to obtain the characteristic value of the first clothing element of the first clothing image, the characteristic value of the second clothing element of the first clothing image, and the the characteristic value of the first clothing element of the second clothing image and the characteristic value of the second clothing element of the second clothing image; a determination module for determining the characteristic value of the first clothing element of the first clothing image and the second Characteristic value of the first clothing element of the clothing image the first matching compatibility between them, and determining the second matching compatibility between the characteristic value of the second clothing element of the first clothing image and the characteristic value of the second clothing element of the second clothing image; the first generation module, Used to generate the clothing matching compatibility and matching level of the first clothing image and the second clothing image according to the first matching compatibility and the second matching compatibility; a second generation module used to generate the clothing matching compatibility and matching level according to the first clothing image. The clothing matching compatibility and matching level of the clothing image and the second clothing image are used to generate a clothing matching combination.
本公开实施例提供一种电子设备,包括:至少一个处理器;存储装置,用于存储至少一个程序,当所述至少一个程序被所述至少一个处理器执行时,使得所述至少一个处理器实现如上述任一种用于服饰智能搭配的方法。An embodiment of the present disclosure provides an electronic device, including: at least one processor; a storage device configured to store at least one program, and when the at least one program is executed by the at least one processor, the at least one processor Implement any of the above methods for intelligent matching of clothing.
本公开实施例提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如上述任一种用于服饰智能搭配的方法。Embodiments of the present disclosure provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program implements any of the above methods for intelligent matching of clothing.
本公开实施例提供的用于服饰智能搭配的方法,通过对不同类别的第一服饰图像和第二服饰图像进行特征提取,获得第一服饰图像和第二服饰图像的各个服饰元素的特征值,根据各个服饰元素之间的搭配兼容性自动生成第一服饰图像和第二服饰图像的服饰搭配兼容性以及搭配等级,使得生成服饰搭配兼容性和搭配等级的原因可定位至具体的服饰元素,从而使得生成的服饰搭配兼容性和搭配等级更加准确;此外,根据第一服饰图像和第二服饰图像的服饰搭配兼容性以及搭配等级自动生成的服饰搭配组合中的服饰搭配效果更好,提高了生成服饰搭配组合的效率,从而提升用户体验。The method for intelligent matching of clothing provided by the embodiment of the present disclosure obtains the feature values of each clothing element of the first clothing image and the second clothing image by performing feature extraction on the first clothing image and the second clothing image of different categories, The clothing matching compatibility and matching level of the first clothing image and the second clothing image are automatically generated based on the matching compatibility between various clothing elements, so that the reason for generating the clothing matching compatibility and matching level can be localized to specific clothing elements, thereby This makes the generated clothing matching compatibility and matching level more accurate; in addition, the clothing matching effect in the clothing matching combination automatically generated based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image is better, improving the generation The efficiency of clothing matching and combination, thereby improving user experience.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and do not limit the present disclosure.
附图说明Description of the drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。显而易见地,下面描述中的附图仅仅是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.
图1示出了可以应用本公开实施例的用于服饰智能搭配的方法的示例性系统架构的示意图。FIG. 1 shows a schematic diagram of an exemplary system architecture to which the method for intelligent matching of clothing according to the embodiment of the present disclosure can be applied.
图2是根据一示例性实施方式示出的一种用于服饰智能搭配的方法的流程图。FIG. 2 is a flow chart of a method for intelligent matching of clothing according to an exemplary embodiment.
图3是根据一示例性实施方式示出的时尚兼容性模型的结构示意图。FIG. 3 is a schematic structural diagram of a fashion compatibility model according to an exemplary embodiment.
图4是根据一示例性实施方式示出的时尚兼容性模型的应用示意图。FIG. 4 is a schematic diagram showing the application of the fashion compatibility model according to an exemplary embodiment.
图5是根据一示例示出的带判别标签的服饰数据库的示意图。FIG. 5 is a schematic diagram of a clothing database with discrimination labels according to an example.
图6是根据一示例性实施方式示出的一种用于服饰智能搭配的方法的流程图。FIG. 6 is a flow chart of a method for intelligent matching of clothing according to an exemplary embodiment.
图7是根据一示例示出的确定服饰搭配组合适合的身体特征标签的示意图。FIG. 7 is a schematic diagram illustrating determining physical characteristic tags suitable for clothing matching combinations according to an example.
图8是根据一示例示出的多层次虚拟穿衣的示意图。Figure 8 is a schematic diagram of multi-level virtual dressing according to an example.
图9是根据一示例性实施例示出的一种服饰智能搭配系统的示意图。Figure 9 is a schematic diagram of an intelligent clothing matching system according to an exemplary embodiment.
图10是根据一示例性实施方式示出的一种用于服饰智能搭配的装置的框图。 Figure 10 is a block diagram of a device for intelligent matching of clothing according to an exemplary embodiment.
图11根据一示例性实施方式示出的一种电子设备的结构示意图。Figure 11 is a schematic structural diagram of an electronic device according to an exemplary embodiment.
具体实施方式Detailed ways
现在将参考附图更全面地描述示例实施方式。然而,示例实施方式能够以多种形式实施,且不应被理解为限于在此阐述的范例;相反,提供这些实施方式使得本公开将更加全面和完整,并将示例实施方式的构思全面地传达给本领域的技术人员。所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施方式中。Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concepts of the example embodiments. To those skilled in the art. The described features, structures or characteristics may be combined in any suitable manner in one or more embodiments.
此外,附图仅为本公开的示意性图解,并非一定是按比例绘制。图中相同的附图标记表示相同或类似的部分,因而将省略对它们的重复描述。附图中所示的一些方框图是功能实体,不一定必须与物理或逻辑上独立的实体相对应。可以采用软件形式来实现这些功能实体,或在一个或多个硬件模块或集成电路中实现这些功能实体,或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings represent the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and/or processor devices and/or microcontroller devices.
此外,在本公开的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。Furthermore, in the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise expressly and specifically limited. The terms “first” and “second” are used for descriptive purposes only and shall not be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as "first" and "second" may explicitly or implicitly include one or more of these features.
图1示出了可以应用本公开实施例的用于服饰智能搭配的方法的示例性系统架构的示意图。FIG. 1 shows a schematic diagram of an exemplary system architecture to which the method for intelligent matching of clothing according to the embodiment of the present disclosure can be applied.
如图1所示,该系统架构可以包括服务器101、网络102和终端设备103。网络102用以在终端设备103和服务器101之间提供通信链路的介质。网络102可以包括各种连接类型,例如有线、无线通信链路或者光纤电缆等等。As shown in Figure 1, the system architecture may include a server 101, a network 102 and a terminal device 103. The network 102 is a medium used to provide a communication link between the terminal device 103 and the server 101 . Network 102 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
本公开实施例中,服务器101可以是提供各种服务的服务器,例如对用户利用终端设备103所进行操作的装置提供支持的后台管理服务器。后台管理服务器可以对接收到的请求等数据进行分析等处理,并将处理结果反馈给终端设备103。In this embodiment of the present disclosure, the server 101 may be a server that provides various services, such as a background management server that provides support for devices operated by users using the terminal device 103 . The background management server can analyze and process the received request and other data, and feed back the processing results to the terminal device 103 .
本公开实施例中,终端设备103可以是智能手机、平板电脑、电子书阅读器、智能眼镜、智能家居设备、AR(Augmented Reality,增强现实)设备、VR(Virtual Reality,虚拟现实)设备等移动终端,或者,终端120也可以是个人计算机(Personal Computer,PC),比如膝上型便携计算机和台式计算机等等。In the embodiment of the present disclosure, the terminal device 103 may be a mobile phone, a tablet computer, an e-book reader, smart glasses, a smart home device, an AR (Augmented Reality, augmented reality) device, a VR (Virtual Reality, virtual reality) device, etc. The terminal, or the terminal 120, may also be a personal computer (Personal Computer, PC), such as a laptop computer, a desktop computer, etc.
本公开实施例中,服务器101例如可以:获取第一服饰类别的第一服饰图像和第二服饰类别的第二服饰图像;分别对第一服饰图像和第二服饰图像进行特征提取,获得第一服饰图像的第一服饰元素的特征值和第一服饰图像的第二服饰元素的特征值、以及第二服饰图像的第一服饰元素的特征值和第二服饰图像的第二服饰元素的特征值;确定第一服饰图像的第一服饰元素的特征值和第二服饰图像的第一服饰元素的特征值之间的第一搭配兼容性,以及确定第一服饰图像的第二服饰元素的特征值和第二服饰图像的第二服饰元素的特征值之间的第二搭配兼容性;根据第一搭配兼容性和第二搭配兼容性,生成第一服饰图 像和第二服饰图像的服饰搭配兼容性及搭配等级;根据第一服饰图像和第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合。In this embodiment of the present disclosure, the server 101 may, for example: obtain a first clothing image of a first clothing category and a second clothing image of a second clothing category; perform feature extraction on the first clothing image and the second clothing image respectively to obtain the first clothing image. The characteristic value of the first clothing element of the clothing image and the characteristic value of the second clothing element of the first clothing image, and the characteristic value of the first clothing element of the second clothing image and the characteristic value of the second clothing element of the second clothing image ; Determine a first matching compatibility between the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image, and determine the characteristic value of the second clothing element of the first clothing image and the second matching compatibility between the feature values of the second clothing element of the second clothing image; generate the first clothing image based on the first matching compatibility and the second matching compatibility The clothing matching compatibility and matching level of the first clothing image and the second clothing image; generating a clothing matching combination based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image.
本公开实施例中,服务器101例如可以将生成的服饰搭配组合发送至终端设备103上进行展示。In this embodiment of the present disclosure, the server 101 may, for example, send the generated clothing matching combination to the terminal device 103 for display.
本公开实施例中,目标对象例如可以通过终端设备103输入自己的身体特征数据;服务器101例如可以获取目标对象的身体特征数据;将所述目标对象的身体特征数据输入至服饰搭配模型,获得适合所述目标对象的目标服饰搭配组合;服务器101例如可以将目标服饰搭配组合发送至终端设备103进行展示,供目标对象查看和选择。In the embodiment of the present disclosure, the target object can, for example, input his or her own physical characteristic data through the terminal device 103; the server 101 can, for example, obtain the physical characteristic data of the target object; input the physical characteristic data of the target object into a clothing matching model to obtain a suitable The target clothing matching combination of the target object; for example, the server 101 can send the target clothing matching combination to the terminal device 103 for display, for the target object to view and select.
应该理解,图1中的终端设备103、网络102和服务器101的数目仅仅是示意性的,服务器101可以是一个实体的服务器,还可以为多个服务器组成的服务器集群,还可以是云端服务器,根据实际需要,可以具有任意数目的终端设备、网络和服务器。It should be understood that the number of terminal equipment 103, network 102 and server 101 in Figure 1 is only illustrative. The server 101 can be a physical server, a server cluster composed of multiple servers, or a cloud server. You can have any number of end devices, networks, and servers based on actual needs.
下面,将结合附图及实施例对本公开示例实施例中的用于服饰智能搭配的方法的各个步骤进行更详细的说明。Below, each step of the method for intelligent matching of clothing in the exemplary embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings and embodiments.
图2是根据一示例性实施方式示出的一种用于服饰智能搭配的方法的流程图。FIG. 2 is a flow chart of a method for intelligent matching of clothing according to an exemplary embodiment.
如图2所示,本公开实施例提供的用于服饰智能搭配的方法可以包括以下步骤。As shown in Figure 2, the method for intelligent matching of clothing provided by the embodiment of the present disclosure may include the following steps.
在步骤S202中,获取第一服饰类别的第一服饰图像和第二服饰类别的第二服饰图像。In step S202, a first clothing image of a first clothing category and a second clothing image of a second clothing category are obtained.
本公开实施例中,服饰可以为服装、配饰、鞋子等,服装可以为上衣、裤子、半裙、连衣裙等,配饰可以为眼镜、耳环、项链、手链、帽子、箱包(手提包、单肩包、双肩包、斜跨包)等,鞋子可以为皮鞋、运动鞋、帆布鞋、靴子等,但本公开并不限定于此。In the embodiment of the present disclosure, clothing can be clothing, accessories, shoes, etc.; clothing can be tops, pants, skirts, dresses, etc.; accessories can be glasses, earrings, necklaces, bracelets, hats, bags (handbags, shoulder bags, etc.) , backpack, cross-body bag), etc., the shoes can be leather shoes, sports shoes, canvas shoes, boots, etc., but the disclosure is not limited thereto.
本公开实施例中,服饰类别用于表示服饰的具体类别,例如上衣、下衣、鞋子、箱包、配饰等。In the embodiment of the present disclosure, the clothing category is used to represent a specific category of clothing, such as tops, bottoms, shoes, bags, accessories, etc.
本公开实施例中,可以获取多个服饰图像,其中各个服饰图像对应的服饰类别均不相同,这多个服饰图像对应的多个服饰可以组成一个服饰搭配组合。In the embodiment of the present disclosure, multiple clothing images can be obtained, in which each clothing image corresponds to a different clothing category. Multiple clothing corresponding to these multiple clothing images can form a clothing matching combination.
例如,可以获取一个上衣图像、一个下衣图像、一个箱包图像、一个鞋子图像和一个配饰图像,这些图像对应的服饰可以组成一个服饰搭配组合。For example, you can obtain a top image, a bottom image, a bag image, a shoe image, and an accessory image, and the clothing corresponding to these images can form a clothing matching combination.
在下面的举例说明中,均以获取两个服饰图像(即第一服饰图像和第二服饰图像)并对两个服饰图像进行处理为例进行说明,但本公开并不限定于此。In the following examples, the description is based on the example of acquiring two clothing images (ie, the first clothing image and the second clothing image) and processing the two clothing images, but the disclosure is not limited thereto.
本公开实施例中,第一服饰图像的服饰类别与第二服饰图像的服饰类别不同,第一服饰图像对应的第一服饰和第二图像对应的第二服饰可以组成一个服饰搭配组合。In the embodiment of the present disclosure, the clothing category of the first clothing image is different from the clothing category of the second clothing image. The first clothing corresponding to the first clothing image and the second clothing corresponding to the second image can form a clothing matching combination.
例如,第一服饰类别的第一服饰图像为上衣图像,第二服饰类别的第二服饰图像为下衣图像。For example, the first clothing image of the first clothing category is a top image, and the second clothing image of the second clothing category is a bottom clothing image.
本公开实施例中的第一服饰图像和第二服饰图像均可以是服饰单品图像,也可以是服饰组合图像,本公开对此不作限定。Both the first clothing image and the second clothing image in the embodiment of the present disclosure may be images of single items of clothing, or may be images of clothing combinations, which the disclosure is not limited to.
在步骤S204中,分别对第一服饰图像和第二服饰图像进行特征提取,获得第一服饰图像的第一服饰元素的特征值和第一服饰图像的第二服饰元素的特征值、以及第二服饰图 像的第一服饰元素的特征值和第二服饰图像的第二服饰元素的特征值。In step S204, feature extraction is performed on the first clothing image and the second clothing image respectively to obtain the feature value of the first clothing element of the first clothing image, the feature value of the second clothing element of the first clothing image, and the second clothing element. Clothing pictures The characteristic value of the first clothing element of the image and the characteristic value of the second clothing element of the second clothing image.
其中,服饰元素可以包括但不限于颜色(color)、印花(print)、材料(material)、轮廓(silhouette)和设计(design)。Among them, clothing elements may include but are not limited to color, print, material, silhouette and design.
本公开实施例中,可以分别提取第一服饰图像和第二服饰图像的多个服饰元素的特征值,下面以提取两个服饰元素(即第一服饰元素和第二服饰元素)为例进行说明,但本公开并不限定于此。In the embodiment of the present disclosure, the feature values of multiple clothing elements of the first clothing image and the second clothing image can be extracted respectively. The following description takes the extraction of two clothing elements (ie, the first clothing element and the second clothing element) as an example. , but the present disclosure is not limited thereto.
本公开实施例中,可以使用时尚兼容性模型对第一服饰图像进行特征提取,获得第一服饰图像的第一服饰元素的特征值和第一服饰图像的第二服饰元素的特征值;可以使用时尚兼容性模型对第二服饰图像进行特征提取,获得第二服饰图像的第一服饰元素的特征值和第二服饰图像的第二服饰元素的特征值。In the embodiment of the present disclosure, the fashion compatibility model can be used to perform feature extraction on the first clothing image to obtain the feature value of the first clothing element of the first clothing image and the feature value of the second clothing element of the first clothing image; you can use The fashion compatibility model performs feature extraction on the second clothing image, and obtains the feature value of the first clothing element of the second clothing image and the feature value of the second clothing element of the second clothing image.
例如,第一服饰类别的第一服饰图像为上衣图像,第二服饰类别的第二服饰图像为下衣图像,第一服饰元素为颜色、第二服饰元素为印花,则对上衣图像进行特征提取,可以获得上衣图像的颜色为红色、印花为植物印花;对下衣图像进行特征提取,可以获得下衣图像的颜色为橙色、印花为碎花印花。For example, if the first clothing image of the first clothing category is a top image, the second clothing image of the second clothing category is a bottom image, the first clothing element is color, and the second clothing element is print, then feature extraction is performed on the top image , it can be obtained that the color of the top image is red and the print is plant printing; by feature extraction of the bottom image, it can be obtained that the color of the bottom image is orange and the print is floral print.
图3是根据一示例性实施方式示出的时尚兼容性模型的结构示意图。FIG. 3 is a schematic structural diagram of a fashion compatibility model according to an exemplary embodiment.
例如,参考图3,时尚兼容性模型(也可称为可解释的深度神经网络模型)可以包括特征提取网络和内部因素兼容性网络,其中,特征提取网络用于对服饰图像进行特征提取以获得服饰图像的服饰元素的特征值,内部因素兼容性网络用于分析服饰图像的服饰元素之间的兼容性。For example, referring to Figure 3, a fashion compatibility model (also known as an interpretable deep neural network model) may include a feature extraction network and an internal factor compatibility network, where the feature extraction network is used to extract features from clothing images to obtain The eigenvalues of clothing elements of clothing images, and the internal factor compatibility network is used to analyze the compatibility between clothing elements of clothing images.
继续参考图3,可以将上衣图像301和下衣图像输入至时尚兼容性模型的特征提取网络中,特征提取网络对上衣图像301的颜色元素、印花元素、材料元素、轮廓元素和设计元素进行特征提取,获得上衣图像301的颜色信息3011、印花信息3012、材料信息3013、轮廓信息3014和设计信息3015;特征提取网络对下衣图像302的颜色元素、印花元素、材料元素、轮廓元素和设计元素进行特征提取,获得下衣图像302的颜色信息3021、印花信息3022、材料信息3023、轮廓信息3024和设计信息3025。Continuing to refer to Figure 3, the top image 301 and the bottom image can be input into the feature extraction network of the fashion compatibility model. The feature extraction network characterizes the color elements, printing elements, material elements, outline elements and design elements of the top image 301. Extract and obtain the color information 3011, printing information 3012, material information 3013, outline information 3014 and design information 3015 of the top image 301; the feature extraction network extracts the color elements, printing elements, material elements, outline elements and design elements of the bottom image 302 Feature extraction is performed to obtain the color information 3021, print information 3022, material information 3023, outline information 3024 and design information 3025 of the underwear image 302.
在步骤S206中,确定第一服饰图像的第一服饰元素的特征值和第二服饰图像的第一服饰元素的特征值之间的第一搭配兼容性,以及确定第一服饰图像的第二服饰元素的特征值和第二服饰图像的第二服饰元素的特征值之间的第二搭配兼容性。In step S206, a first matching compatibility between the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image is determined, and the second clothing of the first clothing image is determined. Second matching compatibility between the feature value of the element and the feature value of the second clothing element of the second clothing image.
本公开实施例中,第一搭配兼容性和第二搭配兼容性是用于评价服饰元素之间适合搭配的程度,服饰搭配兼容性是用于评价服饰之间适合搭配的程度。In the embodiment of the present disclosure, the first matching compatibility and the second matching compatibility are used to evaluate the degree of suitable matching between clothing elements, and the clothing matching compatibility is used to evaluate the degree of suitable matching between clothing elements.
其中,第一搭配兼容性、第二搭配兼容性和服饰搭配兼容性均可以使用数值表示,其数值越大,表示服饰元素或服饰之间越适合搭配在一起。Among them, the first matching compatibility, the second matching compatibility and the clothing matching compatibility can all be expressed by numerical values. The larger the value, the more suitable the clothing elements or clothing are to be matched together.
例如,可以确定上衣图像的颜色和下衣图像的颜色之间的搭配兼容性作为第一搭配兼容性,可以确定上衣图像的印花和下衣图像的印花之间的搭配兼容性作为第二搭配兼容性。For example, the collocation compatibility between the color of the upper garment image and the color of the lower garment image may be determined as the first collocation compatibility, and the collocation compatibility between the print of the upper garment image and the print of the lower garment image may be determined as the second collocation compatibility. sex.
例如,红色和橙色适合搭配在一起,则可以确定上衣图像的颜色和下衣图像的颜色之间的第一搭配兼容性对应的数值较大;植物印花和碎花印花不适合搭配在一起,则可以确 定上衣图像的印花和下衣图像的印花之间的第二搭配兼容性对应的数值较小。For example, if red and orange are suitable for matching together, it can be determined that the first matching compatibility between the color of the top image and the color of the bottom image is larger; if plant printing and floral printing are not suitable for matching together, then Can be sure The numerical value corresponding to the second matching compatibility between the printing of the upper garment image and the printing of the lower garment image is determined to be smaller.
继续参考图3,将上衣图像301的颜色信息3011和下衣图像302的颜色信息3021输入至内部因素兼容性网络,得到上衣图像301的颜色信息3011和下衣图像302的颜色信息3021的第一兼容性303;将上衣图像301的印花信息3012和下衣图像302的印花信息3022输入至内部因素兼容性网络,得到上衣图像301的印花信息3012和下衣图像302的印花信息3022的第二兼容性304;将上衣图像301的材料信息3013和下衣图像302的材料信息3023输入至内部因素兼容性网络,得到上衣图像301的材料信息3013和下衣图像302的材料信息3023的第三兼容性305;将上衣图像301的轮廓信息3014和下衣图像302的轮廓信息3024输入至内部因素兼容性网络,得到上衣图像301的轮廓信息3014和下衣图像302的轮廓信息3024的第四兼容性306;将上衣图像301的设计信息3015和下衣图像302的设计信息3025输入至内部因素兼容性网络,得到上衣图像301的设计信息3015和下衣图像302的设计信息3025的第五兼容性307。Continuing to refer to Figure 3, the color information 3011 of the top image 301 and the color information 3021 of the bottom image 302 are input to the internal factor compatibility network, and the first color information 3011 of the top image 301 and the color information 3021 of the bottom image 302 are obtained. Compatibility 303; input the printing information 3012 of the top image 301 and the printing information 3022 of the bottom image 302 into the internal factor compatibility network to obtain the second compatibility of the printing information 3012 of the top image 301 and the printing information 3022 of the bottom image 302 304; Input the material information 3013 of the top image 301 and the material information 3023 of the bottom image 302 into the internal factor compatibility network to obtain the third compatibility of the material information 3013 of the top image 301 and the material information 3023 of the bottom image 302 305; Input the outline information 3014 of the top image 301 and the outline information 3024 of the bottom image 302 into the internal factor compatibility network to obtain the fourth compatibility 306 of the outline information 3014 of the top image 301 and the outline information 3024 of the bottom image 302 ; Input the design information 3015 of the top image 301 and the design information 3025 of the bottom image 302 into the internal factor compatibility network to obtain the fifth compatibility 307 of the design information 3015 of the top image 301 and the design information 3025 of the bottom image 302.
在步骤S208中,根据第一搭配兼容性和第二搭配兼容性,生成第一服饰图像和第二服饰图像的服饰搭配兼容性及搭配等级。In step S208, the clothing matching compatibility and matching level of the first clothing image and the second clothing image are generated based on the first matching compatibility and the second matching compatibility.
本公开实施例中,搭配等级是用于评价服饰之间适合搭配的等级,例如搭配等级可以包括好、中、差三个等级。In the embodiment of the present disclosure, the matching level is a level used to evaluate suitable matching between clothing items. For example, the matching level may include three levels: good, medium, and poor.
本公开实施例中,可以根据第一服饰图像和第二服饰图像的各个服饰元素之间的搭配兼容性,生成第一服饰图像和第二服饰图像的服饰搭配兼容性以及第一服饰图像和第二服饰图像的搭配等级。In the embodiment of the present disclosure, the clothing matching compatibility between the first clothing image and the second clothing image, and the clothing matching compatibility between the first clothing image and the second clothing image can be generated based on the matching compatibility between the clothing elements of the first clothing image and the second clothing image. 2. Matching level of clothing images.
具体地,例如可以将第一服饰图像和第二服饰图像的各个服饰元素之间的搭配兼容性的平均值作为第一服饰图像和第二服饰图像的服饰搭配兼容性;例如也可以分别为各个服饰元素设置权重,根据第一服饰图像和第二服饰图像的各个服饰元素之间的搭配兼容性及其权重计算第一服饰图像和第二服饰图像的服饰搭配兼容性;例如也可以使用时尚兼容性模型生成第一服饰图像和第二服饰图像的服饰搭配兼容性。Specifically, for example, the average of the matching compatibility between the clothing elements of the first clothing image and the second clothing image can be used as the clothing matching compatibility of the first clothing image and the second clothing image; for example, each of the clothing matching compatibility can also be Set weights for the clothing elements, and calculate the clothing matching compatibility of the first clothing image and the second clothing image based on the matching compatibility and weight of each clothing element of the first clothing image and the second clothing image; for example, fashion compatibility can also be used The sex model generates clothing matching compatibility of the first clothing image and the second clothing image.
具体地,服饰搭配兼容性可以使用数值表示,例如服饰搭配兼容性可以为0~1之间的数值;根据第一服饰图像和第二服饰图像的服饰搭配兼容性确定出第一服饰图像和第二服饰图像的搭配等级,例如服饰搭配兼容性属于第一数值范围时搭配等级为第一搭配等级,服饰搭配兼容性属于第二数值范围时搭配等级为第二搭配等级。Specifically, the clothing matching compatibility can be represented by a numerical value. For example, the clothing matching compatibility can be a numerical value between 0 and 1; the first clothing image and the second clothing image are determined according to the clothing matching compatibility of the first clothing image and the second clothing image. The matching level of the second clothing image, for example, when the clothing matching compatibility falls within the first numerical range, the matching level is the first matching level, and when the clothing matching compatibility falls within the second numerical range, the matching level is the second matching level.
继续参考图3,例如可以根据上衣图像301的颜色信息3011和下衣图像302的颜色信息3021的第一兼容性303、上衣图像301的印花信息3012和下衣图像302的印花信息3022的第二兼容性304、上衣图像301的材料信息3013和下衣图像302的材料信息3023的第三兼容性305、上衣图像301的轮廓信息3014和下衣图像302的轮廓信息3024的第四兼容性306、以及上衣图像301的设计信息3015和下衣图像302的设计信息3025的第五兼容性307确定出上衣图像301和下衣图像302的服饰兼容性和搭配等级,其中,上衣图像301和下衣图像302的搭配等级可以为“差”。Continuing to refer to FIG. 3 , for example, the first compatibility 303 of the color information 3011 of the upper garment image 301 and the color information 3021 of the lower garment image 302 may be based on the second compatibility 302 of the printing information 3012 of the upper garment image 301 and the lower garment image 302 . Compatibility 304, the third compatibility 305 of the material information 3013 of the upper garment image 301 and the material information 3023 of the lower garment image 302, the fourth compatibility 306 of the outline information 3014 of the upper garment image 301 and the outline information 3024 of the lower garment image 302, And the fifth compatibility 307 of the design information 3015 of the upper garment image 301 and the design information 3025 of the lower garment image 302 determines the clothing compatibility and matching level of the upper garment image 301 and the lower garment image 302, wherein the upper garment image 301 and the lower garment image 302 The matching level of 302 can be "poor".
在示例性实施例中,该方法还可以包括:根据第一搭配兼容性、第二搭配兼容性和服 饰搭配兼容性,从第一服饰元素和第二服饰元素中确定目标服饰元素;根据目标服饰元素和搭配等级获得搭配等级的生成原因。In an exemplary embodiment, the method may further include: based on the first collocation compatibility, the second collocation compatibility and the service According to the compatibility of clothing matching, the target clothing element is determined from the first clothing element and the second clothing element; the reason for generating the matching level is obtained based on the target clothing element and the matching level.
本公开实施例中,目标服饰元素可以是各个服饰元素中对服饰搭配兼容性影响最大的服饰元素。In the embodiment of the present disclosure, the target clothing element may be the clothing element that has the greatest impact on clothing matching compatibility among various clothing elements.
具体地,可以将第一服饰图像和第二服饰图像的各个服饰元素对应的搭配兼容性中与服饰搭配兼容性的差值最大的搭配兼容性对应的服饰元素作为目标服饰元素。Specifically, among the matching compatibility corresponding to each clothing element of the first clothing image and the second clothing image, the clothing element corresponding to the matching compatibility with the largest difference in clothing matching compatibility can be used as the target clothing element.
例如,继续参考图3,上衣图像301的印花信息3012和下衣图像302的印花信息3022的第二兼容性304与服饰搭配兼容性的差值最大,则将印花元素作为目标服饰元素。For example, continuing to refer to Figure 3, if the difference between the second compatibility 304 of the printing information 3012 of the top image 301 and the printing information 3022 of the bottom image 302 is the largest and the clothing matching compatibility, then the printing element is used as the target clothing element.
本公开实施例中,根据确定出的目标服饰元素和搭配等级可以获得生成该搭配等级的具体原因。In the embodiment of the present disclosure, the specific reason for generating the matching level can be obtained based on the determined target clothing element and matching level.
例如,继续参考图3,上衣图像301和下衣图像302的搭配等级为“差”,可以追溯生成搭配等级为“差”的原因308为:“上衣图像的印花和下衣图像的印花不匹配”。For example, continuing to refer to Figure 3, the matching level of the top image 301 and the bottom image 302 is "poor", and the reason 308 for generating the matching level "poor" can be traced to: "The printing of the top image and the printing of the bottom image do not match. ".
本公开实施例中,每个服饰元素均对应一个内部因素兼容性网络,以服饰元素A为例,其对应的内部因素兼容性网络可以输出第一服饰图像的和第二服饰图像的服饰元素A属于每个搭配等级的概率。In this disclosed embodiment, each clothing element corresponds to an internal factor compatibility network. Taking clothing element A as an example, its corresponding internal factor compatibility network can output clothing element A of the first clothing image and the second clothing image. The probability of belonging to each collocation level.
在服饰搭配等级(即图像整体的服饰搭配等级)为“差”时,可以通过梯度推理,分别计算各个服饰元素的正向贡献(positive contribution)的差:contribu+ bad-contribu+ normal,其中contribu+ bad表示内部因素兼容性网络输出为“差”的概率,contribu+ normal表示内部因素兼容性网络输出为“中”的概率,即计算各个服饰元素对应的内部因素兼容性网络输出为差的概率与输出为中的概率,取该正向贡献的差最大的值对应的服饰元素作为目标服饰元素,图像整体的服饰搭配等级为“差”的原因就是该目标服饰元素不匹配。When the clothing matching level (that is, the clothing matching level of the overall image) is "bad", the difference in the positive contribution of each clothing element can be calculated through gradient reasoning: contribu + bad -contribu + normal , where contribu + bad represents the probability that the internal factor compatibility network output is "bad", contribu + normal represents the probability that the internal factor compatibility network output is "medium", that is, calculates the probability that the internal factor compatibility network output corresponding to each clothing element is poor. With the probability that the output is medium, the clothing element corresponding to the largest difference in the positive contribution is selected as the target clothing element. The reason why the overall clothing matching level of the image is "poor" is that the target clothing element does not match.
本公开实施例中,在自动生成第一服饰图像和第二服饰图像的服饰搭配兼容性及搭配等级的基础上,还可以自动获得该搭配等级的生成原因,即本公开实施例中的时尚兼容性模型是可解释的神经网络模型,可以使用户更加直观地知道生成搭配等级的原因,便于后续调整服饰搭配。In the embodiment of the present disclosure, on the basis of automatically generating the clothing matching compatibility and matching level of the first clothing image and the second clothing image, the reason for generating the matching level can also be automatically obtained, that is, the fashion compatibility in the embodiment of the present disclosure. The gender model is an interpretable neural network model that allows users to more intuitively know the reasons for generating matching levels, making it easier to adjust clothing matching later.
在步骤S210中,根据第一服饰图像和第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合。In step S210, a clothing matching combination is generated based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image.
本公开实施例中,可以根据第一服饰图像和第二服饰图像的服饰搭配兼容性及搭配等级,将第一服饰图像和第二服饰图像直接组成服饰搭配组合,或者,将第二服饰图像更换为更适合第一服饰图像的第三服饰图像,将第一服饰图像和第三服饰图像组成服饰搭配组合。In the embodiment of the present disclosure, the first clothing image and the second clothing image can be directly formed into a clothing matching combination according to the clothing matching compatibility and matching level of the first clothing image and the second clothing image, or the second clothing image can be replaced In order to make the third clothing image more suitable for the first clothing image, the first clothing image and the third clothing image are formed into a clothing matching combination.
在示例性实施例中,若第一服饰图像和第二服饰图像的搭配等级属于第一搭配等级,则根据第一服饰图像和第二服饰图像生成第一服饰搭配组合。In an exemplary embodiment, if the matching level of the first clothing image and the second clothing image belongs to the first matching level, the first clothing matching combination is generated based on the first clothing image and the second clothing image.
在示例性实施例中,若第一服饰图像和第二服饰图像的搭配等级属于第二搭配等级,则根据目标服饰元素生成用于更换第二服饰图像的搭配建议,其中第一搭配等级优于第二搭配等级;根据搭配建议获取第二服饰类别的第三服饰图像,其中,第三服饰图像的目标 服饰元素和第二服饰图像的目标服饰元素不同;根据第一服饰图像和第三服饰图像生成第二服饰搭配组合。In an exemplary embodiment, if the matching level of the first clothing image and the second clothing image belongs to the second matching level, a matching suggestion for replacing the second clothing image is generated according to the target clothing element, wherein the first matching level is better than The second matching level; according to the matching suggestions, the third clothing image of the second clothing category is obtained, wherein the target of the third clothing image The clothing element and the target clothing element of the second clothing image are different; the second clothing matching combination is generated based on the first clothing image and the third clothing image.
其中,第一搭配等级例如可以是“好”,第二搭配等级例如可以是“差”。The first matching level may be "good", for example, and the second matching level may be "poor", for example.
具体地,若第一服饰图像和第二服饰图像的搭配等级属于“好”,则可以直接将第一服饰图像对应的第一服饰和第二服饰图像对应的第二服饰组成一个服饰搭配组合。Specifically, if the matching level of the first clothing image and the second clothing image is "good", then the first clothing corresponding to the first clothing image and the second clothing corresponding to the second clothing image can be directly formed into a clothing matching combination.
具体地,若第一服饰图像和第二服饰图像的搭配等级属于“差”,则可以根据目标服饰元素生成用于更换第二服饰图像的搭配建议(例如,目标服饰元素为“颜色”,则搭配建议可以为“更换第二服饰的颜色”),根据搭配建议将第二服饰图像更换为第三服饰图像,将第一服饰图像对应的第一服饰和第三服饰图像对应的第三服饰组成一个服饰搭配组合。Specifically, if the matching level of the first clothing image and the second clothing image is "poor", a matching suggestion for replacing the second clothing image can be generated based on the target clothing element (for example, if the target clothing element is "color", then The matching suggestion can be "change the color of the second clothing"). According to the matching suggestion, the second clothing image is replaced with a third clothing image, and the first clothing corresponding to the first clothing image and the third clothing corresponding to the third clothing image are composed. An outfit combination.
图4是根据一示例性实施方式示出的时尚兼容性模型的应用示意图。FIG. 4 is a schematic diagram showing the application of the fashion compatibility model according to an exemplary embodiment.
参考图4,可以将一套服装穿搭(可以包括第一服饰图像、第二服饰图像、第三服饰图像和第四服饰图像)输入至可解释的时尚兼容性模型中,得到的输出结果可以包括相容性分数(即上述服饰搭配兼容性)、整体评价(即上述搭配等级)、原因(即上述搭配等级的生成原因)和建议(即上述搭配建议)。Referring to Figure 4, a set of clothing outfits (which may include a first clothing image, a second clothing image, a third clothing image, and a fourth clothing image) can be input into the interpretable fashion compatibility model, and the obtained output result can be Including compatibility score (i.e., the compatibility of the above-mentioned clothing matching), overall evaluation (i.e., the above-mentioned matching grade), reasons (i.e., the reasons for generating the above-mentioned matching grade) and suggestions (i.e., the above-mentioned matching suggestions).
例如,将一套服饰穿搭401输入至时尚兼容性模型404中,得到的输出结果405为;“相容性分数:0.24;整体评价:坏;原因:包的颜色根衣服的过多色彩让整个穿搭失去色彩平衡;建议:把包换成黑色”;又例如,将一套服饰穿搭402输入至时尚兼容性模型404中,得到的输出结果406为;“相容性分数:0.59;整体评价:正常;原因:没有什么搭配失误,也没有什么亮点”;再例如,将一套服饰穿搭403输入至时尚兼容性模型404中,得到的输出结果407为;“相容性分数:0.87;整体评价:好;原因:裤子跟鞋子同色系搭配色彩和谐,同时亮色给整套穿搭带来明亮的氛围”。For example, if a set of clothing 401 is input into the fashion compatibility model 404, the output result 405 obtained is: "Compatibility score: 0.24; Overall evaluation: bad; Reason: The color of the bag is caused by the excessive colors of the clothes. The entire outfit has lost its color balance; suggestion: change the bag to black."; For another example, if a set of clothing outfit 402 is input into the fashion compatibility model 404, the output result 406 obtained is; "Compatibility score: 0.59; Overall evaluation: normal; reason: there are no matching errors and no highlights."; For another example, if a set of clothing 403 is input into the fashion compatibility model 404, the output result 407 is: "Compatibility score: 0.87; Overall rating: Good; Reason: The pants and shoes are of the same color and are harmonious, while the bright colors bring a bright atmosphere to the entire outfit."
本公开实施例提供的可解释的时尚兼容性模型,在自动生成第一服饰图像和第二服饰图像的服饰搭配兼容性及搭配等级的基础上,还可以自动获得该搭配等级的生成原因及搭配建议,即在给出服饰的相容性分数的基础上,还可以给出明确的判断,做出该结论的理由以及可改进的建议。The explainable fashion compatibility model provided by the embodiments of the present disclosure can automatically generate the clothing matching compatibility and matching level of the first clothing image and the second clothing image, and can also automatically obtain the generation reason and matching of the matching level. Suggestions, that is, on the basis of giving the compatibility score of clothing, a clear judgment can also be given, the reasons for making the conclusion and suggestions for improvement.
本公开实施例中,可以基于数据驱动算法以及对应数据库训练得到深度神经网络模型作为可解释的时尚兼容性模型。In the embodiment of the present disclosure, a deep neural network model can be obtained as an interpretable fashion compatibility model based on data-driven algorithm and corresponding database training.
下面就该时尚兼容性模型的训练过程进行说明,但本公开并不限定于此。The training process of the fashion compatibility model will be described below, but the disclosure is not limited thereto.
首先,可以采集大量的服装组合数据,对服装组合数据进行多维度的属性标注,其中,多维度可以包括但不限于判别标签、面料、颜色、印花、服饰类别等等。其中,判别标签用于评价服装组合中的服饰之间适合搭配的程度,判别标签可以包括但不限于“好”、“正常”、“差”,判别标签可以通过具有时尚背景的人对服装组合进行标注获得,根据服装组合数据及其标注可以构建用于训练时尚单品兼容性的数据库,带判别标签的数据库例如如图5所示。First, a large amount of clothing combination data can be collected and multi-dimensional attribute annotation can be performed on the clothing combination data. The multi-dimensional attributes can include but are not limited to identification labels, fabrics, colors, prints, clothing categories, etc. Among them, the discriminant label is used to evaluate the degree of suitability of matching between the clothing in the clothing combination. The discriminant label can include but is not limited to "good", "normal", and "poor". The discriminant label can be judged by people with a fashion background. The annotations are obtained, and a database for training the compatibility of fashion items can be constructed based on the clothing combination data and its annotations. The database with discriminant labels is shown in Figure 5, for example.
基于构建的数据库,设计可解释的深度神经网络框架(参考图3),将标注的标签以及对应的服饰图片输入到深度神经网络中,经过训练迭代,即可获得相应时尚单品兼容性模 型。Based on the constructed database, an interpretable deep neural network framework is designed (refer to Figure 3). The annotated labels and corresponding clothing pictures are input into the deep neural network. After training iterations, the corresponding fashion item compatibility model can be obtained. type.
本公开实施例提供的用于服饰智能搭配的方法,通过对不同类别的第一服饰图像和第二服饰图像进行特征提取,获得第一服饰图像和第二服饰图像的各个服饰元素的特征值,根据各个服饰元素之间的搭配兼容性自动生成第一服饰图像和第二服饰图像的服饰搭配兼容性以及搭配等级,使得生成服饰搭配兼容性和搭配等级的原因可定位至具体的服饰元素,从而使得生成的服饰搭配兼容性和搭配等级更加准确;此外,根据第一服饰图像和第二服饰图像的服饰搭配兼容性以及搭配等级自动生成的服饰搭配组合中的服饰搭配效果更好,提高了生成服饰搭配组合的效率,从而提升用户体验。The method for intelligent matching of clothing provided by the embodiment of the present disclosure obtains the feature values of each clothing element of the first clothing image and the second clothing image by performing feature extraction on the first clothing image and the second clothing image of different categories, The clothing matching compatibility and matching level of the first clothing image and the second clothing image are automatically generated based on the matching compatibility between various clothing elements, so that the reason for generating the clothing matching compatibility and matching level can be localized to specific clothing elements, thereby This makes the generated clothing matching compatibility and matching level more accurate; in addition, the clothing matching effect in the clothing matching combination automatically generated based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image is better, improving the generation The efficiency of clothing matching and combination, thereby improving user experience.
在一些实施例中,在自动生成第一服饰图像和第二服饰图像的服饰搭配兼容性及搭配等级的基础上,还可以自动获得该搭配等级的生成原因,即本公开实施例中的时尚兼容性模型是可解释的神经网络模型,可以使用户更加直观地知道生成搭配等级的原因,便于后续调整服饰搭配。In some embodiments, on the basis of automatically generating the clothing matching compatibility and matching level of the first clothing image and the second clothing image, the reason for generating the matching level can also be automatically obtained, that is, the fashion compatibility in the embodiments of the present disclosure. The gender model is an interpretable neural network model that allows users to more intuitively know the reasons for generating matching levels, making it easier to adjust clothing matching later.
图6是根据一示例性实施方式示出的一种用于服饰智能搭配的方法的流程图。FIG. 6 is a flow chart of a method for intelligent matching of clothing according to an exemplary embodiment.
在图2实施例的基础上,图6实施例提供的用于服饰智能搭配的方法还可以包括以下步骤。Based on the embodiment of Figure 2, the method for intelligent matching of clothing provided by the embodiment of Figure 6 may also include the following steps.
在步骤S602中,确定服饰搭配组合适合的身体特征标签。In step S602, physical feature tags suitable for the clothing matching combination are determined.
其中,身体特征标签可以包括但不限于肤色、身型、身高、发型以及个性等。Among them, physical characteristic tags may include but are not limited to skin color, body shape, height, hairstyle, personality, etc.
本公开实施例中,可以根据图2实施例提供的方法自动生成大批高质量的服装搭配组合,在根据图2实施例生成服饰搭配组合后,可以分别确定出每个服饰搭配组合适合或者不适合的身体特征标签。In the embodiment of the present disclosure, a large number of high-quality clothing matching combinations can be automatically generated according to the method provided in the embodiment of Figure 2. After generating the clothing matching combinations according to the embodiment of Figure 2, it can be determined whether each clothing matching combination is suitable or not. physical characteristics label.
图7是根据一示例示出的确定服饰搭配组合适合的身体特征标签的示意图。FIG. 7 is a schematic diagram illustrating determining physical characteristic tags suitable for clothing matching combinations according to an example.
参考图7,可以在设计师的客户端显示服饰搭配组合701和身体特征标签,例如身体特征标签可以包括但不限于:因素1:体型(直筒型、上宽下窄的漏斗型、沙漏型、大骨架(运动型、倒三角型)、梨形(三角型、勺型、上窄下宽的沙漏型)苹果型、(圆型、钻石型)),因素2:肤色(偏黄、深色、白皙、古铜色),因素3:发型(长卷发、长直发、中长卷发、中长直发、短卷发、短直发),因素4:发色(姜黄色、黑色、深棕色、浅棕色、灰/银色、金色),因素5:身高(高个子、中等身高、矮个子),因素6:胸部(大、中、小),因素7:发色和肤色的对比度(高对比度(深发色/深色眼睛&浅肤色;浅发色/浅色眼睛&深肤色)、低对比度(深发色/深色眼睛&深肤色;浅发色/浅色眼睛&浅肤色))。Referring to Figure 7 , the clothing matching combination 701 and the body feature tags can be displayed on the designer's client. For example, the body feature tags can include but are not limited to: Factor 1: Body shape (straight-cylindrical, funnel-shaped with wide top and narrow bottom, hourglass shape, Large frame (sporty, inverted triangle), pear-shaped (triangular, spoon-shaped, hourglass-shaped with narrow top and wide bottom), apple-shaped, (round, diamond-shaped)), factor 2: skin color (yellowish, dark) , fair skin, bronze), Factor 3: Hair style (long curly hair, long straight hair, medium-long curly hair, medium-long straight hair, short curly hair, short straight hair), Factor 4: Hair color (ginger, black, dark brown, light Brown, grey/silver, gold), Factor 5: Height (tall, medium, short), Factor 6: Breasts (large, medium, small), Factor 7: Contrast of hair color and skin tone (high contrast (dark) Hair color/dark eyes & light skin tone; light hair color/light eyes & dark skin tone), low contrast (dark hair color/dark eyes & dark skin tone; light hair color/light eyes & light skin tone)).
设计师可以在客户端点击适合该服饰搭配组合701的身体特征标签,或者点击不适合该服饰搭配组合701的身体特征标签,作为该服饰搭配组合701的身体特征标签,以用于训练服饰搭配模型。The designer can click on the physical feature tag that is suitable for the clothing matching combination 701 on the client, or click the physical feature tag that is not suitable for the clothing matching combination 701, as the physical feature tag of the clothing matching combination 701, for training the clothing matching model .
在步骤S604中,根据服饰搭配组合及其适合的身体特征标签训练获得服饰搭配模型。In step S604, a clothing matching model is obtained through training based on clothing matching combinations and their suitable body feature labels.
本公开实施例中,可以根据每个服饰搭配组合及其适合或者不适合的身体特征标签训练深度神经网络模型,获得服饰搭配模型。 In the embodiment of the present disclosure, a deep neural network model can be trained based on each clothing matching combination and its suitable or unsuitable body feature labels to obtain a clothing matching model.
在步骤S606中,获取目标对象的身体特征数据。In step S606, the body characteristic data of the target object is obtained.
本公开实施例中,目的对象例如可以是购物平台的用户,目标对象的身体特征数据例如可以是用户的肤色、身型、身高、发型以及个性等。In the embodiment of the present disclosure, the target object may be, for example, a user of a shopping platform, and the physical characteristic data of the target object may be, for example, the user's skin color, body shape, height, hairstyle, personality, etc.
在步骤S608中,将目标对象的身体特征数据输入至服饰搭配模型,获得适合目标对象的目标服饰搭配组合。In step S608, the target object's physical characteristic data is input into the clothing matching model to obtain a target clothing matching combination suitable for the target object.
本公开实施例中,将用户的身体特征数据输入至服饰搭配模型中,即可获得适合该用户的个性化的目标服饰搭配组合。In this disclosed embodiment, by inputting the user's physical characteristic data into the clothing matching model, a personalized target clothing matching combination suitable for the user can be obtained.
具体地,虽然每个用户的身体特征数据均不相同,即每个用户的肤色、身型、身高、发型等都不相同,但是本公开实施例提供的服饰搭配模型可以为具有各种身体特征数据的用户推荐其适合的目标服饰搭配组合。Specifically, although each user's physical characteristic data is different, that is, each user's skin color, body shape, height, hairstyle, etc. are different, the clothing matching model provided by the embodiment of the present disclosure can be a model with various physical characteristics. Users of the data recommend suitable target clothing combinations.
其中,目标服饰搭配组合可以包括多个目标服饰图像,下面以目标服饰搭配组合包括两个目标服饰图像(即第一目标服饰图像和第二目标服饰图像)为例进行说明,但本公开并不限定于此。The target clothing matching combination may include multiple target clothing images. The following description takes the target clothing matching combination including two target clothing images (ie, the first target clothing image and the second target clothing image) as an example. However, this disclosure does not Limited to this.
在示例性实施例中,该方法还可以包括:根据目标对象的身体特征数据生成目标对象的虚拟图像;确定第一目标服饰图像和第二目标服饰图像的穿衣顺序;将第一目标服饰图像和第二目标服饰图像基于穿衣顺序与虚拟图像进行融合,生成目标穿搭图像。In an exemplary embodiment, the method may further include: generating a virtual image of the target object according to the physical characteristic data of the target object; determining the dressing order of the first target clothing image and the second target clothing image; and converting the first target clothing image into The second target clothing image is fused with the virtual image based on the dressing order to generate the target clothing image.
本公开实施例中,可以根据用户的身体特征数据生成用户的虚拟图像。例如,可以先获取虚拟图像模板,根据用户的身体特征数据(例如身高、体重、肤色等)对该虚拟图像模板进行变形,得到该用户的虚拟图像,其中,由于用户的虚拟图像是根据用户的身体特征数据生成的,因此每个用户的虚拟图像都是特定的,具有个性化的。In the embodiment of the present disclosure, a virtual image of the user can be generated based on the user's physical characteristic data. For example, a virtual image template can be obtained first, and the virtual image template can be deformed according to the user's physical characteristic data (such as height, weight, skin color, etc.) to obtain the user's virtual image. Since the user's virtual image is based on the user's Body feature data is generated, so each user's virtual image is specific and personalized.
本公开实施例中,可以为每个目标服饰图像设置穿衣顺序,例如可以将第一目标服饰图像的穿衣顺序设置为第一穿衣顺序,将第二目标服饰图像的穿衣顺序设置为第二穿衣顺序,则在将第一目标服饰图像和第二目标服饰图像基于穿衣顺序与虚拟图像进行融合时,先融合第一目标服饰图像和虚拟图像,生成中间融合图像,再将第二目标服饰图像与中间融合图像进行融合,生成目标穿搭图像。In the embodiment of the present disclosure, the dressing order can be set for each target clothing image. For example, the dressing order of the first target clothing image can be set to the first dressing order, and the dressing order of the second target clothing image can be set to For the second dressing order, when fusing the first target clothing image and the second target clothing image with the virtual image based on the dressing order, first fuse the first target clothing image and the virtual image to generate an intermediate fusion image, and then fuse the first target clothing image and the virtual image, and then fuse the first target clothing image and the second target clothing image with the virtual image. The two target clothing images are fused with the intermediate fusion image to generate the target outfit image.
在目标服饰搭配组合中包括多个目标服饰图像时,为每个目标服饰图像均设置穿衣顺序,根据穿衣顺序将各个目标服饰图像和虚拟图像进行融合,生成目标穿搭图像。即本公开实施例提供的方法,可以实现多层次虚拟穿衣。When the target clothing matching combination includes multiple target clothing images, a dressing order is set for each target clothing image, and each target clothing image and the virtual image are fused according to the dressing order to generate a target clothing image. That is, the method provided by the embodiment of the present disclosure can realize multi-level virtual dressing.
本公开实施例中,上述穿衣顺序可以根据穿衣逻辑预先设置,也可以根据用户指令进行调整。其中,穿衣逻辑例如可以包括:裙子穿在衬衫里,背心外面套外套,衬衫外面套毛衣等等。In the embodiment of the present disclosure, the above dressing sequence can be preset according to dressing logic, or can be adjusted according to user instructions. The dressing logic may include, for example: wearing a skirt inside a shirt, wearing a jacket outside a vest, wearing a sweater outside a shirt, etc.
例如,可以预先设置穿衣逻辑为“先穿衬衫再穿半身裙”,则先将衬衫与用户的虚拟图像进行融合,再将半身裙与用户的虚拟图像进行融合,生成目标穿搭图像;在生成目标穿搭图像之后,若用户想要调整穿搭顺序,则可以选中半身裙,将其进行拖动,则可以将半身裙叠加至衬衫外面,重新生成目标穿搭图像。For example, the dressing logic can be preset to "wear a shirt first and then a skirt", then first fuse the shirt with the user's virtual image, and then fuse the skirt with the user's virtual image to generate the target outfit image; After generating the target outfit image, if the user wants to adjust the order of outfits, they can select the skirt and drag it, and then the skirt can be superimposed on the outside of the shirt to regenerate the target outfit image.
本公开实施例中,上述目标服饰图像和用户的虚拟图像的融合过程可以通过深度神经 网络模型进行处理。例如可以使用深度神经网络模型分别对目标服饰图像和用户的虚拟图像进行关键点检测,根据检测获得的关键点将目标服饰图像叠加至用户的虚拟图像上,生成目标穿搭图像。In the embodiment of the present disclosure, the fusion process of the above target clothing image and the user's virtual image can be performed through deep neural Network model is processed. For example, a deep neural network model can be used to detect key points on the target clothing image and the user's virtual image respectively. Based on the key points obtained through the detection, the target clothing image is superimposed on the user's virtual image to generate a target outfit image.
图8是根据一示例示出的多层次虚拟穿衣的示意图。Figure 8 is a schematic diagram of multi-level virtual dressing according to an example.
例如,参考图8,目标服饰搭配组合包括第一目标服饰图像801、第二目标服饰图像802、第三目标服饰图像803和第四目标服饰图像804,例如穿衣顺序依次为第一目标服饰图像801、第三目标服饰图像803、第二目标服饰图像802和第四目标服饰图像804,则依次将第一目标服饰图像801、第三目标服饰图像803、第二目标服饰图像802和第四目标服饰图像804这四个目标服饰图像与用户的虚拟图像进行融合,生成目标穿搭图像805。For example, referring to Figure 8, the target clothing matching combination includes a first target clothing image 801, a second target clothing image 802, a third target clothing image 803, and a fourth target clothing image 804. For example, the order of dressing is the first target clothing image. 801, the third target clothing image 803, the second target clothing image 802 and the fourth target clothing image 804, then the first target clothing image 801, the third target clothing image 803, the second target clothing image 802 and the fourth target clothing image are sequentially The four target clothing images of clothing image 804 are fused with the user's virtual image to generate target outfit image 805.
在示例性实施例中,将第一目标服饰图像和第二目标服饰图像基于穿衣顺序与虚拟图像进行融合,生成目标穿搭图像,可以包括:分别对第一目标服饰图像和第二目标服饰图像的服饰结构进行解析,获得第一目标服饰图像的第一服饰前片图像、以及第二目标服饰图像的第二服饰前片图像;根据穿衣顺序,将虚拟图像依次与第一服饰前片图像和第二服饰前片图像进行融合,生成目标穿搭图像。In an exemplary embodiment, fusing the first target clothing image and the second target clothing image with the virtual image based on the dressing order to generate the target outfit image may include: separately merging the first target clothing image and the second target clothing image. Analyze the clothing structure of the image to obtain the first clothing front image of the first target clothing image and the second clothing front image of the second target clothing image; according to the dressing order, the virtual image is sequentially matched with the first clothing front image The image is fused with the second clothing front image to generate a target outfit image.
具体地,目标服饰图像单独显示时可能将服饰的前片和部分后片均显示出来,但是在目标服饰图像和虚拟图像进行融合时,部分后片可能会被虚拟图像挡住,即在生成的目标穿搭图像中不需要显示上述部分后片。例如在圆领T恤图像单独显示时,衣服领子周围的后片会显示出来,但是,在将圆领T恤穿到目标对象的虚拟图像上时,衣服领子周围的后片会被目标对象的虚拟图像挡住,因此在对目标服饰图像与虚拟图像进行融合前,可以使用分割模型对目标服饰图像进行分割,即将目标服饰图像的前片和后片区分出来。Specifically, when the target clothing image is displayed alone, both the front and part of the back part of the clothing may be displayed. However, when the target clothing image and the virtual image are fused, part of the back part may be blocked by the virtual image. That is, in the generated target The above-mentioned back part does not need to be shown in the outfit image. For example, when the round-neck T-shirt image is displayed alone, the back piece around the collar will be displayed. However, when the round-neck T-shirt is worn on the virtual image of the target object, the back piece around the collar will be hidden by the target object. The virtual image is blocked, so before fusing the target clothing image with the virtual image, the segmentation model can be used to segment the target clothing image, that is, to distinguish the front and back pieces of the target clothing image.
在一些实施例中,可以对第一目标服饰图像的服饰结构进行解析,获得第一目标服饰图像的第一服饰前片图像和第一服饰后片图像;对第二目标服饰图像的服饰结构进行解析,获得第二目标服饰图像的第二服饰前片图像和第二服饰后片图像;根据穿衣顺序,将虚拟图像依次与第一服饰前片图像和第二服饰前片图像进行融合,生成目标穿搭图像。In some embodiments, the clothing structure of the first target clothing image can be analyzed to obtain the first clothing front piece image and the first clothing back piece image of the first target clothing image; and the clothing structure of the second target clothing image can be analyzed. Analyze and obtain the second clothing front image and the second clothing back image of the second target clothing image; according to the dressing order, fuse the virtual image with the first clothing front image and the second clothing front image in turn to generate Target outfit images.
在一些实施例中,目标服饰图像的服饰后片图像也需要叠加至虚拟图像上(例如燕尾服),则在将第一目标服饰图像进行解析获得第一服饰前片图像和第一服饰后片图像、以及将第二目标服饰图像进行解析获得第二服饰前片图像和第二服饰后片图像之后,再确定第一服饰前片图像、第一服饰后片图像、第二服饰前片图像和第二服饰后片图像的子穿衣顺序,根据第一服饰前片图像、第一服饰后片图像、第二服饰前片图像和第二服饰后片图像的子穿衣顺序依次将第一服饰前片图像、第一服饰后片图像、第二服饰前片图像和第二服饰后片图像的子穿衣顺序叠加至目标对象的虚拟图像,生成目标穿搭图像。In some embodiments, the clothing back piece image of the target clothing image also needs to be superimposed on the virtual image (such as a tuxedo). Then, the first target clothing image is analyzed to obtain the first clothing front piece image and the first clothing back piece image. , and after analyzing the second target clothing image to obtain the second clothing front image and the second clothing back image, the first clothing front image, the first clothing back image, the second clothing front image and the second clothing front image are determined. The sub-dressing order of the two clothing back piece images is based on the sub-dressing order of the first clothing front piece image, the first clothing back piece image, the second clothing front piece image and the second clothing back piece image. The sub-dressing image, the first clothing back piece image, the second clothing front piece image and the second clothing back piece image are sequentially superimposed on the virtual image of the target object to generate a target outfit image.
本公开实施例提供的用于服饰智能搭配的方法,根据服饰搭配组合及其适合的身体特征标签训练获得服饰搭配模型,将目标对象的身体特征数据输入至所述服饰搭配模型,可以获得适合目标对象的目标服饰搭配组合,即可以获得个性化的目标服饰搭配组合,获得更直观的搭配效果,为目标对象提供更好的造型服务。The method for intelligent matching of clothing provided by the embodiments of the present disclosure is to obtain a clothing matching model based on clothing matching combinations and their suitable body feature labels through training, and input the physical feature data of the target object into the clothing matching model to obtain a suitable target By using the object's target clothing matching combination, you can obtain a personalized target clothing matching combination, obtain a more intuitive matching effect, and provide better styling services for the target object.
在一些实施例中,可以根据目标对象的身体特征数据生成可以直观表达目标对象的身 体特征的虚拟图像,使得生成的目标穿搭图像更接近于目标对象穿着目标服饰的真实效果。In some embodiments, a body image that can intuitively express the target object can be generated based on the physical characteristic data of the target object. The virtual image of the body features makes the generated target outfit image closer to the real effect of the target object wearing the target clothing.
在一些实施例中,根据目标服饰图像的穿衣顺序对目标服饰图像和目标对象的虚拟图像进行融合,可以体现多层次的服饰穿搭效果,从而提升服饰搭配的时尚感。In some embodiments, the target clothing image and the virtual image of the target object are fused according to the dressing order of the target clothing image, which can reflect a multi-level clothing matching effect, thereby enhancing the fashion sense of clothing matching.
图9是根据一示例性实施例示出的一种服饰智能搭配系统的示意图。Figure 9 is a schematic diagram of an intelligent clothing matching system according to an exemplary embodiment.
参考图9,本公开实施例提供的服饰智能搭配系统可以包括可解释的时尚单品的兼容性学习理解模块(即上述时尚兼容性模型)、个性化的具有美学认知的时尚搭配模块和多层次虚拟穿衣模块。Referring to Figure 9, the clothing intelligent matching system provided by the embodiment of the present disclosure may include an interpretable compatibility learning and understanding module of fashion items (ie, the above-mentioned fashion compatibility model), a personalized fashion matching module with aesthetic cognition, and multiple Hierarchical virtual dressing module.
其中,可解释的时尚单品的兼容性学习理解模块可以进行服饰搭配推荐、服饰搭配评价和服饰搭配生成,例如可以将购买的商品输入至时尚兼容性模型,该时尚兼容性模型可以确定购买的商品和数据库中的各个服饰图像之间的服饰搭配兼容性和搭配等级,将与购买的商品的服饰搭配兼容性较高的服饰推荐给购买该商品的用户,又例如,时尚兼容性模型可以确定一套服装穿搭中各个服饰图像的服饰搭配兼容性和搭配等级、以及搭配等级的生成原因,找到不合理的地方并给出搭配建议;再例如,可以通过时尚兼容性模型自动生成大量高质量的服饰搭配组合。Among them, the interpretable compatibility learning and understanding module of fashion items can perform clothing matching recommendation, clothing matching evaluation and clothing matching generation. For example, the purchased goods can be input into the fashion compatibility model, and the fashion compatibility model can determine the purchased items. The clothing matching compatibility and matching level between the product and each clothing image in the database will recommend clothing with higher clothing matching compatibility with the purchased product to the user who purchased the product. For example, the fashion compatibility model can determine The clothing matching compatibility and matching level of each clothing image in a set of clothing, as well as the reasons for generating the matching level, find unreasonable places and give matching suggestions; for another example, a large number of high-quality can be automatically generated through the fashion compatibility model clothing combinations.
其中,可以将不同身材、不同肤色和不同发色的目标对象输入的身体特征信息至个性化的具有美学认知的时尚搭配模块,输出适合目标对象的个性化时尚搭配。Among them, the body characteristic information input by target objects with different body shapes, different skin colors and different hair colors can be input to a personalized fashion matching module with aesthetic cognition, and a personalized fashion matching suitable for the target object can be output.
其中,多层次虚拟穿衣模块可以将服饰搭配组合按照顺序叠加至目标对象的虚拟图像上,具体可参见图6实施例,本公开在此不再赘述。Among them, the multi-level virtual dressing module can superimpose clothing matching combinations onto the virtual image of the target object in order. For details, please refer to the embodiment in Figure 6, and the disclosure will not be repeated here.
需要注意的是,上述附图仅是根据本公开示例性实施例的方法所包括的处理的示意性说明,而不是限制目的。易于理解,上述附图所示的处理并不表明或限制这些处理的时间顺序。另外,也易于理解,这些处理可以是例如在多个模块中同步或异步执行的。It should be noted that the above-mentioned drawings are only schematic illustrations of processes included in methods according to exemplary embodiments of the present disclosure, and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal sequence of these processes. In addition, it is also easy to understand that these processes may be executed synchronously or asynchronously in multiple modules, for example.
下述为本公开装置实施例,可以用于执行本公开方法实施例。对于本公开装置实施例中未披露的细节,请参照本公开方法实施例。The following are device embodiments of the present disclosure, which can be used to perform method embodiments of the present disclosure. For details not disclosed in the device embodiments of the disclosure, please refer to the method embodiments of the disclosure.
图10是根据一示例性实施方式示出的一种用于服饰智能搭配的装置的框图。Figure 10 is a block diagram of a device for intelligent matching of clothing according to an exemplary embodiment.
如图10所示,用于服饰智能搭配的装置1000可以包括图像获取模块1002、特征提取模块1004、确定模块1006、第一生成模块1008和第二生成模块1010。As shown in Figure 10, the device 1000 for intelligent matching of clothing may include an image acquisition module 1002, a feature extraction module 1004, a determination module 1006, a first generation module 1008 and a second generation module 1010.
其中,图像获取模块1002用于获取第一服饰类别的第一服饰图像和第二服饰类别的第二服饰图像;特征提取模块1004用于分别对所述第一服饰图像和所述第二服饰图像进行特征提取,获得所述第一服饰图像的第一服饰元素的特征值和所述第一服饰图像的第二服饰元素的特征值、以及所述第二服饰图像的第一服饰元素的特征值和所述第二服饰图像的第二服饰元素的特征值;确定模块1006用于确定第一服饰图像的第一服饰元素的特征值和第二服饰图像的第一服饰元素的特征值之间的第一搭配兼容性,以及确定第一服饰图像的第二服饰元素的特征值和第二服饰图像的第二服饰元素的特征值之间的第二搭配兼容性;第一生成模块1008用于根据第一搭配兼容性和第二搭配兼容性,生成所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级;第二生成模块1010用于根据 所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合。Among them, the image acquisition module 1002 is used to acquire the first clothing image of the first clothing category and the second clothing image of the second clothing category; the feature extraction module 1004 is used to obtain the first clothing image and the second clothing image respectively. Perform feature extraction to obtain the characteristic value of the first clothing element of the first clothing image, the characteristic value of the second clothing element of the first clothing image, and the characteristic value of the first clothing element of the second clothing image. and the characteristic value of the second clothing element of the second clothing image; the determination module 1006 is used to determine the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image. The first matching compatibility, and determining the second matching compatibility between the characteristic value of the second clothing element of the first clothing image and the characteristic value of the second clothing element of the second clothing image; the first generation module 1008 is used to determine the second matching compatibility according to The first matching compatibility and the second matching compatibility are used to generate the clothing matching compatibility and matching level of the first clothing image and the second clothing image; the second generation module 1010 is used to generate the clothing matching compatibility and matching level according to the first clothing image and the second clothing image. The clothing matching compatibility and matching level of the first clothing image and the second clothing image generate a clothing matching combination.
在本公开一些示例性实施例中,用于服饰智能搭配的装置1000还可以包括:元素确定模块,用于根据所述第一搭配兼容性、所述第二搭配兼容性和所述服饰搭配兼容性,从所述第一服饰元素和所述第二服饰元素中确定目标服饰元素;原因获得模块,用于根据所述目标服饰元素和所述搭配等级获得所述搭配等级的生成原因。In some exemplary embodiments of the present disclosure, the device 1000 for intelligent matching of clothing may further include: an element determination module configured to determine the first matching compatibility, the second matching compatibility, and the clothing matching compatibility. property, determining a target clothing element from the first clothing element and the second clothing element; and a reason obtaining module, configured to obtain a reason for generating the matching level based on the target clothing element and the matching level.
在本公开一些示例性实施例中,第二生成模块1010用于若所述第一服饰图像和所述第二服饰图像的搭配等级属于第一搭配等级,则根据所述第一服饰图像和第二服饰图像生成第一服饰搭配组合。In some exemplary embodiments of the present disclosure, the second generation module 1010 is configured to, if the matching level of the first clothing image and the second clothing image belongs to the first matching level, generate the first clothing image and the second clothing image according to the first matching level. The two clothing images generate a first clothing matching combination.
在本公开一些示例性实施例中,第二生成模块1010用于若所述第一服饰图像和所述第二服饰图像的搭配等级属于第二搭配等级,则根据所述目标服饰元素生成用于更换所述第二服饰图像的搭配建议,其中所述第一搭配等级优于所述第二搭配等级;根据所述搭配建议获取所述第二服饰类别的第三服饰图像,其中,所述第三服饰图像的目标服饰元素和所述第二服饰图像的目标服饰元素不同;根据所述第一服饰图像和所述第三服饰图像生成第二服饰搭配组合。In some exemplary embodiments of the present disclosure, the second generation module 1010 is configured to generate, if the matching level of the first clothing image and the second clothing image belongs to the second matching level, according to the target clothing element. Replace the matching suggestions of the second clothing image, wherein the first matching level is better than the second matching level; obtain a third clothing image of the second clothing category according to the matching suggestions, wherein the third clothing image is The target clothing element of the third clothing image is different from the target clothing element of the second clothing image; a second clothing matching combination is generated based on the first clothing image and the third clothing image.
在本公开一些示例性实施例中,用于服饰智能搭配的装置1000还可以包括:标签确定模块,用于确定所述服饰搭配组合适合的身体特征标签;模型训练模块,用于根据所述服饰搭配组合及其适合的身体特征标签训练获得服饰搭配模型;数据获取模块,用于获取目标对象的身体特征数据;组合获得模块,用于将所述目标对象的身体特征数据输入至所述服饰搭配模型,获得适合所述目标对象的目标服饰搭配组合。In some exemplary embodiments of the present disclosure, the device 1000 for intelligent matching of clothing may further include: a label determination module for determining suitable body feature labels for the clothing matching combination; and a model training module for determining the appropriate body feature labels for the clothing matching combination. The matching combination and its suitable body feature label training are used to obtain a clothing matching model; the data acquisition module is used to obtain the body feature data of the target object; the combination acquisition module is used to input the body feature data of the target object into the clothing matching model to obtain the target clothing matching combination suitable for the target object.
在本公开一些示例性实施例中,所述目标服饰搭配组合包括第一目标服饰图像和第二目标服饰图像;其中,用于服饰智能搭配的装置1000还可以包括:图像生成模块,用于根据所述目标对象的身体特征数据生成所述目标对象的虚拟图像;顺序确定模块,用于确定所述第一目标服饰图像和所述第二目标服饰图像的穿衣顺序;图像融合模块,用于将所述第一目标服饰图像和所述第二目标服饰图像基于所述穿衣顺序与所述虚拟图像进行融合,生成目标穿搭图像。In some exemplary embodiments of the present disclosure, the target clothing matching combination includes a first target clothing image and a second target clothing image; wherein, the device 1000 for intelligent clothing matching may further include: an image generation module, configured to The physical characteristic data of the target object generates a virtual image of the target object; an order determination module is used to determine the dressing order of the first target clothing image and the second target clothing image; an image fusion module is used to The first target clothing image and the second target clothing image are fused with the virtual image based on the dressing order to generate a target outfit image.
在本公开一些示例性实施例中,图像融合模块,用于分别对所述第一目标服饰图像和所述第二目标服饰图像的服饰结构进行解析,获得所述第一目标服饰图像的第一服饰前片图像、以及所述第二目标服饰图像的第二服饰前片图像;根据所述穿衣顺序,将所述虚拟图像依次与所述第一服饰前片图像和所述第二服饰前片图像进行融合,生成所述目标穿搭图像。In some exemplary embodiments of the present disclosure, the image fusion module is configured to analyze the clothing structure of the first target clothing image and the second target clothing image respectively, and obtain the first target clothing image of the first target clothing image. The clothing front image and the second clothing front image of the second target clothing image; according to the dressing order, the virtual image is sequentially matched with the first clothing front image and the second clothing front image. The image is fused to generate the target outfit image.
需要注意的是,上述附图中所示的框图是功能实体,不一定必须与物理或逻辑上独立的实体相对应。可以采用软件形式来实现这些功能实体,或在一个或多个硬件模块或集成电路中实现这些功能实体,或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。It should be noted that the block diagrams shown in the above figures are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and/or processor devices and/or microcontroller devices.
图11是根据一示例性实施方式示出的一种电子设备的结构示意图。需要说明的是,图11示出的电子设备仅仅是一个示例,不应对本公开实施例的功能和使用范围带来任何 限制。FIG. 11 is a schematic structural diagram of an electronic device according to an exemplary embodiment. It should be noted that the electronic device shown in FIG. 11 is only an example and should not have any influence on the functions and scope of use of the embodiments of the present disclosure. limit.
如图11所示,电子设备1100包括中央处理单元(CPU)1101,其可以根据存储在只读存储器(ROM)1102中的程序或者从存储部分1108加载到随机访问存储器(RAM)1103中的程序而执行各种适当的动作和处理。在RAM 1103中,还存储有系统1100操作所需的各种程序和数据。CPU 1101、ROM 1102以及RAM 1103通过总线1104彼此相连。输入/输出(I/O)接口1105也连接至总线1104。As shown in FIG. 11 , the electronic device 1100 includes a central processing unit (CPU) 1101 that can operate according to a program stored in a read-only memory (ROM) 1102 or loaded from a storage portion 1108 into a random access memory (RAM) 1103 And perform various appropriate actions and processing. In the RAM 1103, various programs and data required for the operation of the system 1100 are also stored. CPU 1101, ROM 1102 and RAM 1103 are connected to each other through bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.
以下部件连接至I/O接口1105:包括键盘、鼠标等的输入部分1106;包括诸如阴极射线管(CRT)、液晶显示器(LCD)等以及扬声器等的输出部分1107;包括硬盘等的存储部分1108;以及包括诸如LAN卡、调制解调器等的网络接口卡的通信部分1109。通信部分1109经由诸如因特网的网络执行通信处理。驱动器1110也根据需要连接至I/O接口1105。可拆卸介质1111,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器1110上,以便于从其上读出的计算机程序根据需要被安装入存储部分1108。The following components are connected to the I/O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., speakers, etc.; and a storage section 1108 including a hard disk, etc. ; and a communication section 1109 including a network interface card such as a LAN card, a modem, etc. The communication section 1109 performs communication processing via a network such as the Internet. Driver 1110 is also connected to I/O interface 1105 as needed. Removable media 1111, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive 1110 as needed, so that a computer program read therefrom is installed into the storage portion 1108 as needed.
特别地,根据本公开的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本公开的实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信部分1109从网络上被下载和安装,和/或从可拆卸介质1111被安装。在该计算机程序被中央处理单元(CPU)1101执行时,执行本公开的系统中限定的上述功能。In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communication portion 1109 and/or installed from removable media 1111 . When the computer program is executed by the central processing unit (CPU) 1101, the above-described functions defined in the system of the present disclosure are performed.
需要说明的是,本公开所示的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中,计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:无线、电线、光缆、RF等等,或者上述的任意合适的组合。It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmed read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the foregoing.
附图中的流程图和框图,图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,上述模块、程序段、或代码的一部分包含一个或多 个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图或流程图中的每个方框、以及框图或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more An executable instruction used to implement specified logical functions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block in the block diagram or flowchart illustration, and combinations of blocks in the block diagram or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or may be implemented by special purpose hardware-based systems that perform the specified functions or operations. Achieved by a combination of specialized hardware and computer instructions.
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现,也可以通过硬件的方式来实现。所描述的单元也可以设置在处理器中,例如,可以描述为:一种处理器包括发送单元、获取单元、确定单元和第一处理单元。其中,这些单元的名称在某种情况下并不构成对该单元本身的限定,例如,发送单元还可以被描述为“向所连接的服务端发送图片获取请求的单元”。The units involved in the embodiments of the present disclosure can be implemented in software or hardware. The described unit may also be provided in a processor. For example, it may be described as follows: a processor includes a sending unit, an acquisition unit, a determining unit and a first processing unit. The names of these units do not constitute a limitation on the unit itself under certain circumstances. For example, the sending unit can also be described as "a unit that sends a picture acquisition request to the connected server."
作为另一方面,本公开还提供了一种计算机可读存储介质,该计算机可读存储介质可以是上述实施例中描述的电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。上述计算机可读存储介质承载有一个或者多个程序,当上述一个或者多个程序被一个该电子设备执行时,使得该电子设备实现如上述实施例中所述的方法。例如,所述的电子设备可以实现如图2所示的各个步骤。As another aspect, the present disclosure also provides a computer-readable storage medium. The computer-readable storage medium may be included in the electronic device described in the above embodiments; it may also exist independently without being assembled into the electronic device. in electronic equipment. The computer-readable storage medium carries one or more programs. When the one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiments. For example, the electronic device can implement various steps as shown in Figure 2.
根据本公开的一个方面,提供了一种计算机程序产品或计算机程序,该计算机程序产品或计算机程序包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行上述实施例的各种可选实现方式中提供的方法。According to one aspect of the present disclosure, a computer program product or computer program is provided, the computer program product or computer program including computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the methods provided in various optional implementations of the above embodiments.
需要理解的是,在本公开附图中的任何元素数量均用于示例而非限制,以及任何命名都仅用于区分,而不具有任何限制含义。It should be understood that any number of elements in the drawings of the present disclosure is for illustration rather than limitation, and any naming is only for differentiation without any limiting meaning.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本公开旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本公开的真正范围和精神由下面的权利要求指出。Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the disclosure that follow the general principles of the disclosure and include common common sense or customary technical means in the technical field that are not disclosed in the disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。 It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the disclosure is limited only by the appended claims.

Claims (10)

  1. 一种用于服饰智能搭配的方法,其中,包括:A method for intelligent matching of clothing, including:
    获取第一服饰类别的第一服饰图像和第二服饰类别的第二服饰图像;Obtain the first clothing image of the first clothing category and the second clothing image of the second clothing category;
    分别对所述第一服饰图像和所述第二服饰图像进行特征提取,获得所述第一服饰图像的第一服饰元素的特征值和所述第一服饰图像的第二服饰元素的特征值、以及所述第二服饰图像的第一服饰元素的特征值和所述第二服饰图像的第二服饰元素的特征值;Perform feature extraction on the first clothing image and the second clothing image respectively to obtain the characteristic value of the first clothing element of the first clothing image and the characteristic value of the second clothing element of the first clothing image, And the characteristic value of the first clothing element of the second clothing image and the characteristic value of the second clothing element of the second clothing image;
    确定第一服饰图像的第一服饰元素的特征值和第二服饰图像的第一服饰元素的特征值之间的第一搭配兼容性,以及确定第一服饰图像的第二服饰元素的特征值和第二服饰图像的第二服饰元素的特征值之间的第二搭配兼容性;Determining a first matching compatibility between the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image, and determining the sum of the characteristic values of the second clothing element of the first clothing image the second matching compatibility between the feature values of the second clothing elements of the second clothing image;
    根据第一搭配兼容性和第二搭配兼容性,生成所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级;According to the first matching compatibility and the second matching compatibility, generate the clothing matching compatibility and matching level of the first clothing image and the second clothing image;
    根据所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合。A clothing matching combination is generated based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image.
  2. 根据权利要求1所述的方法,其中,还包括:The method of claim 1, further comprising:
    根据所述第一搭配兼容性、所述第二搭配兼容性和所述服饰搭配兼容性,从所述第一服饰元素和所述第二服饰元素中确定目标服饰元素;Determine a target clothing element from the first clothing element and the second clothing element according to the first matching compatibility, the second matching compatibility and the clothing matching compatibility;
    根据所述目标服饰元素和所述搭配等级获得所述搭配等级的生成原因。The reason for generating the matching level is obtained according to the target clothing element and the matching level.
  3. 根据权利要求1或2所述的方法,其中,根据所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合,包括:The method according to claim 1 or 2, wherein generating a clothing matching combination based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image includes:
    若所述第一服饰图像和所述第二服饰图像的搭配等级属于第一搭配等级,则根据所述第一服饰图像和第二服饰图像生成第一服饰搭配组合。If the matching level of the first clothing image and the second clothing image belongs to the first matching level, a first clothing matching combination is generated based on the first clothing image and the second clothing image.
  4. 根据权利要求3所述的方法,其中,根据所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合,还包括:The method according to claim 3, wherein generating a clothing matching combination according to the clothing matching compatibility and matching level of the first clothing image and the second clothing image further includes:
    若所述第一服饰图像和所述第二服饰图像的搭配等级属于第二搭配等级,则根据所述目标服饰元素生成用于更换所述第二服饰图像的搭配建议,其中所述第一搭配等级优于所述第二搭配等级;If the matching level of the first clothing image and the second clothing image belongs to the second matching level, a matching suggestion for replacing the second clothing image is generated according to the target clothing element, wherein the first matching The level is better than the second matching level;
    根据所述搭配建议获取所述第二服饰类别的第三服饰图像,其中,所述第三服饰图像的目标服饰元素和所述第二服饰图像的目标服饰元素不同;Obtain a third clothing image of the second clothing category according to the matching suggestion, wherein the target clothing element of the third clothing image is different from the target clothing element of the second clothing image;
    根据所述第一服饰图像和所述第三服饰图像生成第二服饰搭配组合。A second clothing matching combination is generated based on the first clothing image and the third clothing image.
  5. 根据权利要求1所述的方法,其中,还包括:The method of claim 1, further comprising:
    确定所述服饰搭配组合适合的身体特征标签;Determine the physical characteristic tags suitable for the clothing matching combination;
    根据所述服饰搭配组合及其适合的身体特征标签训练获得服饰搭配模型;Obtain a clothing matching model based on training of the clothing matching combinations and their suitable body feature labels;
    获取目标对象的身体特征数据;Obtain the physical characteristic data of the target object;
    将所述目标对象的身体特征数据输入至所述服饰搭配模型,获得适合所述目标对象的目标服饰搭配组合。 Input the physical characteristic data of the target object into the clothing matching model to obtain a target clothing matching combination suitable for the target object.
  6. 根据权利要求5所述的方法,其中,所述目标服饰搭配组合包括第一目标服饰图像和第二目标服饰图像;The method according to claim 5, wherein the target clothing matching combination includes a first target clothing image and a second target clothing image;
    其中,所述方法还包括:Wherein, the method also includes:
    根据所述目标对象的身体特征数据生成所述目标对象的虚拟图像;Generate a virtual image of the target object based on the physical characteristic data of the target object;
    确定所述第一目标服饰图像和所述第二目标服饰图像的穿衣顺序;Determine the dressing order of the first target clothing image and the second target clothing image;
    将所述第一目标服饰图像和所述第二目标服饰图像基于所述穿衣顺序与所述虚拟图像进行融合,生成目标穿搭图像。The first target clothing image and the second target clothing image are fused with the virtual image based on the dressing order to generate a target outfit image.
  7. 根据权利要求6所述的方法,其中,将所述第一目标服饰图像和所述第二目标服饰图像基于所述穿衣顺序与所述虚拟图像进行融合,生成目标穿搭图像,包括:The method according to claim 6, wherein the first target clothing image and the second target clothing image are fused with the virtual image based on the dressing order to generate a target outfit image, including:
    分别对所述第一目标服饰图像和所述第二目标服饰图像的服饰结构进行解析,获得所述第一目标服饰图像的第一服饰前片图像、以及所述第二目标服饰图像的第二服饰前片图像;Analyze the clothing structure of the first target clothing image and the second target clothing image respectively to obtain the first clothing front image of the first target clothing image and the second clothing front image of the second target clothing image. Clothing front image;
    根据所述穿衣顺序,将所述虚拟图像依次与所述第一服饰前片图像和所述第二服饰前片图像进行融合,生成所述目标穿搭图像。According to the dressing order, the virtual image is sequentially fused with the first clothing front image and the second clothing front image to generate the target outfit image.
  8. 一种用于服饰智能搭配的装置,其中,包括:A device for intelligent matching of clothing, including:
    图像获取模块,用于获取第一服饰类别的第一服饰图像和第二服饰类别的第二服饰图像;An image acquisition module, configured to acquire a first clothing image of a first clothing category and a second clothing image of a second clothing category;
    特征提取模块,用于分别对所述第一服饰图像和所述第二服饰图像进行特征提取,获得所述第一服饰图像的第一服饰元素的特征值和所述第一服饰图像的第二服饰元素的特征值、以及所述第二服饰图像的第一服饰元素的特征值和所述第二服饰图像的第二服饰元素的特征值;A feature extraction module, configured to perform feature extraction on the first clothing image and the second clothing image respectively, and obtain the characteristic value of the first clothing element of the first clothing image and the second characteristic value of the first clothing image. The characteristic value of the clothing element, the characteristic value of the first clothing element of the second clothing image, and the characteristic value of the second clothing element of the second clothing image;
    确定模块,用于确定第一服饰图像的第一服饰元素的特征值和第二服饰图像的第一服饰元素的特征值之间的第一搭配兼容性,以及确定第一服饰图像的第二服饰元素的特征值和第二服饰图像的第二服饰元素的特征值之间的第二搭配兼容性;A determination module for determining a first matching compatibility between the characteristic value of the first clothing element of the first clothing image and the characteristic value of the first clothing element of the second clothing image, and determining the second clothing of the first clothing image. the second matching compatibility between the feature value of the element and the feature value of the second clothing element of the second clothing image;
    第一生成模块,用于根据第一搭配兼容性和第二搭配兼容性,生成所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级;A first generation module, configured to generate the clothing matching compatibility and matching level of the first clothing image and the second clothing image according to the first matching compatibility and the second matching compatibility;
    第二生成模块,用于根据所述第一服饰图像和所述第二服饰图像的服饰搭配兼容性及搭配等级,生成服饰搭配组合。The second generation module is used to generate a clothing matching combination based on the clothing matching compatibility and matching level of the first clothing image and the second clothing image.
  9. 一种电子设备,其中,包括:An electronic device, including:
    至少一个处理器;at least one processor;
    存储装置,用于存储至少一个程序,当所述至少一个程序被所述至少一个处理器执行时,使得所述至少一个处理器实现如权利要求1至7中任一项所述的方法。A storage device configured to store at least one program, so that when the at least one program is executed by the at least one processor, the at least one processor implements the method according to any one of claims 1 to 7.
  10. 一种计算机可读存储介质,其上存储有计算机可执行指令,其中,所述可执行指令被处理器执行时实现如权利要求1至7中任一项所述的方法。 A computer-readable storage medium having computer-executable instructions stored thereon, wherein the method according to any one of claims 1 to 7 is implemented when the executable instructions are executed by a processor.
PCT/CN2023/089038 2022-04-28 2023-04-18 Method and apparatus for intelligent clothing matching, and electronic device and storage medium WO2023207681A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210470116.6 2022-04-28
CN202210470116.6A CN117056548A (en) 2022-04-28 2022-04-28 Method and device for intelligent collocation of clothes, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
WO2023207681A1 true WO2023207681A1 (en) 2023-11-02
WO2023207681A9 WO2023207681A9 (en) 2024-01-18

Family

ID=88517714

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/089038 WO2023207681A1 (en) 2022-04-28 2023-04-18 Method and apparatus for intelligent clothing matching, and electronic device and storage medium

Country Status (2)

Country Link
CN (1) CN117056548A (en)
WO (1) WO2023207681A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106485515A (en) * 2016-10-28 2017-03-08 宇龙计算机通信科技(深圳)有限公司 Intelligent clothing matching method, system, terminal unit and wardrobe
CN110909746A (en) * 2018-09-18 2020-03-24 深圳云天励飞技术有限公司 Clothing recommendation method, related device and equipment
CN111325226A (en) * 2018-12-14 2020-06-23 北京京东尚科信息技术有限公司 Information presentation method and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106485515A (en) * 2016-10-28 2017-03-08 宇龙计算机通信科技(深圳)有限公司 Intelligent clothing matching method, system, terminal unit and wardrobe
CN110909746A (en) * 2018-09-18 2020-03-24 深圳云天励飞技术有限公司 Clothing recommendation method, related device and equipment
CN111325226A (en) * 2018-12-14 2020-06-23 北京京东尚科信息技术有限公司 Information presentation method and device

Also Published As

Publication number Publication date
WO2023207681A9 (en) 2024-01-18
CN117056548A (en) 2023-11-14

Similar Documents

Publication Publication Date Title
US11715294B2 (en) Systems and methods for improving visual search using summarization feature
US10242396B2 (en) Automatic color palette based recommendations for affiliated colors
JP6825141B2 (en) Fashion coordination recommendation methods and devices, electronic devices, storage media
US11983748B2 (en) Using artificial intelligence to determine a size fit prediction
US20210209510A1 (en) Using artificial intelligence to determine a value for a variable size component
KR102664008B1 (en) Method and device to recommend customer item based on visual information
Zhou et al. Fashion recommendations through cross-media information retrieval
Hsiao et al. ViBE: Dressing for diverse body shapes
CN111325226B (en) Information presentation method and device
KR20210098884A (en) A method of providing a fashion item recommendation service using a body shape and purchase history
CN109614925A (en) Dress ornament attribute recognition approach and device, electronic equipment, storage medium
CN111767817B (en) Dress collocation method and device, electronic equipment and storage medium
KR20210031223A (en) Method and System of recommending fashion based on vector based deep learning
Shimizu et al. Fashion intelligence system: An outfit interpretation utilizing images and rich abstract tags
US11972466B2 (en) Computer storage media, method, and system for exploring and recommending matching products across categories
Zhang et al. Fashion evaluation method for clothing recommendation based on weak appearance feature
Chen et al. A survey of artificial intelligence in fashion
US20170154472A1 (en) System and method for determining custom sizes by visual annotation
CN116127199B (en) User preference modeling method for clothing sequence recommendation
CN112508114A (en) Intelligent clothing recommendation system and method
WO2023207681A1 (en) Method and apparatus for intelligent clothing matching, and electronic device and storage medium
CN113793397B (en) Garment attribute editing method based on improved WGAN
Shimizu et al. Partial visual-semantic embedding: Fine-grained outfit image representation with massive volumes of tags via angular-based contrastive learning
CN113537043B (en) Image processing method, device, electronic equipment and storage medium
Zhang et al. Stylized text-to-fashion image generation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23795114

Country of ref document: EP

Kind code of ref document: A1