CN113554484A - Virtual try-on method and device, storage medium and electronic equipment - Google Patents
Virtual try-on method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN113554484A CN113554484A CN202110823584.2A CN202110823584A CN113554484A CN 113554484 A CN113554484 A CN 113554484A CN 202110823584 A CN202110823584 A CN 202110823584A CN 113554484 A CN113554484 A CN 113554484A
- Authority
- CN
- China
- Prior art keywords
- model
- attribute information
- recommended
- try
- fitting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000012937 correction Methods 0.000 claims abstract description 30
- 238000012216 screening Methods 0.000 claims abstract description 19
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 18
- 238000004590 computer program Methods 0.000 claims description 24
- 238000013507 mapping Methods 0.000 claims description 15
- 238000012986 modification Methods 0.000 claims description 10
- 230000004048 modification Effects 0.000 claims description 10
- 238000012360 testing method Methods 0.000 claims description 7
- 230000015572 biosynthetic process Effects 0.000 claims description 4
- 238000003786 synthesis reaction Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 abstract description 6
- 230000000694 effects Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000004075 alteration Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 210000000697 sensory organ Anatomy 0.000 description 2
- 230000036555 skin type Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 229910003460 diamond Inorganic materials 0.000 description 1
- 239000010432 diamond Substances 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000036548 skin texture Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Item recommendations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- Development Economics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The utility model provides a virtual try-on method, a device, a storage medium and an electronic device, wherein the virtual try-on method comprises the steps of obtaining attribute information of a try-on part and a general model corresponding to the attribute information; performing personalized correction on the general model based on the attribute information to obtain a virtual model of the try-on part; screening a corresponding recommended test-wear model based on the attribute information; and synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model. According to the method, the general model is subjected to personalized correction by utilizing the attribute information of the fitting part, the recommended fitting model is screened out according to the simulated fitting model, the recommended fitting model is synthesized with the virtual model and is used as a reference for the fitting person to select, the fitting person does not need to personally try on each recommended product one by one, and the selection efficiency is greatly improved; moreover, the manual intervention degree is reduced in the process, and the purpose of reducing the labor cost is achieved on the basis of reducing the influence of the subjective judgment of workers.
Description
Technical Field
The present disclosure relates to the field of artificial intelligence technologies, and in particular, to a virtual try-on method, an apparatus, a storage medium, and an electronic device.
Background
With the rapid development of economic society, the high-end consumption capacity of people is greatly improved, and more people like to buy accessories such as jewelry, watches and the like for wearing and matching.
At present, when a customer purchases accessories such as jewelry, watches and the like, the customer only needs to go to a physical store to try on and select the accessories, for example, to purchase a diamond ring, a necklace, an earring and the like, and the customer needs to spend a lot of time to go to the physical store to try on so as to select the products of the heart instrument. However, this method has the following problems: firstly, a customer needs to spend a lot of time to communicate with a clerk of a physical store, so that the clerk can accurately recommend products to the customer, which results in high dependence on manual intervention and high labor cost; secondly, the hand types, skin colors, sizes, facial features and the like of different customers are different, and whether the product is suitable for the needs of the customer can be determined only after the product is tried on, so that more time is needed, and the selection efficiency is low.
Disclosure of Invention
In view of this, an object of the present disclosure is to provide a virtual try-on method, apparatus, storage medium and electronic device, which are used to solve the problems of high labor cost and low selection efficiency in the prior art.
In a first aspect, an embodiment of the present disclosure provides a virtual fitting method, where the method includes:
acquiring attribute information of a fitting part and a general model corresponding to the attribute information;
personalized correction is carried out on the general model based on the attribute information to obtain a virtual model of the fitting part;
screening a corresponding recommended test-wear model based on the attribute information;
and synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
In one possible embodiment, obtaining attribute information of the fitting site includes:
acquiring a video of the fitting part or a plurality of images at a plurality of angles by using image acquisition equipment;
and analyzing the video or the plurality of images to obtain the attribute information.
In a possible implementation manner, obtaining the general model corresponding to the attribute information includes:
searching a target attribute type which is accorded with the attribute information in a plurality of attribute types included in a model library;
taking the model corresponding to the target attribute type as the universal model;
and the model library comprises the mapping relation between the attribute type and the model.
In a possible embodiment, the performing personalized modification on the general model based on the attribute information to obtain the virtual model of the fitting site includes:
and performing personalized correction on the general model based on the size, the color and the position relation between the fitting part and other parts included in the attribute information to obtain a virtual model of the fitting part.
In a possible embodiment, the screening of the recommended test wear model corresponding to the attribute information based on the attribute information includes:
searching at least one recommended product corresponding to the attribute information in a product library;
extracting a model corresponding to the recommended product from a model library to serve as the recommended try-on model;
the product library comprises mapping relations between attribute information and recommended products, and one attribute information corresponds to at least one recommended product.
In a possible embodiment, the virtual fitting method further includes:
determining whether the recommended fitting model meets a preset condition;
and under the condition that the recommended fitting model does not meet the preset conditions, correcting the recommended fitting model according to the preset conditions.
In a possible embodiment, the virtual fitting method further includes:
receiving a desired product determined by a try-on person to which the try-on part belongs;
extracting a model corresponding to the expected product from a model library to serve as an expected sample model;
and synthesizing the expected try-on model and the virtual model to obtain the expected try-on model.
In a second aspect, an embodiment of the present disclosure further provides a virtual try-on device, which includes:
the acquisition module is configured to acquire attribute information of the fitting part and a general model corresponding to the attribute information;
a first correction module configured to perform personalized correction on the general model based on the attribute information to obtain a virtual model of the fitting part;
a screening module configured to screen a recommended test wear model corresponding thereto based on the attribute information;
and the first synthesis module is configured to synthesize the recommended try-on model and the virtual model to obtain a recommended try-on model.
In a third aspect, the present disclosure also provides a storage medium, wherein the computer readable storage medium has a computer program stored thereon, and the computer program when executed by a processor performs the following steps:
acquiring attribute information of a fitting part and a general model corresponding to the attribute information;
personalized correction is carried out on the general model based on the attribute information to obtain a virtual model of the fitting part;
screening a corresponding recommended test-wear model based on the attribute information;
and synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
In a fourth aspect, the present disclosure also provides an electronic device, including: a processor and a memory, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over a bus when an electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of:
acquiring attribute information of a fitting part and a general model corresponding to the attribute information;
personalized correction is carried out on the general model based on the attribute information to obtain a virtual model of the fitting part;
screening a corresponding recommended test-wear model based on the attribute information;
and synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
According to the method and the device, the pre-constructed general model is subjected to personalized correction by utilizing the attribute information of the fitting part, so that the virtual model of the fitting part is simulated, the recommended products are screened out according to the fitting model, and then the recommended fitting product model of the recommended fitting product is synthesized with the virtual model to obtain the recommended fitting model which is used as the reference for the fitting person to select, and the fitting person does not need to try each recommended product one by one, so that the selection efficiency is greatly improved; moreover, the manual intervention degree is reduced in the process, and the purpose of reducing the labor cost is achieved on the basis of reducing the influence of the subjective judgment of workers.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the present disclosure or the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present disclosure, and other drawings can be obtained by those skilled in the art without inventive exercise.
FIG. 1 illustrates a flow chart of a virtual fitting method provided by the present disclosure;
fig. 2 shows a flowchart for acquiring attribute information of a fitting site in a virtual fitting method provided by the present disclosure;
fig. 3 shows a flowchart of obtaining a general model corresponding to attribute information in the virtual fitting method provided by the present disclosure;
fig. 4 shows a flowchart of screening a recommended test wear model corresponding to the virtual test wear method provided by the present disclosure;
FIG. 5 illustrates a flow chart of another virtual fitting method provided by the present disclosure;
FIG. 6 illustrates a flow chart of another virtual fitting method provided by the present disclosure;
fig. 7 shows a schematic structural diagram of a virtual fitting apparatus provided by the present disclosure;
fig. 8 shows a schematic structural diagram of an electronic device provided by the present disclosure.
Detailed Description
Various aspects and features of the disclosure are described herein with reference to the drawings.
It will be understood that various modifications may be made to the embodiments disclosed herein. Accordingly, the foregoing description should not be construed as limiting, but merely as exemplifications of embodiments. Other modifications will occur to those skilled in the art within the scope and spirit of the disclosure.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the disclosure and, together with a general description of the disclosure given above, and the detailed description of the embodiments given below, serve to explain the principles of the disclosure.
These and other characteristics of the present disclosure will become apparent from the following description of preferred forms of embodiment, given as non-limiting examples, with reference to the attached drawings.
It should also be understood that, although the present disclosure has been described with reference to some specific examples, a person of skill in the art shall certainly be able to achieve many other equivalent forms of the disclosure, having the characteristics as set forth in the claims and hence all coming within the field of protection defined thereby.
The above and other aspects, features and advantages of the present disclosure will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present disclosure are described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely exemplary of the disclosure that may be embodied in various forms. Well-known and/or repeated functions and structures have not been described in detail so as not to obscure the present disclosure with unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present disclosure in virtually any appropriately detailed structure.
The specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the disclosure.
In a first aspect, a virtual fitting method provided by the present disclosure is first described in detail to facilitate understanding of the present disclosure. As shown in fig. 1, a flowchart of a virtual fitting method provided in the embodiment of the present disclosure includes steps S101 to S104.
S101, acquiring attribute information of the fitting part and a general model corresponding to the attribute information.
In a specific implementation, the fitting part comprises a hand, a face, a head and the like, for example, when a person who tries to fit the ring wants to fit the ring, the fitting part is the hand; when the try-on person wants to try on the earring, the try-on part is a face; when a try-on person tries to wear a necklace, a hair accessory, or the like, the portion to be worn is a head or the like.
Specifically, fig. 2 shows a flowchart of a method for acquiring attribute information of a fitting site, and specific steps include S201 and S202.
S201, acquiring a video of the fitting part or a plurality of images at a plurality of angles by using an image acquisition device.
S202, analyzing the video or the plurality of images to obtain attribute information.
In a specific implementation, an image capturing device, such as a camera, etc., may be installed in a preset area, and a video or a plurality of images at a plurality of angles of a fitting part within a capturing range may be acquired under a certain trigger condition. The trigger condition may be that a power supply presses a start key, or that an induction device such as a laser scanning device generates a trigger signal, which is not specifically limited in this embodiment of the disclosure.
In the acquisition range, the try-on part can be moved by a try-on person according to the guidance in the actual scene and/or the virtual scene, for example, the modes of manual actual guidance, voice guidance, animation guidance, AR guidance and the like are adopted, so that the image acquisition equipment can comprehensively acquire videos of the try-on part or a plurality of images at a plurality of angles; then, the video or the images at multiple angles are automatically analyzed, such as image processing, angle and size calculation, and the like, so as to obtain the attribute information of the fitting part.
The attribute information includes the size, color, position relation with other parts, etc. of the fitting part, for example, when the fitting part is a hand, the attribute information includes the width, length and thickness of the palm, the length, circumference, nail shape, nail length, skin color, skin type, etc. of the finger; when the fitting part is a face, the attribute information comprises the skin color, the skin quality, the size of five sense organs, the relative position relation among the five sense organs and the like of the face; when the fitting part is a head, the attribute information includes a circumferential length of the head, a length of a neck, a circumferential length, a skin condition, a width and a shape of shoulders, and the like.
After obtaining the attribute information of the fitting site, the general model corresponding to the attribute information is obtained according to the method steps shown in fig. 3, specifically including S301 and S302.
S301, searching a target attribute type which is accorded with the attribute information in a plurality of attribute types included in the model library.
And S302, taking the model corresponding to the target attribute type as a general model.
Specifically, at least one model is established in advance for each fitting site, and the model is obtained by performing 3D modeling based on a large amount of actual data (such as the shape, size, skin color, skin texture, and the like of the fitting site). Under the condition that a plurality of models are established for one fitting part, a plurality of attribute types can be divided according to the shape, the size, the skin color, the skin type and the like of the fitting part so as to improve the accuracy of subsequently determining recommended products, and further improve the selection efficiency of a fitting person to a certain extent.
After all models are built, the mapping relation between the attribute type and the model is built, and the mapping relation between the attribute type and the model is stored in a model library.
After obtaining the attribute information of the fitting part, a target attribute type which the attribute information conforms to is searched for from a plurality of attribute types included in the model library, specifically, a range in which each type of parameter in the attribute information falls is determined, and the attribute type corresponding to the range is determined as the target attribute type. If the attribute information corresponds to a plurality of target attribute types, one of the target attribute types can be randomly selected, and the target attribute type with more parameter falling ranges can be determined as the target attribute type of the subsequent calculation.
After the target attribute type is determined, a model corresponding to the target attribute type is searched in a model library, and the model corresponding to the target attribute type is used as a general model.
And S102, performing personalized correction on the general model based on the attribute information to obtain a virtual model of the fitting part.
In order to restore the fitting part of the fitting person more truly, after the general model is obtained, the general model is subjected to personalized correction based on the size, the color and the position relation between the fitting part and other parts, which are included in the attribute information, so that a virtual model of the fitting part is obtained.
Here, the embodiment of the present disclosure is described in detail by taking an example that after a plurality of models are established in advance, the attribute information is used to perform personalized correction on the corresponding general model to obtain the virtual model of the fitting site, and it should be known to those skilled in the art that the virtual model of the fitting site can also be obtained by performing real-time 3D modeling according to the attribute information. However, compared with the mode of performing real-time 3D modeling according to the attribute information to obtain the virtual model of the fitting part, the mode of performing personalized correction on the corresponding general model by using the attribute information to obtain the virtual model of the fitting part in the embodiment of the present disclosure after a plurality of models are pre-established is more efficient, and the fitting person does not need to wait for a long time, thereby further improving the selection efficiency of the fitting person.
And S103, screening the corresponding recommended sample model based on the attribute information.
In specific implementation, the recommended sample model corresponding to the attribute information needs to be screened based on the attribute information, and preferably, the sample model is also pre-established and stored in the model library. Of course, the model corresponding to the fitting site and the fitting model may be stored in the same model library, or may be stored in different model libraries, and the embodiment of the present disclosure exemplifies that the model corresponding to the fitting site and the fitting model are stored in the same model library.
Specifically, fig. 4 shows the steps of screening the recommended test wear model corresponding to the recommended test wear model, which specifically include S401-S403.
S401, at least one recommended product corresponding to the attribute information is searched in the product library.
S402, extracting a model corresponding to the recommended product from the model library to serve as a recommended try-on model.
Here, the product library includes a mapping relationship between the attribute information and the recommended product, where the mapping relationship between the attribute information and the recommended product is determined based on purchase information of the historical fitter. Because different try-on users have different aesthetics and preferences, the products finally purchased by different try-on users with the same attribute information may be different, and therefore, one attribute information in the product library corresponds to at least one recommended product. The mapping relation between the attribute information and the recommended products can be periodically updated based on the purchase information of the historical try-on person, and therefore the recommendation accuracy is improved.
After the attribute information is obtained, at least one recommended product corresponding to the attribute information is searched in a product library, and when the fitting part is a hand, the recommended product is a ring or a bracelet (which can be identified and determined manually or by the attribute information), and the like; when the fitting part is a face, the recommended product is glasses or earrings (which can be identified and determined by manpower and attribute information), and the like; when the fitting part is the head, the recommended product is a necklace or a hair accessory (which can be identified and determined by manpower and attribute information).
And extracting a model corresponding to the recommended product from the model library to serve as a recommended try-on model.
And S104, synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
After the virtual model and the recommended try-on model are obtained, the recommended try-on model and the virtual model are synthesized to obtain the recommended try-on model, and the recommended try-on model is displayed to a try-on person, so that the try-on person can check the try-on effect. In specific implementation, the try-on person can check the image of the two-dimensional or three-dimensional try-on effect by using the display device, and can check the real try-on effect by using the AR device (such as AR glasses) so that the try-on person can obtain the real try-on effect without trying on the person, and the experience degree of the user is further improved.
Certainly, the recommended fitting model is a three-dimensional model, so that when a fitting person views a three-dimensional fitting effect, the fitting person can switch and display the fitting model based on a plurality of determined angles; when the trial wearing effect is checked by using the Augmented Reality (AR) technology, the recommended trial wearing model or the trial wearing effect is displayed to the trial wearing person more truly by combining the AR technology.
Under the condition that recommended products are a plurality of, the person of trying on can switch different recommendation models of trying on according to predetermineeing the switching mode to try on the effect to different recommendation products and contrast, need not the person of trying on and try on every recommendation product one by one in person, very big improvement the selection efficiency.
In order to ensure the accuracy of the recommended fitting model, the embodiments of the present disclosure further provide a method for modifying the recommended fitting model, and the specific steps refer to S501 and S502 shown in fig. 5.
S501, determining whether the recommended fitting model meets a preset condition.
And S502, under the condition that the recommended fitting model does not meet the preset conditions, correcting the recommended fitting model according to the preset conditions.
The preset condition is that whether the relative position between the recommended try-on model and the virtual model meets the requirements or not, for example, whether the ring is completely worn on the finger or not, whether the necklace completely fits the neck or not, and the like.
And under the condition that the recommended fitting model does not meet the preset conditions, correcting the recommended fitting model according to the preset conditions. For example, when it is determined that half of the ring is not attached to the finger and is in a suspended state, the recommended fitting model is modified so that the ring can be completely worn on the finger.
Of course, there are also products that the try-on person wants to try on that do not appear in the recommended products, at this time, the try-on simulation may be completed according to the scheme shown in fig. 6, and the specific steps include S601-S603.
S601, receiving a desired product determined by a try-on person to which the try-on part belongs.
And S602, extracting a model corresponding to the expected product from the model library as an expected sample model.
And S603, synthesizing the expected try-on model and the virtual model to obtain the expected try-on model.
In particular implementations, all of the products may be displayed to the try-on so that the try-on can autonomously pick the desired product that is desired to be tried on; of course, the model, size, etc. of the desired product can be directly input by a human and directly selected, etc.
After receiving the expected product determined by the try-on person, extracting a model corresponding to the expected product from the model library to serve as an expected try-on model, and synthesizing the expected try-on model and the virtual model to obtain the expected try-on model. Of course, after the synthesis of the desired fitting model, the desired fitting model may also be modified according to the method steps shown in fig. 5, so that the desired fitting model meets the preset conditions.
According to the method and the device, the pre-constructed general model is subjected to personalized correction by utilizing the attribute information of the fitting part, so that the virtual model of the fitting part is simulated, the recommended products are screened out according to the fitting model, and then the recommended fitting product model of the recommended fitting product is synthesized with the virtual model to obtain the recommended fitting model which is used as the reference for the fitting person to select, and the fitting person does not need to try each recommended product one by one, so that the selection efficiency is greatly improved; moreover, the manual intervention degree is reduced in the process, and the purpose of reducing the labor cost is achieved on the basis of reducing the influence of the subjective judgment of workers.
Based on the same inventive concept, the second aspect of the present disclosure further provides a virtual fitting device corresponding to the virtual fitting method, and since the principle of solving the problem of the device in the present disclosure is similar to the virtual fitting method described above in the present disclosure, the implementation of the device may refer to the implementation of the method, and repeated details are not repeated.
Referring to fig. 7, the virtual try-on device includes:
an obtaining module 701 configured to obtain attribute information of a fitting part and a general model corresponding to the attribute information;
a first modification module 702 configured to perform personalized modification on the general model based on the attribute information to obtain a virtual model of the fitting site;
a screening module 703 configured to screen a recommended test wear model corresponding thereto based on the attribute information;
a first synthesizing module 704 configured to synthesize the recommended try-on model and the virtual model to obtain a recommended try-on model.
In another embodiment, the obtaining module 701 includes a first obtaining unit configured to:
acquiring a video of the fitting part or a plurality of images at a plurality of angles by using image acquisition equipment;
and analyzing the video or the plurality of images to obtain the attribute information.
In another embodiment, the obtaining module 701 further includes a second obtaining unit configured to:
searching a target attribute type which is accorded with the attribute information in a plurality of attribute types included in a model library;
taking the model corresponding to the target attribute type as the universal model;
and the model library comprises the mapping relation between the attribute type and the model.
In another embodiment, the first modification module 702 is specifically configured to:
and performing personalized correction on the general model based on the size, the color and the position relation between the fitting part and other parts included in the attribute information to obtain a virtual model of the fitting part.
In another embodiment, the screening module 703 is specifically configured to:
searching at least one recommended product corresponding to the attribute information in a product library;
extracting a model corresponding to the recommended product from a model library to serve as the recommended try-on model;
the product library comprises mapping relations between attribute information and recommended products, and one attribute information corresponds to at least one recommended product.
In another embodiment, the virtual try-on device further comprises a second modification module 705 configured to:
determining whether the recommended fitting model meets a preset condition;
and under the condition that the recommended fitting model does not meet the preset conditions, correcting the recommended fitting model according to the preset conditions.
In another embodiment, the virtual fitting apparatus further comprises a second synthesis module 706 configured to:
receiving a desired product determined by a try-on person to which the try-on part belongs;
extracting a model corresponding to the expected product from a model library to serve as an expected sample model;
and synthesizing the expected try-on model and the virtual model to obtain the expected try-on model.
According to the method and the device, the pre-constructed general model is subjected to personalized correction by utilizing the attribute information of the fitting part, so that the virtual model of the fitting part is simulated, the recommended products are screened out according to the fitting model, and then the recommended fitting product model of the recommended fitting product is synthesized with the virtual model to obtain the recommended fitting model which is used as the reference for the fitting person to select, and the fitting person does not need to try each recommended product one by one, so that the selection efficiency is greatly improved; moreover, the manual intervention degree is reduced in the process, and the purpose of reducing the labor cost is achieved on the basis of reducing the influence of the subjective judgment of workers.
The third aspect of the present disclosure also provides a storage medium, which is a computer-readable medium storing a computer program, and when the computer program is executed by a processor, the computer program implements the method provided in any embodiment of the present disclosure, including the following steps:
s11, acquiring the attribute information of the fitting part and a general model corresponding to the attribute information;
s12, performing personalized correction on the general model based on the attribute information to obtain a virtual model of the fitting part;
s13, screening the corresponding recommended sample model based on the attribute information;
and S14, synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
When the computer program is executed by the processor to acquire the attribute information of the fitting part, the processor further specifically executes the following steps: acquiring a video of the fitting part or a plurality of images at a plurality of angles by using image acquisition equipment; and analyzing the video or the plurality of images to obtain the attribute information.
When the computer program is executed by the processor to acquire the general model corresponding to the attribute information, the following steps are specifically executed by the processor: searching a target attribute type which is accorded with the attribute information in a plurality of attribute types included in a model library; taking the model corresponding to the target attribute type as the universal model; and the model library comprises the mapping relation between the attribute type and the model.
When the computer program is executed by the processor to perform personalized correction on the general model based on the attribute information to obtain the virtual model of the fitting part, the computer program is further executed by the processor to perform the following steps: and performing personalized correction on the general model based on the size, the color and the position relation between the fitting part and other parts included in the attribute information to obtain a virtual model of the fitting part.
When the computer program is executed by the processor to screen the corresponding recommended sample model based on the attribute information, the processor specifically executes the following steps: searching at least one recommended product corresponding to the attribute information in a product library; extracting a model corresponding to the recommended product from a model library to serve as the recommended try-on model; the product library comprises mapping relations between attribute information and recommended products, and one attribute information corresponds to at least one recommended product.
When the computer program is executed by the processor to perform the virtual fitting method, the processor specifically executes the following steps: determining whether the recommended fitting model meets a preset condition; and under the condition that the recommended fitting model does not meet the preset conditions, correcting the recommended fitting model according to the preset conditions.
When the computer program is executed by the processor to perform the virtual fitting method, the processor specifically executes the following steps: receiving a desired product determined by a try-on person to which the try-on part belongs; extracting a model corresponding to the expected product from a model library to serve as an expected sample model; and synthesizing the expected try-on model and the virtual model to obtain the expected try-on model.
According to the method and the device, the pre-constructed general model is subjected to personalized correction by utilizing the attribute information of the fitting part, so that the virtual model of the fitting part is simulated, the recommended products are screened out according to the fitting model, and then the recommended fitting product model of the recommended fitting product is synthesized with the virtual model to obtain the recommended fitting model which is used as the reference for the fitting person to select, and the fitting person does not need to try each recommended product one by one, so that the selection efficiency is greatly improved; moreover, the manual intervention degree is reduced in the process, and the purpose of reducing the labor cost is achieved on the basis of reducing the influence of the subjective judgment of workers.
It should be noted that the storage media described above in this disclosure can be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any storage medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a storage medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The fourth aspect of the present disclosure also provides an electronic device, as shown in fig. 8, the electronic device at least includes a memory 801 and a processor 802, the memory 801 stores a computer program thereon, and the processor 802 implements the method provided by any embodiment of the present disclosure when executing the computer program on the memory 801. Illustratively, the method performed by the electronic device computer program is as follows:
s21, acquiring the attribute information of the fitting part and a general model corresponding to the attribute information;
s22, performing personalized correction on the general model based on the attribute information to obtain a virtual model of the fitting part;
s23, screening the corresponding recommended sample model based on the attribute information;
and S24, synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
When the processor executes the attribute information of the fitting part stored in the memory, the processor further executes the following computer program: acquiring a video of the fitting part or a plurality of images at a plurality of angles by using image acquisition equipment; and analyzing the video or the plurality of images to obtain the attribute information.
When the processor executes the general model stored in the memory and corresponding to the acquired attribute information, the following computer program is also executed: searching a target attribute type which is accorded with the attribute information in a plurality of attribute types included in a model library; taking the model corresponding to the target attribute type as the universal model; and the model library comprises the mapping relation between the attribute type and the model.
When the processor executes the personalized correction of the general model based on the attribute information stored in the memory to obtain the virtual model of the fitting part, the processor further executes the following computer program: and performing personalized correction on the general model based on the size, the color and the position relation between the fitting part and other parts included in the attribute information to obtain a virtual model of the fitting part.
When the processor executes the recommended sample model stored in the memory and screening the corresponding recommended sample model based on the attribute information, the following computer program is also executed: searching at least one recommended product corresponding to the attribute information in a product library; extracting a model corresponding to the recommended product from a model library to serve as the recommended try-on model; the product library comprises mapping relations between attribute information and recommended products, and one attribute information corresponds to at least one recommended product.
The processor, when executing the virtual fitting method stored on the memory, further executes the following computer program: determining whether the recommended fitting model meets a preset condition; and under the condition that the recommended fitting model does not meet the preset conditions, correcting the recommended fitting model according to the preset conditions.
The processor, when executing the virtual fitting method stored on the memory, further executes the following computer program: receiving a desired product determined by a try-on person to which the try-on part belongs; extracting a model corresponding to the expected product from a model library to serve as an expected sample model; and synthesizing the expected try-on model and the virtual model to obtain the expected try-on model.
According to the method and the device, the pre-constructed general model is subjected to personalized correction by utilizing the attribute information of the fitting part, so that the virtual model of the fitting part is simulated, the recommended products are screened out according to the fitting model, and then the recommended fitting product model of the recommended fitting product is synthesized with the virtual model to obtain the recommended fitting model which is used as the reference for the fitting person to select, and the fitting person does not need to try each recommended product one by one, so that the selection efficiency is greatly improved; moreover, the manual intervention degree is reduced in the process, and the purpose of reducing the labor cost is achieved on the basis of reducing the influence of the subjective judgment of workers.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by persons skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
While the present disclosure has been described in detail with reference to the embodiments, the present disclosure is not limited to the specific embodiments, and those skilled in the art can make various modifications and alterations based on the concept of the present disclosure, and the modifications and alterations should fall within the scope of the present disclosure as claimed.
Claims (10)
1. A virtual fitting method, comprising:
acquiring attribute information of a fitting part and a general model corresponding to the attribute information;
personalized correction is carried out on the general model based on the attribute information to obtain a virtual model of the fitting part;
screening a corresponding recommended test-wear model based on the attribute information;
and synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
2. The virtual fitting method according to claim 1, wherein the acquiring of the attribute information of the fitting site includes:
acquiring a video of the fitting part or a plurality of images at a plurality of angles by using image acquisition equipment;
and analyzing the video or the plurality of images to obtain the attribute information.
3. The virtual fitting method according to claim 1, wherein obtaining the general model corresponding to the attribute information includes:
searching a target attribute type which is accorded with the attribute information in a plurality of attribute types included in a model library;
taking the model corresponding to the target attribute type as the universal model;
and the model library comprises the mapping relation between the attribute type and the model.
4. The virtual fitting method according to claim 1, wherein the personalized modification of the general model based on the attribute information to obtain the virtual model of the fitting site comprises:
and performing personalized correction on the general model based on the size, the color and the position relation between the fitting part and other parts included in the attribute information to obtain a virtual model of the fitting part.
5. The virtual fitting method according to claim 1, wherein the screening of the recommended fitting model corresponding to the attribute information based on the attribute information comprises:
searching at least one recommended product corresponding to the attribute information in a product library;
extracting a model corresponding to the recommended product from a model library to serve as the recommended try-on model;
the product library comprises mapping relations between attribute information and recommended products, and one attribute information corresponds to at least one recommended product.
6. The virtual fitting method according to claim 1, further comprising:
determining whether the recommended fitting model meets a preset condition;
and under the condition that the recommended fitting model does not meet the preset conditions, correcting the recommended fitting model according to the preset conditions.
7. The virtual fitting method according to claim 1, further comprising:
receiving a desired product determined by a try-on person to which the try-on part belongs;
extracting a model corresponding to the expected product from a model library to serve as an expected sample model;
and synthesizing the expected try-on model and the virtual model to obtain the expected try-on model.
8. A virtual try-on device, comprising:
the acquisition module is configured to acquire attribute information of the fitting part and a general model corresponding to the attribute information;
a first correction module configured to perform personalized correction on the general model based on the attribute information to obtain a virtual model of the fitting part;
a screening module configured to screen a recommended test wear model corresponding thereto based on the attribute information;
and the first synthesis module is configured to synthesize the recommended try-on model and the virtual model to obtain a recommended try-on model.
9. A storage medium, having a computer program stored thereon, the computer program when executed by a processor performing the steps of:
acquiring attribute information of a fitting part and a general model corresponding to the attribute information;
personalized correction is carried out on the general model based on the attribute information to obtain a virtual model of the fitting part;
screening a corresponding recommended test-wear model based on the attribute information;
and synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
10. An electronic device, comprising: a processor and a memory, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating over a bus when an electronic device is operating, the machine-readable instructions when executed by the processor performing the steps of:
acquiring attribute information of a fitting part and a general model corresponding to the attribute information;
personalized correction is carried out on the general model based on the attribute information to obtain a virtual model of the fitting part;
screening a corresponding recommended test-wear model based on the attribute information;
and synthesizing the recommended try-on model and the virtual model to obtain the recommended try-on model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110823584.2A CN113554484A (en) | 2021-07-21 | 2021-07-21 | Virtual try-on method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110823584.2A CN113554484A (en) | 2021-07-21 | 2021-07-21 | Virtual try-on method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113554484A true CN113554484A (en) | 2021-10-26 |
Family
ID=78103711
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110823584.2A Pending CN113554484A (en) | 2021-07-21 | 2021-07-21 | Virtual try-on method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113554484A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114693414A (en) * | 2022-06-02 | 2022-07-01 | 深圳星坊科技有限公司 | Store item recommendation method and device, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101504750A (en) * | 2009-03-16 | 2009-08-12 | 深圳市帝腾珠宝有限公司 | Virtual finger ring try-in method and apparatus |
| CN107358515A (en) * | 2017-08-09 | 2017-11-17 | 张涛 | A kind of ring tries system and its try-in method on online |
| CN107862334A (en) * | 2017-11-06 | 2018-03-30 | 广东欧珀移动通信有限公司 | Recommendation method, apparatus, storage medium and the terminal device of glasses |
| CN109472859A (en) * | 2018-10-31 | 2019-03-15 | 上海与德通讯技术有限公司 | Dress display methods, electronic equipment and the computer readable storage medium of effect |
| CN112084398A (en) * | 2020-07-28 | 2020-12-15 | 北京旷视科技有限公司 | Accessory recommendation method, accessory virtual try-on method and device and electronic equipment |
-
2021
- 2021-07-21 CN CN202110823584.2A patent/CN113554484A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101504750A (en) * | 2009-03-16 | 2009-08-12 | 深圳市帝腾珠宝有限公司 | Virtual finger ring try-in method and apparatus |
| CN107358515A (en) * | 2017-08-09 | 2017-11-17 | 张涛 | A kind of ring tries system and its try-in method on online |
| CN107862334A (en) * | 2017-11-06 | 2018-03-30 | 广东欧珀移动通信有限公司 | Recommendation method, apparatus, storage medium and the terminal device of glasses |
| CN109472859A (en) * | 2018-10-31 | 2019-03-15 | 上海与德通讯技术有限公司 | Dress display methods, electronic equipment and the computer readable storage medium of effect |
| CN112084398A (en) * | 2020-07-28 | 2020-12-15 | 北京旷视科技有限公司 | Accessory recommendation method, accessory virtual try-on method and device and electronic equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114693414A (en) * | 2022-06-02 | 2022-07-01 | 深圳星坊科技有限公司 | Store item recommendation method and device, computer equipment and storage medium |
| CN114693414B (en) * | 2022-06-02 | 2022-11-04 | 深圳星坊科技有限公司 | Store item recommendation method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Kuhn et al. | An efficient naturalness-preserving image-recoloring method for dichromats | |
| US11157985B2 (en) | Recommendation system, method and computer program product based on a user's physical features | |
| CN111787242B (en) | Method and apparatus for virtual fitting | |
| CN107220960B (en) | Make-up trial method, system and equipment | |
| RU2668408C2 (en) | Devices, systems and methods of virtualising mirror | |
| JP6088549B2 (en) | Simulation system and simulation apparatus | |
| US20240346774A1 (en) | Artificial intelligence virtual makeup method and device using multi-angle image recognition | |
| CN109690617A (en) | System and method for digital vanity mirror | |
| JP2001268594A (en) | Client server system for three-dimensional beauty simulation | |
| US20190156522A1 (en) | Image processing apparatus, image processing system, and program | |
| CN106157360A (en) | A kind of three-dimensional modeling method based on dual camera and device | |
| KR101488491B1 (en) | Method for providing virtual hairstyle and apparatus using the same | |
| CN108664884B (en) | Virtual makeup trial method and device | |
| CN108985878A (en) | A kind of article display system and method | |
| RU2012143140A (en) | SYSTEM FOR ANALYSIS IN TREATMENT OF SKIN USING SPECTRAL IMAGE DATA FOR THE GENERATION OF THE 3D 3D MODEL | |
| CN105955455A (en) | Device and method for adding object in virtual scene | |
| CN113298956A (en) | Image processing method, nail beautifying method and device, and terminal equipment | |
| CN106952142A (en) | Clothing matching intelligent recommendation systems, devices and methods | |
| CN109002248A (en) | VR scene screenshot method, equipment and storage medium | |
| CN110120053A (en) | Face's dressing processing method, device and equipment | |
| KR20150093930A (en) | Apparatus and method for makeup by using augmented reality | |
| CN113554484A (en) | Virtual try-on method and device, storage medium and electronic equipment | |
| CN106558042A (en) | A kind of method and apparatus that crucial point location is carried out to image | |
| JP2006079619A (en) | Method and apparatus for generating a composite image of at least one outer edge of an eyelash | |
| CN112819767A (en) | Image processing method, apparatus, device, storage medium, and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |