CN105354876B - A kind of real-time volume fitting method based on mobile terminal - Google Patents
A kind of real-time volume fitting method based on mobile terminal Download PDFInfo
- Publication number
- CN105354876B CN105354876B CN201510685088.XA CN201510685088A CN105354876B CN 105354876 B CN105354876 B CN 105354876B CN 201510685088 A CN201510685088 A CN 201510685088A CN 105354876 B CN105354876 B CN 105354876B
- Authority
- CN
- China
- Prior art keywords
- garment
- dress
- tried
- dimensional
- clothes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of real-time volume fitting method based on mobile terminal, including：Pass through acquisition for mobile terminal two-dimensional image to be tried on a dress；Registering and matching are carried out after two-dimensional image is rotated and cut；Characteristic point to be tried on a dress is identified in conjunction with the physical trait of fitting person；Carry out the garment features point identification positioning of different styles；It generates garment deformation coefficient and establishes 3D three-dimensional garment forms；Built-in 3D fittings manikin on mobile terminals, and 3D three-dimensionals garment form to be tried on a dress adaptively is fused on a 3D fitting manikin；According to the body parameter automatic adjusument of 3D fitting manikins three-dimensional fitting effects to be tried on a dress；Real-time 360 degree of touch-controls are carried out on mobile terminal screen to three-dimensional fitting effects to show.The present invention improves clothes outline identification precision, shows the three-dimensional clothes effect of high fidelity in real time on mobile terminals.
Description
Technical field
The present invention relates to virtual wearing technical field more particularly to a kind of real-time volume fitting sides based on mobile terminal
Method.
Background technology
As technicalization degree is higher and higher, virtual wearing technology is applied in living scene and has become a certainty.
Virtual wearing technology dabbles extensive technical field of research, in recognition of face, image recognition, machine learning, artificial
Intelligence, computer vision, 3D (3Dimensions, three-dimensional) real-time rendering engine etc. have deeper technical research.It is existing
Virtual wearing technology be primarily limited in the Depth Information Acquistion of monocular cam, and parts 2D (2Dimensions, two dimension)
The algorithm of covering 3D is also a major challenge of the technical field, and the efficiency and effect of 3D real-time renderings understand experience lf being influenced effect, most
Overall efficiency and the optimization on each platform are all technology limitations afterwards.
Wherein, virtual fitting technology can be as a Typical Representative in virtual wearing technical field.In the prior art,
User is in choosing clothes, it is often desirable that it (may be the existing clothes of consumer, or another to understand the clothes with other clothes
A clothes sold) arranging effect or the clothes and other clothings arranging effect.Utilize virtual reality, meter
The technological means such as calculation machine vision, human-computer interaction, the prior art may be implemented to carry out the virtual fitting of 2D using 2D images
Effect.It is worn since user can carry out virtually trying by data service, user without going to dress ornament shops or progress in person
Practical wearing is to assess practical fitting effects.
But the spatial positional information low precision of body image that traditional virtual wearing technology is identified, virtual dress ornament
Size there are relatively large deviations, human action resolution is low, and virtual dress ornament also is difficult to conjunction of the accurate superposition to body image
It sets right position, it is more difficult to coordinate human body actual act to show virtual dress ornament true to nature, virtually trying is caused to wear display effect very
It is stiff.
Moreover, because the limitation of two dimensional surface, existing virtual fitting process only by 2D clothes and 2D fitting persons image into
Row is integrated, and used blending image is 2D models, cannot really show space multistory sense and G-suit induction of clothes etc.
Effect.
In addition, fitting room software has to pass through in the artificial modeling ability in backstage each model that can try on a dress on line
Line is tried on；Moreover, traditional virtually trying technology usually requires to carry out artificial model for every a clothes, clothes library model generates
Period is long, lead to not dynamic real-time update, it is of high cost the problems such as.
Invention content
The technical problem to be solved by the invention is to provide a kind of real-time volume fitting method based on mobile terminal, carries
High clothes outline identification precision shows the three-dimensional clothes effect of high fidelity in real time on mobile terminals.
In order to solve the above technical problems, the embodiment of the present invention provides a kind of real-time volume fitting side based on mobile terminal
Method, including：
Pass through acquisition for mobile terminal two-dimensional image to be tried on a dress；
After carrying out image rotation and region cutting to the two-dimensional image, carry out at style registering and style matching
Reason；
In conjunction with the physical trait of fitting person, identified in the two-dimensional image after style registering and style matching treatment
Characteristic point to be tried on a dress；
According to the characteristic point to be tried on a dress, the garment features point identification positioning of different styles is carried out；
According to the two-dimensional image, the garment features point of different styles, garment deformation coefficient is generated, in movement
Real-time 3D adaptive modelings algorithm is applied in terminal, establishes 3D three-dimensional garment forms；
Built-in multiple 3D fittings manikins on mobile terminals, and certainly by 3D three-dimensionals garment form to be tried on a dress
Adaptation is fused on one of 3D fittings manikin；
According to the different body parameters of 3D fitting manikins, automatic adjusument three-dimensional fitting effects to be tried on a dress；
The real-time 360 degree of touch-controls of three-dimensional fitting effects progress to try on a dress are treated on mobile terminal screen to show.
Preferably, the physical trait of the combination fitting person, the two dimensional surface after style registering and style matching treatment
Characteristic point to be tried on a dress is identified in image, including：
Using K-MEANS algorithms, the pixel for treating the two-dimensional image to try on a dress carries out color segmentation, is formed and waits trying
It wears the clothes the polychrome figure of image；
Using the opening operation operator of mathematical morphology, clothes is carried out to the polychrome figure of image to be tried on a dress described in generation
Image background regions are identified and are deleted；
Using the closed operation operator of mathematical morphology, clothing to be tried on is identified on the polychrome figure for having deleted background area
Take image-region；
According to the human body features of fitting person, characteristic point to be tried on a dress is identified on the clothes image region
Coordinate position；The characteristic point include shoulder point, neckline point, neckline V location points, sleeve points outside and interior side point, armpit point,
It is one or more in waist site, clothing angle point, train of dress clothing angle point.
Further, the physical trait of the combination fitting person, the two dimension after style registering and style matching treatment are flat
Characteristic point to be tried on a dress is identified in the image of face, further includes：
The coordinate position of the characteristic point is shown in the clothes two-dimensional image of mobile terminal, and connects adjacent spy
Point is levied, the feature contour figure of clothes is formed.
Further, the physical trait of the combination fitting person, the two dimension after style registering and style matching treatment are flat
Characteristic point to be tried on a dress is identified in the image of face, further includes：
User chooses any one characteristic point shown on mobile terminal screen by finger point and locks；
Mobile terminal determines the new position of characteristic point, to realize to feature point by tracking user's finger shift position
The artificial correction adjustment set.
Preferably, described according to the two-dimensional image, the garment features point of different styles, generate garment deformation
Coefficient applies real-time 3D adaptive modelings algorithm, establishes the garment form of 3D three-dimensionals on mobile terminals, including：
According to current style registering classification to be tried on a dress, by each adjacent feature point in the two-dimensional image
A closed area is formed after line, and the closed area is divided into multiple former view fields automatically, forms former perspective view；
Generate the 3D model pinup pictures of a blank, and one corresponding to current style registering classification to be tried on a dress
The mapping coordinates of a 3D models generate corresponding multiple target projection regions, form target projection figure；
By linear interpolation algorithm, multiple view fields in the former perspective view are projected to pair of the target projection figure
Region is answered, the 3D model pinup pictures of current style registering classification to be tried on a dress are formed.
Preferably, described by linear interpolation algorithm, multiple view fields in the former perspective view are projected into the mesh
The corresponding region of perspective view is marked, including：
Based on linear interpolation algorithm, the aphylactic map projection region in former perspective view is zoomed in and out and/or stretched, waited for realizing
The two-dimensional image to try on a dress is hinted obliquely to 3D model pinup pictures.
Further, described according to the two-dimensional image, the garment features point of different styles, generate garment shape
Variable coefficient applies real-time 3D adaptive modelings algorithm, establishes the garment form of 3D three-dimensionals, further include on mobile terminals：
According to the relativeness information of garment features point, garment deformation coefficient is calculated；Garment deformation system
Number includes one or more in sleeve length, waistline tightness degree, train of dress amplitude, garment length, train of dress length；
According to current garment style, a 3D garment form conduct corresponding with current garment style is chosen in model library
3D three-dimensional clothes master moulds；
Apply relevant garment deformation coefficient on the three-dimensional top point set of the 3D three-dimensionals clothes master mould, to institute
It states 3D three-dimensional clothes master moulds and carries out auto-adapted fitting deformation, be 3D three-dimensional garment forms by the output of deformed 3D models
Final goal model；
The 3D model pinup pictures are applied to the final goal model, realizes and waits trying on a dress in 3D three-dimensional clothes moulds
The solid of type shows output.
Preferably, the different body parameters of the manikin of being fitted according to 3D, automatic adjusument is to be tried on a dress to stand
Body fitting effects, including：
According to the body parameter and preset current style model vertices set number to be tried on a dress for currently needing to adjust
According to library, the top with the body region corresponding to the body parameter that currently needs to adjust in the 3D three-dimensionals garment form is determined
Point set；
Gravitation shape control corresponding with the body parameter is applied to the vertex set, in the 3D three-dimensionals clothing
It takes and realizes that the clothes to match with the body parameter deforms on model, the clothes after deformation is mapped into 3D fitting manikins
On.
Further, the real-time volume fitting method based on mobile terminal further includes：
By different body parameters input by user, the various stances of 3D fitting manikins are carried out real-time
Adjustment, to adaptively adjust the shape of 3D three-dimensional garment forms.
Further, the real-time volume fitting method based on mobile terminal further includes：
It is flat to the two dimension after rotation and cutting when the 3D three-dimensionals garment form, which does not meet user itself, is expected
Face image re-starts style registering and style matching treatment, to generate new 3D three-dimensional garment forms.
Real-time volume fitting method provided in an embodiment of the present invention based on mobile terminal, user can utilize whenever and wherever possible
Mobile terminal realizes that three-dimensional fitting virtual effect identifies each Important Characteristic Points of clothes, make essence in conjunction with the physical trait of human body
Determine that position clothes each section region is possibly realized；According to the two-dimensional image, the garment features point of different styles, clothing is generated
Style deformation coefficient is taken, applies real-time 3D adaptive modelings algorithm on mobile terminals, arbitrarily shaped image can be zoomed in and out,
It stretches, to realize that user treats captured former 2D images the hinting obliquely to 3D rendering textures that try on a dress, it is vertical to be achieved in 3D
The patch map generalization true to nature of body garment form；In conjunction with garment deformation coefficient, can be combined in 3D three-dimensional garment forms
The relative seat feature at the control point of clothes, to realize that the adaptive tracing for certain clothes 2D picture shapes deforms, to
The adaptive modeling output for realizing target clothes 3D models, makes have the very high 3D three-dimensional clothes as really spending with clothes 2D pictures
The real-time of model is possibly realized.In addition, the present invention carries out the clothing of different styles according to the characteristic point to be tried on a dress
Feature point recognition positioning is taken, therefore the manikin realization that can fit by a small amount of 3D tries displaying on to a variety of style clothes,
Shorten the development cycle, reduces development difficulty and cost；User can treat the three-dimensional examination to try on a dress on mobile terminal screen
It wears the real-time 360 degree of touch-controls of effect progress to show, from the three-dimensional fitting effects of all angles visual perception difference style clothes.
Carry out three-dimensional fitting on mobile terminals using the present invention, user only needs finger to click screen and carries out simple clothes
Registering and characteristic point position confirmation operation, you can obtain and really spend the upper of higher 3D solids clothes with clothes image in original 2D pictures
Body effect, substantially reduce traditional 3D fitting rooms need profession modeling teacher be established per a novel clothes customization 3D modeling when
Between, carry out real-time volume fitting demand when a large amount of clothes picture browsings on the internet especially suitable for mobile terminal user.
Description of the drawings
Fig. 1 is the step flow of one embodiment of the real-time volume fitting method provided by the invention based on mobile terminal
Figure.
Fig. 2 is provided by the invention characteristic point one embodiment to be tried on a dress to be identified in two-dimensional image
Flow chart of steps.
Fig. 3 is the step flow chart of one embodiment provided by the invention for establishing 3D three-dimensional garment forms.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes.
It is the step of one embodiment of the real-time volume fitting method provided by the invention based on mobile terminal referring to Fig. 1
Rapid flow chart.
In the present embodiment, the real-time volume fitting method based on mobile terminal, mainly includes the following steps that S1
~step S8：
Step S1：Pass through acquisition for mobile terminal two dimension to be tried on a dress (2D) flat image.Wherein it is possible to utilize movement
The included camera of terminal, the clothes shown by various sources (including dress ornament shops, internet, magazine etc.) to scene carry out
It takes pictures and obtains the two-dimensional image, alternatively, the two-dimensional image can preserve to be obtained by the modes such as downloading, transfer
Picture on to mobile terminal.It should be noted that it includes to need to be tried on clothing that mobile terminal, which can also use other modes to obtain,
The two-dimensional image of clothes.When it is implemented, the mobile terminal includes but not limited to that (apple is grasped by Android (Android), IOS
Make system), blackberry, blueberry, the portable Intelligent mobile equipment such as Saipan, as intelligent mobile phone terminal, tablet computer, hand-held computer,
Palm terminal etc..
Step S2：After carrying out image rotation and region cutting to the two-dimensional image, style registering and money are carried out
Formula matching treatment.Wherein, it is to adjust to treat the 2D flat images to try on a dress and carry out image rotation and the main purpose of region cutting
The angles of display of the whole 2D flat images for including clothes image, is waited in order to more accurately orient in 2D flat images
The each key position to try on a dress facilitates style registering and style to match.To the 2D flat images cut, according to different moneys
Formula (such as different styles in spring, summer, autumn, winter) or clothes classification (T-shirt, one-piece dress, lower part of the body skirt, jeans, shirt etc.), people
Work, which is chosen, specifies style or direct registering；Wherein, the one-piece dress in clothes classification further includes the classes such as long sleeves, short, sleeveless, longuette
Type.
Step S3：In conjunction with the physical trait of fitting person, the two-dimensional image after style registering and style matching treatment
In identify characteristic point to be tried on a dress.
When it is implemented, the step S3 can be by running of mobile terminal related algorithm automatic identification garment features
Point, meanwhile, optionally, user can also be by manually adjusting the position of the characteristic point to be tried on a dress in two-dimensional image
It sets.
Wherein, when using by running of mobile terminal related algorithm automatic identification garment features point, it is preferable that as schemed
Shown in 2, the step S3 is mainly included the following steps that：
Step S31：Using K-MEANS algorithms, the pixel for treating the two-dimensional image to try on a dress carries out color segmentation,
Form the polychrome figure of image to be tried on a dress.Preferably, the polychrome figure is four chromatic graphs.
Step S32：Using the opening operation operator of mathematical morphology (Mathematical Morphology), to generation
The polychrome figure of the image to be tried on a dress carries out clothes image background area identification and deletion；
Step S33：Using the closed operation operator of mathematical morphology, identifies and wait on the polychrome figure for having deleted background area
The clothes image region tried on.
Step S34：According to the human body features of fitting person, is identified on the clothes image region and wait trying on a dress
Characteristic point coordinate position；The characteristic point includes shoulder point, neckline point, neckline V location points, sleeve points outside and inside
It is one or more in point, armpit point, waist site, clothing angle point, train of dress clothing angle point.
The embodiment of the present invention proposes a kind of clothes outline identification algorithm based on mathematical morphology, and energy Fast Segmentation goes out 2D
Clothes object in clothes picture, and energy is quick, is accurately identified clothes profile.The image processing of mathematical morphology shows as one
Kind of neighborhood operation form, a kind of specifically defined neighborhood are referred to as " structural element " (Structure Element), it is each as
Its region corresponding with binary picture carries out specific logical operation on plain position, and the result of logical operation is to export the phase of image
Answer pixel.The effect of mathematical morphological operation depends on size, content and the property of logical operation of structural element.Common
Morphology operations have corrosion (Erosion) and expansion (Dilation).Give bianry image I (x, y) and as structural element
Two-value template T (i, j) can then carry out relevant corrosion and dilation operation.In the present embodiment, the operation of opening operation operator
Journey is first to corrode the process expanded afterwards, for eliminating wisp, the boundary of separating objects, smooth larger object at very thin point
It is not obvious simultaneously and changes its area；Closed operation operator is the process for first expanding post-etching, for minuscule hole in filler body,
It is not obvious while connection adjacent object, its smooth boundary and changes its area.Therefore, S32 and step through the above steps
S33, may be implemented on the polychrome figure for having deleted background area, accurately identify clothes image region to be tried on.
In the present embodiment, described when carrying out positioning feature point to clothes image region using human body features' information
Step S34 mainly identifies the coordinate position of following garment features point, including but not limited to：
A. left and right shoulder point
B. left and right neckline point
C. neckline V location points
D. left and right sleeve points outside and interior side point (just for there is sleeve clothes)
E. left and right armpit point
F. left and right waist site
G. left and right clothing angle point (such as to non-skirt class clothes)
H. left and right train of dress clothing angle point (refering in particular to skirt class)
Further, the step S3 further includes：
Step S35：The coordinate position of the characteristic point is shown in the clothes two-dimensional image of mobile terminal, and is connected
Adjacent characteristic point forms the feature contour figure of clothes.
The method that the combination human body features that the embodiment of the present invention proposes identify each Important Characteristic Points of clothes so that accurate
Each section region of positioning clothes is possibly realized.
Optionally, the step S3 also allows user to manually adjust the spy to be tried on a dress in two-dimensional image simultaneously
Levy the position of point.It is clicked through when it is implemented, user chooses any one feature shown on mobile terminal screen by finger point
Row locking；Mobile terminal determines the new position of characteristic point, to realize to characteristic point position by tracking user's finger shift position
Artificial correction adjustment.
Step S4：According to the characteristic point to be tried on a dress, the garment features point identification positioning of different styles is carried out.
Step S5：According to the two-dimensional image, the garment features point of different styles, garment deformation system is generated
Number applies real-time 3D adaptive modelings algorithm, establishes 3D three-dimensional garment forms on mobile terminals.
Referring to Fig. 3, it is the step flow chart of one embodiment provided by the invention for establishing 3D three-dimensional garment forms.
Preferably, a kind of realization method of the step S5 mainly includes the following steps that：
Step S51：According to current style registering classification to be tried on a dress, by each phase in the two-dimensional image
A closed area is formed after adjacent characteristic point line, and the closed area is divided into N (N >=1) Ge Yuan view fields (O- automatically
P-AREA), former perspective view is formed；
Step S52：The 3D model pinup pictures of a blank are generated, and according to current style registering classification institute to be tried on a dress
The mapping coordinates of a corresponding 3D model generate corresponding a target projection region (D-P-AREA) of N (N >=1), form target
Perspective view；
Step S53：By linear interpolation algorithm, N (N >=1) a view field in the former perspective view is projected to described
The corresponding region of target projection figure forms the 3D model pinup pictures of current style registering classification to be tried on a dress.
Wherein, the step S53 includes：Based on linear interpolation algorithm, the aphylactic map projection region in former perspective view is carried out
Scaling and/or stretching, to realize two-dimensional image to be tried on a dress hinting obliquely to 3D model pinup pictures.Based on linear interpolation
Algorithm process can be zoomed in and out or be stretched to arbitrarily shaped image, to realize shadow of the clothes original 2D images to 3D rendering textures
Process is penetrated, the patch map generalization true to nature of 3D three-dimensional garment forms is achieved in.
Further, the step S5 further includes：
Step S54：According to the relativeness information of garment features point, garment deformation coefficient is calculated；Preferably, described
Garment deformation coefficient includes but not limited to one in sleeve length, waistline tightness degree, train of dress amplitude, garment length, train of dress length
Item is multinomial.
Step S55：According to current garment style, a 3D clothes corresponding with current garment style is chosen in model library
Model is as 3D three-dimensional clothes master moulds；
Step S56：Apply relevant garment deformation on the three-dimensional top point set of the 3D three-dimensionals clothes master mould
Coefficient carries out auto-adapted fitting deformation to the 3D three-dimensionals clothes master mould, is 3D three-dimensional by the output of deformed 3D models
Change the final goal model of garment form；
Step S57：The 3D model pinup pictures are applied to the final goal model, realizes and waits trying on a dress in 3D solids
The solid for changing garment form shows output.
In the present embodiment, the real-time volume fitting method based on mobile terminal further includes：
It is flat to the two dimension after rotation and cutting when the 3D three-dimensionals garment form, which does not meet user itself, is expected
Face image re-starts style registering and style matching treatment, to generate new 3D three-dimensional garment forms, until being met
3D three-dimensionals garment form expected from user.
Step S6：Built-in multiple 3D fit manikins on mobile terminals, and by 3D three-dimensional clothing to be tried on a dress
Model adaptation is taken to be fused on one of 3D fittings manikin.Specifically, 3D fittings manikin includes female model's mould
The overall fusion of type, alternatively, the overall fusion of man model spy's model, and can be defeated in real time by the different body parameters of setting model
Go out 3D solid clothes effects.
Step S7：According to the different body parameters of 3D fitting manikins, automatic adjusument three-dimensional examination to be tried on a dress
Wear effect；
Specifically, after 3D three-dimensionals garment form is fused on 3D fitting manikins, can fit to 3D manikin
The different stature parameters of (model) are adjusted, including：
1. inputting the height parameter adjustment of 3D models, ranging from 150-180cm；
2. inputting the bust parameter adjustment of 3D models, ranging from 60-120cm；
3. inputting the waistline parameter adjustment of 3D models, ranging from 60-110cm；
4. inputting the hip circumference parameter adjustment of 3D models, ranging from 70-120cm；
5. inputting the shoulder breadth parameter adjustment of 3D models, ranging from 50-100cm；
6. inputting the upper-arm circumference parameter adjustment of 3D models, ranging from 20-50cm；
7. inputting the thigh parameter adjustment of 3D models, ranging from 30-80cm.
To realize through above-mentioned parameter, automatic adjusument is that the upper body of trying on of corresponding 3D three-dimensionals garment form is imitated
Fruit.
When it is implemented, the step S7 includes：
Step S71：According to the body parameter (such as bust/hip circumference) and preset current clothing to be tried on for currently needing to adjust
The style model vertices collective database of clothes determines joining with the body for currently needing to adjust in the 3D three-dimensionals garment form
The vertex set of the corresponding body region (the corresponding chest/hip circumference of such as clothes) of number；
Step S72：Gravitation shape control corresponding with the body parameter is applied to the vertex set, in the 3D
It realizes that the clothes to match with the body parameter deforms in three-dimensional garment form, the clothes after deformation is mapped into 3D fittings
On manikin.
Step S8：The three-dimensional fitting effects to try on a dress are treated on mobile terminal screen carries out real-time 360 degree of touch-control exhibitions
It is existing.For example, the left rotation and right rotation of 3D three-dimensional garment forms, upward, slide downward, realize the animation of three-dimensional garment form modeling
Effect.
In the present embodiment, the real-time volume fitting method based on mobile terminal further includes：
By different body parameters input by user, the various stances of 3D fitting manikins are carried out real-time
Adjustment, to adaptively adjust the shape of 3D three-dimensional garment forms.
The present embodiment can carry out the upper body effect that real-time 360 degree of touch-controls show clothes 3D models on mobile terminal screen
Fruit, control 3D three-dimensional garment forms carry out simple POSE effects, and therefore, user can fit on mobile terminals
When, the various postures for having merged 3D fitting manikins to be tried on a dress can be adjusted in real time, promote user experience.
Real-time volume fitting method provided in an embodiment of the present invention based on mobile terminal, user can utilize whenever and wherever possible
Mobile terminal realizes that three-dimensional fitting virtual effect identifies each Important Characteristic Points of clothes, make essence in conjunction with the physical trait of human body
Determine that position clothes each section region is possibly realized；According to the two-dimensional image, the garment features point of different styles, clothing is generated
Style deformation coefficient is taken, applies real-time 3D adaptive modelings algorithm on mobile terminals, arbitrarily shaped image can be zoomed in and out,
It stretches, to realize that user treats captured former 2D images the hinting obliquely to 3D rendering textures that try on a dress, it is vertical to be achieved in 3D
The patch map generalization true to nature of body garment form；In conjunction with garment deformation coefficient, can be combined in 3D three-dimensional garment forms
The relative seat feature at the control point of clothes, to realize that the adaptive tracing for certain clothes 2D picture shapes deforms, to
The adaptive modeling output for realizing target clothes 3D models, makes have the very high 3D three-dimensional clothes as really spending with clothes 2D pictures
The real-time of model is possibly realized.
In addition, the present invention, according to the characteristic point to be tried on a dress, the garment features point identification for carrying out different styles is fixed
Position, therefore the manikin that can be fitted by a small amount of 3D realizes the displaying of trying on to a variety of style clothes, shortens the development cycle, drop
Low development difficulty and cost；User can treat the three-dimensional fitting effects to try on a dress on mobile terminal screen and carry out in real time
360 degree of touch-controls show, from the three-dimensional fitting effects of all angles visual perception difference style clothes.
Carry out three-dimensional fitting on mobile terminals using the present invention, user only needs finger to click screen and carries out simple clothes
Registering and characteristic point position confirmation operation, you can obtain and really spend the upper of higher 3D solids clothes with clothes image in original 2D pictures
Body effect, substantially reduce traditional 3D fitting rooms need profession modeling teacher be established per a novel clothes customization 3D modeling when
Between, carry out real-time volume fitting demand when a large amount of clothes picture browsings on the internet especially suitable for mobile terminal user.
It should be noted that in flow charts indicate or logic and/or step described otherwise above herein, for example,
It is considered the order list of the executable instruction for realizing logic function, may be embodied in any computer can
Read in medium or embedded microprocessor, for instruction execution system, device or equipment (such as computer based system including
The system of processor or other can be from instruction execution system, device or equipment instruction fetch and the system executed instruction) use, or
It is used in conjunction with these instruction execution systems, device or equipment.For the purpose of this specification, " computer-readable medium " can be appointed
What can include, store, communicate, propagate, or transport program is for instruction execution system, device or equipment or in conjunction with these instructions
The device for executing system, device or equipment and using.The more specific example (non-exhaustive list) of computer-readable medium is wrapped
It includes following：Electrical connection section (electronic device) with one or more wiring, portable computer diskette box (magnetic device) are deposited at random
Access to memory (RAM), read-only memory (ROM), erasable edit read-only storage (EPROM or flash memory), optical fiber
Device and portable optic disk read-only storage (CDROM).It can be beaten on it in addition, computer-readable medium can even is that
The paper or other suitable media of described program are printed, because can be connect for example by carrying out optical scanner to paper or other media
It into edlin, interpretation or is handled when necessary with other suitable methods electronically to obtain described program, then will
It is stored in computer storage.
It should be appreciated that each section of the present invention can be realized with hardware, software, firmware or combination thereof.Above-mentioned
In embodiment, software that multiple steps or method can in memory and by suitable instruction execution system be executed with storage
Or firmware is realized.For example, when implemented in hardware, can with any one of following technology well known in the art or they
It combines to realize：Discrete logic with the logic gates for realizing logic function to data-signal, it is suitable to have
Combinational logic gate circuit application-specific integrated circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that realize all or part of step in above method embodiment
It is that relevant hardware can be instructed to complete by program, the program can be stored in a kind of computer readable storage medium
In, which includes the steps that one or a combination set of embodiment of the method when being executed.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, it can also
That each unit physically exists alone, can also two or more units be integrated in a module.Above-mentioned integrated mould
The form that hardware had both may be used in block is realized, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and when sold or used as an independent product, can also be stored in a computer
In read/write memory medium.Storage medium mentioned above can be read-only memory, disk or CD etc..
The above is the preferred embodiment of the present invention, it is noted that for those skilled in the art
For, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also considered as
Protection scope of the present invention.
Claims (10)
1. a kind of real-time volume fitting method based on mobile terminal, which is characterized in that including：
Pass through acquisition for mobile terminal two-dimensional image to be tried on a dress；
After carrying out image rotation and region cutting to the two-dimensional image, style registering and style matching treatment are carried out；
In conjunction with the physical trait of fitting person, is identified in the two-dimensional image after style registering and style matching treatment and wait trying
Habited characteristic point；
According to the characteristic point to be tried on a dress, the garment features point identification positioning of different styles is carried out；
According to the two-dimensional image, the garment features point of different styles, garment deformation coefficient is generated, in mobile terminal
The upper real-time 3D adaptive modelings algorithm of application, establishes 3D three-dimensional garment forms；Specifically, according to current garment style, in mould
A 3D garment form corresponding with current garment style is chosen in type library as 3D three-dimensional clothes master moulds, according to clothes money
Formula deformation coefficient and the 3D three-dimensionals clothes master mould establish 3D three-dimensional garment forms；
Built-in multiple 3D fittings manikins on mobile terminals, and 3D three-dimensional garment forms to be tried on a dress is adaptive
It is fused on one of 3D fittings manikin；
According to the different body parameters of 3D fitting manikins, automatic adjusument three-dimensional fitting effects to be tried on a dress；
The real-time 360 degree of touch-controls of three-dimensional fitting effects progress to try on a dress are treated on mobile terminal screen to show.
2. the real-time volume fitting method based on mobile terminal as described in claim 1, which is characterized in that the combination fitting
The physical trait of person identifies feature to be tried on a dress in the two-dimensional image after style registering and style matching treatment
Point, including：
Using K-MEANS algorithms, the pixel for treating the two-dimensional image to try on a dress carries out color segmentation, forms clothing to be tried on
Take the polychrome figure of image；
Using the opening operation operator of mathematical morphology, clothes image is carried out to the polychrome figure of image to be tried on a dress described in generation
Background area identifies and deletes；
Using the closed operation operator of mathematical morphology, clothes figure to be tried on is identified on the polychrome figure for having deleted background area
As region；
According to the human body features of fitting person, the seat of characteristic point to be tried on a dress is identified on the clothes image region
Cursor position；The characteristic point includes shoulder point, neckline point, neckline V location points, sleeve points outside and interior side point, armpit point, waist position
It is one or more in point, clothing angle point, train of dress clothing angle point.
3. the real-time volume fitting method based on mobile terminal as claimed in claim 2, which is characterized in that the combination fitting
The physical trait of person identifies feature to be tried on a dress in the two-dimensional image after style registering and style matching treatment
Point further includes：
The coordinate position of the characteristic point is shown in the clothes two-dimensional image of mobile terminal, and connects adjacent feature
Point forms the feature contour figure of clothes.
4. the real-time volume fitting method based on mobile terminal as claimed in claim 2, which is characterized in that the combination fitting
The physical trait of person identifies feature to be tried on a dress in the two-dimensional image after style registering and style matching treatment
Point further includes：
User chooses any one characteristic point shown on mobile terminal screen by finger point and locks；
Mobile terminal determines the new position of characteristic point, to realize to characteristic point position by tracking user's finger shift position
Artificial correction adjusts.
5. the real-time volume fitting method based on mobile terminal as described in claim 1, which is characterized in that described in the basis
The garment features point of two-dimensional image, different styles, generates garment deformation coefficient, applies real-time 3D on mobile terminals
Adaptive modeling algorithm establishes the garment form of 3D three-dimensionals, including：
According to current style registering classification to be tried on a dress, by each adjacent feature point line in the two-dimensional image
A closed area is formed afterwards, and the closed area is divided into multiple former view fields automatically, forms former perspective view；
Generate the 3D model pinup pictures of a blank, and a 3D corresponding to current style registering classification to be tried on a dress
The mapping coordinates of model generate corresponding multiple target projection regions, form target projection figure；
By linear interpolation algorithm, multiple view fields in the former perspective view are projected to the correspondence area of the target projection figure
Domain forms the 3D model pinup pictures of current style registering classification to be tried on a dress.
6. the real-time volume fitting method based on mobile terminal as claimed in claim 5, which is characterized in that described by linear
Multiple view fields in the former perspective view are projected to the corresponding region of the target projection figure by interpolation algorithm, including：
Based on linear interpolation algorithm, the aphylactic map projection region in former perspective view is zoomed in and out and/or stretched, waits trying on to realize
The two-dimensional image of clothes is hinted obliquely to 3D model pinup pictures.
7. the real-time volume fitting method based on mobile terminal as claimed in claim 5, which is characterized in that described in the basis
The garment features point of two-dimensional image, different styles, generates garment deformation coefficient, applies real-time 3D on mobile terminals
Adaptive modeling algorithm establishes the garment form of 3D three-dimensionals, further includes：
According to the relativeness information of garment features point, garment deformation coefficient is calculated；The garment deformation coefficient packet
It includes one or more in sleeve length, waistline tightness degree, train of dress amplitude, garment length, train of dress length；
According to current garment style, it is vertical as 3D that a 3D garment form corresponding with current garment style is chosen in model library
Body clothes master mould；
Apply relevant garment deformation coefficient on the three-dimensional top point set of the 3D three-dimensionals clothes master mould, to the 3D
Three-dimensional clothes master mould carries out auto-adapted fitting deformation, most for 3D three-dimensionals garment form by the output of deformed 3D models
Whole object module；
The 3D model pinup pictures are applied to the final goal model, realizes and waits trying on a dress in 3D three-dimensional garment forms
Solid shows output.
8. the real-time volume fitting method based on mobile terminal as described in claim 1, which is characterized in that described to be tried according to 3D
The different body parameters of clothing manikin, automatic adjusument three-dimensional fitting effects to be tried on a dress, including：
According to the body parameter and preset current style model vertices collective data to be tried on a dress for currently needing to adjust
Library determines the vertex with the body region corresponding to the body parameter that currently needs to adjust in the 3D three-dimensionals garment form
Set；
Gravitation shape control corresponding with the body parameter is applied to the vertex set, in the 3D three-dimensionals clothes mould
It realizes that the clothes to match with the body parameter deforms in type, the clothes after deformation is mapped on 3D fitting manikins.
9. such as real-time volume fitting method of claim 1~8 any one of them based on mobile terminal, which is characterized in that institute
The method of stating further includes：
By different body parameters input by user, the various stances of 3D fitting manikins are adjusted in real time
It is whole, to adaptively adjust the shape of 3D three-dimensional garment forms.
10. the real-time volume fitting method based on mobile terminal as described in claim 1, which is characterized in that further include：
When the 3D three-dimensionals garment form, which does not meet user itself, is expected, to the 2 d plane picture after rotation and cutting
As re-starting style registering and style matching treatment, to generate new 3D three-dimensional garment forms.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510685088.XA CN105354876B (en) | 2015-10-20 | 2015-10-20 | A kind of real-time volume fitting method based on mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510685088.XA CN105354876B (en) | 2015-10-20 | 2015-10-20 | A kind of real-time volume fitting method based on mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105354876A CN105354876A (en) | 2016-02-24 |
| CN105354876B true CN105354876B (en) | 2018-10-09 |
Family
ID=55330843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510685088.XA Active CN105354876B (en) | 2015-10-20 | 2015-10-20 | A kind of real-time volume fitting method based on mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105354876B (en) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105913496B (en) * | 2016-04-06 | 2018-09-28 | 成都景和千城科技有限公司 | It is a kind of by true dress ornament rapid translating be three-dimensional dress ornament method and system |
| CN106072956A (en) * | 2016-06-20 | 2016-11-09 | 北京理工大学 | A kind of dress designing method and device |
| CN106373182A (en) * | 2016-08-18 | 2017-02-01 | 苏州丽多数字科技有限公司 | Augmented reality-based human face interaction entertainment method |
| CN106485572A (en) * | 2016-10-12 | 2017-03-08 | 大连文森特软件科技有限公司 | A kind of based on video image characteristic point technology of identification and the on-line shopping system of virtual reality technology |
| CN108346171B (en) * | 2017-01-25 | 2021-12-10 | 斑马智行网络(香港)有限公司 | Image processing method, device, equipment and computer storage medium |
| CN106657937A (en) * | 2017-03-06 | 2017-05-10 | 柳州智视科技有限公司 | Virtual clothes color changing device, and implementation method thereof |
| CN107122774B (en) * | 2017-03-28 | 2019-12-03 | 武汉斗鱼网络科技有限公司 | A kind of adaptive chart pasting method and system mobile with key point in image |
| CN108181987A (en) * | 2017-11-23 | 2018-06-19 | 中国计量大学 | A kind of textile cognitive method based on virtual reality |
| CN107833109A (en) * | 2017-11-27 | 2018-03-23 | 赵明 | A kind of holographic matching process and system of wisdom retail |
| CN108010134A (en) * | 2017-11-29 | 2018-05-08 | 湘潭大学 | A kind of real-time three-dimensional virtual fit method based on mobile terminal |
| CN107784567A (en) * | 2017-12-08 | 2018-03-09 | 快创科技（大连）有限公司 | Purchase experiences system based on augmented reality |
| CN108038761A (en) * | 2017-12-08 | 2018-05-15 | 快创科技（大连）有限公司 | Shopping Propagate and management system based on AR technologies |
| JP6921768B2 (en) * | 2018-02-21 | 2021-08-18 | 株式会社東芝 | Virtual fitting system, virtual fitting method, virtual fitting program, and information processing device |
| CN110555903B (en) * | 2018-05-31 | 2023-06-23 | 北京京东尚科信息技术有限公司 | Image processing method and device |
| CN109035259B (en) * | 2018-07-23 | 2021-06-29 | 西安建筑科技大学 | Three-dimensional multi-angle fitting device and fitting method |
| CN110246001B (en) * | 2019-04-24 | 2023-04-07 | 维沃移动通信有限公司 | Image display method and terminal equipment |
| CN110210501B (en) * | 2019-06-11 | 2021-06-18 | 北京字节跳动网络技术有限公司 | Virtual object generation method, electronic device and computer-readable storage medium |
| CN110610537B (en) * | 2019-09-18 | 2022-08-26 | 珠海普罗米修斯视觉技术有限公司 | Clothes image display method and device, storage medium and terminal equipment |
| CN111476912B (en) * | 2020-06-28 | 2020-09-29 | 恒信东方文化股份有限公司 | Image matching method and system |
| CN112685649A (en) * | 2021-01-25 | 2021-04-20 | 深圳创维－Rgb电子有限公司 | Clothing recommendation method and device, storage medium and terminal equipment |
| CN114663552B (en) * | 2022-05-25 | 2022-08-16 | 武汉纺织大学 | Virtual fitting method based on 2D image |
| CN115661354A (en) * | 2022-11-07 | 2023-01-31 | 深圳市十二篮服饰有限公司 | 3D intelligent fitting model system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101082765A (en) * | 2006-06-01 | 2007-12-05 | 高宏 | Three-dimensional portrait photograph system and realizing method thereof |
| CN102509349A (en) * | 2011-09-27 | 2012-06-20 | 深圳市朵唯志远科技有限公司 | Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal |
| CN103456042A (en) * | 2012-05-30 | 2013-12-18 | 盛乐信息技术（上海）有限公司 | Method and system for generation of human body models and clothes models, fitting method and fitting system |
| CN104036532A (en) * | 2014-05-29 | 2014-09-10 | 浙江工业大学 | Clothes making method based on three-dimensional to two-dimensional clothes pattern seamless mapping |
| CN104346827A (en) * | 2013-07-24 | 2015-02-11 | 深圳市华创振新科技发展有限公司 | Rapid 3D clothes modeling method for common users |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2868180B1 (en) * | 2004-03-24 | 2006-06-16 | Commissariat Energie Atomique | METHOD AND DEVICE FOR INTERACTIVE SIMULATION OF CONTACT BETWEEN OBJECTS |
-
2015
- 2015-10-20 CN CN201510685088.XA patent/CN105354876B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101082765A (en) * | 2006-06-01 | 2007-12-05 | 高宏 | Three-dimensional portrait photograph system and realizing method thereof |
| CN102509349A (en) * | 2011-09-27 | 2012-06-20 | 深圳市朵唯志远科技有限公司 | Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal |
| CN103456042A (en) * | 2012-05-30 | 2013-12-18 | 盛乐信息技术（上海）有限公司 | Method and system for generation of human body models and clothes models, fitting method and fitting system |
| CN104346827A (en) * | 2013-07-24 | 2015-02-11 | 深圳市华创振新科技发展有限公司 | Rapid 3D clothes modeling method for common users |
| CN104036532A (en) * | 2014-05-29 | 2014-09-10 | 浙江工业大学 | Clothes making method based on three-dimensional to two-dimensional clothes pattern seamless mapping |
Non-Patent Citations (2)
| Title |
|---|
| 基于移动终端的虚拟试衣技术研究;李童;《万方数据知识服务平台》;20150730;正文第44-49、55-56页 * |
| 基于纹理映射的三维服装款式着装效果研究;杨天虹;《中国优秀硕士学位论文全文数据库 信息科技辑》;20071115;正文第60-61页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105354876A (en) | 2016-02-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105354876B (en) | A kind of real-time volume fitting method based on mobile terminal | |
| US10546433B2 (en) | Methods, systems, and computer readable media for modeling garments using single view images | |
| CN109427007B (en) | Virtual fitting method based on multiple visual angles | |
| Robson et al. | Context-aware garment modeling from sketches | |
| US11961200B2 (en) | Method and computer program product for producing 3 dimensional model data of a garment | |
| JP2019510297A (en) | Virtual try-on to the user's true human body model | |
| Zhu et al. | An efficient human model customization method based on orthogonal-view monocular photos | |
| CN110310319B (en) | Illumination-separated single-view human body clothing geometric detail reconstruction method and device | |
| US20150235305A1 (en) | Garment modeling simulation system and process | |
| CN109801380A (en) | A kind of method, apparatus of virtual fitting, storage medium and computer equipment | |
| CN103106604A (en) | Three dimensional (3D) virtual fitting method based on somatosensory technology | |
| CN104794722A (en) | Dressed human body three-dimensional bare body model calculation method through single Kinect | |
| CN109377557A (en) | Real-time three-dimensional facial reconstruction method based on single frames facial image | |
| Li et al. | In-home application (App) for 3D virtual garment fitting dressing room | |
| CN105913416A (en) | Method for automatically segmenting three-dimensional human face model area | |
| Xu et al. | 3d virtual garment modeling from rgb images | |
| CN105653742A (en) | Clothes model building method in three-dimension simulation fitting system | |
| CN105869217A (en) | Virtual method for trying on clothes by real person | |
| Wenninger et al. | Realistic virtual humans from smartphone videos | |
| WO2020104990A1 (en) | Virtually trying cloths & accessories on body model | |
| CN108564619A (en) | A kind of sense of reality three-dimensional facial reconstruction method based on two photos | |
| Bang et al. | Estimating garment patterns from static scan data | |
| JP2013501284A (en) | Representation of complex and / or deformable objects and virtual fitting of wearable objects | |
| KR101508161B1 (en) | Virtual fitting apparatus and method using digital surrogate | |
| Cushen et al. | Markerless real-time garment retexturing from monocular 3d reconstruction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |