CN106933976A - Set up the method for the net models of human body 3D and its application in 3D fittings - Google Patents
Set up the method for the net models of human body 3D and its application in 3D fittings Download PDFInfo
- Publication number
- CN106933976A CN106933976A CN201710079332.7A CN201710079332A CN106933976A CN 106933976 A CN106933976 A CN 106933976A CN 201710079332 A CN201710079332 A CN 201710079332A CN 106933976 A CN106933976 A CN 106933976A
- Authority
- CN
- China
- Prior art keywords
- net
- human body
- model
- models
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
- G06F16/212—Schema design and management with details for data modelling support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Economics (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Development Economics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Processing Or Creating Images (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The present invention proposes a kind of method for setting up the net models of human body 3D, comprises the following steps：S1:Set up and contain height, body weight, the net model databases of human body 3D of gender information；S2:Depth image of the collection current human under clothing situation；S3:Obtain height, body weight and the gender information of current human；S4:Extract the net model of sample；S5:The net model of current human is obtained according to the net model of sample.The method that the present invention sets up the net models of human body 3D, can simultaneously remove the influence of clothes and the local feature brought by height, body weight and sex etc., and the net model of human body can be exactly obtained merely with depth image of the human body under clothing situation.In addition, based on the creation method of the above-mentioned net models of human body 3D, the present invention also proposes a kind of 3D fitting methods and 3D dressing systems, and no matter human body wears loose clothing or compact clothing, using 3D fitting methods of the invention or system, can in real time and 360 ° show the effect worn the clothes.
Description
Technical field
The present invention relates to computer technology and technical field of image processing, and in particular to one kind sets up people using depth image
The method of the net models of body 3D and its application in 3D fittings.
Background technology
Human body three-dimensional (this paper abbreviation 3D) model is all played at aspects such as 3D printing, custom made clothing, 3D fittings, cartoon making
Important effect.Obtain human body 3D models mainly has two kinds of approach at present, and one kind is that, by microcomputer modelling, this mode is obtained
Model smooth it is true to nature, but to model personnel technical merit have requirement higher, the efficiency of modeling is relatively low；Another kind side
Formula is that directly human body is measured by equipment such as 3D scanners or depth cameras, and what is typically obtained in this way is a little
Cloud data, the manikin that subsequently can be more satisfied with by the treatment such as denoising, gridding.Latter approach is although precision
It is not high, but the speed of acquisition manikin is fast, is increasingly becoming cartoon making, the mode that 3D fittings field is commonly used.
In order to improve the precision of 3D measurement models, at present frequently with a kind of mode be by setting up parameterized model, so
Measurement model is approached by deforming the methods such as iteration under the constraint of energy function using parameterized model afterwards, the parameter after deformation
That changes that model and measurement model have largely is similar, but smoothness, precision will be far superior to measurement model.
The premise of the method based on parameterized model is to measure the accurate model of human body, hidden to individual however as people
Private emphasis, it is desirable to which user measures the selection of simultaneously non-optimal under nearly nude state, therefore, when human body is worn the clothes under pattern,
How to obtain the accurate net models of human body 3D to be fitted in order to 3D, be still a problem.
The content of the invention
The technical problem to be solved in the present invention is：Prior art is difficult to obtain accurate human body in the case where human body wears the clothes pattern
The problem that the net models of 3D are fitted in order to 3D, proposes a kind of method for setting up the net models of human body 3D and its answering in 3D fittings
With.
The present invention proposes a kind of method for setting up the net models of human body 3D, comprises the following steps：
S1:Set up and contain height, body weight, the net model databases of human body 3D of gender information；
S2:Depth image of the collection current human under clothing situation；
S3:Obtain height, body weight and the gender information of current human；
S4:From the net model databases of human body 3D extract and sex identical close with current human's height and body weight to
A few net model of human body 3D is used as the net model of sample；
S5:The net model of current human is obtained according to the net model of sample.
Preferably, the net models of human body 3D are comprising height, body weight, the net model of the 3D point cloud of gender information in the step S1
Or the one kind in the net model of 3D grids.
Preferably, the depth image in the step S2 refers to that the local depth image of current human or human body are global
Depth image.
Preferably, the net model for obtaining current human according to the net model of sample in the step S5 is referred to：When the sample
In this net model during the net model of only one human body 3D, using the net models of human body 3D as the net models of the 3D of current human.
Preferably, the net model for obtaining current human according to the net model of sample in the step S5 is referred to：When the sample
When the net models of human body 3D in this net model have two or more, using the averaging model of the net model of the sample as current
The net model of human body, or the accurate net models of human body 3D can be obtained by the algorithm of machine learning.
Preferably, it is when the quantity of the net models of human body 3D in the net model of the sample is 2-10, the sample is net
The averaging model of model as current human net model.
Preferably, when the quantity of the net models of human body 3D in the net model of the sample is more than 10, can be by machine
The algorithm of study obtains the accurate net models of human body 3D, and specific step is：
S51:One in the net model of sample is chosen as the net model of standard；
S52:Other models in the net model of sample obtain deformation relationship through machine learning；
S53:With current human's depth image as foundation, the net model of standard is obtained according to deformation relationship after deformation
The net models of 3D of current human.
Preferably, the deformation relationship in the step S52 includes the deformation relationship determined by posture and/or is determined by build
Deformation relationship.
Preferably, the net model of standard is obtained into the net of current human according to deformation relationship after deformation in the step S53
Model, specifically comprises the following steps：
S531:Set up the energy function for the net model of criterion and current human's model depth image uniformity；
S532:Non-rigid deformation is carried out to the net model of the standard under the constraint of the energy function；
S533:Using through the net model of the standard after non-rigid deformation as the net models of the 3D of current human.
Based on the above-mentioned method for setting up the net models of human body 3D, the present invention also propose it is a kind of set up the net models of human body 3D be
System, including memory, for depositing program；Processor, runs described program, and the net models of human body 3D are set up for control is described
System perform the above-mentioned method for setting up the net models of human body 3D.
The present invention proposes a kind of computer-readable recording medium comprising computer program again, and the computer program can be grasped
Make to make computer perform the above-mentioned method for setting up the net models of human body 3D.
Based on the above-mentioned method for setting up the net models of human body 3D, the present invention also proposes a kind of 3D fitting methods, including following step
Suddenly：
T1:The human body net models of 3D are created according to the above-mentioned method for setting up the net models of human body 3D；
T2:Create clothing model；
T3:Clothes effect will be shown after clothing model and the net model synthesis of human body 3D.
Based on the above-mentioned method for setting up the net models of human body 3D, the present invention also proposes a kind of 3D dressing systems, including memory,
For depositing program；Processor, runs described program, for controlling the 3D dressing systems to perform above-mentioned 3D fitting methods.
The present invention proposes a kind of computer-readable recording medium comprising computer program again, and the computer program can be grasped
Make to make computer perform above-mentioned 3D fitting methods.
Compared with prior art, beneficial effects of the present invention are：The invention provides a kind of human body 3D net models set up
Method, by setting up the net model databases of human body 3D, and considers the influence of height, body weight and sex, targetedly carries
This net model is sampled, the influence of clothes and the shadow of the local feature brought by height, body weight and sex etc. can be simultaneously removed
Ring, the net model of human body can be exactly obtained merely with depth image of the human body under clothing situation.
In addition, the creation method based on the above-mentioned net models of human body 3D, of the invention also to propose a kind of 3D fitting methods and 3D examinations
Clothing system, no matter human body wears loose clothing or compact clothing, using 3D fitting methods of the invention or system, can be real
When and 360 ° show the effect worn the clothes.
Brief description of the drawings
Fig. 1 is the general flow chart of the net model creation methods of human body 3D in the specific embodiment of the invention.
The sub-process figure of the step of Fig. 2 is the net model creation methods of human body 3D in specific embodiment of the invention S5.
The sub-process figure of the step of Fig. 3 is the net model creation methods of human body 3D in specific embodiment of the invention S53.
Fig. 4 is the flow chart of 3D fitting methods in the specific embodiment of the invention.
Specific embodiment
The premise of parametric modeling method is to measure the accurate model of human body, however as people to the note of individual privacy
Weight, it is desirable to which user measures the selection of simultaneously non-optimal under nearly nude state.Therefore in the case where people wear the clothes situation, by wearing
Clothing model carries out clothing and calculates, and obtains the accurate net models of human body 3D, further carries out 3D fittings and would is that one is preferably selected
Select.With reference to specific embodiment and compare accompanying drawing the present invention is described in further details.
1st, the method for setting up the net models of human body 3D
The method for setting up the net models of human body 3D, as shown in figure 1, including following steps：S1:Set up the net models of human body 3D
Database；S2:Depth image of the collection current human under clothing situation；S3:Obtain height, body weight and the sex of current human
Information；S4:The net model of sample is chosen from the net model databases of human body 3D；S5:Obtain current human's according to the net model of sample
Net model.Wherein, set up the net model databases of human body 3D in step S1, but including obtain human body 3D point cloud or the net model of grid,
The steps such as height measurement, measured body weight and sex acquisition；Height, body weight and the sex letter of current human are obtained in step S3
Breath, including height measurement, measured body weight and sex such as obtain at the step；Chosen from the net model databases of human body 3D in step S4
The net model of sample, refers to choose that height, body weight be close and sex identical from the net model databases of human body 3D set up
Model is used as the net model of sample.Above-mentioned steps will be described in detail below.
S1:Set up the net model databases of human body 3D
It is the premise for obtaining human parameters model to set up human body 3D model databases, and the species of model also can in database
Have influence on the quality of final argument model.
The quantity of net model is as more as possible in model database, data will as far as possible comprehensively, not only comprising Human Height,
Body weight, gender information, the also human body model data comprising same human body under different gestures, multiple different human bodies are in close posture
Under human body model data, multiple heights, body weight be close and sex identical different human body model data, is respectively intended to react people
Difference of the body under different gestures, difference of difference and different human body of the different human body on build in local detail feature
It is different.
Set up the net model databases of human body 3D, each net model to not obtain under clothing or tight situation, institute
Say not clothing refer to the situation for only wearing underwear.The foundation of database is to calculate preparation in order to follow-up model of wearing the clothes carries out clothing
's.
In this embodiment, net models of 3D in database except the net model of 3D point cloud or grid of itself it
Outward, also including height, body weight and gender information.Thus, setting up net model database mainly includes the net model measurements of human body 3D, body
High measurement, measured body weight and the several aspects of gender identity.
The net model measurement methods of human body 3D
The method measured currently used for 3D is roughly divided into the method based on laser scanner and based on depth camera.Laser
The high precision of scanner, but involve great expense, the speed of scanning is also relatively slow, is mainly used in surveying the 3D of some small-sized rigid objects
Amount；Method based on depth camera is human body measurement method conventional at present, preferential in this specific embodiment to choose based on deep
The method for spending camera, further chooses and is based on the trigon depth camera of structure light, for the survey of the net models of human body 3D
Amount.
In other specific embodiments can using being based on laser scanner, or using based on time flight method or
The depth camera of Binocular Vision Principle carrys out the measurement for the net models of human body 3D.
Based on the trigon depth camera of structure light using laser-projector to projecting encoded normal structure in space
Light pattern, the difference of target depth is modulated normal structure light pattern in space, is obtained by image correlation scheduling algorithm
Structure light image and the difference of normal structure light pattern after modulation, the difference and target depth are set up according to structure light trigonometry
Between relation can solve the depth image of whole object space.
Usually, it is difficult to whole human body informations are obtained by piece image, it is necessary to obtain the depth at each position of human body
Degree image, then overall human body 3D point cloud data are obtained after being merged by registration algorithm.The 3D points obtained by depth camera
Cloud data typically can not be directly as human body model data, in addition it is also necessary to the step of being pre-processed by some.Usually, including figure
As segmentation, denoising, gridding, set up the steps such as corresponding relation.
Image segmentation.It is general in the depth image that thus depth camera is obtained also to be carried on the back including other in addition to human body parts
Scape composition, the step of being necessitated using image segmentation algorithm removal background.Due to the uniqueness of depth image data, i.e., its is each
A kind of depth distance of the object that pixel value is represented, simple image segmentation algorithm --- threshold method just can effectively remove the back of the body
Scape.Specifically, i.e., the threshold value of human body and background can be reasonably differentiated by setting, the pixel value that will belong to background parts is returned
Zero (or taking maximum), reservation belongs to the pixel value of human body.
Image denoising.Because the 3D point cloud data for obtaining are inevitable that noise (i.e. outlier) is present, while by
Blocking between human body occurs hole, and the flatness of cloud data is also poor in addition.Therefore, the purpose of image denoising
On the one hand outlier is removed, the treatment of smooth and holes filling is on the other hand carried out to cloud data.
Gridding.In specific application, such as deformation transfer, cartoon making of model etc., only for the treatment of a cloud
It is complex, thus correlation between points do not reflected in 3D point cloud.And 3D network models are then retaining
Topological relation between a cloud is increased again while point cloud, and particularly in deformation process, 3D network models have larger excellent
Gesture.Therefore, it is necessary to 3D point cloud model meshes are melted into 3D grid models.The form of grid can be triangle, polygon etc.,
Conventional is triangle grid model.
Set up corresponding relation.The build and posture of different people are all otherwise varied, therefore the 3D point cloud obtained by depth camera
Also had any different on data bulk, bigger difficulty is had in the treatment below.It is necessary when database is set up just to all
Manikin set up corresponding relation.Specifically, width quality 3D point cloud data higher are first chosen as reference.For current
The net models of human body 3D, using rigid registration or non-rigid registration algorithm, set up correspondence pass between points therebetween
System, and the corresponding relation is also served as a part for the net models of current human 3D.
Body weight is measured
The body weight of each human body is measured using doctor's type scale, obtains body weight.
Height is measured
In this embodiment, height measurement uses accurate way.3D human body data clouds are entered first
Row skeletal extraction, or by 3D human body segmentations into multiple semantic components (head, upper body, leg), then by the length phase of various pieces
Plus after obtain the height of human body.
In other specific embodiments, it is possible to use traditional dimensional measurement mode carries out height measurement, it is also possible to straight
Connect using 3D human bodies point cloud or grid data to measure height.It should be noted that when human body is in different gestures, it is impossible to one
In general Stature estimation is carried out using the peak in point cloud or grid data and the difference of minimum point.
Sex is obtained
In this embodiment, sex is obtained and uses a kind of method of automatic identification.I.e. using the coloured silk of manikin
Color image, extracts the coloured image of face, is inputted in housebroken gender sorter and is judged.According to grader
Species, processing mode is also had any different, and usually the coloured image first to face carries out principal component analysis (PCA), can be lifted
Recognition efficiency.
In other specific embodiments, under artificial auxiliary situation, artificial setting can be carried out.
On the one hand the net models of human body 3D will will cover height as much as possible, body weight as far as possible comprehensively in model database
And the net model of human body of sex；Another aspect height, body weight are close, and sex identical human body will also have enough human body 3D
Net model data.The former purpose is that can more comprehensively reflect difference of the human body on different gestures, build, the mesh of the latter
Be that can more accurately reflect difference of the human body in local detail feature.
S2:Depth image of the collection current human under clothing situation
Usually, when 3D fittings are carried out to current human, it is necessary first to obtain its net model, there is two hypothesis herein
Premise：One be current human not in the net model databases of 3D, otherwise can directly extract the net model；Two is to work as
Preceding human body usually clothing in the case of fitted, that is to say, that by depth camera obtain the corresponding people of depth image
Body Model includes the influence of clothes, and model model neter than human body 3D is big, is then obtained only according to model of wearing the clothes in the present invention
Model.
Current human collects depth image under situation of wearing the clothes by depth camera, is obtained only after image segmentation and denoising
Depth image containing human body.Here depth image can be the depth image of body local or the overall situation, for global depth
Degree image is often to be merged to form after registration by multi-amplitude deepness image.
S3:Obtain height, body weight and the gender information of current human
The body weight of human body, sex and height information can be obtained using foregoing method.
S4:The net model of sample is chosen from the net model databases of human body 3D
After the depth image and relevant information for obtaining current human, then can be from the net pattern numbers of human body 3D set up
According in storehouse choose height, body weight is close and sex identical model is used as the net model of sample.The quantity of the net model of sample is at least
It is 1.When sample size is for multiple, then can well reflect the local feature difference of the height, body weight, sex population,
The more accurate net models of human body 3D can be obtained in follow-up treatment.S5:The net of current human is obtained according to the net model of sample
Model
Quantity according to the net model of sample is different, and the acquisition modes of the net models of current human 3D are also had any different.
(1) when the net model of sample only has one, can directly using the net model as the net models of the 3D of current human.By
It is consistent in height, body weight, sex, it is this approximately to be received in the case of only one sample net model.
(2) when the net model negligible amounts of sample, when being 2-10, the average value of all net models can be taken as working as forefathers
The net models of 3D of body.The processing mode of this equalization, although the actual physical characteristic of current human can not be accurately reflected, but
For compared to the first situation, degree of approximation is higher.
(3) when the net model quantity of sample is more, when being more than 10, then can be obtained accurately by means of machine learning algorithm
The net models of human body 3D.Specific algorithm flow is as shown in Fig. 2 comprise the following steps：
S51:One in the net model of sample is chosen as the net model of standard, general selected point cloud or the good people of mesh quality
The net models of body 3D are used as the net model of standard；
S52:Other net models in the net model of sample obtain deformation relationship through machine learning.Here deformation relationship
The deformation relationship determined including the deformation relationship determined by posture and by build.Generally, the change for being determined by posture
Shape relation, is that, for other all net models in the net model of sample, can allow the net model of standard according to other net models
Pose parameter through the deformation relationship calculate after obtain the net model consistent with other net models.For the deformation determined by build
Relation, is that, for other all net models in the net model of sample, can allow the net model of standard according to other net models
Shape parameter obtains the net model consistent with other net models after being calculated through the deformation relationship.The target of machine learning is to pass through
All net model in the net model of sample is learnt, gesture distortion relation and build deformation relationship is obtained.
S53:With current human's depth image as foundation, the net model of standard is obtained according to deformation relationship after deformation
The net model of current human.Specifically, as shown in figure 3, comprising the following steps：
S531:Set up the energy function for the net model of criterion and current human's model depth image uniformity.Energy
Flow function generally comprises similarity function, the smoothness function of model and the local feature function represented with distance.
S532:Non-rigid deformation is carried out to the net model of the standard under the constraint of the energy function.It is real in this step
It is setting pose parameter, the initial value of shape parameter, by the change obtained in S52 steps under the constraint of energy function in matter
Shape relation is iterated deformation, and when energy function reaches default optimum value (typically taking minimum value) i.e., deformation terminates.Here
Deformed finger be non-rigid deformation.
S533:Using through the net model of the standard after non-rigid deformation as current human net model.By the mark after deformation
Accurate net model can extremely accurate partially or fully depth image is consistent with current human, thus can be as current human
Net model.
2nd, the system for setting up the net models of human body 3D
In this embodiment, the system for setting up the net models of human body 3D, including memory, for depositing program；Place
Reason device, runs described program, and for controlling, the system execution for setting up the net models of human body 3D is above-mentioned to set up the net moulds of human body 3D
The method of type.
In other specific embodiments, the system for setting up the net models of human body 3D can also be one kind comprising computer program
Computer-readable recording medium, the computer program is operable to make computer to perform the above-mentioned net models of human body 3D of setting up
Method.
3rd, application of the net models of human body 3D in 3D fittings
3D fitting methods, as shown in figure 4, comprising the following steps：T1：Create the human body net models of 3D；T2：Create clothing mould
Type；T3：Clothes effect will be shown after clothing model and the net model synthesis of human body 3D.Usually, first to standard stance
Manikin is fitted, and this step can regard static fitting as；Secondly the real-time fitting when actual human body postural change,
Dynamic fitting can be regarded as.Wherein dynamic fitting is actually static fitting extension in time.It is thus next main
Illustrate static fitting.
The clothing simulation model of current comparative maturity is mass spring model, is needed clothing after setting up clothing simulation model
Thing is registered with the net models of human body 3D.It is generally acknowledged that after the peak at the clothing back side and human body neck center, accordingly can be with
Realize the preliminary registration of clothing and manikin；Then realize that the part of various pieces is matched somebody with somebody according to the current framework information of human body
It is accurate.After Registration, calculating, laundry hits detection of the power of particle etc. can also be carried out, it is more real to simulate
Clothing display effect.
During follow-up real-time shows, as long as the framework information by identifying human body, then according to the skeleton
Information carries out local registration and can realize real-time 3D fittings.
3rd, 3D dressing systems
In this embodiment, 3D dressing systems, including memory, for depositing program；Processor, operation is described
Program, for controlling the 3D dressing systems to perform above-mentioned 3D fitting methods.
In other specific embodiments, 3D dressing systems can also be a kind of computer-readable comprising computer program
Storage medium, the computer program is operable to make computer perform above-mentioned 3D fitting methods.
This specific embodiment provides a kind of creation method of the net models of human body 3D based on depth camera, passes through first
The net model databases of human body 3D containing height, body weight and gender information are set up, then collection current human is under clothing situation
Depth image, and obtain height, body weight and the gender information of current human, then extracted from the net model databases of human body 3D with
Current human's height, body weight are close, the net models of human body 3D of sex identical at least one as the net model of sample, finally further according to
The net model of sample obtains the net models of 3D of current human.This specific embodiment by setting up the net model databases of human body 3D, and
And the influence of consideration height, body weight and sex, the net model of sample is targetedly extracted, can simultaneously remove the influence of clothes
And the influence of the local feature brought by height, body weight and sex etc., depth that can be merely with human body under clothing situation
Image obtains the net models of 3D of human body exactly.
In addition, the creation method based on the above-mentioned net models of human body 3D, this specific embodiment also proposes a kind of 3D fitting sides
Method and 3D dressing systems, no matter human body wears loose clothing or compact clothing, uses the 3D fitting sides of this specific embodiment
Method or system, can in real time and 360 ° show the effect worn the clothes.
Above content is to combine specific preferred embodiment further description made for the present invention, it is impossible to assert
Specific implementation of the invention is confined to these explanations.For those skilled in the art, do not taking off
On the premise of present inventive concept, some equivalent substitutes or obvious modification can also be made, and performance or purposes are identical, all should
When being considered as belonging to protection scope of the present invention.
Claims (13)
1. a kind of method for setting up the net models of human body 3D, it is characterised in that comprise the following steps：
S1:Set up and contain height, body weight, the net model databases of human body 3D of gender information；
S2:Depth image of the collection current human under clothing situation；
S3:Obtain height, body weight and the gender information of current human；
S4:And sex identical at least close with current human's height and body weight is extracted from the net model databases of human body 3D
The individual net models of human body 3D are used as the net model of sample；
S5:The net model of current human is obtained according to the net model of sample.
2. the method for setting up the net models of human body 3D according to claim 1, it is characterised in that the depth in the step S2
Image refers to the local depth image of current human or the global depth image of human body.
3. the method for setting up the net models of human body 3D according to claim 1, it is characterised in that according to sample in the step S5
The net model that this net model obtains current human is referred to：When the net models of only human body 3D in the net model of the sample,
Using the net models of human body 3D as current human net model.
4. the method for setting up the net models of human body 3D according to claim 1, it is characterised in that according to sample in the step S5
The net model that this net model obtains current human is referred to：When the net models of human body 3D in the net model of the sample have two or two
During the individual above, using the averaging model of the net model of the sample as current human net model, or by the calculation of machine learning
Method obtains the accurate net models of human body 3D.
5. the method for setting up the net models of human body 3D according to claim 4, it is characterised in that when in the net model of the sample
The net models of human body 3D quantity be 2-10 when, using the averaging model of the net model of the sample as current human net mould
Type.
6. the method for setting up the net models of human body 3D according to claim 4, it is characterised in that when in the net model of the sample
The net models of human body 3D quantity be more than 10 when, obtain the accurate net models of human body 3D by the algorithm of machine learning, and
Specific step is：
S51:One in the net model of sample is chosen as the net model of standard；
S52:Other models in the net model of sample obtain deformation relationship through machine learning；
S53:With current human's depth image as foundation, the net model of standard is obtained current according to deformation relationship after deformation
The net models of 3D of human body.
7. the method for setting up the net models of human body 3D according to claim 6, it is characterised in that the change in the step S52
Shape relation includes the deformation relationship determined by posture and/or the deformation relationship determined by build.
8. the method for setting up the net models of human body 3D according to claim 6, it is characterised in that will mark in the step S53
Accurate net model obtains the net model of current human according to deformation relationship after deformation, specifically comprises the following steps：
S531:Set up the energy function for the net model of criterion and current human's model depth image uniformity；
S532:Non-rigid deformation is carried out to the net model of the standard under the constraint of the energy function；
S533:Using through the net model of the standard after non-rigid deformation as the net models of the 3D of current human.
9. a kind of system for setting up the net models of human body 3D, it is characterised in that including memory, for depositing program；Processor, fortune
Row described program, for controlling the system for setting up the net models of human body 3D to perform the side as described in claim 1-8 is any
Method.
10. a kind of computer-readable recording medium comprising computer program, the computer program is operable to make computer
Perform the method as described in claim 1-8 is any.
A kind of 11. 3D fitting methods, comprise the following steps：
T1:The human body net models of 3D are created according to any described methods of claim 1-8；
T2:Create clothing model；
T3:Clothes effect will be shown after clothing model and the net model synthesis of human body 3D.
12. a kind of 3D dressing systems, it is characterised in that including memory, for depositing program；Processor, runs described program,
For controlling the 3D dressing systems to perform 3D fitting methods as claimed in claim 11.
A kind of 13. computer-readable recording mediums comprising computer program, the computer program is operable to make computer
Perform 3D fitting methods as claimed in claim 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710079332.7A CN106933976B (en) | 2017-02-14 | 2017-02-14 | Method for establishing human body 3D net model and application thereof in 3D fitting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710079332.7A CN106933976B (en) | 2017-02-14 | 2017-02-14 | Method for establishing human body 3D net model and application thereof in 3D fitting |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106933976A true CN106933976A (en) | 2017-07-07 |
| CN106933976B CN106933976B (en) | 2020-09-18 |
Family
ID=59424643
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710079332.7A Active CN106933976B (en) | 2017-02-14 | 2017-02-14 | Method for establishing human body 3D net model and application thereof in 3D fitting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106933976B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108053437A (en) * | 2017-11-29 | 2018-05-18 | 深圳奥比中光科技有限公司 | Three-dimensional model acquiring method and device based on figure |
| CN108921635A (en) * | 2018-05-11 | 2018-11-30 | 江苏皓之睿数字科技有限公司 | A kind of human body accurate-size acquisition system and method |
| CN110021061A (en) * | 2018-01-08 | 2019-07-16 | 广东欧珀移动通信有限公司 | Collocation model building method, dress ornament recommended method, device, medium and terminal |
| WO2020232917A1 (en) * | 2019-05-17 | 2020-11-26 | 上海凌笛数码科技有限公司 | Automatic human body parameter generation method based on machine learning |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101650839A (en) * | 2009-08-11 | 2010-02-17 | 东华大学 | Fitting performance evaluation method of three dimensional garment in network environment |
| CN101976453A (en) * | 2010-09-26 | 2011-02-16 | 浙江大学 | GPU-based three-dimensional face expression synthesis method |
| CN102332180A (en) * | 2011-10-15 | 2012-01-25 | 杭州力孚信息科技有限公司 | Three-dimensional garment modeling and pattern designing method based on draping |
| US20120072462A1 (en) * | 2010-09-21 | 2012-03-22 | Alibaba Group Holding Limited | Processing of categorized product information |
| CN102982578A (en) * | 2012-10-31 | 2013-03-20 | 北京航空航天大学 | Estimation method for dressed body 3D model in single character image |
| CN104008571A (en) * | 2014-06-12 | 2014-08-27 | 深圳奥比中光科技有限公司 | Human body model obtaining method and network virtual fitting system based on depth camera |
| CN104091269A (en) * | 2014-06-30 | 2014-10-08 | 京东方科技集团股份有限公司 | Virtual fitting method and virtual fitting system |
| CN104240288A (en) * | 2013-06-21 | 2014-12-24 | 株式会社东芝 | Methods and systems for generating a three-dimensional representation of a subject |
| CN105956912A (en) * | 2016-06-06 | 2016-09-21 | 施桂萍 | Method for realizing network fitting |
-
2017
- 2017-02-14 CN CN201710079332.7A patent/CN106933976B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101650839A (en) * | 2009-08-11 | 2010-02-17 | 东华大学 | Fitting performance evaluation method of three dimensional garment in network environment |
| US20120072462A1 (en) * | 2010-09-21 | 2012-03-22 | Alibaba Group Holding Limited | Processing of categorized product information |
| CN101976453A (en) * | 2010-09-26 | 2011-02-16 | 浙江大学 | GPU-based three-dimensional face expression synthesis method |
| CN102332180A (en) * | 2011-10-15 | 2012-01-25 | 杭州力孚信息科技有限公司 | Three-dimensional garment modeling and pattern designing method based on draping |
| CN102982578A (en) * | 2012-10-31 | 2013-03-20 | 北京航空航天大学 | Estimation method for dressed body 3D model in single character image |
| CN104240288A (en) * | 2013-06-21 | 2014-12-24 | 株式会社东芝 | Methods and systems for generating a three-dimensional representation of a subject |
| CN104008571A (en) * | 2014-06-12 | 2014-08-27 | 深圳奥比中光科技有限公司 | Human body model obtaining method and network virtual fitting system based on depth camera |
| CN104091269A (en) * | 2014-06-30 | 2014-10-08 | 京东方科技集团股份有限公司 | Virtual fitting method and virtual fitting system |
| CN105956912A (en) * | 2016-06-06 | 2016-09-21 | 施桂萍 | Method for realizing network fitting |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108053437A (en) * | 2017-11-29 | 2018-05-18 | 深圳奥比中光科技有限公司 | Three-dimensional model acquiring method and device based on figure |
| CN108053437B (en) * | 2017-11-29 | 2021-08-03 | 奥比中光科技集团股份有限公司 | Three-dimensional model obtaining method and device based on posture |
| CN110021061A (en) * | 2018-01-08 | 2019-07-16 | 广东欧珀移动通信有限公司 | Collocation model building method, dress ornament recommended method, device, medium and terminal |
| CN108921635A (en) * | 2018-05-11 | 2018-11-30 | 江苏皓之睿数字科技有限公司 | A kind of human body accurate-size acquisition system and method |
| WO2020232917A1 (en) * | 2019-05-17 | 2020-11-26 | 上海凌笛数码科技有限公司 | Automatic human body parameter generation method based on machine learning |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106933976B (en) | 2020-09-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2680228B1 (en) | Improvements in or relating to three dimensional close interactions. | |
| CN106778468B (en) | 3D face identification method and equipment | |
| CN106157372B (en) | A kind of 3D face grid reconstruction method based on video image | |
| US20190035149A1 (en) | Methods of generating personalized 3d head models or 3d body models | |
| CN109844818B (en) | Method for building deformable 3d model of element and related relation | |
| CN106933976A (en) | Set up the method for the net models of human body 3D and its application in 3D fittings | |
| CN109887082A (en) | A kind of interior architecture three-dimensional modeling method and device based on point cloud data | |
| CN106778628A (en) | A kind of facial expression method for catching based on TOF depth cameras | |
| CN106952335B (en) | Method and system for establishing human body model library | |
| EP2327061A1 (en) | Method and apparatus for estimating body shape | |
| KR20060057627A (en) | Object posture estimation/correlation system using weight information | |
| CN106778474A (en) | 3D human body recognition methods and equipment | |
| CN109003331A (en) | A kind of image reconstructing method | |
| CN108898673A (en) | A kind of reconstruct foot triangle grid model processing method and system | |
| CN108154104A (en) | A kind of estimation method of human posture based on depth image super-pixel union feature | |
| CN109102569A (en) | A kind of reconstruct foot point cloud model processing method and system | |
| CN109330106A (en) | A kind of subscript dimension measurement method based on mobile phone photograph | |
| CN109655011B (en) | Method and system for measuring dimension of human body modeling | |
| CN109101864A (en) | The upper half of human body action identification method returned based on key frame and random forest | |
| CN108898663A (en) | A kind of foot's characteristic parameter driving standard shoe tree deformation method and system | |
| CN111951383A (en) | Face reconstruction method | |
| CN106778491B (en) | The acquisition methods and equipment of face 3D characteristic information | |
| CN106952333A (en) | A kind of method and system for creating human body parameterized model | |
| CN109801326A (en) | It is a kind of for obtaining the image measuring method of human somatotype data | |
| CN109509194B (en) | Front human body image segmentation method and device under complex background |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: A808, Zhongdi building, industry university research base, China University of Geosciences, No.8, Yuexing Third Road, Nanshan District, Shenzhen, Guangdong 518000 Patentee after: Obi Zhongguang Technology Group Co.,Ltd. Address before: A808, Zhongdi building, industry university research base, China University of Geosciences, No.8, Yuexing Third Road, Nanshan District, Shenzhen, Guangdong 518000 Patentee before: SHENZHEN ORBBEC Co.,Ltd. |
|
| CP01 | Change in the name or title of a patent holder | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220629 Address after: 710061 room 1101, building C2, yunhuigu (Xi'an software new town R & D base phase II project), 156 tianguba Road, software new town, Xi'an high tech Zone, Shaanxi Province Patentee after: Xi'an aobi Tuojiang Technology Co.,Ltd. Address before: A808, Zhongdi building, industry university research base, China University of Geosciences, No.8, Yuexing Third Road, Nanshan District, Shenzhen, Guangdong 518000 Patentee before: Obi Zhongguang Technology Group Co.,Ltd. |
|
| TR01 | Transfer of patent right |