CN105913493A - Interaction property and three-dimensional model combined construction method based on single image - Google Patents
Interaction property and three-dimensional model combined construction method based on single image Download PDFInfo
- Publication number
- CN105913493A CN105913493A CN201610261400.7A CN201610261400A CN105913493A CN 105913493 A CN105913493 A CN 105913493A CN 201610261400 A CN201610261400 A CN 201610261400A CN 105913493 A CN105913493 A CN 105913493A
- Authority
- CN
- China
- Prior art keywords
- parts
- image
- model
- labelling
- interaction attributes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
Landscapes
- Physics & Mathematics (AREA)
- Geometry (AREA)
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides an interaction property and three-dimensional model combined construction method based on a single image. The method comprises the following steps that a single image including an interaction property object is inputted and marking of an object bounding box and components is completed; a structure model of the object is established and component size and layout optimization is completed; acting force marking is performed on each component on the structure model so that a component force diagram structure is constructed; the type of each component is determined so that a three-dimensional model having the interaction property is generated; and iteration of the steps is performed and the object internal structure design of the image is completed. The limitation that object internal structure information cannot be known from the image can be overcome, and users are enabled to design the object internal structure of the image in a personalized way so that the complete three-dimensional model having the interaction property is obtained. The method is suitable for designers and other professional users and also suitable for common amateur users so that the method has wide application prospect in the field of three-dimensional model rapid prototype design, interior decoration design and e-commerce.
Description
Technical field
The present invention relates to field of Computer Graphics, a kind of interaction attributes based on single image joins with threedimensional model
Close construction method.
Background technology
One of three-dimensional modeling main direction of studying always being field of Computer Graphics.Interaction attributes is combined with threedimensional model
Structure can quickly generate the threedimensional model that user directly can be mutual, therefore has interaction attributes for common in daily life
Object, it is a most interesting and significant job that structure generation has the threedimensional model of interaction attributes, quick at threedimensional model
The fields such as prototype, interior decoration design and ecommerce have broad application prospects.
In field of Computer Graphics, three-dimensional modeling based on image has had long-term development and research, and currently still
Being the focus of research, a lot of researchers are devoted to three-dimensional modeling based on image research.Byong Mok Oh et al. is 2001
Year proposes a kind of modeling based on image and editing system.By input picture is layered, reconstruct three-dimensional scenic so that permissible
Direct editing input picture.Nianjuan Jiang et al. proposed a kind of veined three-dimensional based on single image and builds in 2009
Mould method, needs user to guide alternately in modeling process.Manfred Lau et al. proposed a framework in 2010, it is allowed to use
Threedimensional model, using image as a rough guidance, is designed in family personalizedly.But, build threedimensional model with image for input
Remain a challenging task.Owing to different types of model has different structure and featuress, so being hardly formed
A kind of unified modeling method is applicable to different types of model construction.Therefore, present stage three-dimensional modeling based on image is studied all
Only consider a certain certain types of object, such as based on image Plants modeling, City Modeling based on image etc..
In terms of the object three-dimensional modeling with interaction attributes, there are some researchs and progress.Wanbin Pan et al. exists
Within 2011, propose a kind of furniture modeling method based on sample, by reusing existing threedimensional model, and on model, add ginseng
Number limits thus builds and generate new three-dimensional furniture model.Youyi Zheng et al. proposed a kind of based on symmetrical temper in 2013
Structure matching, the rational model of method of geometry constructing function of replacement.Manfred Lau et al. proposed one side in 2011
Method carries out structural analysis to the three-dimensional furniture model of input, isolates all parts, and generates the attachment structure between all parts,
The model generated is made to have interaction attributes.Yuliy Schwartzburg et al. proposed a kind of calculating method for designing in 2013,
Can be assembled by " chain flat components " and generate threedimensional model.This modeling method can expand to the assembling of mock-up funiture and build.
Yuliang Rong et al. proposed a kind of interactive approach recovering functional prototype from individual RGBD image in 2016, should
Method has had to believable functional parts, but modeling does not generates actual threedimensional model.
The above present Research shows, is currently based on the three-dimensional modeling method of image mostly just for certain types of object, right
Modeling in the object with interaction attributes need deeply, and existing modeling method seldom relates to object interaction attribute and three
Dimension module joint mapping problem.
Summary of the invention
The technology of the present invention solves problem: overcome the most methodical deficiency, the invention provides a kind of mutual genus based on single image
Property with threedimensional model joint mapping method, the method has the image of interaction attributes object as input using single width, by user's
Simple marking, rapid build generates image object 3 d structure model.Then, on image object structural model, user is carried out again
The labelling of parts stressing conditions, build all parts force diagram structure, so that it is determined that the type of all parts, interactive mode with
And attachment structure.Finally, the basic element of character model generation preset is utilized to have the threedimensional model of interaction attributes.
For completing goal of the invention, the technical solution used in the present invention is: a kind of interaction attributes based on single image and threedimensional model
Joint mapping method, the method comprises the following steps:
Step one: input individual image with interaction attributes object and complete the labelling of object bounding box and parts；
Step 2: set up the structural model of image object and complete part dimension, layout optimization；
Step 3: all parts does on structural model active force labelling, builds parts force diagram structure；
Step 4: determine each unit type, generates the threedimensional model with interaction attributes；
Step 5: iteration above step, completes image object internal structure design.
Wherein, in " interaction attributes " described in step one, refer to translation, rotate to be main parts interactive mode, such as drawer
Pull, the rotation etc. of door and window." structural model of image object " described in step 2, refers to the main body of image object
Framework is abstract is a cube, by abstract for the parts of object thin piece of some cubes being to be attached to main body frame solid front faces.
" part dimension, layout optimization " described in step 2, refers to owing to the parts of user's manually rough labelling in step one can
Can in size, layout misalignment, so needing to consider that all parts is adjacent size and the position relationship of parts so that each
Parts can align.Each parts length of side needs to meet:
Wherein, SiRepresent the length on i-th limit, I after optimizingiRepresent the length on i-th limit of user's labelling, SijRepresent with
Article i-th, the set on all limits that limit is adjacent, n represents the quantity on limit to be optimized, and λ is the parameter of two before and after balance.
Wherein, " the parts force diagram structure " described in step 3, refer to stress surface (i.e. one rectangle of parts
Face) each limit abstract be a node, i.e. have four limit nodes, they are sequentially connected, on this this stress surface external add one
Individual face node, each node can be stress node with one active force of labelling, the node that marked active force, thus constitute
Structure be " parts force diagram structure ".By this graph structure, just can determine that the particular type of these parts, different types of portion
Part has different motion modes and attachment structure, the most just can get the threedimensional model with interaction attributes in step 4.
Wherein, " internal structure design " described in step 5, the object being because on input picture is typically all closure state
, user cannot be any structure inside aware object from image on earth.Therefore, the present invention allows user at above-mentioned model
On the basis of further design its internal structure.
Compared with prior art, its useful feature is the present invention:
1, the present invention uses individual to have the image of interaction attributes object as input, can realize image under user guides alternately
The interaction attributes of object and threedimensional model joint mapping.
What 2, the present invention proposed a kind of interactive boot can interactive component modeling method so that the threedimensional model parts tool of generation
There is interaction attributes.
3, the present invention allows user that image object model does the internal structure design of personalization.
Accompanying drawing explanation
Fig. 1 is the inventive method flowchart；
Fig. 2 is the method for the invention schematic flow sheet；
Fig. 3 is the parts force diagram structural representation of the present invention；
Fig. 4 is four kinds of building block models that the present invention defines；
Fig. 5 is the internal structure design schematic flow sheet of the present invention.
Detailed description of the invention
In order to make the purpose of the present invention, technical scheme and advantage clearer, in detail below as a example by furniture models, in conjunction with
Accompanying drawing, is explained in detail explanation to the method for the present invention.
The present invention proposes interaction attributes based on single image and threedimensional model joint mapping method.As a example by furniture models, this
Method, using individual furniture image as input, goes out bounding box and all parts of furniture, just by the hand labeled that user is rough
Can generate the structural model of furniture by rapid build, this structural model is one is just being attached to bounding box cube by abstract for the parts of furniture
Thin piece of the cube in face, while user's flag member, the method intercepted all parts sectional drawing so as to generate with
The mock-up funiture of texture mapping.Further it is proposed that a kind of interactive boot can interactive component modeling method.User exists
The stressing conditions of labelling all parts on said structure model, this method determines furniture parts by setting up parts force diagram structure
Particular type, generates that have can the mock-up funiture of interactive component.Owing to the internal structure of furniture cannot be learnt on image, this
Bright design furniture internal structure with also allowing for user individual.The present invention, can quickly, just under the mutual guiding of a small amount of user
Prompt ground generating unit can be mutual mock-up funiture, it is adaptable to specialty furniture design teacher, be also applied for common amateur user.
Present invention interaction attributes based on single image and threedimensional model joint mapping method, operating process such as figure, shown in 2, tool
It is as follows that body implements step:
Step one: input individual furniture image and complete the labelling of furniture bounding box and all parts.
The present invention, using individual furniture image as input, carries out furniture modeling.Firstly the need of user, input picture is marked,
Labelling is divided into two kinds: the labelling to furniture bounding box, and the labelling to furniture all parts.As shown in (a) in Fig. 2,
The cube that dotted line is constituted is the bounding box of furniture, and solid line tetragon is all parts of furniture.Mark to furniture bounding box
The note present invention uses existing method, and user marks six summits of this furniture outermost on image, just can automatically calculate
Obtain the coordinate on other two summit, thus identify the cube of its correspondence.Then, in the cubical front of above-mentioned bounding box,
User, by marking the tetragon borderline region of all parts, completes the labelling to furniture parts.
Step 2: set up furnature construction model and complete part dimension, layout optimization.
By the labelling of step one, the present invention can quickly generate the structural model of furniture.So-called furnature construction model, in Fig. 2
(b) shown in, refer to by abstract for the main body frame of furniture be a cube, by abstract for the parts of furniture for being attached to main body frame
Thin piece of some cubes of solid front faces.Additionally, due in step one parts of user's manually rough labelling may size,
Misalignment in layout, so the present invention proposes a kind of parts automatic aligning algorithm and makes adjacent parts to align.This algorithm
Need to consider that neighbouring relations and the length of side of all parts of parts, each length of side need to meet:
Wherein, SiRepresent the length on i-th limit, I after optimizingiRepresent the length on i-th limit of user's labelling, SijRepresent with
Article i-th, the set on all limits that limit is adjacent, n represents the quantity on limit to be optimized, and λ is the parameter of two before and after balance.Above-mentioned public affairs
Formula is a quadratic function, can quickly try to achieve result by conjugate gradient algorithms.
Step 3: all parts does on structural model active force labelling, builds parts force diagram structure.
On the basis of above-mentioned furnature construction model, what the present invention proposed a kind of interactive boot can interactive component modeling method.
By user to each parts labelling stressing conditions in structural model, construct parts force diagram structure, determine the type of each parts.
User's labelling for convenience, each furniture parts is introduced at five " control point " by the present invention, such as five in (b) in Fig. 2
Black blockage, around the four edges of four control point correspondence furniture parts, records the stressing conditions on each limit, center control point pair
Answer the face of furniture parts, record the stressing conditions in this face.Each control point can the active force in labelling direction, such as (b) in Fig. 2
Shown arrow.After completing the labelling of parts stressing conditions, the present invention corresponding each component construction force diagram structure, such as figure
Shown in 3.The node of three types is included: limit node, face node and stress node in parts force diagram structure.Bian Jie
Point has two attribute: the angle of the limit corresponding with the distance of stress node, this limit node and Impact direction.Face node can only be subject to
To the power in this face vertical, need individual processing.As it is shown on figure 3, node a is then a stress node in (b) in Fig. 3, its
Impact direction be level to the right, in (c) in Fig. 3, node a is also a stress node, its Impact direction be vertical outwards.
Step 4: determine each unit type, generates that have can the mock-up funiture of interactive component.
On the basis of above-mentioned parts force diagram structure, in order to determine particular type and the motion mode of all parts, the present invention
For each node V in parts force diagram structureiParameter (d is seti,θi), wherein diIt it is this node distance stress node distance,
θiRefer to the angle on limit that this node is corresponding and the active force of user's labelling, owing to face node can only be acted on by being perpendicular to this face
Power, so needing individual processing.Type and the position of member connection structure is determined eventually through equation below.
Wherein V ' is the set of the node needing to arrange attachment structure.If having θ for all of ii≠ 0, then this connection knot
Structure is hinge types, and position is at the node that distance stress node is farthest, and otherwise, attachment structure is then sliding type, connects knot
The structure i.e. position of chute is at the node parallel with user's labelling force direction.If additionally, the active force of user's labelling is positioned at
On one face node, then this member connection structure is the sliding type along force direction.Also have a kind of special situation, i.e. do not have
By the parts force diagram structure of user's labelling, this situation present invention then gives tacit consent to does not has movable parts herein, is a sky
Grid.
Invention defines four kinds of modal furniture parts types: revolving door, sliding door, drawer and hollow grid, and
And give the master pattern of these four parts, as shown in Figure 4.
On the basis of the above, the present invention utilizes the method for constructive solid geometry to cut Furniture Body cube, to above-mentioned mark
Quasi-component carries out deforming, translating, and assembles them into a complete mock-up funiture, and according to the particular type of parts and motion side
Parts in mock-up funiture are added kinematic constraint, finally give the mock-up funiture that parts can be mutual, such as (c) in Fig. 2 by formula
Shown in.
Step 5: iteration above step, completes the design of inside of furniture structure.
Owing to cannot obtain inside of furniture structure from furniture image, the present invention designs the internal junction of furniture with allowing user individual
Structure, its operating process is as shown in Figure 5.Design to inside of furniture structure comprises the steps: (a) user labelling in fig. 2
On the basis of, by user's labelling subassembly, set up structural model, by labelling stressing conditions on structural model, determine son
Unit type, thus generate final internal structure model.Complete internal structure design, just can obtain final mock-up funiture,
As shown in (d) in Fig. 2.It is attached to step one intercepts the parts pinup picture obtained on mock-up funiture, has just obtained band textured
The mock-up funiture of pinup picture, as shown in (e) in Fig. 2.So far, i.e. obtained one with pinup picture, have can interactive component,
There is the complete furniture threedimensional model of internal structure.
The foregoing is only some basic explanations of the present invention, any equivalent transformation done according to technical scheme, all
Protection scope of the present invention should be belonged to.
Claims (7)
1. an interaction attributes based on single image and threedimensional model joint mapping method, it is characterised in that comprise the following steps:
Step (1) inputs individual to be had interaction attributes object images and completes the labelling of object images bounding box and parts；
Step (2) is set up the structural model of image object and completes part dimension, layout optimization；
All parts is done active force labelling on structural model by step (3), builds parts force diagram structure；
Step (4), according to parts force diagram structure, determines each unit type, generates the threedimensional model with interaction attributes；
Step (5) iteration above step, completes the internal structure design of image object.
Interaction attributes based on single image the most according to claim 1 and threedimensional model joint mapping method, its feature exists
In: the interaction attributes described in step (1) refers to translation, rotates to be main parts interactive mode, including the pull of drawer,
The rotation of door and window.
Interaction attributes based on single image the most according to claim 1 and threedimensional model joint mapping method, its feature exists
In: the configuration model of step (2) described image object is: by abstract for the main body frame of image object be a cube,
By abstract for all parts of image object thin piece of some cubes being to be attached to main body frame solid front faces, by these cube institutes
The model constituted is the structural model of image object.
Interaction attributes based on single image the most according to claim 1 and threedimensional model joint mapping method, its feature exists
In: part dimension, layout optimization described in step (2) be: in step (1), the parts of user's manually rough labelling may
Misalignment in size, layout, needs to consider size and the position relationship that all parts is adjacent parts so that each parts can
With alignment, each parts length of side needs to meet:
Wherein, SiRepresent the length on i-th limit, I after optimizingiRepresent the length on i-th limit of user's labelling, SijRepresent with
Article i-th, the set on all limits that limit is adjacent, n represents the quantity on limit to be optimized, and λ is the parameter of two before and after balance.
Interaction attributes based on single image the most according to claim 1 and threedimensional model joint mapping method, its feature exists
In: the structure of the parts force diagram structure described in step (3) is by the stress surface of parts, and i.e. a rectangle face is each
Individual limit is abstract is a node, has four limit nodes, and they are sequentially connected, and this this stress surface external adds a face node,
One active force of labelling on each node, the node that marked active force is stress node, and the structure thus constituted is parts
Force diagram structure.
Interaction attributes based on single image the most according to claim 1 and threedimensional model joint mapping method, its feature exists
In: each unit type of determination described in step (4), generate the threedimensional model with interaction attributes, refer to according to parts stress
The position of stress node, the information of suffered active force in graph structure, determine the particular type of all parts, motion mode and
The position of attachment structure, the parts in the threedimensional model thus generated just are provided with attribute that can be mutual.
Interaction attributes based on single image the most according to claim 1 and threedimensional model joint mapping method, its feature exists
In: the image object internal structure design described in step (5) is: cannot obtain object internal structural information from image, it is allowed to
The internal structure of user individual ground designed image object, user is the sub-portion of labelling on the profile cube in object indoor design region
Part, sets up structural model, by labelling stressing conditions on structural model, determine the particular type of subassembly, motion mode,
And the position of attachment structure, thus generate final internal structure model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610261400.7A CN105913493B (en) | 2016-04-25 | 2016-04-25 | A kind of interaction attributes based on single image and threedimensional model joint mapping method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610261400.7A CN105913493B (en) | 2016-04-25 | 2016-04-25 | A kind of interaction attributes based on single image and threedimensional model joint mapping method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105913493A true CN105913493A (en) | 2016-08-31 |
| CN105913493B CN105913493B (en) | 2019-03-08 |
Family
ID=56752793
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610261400.7A Active CN105913493B (en) | 2016-04-25 | 2016-04-25 | A kind of interaction attributes based on single image and threedimensional model joint mapping method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105913493B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102508991A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Method of constructing virtual experiment teaching scene based on image material |
| CN102508994A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Virtual experiment teaching oriented dynamic component visualization method |
| CN103279599A (en) * | 2013-05-15 | 2013-09-04 | 西北工业大学 | Product modeling method based on interactive feature pair |
-
2016
- 2016-04-25 CN CN201610261400.7A patent/CN105913493B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102508991A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Method of constructing virtual experiment teaching scene based on image material |
| CN102508994A (en) * | 2011-09-30 | 2012-06-20 | 北京航空航天大学 | Virtual experiment teaching oriented dynamic component visualization method |
| CN103279599A (en) * | 2013-05-15 | 2013-09-04 | 西北工业大学 | Product modeling method based on interactive feature pair |
Non-Patent Citations (2)
| Title |
|---|
| KAI XU ET AL.: "Style-content separation by anisotropic part scales", 《ACM TRANSACTIONS ON GRAPHICS》 * |
| NOA FISH ET AL.: "Meta-representation of shape families", 《ACM TRANSACTIONS ON GRAPHICS》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105913493B (en) | 2019-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20080249756A1 (en) | Method and system for integrating computer aided design and energy simulation | |
| CN103473806A (en) | Method for building clothing three-dimensional model based on single image | |
| CN103080941A (en) | Apparatus for generating computational data, method for generating computational data, and program for generating computational data | |
| Lin et al. | MOOSAS–A systematic solution for multiple objective building performance optimization in the early design stage | |
| CN101419721A (en) | Complex indoor scene rapid drafting method based on view rejection | |
| CN113987659A (en) | Building design method based on BIM technology | |
| Tsigkari et al. | Integrated design in the simulation process | |
| Çavuşoğlu | The position of BIM tools in conceptual design phase: parametric design and energy modeling capabilities | |
| CN105913493A (en) | Interaction property and three-dimensional model combined construction method based on single image | |
| CN113051637A (en) | BIM modeling method for public medical building | |
| CN107729821A (en) | A kind of video summarization method based on one-dimensional sequence study | |
| Kota et al. | Development of a Reference Building Information Model for Thermal Model Compliance Testing--Part I: Guidelines for Generating Thermal Model Input Files. | |
| Tang et al. | Performance-Based Generative Design, An investigation of the Parametric Nature of Architecture | |
| CN103778289B (en) | A kind of visual architectural design method of wind-velocity streamline | |
| FATHY et al. | BIMPO: A Generative Parametric Technique for Building Envelope Design | |
| Lilis et al. | Space boundary topology simplification for building energy performance simulation speed-up | |
| CN103729874B (en) | Flower modeling device and flower modeling method | |
| CN106023287B (en) | A kind of the interactive three-dimensional animation synthesizing method and system of data-driven | |
| NGUYEN et al. | A shape grammar approach to climatically adaptable façade systems with real time performance evaluation | |
| CN112433265B (en) | Sunshine analyzer for high-rise residence based on city planning and use method thereof | |
| Chen | Research on mobile terminal sketch 3D modeling technology based on interactive design | |
| Tang et al. | Performative Computation-aided Design Optimization | |
| Xiongjin | Research on Interactive Design of BIM Architectural Space for Teaching Practice | |
| Iommi et al. | Evaluation of Easy-to-Use Energy Building Design Tools for Solar Access Analysis in Urban Contexts: Comparison of Friendly Simulation Design Tools for Architectural Practice in the Early Design Stage | |
| Kieferle et al. | Interactive Simulation in Virtual Environments-A Design Tool for Planners and Architects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |