WO2021244119A1 - 一种平面家装设计辅助方法 - Google Patents

一种平面家装设计辅助方法 Download PDF

Info

Publication number
WO2021244119A1
WO2021244119A1 PCT/CN2021/084729 CN2021084729W WO2021244119A1 WO 2021244119 A1 WO2021244119 A1 WO 2021244119A1 CN 2021084729 W CN2021084729 W CN 2021084729W WO 2021244119 A1 WO2021244119 A1 WO 2021244119A1
Authority
WO
WIPO (PCT)
Prior art keywords
home improvement
flat
home
materials
projection plane
Prior art date
Application number
PCT/CN2021/084729
Other languages
English (en)
French (fr)
Inventor
宋璐
唐睿
黄治
Original Assignee
杭州群核信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州群核信息技术有限公司 filed Critical 杭州群核信息技术有限公司
Priority to US17/639,567 priority Critical patent/US20220300669A1/en
Publication of WO2021244119A1 publication Critical patent/WO2021244119A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00—Computer-aided design [CAD]
    • G06F30/10—Geometric CAD
    • G06F30/13—Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00—Details relating to CAD techniques
    • G06F2111/16—Customisation or personalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00—Details relating to CAD techniques
    • G06F2111/18—Details relating to CAD techniques using virtual or augmented reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00—Details relating to CAD techniques
    • G06F2111/20—Configuration CAD, e.g. designing by assembling or positioning modules selected from libraries of predesigned modules
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/08—Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/04—Architectural design, interior design
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Definitions

  • the invention relates to the cross-field of home improvement design and computer-aided design, and in particular to a flat home improvement design assisting method.
  • Home decoration design generally includes hard decoration, customization and soft decoration. Now the delivery of fine decoration is the general trend of social development.
  • the home decoration design can be completed by part of the hard decoration and auxiliary furnishings, and this part is the part that best reflects the character and preferences of the house owner.
  • Soft decoration is an emerging concept in recent years, which has further subdivided the field of home decoration.
  • the so-called soft decoration refers to the use of accessories that are easy to replace and change positions such as wallpaper, fabrics, carpets, furniture, ornaments, etc. Lighting, plants and other indoor furnishings and arrangements. In other words, it means that in addition to the fixed and immovable decorations in the interior, such as floors, ceilings, walls, doors and windows, other removable and easy-to-replace decorations are the second-degree furnishings and layouts of the living room. .
  • Some Internet 3D design tools such as Kujiale, Three-dimensional Home, and Flat Design, often need to go through the steps of painting, hard installation, and customization before starting the soft decoration design.
  • the pre-steps are too long and cumbersome, and it is difficult to meet the current refined decoration delivery.
  • the trend of personalized soft outfits are too long and cumbersome, and it is difficult to meet the current refined decoration delivery.
  • the invention patent application with application publication number CN106295052A discloses a mutual aid home improvement design system
  • the invention patent application with application publication number CN107239997A discloses a self-service furniture home improvement design system, both of which are based on three-dimensional models for home improvement design ,low efficiency.
  • the purpose of the present invention is to provide a flat home improvement design assistance method to improve the efficiency of home improvement design.
  • the present invention provides a flat home improvement design assistance method, which includes the following steps:
  • the flat home improvement background image is a plan view including at least one projection plane of a ground projection plane, a wall projection plane, and a top projection plane;
  • the present invention provides a flat home improvement design assistance method, which includes the following steps:
  • the flat home improvement background image is a plan view that includes at least one projection plane among a ground projection plane, a wall projection plane, and a top projection plane;
  • the beneficial effects include at least:
  • the flat home improvement design assistance method constructs a three-dimensional model of the flat home improvement background map, and when the home improvement materials are placed on the flat home improvement background map, auxiliary constraints are performed according to the type of the home improvement materials and the three-dimensional space constraints to realize the automatic adjustment of the home improvement
  • the size, position and angle of the material greatly improve the efficiency of home decoration design.
  • FIG. 1 is a flowchart of an embodiment of a flat home improvement design assistance method provided by the present invention
  • Figure 2 is an example diagram of a flat home improvement background diagram provided by the present invention.
  • 3 is an example diagram of the homogeneous coordinates of the projection plane for each point in the projection plane provided by the present invention
  • Figures 4(a) and 4(b) are examples of the three-dimensional home improvement material table provided by the present invention being placed on the ground projection plane, showing the perspective reality of large and small perspectives;
  • Fig. 5 is an example diagram of the flat home decoration material hanging picture provided by the present invention being placed on the projection plane of the wall to show the perspective reality of the large and small.
  • Fig. 6 is a layout diagram of the home improvement materials placed on the projection plane of the wall relative to the camera provided by the present invention.
  • Fig. 7 is a flowchart of another embodiment of a flat home improvement design assistance method provided by the present invention.
  • an embodiment of the present invention provides a flat home improvement design auxiliary method.
  • FIG. 1 is a flow chart of an embodiment of a flat home improvement design assistance method provided by the present invention.
  • the graphic home improvement design assistance method shown in Figure 1 is mainly for the graphic home improvement design assistance method that uses the rendering as the background image of the graphic home improvement.
  • the graphic home improvement design assistance method includes the following steps:
  • S101 Acquire a rendered image as a background image of a flat home improvement, and acquire camera parameters and depth information of the rendered image at the same time.
  • the flat home improvement background image is the initial input picture of the flat home improvement design, that is, the home improvement material is designed on the flat home improvement background image.
  • the flat home improvement background image is a projection plane from the current perspective, that is, the flat home improvement background image includes a ground projection plane and a wall projection plane. And a plan view of at least one projection plane in the top projection plane.
  • Figure 2 exemplarily shows a flat home improvement background image, which includes a ground projection plane F, a wall projection plane W1, W2, W3, and a top projection plane C.
  • the renderings include home decoration design renderings and blank scene renderings with depth information and camera parameters;
  • the blank scene rendering image is directly used as a flat home improvement background image, using preset camera parameters and depth information.
  • the separated soft decoration elements are used as plane renderings in a way that each layer carries a current perspective.
  • the plan rendering is directly used as the preset home improvement material.
  • Home decoration materials are soft decoration or part of the hard decoration that are selected to decorate the interior layout during the design. These home improvement materials can be divided into three-dimensional home improvement materials or two-dimensional home improvement materials.
  • the three-dimensional home improvement materials are generally stored in a material library, and include a three-dimensional model of the home improvement materials and a plane rendering from any angle of view. In the design process, 3D home improvement materials are generally replaced by flat renderings with default angles. In addition to storing the two-dimensional home improvement materials in the material library, they are generally uploaded by the designer themselves. In the design process, two-dimensional home improvement materials are directly used as flat home improvement materials.
  • the shape of the home improvement materials it can be divided into flat home improvement materials and three-dimensional home improvement materials.
  • the flat home improvement materials include carpets, murals, tablecloths, carpets, etc.
  • the three-dimensional home improvement materials include tables, chairs, cabinets, plants, sofas, etc. Air conditioners, lamps, etc.
  • three-dimensional home improvement materials can be divided into placed three-dimensional home improvement materials and hanging three-dimensional home improvement materials directly placed on the ground.
  • Placed three-dimensional home improvement materials include tables, sofas, etc., directly at the default angle Placed on the ground
  • hanging three-dimensional home decoration materials include hanging lights, hanging air conditioners, range hoods, etc., rotating to place the wall or top surface at an angle where the back is attached to the wall.
  • S102 Construct a transformation matrix between the projection plane coordinate system and the world coordinate system according to the camera parameters, and construct a three-dimensional model corresponding to the flat home improvement background image according to the transformation matrix.
  • the construction method of the transformation matrix between the projection plane coordinate system and the world coordinate system is:
  • v is the world coordinate system coordinates
  • v′′ is the camera coordinate system coordinates
  • R is the rotation transformation matrix and R is the orthogonal matrix
  • T is the translation transformation matrix
  • P is the projection matrix
  • the flat home improvement background image is a projection plan obtained by rendering with known camera parameters and depth information.
  • the depth z of each point in the projection plan can be obtained directly according to the plane size proportional relationship, and then combined with the projection plan for each point
  • the world coordinates, and finally according to the world coordinates of each point, the three-dimensional model corresponding to the flat home improvement background image can be obtained.
  • the distance between the boundary line of the projection plane C is L
  • the distance between the boundary line of the wall projection plane W2 and the top projection plane C to the x axis is L0
  • the depth corresponding to the distance L0 is the distance Z0 from the camera to the wall projection plane W2 corresponding to the wall , Then the depth corresponding to point A
  • the plane K is an example diagram of the homogeneous coordinates of point A in the projection plane,
  • S103 Select the target location of the home improvement material on the flat home improvement background image, place the home improvement material at the target location according to the three-dimensional space constraint conditions corresponding to the type of the home improvement material, and at the same time transform the home improvement material from a physical size to a projection according to the target position and depth information Size to realize the auxiliary design of flat home improvement.
  • the target location can be any point on the flat home improvement background map.
  • three-dimensional space constraints are provided.
  • This three-dimensional space Constraints correspond to the types of home improvement materials. Different types of home improvement materials correspond to different three-dimensional space constraints.
  • the home improvement materials are automatically placed at the target location according to the three-dimensional space constraints corresponding to the type of home improvement materials.
  • the three-dimensional space constraint condition corresponding to the type of the home improvement material placing the home improvement material at the target position includes:
  • the corresponding three-dimensional space constraint is to be adsorbed to the projection plane, so when the home improvement materials are placed, the home improvement materials are directly adsorbed to the target position;
  • the corresponding three-dimensional space constraint is that they are placed on the projection plane. Therefore, when placing home improvement materials, the home improvement materials are directly placed in contact with the target location.
  • the three-dimensional space constraint condition can also be cancelled according to the user's choice.
  • the three-dimensional space constraint condition is included when the home improvement material is placed.
  • the projection size is mainly calculated based on the target position and depth information and the physical size of the home improvement materials.
  • the physical size of the home improvement materials is known and can be obtained directly.
  • the default physical size will be designed according to the type of home improvement materials. For example, the default height of the sofa is 800mm, and the default height of the floor lamp is 1600mm.
  • the transforming the home improvement material from a physical size to a projection size according to the target position and depth information includes:
  • the home decoration material is transformed from physical size to projection size.
  • the reference plane can be any projection plane, such as a wall projection plane, or a plane parallel to the projection plane, such as a plane parallel to the wall projection plane. The selection of the reference plane takes the convenience of calculation as the main consideration, and the others are not restricted.
  • the target placement position on the wall projection plane is defined as the center point of the home improvement element.
  • the target position of the ground projection plane and the top projection plane as the center point of the contact between the home improvement material and the projection plane.
  • the target position is the center point of the bottom surface of the sofa, and when placing a chandelier, the target position is the center point of the top of the ceiling.
  • the pixel range is obtained according to the target position and the size of the home improvement material on the reference plane.
  • the target position is (x0, y0)
  • the size of the reference plane is (w ,h) hangs the picture on the wall projection plane
  • the position range of the picture on the reference plane is (x0-w/2,y0-h/2) ⁇ (x0+w/2,y0+h/2) .
  • the world coordinates of the target position are calculated on the premise that the target position and depth information are known.
  • the world coordinates of the target location are obtained, the world coordinates of the home improvement materials can be obtained according to the positional relationship between the target location and the home improvement materials, and the physical size of the home improvement materials.
  • the world coordinates of the home improvement material are transformed to obtain the projected coordinates of the home improvement material.
  • the projection size of the home improvement material is initially obtained.
  • the home improvement material can be divided into a sampling part and an interpolation part. Based on the change of the depth value in the depth direction, the depth value is the depth value calculated in the camera coordinate system with the camera as the origin.
  • the target position of the home improvement material as the dividing line, for the side home improvement material whose depth value decreases along the depth direction, that is, the half of the home improvement material closer to the camera.
  • This half of the home decoration materials are subjected to different levels of interpolation processing. The smaller the depth value, the more the number of interpolations, and the size will gradually increase along the vertical direction of the depth. In this way, the transformation of home decoration materials from physical size to projection size is completed, and the perspective reality of large and small can be presented.
  • perspective transformation is performed on the high-definition large image of the home improvement material directly according to the perspective transformation matrix of the reference coordinate system and the projection coordinate system to adjust the projection size of the home improvement material.
  • Figures 4(a) and 4(b) exemplarily show the three-dimensional home improvement material table A is placed on the ground projection plane to show the perspective reality of entering large and small
  • Figure 5 exemplarily shows the flat home improvement material
  • the hanging picture B is placed on the wall projection plane to show the perspective reality of large, far and small.
  • the perspective reality of the hanging picture is consistent with the perspective reality of the placed wall projection plane.
  • said transforming the world coordinates of the home improvement material to the projection coordinates of the projection plane includes:
  • Method 1 According to the conversion matrix of the world coordinate system and the reference coordinate system, transform the world coordinates of the home improvement materials to obtain the reference coordinates of the home improvement materials; then refer to the home improvement materials according to the perspective transformation matrix of the reference coordinate system and the projection coordinate system The coordinates are converted to obtain the projected coordinates of the home improvement materials; or,
  • Method 2 According to the transformation matrix between the projection plane coordinate system and the world coordinate system, the world coordinates of the home improvement materials are changed to obtain the projected coordinates of the home improvement materials.
  • the conversion matrix between the world coordinate system and the reference coordinate system is determined according to the correspondence between the physical size of the home improvement material in the world space and the pixel size on the reference plane.
  • the perspective transformation matrix of the reference coordinate system and the projection coordinate system is determined according to the perspective relationship between the reference plane and the projection plane.
  • the transformation matrix between the projection plane coordinate system and the world coordinate system is directly the change matrix M in S102.
  • the home improvement materials close to the wall projection plane are automatically rotated and placed back against the wall projection plane according to the rotation angle corresponding to the wall projection plane.
  • the selected home improvement material is a three-dimensional home improvement material
  • the area not close to the wall is generally placed at the default angle, and the area close to the wall is automatically rotated to the angle of the back to the wall for placement.
  • the home improvement materials close to the wall projection plane are rotated and placed back against the wall projection plane according to the rotation angle corresponding to the wall projection plane.
  • the rotation angle corresponding to the wall projection plane needs to be calculated.
  • the specific calculation process is as follows: Assume that the home improvement element is located directly in front of the camera, with the back of the reference wall projection plane, so that you can see the front view of the home improvement material and define this posture It is a front view. In fact, if you translate the home improvement materials by the reference wall projection plane, you will see a little side view, but this state is ignored in the graphic design process, and the movement along the reference wall projection plane is converted into a movement along the arc wall. Approximately, as shown in Figure 6 below, when looking at the camera position, a few square home improvement materials against an arc wall are all frontal poses, and several square home improvement materials against an arc wall will give the correct pose in the final rendering.
  • the observation angle of the home improvement material is determined according to the imaging angle of the left wall.
  • the cos value of the imaging angle ⁇ of the left wall is equal to the ratio of the pixel length of the horizontal line of unit length on the left wall projection plane and the pixel length of the reference wall projection plane, so that the rotation angle ⁇ corresponding to the wall projection plane can be determined.
  • the ratio is 1, and ⁇ is 0, and when the observation length is 0, ⁇ is 90°.
  • the home improvement material when the home improvement material needs to be placed at an angle adjusted, it is rotated 360 degrees at an interval of unit rotation angle according to the user's choice;
  • the home improvement material is a three-dimensional home improvement material
  • the home improvement material before the rotation will be replaced with the home improvement material rendering at the target angle after rotation;
  • the predicted image of the two-dimensional home improvement material at the target angle is predicted based on the pre-trained deep learning network, and the predicted image is used to replace the home improvement material before rotation.
  • the user can adjust the placement angle of the home improvement materials.
  • the unit rotates by a unit rotation angle.
  • the unit rotation angle can be set to any angle, for example, it can be 10 degrees. That is, the home improvement material is rotated at 10 degree intervals during rotation until the user is satisfied.
  • the placement angle of the home improvement material changes, the presented state will also change. In order to enhance the realism of the design, it is necessary to replace the original state view with the state view presented after the home improvement material is transformed.
  • the material library contains the 3D model of the 3D home improvement material
  • the 3D model is directly rendered at the target angle (that is, the angle after rotation) to obtain the home improvement material rendering at the target angle, and the home improvement material rendering image is used to replace the rotation Front home improvement materials.
  • the deep learning network is a learning network that can realize image prediction. It can be composed of a convolutional layer, a pooling layer, and a fully connected layer. For example, it can be VI-GAN (View Independent Generative Adversarial Network from ICCV2019, which is independent of perspective generation). Network), TVSN (Transformation-grounded view synthesis network) from CVPR2017, and view synthesis via appearance flow from ECCV2016, which is not specifically limited here.
  • the world coordinates of the target location and the placement angle information of the original home improvement material are retained, and the projection size of the current home improvement material is calculated.
  • the projection size of the home improvement material is directly scaled linearly. After the scaling is completed, the physical size corresponding to the scaled projection size is mapped to the world coordinate system and saved .
  • FIG. 7 is a flowchart of another embodiment of a flat home improvement design assistance method provided by the present invention.
  • the graphic home improvement design assistance method shown in Figure 7 is mainly aimed at the graphic home improvement design assistance method that uses the actual photos of the house hard decoration as the background image of the graphic home improvement.
  • the graphic home improvement design assistance method includes the following steps:
  • S701 Acquire a real-shot photo of the hard-installation of the house as a background picture of the flat home-improvement.
  • the flat home improvement background image is a plan view that includes at least one projection plane among a ground projection plane, a wall projection plane, and a top projection plane.
  • S702 Detect plane intersection lines in the flat home improvement background image to construct a three-dimensional model corresponding to the flat home improvement background image.
  • a straight line detection method may be used to detect the plane intersection lines in the real-shot photo of the hard-installation of the house, so as to obtain the three-dimensional structure of the real-shot photo of the hard-installation of the house.
  • RoomNet from RoomNet End-to-End Room Layout Estimation
  • CFILE Coarse-to-Fine Indoor Layout Estimation
  • S703 Add physical dimensions according to the three-dimensional model, and determine camera parameters, depth information, and transformation matrix between the projection plane coordinate system and the world coordinate system.
  • the 3D model is also required to estimate the physical size.
  • Adding the physical size to the 3D model is an interactive process. The user modifies and determines the physical size automatically added by the system to determine the correct physical size.
  • the camera information and depth information are reversed based on physical dimensions.
  • any 3 points that are not collinear at least 6 points to calculate the transformation matrix between the projection plane coordinate system and the world coordinate system. Specifically, you can select any 3 points that are not collinear to calculate the transformation matrix between the projection plane coordinate system and the world coordinate system. When there are more than 6 points selected, group the selected points and use each group of points The calculated transformation matrix is averaged and used as the final transformation matrix between the projection plane coordinate system and the world coordinate system.
  • S704 Select the target location of the home improvement material on the flat home improvement background image, place the home improvement material at the target location according to the three-dimensional space constraint conditions corresponding to the type of the home improvement material, and at the same time transform the home improvement material from a physical size to a projection according to the target position and depth information Size to realize the auxiliary design of flat home improvement.
  • the graphic home improvement design assistance method further includes:
  • the home improvement material is a 3D home improvement material
  • directly call the 3D model of each home improvement material and place the 3D model in the 3D model corresponding to the flat home improvement background image to the target position of the home improvement material to obtain a 3D model of the scene, and then according to the camera
  • the parameters render the 3D model of the scene to obtain a rendering of the scene.
  • the graphic home improvement design assistance method further includes:
  • the home improvement material is a two-dimensional home improvement material
  • search for a matching model that matches the home improvement material in the model library and place the matching model in the 3D model corresponding to the flat home improvement background image to the target location of the home improvement material to obtain a 3D model of the scene.
  • Method 1 Generate a flat 3D model based on the outline of the home improvement material, add material attributes according to the type of the home improvement material, and apply texture mapping on the surface of the flat panel in the home improvement material alignment method to obtain the processed flat 3D model, and then place it on the flat home improvement background image.
  • the processed flat 3D model is placed at the target location of the home improvement materials to obtain the 3D model of the scene, and then the 3D model of the scene is rendered according to the camera parameters to obtain the rendering of the scene;
  • Method 2 Abandon the 2D home improvement materials directly, render the scene 3D model containing the 3D model of the 3D home improvement materials to obtain the scene rendering, and subtract the occluded part of the 2D home improvement materials according to the occlusion relationship of the scene rendering, and the rest is Part of the two-dimensional home improvement materials are pasted on the scene rendering.
  • the search process first, calculate the similarity between all models in the model library and the home improvement materials, and arrange them in descending order of similarity; then, determine whether the model matches the home improvement materials according to the similarity between the searched model and the home improvement materials.
  • the model is considered to be a matching model that matches the home improvement material; when the similarity between the model and the home improvement material is less than the similarity threshold, the model is considered to be mismatched with the home improvement material.
  • the flat home improvement design drawing can be a design result drawing obtained by directly placing home improvement materials on a flat home improvement background drawing, a rendering drawing obtained by mapping the design result drawing to a three-dimensional space rendering, or a direct reference to a general three-dimensional design The rendered image obtained by the scheme rendering dyeing.
  • the flat home improvement design assistance method constructs a three-dimensional model of the flat home improvement background map, and when placing home improvement materials on the flat home improvement background map, auxiliary constraints are performed according to the type of the home improvement material and the three-dimensional space constraints to realize the automatic adjustment of the home improvement materials
  • the effect of size, position and angle greatly improves the efficiency of home decoration design.
  • both the background and home improvement materials use plane textures, which can be compatible with two-dimensional home improvement materials and three-dimensional home improvement materials at the same time. It has strong universality and greatly reduces the front-end computing pressure compared with 3D design. , The user experience and interaction are more intuitive and easy to use. After the design is over, the 3D solution can be seamlessly connected to render, and a more realistic photo-level rendering that is comparable to real light and shadow can be generated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Structural Engineering (AREA)
  • Computational Mathematics (AREA)
  • Civil Engineering (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Processing Or Creating Images (AREA)

Abstract

一种平面家装设计辅助方法，包括以下步骤：（1）获取渲染图作为平面家装背景图，同时获取渲染图的相机参数和深度信息（S101）；(2)根据相机参数构建投影平面坐标系与世界坐标系的变换矩阵，依据该变换矩阵构建平面家装背景图对应的三维模型（S102）；(3)在所述平面家装背景图上选择家装素材的目标位置，根据家装素材种类对应的三维空间约束条件在目标位置放置家装素材，同时根据目标位置和深度信息将家装素材由物理尺寸变换为投影尺寸，以实现平面家装辅助设计（S103）。该平面家装辅助设计方法可以提升家装设计效率。

Description

一种平面家装设计辅助方法 技术领域
本发明涉及家装设计和计算机辅助设计的交叉领域，具体涉及一种平面家装设计辅助方法。
背景技术
家装设计一般包含硬装、定制和软装几个部分，而现在精装修交付是社会发展的大趋势，业主收房之后已经是经过开发商统一硬装的房屋，只需对其进行软装和部分硬装辅助搭配陈设即可完成家装设计，而这一部分是最能够体现房屋主人性格和喜好的部分。
软装是一个近年来新兴的概念，把家装领域更加细分化了，所谓软装是指硬装修完毕之后，利用那些易更换、易变动位置的饰物如墙纸、布艺、地毯、家具、饰品、灯饰、植物等对室内的二度陈设与布置。换句话说，就是指除了室内装潢中固定的、不能移动的装饰物如地板、顶棚、墙面以及门窗等之外，其它可以移动的、易于更换的饰物，是对居室的二度陈设与布置。
随着人们生活水平的提高，对软装设计的个性化需求愈加明显，人们通常通过专业的软装设计师、家居卖场的门店导购，或自己简单搭配来确定自己喜欢的风格和色系，以及特定的软装单品，然后才去进行软装的购置和摆场。但是现有的软装设计工具，如美间、Microsoft PowerPoint、Adobe photoshop等，往往不够智能便捷，用户需要自行确定软装素材的大小、位置、形变等，尤其是在透视关系的场景中，用户往往花费很多精力在素材的变形操作上。而3D设计工具，如3D max，对普通用户来说学习成本太高，难以普及。一些互联网3d设计工具如酷家乐、三维家、躺平设计家等，往往需要经历画户型、硬装、定制步骤，才能开始软装设计，前置步骤过于冗长繁琐，难以满足现在精装修交付个性化软装的趋势。
申请公布号为CN106295052A的发明专利申请公开了一种互助家装设计系统，申请公布号为CN107239997A的发明专利申请公开了一种自助 家具家装设计系统，这两种家装设计系统均基于三维模型进行家装设计，效率低。
发明内容
本发明的目的是提供一种平面家装设计辅助方法，以提升家装设计效率。
为实现上述发明目的，本发明提供了一种平面家装设计辅助方法，包括以下步骤：
获取渲染图作为平面家装背景图，同时获取渲染图的相机参数和深度信息；所述平面家装背景图是包含地面投影平面、墙面投影平面以及顶面投影平面中至少一种投影平面的平面图；
根据相机参数构建投影平面坐标系与世界坐标系的变换矩阵，依据该变换矩阵构建平面家装背景图对应的三维模型；
在所述平面家装背景图上选择家装素材的目标位置，根据家装素材种类对应的三维空间约束条件在目标位置放置家装素材，同时根据目标位置和深度信息将家装素材由物理尺寸变换为投影尺寸，以实现平面家装辅助设计。
为实现上述发明目的，本发明提供了一种平面家装设计辅助方法，包括以下步骤：
获取房屋硬装实拍照片图作为平面家装背景图，所述平面家装背景图是包含地面投影平面、墙面投影平面以及顶面投影平面中至少一种投影平面的平面图；
检测所述平面家装背景图中平面相交线以此构所述建平面家装背景图对应的三维模型；
依据所述三维模型添加物理尺寸，并确定相机参数、深度信息、投影平面坐标系与世界坐标系的变换矩阵；
在所述平面家装背景图上选择家装素材的目标位置，根据家装素材种类对应的三维空间约束条件在目标位置放置家装素材，同时根据目标位置和深度信息将家装素材由物理尺寸变换为投影尺寸，以实现平面家装辅助设计。
与现有技术相比，具有的有益效果至少包括：
本发明实施例提供的平面家装设计辅助方法，通过构建平面家装背景图的三维模型，在平面家装背景图上放置家装素材时，根据家装素材类型以及三维空间约束条件进行辅助约束，实现自动调节家装素材大小、位置和角度的作用，进而极大地提高了家装设计效率。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图做简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动前提下，还可以根据这些附图获得其他附图。
图1是本发明提供的平面家装设计辅助方法一实施例的流程图；
图2是本发明提供的平面家装背景图的示例图；
图3是本发明提供的构建投影平面内每个点的投影平面的齐次坐标的示例图；
图4(a)和图4(b)是本发明提供的立体类家装素材桌子被放置到地面投影平面上呈现出进大远小的透视真实感示例图；
图5是本发明提供的平面家装素材挂画被放置到墙面投影平面上呈现出进大远小的透视真实感示例图。
图6是本发明提供的摆放到墙面投影平面上的家装素材相对于相机的布局图；
图7是本发明提供的平面家装设计辅助方法另一实施例的流程图。
具体实施方式
为使本发明的目的、技术方案及优点更加清楚明白，以下结合附图及实施例对本发明进行进一步的详细说明。应当理解，此处所描述的具体实施方式仅仅用以解释本发明，并不限定本发明的保护范围。
为了解决现有平面家装设计效率低下或者前置步骤冗长的问题，以提升平面家装设计效率，本发明实施例提供了一种平面家装设计辅助方法。
图1为本发明提供的平面家装设计辅助方法一实施例的流程图。图1所示的平面家装设计辅助方法主要是针对以渲染图为平面家装背景图的平面家装设计辅助方法。如图1所示，该平面家装设计辅助方法包括以下 步骤：
S101，获取渲染图作为平面家装背景图，同时获取渲染图的相机参数和深度信息。
平面家装背景图是平面家装设计的初始输入图片，即在该平面家装背景图上进行家装素材的设计。一般情况下，为了在进行平面家装设计时实现室内整体的呈现效果，平面家装背景图为一个在当前视角下的一个投影平面，即所述平面家装背景图是包含地面投影平面、墙面投影平面以及顶面投影平面中至少一种投影平面的平面图。图2示例性给出了一个平面家装背景图，该平面家装背景图包含地面投影平面F，墙面投影平面W1、W2、W3，顶面投影平面C。
其中，渲染图包括带有深度信息和相机参数的家装设计渲染图和空白场景渲染图；
针对带有深度信息和相机参数的渲染图，直接从渲染图中获得相机参数和深度信息；解析渲染图，将软装元素分离出来作为家装素材，剩下部分重新渲染作为平面家装背景图；
所述空白场景渲染图直接作为平面家装背景图，使用预设的相机参数和深度信息。
实施例中，被分离出来的软装元素以每个图层承载一个当前视角的方式作为平面渲染图。在设计过程中，该平面渲染图直接作为预设家装素材被使用。
家装素材是在设计时被选择用于装饰室内布局的软装或者部分硬装。该些家装素材可以分为三维家装素材或者二维家装素材，三维家装素材一般存储在素材库中，包含家装素材的三维模型和任意视角下的平面渲染图。在设计过程三维家装素材一般以默认角度的平面渲染图代替。二维家装素材除了存储在素材库中外，一般还由设计者自行上传。在设计过程中，二维家装素材作为平面家装素材直接被使用。
按照家装素材的形状，可以分为平面类家装素材和立体类家装素材，其中，平面类家装素材包括地毯、壁画、桌布、地毯等，立体类家装素材包括桌子、椅子、柜子、植物、沙发、空调、灯具等。根据放置方式，可以将立体类家装素材分为直接放置到地面上的摆放式立体类家装素材和悬挂式立体类家装素材，摆放式立体类家装素材包括桌子、沙发等，直接 以默认角度放置于地面，悬挂式立体类家装素材包括挂灯、挂式空调、抽油烟机等，旋转为背靠墙面贴合的角度放置墙面或者顶面。
S102，根据相机参数构建投影平面坐标系与世界坐标系的变换矩阵，依据该变换矩阵构建平面家装背景图对应的三维模型。
实施例中，投影平面坐标系与世界坐标系的变换矩阵的构建方式为：
根据相机参数计算相机坐标系到世界坐标系的变换矩阵，
v＝TRv″
其中，v是世界坐标系坐标，v″是相机坐标系坐标，R是旋转变换矩阵且R是正交矩阵，T是平移变换矩阵，那么v″＝R TT -1v，这样就得到了世界坐标系和相机坐标系的相互变换关系；
计算投影坐标系与相机坐标系的变换关系，
u＝Pv″
其中，P是投影矩阵，u＝(x,y,z,w)是投影平面的齐次坐标，其中w＝1，z为投影平面深度，(x,y)为投影平面的二维坐标，那么v″＝P -1u；
综合可以得到投影平面坐标与世界坐标系之间的转换关系：
u＝Mv
其中，M＝PR TT -1为投影平面坐标系与世界坐标系的变换矩阵，那么v＝M -1u。这样只要给定一个点的投影平面的齐次坐标，既可以根据v＝M -1u计算获得该点的世界坐标。
平面家装背景图是一个在已知相机参数和深度信息通过渲染获得的投影平面图，可以直接根据平面尺寸比例关系即可以获得的投影平面图内每个点的深度z，再结合投影平面图每个点的二维坐标(x,y)，即可以获得每个点在投影平面的齐次坐标u＝(x,y,z,w)，然后根据v＝M -1u即可以计算获得每个点的世界坐标，最后根据每个点的世界坐标即可以获得平面家装背景图对应的三维模型。
图3为构建投影平面内每个点的投影平面的齐次坐标u＝(x,y,z,w)的示例图，假设选择左上角为原点，定义向下为y轴正方向，向右为x轴正方向，构建图上坐标系，点A为顶面投影平面上的一点，则点A的图上二维坐标为(x,y)，点A到墙面投影平面W2与顶面投影平面C交界线的距离为L，墙面投影平面W2与顶面投影平面C交界线到x轴的距离为L0，距离L0对应的深度为相机到墙面投影平面W2对应墙体的距离Z0， 则点A对应的深度
Figure PCTCN2021084729-appb-000001
这样即可以获得点A在投影平面的齐次坐标
Figure PCTCN2021084729-appb-000002
需要注意的是，点A所在的平行于墙面投影平面W2的平面K与平行于墙面投影平面W2在三维空间大小相同，但是平面上的点的深度不同。
S103，在所述平面家装背景图上选择家装素材的目标位置，根据家装素材种类对应的三维空间约束条件在目标位置放置家装素材，同时根据目标位置和深度信息将家装素材由物理尺寸变换为投影尺寸，以实现平面家装辅助设计。
在设计过程中，首先选择需要放置的家装素材，和放置家装素材的目标位置，目标位置可以是平面家装背景图上的任意一点。针对选定的目标位置计算获得目标位置在投影平面的次坐标u＝(x,y,z,w)，然后可以根据投影平面坐标系与世界坐标系的变换矩阵计算目标位置的世界坐标。
物理世界中，实际家装素材由于重力约束和空间碰撞约束，不会悬浮于空中，也不会嵌入墙体或地面，因此为了提升设计速率和设计真实感，提供了三维空间约束条件，该三维空间约束条件与家装素材种类相对应，不同类的家装素材对应不同的三维空间约束条件，在放置家装素材时，根据家装素材种类对应的三维空间约束条件，家装素材自动放置到目标位置上。
在一个实施方式中，所述家装素材种类对应的三维空间约束条件在目标位置放置家装素材包括：
针对平面类家装素材，对应三维空间约束条件为吸附到投影平面上，因此在放置家装素材时，家装素材直接吸附到目标位置；
针对摆放式立体类家装素材和悬挂式立体类家装素材，对应三维空间约束条件为接触放置到投影平面上，因此在放置家装素材时，家装素材直接接触放置到目标位置。
当然，在一些可能的实施方式中，该三维空间约束条件也可以根据用户选择被取消，默认条件下，在放置家装素材时，带有该三维空间约束条件。
将家装素材放置到目标位置之后，还需要对家装素材投影尺寸进行调 节。调节时，主要根据目标位置和深度信息以及家装素材的物理尺寸计算投影尺寸。
针对三维家装素材，家装素材的物理尺寸已知，直接可以获得。针对二维家装素材，会根据家装素材的类型设计默认物理尺寸，例如沙发默认高度800mm，落地灯默认高度1600mm。
在一个实施方式中，所述根据目标位置、深度信息将家装素材由物理尺寸变换为投影尺寸包括：
根据目标位置和深度信息计算家装素材的世界坐标；
将家装素材的世界坐标变换到投影平面的投影坐标；
以家装素材的目标位置为分界线，取沿深度方向以增大深度值那侧部分家装素材作为采样部分，将采样部分沿深度方向根据投影坐标依次进行不同等级的像素点采样，以缩小尺寸；
以家装素材的目标位置为分界线，取沿深度方向以减小深度值那侧部分家装素材作为插值部分，将插值部分沿深度方向根据投影坐标依次进行不同等级的像素点插值，以增大尺寸，至此完成家装素材由物理尺寸变换为投影尺寸。在进行家装素材尺寸变换时，选择一个参考平面，该参考平面可以是任意一个投影平面，例如墙面投影平面，也可以是与投影平面平行的平面，例如与墙面投影平面平行的平面。参考平面的选择以方便计算为主要考虑因素，其他不受限制。
实施例中，定义在墙面投影平面的目标放置位置为家装元素的中心点，例如将挂画放置于墙面投影平面的目标位置时，期望挂画的形心位于指定的目标位置。定义地面投影平面和顶面投影平面的目标位置为家装素材与投影平面接触的中心点。例如放置沙发，目标位置为沙发底面的中心点，放置吊灯，目标位置为吊顶顶端的中心点。
由于选定的目标位置是一点，而家装素材是一个平面图像，所以根据目标位置和家装素材在参考平面的大小获得像素范围，如目标位置为(x0，y0)，放置参考平面大小为(w,h)的挂画到墙面投影平面上，那么在参考平面挂画的位置范围为(x0-w/2,y0-h/2)～(x0+w/2,y0+h/2)。
按照S102中的方式在已知目标位置和深度信息的前提下，计算目标位置的世界坐标。当获得目标位置的世界坐标后，根据目标位置与家装素材的位置关系，以及家装素材的物理尺寸即可以得到家装素材的世界坐标。
然后，根据世界坐标系与投影坐标系的关系对家装素材的世界坐标进行变换，获得家装素材的投影坐标。这样就初步得到了家装素材的投影尺寸。
在得到家装素材的投影尺寸的基础上，为了使家装素材呈现透视关系，提升家装素材的真实感，需要对家装素材进行投影尺寸调整，可以将家装素材划分为采样部分和插值部分，具体划分时以深度方向的深度值的变化为依据，该深度值是以相机为原点的相机坐标系下计算的深度值。
具体地，以家装素材的目标位置为分界线，针对沿深度方向深度值增大的那侧家装素材，即距离相机较远的那半部分家装素材，为了实现呈现进大远小的透视关系，需要对这半部分家装素材做不同等级的采样处理，深度值越大，采样个数越小，以沿深度方向的垂直方向逐渐缩小尺寸。
同样以家装素材的目标位置为分界线，针对沿深度方向深度值减小的那侧家装素材，即距离相机较近的那半部分家装素材，为了实现呈现进大远小的透视关系，需要对这半部分家装素材做不同等级的插值处理，深度值越小，插值个数越多，以沿深度方向的垂直方向逐渐增大尺寸。这样就完成了家装素材由物理尺寸到投影尺寸的变换，且能够呈现进大远小的透视真实感。
在另外一个实施方式中，为了防止呈现透视关系的家装素材失真，直接根据参考坐标系与投影坐标系的透视变换矩阵对家装素材的高清大图进行透视变换，以调整家装素材的投影尺寸。图4(a)和图4(b)示例性给出了立体类家装素材桌子A被放置到地面投影平面上呈现出进大远小的透视真实感，图5示例性给出了平面家装素材挂画B被放置到墙面投影平面上呈现出进大远小的透视真实感，该挂画呈现的透视真实感与所放置的墙面投影平面呈现的透视真实感一致。
其中，所述将家装素材的世界坐标变换到投影平面的投影坐标包括：
方式一：根据世界坐标系与参考坐标系的转换矩阵，对家装素材的世界坐标进行转换，获得家装素材的参考坐标；然后根据参考坐标系与投影坐标系的透视变换矩阵，对家装素材的参考坐标进行转换，获得家装素材的投影坐标；或，
方式二：根据投影平面坐标系与世界坐标系的变换矩阵，对家装素材的世界坐标进行变化，获得家装素材的投影坐标。
方式一中，根据家装素材在世界空间的物理尺寸与在参考平面的图上像素尺寸之间的对应关系确定世界坐标系与参考坐标系的转换矩阵。根据参考平面与投影平面之间的透视关系确定参考坐标系和投影坐标系的透视变换矩阵。方式二中投影平面坐标系与世界坐标系的变换矩阵直接为S102中的变化矩阵M。
在另外一个实施方式中，当立体类家装素材需要背靠墙面投影平面摆放时，自动根据墙面投影平面对应的旋转角对靠近墙面投影平面的家装素材旋转背靠墙面投影平面放置。
在设计过程中，所选家装素材为立体家装素材时，在不靠近墙体的区域一般以默认角度进行放置，靠近墙体的区域自动旋转为背靠墙体的角度进行放置。在转换的过程中，直接根据墙面投影平面对应的旋转角对靠近墙面投影平面的家装素材旋转背靠墙面投影平面进行放置。
其中墙面投影平面对应的旋转角是需要计算的，具体计算过程为：假设家装元素位于相机的正前方，背靠参考墙面投影平面，这样看到家装素材的正前方视图，定义这样的姿态为正面视图。事实上，靠参考墙面投影平面平移家装素材，会稍微看到一点侧面的视图，但是在平面设计过程中忽略这种状态，把沿参考墙面投影平面的移动转换成一个沿弧线墙移动的近似，如下图6所示，在相机位置看几个靠弧形墙的方形家装素材都是正面姿态，几个靠弧形墙的方形家装素材在最终渲染时会给出正确的姿态。
当考虑与参考墙左相邻的左墙距离相机无限远的极限状态，看到的也是家装素材的正面视图，而当左墙正好处于相机正前方，看到了家装素材左面90°的视图，而当左墙处于一般位置时，根据左墙成像角度来确定家装素材的观测角度。左墙的成像角度θ的cos值等于单位长度的水平线在左墙面投影平面的像素长度和参考墙面投影平面的像素长度的比值，这样即可以确定墙面投影平面对应的旋转角θ。特别地，观测长度等于实际长度时，比值为1，θ为0，当观测长度为0时，θ为90°。
在另外一个实施方式中，当家装素材需要调整角度放置时，根据用户选择以单位旋转角度为间隔进行360度旋转；
旋转时，若家装素材为三维家装素材，则以旋转后目标角度的家装素材渲染图替换旋转前家装素材；
若家装素材为二维家装素材，则依据预训练的深度学习网络预测二维 家装素材在目标角度下的预测图像，利用该预测图像替换旋转前家装素材。
在家装设计过程中，用户可以调整家装素材的放置角度，调整时，用户每选择一次，旋转一个单位旋转角度，单位旋转角度可以设置为任意角度，举例可以为10度。即在旋转时以10度为间隔旋转家装素材，直到用户满意。当家装素材放置角度发生变化时，呈现的状态也会发生变化，为了提升设计真实感，需要利用家装素材变换后呈现的状态视图替换原来呈现的状态视图。针对三维家装素材，由于素材库中包含三维家装素材的三维模型，这样，直接以目标角度(也就是旋转后角度)渲染三维模型得到目标角度的家装素材渲染图，利用该家装素材渲染图替换旋转前家装素材。
针对没有三维模型的二维家装素材，为了获得目标角度下的二维家装素材，以大量不同角度的二维家装素材作为训练样本，对深度学习网络进行训练，使得训练后的深度学习网络对二维家装素材在目标角度下的图像进行预测，获得预测图像，利用该预测图像替换旋转前家装素材。该深度学习网络是可以实现图像预测的学习网络，可以由卷积层、池化层、全连接层组成，举例可以为出自ICCV2019的VI-GAN(View Independent Generative Adversarial Network，与视角无关的对抗生成网络)，出自CVPR2017的TVSN(Transformation-grounded view synthesis network，变换合理的视角合成网络)，出自ECCV2016的view synthesis via appearance flow(通过外观流进行视角合成)，在此不做具体限定。
在移动的过程中，以移动前的视角跟随鼠标移动，当鼠标左键抬起确认目标位置时，以目标位置重新计算家装素材所呈现的视图。
在另外一个实施方式中，当目标位置的原始家装素材被替换为当前家装素材时，保留目标位置的世界坐标和原始家装素材的放置角度信息，计算当前家装素材的投影尺寸。
在家装设计过程中，当对某个目标位置放置的家装素材不满意时，还可以替换家装素材。为了提升替换速率，在替换家装素材时，目标位置的世界坐标和原始家装素材的角度信息保持不变，仅仅重新计算当前家装素材的投影尺寸即可以。
在另外一个实施方式中，当对投影平面上的家装素材进行缩放时，直接对家装素材的投影尺寸进行线性缩放，完成缩放后，将缩放后投影尺寸 对应的物理尺寸映射到世界坐标系并保存。
在家装设计过程中，当用户对家装素材的投影尺寸不满意时，直接可以对家装素材进行缩放，为了提升缩放速率，直接采用简单有效的线性缩放调整投影尺寸，调整后，还需要保存缩放后投影尺寸对应的物理尺寸，以及物理尺寸对应的世界坐标。
图7为本发明提供的平面家装设计辅助方法另一实施例的流程图。图7所示的平面家装设计辅助方法主要是针对以房屋硬装实拍照片图为平面家装背景图的平面家装设计辅助方法。如图7所示，该平面家装设计辅助方法包括以下步骤：
S701，获取房屋硬装实拍照片图作为平面家装背景图。
所述平面家装背景图是包含地面投影平面、墙面投影平面以及顶面投影平面中至少一种投影平面的平面图。
S702，检测所述平面家装背景图中平面相交线以此构所述建平面家装背景图对应的三维模型。
由于房屋硬装实拍照片图是用户上传的，没有三维模型，在家装设计过程中，需要根据三维空间约束条件放置家装素材，因此在放置家装素材之前，需要构建房屋硬装实拍照片图的三维模型。具体地，可以采用直线检测的方式，检测房屋硬装实拍照片图中平面相交线，以获得房屋硬装实拍照片图的三维结构。
当然也可以采用布局估计算法，例如出自RoomNet:End-to-End Room Layout Estimation的RoomNet，出自A Coarse-to-Fine Indoor Layout Estimation(CFILE)Method的CFILE，出自Physics Inspired Optimization on Semantic Transfer Features:An Alternative Method for Room Layout Estimation的ST-PIO来估计房屋硬装实拍照片图的三维结构。
S703，依据所述三维模型添加物理尺寸，并确定相机参数、深度信息、投影平面坐标系与世界坐标系的变换矩阵。
在获得三维模型基础上，还需要三维模型进行物理尺寸估计，为三维模型添加物理尺寸是一个交互过程，用户对系统自动添加的物理尺寸进行修改确定，以确定正确的物理尺寸。此外，为了方便后续渲染三维模型，根据物理尺寸标注反推相机信息和深度信息。
针对房屋硬装实拍照片图，选择任意3个点不共线的至少6个点计算 投影平面坐标系与世界坐标系的变换矩阵。具体可以选自选择任意3个点不共线的6个点计算投影平面坐标系与世界坐标系的变换矩阵，当选择的点超多6个时，对选择的点进行分组，利用每组点计算得到的变换矩阵取平均值后作为最终的投影平面坐标系与世界坐标系的变换矩阵。
S704，在所述平面家装背景图上选择家装素材的目标位置，根据家装素材种类对应的三维空间约束条件在目标位置放置家装素材，同时根据目标位置和深度信息将家装素材由物理尺寸变换为投影尺寸，以实现平面家装辅助设计。
S704的步骤与S103的步骤相同，此处不再赘述。
在一些实施方式中，在平面家装设计完成的基础上，为了得到真实感的设计结果图，还可以对设计结果进行渲染，获得渲染图。因此，所述平面家装设计辅助方法还包括：
当家装素材为三维家装素材时，直接调用每个家装素材的三维模型，在平面家装背景图对应的三维模型中，将该三维模型放置到家装素材的目标位置，获得场景三维模型，然后根据相机参数对场景三维模型进行渲染，获得场景渲染图。
在一些实施方式中，所述平面家装设计辅助方法还包括：
当家装素材为二维家装素材时，在模型库中搜索与家装素材匹配的匹配模型，在平面家装背景图对应的三维模型中，将匹配模型放置到家装素材的目标位置，获得场景三维模型，然后根据相机参数对场景三维模型进行渲染，获得场景渲染图；
当在模型库中搜索到的模型与家装素材不匹配时，采用以下两种方式处理：
方式一、以家装素材的轮廓生成一个平板三维模型，根据家装素材的类型添加材质属性并在平板表面以家装素材对齐方式进行材质贴图获得处理后的平板三维模型，然后在平面家装背景图对应的三维模型中，将处理后的平板三维模型放置到家装素材的目标位置，获得场景三维模型，然后根据相机参数对场景三维模型进行渲染获得场景渲染图；
方式二、直接抛弃二维家装素材，对包含有三维家装素材的三维模型的场景三维模型进行渲染，获得场景渲染图，根据场景渲染图的遮挡关系减去二维家装素材被遮挡部分，剩下部分二维家装素材贴在场景渲染图上。
在搜索过程中，首先，计算模型库里所有模型与家装素材的相似度，并按照相似度降序排列；然后，根据搜索的模型与家装素材的相似度来判断模型与家装素材是否匹配，当模型与家装素材的相似度大于相似度阈值时，则认为该模型为家装素材相匹配的匹配模型；当模型与家装素材的相似度小于相似度阈值时，则认为该模型与家装素材不匹配。
在一些实施方式中，对利用上述实施例提供的平面家装设计辅助方法设计的平面家装设计图不满意时，可以以该平面家装设计图作为平面家装背景图利用上述平面家装设计辅助方法进行再设计，对家装素材进行调整，直到对设计结果满意为止。
其中，该平面家装设计图可以是直接在平面家装背景图上放置家装素材获得的设计结果图，还可以是对设计结果图映射到三维空间渲染得到的渲染图，还可以是直接对一般三维设计方案渲染染得到的渲染图。
上述实施例提供的平面家装设计辅助方法，通过构建平面家装背景图的三维模型，在平面家装背景图上放置家装素材时，根据家装素材类型以及三维空间约束条件进行辅助约束，实现自动调节家装素材大小、位置和角度的作用，进而极大地提高了家装设计效率。
此外，上述实施例提供的平面家装设计辅助方法中，背景和家装素材都采用平面贴图，能够同时兼容二维家装素材和三维家装素材，普适性强，相比3D设计极大地减轻前端计算压力，用户体验和交互上也更加直观易用。在设计结束后，还能够无缝对接3D方案去渲染，生成更具真实感的媲美真实光影的照片级效果图。
以上所述的具体实施方式对本发明的技术方案和有益效果进行了详细说明，应理解的是以上所述仅为本发明的最优选实施例，并不用于限制本发明，凡在本发明的原则范围内所做的任何修改、补充和等同替换等，均应包含在本发明的保护范围之内。

Claims (13)

  1. 一种平面家装设计辅助方法，其特征在于，包括以下步骤：
    获取渲染图作为平面家装背景图，同时获取渲染图的相机参数和深度信息；所述平面家装背景图是包含地面投影平面、墙面投影平面以及顶面投影平面中至少一种投影平面的平面图；
    根据相机参数构建投影平面坐标系与世界坐标系的变换矩阵，依据该变换矩阵构建平面家装背景图对应的三维模型；
    在所述平面家装背景图上选择家装素材的目标位置，根据家装素材种类对应的三维空间约束条件在目标位置放置家装素材，同时根据目标位置和深度信息将家装素材由物理尺寸变换为投影尺寸，以实现平面家装辅助设计。
  2. 如权利要求1所述的平面家装设计辅助方法，其特征在于，所述渲染图包括带有深度信息和相机参数的家装设计渲染图和空白场景渲染图；
    针对带有深度信息和相机参数的渲染图，直接从渲染图中获得相机参数和深度信息；解析渲染图，将软装元素分离出来作为设计元素，剩下部分重新渲染作为平面家装背景图；
    所述空白场景渲染图直接作为平面家装背景图，使用预设的相机参数和深度信息。
  3. 一种平面家装设计辅助方法，其特征在于，包括以下步骤：
    获取房屋硬装实拍照片图作为平面家装背景图，所述平面家装背景图是包含地面投影平面、墙面投影平面以及顶面投影平面中至少一种投影平面的平面图；
    检测所述平面家装背景图中平面相交线以此构所述建平面家装背景图对应的三维模型；
    依据所述三维模型添加物理尺寸，并确定相机参数、深度信息、投影平面坐标系与世界坐标系的变换矩阵；
    在所述平面家装背景图上选择家装素材的目标位置，根据家装素材种类对应的三维空间约束条件在目标位置放置家装素材，同时根据目标位置和深度信息将家装素材由物理尺寸变换为投影尺寸，以实现平面家装辅助 设计。
  4. 如权利要求1或3所述的平面家装设计辅助方法，其特征在于，所述家装素材种类对应的三维空间约束条件在目标位置放置家装素材包括：
    针对平面类家装素材，对应三维空间约束条件为吸附到投影平面上，因此在放置家装素材时，家装素材直接吸附到目标位置；
    针对摆放式立体类家装素材和悬挂式立体类家装素材，对应三维空间约束条件为接触放置到投影平面上，因此在放置家装素材时，家装素材直接接触放置到目标位置。
  5. 如权利要求1或3所述的平面家装设计辅助方法，其特征在于，所述根据目标位置、深度信息将家装素材由物理尺寸变换为投影尺寸包括：
    根据目标位置和深度信息计算家装素材的世界坐标；
    将家装素材的世界坐标变换到投影平面的投影坐标；
    以家装素材的目标位置为分界线，取沿深度方向以增大深度值那侧部分家装素材作为采样部分，将采样部分沿深度方向根据投影坐标依次进行不同等级的像素点采样，以缩小尺寸；
    以家装素材的目标位置为分界线，取沿深度方向以减小深度值那侧部分家装素材作为插值部分，将插值部分沿深度方向根据投影坐标依次进行不同等级的像素点插值，以增大尺寸，至此完成家装素材由物理尺寸变换为投影尺寸。
  6. 如权利要求5所述的平面家装设计辅助方法，其特征在于，所述将家装素材的世界坐标变换到投影平面的投影坐标包括：
    方式一：根据世界坐标系与参考坐标系的转换矩阵，对家装素材的世界坐标进行转换，获得家装素材的参考坐标；然后根据参考坐标系与投影坐标系的透视变换矩阵，对家装素材的参考坐标进行转换，获得家装素材的投影坐标；或，
    方式二：根据投影平面坐标系与世界坐标系的变换矩阵，对家装素材的世界坐标进行变化，获得家装素材的投影坐标。
  7. 如权利要求1或3所述的平面家装设计辅助方法，其特征在于，当家装素材需要背靠墙面投影平面摆放时，自动根据墙面投影平面对应的旋转角对靠近墙面投影平面的家装素材旋转背靠墙面投影平面放置。
  8. 如权利要求1或3所述的平面家装设计辅助方法，其特征在于，当家装素材需要调整角度放置时，根据用户选择以单位旋转角度为间隔进行360度旋转；
    旋转时，若家装素材为三维家装素材，则以旋转后目标角度的家装素材渲染图替换旋转前家装素材；
    若家装素材为二维家装素材，则依据预训练的深度学习网络预测二维家装素材在目标角度下的预测图像，利用该预测图像替换旋转前家装素材。
  9. 如权利要求1或3所述的平面家装设计辅助方法，其特征在于，当目标位置的原始家装素材被替换为当前家装素材时，保留目标位置的世界坐标和原始家装素材的放置角度信息，计算当前家装素材的投影尺寸。
  10. 如权利要求1或3所述的平面家装设计辅助方法，其特征在于，当对投影平面上的家装素材进行缩放时，直接对家装素材的投影尺寸进行线性缩放，完成缩放后，将缩放后投影尺寸对应的物理尺寸映射到世界坐标系并保存。
  11. 如权利要求1或3所述的平面家装设计辅助方法，其特征在于，所述平面家装设计辅助方法还包括：
    当家装素材为三维家装素材时，直接调用每个家装素材的三维模型，在平面家装背景图对应的三维模型中，将该三维模型放置到家装素材的目标位置，获得场景三维模型，然后根据相机参数对场景三维模型进行渲染，获得场景渲染图。
  12. 如权利要求1或3所述的平面家装设计辅助方法，其特征在于，所述平面家装设计辅助方法还包括：
    当家装素材为二维家装素材时，在模型库中搜索与家装素材匹配的匹配模型，在平面家装背景图对应的三维模型中，将匹配模型放置到家装素材的目标位置，获得场景三维模型，然后根据相机参数对场景三维模型进行渲染，获得场景渲染图；
    当在模型库中搜索到的模型与家装素材不匹配时，采用以下两种方式处理：
    方式一、以家装素材的轮廓生成一个平板三维模型，根据家装素材的类型添加材质属性并在平板表面以家装素材对齐方式进行材质贴图获得处理后的平板三维模型，然后在平面家装背景图对应的三维模型中，将处 理后的平板三维模型放置到家装素材的目标位置，获得场景三维模型，然后根据相机参数对场景三维模型进行渲染获得场景渲染图；
    方式二、直接抛弃二维家装素材，对包含有三维家装素材的三维模型的场景三维模型进行渲染，获得场景渲染图，根据场景渲染图的遮挡关系减去二维家装素材被遮挡部分，剩下部分二维家装素材贴在场景渲染图上。
  13. 如权利要求1、3、11或12所述的平面家装设计辅助方法，其特征在于，所述平面家装设计辅助方法还包括：
    对利用权利要求1～12任一项所述的平面家装设计辅助方法设计的平面家装设计图不满意时，以该平面家装设计图作为平面家装背景图，然后利用利用权利要求1～12任一项所述的平面家装设计辅助方法进行再设计，对家装素材进行调整，直到对设计结果满意为止。
PCT/CN2021/084729 2020-06-05 2021-03-31 一种平面家装设计辅助方法 WO2021244119A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/639,567 US20220300669A1 (en) 2020-06-05 2021-03-31 An auxiliary method for graphic home improvement design

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010503472.4A CN113761614B (zh) 2020-06-05 2020-06-05 一种平面家装设计辅助方法
CN202010503472.4 2020-06-05

Publications (1)

Publication Number Publication Date
WO2021244119A1 true WO2021244119A1 (zh) 2021-12-09

Family

ID=78783867

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/084729 WO2021244119A1 (zh) 2020-06-05 2021-03-31 一种平面家装设计辅助方法

Country Status (3)

Country Link
US (1) US20220300669A1 (zh)
CN (1) CN113761614B (zh)
WO (1) WO2021244119A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116226951A (zh) * 2022-12-05 2023-06-06 中山市可讯科技有限公司 一种新型的在线平面测量方法及其应用

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11688085B2 (en) * 2019-03-15 2023-06-27 Certainteed Gypsum, Inc. Method of characterizing a surface texture and texture characterization tool
EP4229552A4 (en) * 2020-10-13 2024-03-06 Flyreel Inc GENERATION OF MEASUREMENTS OF PHYSICAL STRUCTURES AND ENVIRONMENTS THROUGH AUTOMATED ANALYSIS OF SENSOR DATA
CN114661202B (zh) * 2022-03-02 2022-11-22 北京城市网邻信息技术有限公司 在线家装方法、设备及存储介质
CN115439625B (zh) * 2022-11-08 2023-02-03 成都云中楼阁科技有限公司 建筑草图辅助绘制方法、装置、存储介质及绘制设备
CN116680793B (zh) * 2023-08-03 2023-10-20 贝壳找房(北京)科技有限公司 墙体数据处理方法、构件创建方法、电子设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180374276A1 (en) * 2016-04-04 2018-12-27 Occipital, Inc. System for multimedia spatial annotation, visualization, and recommendation
CN109461210A (zh) * 2018-10-15 2019-03-12 杭州群核信息技术有限公司 一种在线家装的全景漫游方法
CN109598783A (zh) * 2018-11-20 2019-04-09 西南石油大学 一种房间3d建模方法及家具3d预览系统
CN110929310A (zh) * 2019-11-25 2020-03-27 杭州群核信息技术有限公司 一种云端图纸智能生成及编辑方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180374276A1 (en) * 2016-04-04 2018-12-27 Occipital, Inc. System for multimedia spatial annotation, visualization, and recommendation
CN109461210A (zh) * 2018-10-15 2019-03-12 杭州群核信息技术有限公司 一种在线家装的全景漫游方法
CN109598783A (zh) * 2018-11-20 2019-04-09 西南石油大学 一种房间3d建模方法及家具3d预览系统
CN110929310A (zh) * 2019-11-25 2020-03-27 杭州群核信息技术有限公司 一种云端图纸智能生成及编辑方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116226951A (zh) * 2022-12-05 2023-06-06 中山市可讯科技有限公司 一种新型的在线平面测量方法及其应用
CN116226951B (zh) * 2022-12-05 2024-04-30 中山市可讯科技有限公司 一种新型的在线平面测量方法及其应用

Also Published As

Publication number Publication date
CN113761614A (zh) 2021-12-07
CN113761614B (zh) 2023-08-11
US20220300669A1 (en) 2022-09-22

Similar Documents

Publication Publication Date Title
WO2021244119A1 (zh) 一种平面家装设计辅助方法
US11367250B2 (en) Virtual interaction with three-dimensional indoor room imagery
JP7325602B2 (ja) インテリアデザインのための人工知能システム及び方法
US11640672B2 (en) Method and system for wireless ultra-low footprint body scanning
US10628666B2 (en) Cloud server body scan data system
US20140125654A1 (en) Modeling and Editing Image Panoramas
WO2022141887A1 (zh) 一种家装平面自动设计方法和装置、计算机设备和存储介质
US9536340B2 (en) Software incorporating efficient 3-D rendering
US9330501B2 (en) Systems and methods for augmenting panoramic image data with performance related data for a building
US7249005B2 (en) Design software incorporating efficient 3-D rendering
US9471719B2 (en) Efficient lighting effects in design software
CN111723902A (zh) 使用神经网络动态估计增强现实场景中位置的照明参数
US20210327154A1 (en) Systems and methods for scene-independent augmented reality interfaces
CN106683177B (zh) 基于互动漫游式房屋装修数据交互方法及装置
WO2022141888A1 (zh) 一种家装素材移动方法、装置、计算机设备和存储介质
WO2022060873A1 (en) Techniques for virtual visualization of a product in a physical scene
Wang et al. PointShopAR: Supporting environmental design prototyping using point cloud in augmented reality
WO2018182938A1 (en) Method and system for wireless ultra-low footprint body scanning
US20150138199A1 (en) Image generating system and image generating program product
JP2003157290A (ja) イメージシミュレーション用処理方法、イメージシミュレーション用処理システム、イメージシミュレーション用処理プログラム及び記録媒体
Zhang Virtual Design Method of Interior Landscape Based on 3D Vision
US20180020165A1 (en) Method and apparatus for displaying an image transition
Ishikawa et al. Interactive indoor 3D modeling from a single photo with CV support
TWI723565B (zh) 立體格局圖產生方法與系統
JP3278473B2 (ja) ３次元モデル配置システムおよび３次元モデル配置方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21816721

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21816721

Country of ref document: EP

Kind code of ref document: A1