WO2022141888A1

WO2022141888A1 - Home decoration material moving method and apparatus, and computer device and storage medium

Info

Publication number: WO2022141888A1
Application number: PCT/CN2021/084733
Authority: WO
Inventors: 宋璐; 黄治; 喻培; 陈静; 唐睿
Original assignee: 杭州群核信息技术有限公司
Priority date: 2020-12-31
Filing date: 2021-03-31
Publication date: 2022-07-07
Also published as: CN112765706A; CN112765706B

Abstract

Provided are a home decoration material moving method and apparatus, and a computer device and a storage medium, which belong to the field of home decoration designs. The method comprises: acquiring a house type projection plane graph including a designed home decoration material (S101), wherein the house type projection plane graph includes three-dimensional structure information of a house type; receiving a material moving instruction (S102); and on the basis of auxiliary information corresponding to a material state, prompt information and the three-dimensional structure information of the house type, adjusting a design by means of moving the designed home decoration material according to the material moving instruction, so as to obtain a home decoration design result (S103). Moving a 2D material and a 3D material in a two-dimensional plane improves the design efficiency and the design effect of a home decoration layout, and brings an excellent operation experience for a user.

Description

A method, device, computer equipment and storage medium for moving home improvement materials

technical field

The invention belongs to the cross field of home improvement design and computer-aided design, and also relates to the technical field of graphics and images, in particular to a method, device, computer equipment and storage medium for moving home improvement materials.

Background technique

Home decoration design generally includes hard decoration, customization and soft decoration. Now fine decoration delivery is a major trend of social development. After the owner has acquired the house, it is already a house that has been uniformly decorated by the developer, and only needs to be soft and furnished. Part of the hard decoration can be supplemented with furnishings to complete the home decoration design, and this part is the part that can best reflect the personality and preferences of the owner of the house.

With the improvement of people's living standards, the personalized demand for soft decoration design has become more and more obvious. People usually determine their favorite styles and colors through professional soft decoration designers, shopping guides in home stores, or simple matching by themselves, and Specific soft outfit items, and then go to the purchase and placement of soft outfits. There are two mainstream methods for the current situation of home decoration design, one is 3D form, such as 3D Max, Kujiale, 3D home, and flat design home. This method uses the schematic placement of the 3D model of the home improvement material in the visualization tool as the main design process. The effect in the design process cannot be directly used as the delivery result, and it takes a long time to render and wait for the rendering. The other is 2D form, such as Meijian, PS, PPT, etc. This form uses pictures of home improvement materials to make puzzles on a flat canvas. The effect presented in the design process is the final delivery effect, which is intuitive and simple, but requires strong spatial imagination and takes a long time to make perspective relationships between pictures. , size, etc.

SUMMARY OF THE INVENTION

In view of the above, the purpose of the present invention is to provide a method, device, computer equipment and storage medium for moving home decoration materials, which can improve the design efficiency and design effect of home decoration layout by moving 2D materials and 3D materials in a two-dimensional plane. Give users the ultimate operating experience.

In a first aspect, an embodiment of the present invention provides a method for moving home improvement materials, including the following steps:

Acquiring a floor plan of a house type that includes materials that have been designed for home decoration, where the floor plan of the house type projection includes three-dimensional structure information of the house type;

Receive material movement instructions;

Based on the auxiliary information, prompt information and the three-dimensional structure information of the house type corresponding to the material state, the designed home decoration material is moved according to the material movement instruction to adjust the design, and the home decoration design result is obtained.

In a second aspect, an embodiment of the present invention provides a device for moving home improvement materials, including:

an acquisition module, which acquires a floor plan of a house type that includes materials for home decoration that have been designed, and the floor plan of the house type projection includes the three-dimensional structure information of the house type;

The receiving module receives the material movement instruction;

The moving module, based on the auxiliary information corresponding to the material state, the prompt information and the three-dimensional structure information of the house type, assists in moving the designed home decoration material according to the material moving instruction.

In a third aspect, an embodiment of the present invention provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, when the processor executes the computer program The steps of implementing the method for moving home improvement materials described in the first aspect.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is processed and executed, the steps of the method for moving home improvement materials described in the first aspect are implemented. .

Compared with the prior art, the beneficial effects of the present invention at least include:

A method, device, computer equipment, and storage medium for moving home improvement materials provided by the embodiments of the present invention assist in moving the designed home improvement materials to adjust the design based on auxiliary information, prompt information corresponding to the material state, and three-dimensional structure information of the house type. , the existence of the auxiliary information and prompt information will improve the design efficiency of the home decoration layout, bring users the ultimate operating experience, and improve the design effect.

Description of drawings

In order to illustrate the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative efforts.

1 is a flowchart of a method for moving home improvement materials provided by an embodiment of the present invention;

2 is a schematic diagram of imaging room area information provided by an embodiment of the present invention;

FIG. 3 is a projected plan view of a house type showing control points according to an embodiment of the present invention;

4 is a schematic diagram of auxiliary information sum corresponding to a material state provided by an embodiment of the present invention;

5 is a schematic diagram of an alignment reference line of a material provided by an embodiment of the present invention;

FIG. 6 is a schematic view of an aligned reference plane of a material provided by an embodiment of the present invention;

FIG. 7 is a schematic diagram of prompting a spatial range of material movement provided by an embodiment of the present invention;

FIG. 8 is a schematic diagram showing the effect that the material provided by an embodiment of the present invention presents a near-large and far-small effect;

9 is a schematic structural diagram of a home improvement material moving device provided by an embodiment of the present invention;

10 is a schematic structural diagram of a home improvement material moving device provided by another embodiment of the present invention;

FIG. 11 is a schematic structural diagram of a computer device according to an embodiment of the present invention.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, and do not limit the protection scope of the present invention.

In order to improve the efficiency and effect of home decoration design, the embodiments of the present invention provide a method, device, computer equipment and storage medium for moving home decoration materials, which can be specifically applied to the field of home decoration to realize moving home decoration materials on a 2.5-dimensional house type projection plan to achieve Adjust the design. Each section is described in detail below.

Example 1

Embodiment 1 provides a method for adjusting home improvement materials. As shown in FIG. 1 , the embodiment provides a method for moving home improvement materials, including the following steps:

S101: Acquire a floor plan projection plan of a house type that includes materials that have been designed for home decoration, where the floor plan projection plan of the house type includes three-dimensional structure information of the house type.

The floor plan of the house type projection is generated from the background image of the flat home decoration. Place the home improvement material on the floor plan of the house type to obtain the floor plan of the house type that has been designed with the home decoration material.

Among them, the background image of the flat home decoration is the reference diagram of the flat design of the user's home decoration. There are many choices for the background picture of flat home decoration, which can be a complete rendering with soft decoration, an empty scene rendering without soft decoration, a real photo or a whiteboard. A whiteboard is a blank background.

The method for moving home decoration materials provided by the present invention is a 3D or 2.5D design method. Therefore, the three-dimensional information of the house type is very important auxiliary information in the design process. Before designing, it is necessary to obtain the three-dimensional structure information of the house type. 3D information for home decoration layout adjustment.

When the background image of the flat home decoration is a rendering image, after parsing the rendering image, the camera parameters and light field information are obtained according to the rendering parameters, and the camera matrix is constructed; the 3D model of the rendering image is obtained by calculating the rendering image and the camera matrix, that is, the 3D structure information of the house type is obtained. Constructing a floor plan projection plan according to the three-dimensional structure information of the floor plan, wherein the projection plan view includes at least one of a ground projection plane (referred to as the ground), a wall projection plane (referred to as a wall) and a top projection plane (referred to as the top surface).

When the background picture of the flat home decoration is a real photo, the camera parameters are preset, that is, the camera position is used as the origin of the world coordinate system, and the world coordinate system and the camera coordinate system are coincident, and the edge detection is performed on the real photo, and the top of the wall is perpendicular to each other. The assumption is that the three-dimensional structure information of the house type is restored, and then the projected floor plan of the house type is constructed according to the three-dimensional structure information of the house type.

In an implementation manner, constructing a floor plan of a house type projection according to the three-dimensional structure information of the house type includes: obtaining all corner (corner) information and all wall (wall) information indicating a wall connection based on the three-dimensional structure information of the house type; wherein, The corner information is represented by coordinates, and the wall information is described by the coordinates of two corner points connecting the wall, the thickness of the wall and the height of the wall.

After building the floor plan according to the corner point information and the wall information, project the floor plan according to the camera parameters to obtain the floor plan of the floor plan. The specific process is: first, connect the corresponding corner points to generate wall lines according to the corner coordinates and wall information, and obtain the floor plan of the house; then, according to the camera position and the near-plane clipping distance of the direction the camera is looking at, obtain the direction the camera is looking at After the plane coordinates of the point, judge and determine that the point the camera is looking at is located in the room area of the floor plan according to the plane coordinates of the point the camera is looking at; finally, filter and determine the effective corners that make up the room area, based on the effective corners , wall thickness, wall height and camera parameters to generate the wall projection plane, the ground projection plane and the top projection plane to form the floor plan of the room area.

In the embodiment, after obtaining the effective corner points of the room area, the apartment frame is formed according to the connection of the effective corner points, and according to the thickness of the wall, lines parallel to the apartment frame are generated inwardly and outwardly along the apartment frame as the inner wall line and the outer wall line. , determine the intersection of the lines in the wall and use the intersection as the target corner, obtain the two-dimensional coordinates (x, y) at the same time, determine the z-coordinate of the target corner according to the camera height and floor height, and obtain the three-dimensional coordinates of the target corner (x, y) y, z), determine the space connection line according to the three-dimensional coordinates of the target corner point, use the camera view cone determined by the camera parameters to truncate the space connection line to generate a new control point, and take the target corner point in the camera view cone as the original. Control point, according to the new control point and the original control point to generate the wall projection plane, the ground projection plane and the top projection plane to form the floor plan of the room area.

In the embodiment, the point in the direction the camera looks at refers to the clipping plane of the direction in which the camera looks, that is, the intersection of the near plane of the imaging viewing cone and the direction in which the camera looks. Since the room area is a closed area, the corner points between the walls in the room area and the corner points of other rooms of the apartment type are removed as redundant points, and the remaining corner points are the effective corner points that constitute the room area. As shown in Figure 2, the corners represented by the symbol × without dots are redundant points in the room where the camera is located, and the remaining symbols × with dots next to them are used to form walls and are valid corners. After eliminating the redundant points, use the thickness information of the wall to increase or decrease the thickness of the wall by 1/2 along the direction perpendicular to the wall to obtain the inner wall line and the outer wall line, and take the intersection of the inner wall line as the target corner point, That is, the dots in Figure 2, they are the smallest set of points that describe the polygons formed by the lines in the wall of the room where the camera is located.

In the embodiment, the target corner point (the circle point in Fig. 2 ) of the final projected plan view is actually the intersection point of all the inner wall lines, but because the room is irregular, it is impossible to distinguish the inner wall line and the outer wall line, so it is necessary to Line recognition is performed to determine the intersection of lines within the wall. The specific process includes:

Extend the line inside the wall and the line outside the wall to realize the closure of the intersection connection to generate the intersection, and at the same time remove the outgoing line segment at the intersection, and then find the closed area where the plane coordinates of the point in the direction the camera is looking at. as the target corner.

In the embodiment, the perspective projection and orthogonal projection of the indoor area can be realized by using the camera view cone. When the perspective projection is realized, the camera view cone used is the truncation of the spatial connection of the vertebral frustum to the target corner, and the intersection of the vertebral frustum and the spatial connection. is the new control point; when the orthographic projection is realized, the camera view cone used is the spatial connection truncation of the cube to the target corner.

In the embodiment, the new control point and the original control point are connected in sequence to generate the wall projection plane, then all the upper control points of the wall are connected to form the top projection plane, and all the lower control points of the wall are connected to form the bottom surface. Projection plane, which forms the projected floor plan of the room area.

In the present invention, the projection plane is called the adsorption surface, which means that the home improvement material can be adsorbed to the corresponding surface according to the configuration property of the material. In order to better describe the adsorption surface, the corner points of the plane are set as control points, and the adsorption surface is described according to the control points. In the embodiment, the adsorption surface is represented by the control points connected clockwise, and a List is used to describe the visible projection plane of the house type structure of the rendering image, and each visible projection plane is described by no less than 3 control points. In particular, when a certain projection plane is cut off by the picture (that is, the viewing cone range), the control points should be adjusted accordingly to the picture, and increased as needed. For example, as shown in Figure 3, the first wall A from the left is truncated by a corner of the view cone, then the control points describing the first wall from the left will be changed from 4 to 5. In addition, there are 4 control points in the last whole picture. The corner points are also added to the corresponding projection planes as control points to ensure that the entire picture is completely covered by all projection planes, such as the upper left corner, upper right corner, and lower right corner in Figure 3, but the projection planes can be overlapped in the picture, such as behind the bump wall The plane is shown in Part B of Figure 3.

When the background image of the flat home decoration is a whiteboard, a series of rendering images need to be predefined as the input of the three-dimensional structure information of the whiteboard, and the projected floor plan of the house type is constructed according to the three-dimensional structure information of the house type; but the tool display level is blank, that is, RGB=(255, 255, 255), or other user-defined value. One of the typical cases is to select the case where the camera is looking straight ahead, and there is only a part of a wall in the field of view. In this case, all the home improvement materials are placed on the same plane in a tiled type, which is compatible with pure 2D design. .

In the embodiment, the home improvement material defines two material types according to the setting method, namely the placement type and the paving type. Among them, the placement type refers to materials that can be placed directly, such as sofas, beds, tables, etc., and is further subdivided. The placement types include placing on the ground, hanging on the wall, and hanging on the top. The type of paving refers to the materials that can be paved, such as carpets, paintings, curtains, etc., and is further subdivided. The types of paving include paving on the ground and pasting on the wall.

Home improvement materials also define two types of materials according to dimensions, namely three-dimensional (3D) materials and two-dimensional (2D) materials. The manipulated material elements in the canvas are all pictures, the background is a large texture as the background layer, and each material element is a small picture, which is carried by a separate layer.

In order to facilitate the adjustment of the 3D material and the 2D material during the moving process, a description flag is set for the 3D material and the 2D material.

Set the adjustment description of the 3D material as a solid bounding box containing the coordinate system, including the upper plane, the lower plane, the left plane, the right plane, the front plane, and the back plane. For 2D material, the bounding box describing its physical size is missing, but in the present invention, the coordinate form of the bounding box of 3D material is still used. Let the y value be 0, and the x value is calculated according to the ratio of the aspect ratio of the 2D image and the z value of the Bounding Box. Assuming that the default height of z is 2000mm, the pixel height of the corresponding material is 400px, and the real pixel width of the material is 600px, then the z value is 3000mm according to the proportional calculation. After obtaining the x, y, z values, set the origin of the Cartesian coordinate system at the centroid of the 2D material, then the coordinates of the four vertices of the Bounding Box are {point 1(-x/2,0,z/ 2), point 2(-x/2,0,-z/2), point 3(x/2,0,-z/2), point 4(x/2,0,z/2)}.

So far, 2D material and 3D material have the same complete description and identification, the difference is that the Bounding Box of 3D material is a cube, while the Bounding Box of 2D material is a plane (a special cube with a thickness of 0).

When placing the home decoration material on the floor plan of the house type projection, drag the material to the floor plan of the house type projection to place the material, or click the button, the preview of the material can be attached to the mouse, and then click the floor plan of the house type projection to place the material. In addition, at the initial moment of dragging or clicking the button, the mouse is positioned at the center of the preview image of the material.

In order to better realize the design, a default adsorption surface is configured for each type of material. A certain default binding relationship is maintained between the material and the adsorption surface. All materials set in the floor plan of the floor plan are placed on the corresponding adsorption surface and maintain a certain binding relationship. Among them, for the ground materials placed on the ground and laid on the ground, the default adsorption surface is defined as the ground in the floor plan of the floor plan; for the top surface material suspended on the top surface, the default adsorption surface is defined as the floor in the floor plan of the floor plan. Top surface; for the wall materials hung on the wall and attached to the wall, the default adsorption surface is defined as the wall in the floor plan of the floor plan.

S102, receiving a material movement instruction.

Designation of home decoration design refers to various operation instructions for designing home decoration materials on the floor plan projection plane, including material placement, material movement, material scaling, material rotation, material replacement, rendering, and generating proposals. In the present invention, it mainly relates to the material movement instruction.

S103 , based on the auxiliary information corresponding to the material state, the prompt information, and the three-dimensional structure information of the house type, assist in moving the designed home decoration material according to the material movement instruction to adjust the design, and obtain a home decoration design result.

Moving the home improvement material is mainly used to adjust the layout. In order to improve the speed and accuracy of the adjustment, in the material moving method provided by the embodiment, auxiliary information, prompt information, etc. corresponding to the material state are set to assist the material movement, and It is convenient for users to operate the material to realize the custom design of home decoration.

The auxiliary information corresponding to the material is defined according to the material state, as shown in Figure 4, which specifically includes: unselected state, no auxiliary information, that is, when the material is in the unselected state, only the preview image of the material is displayed; in the selected state, the auxiliary information includes the check box, Height auxiliary arrow, height auxiliary line, that is, when the material is in the selected state, the material preview, check box, height auxiliary arrow, and height auxiliary line are displayed; in the moving state, auxiliary information includes check box, adsorption surface highlight, height auxiliary arrow and height Auxiliary line, that is, when the material is in the moving state, the preview of the material, the check box, and the highlight of the adsorption surface are displayed, and the height auxiliary arrow and height auxiliary line are also displayed when the height is moved. According to the auxiliary information corresponding to the state of the material, the placed material can be moved to realize the custom design.

For graphic design, alignment is very necessary, and the user can quickly adjust the alignment of the two materials according to the auxiliary lines. Similarly, the design process of the present invention also supports auxiliary line reminders, in the horizontal direction of the canvas, reminding the bottom edge of the two materials to align, horizontal center alignment, and top edge alignment; in the vertical direction of the canvas, reminding the left edge of the two materials, Vertical center alignment, right edge alignment, etc.

In one embodiment, the prompt information includes alignment prompt information in 3D space, that is, the method for moving home improvement materials further includes an alignment prompt function in 3D space, so as to facilitate the user to align the materials, such as two materials in the same adsorption plane The front alignment, centroid alignment, back alignment, etc., to facilitate the placement of the same type of material, such as two bedside tables, two wall lamps, etc.

Wherein, the alignment prompt function includes a plane alignment prompt and a space alignment prompt; when the alignment prompt function is enabled, for the plane alignment prompt, the 4 edge lines and 2 center lines of the circumscribed rectangle of the selected box are generated for the material as alignment reference lines, During the material movement, the alignment reference line is displayed to remind the user of the alignment operation; for the spatial alignment prompt, the 6 faces and 3 center faces of the circumscribed cube of the bounding box are generated for the material as the alignment reference planes. During the material movement, the alignment is displayed by displaying the alignment The reference surface reminds the user of the alignment operation.

In the actual operation, the user chooses to enable the alignment prompt function, and selects the plane alignment prompt or the space alignment prompt. When the plane alignment prompt is selected, during the moving process of the material, the 4 edge lines and 2 center lines of the circumscribed rectangle of the material selection box are used as Align reference line, when any one reference line of the two materials moves to the same x-axis or y-axis on the screen coordinate system, the alignment reference line is displayed, as shown in Figure 5; when the space alignment prompt is selected, the material is moving During the process, the 6 faces and 3 center faces of the circumscribed cube of the material bounding box are used as the alignment reference planes, as shown in Figure 6, when any one reference plane of the two materials moves to the same U axis, V axis in the camera coordinate system. Axis or W axis, the alignment reference plane is displayed; when the user chooses to turn off the alignment prompt function, no alignment reference line or alignment reference plane is displayed during the movement.

In the design process, in order to let users feel the relative relationship between materials and space more clearly, but at the same time have a high degree of creative freedom. In one embodiment, it also includes defining a moving space range providing function, that is, the prompt information includes moving space range prompt information, and generates spatial range prompt information corresponding to the location of the material according to the location of the material. For example, for the ground material, extend the ground within the visible range, and the material can be moved freely on the ground after the extension, but when the material is completely moved out of the space, the material preview and selection box will become translucent, penetrating walls Highlight and supplement with text prompts, such as "The material has been moved out of the space, it is recommended to switch the placement position", as shown in Figure 7, when the material is moved back into the space, the material preview and the selected box return to normal and penetrate the wall The highlight disappears. In addition, this state is only displayed during the moving process, and the state returns to normal after the material is placed.

Among them, the first method of confirming the location of the material: project the bounding box of the material to its adsorption surface to obtain a rectangle, calculate the intersection of the rectangle and the adsorption surface, if the intersection is equal to the rectangle, it is located in the space, if the intersection is smaller than the rectangle, it is in the Penetrates the space, and if the intersection is empty is completely outside the space. Confirmation method 2: Project the bounding box of the material onto its adsorption surface to obtain a rectangle, and determine the positions of the four vertices of the rectangle. If the number of vertices is less than 4 but greater than 0, the material is penetrating. If the number of vertices in the adsorption surface is 0, that is, if all vertices are located outside the adsorption surface, the material is located outside the space.

Since the type projection plan is a projection plane, in order to make the design result map realize the presentation effect of near big and far small in line with the real world observation results. You need to adjust the placement of the material to show the perspective effect of near, large and far. In traditional 2D design, users usually rely on their own spatial imagination to manually scale the size of each material to achieve the effect of near big and far small. This manual adjustment method has low efficiency, poor accuracy and poor effect.

In order to solve the problems of low efficiency, poor accuracy and poor effect of the manual adjustment method, the method for moving home decoration materials of the present invention further includes: automatically adjusting the size of the 3D materials to achieve the effect of near big and far small, including: material-based bounding box and camera parameters , after the position of the material preview image in the house type projection plane is given, the 2D coordinates of the 8 vertices of the material bounding box in the house type projection plane are obtained by calculating, so as to realize the adjustment of the 3D material.

In one embodiment, the process of automatically adjusting the size of the 3D material is: calculating the plane parallel to the floor plan of the floor plan where the centroid of the bounding box is located, and pasting the material preview image at the centroid of the bounding box, then the Display height h=bbox.z+a*bbox.y, in which the coefficient a is determined according to the projection of the normal of the adsorption surface where the material is located in the direction parallel to the floor plan of the floor plan, and bbox.z is the projection of the bounding box to the floor plan of the floor plan. After, the pixel size of the height of the back plane, bbox.y is the pixel size when the upper or lower plane of the bounding box is expanded to be parallel to the back plane, a*bbox.y represents the upper or lower plane of the bounding box projected on the house The pixel size in the plan view; the display width of the material preview is calculated according to the aspect ratio of the material preview to ensure the consistency of the material preview and the bounding box. After determining the display height and width of the material preview, Then, according to the camera parameters, the 2D coordinates of the 8 vertices of the bounding box in the house type projection plane can be determined, and then the adjustment of the 3D material can be realized. As shown in the chandelier in Figure 8, at different positions in the picture, the bounding box will achieve the visual effect of near, large and far small according to the physical size, and the 3D material will become larger and smaller together.

For 2D materials, bbox.y=0, bbox.x is calculated from bbox.z and the aspect ratio of the material preview, so the bounding box and the material preview are also completely matched in the floor plan of the floor plan, as shown in Figure 8 sofa.

The method for moving home improvement materials provided by the present invention further includes: when moving the materials that have been placed on the floor plan projection plane, the materials keep the effect of being near big and far small during the moving process.

In one of the embodiments, the realization process of the effect of keeping the material near big and far small during the moving process can be as follows: determine the 3D coordinates of the position selected by the mouse, bind the relative position of the selected position of the mouse and the material to remain unchanged, and move the mouse by moving the mouse. During the material process, the 3D coordinates and 2D coordinates of the mouse are updated according to the camera parameters, and the 2D coordinates of the 8 vertices of the material bounding box are updated according to the new 2D coordinates of the mouse, so as to achieve the effect of keeping the material near large and far small during the moving process.

In the embodiment, the method of determining the 3D coordinates of the mouse is: when the mouse selects a material, the depth of the center of the material bounding box is used as the depth of the mouse click position, and the 2D position in the floor plan of the house type projection is based on the depth of the mouse click position and the mouse click position. Coordinates, use the inverse matrix of the camera matrix to do transformation processing to obtain the 3D coordinates of the mouse click position.

In the embodiment, when selecting a material with a mouse, for the non-transparent pixel portion of the current material, only the mouse is supported to select the current material, and for the transparent pixel portion of the current material, the transparent pixel portion of the current material is supported to select the following material.

In one of the embodiments, the realization process of the effect of keeping the material near big and far small during the moving process is as follows: determining the 3D coordinates of the position selected by the mouse, and in the process of moving the material by the mouse, the movement of the mouse is decomposed into the horizontal direction and the vertical direction. When moving in two directions, the bounding box of the material moves with the mouse when moving horizontally. When moving vertically, the mouse only indicates the moving direction. The vertical direction means moving at a constant speed in the world coordinate system along the direction the camera is looking at. Adjust the depth information of the mouse and the bounding box, so that during the movement of the material, the material bounding box will automatically show the state of near big and far small according to different positions. According to the positive correlation between the material preview image and the projected size of the bounding box, the material can be realized. The state of the near-large and far-small preview images.

In the process of moving the material with the mouse, for the top material, when the mouse is dragged upward, the top material moves to the near side along the top surface, and when the mouse is dragged and moved downward, the material moves along the top surface to the far side. For ground material, when it is dragged upward by the mouse, the ground material moves far along the ground, and when it is dragged and moved downward by the mouse, the material moves near the ground, and the vertical decomposition is along the direction of the camera. The direction moves at a constant speed in the world coordinate system, adjust the depth information and the corresponding 3D coordinates, and then obtain the 2D coordinates of the bounding box and the 2D coordinates of the material preview image to achieve the effect of near big and far small. Only when moving left and right, the relative position of the mouse and the material will remain unchanged. When it comes to moving up and down, since only the moving direction is specified, the moving speed is uniform, so the movement of the material is natural and can be precisely controlled.

In order to conveniently control the movement of the material through the mouse, the method for moving the home improvement material of the present invention further includes: defining a corresponding relationship between the movement of the mouse and the movement of the material, and controlling the movement of the material through the mouse according to the corresponding relationship, that is, when the mouse is pressed down on the material, the material moves with the mouse, The corresponding relationship is as follows:

(a) For ground material, on the basis of holding down the mouse at any position of the material, when the mouse moves up, the material moves away from the camera on the ground, and the material becomes smaller; when the mouse moves down, the opposite is true; When the mouse moves to the left, the material moves to the left on the ground, and the size of the material remains unchanged. When the mouse moves to the right, the opposite is true.

(b) For the top surface material, on the basis of pressing the mouse on any position of the material, when the mouse moves up, the material moves on the top surface toward the direction close to the camera, and the material becomes larger, and when the mouse moves downward, the On the contrary; when the mouse is moved to the left, the material moves to the left on the top side, and the size of the material remains unchanged, and the opposite is true when the mouse is moved to the right.

(c) For wall material, on the basis of holding down the mouse at any position of the material, when the mouse moves up, the material moves up on the wall, and the size of the material remains unchanged, but the opposite is true when the mouse moves down; When moving to the left, if the wall is parallel to the screen, the material moves to the left on the wall, and the size of the material remains unchanged. If the angle between the wall and the screen is an acute angle, the material moves on the wall toward the camera. , the material becomes larger. If the angle between the wall and the screen is an obtuse angle, the material moves on the wall away from the camera, and the material becomes smaller. When the mouse moves to the right, the opposite is true.

(d) For the ground material and top surface material, define the height auxiliary arrow and height auxiliary line to support a certain height from the adsorption surface. The position is shown in Figure 4. When the mouse moves up by pressing the height auxiliary arrow, the adsorption surface is highlighted. , the material detaches from the adsorption surface and moves vertically toward the top surface until the center of the upper plane of the material bounding box intersects with the top surface and stops moving; when the mouse is pressed and the height auxiliary arrow moves down, the adsorption surface is highlighted, and the material detaches from the adsorption surface toward the top surface. Move vertically to the ground until the center of the lower plane of the material bounding box intersects the ground, and then stop moving; for the ground material and top material that are detached from the adsorption surface, the height guide line represented by a dotted line will be displayed when it is selected or moved. to display the height of the material from the snapping surface.

The above solution provides moving the material through the mouse, but only the rough position adjustment can be achieved by relying on the mouse to move the material, but the effect of fine adjustment of the position cannot be achieved. Therefore, the method for moving the home improvement material of the present invention also includes: according to the adjustment of the keyboard and the material Rules, fine-tune the material position via the keyboard.

Among them, the adjustment rules of the keyboard and the material include: for the paving material, the freedom of movement in the paving state includes two dimensions, which correspond to the up, down, left, and right keys of the keyboard. Material movement adjustment; for placed materials, after the height from the ground is constrained, the freedom of movement in the placed state only includes two dimensions, including the front and rear dimensions and the left and right dimensions, which correspond to the up, down, left, and right keys of the keyboard. By operating the keyboard The up, down, left, and right keys can adjust the movement of the placed material.

In the embodiment, the unit movement distance corresponding to each keystroke on the keyboard is set, for example, if the unit movement distance is set to 100mm, then each time the left keyboard is clicked, the material will move to the left by 10cm in the world coordinate system.

In order to achieve a realistic effect, multiple materials in the same position will show an occlusion relationship. The method for moving home improvement materials of the present invention further comprises: automatically generating a layer for the materials placed on the floor plan of the house type projection and adjusting the layer according to the material moving instruction, specifically, generating the layer depth according to the depth information of the material bounding box, and according to the depth compensation value Make adjustments to the layer depth to adjust the layer position.

In the present invention, all 3D materials are flattened to a plane with a central depth, and then all 3D materials are degraded into 2D material preview images. Based on this, the depth information of the center of the material bounding box can be used to add a depth compensation value Sort the layers, that is, the layer farthest from the camera is on the bottom layer, and the layer closer to the camera is on the upper layer, so that the near material can block the distant material. When moving or adding material, its depth changes in real time, and the layers are adjusted accordingly to automatically achieve a reasonable occlusion relationship.

For the 3D material added to the floor plan of the house type projection, the direction of the depth compensation value is the direction the camera is looking at, and the size is bbox.y/2, which is the depth of the back plane of the material's bounding box, so that the ornaments on the table, the pillows on the sofa, The pillows, blankets, etc. on the bed will be on the upper layer, which is consistent with the observation results.

For layer adjustment, as with pure graphic design, define operations such as top, bottom, move up, move down, etc. for layers. It can be seen from the automatic generation process of the layer that the layer definition depends on the depth calculation of the material. The valid value range for the depth of the soft-covered material layer is (-∞, 1], where the visible range of the viewing cone in the room is [-1, 1], 1 means the near plane, -1 means the far (far) ) plane. However, the depth value can be less than -1 because the material can move outside the bounds of the room.

For layer adjustment, set the adjustment precision value, perform compensation operation on the precision value and the depth of the material to be adjusted to obtain the compensated depth value, and adjust the material position according to the compensated depth value.

In an embodiment, the adjusted precision value eps may be defined as the minimum precision value recognizable by the computer, such as 1e-6. Then, when the selected material is moved up one layer, sort the depth values of all the original materials, find the depth a of the material one layer above the selected material, adjust the depth compensation value, and set the depth value of the material to be adjusted to a+eps. The same is true for moving down a layer. If you set it to the top, find the value b with the largest depth of all the materials, and set the depth value of the material to be adjusted to b+eps. The same is true for the bottom.

In one embodiment, the method for moving home improvement materials of the present invention further includes: rendering the home improvement graphic design result to generate a rendering and outputting the result.

Since the design process, whether it is the floor plan of the house type projection or the material, is all assisted by 3D information, it is very easy to convert it into a 3D model for offline rendering to obtain a more realistic light and shadow effect.

The most basic situation is that after obtaining the 3D house type model of the floor plan of the house type projection and the 3D model of the 3D material, a 3D scene model is formed, and the 3D scene model is rendered to obtain a rendering of the home improvement design result.

When the material is a 2D material, because there is no 3D model, the following three methods are used for rendering: the first method is to tolerate a certain degree of inconsistency, and the image search technology is used to search for the most similar model to render; the second method is based on The outline of the 2D material builds a flat model, and the 2D material is pasted on the surface as a texture for rendering; the three methods are to temporarily remove all the 2D material during rendering, and after obtaining the rendered scene graph of the 3D material, calculate its depth map, and use the 2D material according to The depth information is placed where the occluded part is cropped.

In one embodiment, the method for moving home decoration materials of the present invention further includes: generating and outputting a design proposal based on the home decoration design result.

When the user completes the design of each space, it is also necessary to generate a complete proposal to constitute the entire design scheme. In addition to space design, the complete proposal also includes cover, back cover, catalog, style analysis, material analysis, color analysis, etc. These contents belong to the category of pure 2D design, which can be realized by using the pure white background mentioned above. That is, all materials are posted on the same wall facing the same side. Users can also upload pictures as one or more pages of the proposal, and each space is designed as a page, thus forming a complete proposal that can be shared, disseminated and reported.

The method for moving home decoration materials provided by the embodiment of the present invention does not limit the background image, and can take photos for renderings, whiteboards, or real scenes, with stronger application compatibility, which is convenient for users to design home decoration. To achieve the effect of real-life design.

The method for moving home decoration materials provided by the embodiment of the present invention provides an automatic size adjustment method for realizing the effect of near big and far small for 3D materials by setting auxiliary information for materials according to the material state, defining the corresponding relationship between mouse movement and material movement, and providing alignment The prompt function, the function of providing the scope of the mobile space, etc., realize the mobile adjustment of materials, simplify the difficulty of home decoration design, lower the threshold for the use of design software, improve the design efficiency of home decoration layout, bring users the ultimate operating experience, and improve the design. Effect.

The method for moving home decoration materials provided by the embodiments of the present invention uses 3D information to assist the design process, so that the work efficiency of designers is greatly improved, and at the same time, it is perfectly compatible with 2D and 3D materials, and solves the problem of high cost of 2D material information and 3D material acquisition. .

In the method for moving home decoration materials provided by the embodiments of the present invention, the results of the home decoration graphic design can be docked and rendered, so as to obtain more realistic light and shadow effects, and at the same time, proposals can be generated to provide to users.

Example 2

Embodiment 2 provides a device for moving home improvement materials. As shown in FIG. 9, the home improvement material moving device 900 provided by the embodiment includes:

The obtaining module 901 obtains a floor plan of a house type that contains materials for home decoration, where the floor plan of the house type projection includes three-dimensional structure information of the house type;

A receiving module 902, receiving a material movement instruction;

The moving module 903, based on the auxiliary information corresponding to the material state, the prompt information and the three-dimensional structure information of the house type, assists in adjusting the design by moving the designed home decoration materials according to the material movement instruction, and obtains the home decoration design result.

In one embodiment, as shown in FIG. 10 , the device 900 for adjusting materials for home improvement further includes:

The rendering module 1001 renders the results of the home decoration graphic design to obtain a rendering;

The proposal generation module 1002 generates proposals based on the home improvement graphic design results.

It should be noted that when the home improvement material moving device provided in Embodiment 2 moves home improvement materials, the division of the above-mentioned functional modules should be used as an example for illustration, and the above-mentioned functions can be allocated to different functional modules as needed. Or the internal structure of the server is divided into different functional modules to complete all or part of the functions described above. In addition, the home improvement material moving device provided in Embodiment 2 and the home improvement material moving method embodiment belong to the same concept, and the specific implementation process thereof is detailed in the home improvement material moving method embodiment, which will not be repeated here.

Example 3

Embodiment 3 provides a computer device, and provides a computer device, the computer device may be a terminal, and its internal structure diagram may be as shown in FIG. 11 . The computer equipment includes a processor, memory, a network interface, a display screen, and an input device connected by a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium, an internal memory. The nonvolatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the execution of the operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer program, when executed by the processor, implements an image presentation method. The display screen of the computer equipment may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment may be a touch layer covered on the display screen, or a button, a trackball or a touchpad set on the shell of the computer equipment , or an external keyboard, trackpad, or mouse. Those skilled in the art can understand that the structure shown in FIG. 11 is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer equipment to which the solution of the present application is applied. Include more or fewer components than shown in the figures, or combine certain components, or have a different arrangement of components.

In one of the embodiments, a computer device is provided, including a memory, a processor, and a computer program stored in the machine memory and executable on the processor, and the processor implements the method described in claim 1 when the processor executes the computer program. The steps of the method for moving home improvement materials include the following steps:

Receive material movement instructions;

In one of the embodiments, when the processor executes the computer program, the following step is further implemented: automatically adjust the size of the 3D material to achieve the effect of near large and far small.

In one embodiment, when the processor executes the computer program, the processor further implements the following steps: when moving the material, the material maintains the effect of near-large and far-small during the moving process, and also keeps the relative position of the mouse and the material preview image from occurring. Variety.

In one embodiment, the processor further implements the following steps when executing the computer program: controlling the movement of the material through the mouse according to the defined correspondence between the movement of the mouse and the movement of the material.

In one embodiment, when the processor executes the computer program, the following steps are further implemented: according to the adjustment rules of the keyboard and the material, the material is moved finely through the keyboard to adjust the position of the material.

In one embodiment, when the processor executes the computer program, the processor further implements the following steps: automatically generating a layer for the material placed on the floor plan of the house type projection and adjusting the layer according to the material moving instruction.

In one of the embodiments, when the processor executes the computer program, the processor further implements the following steps: rendering the home improvement graphic design result to generate a rendering and outputting the rendering.

In one of the embodiments, when the processor executes the computer program, the following steps are further implemented: generating and outputting a design proposal based on the home improvement graphic design result.

Example 4

Embodiment 4 also provides a computer-readable storage medium, such as a memory including at least one instruction, the at least one instruction can be executed by a processor in the terminal to complete the step of moving home improvement materials in Embodiment 1.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other medium used in the various embodiments provided in this application may include non-volatile and/or volatile memory. Nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Road (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

The above-mentioned specific embodiments describe in detail the technical solutions and beneficial effects of the present invention. It should be understood that the above-mentioned embodiments are only the most preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, additions and equivalent replacements made within the scope shall be included within the protection scope of the present invention.

Claims

A method for moving home improvement materials, comprising the following steps:

Acquiring a floor plan of a house type that includes materials that have been designed for home decoration, where the floor plan of the house type projection includes three-dimensional structure information of the house type;

Receive material movement instructions;

Based on the auxiliary information, prompt information and the three-dimensional structure information of the house type corresponding to the material state, the designed home decoration material is moved according to the material movement instruction to adjust the design, and the home decoration design result is obtained.
The method for moving home improvement materials according to claim 1, wherein the auxiliary information corresponding to the materials is defined according to the state of the materials, which specifically includes:

In the unselected state, there is no auxiliary information, that is, when the material is in the unselected state, only the preview image of the material is displayed;

In the selected state, the auxiliary information includes the check box, the height auxiliary arrow, and the height guide line, that is, when the material is in the selected state, the material preview, the check box, the height auxiliary arrow, and the height guide line are displayed;

In the moving state, the auxiliary information includes the check box, the highlight of the suction surface, the height auxiliary arrow and the height guide line, that is, when the material is in the moving state, the preview of the material, the check box, and the highlight of the suction surface are displayed, and the height assistant is also displayed when the height is moved. Arrows and height guides.
The method for moving home improvement materials according to claim 1, wherein the prompt information includes alignment prompt information in 3D space, that is, the method for moving home improvement materials further includes an alignment prompt function in 3D space, and the alignment prompt function includes plane alignment Prompts and space alignment prompts; when the alignment prompt function is enabled, for the plane alignment prompt, the 4 edges and 2 center lines of the bounding rectangle of the selected box are generated for the material as alignment reference lines. During the material movement, the alignment reference lines are displayed by displaying the alignment reference lines. Remind the user for the alignment operation; for the spatial alignment prompt, the 6 faces and 3 central faces of the circumscribed cube of the bounding box are generated for the material as the alignment reference planes. During the material movement, the alignment reference plane is displayed to remind the user of the alignment operation.
The method for moving home improvement materials according to claim 1, wherein the prompt information includes moving space range prompt information, and the space range prompt information corresponding to the location of the material is generated according to the location of the material.
The method for moving home improvement materials according to claim 4, wherein the first method of confirming the location of the material is: project the bounding box of the material to its adsorption surface to obtain a rectangle, and calculate the intersection of the rectangle and the adsorption surface, if the intersection is equal to The rectangle is located in the space, if the intersection is smaller than the rectangle, it is penetrating the space, and if the intersection is empty, it is completely outside the space;

Confirmation method 2: Project the bounding box of the material onto its adsorption surface to obtain a rectangle, and determine the positions of the four vertices of the rectangle. If the number of vertices is less than 4 but greater than 0, the material is penetrating. If the number of vertices in the adsorption surface is 0, that is, if all vertices are located outside the adsorption surface, the material is located outside the space.
The method for moving home improvement materials according to claim 1, further comprising: automatically adjusting the size of the 3D materials to achieve a near-large and far-small effect, comprising: based on the bounding box and camera parameters of the materials, in a given material preview image After the position in the house type projection plane, the 2D coordinates of the 8 vertices of the material bounding box in the house type projection plane are obtained by calculating, so as to realize the adjustment of the 3D material.
The method for moving home improvement materials according to claim 1, further comprising: when the materials are moved, the realization process of the effect of keeping the materials near large and far small during the moving process includes two processes, respectively:

Implementation process 1: Determine the 3D coordinates of the selected position of the mouse, and bind the relative position of the selected position of the mouse to the material. During the process of moving the material with the mouse, the 3D coordinates and 2D coordinates of the mouse are updated according to the camera parameters, according to the new 2D coordinates of the mouse. Update the 2D coordinates of the 8 vertices of the material bounding box, so as to achieve the effect of keeping the material near big and far small during the moving process;

Implementation process 2: Determine the 3D coordinates of the position selected by the mouse. During the process of moving the material with the mouse, the movement of the mouse is decomposed into horizontal and vertical movements. When the horizontal direction moves, the material bounding box moves with the mouse, and the vertical direction When moving, the mouse only indicates the moving direction, and the vertical direction moves along the direction of the camera at a constant speed in the world coordinate system. Adjust the depth information of the mouse and the bounding box, so that during the material movement, the material bounding box will change according to different According to the positive correlation between the preview image of the material and the projected size of the bounding box, the state of the preview image of the material can be realized.
The method for moving home improvement materials according to claim 7, wherein the method of determining the 3D coordinates of the mouse is: when the mouse selects the material, the depth of the center of the material bounding box is used as the depth of the mouse click position, and the The 2D coordinates of the depth and the mouse click position in the floor plan of the floor plan are transformed by the inverse matrix of the camera matrix to obtain the 3D coordinates of the mouse click position.
The method for moving home improvement materials according to claim 1, further comprising: defining a correspondence between mouse movement and material movement, and controlling material movement through the mouse according to the correspondence.
The method for moving home improvement materials according to claim 1, further comprising: according to the adjustment rules of the keyboard and the materials, finely moving the materials through the keyboard to adjust the position of the materials.
The method for moving home improvement materials according to claim 1, further comprising: automatically generating a layer for the materials placed on the floor plan of the house type projection and adjusting the layers according to the material movement instruction, specifically generating a map according to the depth information of the material bounding box Layer depth, adjust the layer depth according to the depth compensation value to adjust the layer position.
The method for moving home improvement materials according to any one of claims 1 to 11, further comprising: rendering a home improvement design result to generate a rendering and outputting;

Generate and output design proposals based on home improvement design results.
A device for moving home improvement materials, comprising:

an acquisition module, which acquires a floor plan of a house type that includes materials for home decoration that have been designed, and the floor plan of the house type projection includes the three-dimensional structure information of the house type;

Receiving module, receiving material movement instructions;

The moving module, based on the auxiliary information corresponding to the material state, the prompt information and the three-dimensional structure information of the house type, assists in moving the designed home decoration material according to the material moving instruction.
A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, when the processor executes the computer program, claims 1 to 12 are implemented The steps of any one of the methods for moving home improvement materials.
A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is processed and executed, the steps of the method for moving home improvement materials according to any one of claims 1 to 12 are implemented.