CN113792358A - Automatic interaction layout method and device for three-dimensional furniture and electronic equipment - Google Patents
Automatic interaction layout method and device for three-dimensional furniture and electronic equipment Download PDFInfo
- Publication number
- CN113792358A CN113792358A CN202111108052.7A CN202111108052A CN113792358A CN 113792358 A CN113792358 A CN 113792358A CN 202111108052 A CN202111108052 A CN 202111108052A CN 113792358 A CN113792358 A CN 113792358A
- Authority
- CN
- China
- Prior art keywords
- furniture
- room
- information
- dimensional
- movement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 230000003993 interaction Effects 0.000 title description 6
- 230000002452 interceptive effect Effects 0.000 claims abstract description 11
- 238000013461 design Methods 0.000 claims description 45
- 238000004088 simulation Methods 0.000 claims description 34
- 238000012545 processing Methods 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 claims description 3
- 239000003795 chemical substances by application Substances 0.000 description 13
- 238000010586 diagram Methods 0.000 description 6
- 238000012549 training Methods 0.000 description 6
- 238000013527 convolutional neural network Methods 0.000 description 5
- 238000010801 machine learning Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 238000005034 decoration Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/10—Geometric CAD
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Mathematical Physics (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computer Graphics (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a method and a device for automatic interactive layout of three-dimensional furniture and electronic equipment, wherein the method comprises the following steps: responding to an adjustment instruction of the first furniture, determining the movement information of the second furniture according to the initial layout state of the room, the information of the first furniture, a preset first layout network and the information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the state information of the first room; the second furniture is any one or more than one furniture except the first furniture; and determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information. Therefore, when the furniture needs to be moved or replaced, the furniture which is not selected by the user is adjusted at first, and then all the furniture is adjusted, so that a new furniture layout can be directly generated, and the efficiency is improved.
Description
Technical Field
The invention relates to the field of home furnishing layout, in particular to a three-dimensional furniture automatic interaction layout method and device and electronic equipment.
Background
Before house decoration, a designer is usually required to give a design scheme, the design scheme comprises hard equipment and soft equipment, but due to the continuous change of the user requirement, the design drawing is also continuously modified, for example, the user may need to adjust the layout of furniture or replace the furniture in the design drawing.
In the prior art, if the layout of the furniture needs to be adjusted or the furniture needs to be replaced, a user needs to communicate with a designer, and the designer modifies the scheme, so that the timeliness is poor, and if the designer does not have the full user intention, a small change may be modified for multiple times, and the efficiency is low.
Disclosure of Invention
In view of this, the embodiment of the invention discloses a method and a device for automatic interactive layout of three-dimensional furniture and electronic equipment, which solve the problems of poor timeliness and low efficiency of furniture layout adjustment in the prior art.
The embodiment of the invention discloses a method for automatic interactive layout of three-dimensional furniture, which comprises the following steps:
generating a three-dimensional simulation environment through a two-dimensional furniture design drawing; the three-dimensional simulation environment comprises: the house size of each room, the three-dimensional outline of each furniture and the position relationship of each furniture and the room;
determining an initial layout state of a room according to the three-dimensional simulation environment;
responding to an adjustment instruction of first furniture, determining movement information of second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain state information of the first room; the second furniture is any one or more than one furniture except the first furniture;
and determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information.
Optionally, the generating a three-dimensional simulation environment through a two-dimensional furniture design drawing includes:
identifying each furniture element and attribute information of each furniture element from the two-dimensional furniture design drawing;
generating a three-dimensional outline of each furniture element according to the attribute information of each furniture element in the two-dimensional furniture design drawing;
processing a two-dimensional furniture design drawing through a pre-trained semantic recognition model to obtain a civil engineering language intention;
identifying key points of each civil engineering element from the civil engineering language intention, and constructing a contour of each civil engineering element according to the key points of each civil engineering element;
calculating the house size of each room through the outline of each civil engineering element;
and determining the position relation of each furniture and each room based on the house size of each room and the three-dimensional outline of each furniture.
Optionally, the determining, according to the initial layout state of the room, the first furniture information, the preset first layout network, and the information of the second furniture, the movement information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the state information of the first room includes:
if the currently obtained first room state information and the first room state information obtained by moving the furniture last time are changed, taking the currently obtained first room state information as the current room state information, and executing the following steps:
determining a first probability value of the first furniture and the second furniture moving in different directions when moving simultaneously based on a preset first furniture cooperative intelligent agent network and current room state information; the current room state and the initial room state in the initial state;
determining the probability of the second furniture moving in different directions according to a preset first furniture cooperative intelligent network and the current room state;
determining a first target direction and a moving step length of the second furniture to be moved according to the second probability of moving in different directions and the first probability of moving in different directions;
and moving the second furniture according to the moving step length of the second furniture in the first target direction to obtain the state information of the first room.
Optionally, the determining a first target direction and a moving step length that the second furniture needs to be moved according to the second probability of moving in different directions and the first probability of moving in different directions includes:
calculating a product value of a second probability value of the movement of the second furniture in each direction and the first probability value in the direction;
and taking the direction corresponding to the maximum product value as a first target direction.
Optionally, the determining, based on the first room state information and a preset second layout network, movement information of a plurality of pieces of furniture, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information includes:
if the currently obtained second room state is different from the second room state obtained by the last furniture movement, representing the currently obtained second room state as the current room state, and executing the following steps:
determining third probability values of movement of the plurality of pieces of furniture in different directions when the plurality of pieces of furniture move cooperatively according to the current room state and a preset second furniture cooperative intelligent network;
determining fourth probability values of furniture in the plurality of pieces of furniture moving in different directions according to the current room state and a preset second furniture mobile intelligent network;
determining a second direction of movement of each piece of furniture and a second movement step size by a third probability value of movement in different directions when the plurality of pieces of furniture move cooperatively and a fourth probability value of movement of each piece of furniture in different directions;
and moving each piece of furniture according to the second direction of movement of each piece of furniture and the moving step length.
Optionally, the determining the second direction of movement of each piece of furniture by the third probability value of movement in different directions when the pieces of furniture move cooperatively and the fourth probability value of movement of each piece of furniture in different directions includes:
for any one piece of furniture, calculating the product of the fourth probability of the piece of furniture in each direction and the third probability value of the plurality of pieces of furniture in the corresponding direction when the pieces of furniture move cooperatively;
and taking the direction corresponding to the maximum product value as a second target direction.
Optionally, the method further includes:
replacing second furniture, determining the movement information of the second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and the information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the state information of the first room; the second piece of furniture is any one or more pieces of furniture other than the first piece of furniture.
The embodiment of the invention discloses a device for automatic interactive layout of three-dimensional furniture, which comprises:
the generating unit is used for generating a three-dimensional simulation environment through a two-dimensional furniture design drawing; the three-dimensional simulation environment comprises: the house size of each room, the three-dimensional outline of each furniture and the position relationship of each furniture and the room;
the determining subunit is used for determining an initial layout state of the room according to the three-dimensional simulation environment;
the first mobile unit is used for responding to an adjustment instruction of first furniture, determining the mobile information of second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and the information of the second furniture, and moving the second furniture according to the mobile information of the second furniture to obtain the state information of the first room; the second furniture is any one or more than one furniture except the first furniture;
and the second moving unit is used for determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain the layout information of the second room.
Optionally, the generating unit includes:
the first identification subunit is used for identifying each furniture element and attribute information of each furniture element from the two-dimensional furniture design drawing;
the generating subunit is used for generating a three-dimensional outline of each furniture element according to the attribute information of each furniture element in the two-dimensional furniture design drawing;
the processing subunit is used for processing the two-dimensional furniture design drawing through a pre-trained semantic recognition model to obtain a civil engineering language intention;
the second identification subunit is used for identifying key points of each civil engineering element from the civil engineering language intention and constructing the outline of each civil engineering element according to the key points of each civil engineering element;
the calculation subunit is used for calculating the house size of each room through the outline of each civil engineering element;
and the determining subunit is used for determining the position relationship of each piece of furniture and each room based on the house size of each room and the three-dimensional contour of each piece of furniture.
The embodiment of the invention discloses an electronic device, which comprises:
a memory and a processor;
the memory is used for storing programs, and the processor is used for executing the method for the automatic interactive layout of the three-dimensional furniture when the programs in the memory are executed.
The embodiment of the invention discloses a method and a device for automatic interactive layout of three-dimensional furniture and electronic equipment, wherein the method comprises the following steps: responding to an adjustment instruction of first furniture, determining movement information of second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain state information of the first room; the second furniture is any one or more than one furniture except the first furniture; and determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information, wherein the initial layout state of the room is determined according to a three-dimensional simulation environment, and the three-dimensional simulation environment is determined through a two-dimensional furniture design drawing. Therefore, when the furniture needs to be moved or replaced, the furniture which is not selected by the user is adjusted at first, and then all the furniture is adjusted, so that when the user needs to adjust a certain furniture, a new furniture layout can be directly generated, and the efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a flow chart illustrating a method for automatic interactive layout of three-dimensional furniture according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of an automatic interaction layout device for three-dimensional furniture according to an embodiment of the present invention;
fig. 3 shows a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the prior art, if the layout of the furniture in the design drawing needs to be adjusted or the furniture needs to be replaced, a user needs to communicate with a designer under normal conditions, and the designer modifies the scheme.
In order to improve efficiency, the embodiment of the invention discloses a three-dimensional furniture automatic interaction layout method, which is characterized in that a three-dimensional simulation environment is generated based on a two-dimensional furniture design drawing, wherein the three-dimensional simulation environment comprises the house size of each room, the three-dimensional outline of each furniture and the position relation between each furniture and the room, the initial layout state of the room is determined according to the three-dimensional simulation environment, then the layout of the furniture is adjusted through two levels, firstly, the movement information of a first furniture (the furniture which is not selected by a user to be adjusted) is determined through a preset first layout network, and a second furniture is moved according to the movement information of the second furniture to obtain the state information of the first room; and then, determining the movement information of the plurality of pieces of furniture through a preset second layout network, thereby obtaining second furniture layout information. Therefore, when a user needs to adjust certain furniture, the design scheme after the furniture is adjusted can be directly generated, and the efficiency is improved.
And the furniture can be adjusted according to the requirements of the user, and various different layout schemes can be generated for the user to select.
The technical scheme is described in detail as follows:
example 1
Referring to fig. 1, a flow chart of a method for automatic interactive layout of three-dimensional furniture according to an embodiment of the present invention is shown, in this embodiment, the method includes:
s101: generating a three-dimensional simulation environment through a two-dimensional furniture design drawing; the three-dimensional simulation environment comprises: the house size of each room, the three-dimensional outline of each furniture and the position relationship of each furniture and the room;
in this embodiment, the two-dimensional furniture design drawing may be designed in any manner, for example, may be a CAD drawing, where the two-dimensional furniture drawing includes each element of the soft and hard clothing and attribute information of each element (the attribute information includes at least a size and a category).
The generated three-dimensional simulation environment includes the house size of each room and the three-dimensional contour of each furniture, optionally, the three-dimensional simulation environment can be obtained by identifying the two-dimensional furniture design drawing and calculating each identified information, and optionally, S101 includes:
identifying each furniture element and attribute information of each furniture element from the two-dimensional furniture design drawing;
generating a three-dimensional outline of each furniture element according to the attribute information of each furniture element in the two-dimensional furniture design drawing;
processing a two-dimensional furniture design drawing through a pre-trained semantic recognition model to obtain a civil engineering language intention;
identifying key points of each civil engineering element from the civil engineering language intention, and constructing a contour of each civil engineering element according to the key points of each civil engineering element;
calculating the house size of each room through the outline of each civil engineering element;
and determining the position relation of each furniture and each room based on the house size of each room and the three-dimensional outline of each furniture.
In this embodiment, each furniture element and attribute information of each furniture element may be identified from the two-dimensional design drawing in various ways, for example, each furniture element and attribute information of each furniture element may be identified from the two-dimensional design drawing through a SSD (Single Shot Multi-Box Detector) model or a fasternn model.
The attribute information of each element includes at least: the size and the category of the individual furniture elements, wherein the categories represent different furniture categories, such as parlor sofas, bedroom beds, etc.
In this embodiment, the civil semantic graph includes a structure hardbound for a room, for example, including: walls, doors, windows, roofs, floors, etc. And, the semantic recognition model may be any convolutional neural network model or other machine learning model, and optionally, the semantic recognition model may include: an encoder and a decoder, wherein the encoder comprises: a 4-layer CNN (convolutional) layer, and the parameters of the encoder include, for example: 160 x 128,80 x 256,40 x 512,20 x 512, wherein the two-dimensional image can be encoded into 10 x 512 vectors by the encoder; the decoder comprises two CNN (convolutional) layer configurations, the parameters respectively comprising: 20 x 512,40 x 256, where the vector can be decoded by a decoder into 128 x 3.
In this embodiment, the key point of each civil element may be represented as an inflection point of each civil element, and the contour of each civil element may be constructed by the inflection point of each civil element. Wherein the outline of each civil element represents the composition and size of each civil element.
In this embodiment, the house size of each room is calculated by the contour of each civil engineering element, where the house size of each room includes: the length, width, height, etc. of each room.
S102: determining an initial layout state of a room according to the three-dimensional simulation environment;
in this embodiment, as can be seen from the above description, the three-dimensional simulation environment includes: the house size of each room, the three-dimensional profile of each furniture, and the positional relationship of each furniture and room, which information may represent the initial layout state of the room.
S103: responding to an adjustment instruction of first furniture, determining movement information of second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain state information of the first room; the second furniture is any one or more than one furniture except the first furniture;
in this embodiment, the adjustment command of the first furniture may be user-triggered, wherein the adjustment command may be a replacement of the position of the first furniture or a replacement of the first furniture.
In this embodiment, the first layout network is obtained through pre-training, and the trained first layout network has a capability of adjusting a layout of furniture, specifically, the first layout network can adjust, when a user replaces a certain furniture in a room, other furniture than the furniture that needs to be replaced, optionally, S102 includes:
if the currently obtained first room state information and the first room state information obtained by moving the furniture last time are changed, taking the currently obtained first room state information as the current room state information, and executing the following steps:
determining a first probability value of the first furniture and the second furniture moving in different directions when moving simultaneously based on a preset first furniture cooperative intelligent agent network and current room state information; the current room state and the initial room state in the initial state;
determining the probability of the second furniture moving in different directions according to a preset first furniture cooperative intelligent network and the current room state;
determining a first target direction and a moving step length of the second furniture to be moved according to the second probability of moving in different directions and the first probability of moving in different directions;
and moving the second furniture according to the moving step length of the second furniture in the first target direction to obtain the state information of the first room.
In this embodiment, the first furniture cooperative intelligent network may be pre-trained, and the first furniture cooperative intelligent network may be trained by using the room state information as a training sample, so that the first furniture cooperative intelligent network has a probability of outputting movement in different directions when different furniture cooperatively moves.
For example, the following steps are carried out: the directions in which the pieces of furniture move cooperatively include, for example: up, down, left, right, forward and backward, the probability in each direction when different furniture moves cooperatively can be predicted by the first furniture agent network.
The first furniture cooperative intelligent agent network may be any convolutional neural network or any machine learning model, and optionally, the first furniture cooperative intelligent agent network includes:
three convolutional layers and two fully connected layers, wherein the parameters of the three convolutional layers include, for example: (512*512*512*64,256*256*256*128,128*128*128*256.
In this embodiment, the first furniture mobile intelligent network may be obtained by pre-training, the training samples are room state information and information of the selected furniture to be replaced, and the trained second furniture mobile intelligent network has a probability of predicting that the user does not select the furniture (the second furniture) to move in different directions.
The first furniture mobile intelligent network may be any convolutional neural network or any machine learning model, and optionally, the first furniture mobile intelligent network includes:
three convolutional layers and two fully connected layers, wherein the parameters of the three convolutional layers include, for example: (512*512*512*64,256*256*256*128,128*128*128*256.
In this embodiment, determining the first target direction of movement of each second furniture by using the first probability that the first furniture and the second furniture cooperatively move in different directions and the probability that the second furniture not selected by the user moves in different directions, optionally, selecting the direction with the largest probability value as the first target direction of movement of the second furniture, includes:
calculating a product value of a second probability value of the movement of the second furniture in each direction and the first probability value in the direction;
and taking the direction corresponding to the maximum product value as a first target direction.
In this embodiment, when a certain furniture needs to be moved, for example, when a bed or a moving bed needs to be replaced, a head cabinet of the moving bed may be required, or a cabinet of the moving bed may be required, and then, in the case of moving different furniture, different furniture layout diagrams may be obtained, and then, in order to give more choices to a user, different drawings of different furniture may be obtained by selecting different second furniture, specifically, the method further includes:
replacing second furniture, determining the movement information of the second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and the information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the state information of the first room; the second piece of furniture is any one or more pieces of furniture other than the first piece of furniture.
In this embodiment, the step length of the movement in the first target direction may be preset or may be actually calculated.
S104: and determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information.
In this embodiment, after a certain piece of furniture moves, the layout of a plurality of pieces of furniture in a room may be affected, and therefore, in order to achieve the overall layout of the room, the moving adjustment of the plurality of pieces of furniture is required, specifically, S104 includes:
if the currently obtained second room state is different from the second room state obtained by the last furniture movement, representing the currently obtained second room state as the current room state, and executing the following steps:
determining third probability values of movement of the plurality of pieces of furniture in different directions when the plurality of pieces of furniture move cooperatively according to the current room state and a preset second furniture cooperative intelligent network;
determining fourth probability values of movement of each piece of furniture in different directions according to the current room state and a preset second furniture mobile intelligent network;
determining a second direction of movement of each piece of furniture and a second movement step size through a third probability value of movement in different directions when the plurality of pieces of furniture move cooperatively and a fourth probability value of movement of each piece of furniture in different directions;
and moving each piece of furniture according to the second direction of movement of each piece of furniture and the moving step length.
In this embodiment, the second furniture cooperative intelligent network is obtained by pre-training, and the second furniture cooperative intelligent network is trained by using the current room state as a training sample, so that the trained second furniture intelligent network has a third probability value of outputting a plurality of furniture cooperative movements while moving in different directions.
The second furniture cooperative intelligent network can be any convolutional neural network or any network of machine learning models.
For example, the following steps are carried out: the second furniture collaboration smart agent network may be composed of 3 convolutional layers and two layers of all-connected Cen, wherein the parameters of the 3 convolutional layers may include:
512*512*512x64,256*256*256*128,128*128*128*256。
in this embodiment, the second furniture mobile intelligent agent network may be any convolutional neural network or any machine learning model, and optionally, the second furniture mobile intelligent agent network includes: three convolutional layers and two fully connected layers, for example, the parameters of a three convolutional layer may include:
512*512*512*64,256*256*256*128,128*128*128*256。
in this embodiment, the determining, by the probabilities of moving in different directions when the plurality of pieces of furniture move cooperatively and the probabilities of moving in different directions of each piece of furniture, the second direction in which each piece of furniture moves and the second moving step length specifically include:
for any one piece of furniture, calculating the product of the fourth probability of the piece of furniture in each direction and the third probability value of the plurality of pieces of furniture in the corresponding direction when the pieces of furniture move cooperatively;
and taking the direction corresponding to the maximum product value as a second target direction.
In this embodiment, it can be known from the above description that, in order to give more choices to the user, different furniture layout diagrams can be obtained by selecting different second furniture, that is, different first room status information can be obtained, and then, in the case of different first room status information, different second room layout information can be finally obtained through the step of S104, so that different design solutions can be obtained.
Example 2:
referring to fig. 2, a schematic structural diagram of an automatic interaction layout apparatus for three-dimensional furniture according to an embodiment of the present invention is shown, in this embodiment, the apparatus includes:
a generating unit 201, configured to generate a three-dimensional simulation environment through a two-dimensional furniture design drawing; the three-dimensional simulation environment comprises: the house size of each room, the three-dimensional outline of each furniture and the position relationship of each furniture and the room;
a determining subunit 202, configured to determine an initial layout state of the room according to the three-dimensional simulation environment;
the first moving unit 203 is configured to, in response to an adjustment instruction of the first furniture, determine movement information of the second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network, and information of the second furniture, and move the second furniture according to the movement information of the second furniture to obtain first room state information; the second furniture is any one or more than one furniture except the first furniture;
the second moving unit 204 is configured to determine movement information of the plurality of pieces of furniture based on the first room status information and a preset second layout network, and move the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain layout information of a second room.
Optionally, the generating unit includes:
the first identification subunit is used for identifying each furniture element and attribute information of each furniture element from the two-dimensional furniture design drawing;
the generating subunit is used for generating a three-dimensional outline of each furniture element according to the attribute information of each furniture element in the two-dimensional furniture design drawing;
the processing subunit is used for processing the two-dimensional furniture design drawing through a pre-trained semantic recognition model to obtain a civil engineering language intention;
the second identification subunit is used for identifying key points of each civil engineering element from the civil engineering language intention and constructing the outline of each civil engineering element according to the key points of each civil engineering element;
the first calculation subunit is used for calculating the house size of each room through the outline of each civil engineering element;
and the determining subunit is used for determining the position relationship of each piece of furniture and each room based on the house size of each room and the three-dimensional contour of each piece of furniture.
Optionally, the first mobile unit includes:
a first detecting subunit, configured to, if the currently obtained first room state information and the first room state information obtained by moving the furniture last time change, take the currently obtained first room state information as current room state information, and execute the following steps:
a first determining subunit, configured to determine, based on a preset first furniture cooperative agent network and current room status information, first probability values of movement in different directions when the first furniture and the second furniture move simultaneously; the current room state and the initial room state in the initial state;
the second determining subunit is used for determining the probability of the second furniture moving in different directions according to the preset first furniture cooperative intelligent agent network and the current room state;
the third determining subunit is used for determining a first target direction and a moving step length of the second furniture to be moved according to the second probability of moving in different directions and the first probability of moving in different directions;
and the first moving subunit is used for moving the second furniture according to the moving step length of the second furniture in the first target direction to obtain the first room state information.
Optionally, the third determining subunit includes:
a second calculating subunit for calculating a product value of a second probability value of the movement of the second furniture in each direction and the first probability value in the direction;
and the fourth determining subunit is used for taking the direction corresponding to the maximum product value as the first target direction.
Optionally, the second mobile unit includes:
a second detecting subunit, configured to, if the currently obtained second room state is different from the second room state obtained by the previous movement of the furniture, represent the currently obtained second room state as the current room state, and perform the following steps:
the fifth determining subunit is used for determining third probability values of the plurality of pieces of furniture moving in different directions in a cooperative movement mode according to the current room state and a preset second furniture cooperative intelligent agent network;
a sixth determining subunit, configured to determine, according to the current room state and a preset second furniture mobile intelligent agent network, fourth probability values that each piece of furniture of the plurality of pieces of furniture moves in different directions;
a seventh determining subunit, configured to determine a second direction in which each piece of furniture moves and a second movement step size by using a third probability value of movement in different directions when the pieces of furniture move cooperatively and a fourth probability value of movement in different directions of each piece of furniture;
and the second moving subunit is used for moving each piece of furniture according to the second direction of movement of each piece of furniture and the movement step length.
Optionally, the seventh determining subunit is configured to:
a third calculating subunit, configured to calculate, for any one of the pieces of furniture, a product of a fourth probability of the piece of furniture in each direction and a third probability value of the piece of furniture in the corresponding direction when the pieces of furniture move cooperatively;
and the eighth determining subunit is configured to use the direction corresponding to the maximum product value as the second target direction.
Optionally, the method further includes:
replacing second furniture, determining the movement information of the second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and the information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the state information of the first room; the second piece of furniture is any one or more pieces of furniture other than the first piece of furniture.
The device of the embodiment, in response to an adjustment instruction of a first furniture, determines movement information of a second furniture according to an initial layout state of a room, first furniture information, a preset first layout network and information of the second furniture, and moves the second furniture according to the movement information of the second furniture to obtain state information of the first room; the second furniture is any one or more than one furniture except the first furniture; and determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information, wherein the initial layout state of the room is determined according to a three-dimensional simulation environment, and the three-dimensional simulation environment is determined through a two-dimensional furniture design drawing. Therefore, when the furniture needs to be moved or replaced, the furniture which is not selected by the user is adjusted at first, and then all the furniture is adjusted, so that a new furniture layout can be directly generated under the condition that the furniture is adjusted, and the efficiency is improved.
Example 3:
referring to fig. 3, a schematic structural diagram of an electronic device according to an embodiment of the present invention is shown, where in this embodiment, the electronic device includes:
a memory 301 and a processor 302;
the memory 301 is used for storing programs, and the processor 302 is used for executing the following method for automatic interactive layout of three-dimensional furniture when the programs in the memory are executed:
generating a three-dimensional simulation environment through a two-dimensional furniture design drawing; the three-dimensional simulation environment comprises: the house size of each room, the three-dimensional outline of each furniture and the position relationship of each furniture and the room;
determining an initial layout state of a room according to the three-dimensional simulation environment;
responding to an adjustment instruction of first furniture, determining movement information of second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain state information of the first room; the second furniture is any one or more than one furniture except the first furniture;
and determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information.
Optionally, the generating a three-dimensional simulation environment through a two-dimensional furniture design drawing includes:
identifying each furniture element and attribute information of each furniture element from the two-dimensional furniture design drawing;
generating a three-dimensional outline of each furniture element according to the attribute information of each furniture element in the two-dimensional furniture design drawing;
processing a two-dimensional furniture design drawing through a pre-trained semantic recognition model to obtain a civil engineering language intention;
identifying key points of each civil engineering element from the civil engineering language intention, and constructing a contour of each civil engineering element according to the key points of each civil engineering element;
calculating the house size of each room through the outline of each civil engineering element;
and determining the position relation of each furniture and each room based on the house size of each room and the three-dimensional outline of each furniture.
Optionally, the determining, according to the initial layout state of the room, the first furniture information, the preset first layout network, and the information of the second furniture, the movement information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the state information of the first room includes:
if the currently obtained first room state information and the first room state information obtained by moving the furniture last time are changed, taking the currently obtained first room state information as the current room state information, and executing the following steps:
determining a first probability value of the first furniture and the second furniture moving in different directions when moving simultaneously based on a preset first furniture cooperative intelligent agent network and current room state information; the current room state and the initial room state in the initial state;
determining the probability of the second furniture moving in different directions according to a preset first furniture cooperative intelligent network and the current room state;
determining a first target direction and a moving step length of the second furniture to be moved according to the second probability of moving in different directions and the first probability of moving in different directions;
and moving the second furniture according to the moving step length of the second furniture in the first target direction to obtain the state information of the first room.
Optionally, the determining a first target direction and a moving step length that the second furniture needs to be moved according to the second probability of moving in different directions and the first probability of moving in different directions includes:
calculating a product value of a second probability value of the movement of the second furniture in each direction and the first probability value in the direction;
and taking the direction corresponding to the maximum product value as a first target direction.
Optionally, the determining, based on the first room state information and a preset second layout network, movement information of a plurality of pieces of furniture, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information includes:
if the currently obtained second room state is different from the second room state obtained by the last furniture movement, representing the currently obtained second room state as the current room state, and executing the following steps:
determining third probability values of movement of the plurality of pieces of furniture in different directions when the plurality of pieces of furniture move cooperatively according to the current room state and a preset second furniture cooperative intelligent network;
determining fourth probability values of movement of each piece of furniture in different directions according to the current room state and a preset second furniture mobile intelligent network;
determining a second direction of movement of each piece of furniture and a second movement step size through a third probability value of movement in different directions when the plurality of pieces of furniture move cooperatively and a fourth probability value of movement of each piece of furniture in different directions;
and moving each piece of furniture according to the second direction of movement of each piece of furniture and the moving step length.
Optionally, the determining the second direction of movement of each of the plurality of pieces of furniture by the third probability value of movement in different directions when the plurality of pieces of furniture move cooperatively and the fourth probability value of movement of each of the plurality of pieces of furniture in different directions includes:
for any one piece of furniture, calculating the product of the fourth probability of the piece of furniture in each direction and the third probability value of the plurality of pieces of furniture in the corresponding direction when the pieces of furniture move cooperatively;
and taking the direction corresponding to the maximum product value as a second target direction.
Optionally, the method further includes:
replacing second furniture, determining the movement information of the second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and the information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the state information of the first room; the second piece of furniture is any one or more pieces of furniture other than the first piece of furniture.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for automatic interactive layout of three-dimensional furniture is characterized by comprising the following steps:
generating a three-dimensional simulation environment through a two-dimensional furniture design drawing; the three-dimensional simulation environment comprises: the house size of each room, the three-dimensional outline of each furniture and the position relationship of each furniture and the room;
determining an initial layout state of a room according to the three-dimensional simulation environment;
responding to an adjustment instruction of first furniture, determining movement information of second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain state information of the first room; the second furniture is any one or more than one furniture except the first furniture;
and determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information.
2. The method of claim 1, wherein generating a three-dimensional simulation environment from a two-dimensional furniture design drawing comprises:
identifying each furniture element and attribute information of each furniture element from the two-dimensional furniture design drawing;
generating a three-dimensional outline of each furniture element according to the attribute information of each furniture element in the two-dimensional furniture design drawing;
processing a two-dimensional furniture design drawing through a pre-trained semantic recognition model to obtain a civil engineering language intention;
identifying key points of each civil engineering element from the civil engineering language intention, and constructing a contour of each civil engineering element according to the key points of each civil engineering element;
calculating the house size of each room through the outline of each civil engineering element;
and determining the position relation of each furniture and each room based on the house size of each room and the three-dimensional outline of each furniture.
3. The method of claim 1, wherein the determining movement information of the second furniture according to the initial layout state of the room, the first furniture information, the preset first layout network and the information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the first room state information comprises:
if the currently obtained first room state information and the first room state information obtained by moving the furniture last time are changed, taking the currently obtained first room state information as the current room state information, and executing the following steps:
determining a first probability value of the first furniture and the second furniture moving in different directions when moving simultaneously based on a preset first furniture cooperative intelligent agent network and current room state information; the current room state and the initial room state in the initial state;
determining the probability of the second furniture moving in different directions according to a preset first furniture cooperative intelligent network and the current room state;
determining a first target direction and a moving step length of the second furniture to be moved according to the second probability of moving in different directions and the first probability of moving in different directions;
and moving the second furniture according to the moving step length of the second furniture in the first target direction to obtain the state information of the first room.
4. The method of claim 3, wherein determining a first target direction and a step size of movement for the second furniture item to move based on the second probability of moving in a different direction and the first probability of moving in a different direction comprises:
calculating a product value of a second probability value of the movement of the second furniture in each direction and the first probability value in the direction;
and taking the direction corresponding to the maximum product value as a first target direction.
5. The method of claim 1, wherein the determining movement information of a plurality of pieces of furniture based on the first room status information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain second room layout information comprises:
if the currently obtained second room state is different from the second room state obtained by the last furniture movement, representing the currently obtained second room state as the current room state, and executing the following steps:
determining third probability values of movement of the plurality of pieces of furniture in different directions when the plurality of pieces of furniture move cooperatively according to the current room state and a preset second furniture cooperative intelligent network;
determining a fourth probability value of movement of each piece of furniture in the plurality of pieces of furniture in different directions according to the current room state and a preset second furniture mobile intelligent network;
determining a second direction of movement of each piece of furniture and a second movement step size by a third probability value of movement in different directions when the plurality of pieces of furniture move cooperatively and a fourth probability value of movement of each piece of furniture in different directions;
and moving each piece of furniture according to the second direction of movement of each piece of furniture and the moving step length.
6. The method of claim 5, wherein determining the second direction of movement for each of the plurality of furniture items by a third probability value for movement in a different direction when the plurality of furniture items are moved in concert and a fourth probability value for movement in a different direction for each of the plurality of furniture items comprises:
for any one piece of furniture, calculating the product of the fourth probability of the piece of furniture in each direction and the third probability value of the plurality of pieces of furniture in the corresponding direction when the pieces of furniture move cooperatively;
and taking the direction corresponding to the maximum product value as a second target direction.
7. The method of claim 1, further comprising:
replacing second furniture, determining the movement information of the second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and the information of the second furniture, and moving the second furniture according to the movement information of the second furniture to obtain the state information of the first room; the second piece of furniture is any one or more pieces of furniture other than the first piece of furniture.
8. An apparatus for automatic interactive layout of three-dimensional furniture, comprising:
the generating unit is used for generating a three-dimensional simulation environment through a two-dimensional furniture design drawing; the three-dimensional simulation environment comprises: the house size of each room, the three-dimensional outline of each furniture and the position relationship of each furniture and the room;
the determining subunit is used for determining an initial layout state of the room according to the three-dimensional simulation environment;
the first mobile unit is used for responding to an adjustment instruction of first furniture, determining the mobile information of second furniture according to the initial layout state of the room, the first furniture information, a preset first layout network and the information of the second furniture, and moving the second furniture according to the mobile information of the second furniture to obtain the state information of the first room; the second furniture is any one or more than one furniture except the first furniture;
and the second moving unit is used for determining the movement information of the plurality of pieces of furniture based on the first room state information and a preset second layout network, and moving the plurality of pieces of furniture according to the movement information of the plurality of pieces of furniture to obtain the layout information of the second room.
9. The apparatus of claim 8, wherein the generating unit comprises:
the first identification subunit is used for identifying each furniture element and attribute information of each furniture element from the two-dimensional furniture design drawing;
the generating subunit is used for generating a three-dimensional outline of each furniture element according to the attribute information of each furniture element in the two-dimensional furniture design drawing;
the processing subunit is used for processing the two-dimensional furniture design drawing through a pre-trained semantic recognition model to obtain a civil engineering language intention;
the second identification subunit is used for identifying key points of each civil engineering element from the civil engineering language intention and constructing the outline of each civil engineering element according to the key points of each civil engineering element;
the calculation subunit is used for calculating the house size of each room through the outline of each civil engineering element;
and the determining subunit is used for determining the position relationship of each piece of furniture and each room based on the house size of each room and the three-dimensional contour of each piece of furniture.
10. An electronic device, comprising:
a memory and a processor;
the memory is used for storing programs, and the processor is used for executing the method for automatically interacting layout of three-dimensional furniture as claimed in claims 1-7 when the programs of the memory are executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111108052.7A CN113792358B (en) | 2021-09-22 | 2021-09-22 | Automatic interactive layout method and device for three-dimensional furniture and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111108052.7A CN113792358B (en) | 2021-09-22 | 2021-09-22 | Automatic interactive layout method and device for three-dimensional furniture and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113792358A true CN113792358A (en) | 2021-12-14 |
| CN113792358B CN113792358B (en) | 2024-06-04 |
Family
ID=78879064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111108052.7A Active CN113792358B (en) | 2021-09-22 | 2021-09-22 | Automatic interactive layout method and device for three-dimensional furniture and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113792358B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004195217A (en) * | 2002-12-04 | 2004-07-15 | Matsushita Electric Ind Co Ltd | Automatic arrangement device of furniture |
| CN109670262A (en) * | 2018-12-28 | 2019-04-23 | 江苏艾佳家居用品有限公司 | A kind of area of computer aided domestic layout optimization method and system |
| CN109740243A (en) * | 2018-12-29 | 2019-05-10 | 江苏艾佳家居用品有限公司 | A kind of furniture layout method and system based on bulk-breaking intensified learning technology |
| CN110751721A (en) * | 2019-12-24 | 2020-02-04 | 广东博智林机器人有限公司 | Furniture layout drawing generation method and device, computer equipment and storage medium |
| US20200082633A1 (en) * | 2018-09-11 | 2020-03-12 | Shay Rom | Virtual item placement system |
| CN111177826A (en) * | 2019-12-12 | 2020-05-19 | 江苏艾佳家居用品有限公司 | Indoor home automatic layout method based on deep convolutional network |
| CN113221225A (en) * | 2021-05-27 | 2021-08-06 | 北京有竹居网络技术有限公司 | Article layout method, article layout device, storage medium and electronic equipment |
| JP6932821B1 (en) * | 2020-07-03 | 2021-09-08 | 株式会社ベガコーポレーション | Information processing systems, methods and programs |
-
2021
- 2021-09-22 CN CN202111108052.7A patent/CN113792358B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004195217A (en) * | 2002-12-04 | 2004-07-15 | Matsushita Electric Ind Co Ltd | Automatic arrangement device of furniture |
| US20200082633A1 (en) * | 2018-09-11 | 2020-03-12 | Shay Rom | Virtual item placement system |
| CN109670262A (en) * | 2018-12-28 | 2019-04-23 | 江苏艾佳家居用品有限公司 | A kind of area of computer aided domestic layout optimization method and system |
| CN109740243A (en) * | 2018-12-29 | 2019-05-10 | 江苏艾佳家居用品有限公司 | A kind of furniture layout method and system based on bulk-breaking intensified learning technology |
| CN111177826A (en) * | 2019-12-12 | 2020-05-19 | 江苏艾佳家居用品有限公司 | Indoor home automatic layout method based on deep convolutional network |
| CN110751721A (en) * | 2019-12-24 | 2020-02-04 | 广东博智林机器人有限公司 | Furniture layout drawing generation method and device, computer equipment and storage medium |
| JP6932821B1 (en) * | 2020-07-03 | 2021-09-08 | 株式会社ベガコーポレーション | Information processing systems, methods and programs |
| CN113221225A (en) * | 2021-05-27 | 2021-08-06 | 北京有竹居网络技术有限公司 | Article layout method, article layout device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113792358B (en) | 2024-06-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6522060B2 (en) | Object recognition device, classification tree learning device and operation method thereof | |
| CN111260764B (en) | Method, device and storage medium for making animation | |
| CN100435173C (en) | Apparatus for controlling a virtual environment | |
| CN103544496B (en) | The robot scene recognition methods merged with temporal information based on space | |
| CN111709061B (en) | Automatic indoor article placement processing method, device and equipment and storage medium | |
| KR101718837B1 (en) | A method, a device, and an electronic equipment for controlling an Application Program | |
| CN111914552A (en) | Training method and device of data enhancement model | |
| CN112720453A (en) | Method and apparatus for training manipulation skills of a robotic system | |
| CN111507219A (en) | Action recognition method and device, electronic equipment and storage medium | |
| Thabet et al. | Sample-efficient deep reinforcement learning with imaginary rollouts for human-robot interaction | |
| CN115115846A (en) | Automatic generation method and device of house type layout, computer equipment and storage medium | |
| CN108229640B (en) | Emotion expression method and device and robot | |
| KR100809659B1 (en) | System and method for offering intelligent home service | |
| CN117132864B (en) | Multi-mode input digital character generation method, device, equipment and storage medium | |
| CN113792358B (en) | Automatic interactive layout method and device for three-dimensional furniture and electronic equipment | |
| CN107256434B (en) | Automatic household layout method | |
| CN115617429A (en) | Data processing method and related equipment | |
| Di et al. | Multi-agent reinforcement learning of 3d furniture layout simulation in indoor graphics scenes | |
| JP2018194932A (en) | Control apparatus, control program, learning data creation method, and learning method | |
| CN116485962A (en) | Animation generation method and system based on contrast learning | |
| CN112648997A (en) | Method and system for positioning based on multitask network model | |
| CN116977503A (en) | Track information processing method, track information processing device, computer equipment and readable storage medium | |
| CN114065353A (en) | Indoor arrangement method and device, electronic equipment and storage medium | |
| CN111046467B (en) | House type parametric modeling method and related equipment | |
| Cui et al. | Master of puppets: an animation-by-demonstration computer puppetry authoring framework |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |