CN109816768B - Indoor reconstruction method, device, equipment and medium - Google Patents
Indoor reconstruction method, device, equipment and medium Download PDFInfo
- Publication number
- CN109816768B CN109816768B CN201711163966.7A CN201711163966A CN109816768B CN 109816768 B CN109816768 B CN 109816768B CN 201711163966 A CN201711163966 A CN 201711163966A CN 109816768 B CN109816768 B CN 109816768B
- Authority
- CN
- China
- Prior art keywords
- dimensional
- model
- house
- reconstruction
- panoramic image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000005034 decoration Methods 0.000 claims abstract description 104
- 238000009877 rendering Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 4
- 230000007613 environmental effect Effects 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 6
- 239000000463 material Substances 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 239000004566 building material Substances 0.000 description 4
- 239000003086 colorant Substances 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention discloses an indoor reconstruction method, an indoor reconstruction device, indoor reconstruction equipment and an indoor reconstruction medium, and relates to a three-dimensional reconstruction technology. The method comprises the following steps: acquiring an acquired panoramic image, depth data and an acquisition position of indoor decoration; and carrying out three-dimensional reconstruction on the three-dimensional space of the house where the interior decoration is positioned according to the panoramic image, the depth data and the acquisition position, and generating a three-dimensional house model. The embodiment of the invention provides an indoor reconstruction method, an indoor reconstruction device, indoor reconstruction equipment and an indoor reconstruction medium, which realize three-dimensional reconstruction of indoor decoration.
Description
Technical Field
The embodiment of the invention relates to a three-dimensional reconstruction technology, in particular to an indoor reconstruction method, an indoor reconstruction device, an indoor reconstruction equipment and an indoor reconstruction medium.
Background
Currently, many real estate developers provide simple decoration for houses developed by the developers, and users carry out fine decoration according to requirements after housing exchange.
The inventors have found that the following problems exist in the prior art in the process of implementing the present invention: in the home decoration process, users often need to repeatedly run between houses and building material markets to confirm whether the material textures and styles of purchased decorations, furniture, electric appliances and the like are unified with the styles of finished simple parts.
Disclosure of Invention
The embodiment of the invention provides an indoor reconstruction method, an indoor reconstruction device, indoor reconstruction equipment and an indoor reconstruction medium, so as to realize three-dimensional reconstruction of indoor decoration.
In a first aspect, an embodiment of the present invention provides an indoor reconstruction method, including:
acquiring an acquired panoramic image, depth data and an acquisition position of indoor decoration;
And carrying out three-dimensional reconstruction on the three-dimensional space of the house where the interior decoration is located according to the panoramic image, the depth data and the acquisition position, and generating a three-dimensional house model.
Further, according to the panoramic image, the depth data and the acquisition position, performing three-dimensional reconstruction on a three-dimensional space of a house where the interior decoration is located, and generating a three-dimensional house model includes:
performing three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
determining the spatial position of the three-dimensional environment model according to the acquisition position;
and setting the three-dimensional environment model at the space position to generate a three-dimensional house model.
Further, according to the panoramic image, the depth data and the acquisition position, performing three-dimensional reconstruction on a three-dimensional space of a house where the interior decoration is located, and generating a three-dimensional house model includes:
performing three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
determining the position of the three-dimensional environment model in a three-dimensional house type model according to the acquisition position, wherein the three-dimensional house type model is a three-dimensional model of the structure and the shape of a house where the interior decoration is located;
and combining the three-dimensional environment model with the three-dimensional house model according to the position to generate a three-dimensional house model.
Further, according to the position, combining the three-dimensional environment model with the three-dimensional house model to generate a three-dimensional house model, including:
According to a preset initial acquisition direction when the panoramic image is acquired, carrying out relative position calibration on the three-dimensional environment model and the part of the position in the three-dimensional house type model;
and after calibration, combining the three-dimensional environment model with the three-dimensional house model to generate a three-dimensional house model.
Further, before determining the position of the three-dimensional environment model in the three-dimensional house type model according to the acquisition position, the three-dimensional house type model is a three-dimensional model of the structure and the shape of the house where the interior decoration is located, the method further comprises:
and carrying out three-dimensional reconstruction on the structure and the shape of the house where the interior decoration is located according to the house type graph, and generating a three-dimensional house type model.
Further, three-dimensional reconstruction is performed on the structure and the shape of the house where the interior decoration is located according to the house type graph, and the generation of the three-dimensional house type model comprises the following steps:
identifying walls, doors and windows in the house type graph;
and carrying out three-dimensional reconstruction according to the identification result to generate a three-dimensional house type model.
Further, after three-dimensional reconstruction is performed on the three-dimensional space of the house where the interior decoration is located according to the panoramic image, the depth data and the acquisition position, the method further comprises the steps of:
acquiring a decoration article three-dimensional model selected by a user and a placement position;
And adding the selected three-dimensional model into the three-dimensional house model according to the placement position, and rendering the three-dimensional house model.
Further, before the pre-stored three-dimensional model and the placement position selected by the user are obtained, the method further comprises:
And carrying out three-dimensional reconstruction on the decoration articles to generate a pre-stored three-dimensional model.
In a second aspect, an embodiment of the present invention further provides an indoor reconstruction apparatus, including:
the acquisition module is used for acquiring the acquired panoramic image, depth data and acquisition position of the interior decoration;
And the three-dimensional reconstruction module is used for carrying out three-dimensional reconstruction on the three-dimensional space of the house where the interior decoration is positioned according to the panoramic image, the depth data and the acquisition position, and generating a three-dimensional house model.
Further, the three-dimensional reconstruction module includes:
The three-dimensional reconstruction unit is used for carrying out three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
the position determining unit is used for determining the space position of the three-dimensional environment model according to the acquisition position;
And the model generating unit is used for setting the three-dimensional environment model at the space position and generating a three-dimensional house model.
Further, the three-dimensional reconstruction module includes:
the environment reconstruction unit is used for carrying out three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
The relative position determining unit is used for determining the position of the three-dimensional environment model in a three-dimensional house type model according to the acquisition position, wherein the three-dimensional house type model is a three-dimensional model of the structure and the shape of a house where the interior decoration is located;
And the house model generating unit is used for combining the three-dimensional environment model and the three-dimensional house model according to the position to generate a three-dimensional house model.
In a third aspect, an embodiment of the present invention further provides an apparatus, including:
One or more processors;
Storage means for storing one or more programs,
The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the indoor reconstruction method according to any one of the embodiments of the present invention.
In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements the indoor reconstruction method according to any one of the embodiments of the present invention.
According to the technical scheme, the three-dimensional room model is generated by carrying out three-dimensional reconstruction on the three-dimensional space of the room where the interior decoration is located according to the collected panoramic image, depth data and collection position of the interior decoration. Because the panoramic image contains the interior decoration, the generated three-dimensional house model is a three-dimensional model containing the interior decoration. Through the three-dimensional house model, a user can view the indoor simple package environment at any time and any place. Therefore, the problem that in the process of home decoration, users need to repeatedly run between houses and building material markets to confirm whether the material textures and styles of purchased decorations, furniture, electric appliances and the like are unified with the styles of finished simple parts is solved.
Drawings
Fig. 1 is a flowchart of an indoor reconstruction method according to a first embodiment of the present invention;
Fig. 2 is a flowchart of an indoor reconstruction method according to a second embodiment of the present invention;
Fig. 3 is a flowchart of an indoor reconstruction method according to a third embodiment of the present invention;
Fig. 4 is a schematic structural diagram of an indoor reconstruction device according to a fourth embodiment of the present invention;
fig. 5 is a schematic structural diagram of a device according to a fifth embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
Fig. 1 is a flowchart of an indoor reconstruction method according to an embodiment of the present invention. The embodiment can be applied to the case of three-dimensional reconstruction of interior decoration. The method may be performed by an indoor reconstruction device, which may be implemented in software and/or hardware. Referring to fig. 1, the indoor reconstruction method provided in this embodiment includes:
S110, acquiring an acquired panoramic image of the interior decoration, depth data and an acquisition position.
The panoramic image is a 360-degree full-view image of the current scene, the image can be obtained through a professional camera, and typically, in order to simultaneously obtain the depth of field data of the panoramic image, the current scene is preferably photographed by a depth of field camera so as to obtain the panoramic image data with the depth of field. Alternatively, the current scenario may be a living room, bedroom, restaurant, etc.
The acquisition position is the position in the current scene where the panoramic image was taken. The acquisition position may be obtained by a positioning tracker of a photographing device of the panoramic image.
Taking a house as an example, firstly placing shooting equipment with a positioning tracker at a first position of a bedroom of the house, and acquiring panoramic images and corresponding depth data of the bedroom at a preset acquisition angle; then, moving the shooting equipment with the positioning tracker to a second position of the living room, and acquiring panoramic images and corresponding depth data of the living room at a preset acquisition angle; panoramic images and corresponding depth data of other indoor spaces within the house are acquired in the same manner. And acquiring coordinates of the first position, the second position and other acquisition positions as acquisition positions through a positioning tracker.
Optionally, panoramic image acquisition can be performed on the interior decoration of the whole house along the wall surface by taking any position of any wall surface in the house as a starting point.
And S120, carrying out three-dimensional reconstruction on the three-dimensional space of the house where the interior decoration is located according to the panoramic image, the depth data and the acquisition position, and generating a three-dimensional house model.
Typically, the generating the three-dimensional house model may include:
Performing three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
determining the spatial position of the three-dimensional environment model according to the acquisition position;
and setting the three-dimensional environment model at the space position to generate a three-dimensional house model.
Taking a house as an example, the three-dimensional environment model of the bedroom is generated by carrying out three-dimensional reconstruction on the environment of the bedroom according to the collected panoramic image and depth data of the bedroom; and determining the position of the three-dimensional environment model of the bedroom in the three-dimensional space according to the acquisition position when the panoramic image of the bedroom is acquired. According to the acquired panoramic image and depth data of the living room, carrying out three-dimensional reconstruction on the environment of the living room to generate a three-dimensional environment model of the living room; and determining the position of the three-dimensional environment model of the living room in the three-dimensional space according to the acquisition position when the panoramic image of the living room is acquired. And similarly, determining the three-dimensional environment model of other indoor spaces in the house and the position of the three-dimensional environment model in the three-dimensional space. And, setting the three-dimensional environment model of the bedroom, the three-dimensional environment model of the living room and the three-dimensional environment model of other indoor spaces in the house at corresponding positions in the three-dimensional space, thereby generating a three-dimensional house model.
In practical applications, the indoor reconstruction method can be described as follows:
The method comprises the steps of obtaining the specific positions and sizes of a wall surface, a floor and a ceiling, uploading the specific positions and sizes to a cloud for storage, and carrying out three-dimensional reconstruction on the internal environment of a house to generate a three-dimensional house model;
according to the unified definition, commodity models with texture, models, sizes, colors and other information issued by various soft-and hard-packaged merchants are obtained and uploaded to a cloud for storage, wherein the commodity models comprise furniture soft-packaged commodity models with styles, colors and sizes, lamp soft-packaged commodity models with sizes and styles, commodity models with materials and colors for hard-packaged floors and paint models with colors;
And acquiring commodity models and corresponding placement positions corresponding to the soft package and the hard package selected by the user, placing the corresponding commodity models at the corresponding placement positions in the three-dimensional house model, and rendering and synthesizing.
Through the steps, the user can compare and select the effects of different selected decorative articles.
Specifically, according to the panoramic image and the depth data, performing three-dimensional reconstruction on the interior decoration, and generating a three-dimensional environment model includes:
Identifying the panoramic image;
And carrying out three-dimensional reconstruction on the interior decoration represented by the panoramic image according to the identification result and the depth data, and generating a three-dimensional environment model.
Optionally, according to the panoramic image, the depth data and the acquisition position, performing three-dimensional reconstruction on a three-dimensional space of a house where the interior decoration is located, generating the three-dimensional house model may include:
performing three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
determining the position of the three-dimensional environment model in a three-dimensional house type model according to the acquisition position, wherein the three-dimensional house type model is a three-dimensional model of the structure and the shape of a house where the interior decoration is located;
and combining the three-dimensional environment model with the three-dimensional house model according to the position to generate a three-dimensional house model.
Taking a room as an example, after generating a three-dimensional environment model of a bedroom, a three-dimensional environment model of a living room and three-dimensional environment models of other indoor spaces in the room, respectively combining the three-dimensional environment model of the bedroom, the three-dimensional environment model of the living room and the three-dimensional environment models of other indoor spaces in the room with the bedroom, the living room and the other indoor spaces in the three-dimensional house model according to the position when the panoramic images of the bedroom are acquired, the position when the panoramic images of the living room are acquired and the position when the panoramic images of the other indoor spaces in the room are acquired.
According to the technical scheme, the three-dimensional room model is generated by carrying out three-dimensional reconstruction on the three-dimensional space of the room where the interior decoration is located according to the collected panoramic image, depth data and collection position of the interior decoration. Because the panoramic image contains the interior decoration, the generated three-dimensional house model is a three-dimensional model containing the interior decoration. Through the three-dimensional house model, a user can view the indoor simple package environment at any time and any place. Therefore, the problem that in the process of home decoration, users need to repeatedly run between houses and building material markets to confirm whether the material textures and styles of purchased decorations, furniture, electric appliances and the like are unified with the styles of finished simple parts is solved.
When the three-dimensional environment model and the three-dimensional house model are combined, a combination error of the wall surface in the three-dimensional environment model and the wall surface in the three-dimensional house model may occur. For example, a first wall surface in a three-dimensional environmental model of a bedroom should be combined with a first wall surface of a bedroom in a three-dimensional house type model, but when combined, there is an error case in which the first wall surface in the three-dimensional environmental model of a bedroom should be combined with a non-first wall surface of a bedroom in a three-dimensional house type model.
To solve the above problem, according to the location, combining the three-dimensional environment model with a three-dimensional house model, generating a three-dimensional house model includes:
According to a preset initial acquisition direction when the panoramic image is acquired, carrying out relative position calibration on the three-dimensional environment model and the part of the position in the three-dimensional house type model;
and after calibration, combining the three-dimensional environment model with the three-dimensional house model to generate a three-dimensional house model.
The preset initial acquisition direction may be set according to needs, alternatively, may be determined according to the north-south standard determined by the earth magnetic field, for example, 40 degrees in north and 40 degrees in east, which is not limited in this embodiment.
Illustratively, shooting is started from a position 40 degrees north-east in the bedroom, a three-dimensional environment model of the bedroom is obtained, and the point is marked in the three-dimensional environment model. Starting the three-dimensional environment model from the marked point, and loading the three-dimensional environment model of the bedroom into the three-dimensional house model of the bedroom from a position 40 degrees north-east in the three-dimensional house model of the bedroom. Thereby achieving calibration of the relative positions.
Further, before determining the position of the three-dimensional environment model in the three-dimensional house model according to the acquisition position, the three-dimensional house model may further include:
and carrying out three-dimensional reconstruction on the structure and the shape of the house where the interior decoration is located according to the house type graph, and generating a three-dimensional house type model.
Further, the three-dimensional reconstruction of the structure and the shape of the house where the interior decoration is located according to the house type graph, and the generating of the three-dimensional house type model may include:
identifying walls, doors and windows in the house type graph;
and carrying out three-dimensional reconstruction according to the identification result to generate a three-dimensional house type model.
Further, after three-dimensional reconstruction is performed on the three-dimensional space of the house where the interior decoration is located according to the panoramic image, the depth data and the acquisition position, the method further comprises the steps of:
acquiring a decoration article three-dimensional model selected by a user and a placement position;
And adding the selected three-dimensional model into the three-dimensional house model according to the placement position, and rendering the three-dimensional house model.
The pre-stored three-dimensional model is a decoration article, and can be any article of decoration, furniture and electric appliances. The placement location may be determined by clicking on the corresponding location in the three-dimensional house model.
Illustratively, the pre-stored three-dimensional model is a sofa and the placement location is a location in the living room. After the placing positions are obtained, placing the sofa at the appointed position of the living room, and rendering the three-dimensional house model.
It will be appreciated that by the above steps, an effect can be achieved in which a user can place a favorite three-dimensional model at a specified position of a three-dimensional house model, whereby the user can view the placed effect. After the decoration effect is confirmed, corresponding decoration articles are purchased, and the problem that whether the material texture and style of purchased decorations, furniture, electric appliances and the like are unified with the style of the finished simple package part is avoided.
Further, before the pre-stored three-dimensional model and the placement position selected by the user are obtained, the method further comprises the following steps:
And carrying out three-dimensional reconstruction on the decoration articles to generate a pre-stored three-dimensional model.
It should be noted that, given the above teachings, those skilled in the art may have an incentive to implement the above embodiments in any combination, and this embodiment is not limited in any way.
Example two
Fig. 2 is a flowchart of an indoor reconstruction method according to a second embodiment of the present invention. This embodiment is an alternative to the embodiments described above. Referring to fig. 2, the indoor reconstruction method provided in this embodiment includes:
S210, acquiring an acquired panoramic image of the interior decoration, depth data and an acquisition position.
S220, carrying out three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data, and generating a three-dimensional environment model.
S230, determining the spatial position of the three-dimensional environment model according to the acquisition position.
Specifically, any point in the room may be set as an origin in the three-dimensional space, and the spatial position of the three-dimensional environment model in the three-dimensional space may be determined according to the difference between the abscissa and the ordinate of the acquisition position relative to the point.
And S240, setting the three-dimensional environment model at the space position to generate a three-dimensional house model.
S250, performing three-dimensional reconstruction on the decoration articles.
S260, acquiring a three-dimensional model and a placement position of the decoration article selected by a user.
And S270, adding the selected three-dimensional model into the three-dimensional house model according to the placement position, and rendering the three-dimensional house model.
According to the technical scheme, the spatial position of the three-dimensional environment model is determined through the acquisition position, so that the structure of the house where the interior decoration is located is determined.
Example III
Fig. 3 is a flowchart of an indoor reconstruction method according to a third embodiment of the present invention. This embodiment is an alternative to the embodiments described above. Referring to fig. 3, the indoor reconstruction method provided in this embodiment includes:
s310, acquiring an acquired panoramic image of the interior decoration, depth data and an acquisition position.
S320, carrying out three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data, and generating a three-dimensional environment model.
S330, carrying out three-dimensional reconstruction on the structure and the shape of the house where the interior decoration is located according to the house type graph, and generating a three-dimensional house type model.
S340, determining the position of the three-dimensional environment model in the three-dimensional house type model according to the acquisition position.
Specifically, when a plurality of acquisition positions exist, the positions of the three-dimensional environment model in the three-dimensional house type model can be determined according to the relation among the acquisition positions and by combining the three-dimensional house type model. For example, the relation between the acquisition positions is in a shape of T, and the three-dimensional environment model and the three-dimensional house model are corresponding according to the shape of T.
Alternatively, when acquiring the panoramic image, one of the plurality of acquisition positions may be associated with a corresponding position in the three-dimensional house type model. And according to the relation between the acquisition position and other acquisition positions, associating the three-dimensional environment model with other positions in the three-dimensional house type model.
S350, according to a preset initial acquisition direction when the panoramic image is acquired, carrying out relative position calibration on the three-dimensional environment model and the part of the position in the three-dimensional house type model.
S360, after calibration, combining the three-dimensional environment model and the three-dimensional house model to generate a three-dimensional house model.
S370, performing three-dimensional reconstruction on the decoration articles.
S380, acquiring a three-dimensional model and a placement position of the decoration article selected by a user, adding the selected three-dimensional model into the three-dimensional house model according to the placement position, and rendering the three-dimensional house model.
Specifically, the three-dimensional reconstruction of the structure and shape of the house where the interior decoration is located according to the house type graph, and the generating of the three-dimensional house type model may include:
identifying walls, doors and windows in the house type graph;
and carrying out three-dimensional reconstruction according to the identification result to generate a three-dimensional house type model.
According to the technical scheme, the position of the three-dimensional environment model in the three-dimensional house type model is determined through the acquisition position, and then the three-dimensional environment model is combined with the three-dimensional house type model, so that the structure of the house where the interior decoration is located is determined. In addition, according to a preset initial acquisition direction when the panoramic image is acquired, the relative position calibration is carried out on the three-dimensional environment model and the part of the position in the three-dimensional house type model. Thereby realizing the correct combination of the three-dimensional environment model and the three-dimensional house type model.
Example IV
Fig. 4 is a schematic structural diagram of an indoor reconstruction device according to a fourth embodiment of the present invention. Referring to fig. 4, an indoor reconstruction apparatus according to a fourth embodiment includes: an acquisition module 10 and a three-dimensional reconstruction module 20.
The acquisition module 10 is used for acquiring the acquired panoramic image, depth data and acquisition position of the interior decoration;
And the three-dimensional reconstruction module 20 is used for three-dimensionally reconstructing the three-dimensional space of the house where the interior decoration is positioned according to the panoramic image, the depth data and the acquisition position to generate a three-dimensional house model.
Further, the three-dimensional reconstruction module 20 includes: a three-dimensional reconstruction unit, a position determination unit and a model generation unit.
The three-dimensional reconstruction unit is used for carrying out three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
the position determining unit is used for determining the space position of the three-dimensional environment model according to the acquisition position;
And the model generating unit is used for setting the three-dimensional environment model at the space position and generating a three-dimensional house model.
Further, the three-dimensional reconstruction module 20 includes: an environment reconstruction unit, a relative position determination unit, and a house model generation unit.
The environment reconstruction unit is used for carrying out three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
The relative position determining unit is used for determining the position of the three-dimensional environment model in a three-dimensional house type model according to the acquisition position, wherein the three-dimensional house type model is a three-dimensional model of the structure and the shape of a house where the interior decoration is located;
And the house model generating unit is used for combining the three-dimensional environment model and the three-dimensional house model according to the position to generate a three-dimensional house model.
According to the technical scheme, the three-dimensional room model is generated by carrying out three-dimensional reconstruction on the three-dimensional space of the room where the interior decoration is located according to the collected panoramic image, depth data and collection position of the interior decoration. Because the panoramic image contains the interior decoration, the generated three-dimensional house model is a three-dimensional model containing the interior decoration. Through the three-dimensional house model, a user can view the indoor simple package environment at any time and any place. Therefore, the problem that in the process of home decoration, users need to repeatedly run between houses and building material markets to confirm whether the material textures and styles of purchased decorations, furniture, electric appliances and the like are unified with the styles of finished simple parts is solved.
Further, the indoor reconstruction device further includes: and a calibration module.
The calibration module is used for carrying out relative position calibration on the three-dimensional environment model and the three-dimensional house type model according to a preset initial acquisition direction when the panoramic image is acquired before the three-dimensional environment model and the three-dimensional house type model are combined according to the position to generate the three-dimensional house model.
Further, the indoor reconstruction device further includes: and a house type reconstruction module.
The house type reconstruction module is used for determining the position of the three-dimensional environment model in the three-dimensional house type model according to the acquisition position, wherein the three-dimensional house type model is a three-dimensional model of the structure and the shape of a house where the interior decoration is located, and three-dimensional reconstruction is carried out on the structure and the shape of the house where the interior decoration is located according to a house type diagram to generate the three-dimensional house type model.
Further, the house type reconstruction module includes: an identification unit and a generation unit.
The identification unit is used for identifying the wall, the door and the window in the house type graph;
and the generating unit is used for carrying out three-dimensional reconstruction according to the identification result and generating a three-dimensional house type model.
Further, the indoor reconstruction device further includes: a selection module and a rendering module.
The selection module is used for carrying out three-dimensional reconstruction on the three-dimensional space of the house where the interior decoration is located according to the panoramic image, the depth data and the acquisition position, and obtaining a three-dimensional model of the decoration article selected by a user and a placement position after generating a three-dimensional house model;
And the rendering module is used for adding the selected three-dimensional model into the three-dimensional house model according to the placement position and rendering the three-dimensional house model.
Further, the indoor reconstruction device further includes: and a model reconstruction module.
The model reconstruction module is used for carrying out three-dimensional reconstruction on the decoration articles before the pre-stored three-dimensional model and the placement position selected by the user are obtained.
Example five
Fig. 5 is a schematic structural diagram of a device according to a fifth embodiment of the present invention. Fig. 5 shows a block diagram of an exemplary device 12 suitable for use in implementing embodiments of the present invention. The device 12 shown in fig. 5 is merely an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 5, device 12 is in the form of a general purpose computing device. Components of device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.
Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.
Device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by device 12 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. Device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, commonly referred to as a "hard disk drive"). Although not shown in fig. 5, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods of the embodiments described herein.
Device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with device 12, and/or any devices (e.g., network card, modem, etc.) that enable device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Also, device 12 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, via network adapter 20. As shown, network adapter 20 communicates with other modules of device 12 over bus 18. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, to implement the indoor reconstruction method provided by the embodiment of the present invention.
Example six
The sixth embodiment of the present invention further provides a computer readable storage medium having a computer program stored thereon, where the program when executed by a processor implements the indoor reconstruction method according to any one of the embodiments of the present invention, the method including:
acquiring an acquired panoramic image, depth data and an acquisition position of indoor decoration;
And carrying out three-dimensional reconstruction on the three-dimensional space of the house where the interior decoration is located according to the panoramic image, the depth data and the acquisition position, and generating a three-dimensional house model.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (9)
1. An indoor reconstruction method, comprising:
acquiring an acquired panoramic image, depth data and an acquisition position of indoor decoration;
According to the panoramic image, the depth data and the acquisition position, carrying out three-dimensional reconstruction on the three-dimensional space of the house where the interior decoration is located, and generating a three-dimensional house model;
wherein, according to the panoramic image, the depth of field data and the acquisition position, three-dimensional reconstruction is carried out on the three-dimensional space of the house where the interior decoration is located, and generating a three-dimensional house model comprises:
identifying the panoramic image;
Performing three-dimensional reconstruction on the interior decoration represented by the panoramic image according to the identification result and the depth data to generate a three-dimensional environment model;
determining the position of the three-dimensional environment model in a three-dimensional house type model according to the acquisition position, wherein the three-dimensional house type model is a three-dimensional model of the structure and the shape of a house where the interior decoration is located;
Combining the three-dimensional environment model with the three-dimensional house model according to the position to generate a three-dimensional house model;
Before combining the three-dimensional environment model with the three-dimensional house model according to the position, generating a three-dimensional house model, the method further comprises:
And according to a preset initial acquisition direction when the panoramic image is acquired, carrying out relative position calibration on the three-dimensional environment model and the part of the position in the three-dimensional house type model.
2. The indoor reconstruction method according to claim 1, wherein the generating a three-dimensional house model by three-dimensionally reconstructing a stereoscopic space of a house where the interior decoration is located based on the panoramic image, the depth data, and the acquisition position comprises:
performing three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
determining the spatial position of the three-dimensional environment model according to the acquisition position;
and setting the three-dimensional environment model at the space position to generate a three-dimensional house model.
3. The indoor reconstruction method according to claim 1, wherein combining the three-dimensional environment model with the three-dimensional house model according to the position to generate a three-dimensional house model comprises:
and after calibration, combining the three-dimensional environment model with the three-dimensional house model to generate a three-dimensional house model.
4. The indoor reconstruction method according to claim 1, wherein before determining the position of the three-dimensional environmental model in a three-dimensional house model according to the acquisition position, wherein the three-dimensional house model is a three-dimensional model of a structure and a shape of a house where the interior decoration is located, further comprising:
and carrying out three-dimensional reconstruction on the structure and the shape of the house where the interior decoration is located according to the house type graph, and generating a three-dimensional house type model.
5. The indoor reconstruction method according to claim 1, wherein after three-dimensionally reconstructing a stereoscopic space of a house where the interior decoration is located from the panoramic image, the depth data, and the acquisition position, generating a three-dimensional house model, further comprising:
acquiring a decoration article three-dimensional model selected by a user and a placement position;
And adding the selected three-dimensional model into the three-dimensional house model according to the placement position, and rendering the three-dimensional house model.
6. An indoor reconstruction apparatus, comprising:
the acquisition module is used for acquiring the acquired panoramic image, depth data and acquisition position of the interior decoration;
The three-dimensional reconstruction module is used for carrying out three-dimensional reconstruction on the three-dimensional space of the house where the interior decoration is located according to the panoramic image, the depth data and the acquisition position, so as to generate a three-dimensional house model;
wherein, the three-dimensional reconstruction module includes:
the environment reconstruction unit is used for identifying the panoramic image; performing three-dimensional reconstruction on the interior decoration represented by the panoramic image according to the identification result and the depth data to generate a three-dimensional environment model;
The relative position determining unit is used for determining the position of the three-dimensional environment model in a three-dimensional house type model according to the acquisition position, wherein the three-dimensional house type model is a three-dimensional model of the structure and the shape of a house where the interior decoration is located;
The house model generating unit is used for combining the three-dimensional environment model and the three-dimensional house model according to the position to generate a three-dimensional house model;
The indoor reconstruction device further includes: and the calibration module is used for carrying out relative position calibration on the three-dimensional environment model and the three-dimensional house type model according to a preset initial acquisition direction when the panoramic image is acquired before the three-dimensional environment model and the three-dimensional house type model are combined according to the positions to generate the three-dimensional house model.
7. The indoor reconstruction device of claim 6, wherein the three-dimensional reconstruction module comprises:
The three-dimensional reconstruction unit is used for carrying out three-dimensional reconstruction on the interior decoration according to the panoramic image and the depth data to generate a three-dimensional environment model;
the position determining unit is used for determining the space position of the three-dimensional environment model according to the acquisition position;
And the model generating unit is used for setting the three-dimensional environment model at the space position and generating a three-dimensional house model.
8. An electronic device, the device comprising:
One or more processors;
Storage means for storing one or more programs,
When executed by the one or more processors, causes the one or more processors to implement the indoor reconstruction method as recited in any one of claims 1-5.
9. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the indoor reconstruction method as claimed in any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711163966.7A CN109816768B (en) | 2017-11-21 | 2017-11-21 | Indoor reconstruction method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711163966.7A CN109816768B (en) | 2017-11-21 | 2017-11-21 | Indoor reconstruction method, device, equipment and medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109816768A CN109816768A (en) | 2019-05-28 |
| CN109816768B true CN109816768B (en) | 2024-04-26 |
Family
ID=66599625
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711163966.7A Active CN109816768B (en) | 2017-11-21 | 2017-11-21 | Indoor reconstruction method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109816768B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110852919A (en) * | 2019-10-23 | 2020-02-28 | 深圳市汇融科技有限公司 | Real estate evaluation system |
| CN111161350B (en) * | 2019-12-18 | 2020-12-04 | 北京城市网邻信息技术有限公司 | Position information and position relation determining method, position information acquiring device |
| CN111127655B (en) * | 2019-12-18 | 2021-10-12 | 北京城市网邻信息技术有限公司 | House layout drawing construction method and device, and storage medium |
| CN113989376B (en) * | 2021-12-23 | 2022-04-26 | 贝壳技术有限公司 | Method and device for acquiring indoor depth information and readable storage medium |
| CN114554108B (en) * | 2022-02-24 | 2023-10-27 | 北京有竹居网络技术有限公司 | Image processing method and device and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101930627A (en) * | 2010-09-10 | 2010-12-29 | 西安新视角信息科技有限公司 | Three-dimensional dwelling size modeling method based on two-dimensional dwelling size diagram |
| CN103839293A (en) * | 2014-03-07 | 2014-06-04 | 武汉蜗牛科技有限责任公司 | Three-dimensional house decorating method and system |
| CN105630876A (en) * | 2015-12-17 | 2016-06-01 | 百度在线网络技术（北京）有限公司 | Cross-application information obtaining method and device |
| CN106485785A (en) * | 2016-09-30 | 2017-03-08 | 李娜 | A kind of scene generating method based on indoor three-dimensional modeling and positioning and system |
| CN106780421A (en) * | 2016-12-15 | 2017-05-31 | 苏州酷外文化传媒有限公司 | Finishing effect methods of exhibiting based on panoramic platform |
-
2017
- 2017-11-21 CN CN201711163966.7A patent/CN109816768B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101930627A (en) * | 2010-09-10 | 2010-12-29 | 西安新视角信息科技有限公司 | Three-dimensional dwelling size modeling method based on two-dimensional dwelling size diagram |
| CN103839293A (en) * | 2014-03-07 | 2014-06-04 | 武汉蜗牛科技有限责任公司 | Three-dimensional house decorating method and system |
| CN105630876A (en) * | 2015-12-17 | 2016-06-01 | 百度在线网络技术（北京）有限公司 | Cross-application information obtaining method and device |
| CN106485785A (en) * | 2016-09-30 | 2017-03-08 | 李娜 | A kind of scene generating method based on indoor three-dimensional modeling and positioning and system |
| CN106780421A (en) * | 2016-12-15 | 2017-05-31 | 苏州酷外文化传媒有限公司 | Finishing effect methods of exhibiting based on panoramic platform |
Non-Patent Citations (1)
| Title |
|---|
| 基于多视照片的三维重建技术在室内陈设设计中的应用――以家居摆件品为例;林晓鸿等;《家具与室内装饰》;20161005(第10期);79-81 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109816768A (en) | 2019-05-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109816768B (en) | Indoor reconstruction method, device, equipment and medium | |
| US11217019B2 (en) | Presenting image transition sequences between viewing locations | |
| CN111127627B (en) | Model display method and device in three-dimensional house model | |
| CN111127655B (en) | House layout drawing construction method and device, and storage medium | |
| US11514674B2 (en) | Automated analysis of image contents to determine the acquisition location of the image | |
| US11823325B2 (en) | Providing simulated lighting information for building models | |
| US20210319149A1 (en) | Method, device, equipment and storage medium for generating three-dimensional space of target house | |
| CN108986233B (en) | Method and system for rapidly drawing indoor preview | |
| CN110728755B (en) | Method and system for roaming among scenes, model topology creation and scene switching | |
| WO2019058266A1 (en) | A system and method for conversion of a floor plan to a 3d scene for creation & rendering of virtual reality architectural scenes, walk through videos and images | |
| CN111161336B (en) | Three-dimensional reconstruction method, three-dimensional reconstruction apparatus, and computer-readable storage medium | |
| US10600255B2 (en) | Technologies for composing a virtual reality setting in a mobile computing environment | |
| CN111932666A (en) | Reconstruction method and device of house three-dimensional virtual image and electronic equipment | |
| CN113240769A (en) | Spatial link relation identification method and device and storage medium | |
| US20230125295A1 (en) | Automated Analysis Of Visual Data Of Images To Determine The Images' Acquisition Locations On Building Floor Plans | |
| US20230206393A1 (en) | Automated Building Information Determination Using Inter-Image Analysis Of Multiple Building Images | |
| CN114511668A (en) | Method, device and equipment for acquiring three-dimensional decoration image and storage medium | |
| US20150138199A1 (en) | Image generating system and image generating program product | |
| CN111028362A (en) | Image display method, image annotation processing method, image processing device, image processing program, and storage medium | |
| Weber et al. | Editable indoor lighting estimation | |
| CN112950759B (en) | Three-dimensional house model construction method and device based on house panoramic image | |
| CN115423920B (en) | VR scene processing method, device and storage medium | |
| CN115115786A (en) | Method, apparatus, device and storage medium for three-dimensional model generation | |
| CN108846898B (en) | Method and device for presenting 3D orientation on 3D house model | |
| CN111429576A (en) | Information display method, electronic device, and computer-readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |