CN113487723B - House online display method and system based on measurable panoramic three-dimensional model - Google Patents
House online display method and system based on measurable panoramic three-dimensional model Download PDFInfo
- Publication number
- CN113487723B CN113487723B CN202110699231.6A CN202110699231A CN113487723B CN 113487723 B CN113487723 B CN 113487723B CN 202110699231 A CN202110699231 A CN 202110699231A CN 113487723 B CN113487723 B CN 113487723B
- Authority
- CN
- China
- Prior art keywords
- house
- panoramic
- dimensional model
- information
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000008569 process Effects 0.000 claims abstract description 10
- 238000010276 construction Methods 0.000 claims abstract description 6
- 238000012545 processing Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 4
- 238000012937 correction Methods 0.000 claims description 2
- 230000011218 segmentation Effects 0.000 claims description 2
- 238000009499 grossing Methods 0.000 claims 1
- 238000013507 mapping Methods 0.000 description 5
- 238000011161 development Methods 0.000 description 4
- 230000018109 developmental process Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000005034 decoration Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 230000029305 taxis Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/08—Projecting images onto non-planar surfaces, e.g. geodetic screens
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration using histogram techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/187—Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/04—Architectural design, interior design
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a house online display method and a house online display system based on a measurable panoramic three-dimensional model, which comprises the steps of receiving panoramic image information of each part of a house acquired by a client image, and sending panoramic image data to a server end by using the client through a network; after receiving the house panoramic image information, the server side uses a three-dimensional model construction mode to process and generate a measurable panoramic three-dimensional model; the house information provider autonomously inputs other information of the house and uploads the information to the server database; the server arranges and stores the received house data in a warehouse, so that the client can conveniently search; and the server sends the measurable panoramic three-dimensional model of the house and other related information to the client for display according to the request sent by the client. The invention realizes the specific display of the house live and size parameters by three-dimensional modeling of the house and integrating the image picture into the three-dimensional scene according to the strict geometric relation, thereby reducing the related cost and improving the efficiency.
Description
Technical Field
The invention belongs to the field of panoramic three-dimensional measurable modeling and house online display, and provides a house online display method and a house online display system based on a measurable panoramic three-dimensional model.
Background
The exhibition of the house live information is a necessary step for selling houses, and in order to ensure the authenticity and the validity of the house information, house purchasing or house renting clients are generally required to conduct on-site check of houses under the guidance of a house intermediation platform so as to obtain the real conditions of the houses and conduct renting decisions. With the development of modernization and urbanization of our country, simple, rough and even false information display of houses by the traditional internet platform can not meet the market requirement any more, so that the house leasing and buying and selling transactions can not be completed efficiently on line, the development of the industry is hindered, the house-viewing time cost and the traffic cost in the transactions are correspondingly increased, and the real and full appearance of the building space can not be reflected by the traditional house display technical means. Therefore, a practical technology capable of checking and displaying the live house online is of high market significance to the development of the industry.
In recent years, an online house information three-dimensional panoramic display system is adopted by a plurality of large house information platforms, so that the house-viewing efficiency is obviously improved, and the house-viewing cost is reduced. On the basis, the application functions of the existing online house information three-dimensional panoramic display system are fully excavated and expanded, the measurable panoramic three-dimensional online house watching system is popularized and applied to medium and small-sized house intermediaries and individual sellers, the house three-dimensional information acquisition efficiency is improved, the house three-dimensional model acquisition cost is reduced, the technical feasibility is achieved, the remarkable market benefits are brought, and the important popularization value is achieved.
Disclosure of Invention
The invention meets the requirements which cannot be solved by the prior art and provides a house online display method and a house online display system based on a measurable panoramic three-dimensional model.
The technical scheme provided by the invention is a house online display method based on a measurable panoramic three-dimensional model, which comprises the following steps,
receiving panoramic image information of all parts of a house acquired by a client image, and sending panoramic image data to a server by using the client through a network;
step two, after receiving the house panoramic image information, the server side uses a three-dimensional model construction mode to process, and a measurable panoramic three-dimensional model is generated;
the three-dimensional model building processing comprises the steps of firstly, generating a three-dimensional model by utilizing a panoramic picture, wherein any point on the three-dimensional model has a space coordinate, and the panoramic picture corresponds to the position of the three-dimensional model during display; each time a pixel on the panorama is clicked, the pixel can correspond to a voxel on the three-dimensional model, namely a coordinate value, so that the measurability of the three-dimensional model is realized;
step three, the house information provider autonomously inputs other information of the house and uploads the information to the server database;
the server arranges and stores the received house data in a warehouse, so that the client can conveniently search;
and step five, the server sends the measurable panoramic three-dimensional model of the house and other related information to the client for display according to the request sent by the client.
And in the step one, the panoramic image information is acquired in a manner that a panoramic camera function or a panoramic camera of the intelligent mobile device is utilized to acquire 360-degree panoramic image data of the house.
And in the third step, the database is established and managed by using a mysql system and is used for storing house source information to be displayed, wherein the house source information comprises a measurable panoramic three-dimensional model of a house source and information input by a user.
Furthermore, the autonomous input of other information about the house in step three includes the price, location, surrounding environment and subjective impression of the house.
And the database arrangement in the fourth step comprises the steps of extracting key information of the house information and generating description keywords.
And in the fifth step, the request sent by the client comprises keyword search and condition search.
On the other hand, the invention also provides a house online display system based on the measurable panoramic three-dimensional model, which is used for realizing the house online display method based on the measurable panoramic three-dimensional model.
The system comprises a client, a remote server and a database, wherein the database stores massive house source information of a house, and the house source information comprises a three-dimensional model of the house; the client is in communication connection with the remote server and sends a query instruction for querying the house to the remote server; and the remote server is connected with the database, searches for the house conforming to the query instruction according to the received query instruction, and returns the house source information of the conforming house to the client.
The invention provides a system for carrying out live-action measurable three-dimensional modeling and realizing on-line house watching by utilizing panoramic image data, which has the advantages of reasonable design, strong functionality and convenient use, fully meets the market demand and has the following positive effects:
1) According to the measurable panoramic three-dimensional online house-watching system and method, live measurable three-dimensional modeling can be performed on a house based on the obtained house three-dimensional image, so that the house can be browsed in different angles and different spaces, accurate length data of the house can be obtained, a house-watching person or a house-purchasing person can obtain detailed real information that the house is not less than the house-watching on the spot, a user can know real house conditions conveniently, and the user experience effect is improved.
2) The online house-watching characteristic of the invention reduces the time cost and the traffic cost for house-watching persons or house-purchasing persons, improves the enthusiasm for knowing the detailed conditions of houses, and improves the sale or lease probability of houses.
3) The invention reduces the time cost, the labor cost and the resource occupation of the house for constructing the measurable panoramic three-dimensional model, does not need special persons to collect house information at fixed points by using professional equipment, and can collect panoramic image data meeting the requirements by using equipment such as a consumer-grade mobile phone camera, thereby widening the client range of the system and having stronger application potential.
Drawings
Fig. 1 is a flow chart of house panoramic data acquisition and three-dimensional model construction according to an embodiment of the present invention.
Fig. 2 is a flow chart of online house-viewing according to an embodiment of the present invention.
Detailed Description
The present invention is described in further detail below with reference to specific examples.
Referring to fig. 2, an embodiment of the method for displaying a house on line based on a measurable panoramic three-dimensional model includes the following steps:
receiving panoramic image information of all parts of the house acquired by a client through image acquisition, and sending panoramic image data to a server through a network by using the client.
The panoramic image information is obtained, and the suggested implementation mode is that a panoramic camera shooting function or a panoramic camera of the intelligent mobile device is utilized to acquire 360-degree panoramic image data of the house.
Preferably, the resolution of the intelligent mobile device or the panoramic camera is not lower than 4K, and a panoramic lens is adopted; the house is shot in a handheld mode, so that the house is stable as much as possible, and the image coverage range is as comprehensive as possible; the panoramic video acquisition frame rate is not lower than 25frame/second.
And step two, after receiving the house panoramic image information, the server side processes the house panoramic image information by using a three-dimensional model building mode to generate a measurable panoramic three-dimensional model.
In the three-dimensional model construction processing, a three-dimensional model is generated by using the panoramic picture, any point on the three-dimensional model has a space coordinate, and the panoramic picture corresponds to the position of the three-dimensional model when being displayed. Each time a pixel on the panorama is clicked, a voxel on the three-dimensional model can be corresponding, namely a coordinate value is corresponding, and therefore measurability of the three-dimensional model is achieved.
The building method based on the panoramic image and the scene three-dimensional model is constructed and fused, so that three-dimensional modeling of a house can be realized, an image picture is fused into a three-dimensional scene according to a strict geometric relation, and specific automatic display of the house live and size parameters is realized.
Referring to fig. 1, the preferred three-dimensional model building and generating method adopted by the embodiment includes the following steps:
step 1, inputting 360-degree panoramic data of a house.
The data obtained in the step one can be directly adopted in the step one. In particular, photos or videos of house panoramic data shot and uploaded by the masses can be utilized and uploaded.
And 2, generating a house three-dimensional color point cloud by using the house 360-degree panoramic data.
2.1 First, a 360-degree panoramic video stream is decimated to create a 360-degree panoramic image set of the sequence.
In specific implementation, the panoramic video frame extraction interval should be set for shooting stability, and the effect is better. The preferred proposed implementation is as follows:
(1) when the video is stable, setting an interval of 5 frames/second to extract video frames; (2) when the shooting process has large jitter, the interval of 3 frames/second is set to extract video frames.
2.2 Multi-view projection correction is performed on the 360-degree panoramic image to obtain a sequence multi-view image.
The specific method comprises the following steps:
firstly, converting an originally input 360-degree panoramic image into a three-dimensional panoramic ball space (the relational expressions are shown as formula 1 and formula 2) by adopting an equal-rectangle projection spherical panoramic model; the equal-rectangular projection spherical panoramic model is used for converting a three-dimensional spherical model and a two-dimensional plane of a panoramic image and establishing a conversion relation among a three-dimensional spherical surface, spherical surface textures and the two-dimensional panoramic plane;
in the formula (I), the compound is shown in the specification,
is the image in the original panoramic imagePoint coordinate>
Is the coordinate of the corresponding point in the three-dimensional panoramic sphere, w is the original panoramic image length, h is the original panoramic image width, theta q Is a zenith angle in a spherical coordinate system>
Is the azimuth angle in the spherical coordinate system.
Secondly, surrounding the panoramic ball by a square with the side length equal to the diameter of the panoramic ball, and mapping points on the spherical surface to the corresponding cubic surface to obtain 6 multi-view images;
thirdly, rotating the cube by 45 degrees, and mapping the points on the spherical surface to the corresponding cube surface again to obtain another 6 multi-view images;
and finally, selecting at least 6 images in the horizontal direction and at least 2 images in the vertical direction from the 12 multi-view images to form a house sequence multi-view image.
2.3 Then carrying out house sequence multi-view image matching and SFM reconstruction to generate three-dimensional sparse point cloud, comprising the following operations:
firstly, extracting feature points of a house sequence multi-view image by adopting an SIFT feature operator;
secondly, matching the house multi-view images by using a support line voting and affine invariant constraint image matching mode to obtain a house sequence image matching point set;
and thirdly, performing aerial triangulation and sparse point cloud generation on the house sequence image matching point set through SFM, recovering the camera pose of each frame of panoramic image, and generating a house three-dimensional sparse point cloud.
2.4 According to the three-dimensional sparse point cloud, adopting PMVS to generate dense three-dimensional point cloud, specifically implementing as follows:
firstly, generating dense three-dimensional point cloud of a house by adopting PMVS (pulse-modulated visual switching) according to the three-dimensional sparse point cloud of the house;
secondly, generating an irregular house triangular Mesh based on the house dense three-dimensional point cloud;
and finally, traversing a house Mesh patch, calculating a normal vector, searching a corresponding multi-view image to determine the most appropriate texture block, and mapping the most appropriate texture block to the Mesh patch to obtain a three-dimensional model of the house with realistic texture, wherein the three-dimensional model comprises a house three-dimensional color point cloud and a surface Mesh model constructed based on the color point cloud.
And 3, carrying out point cloud regularization on house color.
The step 3 implementation of the embodiment comprises the following specific processes:
3.1 The point cloud is smoothed by surface fitting, so that the model is reduced or filled, and the model deformation is reduced.
3.2 Secondly, carrying out point cloud plane segmentation by using a region growing algorithm, searching similar point sets, combining the point sets, and segmenting to obtain different objects;
performing plane point cloud fitting by using an iterative weight least square method, and calculating a normal vector n of a point cloud plane;
3.3 The vertical plane is taken as a candidate wall surface, then the plane with the height of the vertical plane lower than the threshold value is removed, and then the wall surface meeting the condition is obtained.
The embodiment calculates whether the judgment plane is vertical or not by using the formula | n.v | <epsilon. Where n is the normal vector of the point cloud plane, v = (0,0,1) T, and e is the cosine value of the angle threshold. When the angle threshold is 90 ° ± 1 °, e = cos (90 ° ± 1 °). And removing the plane with the height h of the vertical plane less than 1.5m, and then obtaining the wall surface meeting the conditions.
And 4, generating a house plane graph and three-dimensional grid model based on the house point cloud.
The step 4 implementation of the embodiment comprises the following specific processes:
4.1 The point cloud is vertically projected on a horizontal plane, and straight line fitting is carried out according to the density of the projected points.
4.2 The fitted straight lines are used for carrying out area division, a two-dimensional plane space is divided into polygon units by using two-dimensional line segments, and the vector polygon units for dividing the space are obtained by using a space division algorithm. And splicing the vector lines to obtain a vector line layer projected to a 2D plane.
4.3 Using the vector room plan data generated in the step 4.2, obtaining the elevation information of the floor and the ceiling of each room from the point clouds by using a height histogram method, wherein the point cloud number of the height histogram is represented as two peak values, and the two elevation values are respectively used as the elevations of the floor and the ceiling of the room; and triangulating the ceiling, the wall and the floor of each room by using a Delaunay triangularization method, and constructing a final room three-dimensional model. And outputting the constructed three-dimensional model of the room in a vector Mesh grid form.
Preferably, based on the dense three-dimensional point cloud of the house, the irregular triangular Mesh of the house is generated according to a Poisson reconstruction algorithm. And texture mapping is carried out on the Mesh surface patch after the triangular net is constructed, during mapping, consistency check and color smoothness evaluation of surface patch textures are carried out by adopting a graph cut theory, transition of color and brightness is carried out by adopting a distance weighting mode, and a seam between adjacent texture blocks is eliminated.
And step 5, associating the house 360 panorama, the plan and the three-dimensional model.
The step 5 implementation of the embodiment comprises the following specific processes:
5.1 Solving the coordinates of the photographing center by a beam method, projecting the photographing center on a horizontal plane, and setting a label at the position of the projection point.
5.2 The photographing center point and the corresponding tag position are used as references to unify the house panorama, the plan view and the three-dimensional model into the same coordinate system.
The process can realize low-cost 360-degree panoramic image data live-action indoor three-dimensional reconstruction, and can be used for building live-action indoor three-dimensional models to visually display houses and acquire basic data.
And step three, receiving other information of the house, such as geographical position, price, floor and the like, provided by the house information provider, and uploading the information to the server database.
The house information provider may be a house intermediary, a homeowner, a property, etc. The database is preferably established and managed by a mysql system and is used for storing house source information to be displayed, and the house source information comprises a measurable panoramic three-dimensional model of a house source and information input by a user according to self description. Other information about the premises is entered autonomously, including the price, location, surrounding environment, impression of the supervisor, etc.
And fourthly, the server arranges and stores the received house data in a warehouse, so that the client can conveniently search.
And the database arrangement mainly comprises the steps of extracting key information of the house information and generating description keywords.
And step five, the server sends the measurable panoramic three-dimensional model of the house, possibly accompanied with other house explanation videos, house price information and the like to the client according to the request sent by the client.
The request sent by the client comprises keyword search and conditional search. The keyword search refers to inputting keywords describing house source information on a search interface, such as "wuhan", "one room", and the like. The condition search refers to the adjustment of screening conditions in condition options provided by a search interface, for example, the price range is adjusted to be 0-3000.
The query client in the step and the client used for uploading the data in the step one can be different clients used by different users. Different users can adopt the intelligent mobile equipment of oneself to realize corresponding operation according to the demand:
the method comprises the steps of acquiring panoramic images of all parts of a house through image acquisition, transmitting the panoramic images to a server through a network by using an uploading client, processing acquired panoramic image data by using a three-dimensional model construction mode at the server, obtaining a live-action measurable three-dimensional model of the house according to the panoramic image data, and returning required three-dimensional house information to a request client by the server when a house-watching request instruction is received, so that measurable panoramic three-dimensional online house watching is realized.
The display mode of the measurable panoramic three-dimensional information model can be a website which can be accessed through a first terminal of a user, a target application program (APP) installed on the first terminal, and other equipment with a display function.
The second embodiment provides a house online display system based on a measurable panoramic three-dimensional model, and is used for realizing the measurable panoramic three-dimensional online house watching system display method. The system comprises a client, a server and a database, wherein a plurality of clients are in communication connection with the server, for example, the plurality of clients can be connected with a remote server through the Internet, and the remote server can access the database connected with the remote server.
In specific implementation, if the three-dimensional house model is stored in the database in advance, the panoramic image uploading step and the corresponding uploading client can be omitted. Namely:
massive house source information is stored in the database, and the house source information comprises a three-dimensional model of the house; the client is in communication connection with the remote server and sends a query instruction for querying the house to the remote server; and the remote server is connected with the database, searches the house corresponding to the query instruction according to the received query instruction, and returns the house source information of the house corresponding to the query instruction to the client. The database of the embodiment of the invention is established and managed by using a mysql system and is used for storing house source information to be displayed, wherein the house source information comprises a measurable panoramic three-dimensional model of a house source. The house source showing party can use intelligent mobile equipment, such as a smart phone, shoot the panoramic image inside the house, upload image data to the server through the client, and the showing party can select the information description of independently inputting the house. And processing the data by the server and storing the data into a database after generating the measurable panoramic three-dimensional model. The server integrates various data uploaded to the same house, and therefore the house source information and the three-dimensional model of the house are obtained.
The website framework can be constructed by adopting popular angular, and the mobile device-based app can be developed by adopting ReactNative. The back end is based on a node.JS development platform. The client is based on an intelligent mobile device and a computer platform which can be accessed to the internet, such as a smart phone, a tablet computer and the like; the user can access the server through the client, and after receiving the instruction sent by the client, the server can query the database according to the received instruction and return the query result to the client.
The front-end map is displayed by using an online osm map, and the house panorama and the three-dimensional model are displayed by using threejs. The measurable panoramic three-dimensional information can enable a user to watch details such as the structure, layout, interior decoration design, furniture placement and specific length and size of a house on line, and the user can also control the amplification, reduction, rotation and roaming of house display pictures through input equipment of a client; the client input device comprises a touch screen, a keyboard, a mouse and the like.
The client side comprises a database-based search function, a user can input a query instruction through a search interface, for example, keywords such as Wuhan city, wuhan university and a living room, and the user can also search through condition screening, such as a price interval and the like. After the query instruction is input, the client sends the query instruction to the remote server, and the remote server queries according to the query instruction and sends a query result to the client.
The client side can display the query results in a list form after receiving the query results, and each house information comprises information such as the price, the house type, the position and the measurable panoramic three-dimensional model of the house source. The user can browse the interested house in the query interface and further know the three-dimensional model information of the house, the three-dimensional model really shows the structure of the house, and the user can observe the details of the house through the enlargement, the reduction, the roaming and the like of the three-dimensional image.
The measurable panoramic three-dimensional house source information exists in the house source information, and required materials need to be recorded on site, so that the reliability and the authenticity of the house source can be ensured from the source; the invention can widen the client group and is convenient for the medium and small-sized houses and the landlord of the individual seller because the panoramic image which is easy to obtain is used; the three-dimensional model building module of the server receives the sent panoramic image data and generates a three-dimensional model, information is stored and released, a house purchasing or leasing party can see corresponding house source information through a client, and online house watching is completed at the client, so that the time cost and the traffic cost for house watching are greatly reduced, the management of house resource providers is facilitated, and the transaction efficiency is improved.
At present, only basic information of a second-hand house source is usually displayed in a house website, and the basic information can include house source pictures, peripheral matching and commuting, and house source details such as core selling points, house types, taxes and the like, and the information is too fragmented, so that a client cannot obtain visual and comprehensive visual experience of a house. This will lead to the customer can't directly know the second-hand house source of interest comprehensively according to the content that the house website demonstrates, can only look over the quality information of the second-hand house source of interest by oneself when looking at the house on the spot, and probably can't consider comprehensively in the course of looking at the house once when looking over by oneself, and then lead to needing to look at the house many times, prolonged the house period of making a transaction, increased the cost of seeing the house of customer and the cost of bringing and seeing of broker. The measurable panoramic three-dimensional online house-watching system provided by the embodiment of the invention can solve the technical problems in the prior art and improve the customer experience through an intelligent technical scheme.
The specific embodiments described herein are merely illustrative of the spirit of the invention. Various modifications or additions may be made to the described embodiments, or alternatives may be employed, by those skilled in the art, without departing from the spirit or ambit of the invention as defined in the appended claims.
Claims (8)
1. A house online display method based on a measurable panoramic three-dimensional model is characterized by comprising the following steps: the method for carrying out live measurable three-dimensional modeling on a house based on a house three-dimensional image acquired by client image acquisition so as to support the selection of different angles and different spaces to browse the whole house and acquire accurate length data of the house comprises the following steps,
receiving panoramic image information of all parts of a house acquired by client image acquisition, and sending panoramic image data to a server by using a client through a network;
step two, after receiving the house panoramic image information, the server side uses a three-dimensional model construction mode to process, and a measurable panoramic three-dimensional model is generated;
the three-dimensional model building processing comprises the steps of firstly, generating a three-dimensional model by utilizing a panoramic picture, wherein any point on the three-dimensional model has a space coordinate, and the panoramic picture corresponds to the position of the three-dimensional model during display; each time a pixel on the panorama is clicked, the pixel can correspond to a voxel on the three-dimensional model, namely a coordinate value, so that the measurability of the three-dimensional model is realized;
a three-dimensional model building process implementation includes the following steps,
step 1, inputting 360-degree panoramic data of a house;
step 2, generating a house three-dimensional color point cloud by using the house 360-degree panoramic data in the following way,
2.1 Frames are extracted from the 360-degree panoramic video stream, and a sequence 360-degree panoramic image set is established;
2.2 Multi-view projection correction is carried out on the 360-degree panoramic image to obtain a sequence multi-view image;
2.3 Performing multi-view image matching and SFM reconstruction on a house sequence to generate a three-dimensional sparse point cloud;
2.4 From the three-dimensional sparse point cloud, generating a dense three-dimensional point cloud using PMVS;
step 3, the house color point cloud is normalized in the following implementation mode,
3.1 Smoothing the point cloud through surface fitting to reduce or fill the model and reduce the deformation of the model;
3.2 Carrying out point cloud plane segmentation by using a region growing algorithm, searching similar point sets, merging, and segmenting to obtain different objects; performing plane point cloud fitting, and calculating a normal vector of a point cloud plane;
3.3 Wall selection, which comprises judging a vertical plane as a candidate wall according to a normal vector, and then eliminating a plane with the height of the vertical plane lower than a corresponding preset threshold value to obtain a wall meeting the condition;
step 4, generating a house plane graph and a three-dimensional grid model based on the house point cloud, wherein the realization method comprises the following steps,
4.1 Vertically projecting the point cloud onto a horizontal plane, and performing straight line fitting according to the density of the projected points;
4.2 The fitted straight line is used for carrying out area division, a two-dimensional line segment is used for dividing a two-dimensional plane space to form a polygon unit, a space division algorithm is used for obtaining a vector polygon unit for dividing the space, and a vector line image layer projected to a 2D plane is obtained by splicing;
4.3 Using the vector room plan data generated in step 4.2, obtaining the floor and ceiling elevation information of each room from the point cloud; triangularizing the ceiling, the wall surface and the floor of each room to construct a final room three-dimensional model;
step 5, associating the house 360 panorama, the plan view and the three-dimensional model, and realizing the following manner,
5.1 Solving the coordinates of the photographing center by a beam method, projecting the photographing center on a horizontal plane, and setting a label at the position of the projection point;
5.2 Unifying the house panorama, the plan view and the three-dimensional model to be under the same coordinate system by taking the photographing central point and the corresponding label position as references;
step three, the house information provider independently inputs other information of the house and uploads the information to the server database;
step four, the server sorts and stores the received house data in a warehouse, so that the client side can conveniently search;
and step five, the server sends the measurable panoramic three-dimensional model of the house and other related information to the client for display according to the request sent by the client.
2. The on-line house exhibition method based on the measurable panoramic three-dimensional model, according to claim 1, wherein: in the first step, the panoramic image information is acquired in a mode that a panoramic camera function or a panoramic camera of the intelligent mobile device is used for acquiring 360-degree panoramic image data of the house.
3. The on-line house exhibition method based on the measurable panoramic three-dimensional model, according to claim 1, wherein: and in the third step, the database is established and managed by using a mysql system and is used for storing house source information to be displayed, wherein the house source information comprises a measurable panoramic three-dimensional model of a house source and information input by a user.
4. The on-line house exhibition method based on the measurable panoramic three-dimensional model, according to claim 1, wherein: the autonomous entry of other information about the premises in step three includes the price, location, surrounding environment and subjective impression of the premises.
5. The on-line house exhibition method based on the measurable panoramic three-dimensional model, according to claim 1, wherein: and step four, database arrangement, which comprises the steps of extracting key information of the house information and generating description keywords.
6. The method for on-line exhibition of a house based on a scalable panoramic three-dimensional model as claimed in claim 1, 2, 3, 4 or 5, wherein: and step five, the request sent by the client comprises keyword search and condition search.
7. The utility model provides a house online display system based on can measurationing panorama three-dimensional model which characterized in that: method for the realization of an online exhibition of a house based on a scalable panoramic three-dimensional model according to any one of claims 1 to 6.
8. The system of claim 7, wherein the system comprises: the system comprises a client, a remote server and a database, wherein the database stores massive house source information of a house, and the house source information comprises a three-dimensional model of the house; the client is in communication connection with the remote server and sends a query instruction for querying the house to the remote server; and the remote server is connected with the database, searches the house corresponding to the query instruction according to the received query instruction, and returns the house source information of the house corresponding to the query instruction to the client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110699231.6A CN113487723B (en) | 2021-06-23 | 2021-06-23 | House online display method and system based on measurable panoramic three-dimensional model |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110699231.6A CN113487723B (en) | 2021-06-23 | 2021-06-23 | House online display method and system based on measurable panoramic three-dimensional model |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113487723A CN113487723A (en) | 2021-10-08 |
| CN113487723B true CN113487723B (en) | 2023-04-18 |
Family
ID=77935966
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110699231.6A Active CN113487723B (en) | 2021-06-23 | 2021-06-23 | House online display method and system based on measurable panoramic three-dimensional model |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113487723B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113920270B (en) * | 2021-12-15 | 2022-08-19 | 深圳市其域创新科技有限公司 | Layout reconstruction method and system based on multi-view panorama |
| CN114513680B (en) * | 2021-12-28 | 2023-04-28 | 上海瑞家信息技术有限公司 | Video processing method, device, apparatus and storage medium |
| CN115965742A (en) * | 2022-11-21 | 2023-04-14 | 北京乐新创展科技有限公司 | Space display method, device, equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103400415A (en) * | 2013-08-07 | 2013-11-20 | 赞奇科技发展有限公司 | Implementation method and system for automatic generation and on-line interaction of three-dimensional digital model with planar space structure |
| CN106096153A (en) * | 2016-06-16 | 2016-11-09 | 上海营匠网络科技有限公司 | Indoor decoration outdoor scene is experienced scene and is provided method and system |
| WO2018069736A1 (en) * | 2016-10-14 | 2018-04-19 | Axial Medical Printing Limited | A method for generating a 3d physical model of a patient specific anatomic feature from 2d medical images |
| CN108470037A (en) * | 2018-02-07 | 2018-08-31 | 链家网（北京）科技有限公司 | A kind of the three-dimensional scenic methods of exhibiting and device of various dimensions |
| CN110189412A (en) * | 2019-05-13 | 2019-08-30 | 武汉大学 | More floor doors structure three-dimensional modeling methods and system based on laser point cloud |
| WO2020006941A1 (en) * | 2018-07-03 | 2020-01-09 | 上海亦我信息技术有限公司 | Method for reconstructing three-dimensional space scene on basis of photography |
| CN111462326A (en) * | 2020-03-31 | 2020-07-28 | 武汉大学 | Low-cost 360-degree panoramic video camera urban pipeline three-dimensional reconstruction method and system |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101958891A (en) * | 2010-09-01 | 2011-01-26 | 上海杰图房网信息科技有限公司 | System and method for constructing house property panoramic exhibition by using portable shooting device |
| CN102393939A (en) * | 2011-07-13 | 2012-03-28 | 上海杰图看房网络有限公司 | Method and system for house property panoramic exhibition by portable terminal |
| CN107169136A (en) * | 2017-06-09 | 2017-09-15 | 成都智建新业建筑设计咨询有限公司 | Houseclearing three-dimensional panorama display systems |
| CN108010092B (en) * | 2017-12-26 | 2018-11-13 | 哈尔滨工业大学 | A kind of city high density area Solar use potential evaluation method based on low altitude photogrammetry |
| US10872467B2 (en) * | 2018-06-06 | 2020-12-22 | Ke.Com (Beijing) Technology Co., Ltd. | Method for data collection and model generation of house |
| CN111145352A (en) * | 2019-12-20 | 2020-05-12 | 北京乐新创展科技有限公司 | House live-action picture display method and device, terminal equipment and storage medium |
| CN111524230B (en) * | 2020-04-01 | 2021-01-26 | 中南大学 | Linkage browsing method for three-dimensional model and unfolded panoramic image and computer system |
-
2021
- 2021-06-23 CN CN202110699231.6A patent/CN113487723B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103400415A (en) * | 2013-08-07 | 2013-11-20 | 赞奇科技发展有限公司 | Implementation method and system for automatic generation and on-line interaction of three-dimensional digital model with planar space structure |
| CN106096153A (en) * | 2016-06-16 | 2016-11-09 | 上海营匠网络科技有限公司 | Indoor decoration outdoor scene is experienced scene and is provided method and system |
| WO2018069736A1 (en) * | 2016-10-14 | 2018-04-19 | Axial Medical Printing Limited | A method for generating a 3d physical model of a patient specific anatomic feature from 2d medical images |
| CN108470037A (en) * | 2018-02-07 | 2018-08-31 | 链家网（北京）科技有限公司 | A kind of the three-dimensional scenic methods of exhibiting and device of various dimensions |
| WO2020006941A1 (en) * | 2018-07-03 | 2020-01-09 | 上海亦我信息技术有限公司 | Method for reconstructing three-dimensional space scene on basis of photography |
| CN110189412A (en) * | 2019-05-13 | 2019-08-30 | 武汉大学 | More floor doors structure three-dimensional modeling methods and system based on laser point cloud |
| CN111462326A (en) * | 2020-03-31 | 2020-07-28 | 武汉大学 | Low-cost 360-degree panoramic video camera urban pipeline three-dimensional reconstruction method and system |
Non-Patent Citations (2)
| Title |
|---|
| Google Street View:Capturing the World at Street Level;Carole D;《Computer》;第43卷(第6期);第32-38页 * |
| 面向iOS的移动端全景地图构建方法;赵鹏程等;《地理与地理信息科学》(第01期);第99-103页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113487723A (en) | 2021-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113487723B (en) | House online display method and system based on measurable panoramic three-dimensional model | |
| US11783409B1 (en) | Image-based rendering of real spaces | |
| CN112053446B (en) | Real-time monitoring video and three-dimensional scene fusion method based on three-dimensional GIS | |
| US11729245B2 (en) | Platform for constructing and consuming realm and object feature clouds | |
| US11645781B2 (en) | Automated determination of acquisition locations of acquired building images based on determined surrounding room data | |
| CN110874818B (en) | Image processing and virtual space construction method, device, system and storage medium | |
| CN102959946A (en) | Augmenting image data based on related 3d point cloud data | |
| US20080112610A1 (en) | System and method for 3d model generation | |
| US20190378332A1 (en) | Systems and methods for filling holes in a virtual reality model | |
| CN109102566A (en) | A kind of indoor outdoor scene method for reconstructing and its device of substation | |
| Zalama et al. | An effective texture mapping approach for 3D models obtained from laser scanner data to building documentation | |
| CN112270736B (en) | Augmented reality processing method and device, storage medium and electronic equipment | |
| CN110660125B (en) | Three-dimensional modeling device for power distribution network system | |
| WO2020211427A1 (en) | Segmentation and recognition method, system, and storage medium based on scanning point cloud data | |
| CN113379901A (en) | Method and system for establishing house live-action three-dimension by utilizing public self-photographing panoramic data | |
| CN116051747A (en) | House three-dimensional model reconstruction method, device and medium based on missing point cloud data | |
| Franz et al. | Real-time collaborative reconstruction of digital building models with mobile devices | |
| US7126603B2 (en) | Method and system for creating interactive walkthroughs of real-world environment from set of densely captured images | |
| JP2004110459A (en) | Three-dimensional model space creating device, three-dimensional model space creating method, three-dimensional model space creating program, and content transmitting server | |
| Reitinger et al. | Augmented reality scouting for interactive 3d reconstruction | |
| Zlatanova et al. | Modelling for 3D GIS: Spatial analysis and visualisation through the web | |
| CN114048541B (en) | Asset space marking method and system based on digital twins | |
| Sequeira et al. | Hybrid 3D reconstruction and image-based rendering techniques for reality modeling | |
| CN112256771A (en) | Exhibition platform system for expo | |
| Drap et al. | Photogrammetry and archaeological knowledge: toward a 3D information system dedicated to medieval archaeology: A case study of Shawbak Castle in Jordan |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |