CN117523128A - Three-dimensional modeling method and system for realizing city information based on big data - Google Patents

Abstract

The invention belongs to the technical field of urban space big data mining, collection and analysis. Specifically, it refers to a three-dimensional modeling method and system for realizing urban information based on big data, including a data acquisition module, a data processing module, a three-dimensional modeling algorithm module, and visualization. module, security and privacy module and system management module; the invention integrates multiple modules and realizes the comprehensive integration of urban data, including geography, buildings, traffic flow and population data, through the synergy of the data collection module and the data processing module. This method not only improves the accuracy and comprehensiveness of urban information databases, but also enhances the intelligence level of urban planning and management.

Description

A three-dimensional modeling method and system for urban information based on big data

Technical field

The invention belongs to the technical field of urban spatial big data mining, collection and analysis, and specifically refers to a three-dimensional modeling method and system for realizing urban information based on big data.

Background technique

As cities increase in size and complexity, accurate and efficient 3D modeling of urban information becomes increasingly important. At present, the three-dimensional modeling system of urban information shows great potential in the context of big data. However, there are still some bottlenecks and challenges in the existing technology.

First of all, traditional urban modeling methods face the complexity of data acquisition and integration. Urban information covers multiple fields, including geographical information, building information, traffic flow, demographics, etc. These data sources are extensive but scattered, resulting in data collection and Integration is difficult to achieve efficiently. When dealing with these heterogeneous data sources, current technology lacks a unified and efficient data integration method, which limits the comprehensiveness and accuracy of urban information modeling.

Secondly, existing modeling algorithms have limitations in processing large-scale, high-dimensional data. The geographical and architectural information of cities is very large, and it is often difficult to meet the requirements for high-quality and efficient data processing using traditional modeling algorithms. In the era of big data, more advanced algorithms and technologies are needed to fully mine and utilize this information to improve the accuracy and efficiency of 3D modeling. In addition, there are still challenges in user interaction and visualization. Traditional urban information systems are usually limited in user interaction and visualization, and it is difficult to provide intuitive and flexible operation interfaces. In areas such as urban planning and management, users need a higher degree of expertise. Immersive experience and real-time interactivity, while existing technologies have certain deficiencies in this regard.

Contents of the invention

In view of the above situation, in order to overcome the shortcomings of the existing technology, the present invention provides a three-dimensional modeling system for urban information based on big data, in order to solve the limitations of existing modeling algorithms in processing large-scale, high-dimensional data. The geographical and architectural information of the city is very large, and it is often difficult to meet the requirements for high-quality and efficient data processing using traditional modeling algorithms. The present invention integrates multiple modules, through the synergy of the data acquisition module and the data processing module. , realizing the comprehensive integration of various types of urban data, including geographical information, building information, traffic flow, and demographic data. This helps build a more accurate and comprehensive city information database.

The technical solutions adopted by the present invention are as follows: The present invention provides a three-dimensional modeling system for urban information based on big data, including:

Data collection module: used to collect various types of urban data, including geographical information, building information, traffic flow, and demographic data;

Data processing module: cleans, integrates and preprocesses the collected data to ensure the accuracy and consistency of the data; 3D modeling algorithm module: implements a 3D modeling algorithm based on urban data, and integrates various types of collected data Convert to 3D model;

Visualization module: used to present the generated three-dimensional model in an intuitive way and support user interaction;

User interface module: Provides an interface for users to interact with the system, including functions for querying city information and editing models;

Security and privacy module: ensure the security of data collection, processing, storage and display, and prevent unauthorized access and data leakage;

System management module: Monitor, maintain and manage the entire system to ensure system stability and availability, including system configuration, performance monitoring, and troubleshooting functions.

Further, data sources include sensors, satellite remote sensing, social media, and municipal facilities.

Further, the interface for users to interact with the system is a graphical interface (GUI) and a Web interface.

Further, the data processing module includes:

The data cleaning and integration unit detects and corrects errors, missing values, and outliers in the data, integrates data from different sources, and ensures format consistency;

The data preprocessing unit performs preliminary processing on the data, including normalization, standardization, and dimensionality reduction operations;

The spatial data processing unit performs specialized spatial data processing based on the spatial characteristics of urban information, including geographical coordinate conversion and GIS processing;

The data management and security protection unit uses big data processing technology to ensure data security, perform real-time and batch processing, and process data generated in real time to ensure compliance with privacy regulations and desensitize and encrypt sensitive information.

Furthermore, the data preprocessing unit uses a distributed computing framework to accelerate data processing. The algorithm steps are as follows: Map stage: the input data is split into multiple small blocks, and each block is processed by a Map task. The block data is processed to generate key-value pairs;

Shuffle phase: Transfer data with the same key to the same Reduce task. This phase is automatically completed by the framework.

Reduce stage: perform aggregation operations on each key to generate the final result.

Further, the three-dimensional modeling algorithm module includes:

The voxelization algorithm unit divides the urban space into small cubes and assigns corresponding attribute information to each voxel, and is responsible for converting the attribute information into a three-dimensional model;

The point cloud processing algorithm unit processes urban point cloud data collected through lidar and camera sensors, and converts the point cloud data into a three-dimensional model;

The BIM algorithm unit, based on the parametric three-dimensional modeling method of the building, integrates various information of the building, including structure, materials, and functions, to form a highly information-based three-dimensional model;

The GIS and geographical information modeling unit uses geographical information system technology to model various urban elements in the form of geographical coordinates, and combines big data technology to integrate geographical information data from different sources to achieve more precise and comprehensive three-dimensional urban modeling;

The image recognition and computer vision unit uses satellite images for modeling, uses computer vision technology for image recognition, and converts the identified features into a three-dimensional model;

The deep learning and generative model unit uses deep learning technology to train neural networks to learn urban characteristics from large-scale data. Use generative models to generate 3D models of cities.

Furthermore, the BIM algorithm unit adopts a parametric modeling algorithm, and the algorithm formula is as follows:

Parameter definition: Define a set of parameters, the length (L), width (W), and height (H) of the building;

Parametric modeling: Use the defined parameters to construct the geometric shape of the building. The volume of the building is expressed as V=L*W*H; Attribute association: Associate the parameters with other attributes of the building, the structure and height of the building Association, if the height is greater than a certain threshold, a specific structure is adopted;

Model update: When parameters change, the building model is automatically updated. If the user changes the length parameters of the building, the system will recalculate the geometry of the building.

Furthermore, the deep learning and generative model unit uses the convolutional neural network algorithm, and the generative model uses the generative adversarial network algorithm. The algorithm formula is as follows:

Convolutional neural network algorithm:

Convolutional layer formula:

Gomv(x,w)=σ(x*w+b);

Among them, x is the input data, w is the convolution kernel, b is the bias term, and σ is the activation function;

Pooling layer:

Pool(x)=max(x);

Among them, x is the data in the pooling window;

Generative adversarial network algorithm:

Generator:

G(z);

Among them, z is the input random noise;

Discriminator:

D(x);

Among them, x is the input data;

Adversarial training process:

This plan also discloses an operation method for realizing a three-dimensional modeling system of urban information based on big data, which mainly includes the following steps:

Step A1: Use the data collection module to collect various types of urban data, including geographical information, building information, traffic flow, and demographic data. The data comes from multiple sources such as sensors, satellite remote sensing, municipal facilities, and social media;

Step A2: Use the data processing module to clean, integrate and preprocess the collected data, including processing errors, missing values and outliers in the data to ensure the consistency and accuracy of the data;

Step A3: Use the 3D modeling algorithm module to implement 3D modeling based on urban data;

Step A4: Use the visualization module to present the generated three-dimensional model in an intuitive way, including graphics processing technology and virtual reality technology to support user interaction;

Step A5: Provide a user interface module that allows users to query city information and edit models. Users can interact with the system through the graphical interface or Web interface to obtain the required information and participate in the modeling process;

Step A6: At each stage of data collection, processing, storage and display, use the security and privacy module to ensure the security of the system, including the processing of sensitive information, data encryption, and access control;

Step A7: Use the system management module to monitor, maintain and manage the entire system, including configuration management, performance monitoring, troubleshooting and other functions to ensure the stability and availability of the system.

The beneficial effects achieved by the present invention using the above structure are as follows: The present invention provides a three-dimensional modeling system for urban information based on big data, and achieves the following beneficial effects:

(1) Comprehensive data integration: Through the synergy of the data collection module and the data processing module, the comprehensive integration of various urban data is achieved, including geographical information, building information, traffic flow, and demographic data. This helps build a more accurate and comprehensive city information database.

(2) High-quality three-dimensional modeling: Utilize the three-dimensional modeling algorithm module and adopt advanced algorithms such as voxelization, point cloud modeling, and BIM to transform urban data into high-quality three-dimensional models. This helps reflect urban geography and architectural features, providing users with an intuitive visualization experience.

(3) User-friendly interactive interface: Through the interface provided by the user interface module, users can easily query city information, edit models, etc. This helps improve the usability of the system and enables users to more intuitively participate in the process of exploring and modeling urban information.

(4) Security and privacy protection: The security and privacy module ensures the security of data in all aspects of data collection, processing, storage and display, and prevents unauthorized access and data leakage. This helps build user trust and ensures sensitive information is handled appropriately.

(5) System stability and maintainability: The entire system is monitored, maintained and managed through the system management module to ensure system stability and availability. This helps to promptly discover and solve potential problems, improve system stability, and provide users with reliable services.

Description of drawings

Figure 1 is a flow chart of a three-dimensional modeling system for realizing urban information based on big data proposed by the present invention.

The drawings are used to provide a further understanding of the present invention and constitute a part of the specification. They are used to explain the present invention together with the embodiments of the present invention and do not constitute a limitation of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.

Example 1:

Please refer to Figure 1. This embodiment is a three-dimensional modeling system for urban information based on big data, including a data acquisition module, a data processing module, a three-dimensional modeling algorithm module, a visualization module, a security and privacy module and system management. module; among them, the data collection module is used to collect various types of urban data, including geographical information, building information, traffic flow, and demographic data;

Among them, the data processing module cleans, integrates and pre-processes the collected data to ensure the accuracy and consistency of the data;

Among them, the three-dimensional modeling algorithm module implements the three-dimensional modeling algorithm based on urban data and converts various types of collected data into three-dimensional models;

Among them, the visualization module is used to present the generated three-dimensional model in an intuitive way to support user interaction;

Among them, the user interface module provides an interface for users to interact with the system, including functions for querying city information and editing models;

Among them, the security and privacy module ensures the security of data collection, processing, storage and display, and prevents unauthorized access and data leakage;

Among them, the system management module monitors, maintains and manages the entire system to ensure the stability and availability of the system, including system configuration, performance monitoring, and troubleshooting functions.

Example 2:

Please refer to Figure 1. This embodiment is a method of using a three-dimensional modeling system for urban information based on big data, including the following steps:

Step A1: Use the data collection module to collect various types of urban data, including geographical information, building information, traffic flow, and demographic data. The data comes from multiple sources such as sensors, satellite remote sensing, municipal facilities, and social media;

Step A2: Use the data processing module to clean, integrate and preprocess the collected data, including processing errors, missing values and outliers in the data to ensure the consistency and accuracy of the data;

Step A3: Use the 3D modeling algorithm module to implement 3D modeling based on urban data;

Step A4: Use the visualization module to present the generated three-dimensional model in an intuitive way, including graphics processing technology and virtual reality technology to support user interaction;

Step A5: Provide a user interface module that allows users to query city information and edit models. Users can interact with the system through the graphical interface or Web interface to obtain the required information and participate in the modeling process;

Step A6: At each stage of data collection, processing, storage and display, use the security and privacy module to ensure the security of the system, including the processing of sensitive information, data encryption, and access control;

Step A7: Use the system management module to monitor, maintain and manage the entire system, including configuration management, performance monitoring, troubleshooting and other functions to ensure the stability and availability of the system.

Although the embodiments of the present invention have been shown and described, those of ordinary skill in the art will understand that various changes, modifications, and substitutions can be made to these embodiments without departing from the principles and spirit of the invention. and modifications, the scope of the invention is defined by the appended claims and their equivalents.

The present invention and its embodiments have been described above. This description is not limiting. What is shown in the drawings is only one embodiment of the present invention, and the actual structure is not limited thereto. In short, if a person of ordinary skill in the art is inspired by the invention and without departing from the spirit of the invention, can devise structural methods and embodiments similar to the technical solution without inventiveness, they shall all fall within the protection scope of the invention.

Claims (9)

1. A three-dimensional modeling system based on big data to realize urban information, which is characterized by including: Data collection module: used to collect various types of urban data, including geographical information, building information, traffic flow, and demographic data; Data processing module: cleans, integrates and preprocesses the collected data to ensure data accuracy and consistency; Three-dimensional modeling algorithm module: implements three-dimensional modeling algorithms based on urban data and converts various types of collected data into three-dimensional models; Visualization module: used to present the generated three-dimensional model in an intuitive way and support user interaction; User interface module: Provides an interface for users to interact with the system, including functions for querying city information and editing models; Security and privacy module: ensure the security of data collection, processing, storage and display, and prevent unauthorized access and data leakage; System management module: Monitor, maintain and manage the entire system to ensure system stability and availability, including system configuration, performance monitoring, and troubleshooting functions. 2. A three-dimensional modeling system for urban information based on big data according to claim 1, characterized in that: data sources include sensors, satellite remote sensing, social media, and municipal facilities. 3. A three-dimensional modeling system for realizing urban information based on big data according to claim 2, characterized in that: the interface for users to interact with the system is a graphical interface (GUI) or a Web interface. 4. A three-dimensional modeling system for urban information based on big data according to claim 3, characterized in that: the data processing module module includes: The data cleaning and integration unit detects and corrects errors, missing values, and outliers in the data, integrates data from different sources, and ensures format consistency; The data preprocessing unit performs preliminary processing on the data, including normalization, standardization, and dimensionality reduction operations; The spatial data processing unit performs specialized spatial data processing based on the spatial characteristics of urban information, including geographical coordinate conversion and GIS processing; The data management and security protection unit uses big data processing technology to ensure data security, perform real-time and batch processing, and process data generated in real time to ensure compliance with privacy regulations and desensitize and encrypt sensitive information. 5. A three-dimensional modeling system for urban information based on big data according to claim 4, characterized in that: the data preprocessing unit adopts a distributed computing framework to accelerate data processing, and its algorithm steps are as follows: Map stage: The input data is split into multiple small blocks, each block is processed by a Map task, and the data of each small block is processed to generate key-value pairs; Shuffle phase: transfer data with the same key to the same Reduce task. This phase is automatically completed by the framework. Reduce phase: aggregate operation is performed on each key to generate the final result. 6. A three-dimensional modeling system for realizing urban information based on big data according to claim 5, characterized in that: the three-dimensional modeling algorithm module includes: The voxelization algorithm unit divides the urban space into small cubes and assigns corresponding attribute information to each voxel, and is responsible for converting the attribute information into a three-dimensional model; The point cloud processing algorithm unit processes urban point cloud data collected through lidar and camera sensors, and converts the point cloud data into a three-dimensional model; The BIM algorithm unit, based on the parametric three-dimensional modeling method of the building, integrates various information of the building, including structure, materials, and functions, to form a highly information-based three-dimensional model; The GIS and geographical information modeling unit uses geographical information system technology to model various urban elements in the form of geographical coordinates, and combines big data technology to integrate geographical information data from different sources to achieve more precise and comprehensive three-dimensional urban modeling; The image recognition and computer vision unit uses satellite images for modeling, uses computer vision technology for image recognition, and converts the identified features into a three-dimensional model; The deep learning and generative model unit uses deep learning technology to train a neural network to learn urban characteristics from large-scale data, and uses a generative model to generate a three-dimensional model of the city. 7. A three-dimensional modeling system based on big data to realize urban information according to claim 6, characterized in that: the BIM algorithm unit adopts a parametric modeling algorithm, and the formula of the algorithm is as follows: Parameter definition: Define a set of parameters, the length (L), width (W), and height (H) of the building; Parametric modeling: Use the defined parameters to construct the geometric shape of the building, and the volume of the building is expressed as V=L*W*H; Attribute association: associate parameters with other attributes of the building. The structure of the building is associated with the height. If the height is greater than a certain threshold, a specific structure is adopted; Model update: When parameters change, the building model is automatically updated. If the user changes the length parameters of the building, the system will recalculate the geometry of the building. 8. A three-dimensional modeling system based on big data to realize urban information according to claim 7, characterized in that: the deep learning and generative model unit adopts a convolutional neural network algorithm, and the generative model adopts a generative adversarial network algorithm, and its algorithm The formula is as follows: Convolutional neural network algorithm: Convolutional layer formula: Conv(x,w)=σ(x*w+b); Among them, x is the input data, w is the convolution kernel, b is the bias term, and σ is the activation function; Pooling layer: Fool(x)=max(x); Among them, x is the data in the pooling window; Generative adversarial network algorithm: Generator: G(z); Among them, z is the input random noise; Discriminator: D(x); Among them, x is the input data; Adversarial training process: 9. A three-dimensional modeling method based on big data to realize urban information, characterized in that: utilizing a three-dimensional modeling system based on big data to realize urban information according to claim 8 is operated, which mainly includes the following steps: Step A1: Use the data collection module to collect various types of urban data, including geographical information, building information, traffic flow, and demographic data. The data comes from multiple sources such as sensors, satellite remote sensing, municipal facilities, and social media; Step A2: Use the data processing module to clean, integrate and preprocess the collected data, including processing errors, missing values and outliers in the data to ensure the consistency and accuracy of the data; Step A3: Use the 3D modeling algorithm module to implement 3D modeling based on urban data; Step A4: Use the visualization module to present the generated three-dimensional model in an intuitive way, including graphics processing technology and virtual reality technology to support user interaction; Step A5: Provide a user interface module that allows users to query city information and edit models. Users can interact with the system through the graphical interface or Web interface to obtain the required information and participate in the modeling process; Step A6: At each stage of data collection, processing, storage and display, use the security and privacy module to ensure the security of the system, including the processing of sensitive information, data encryption, and access control; Step A7: Use the system management module to monitor, maintain and manage the entire system, including configuration management, performance monitoring, troubleshooting and other functions to ensure the stability and availability of the system.