CN115146953A - Smart city evaluation index data management method and system - Google Patents

Smart city evaluation index data management method and system Download PDF

Info

Publication number
CN115146953A
CN115146953A CN202210765910.3A CN202210765910A CN115146953A CN 115146953 A CN115146953 A CN 115146953A CN 202210765910 A CN202210765910 A CN 202210765910A CN 115146953 A CN115146953 A CN 115146953A
Authority
CN
China
Prior art keywords
data
access
index data
evaluation index
maintenance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210765910.3A
Other languages
Chinese (zh)
Inventor
张红卫
范科峰
张群
彭革非
于浩
刘�文
李腾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Electronics Standardization Institute
Original Assignee
China Electronics Standardization Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Electronics Standardization Institute filed Critical China Electronics Standardization Institute
Priority to CN202210765910.3A priority Critical patent/CN115146953A/en
Publication of CN115146953A publication Critical patent/CN115146953A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • G06Q10/06393Score-carding, benchmarking or key performance indicator [KPI] analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/62Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G06F21/6245Protecting personal data, e.g. for financial or medical purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/062Securing storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671In-line storage system
    • G06F3/0683Plurality of storage devices
    • G06F3/0689Disk arrays, e.g. RAID, JBOD

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Human Resources & Organizations (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Strategic Management (AREA)
  • Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • Development Economics (AREA)
  • Educational Administration (AREA)
  • Economics (AREA)
  • Computer Security & Cryptography (AREA)
  • Game Theory and Decision Science (AREA)
  • Software Systems (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Computer Hardware Design (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

According to the method and the system for managing the smart city evaluation index data, the smart city evaluation index is collected in a partition mode according to the geographic spatial position, comprehensive collection of evaluation data is achieved with low cost, and after the data index to be improved is given out subsequently, backtracking feedback solution can be well carried out according to the spatial position information; and the storage cost and the storage safety are considered; the use of the whole storage system cannot be influenced by the fault of a certain node; the quality of the acquired data is improved through processing and analysis; the city planning and management are facilitated to be more scientific and advanced; and index data related to the citizen privacy are desensitized, the citizen privacy is protected, and finally, the access to a data system is completed, so that the related loss caused by downtime is avoided.

Description

Smart city evaluation index data management method and system
Technical Field
The invention relates to the technical field of smart cities, in particular to a smart city evaluation index data management method and system.
Background
With the continuous acceleration of city informatization pace, the rise of data science and the development and the perfection of digital cities, a sequence-reading screen is pulled for the construction of smart cities, the smart cities become a new direction for the development of future cities in the world, the core of the smart cities is the management and the application of data, and the construction of the smart cities is the construction of city systems taking the data as centers.
Along with the rapid development of economy in China, the urbanization speed is continuously accelerated, the number of cities is rapidly increased, and the scale of the cities is rapidly expanded, but the construction of smart cities relates to various contents of city development, and the bulkiness and complexity of the smart cities determine that the construction of the smart cities can be built at once; this brings a series of considerable problems, such as resource environment problem, urban traffic problem, and difficulty in transformation and upgrade of cities.
However, the existing smart city evaluation index data management system cannot make a good choice between system safety and construction cost, the two cannot be considered, the existing index data management system is relatively chaotic, the smart city is realized on the basis of sensor resource observation application, the types of urban sensor resources are various, the observation mechanisms are different, the existing system is not deep enough in data mining and analysis, the existing data is not sufficiently utilized, corresponding safety measures are relatively weak, and the system is easy to crash when large access flow is faced.
Therefore, those skilled in the art are dedicated to develop a method and system for managing data of smart city assessment index to solve the above-mentioned deficiencies of the prior art.
Disclosure of Invention
In view of the above drawbacks of the prior art, the technical problem to be solved by the present invention is that in the prior art, the method and system for managing the smart city evaluation index data cannot achieve a compromise between the construction cost of the data management system and the system security; the existing system is insufficient in utilization and mining of related index data, so that a large amount of data is wasted; the security of the data system is not enough, and needs to be improved urgently.
In order to achieve the purpose, the invention discloses a smart city evaluation index data management method and a smart city evaluation index data management system, which comprise the following steps:
step 1, collecting smart city evaluation index data;
step 2, storing the evaluation index data acquired in the step 1;
step 3, data management and data maintenance are carried out after the data stored in the step 2 are collected;
step 4, inputting the data subjected to quality improvement into a smart city evaluation index data management system for people to access and use;
the smart city evaluation index acquisition is the basis and source of all subsequent steps, and the smart city evaluation index data acquisition is the foundation of the whole system;
further, the smart city evaluation index relates to natural, economic, social and other information factors in the smart city; the existing smart city evaluation index data comprise all things, the index data type is complex and relates to all trades, but strong correlation is still presented between the index data type and the geographic spatial position; most of the index data relates to geospatial location;
furthermore, the smart city assessment data acquisition is sequentially refined to the street according to the administrative region as a basis and the final assessment index acquisition; the task of index data acquisition can be implemented on a specific street, and incomplete data acquisition caused by lack of relevant index information of department urban areas in the subsequent process is avoided; or repeated collection is caused, and resources are wasted;
furthermore, the smart city evaluation index acquisition process is wide in related range, large in depth and diverse in data, and the smart city evaluation indexes are acquired in a partition mode according to the geographic spatial positions, so that the comprehensive acquisition of evaluation data can be realized at lower cost, the personnel organization structure of administrative divisions is fully utilized, and the acquisition resistance is small;
furthermore, in the data acquisition process, data are acquired according to the geographic and spatial position information, and after data indexes to be improved are given in the subsequent steps, backtracking feedback solution can be better performed by using the spatial position information;
step 2, storing the evaluation index data acquired in the step 1;
furthermore, the storage of the evaluation index data adopts distributed storage, the evaluation index data are respectively stored on a plurality of storage servers, and a certain disk array is formed on the plurality of storage servers;
furthermore, the specific selection of the disk array can be flexibly selected according to the evaluation index data amount to be stored and the specific urban situation, and the storage cost and the storage safety are considered;
furthermore, the distributed storage system can continue to complete storage work when some server nodes have faults, has a fault-tolerant function, and cannot influence the use of the whole storage system due to the fault of a certain node;
further, the storage system is provided with a high-speed storage area and a low-speed storage area; the high-speed storage area is used for storing relevant index data which are being collected and are collected recently, and the higher storage speed can improve the operation efficiency of the whole system;
furthermore, a low-speed storage area in the storage system is mainly used for storing the historical data of the evaluation index of the smart city, wherein the historical data is mainly based on the current time of the acquisition time interval, the use frequency of the historical data is low, and under the balance of the storage cost, the storage cost and the electricity charge for system operation can be saved by adopting a storage medium with a lower storage speed; the system is more environment-friendly to operate;
furthermore, in order to save storage capacity and reduce storage cost, the storage system adopts a high-density compression algorithm aiming at the smart city evaluation index historical data, and stores the smart city evaluation index historical data in low-rate storage equipment after high-density compression;
furthermore, the servers in the storage system can form a redundant array of disks to improve the fault tolerance rate of the storage device, so that the safety of data can be greatly improved, and the capacity of improving the data reading and writing performance is also added;
step 3, data management and data maintenance are carried out after the data stored in the step 2 are collected;
after the evaluation index data is collected, only basic data is collected, and the basic data contains huge practical value but cannot be directly utilized by people, wherein a large amount of data pollution and data garbage inevitably exist, and required information cannot be visually reflected, so that data management needs to be carried out on the massive data, and the quality of the collected data is improved through processing and analysis;
further, the data management comprises data cleaning and data mining;
furthermore, the data cleaning is mainly realized by manual participation, and supervised data cleaning is formed; if abnormal data and repeated records exist, deleting the data by manual supervision; if the missing value exists, corresponding supplement is carried out manually; the core of the cleaning strategy is to find problem evaluation index data and correct evaluation index data;
furthermore, the data mining is mainly aimed at storing collected smart city evaluation index data,
the smart city evaluation index data range is wide, the field is wide, the base number is large, the quantity is large, the data types are rich, if mining analysis is not performed on all index data, the collected evaluation index data is utilized through a random analysis method such as sampling survey, the collection of comprehensive data in the step 1 is wasted, and the result obtained by the random analysis method is not persuasive;
furthermore, the massive data inevitably has the integral characteristic, and if data mining analysis is not performed, the massive data only has subjectivity, one-sidedness and blindness, and the isolated massive data cannot be fully utilized, data mining is not actively performed, and the data mining is to find out hidden information from numerous data which seems to be unrelated;
furthermore, in the aspect of urban planning, the data mining is used for discussing deep mining of urban natural geographic information data such as environment, geology and water resources and social and humanistic information such as social economy, social culture and population information, so that strong decision support can be provided for urban planning, and the scientificity and the advancement of urban management are enhanced;
furthermore, the data mining can utilize a highly integrated data network, and can timely and comprehensively reflect the mainstream will of the current society through comprehensive analysis and extraction of data, thereby being beneficial to comprehensively grasping the social sentiment and the folk meaning and promoting the government and enterprises to improve the public service capability;
furthermore, the data mining is in the field of disaster prevention, early warning information of emergencies such as artificial or natural disasters and terrorist events can be obtained in time through deep mining of the data, effective measures are adopted for prevention, and emergency handling capacity and safety precaution capacity are improved;
further, the data maintenance comprises safety maintenance, monitoring maintenance, detection maintenance and the like;
furthermore, the safety maintenance in the data maintenance is to perform data desensitization processing on the acquired and received information, and perform desensitization safety processing on the relevant acquired citizen information in the data maintenance; the method has the advantages that relevant privacy data of the citizen are correctly used, the privacy rights and interests of the citizen are maintained, and meanwhile, the trouble of the citizen possibly caused by the leakage of unexpected factors is avoided;
furthermore, the monitoring and maintenance is to provide an operation and maintenance monitoring function, and can conveniently use a visualization tool to perform related operation and maintenance monitoring, when monitoring finds abnormality, an alarm can be generated at the first time, related operation and maintenance personnel are notified to check and perform corresponding processing in time, the generation of online faults is reduced to the maximum extent, and the influence of the faults is reduced;
furthermore, the detection maintenance outputs a detection log report, records in the data processing and maintenance process are all recorded in the detection log, so that the labor cost and the consumed cost can be reduced, and the operation and maintenance personnel can be helped to master the operation state of the index data management system in multiple dimensions and multiple directions based on the log generated by the detection maintenance, so that the stability and the value of the system operation are greatly improved;
step 4, inputting the data subjected to quality improvement into a smart city evaluation index data management system for people to access and use;
further, the access comprises access management and access security;
further, the access management comprises the steps that users which can be accessed by adding and deleting can be created, and different access rights are opened for different access users, and good access management is a precondition for ensuring correct use of data; the content and the time of the user who accesses the data can be recorded to form a log, and the operation and maintenance personnel can check the log and better supervise the use of the evaluation index data;
furthermore, the access security mainly means that when an access request with a sudden and large capacity is directed, the evaluation index data management system may cause a system downtime due to the promotion of instantaneous access, and threatens the access security of the system, the existence of the access security mainly aims to limit the current and protect the system, when a sudden access flow is too large in a sudden situation, the access contact of a user with ordinary authority access is actively broken, only the user with higher authority and an administrator are allowed to access, and the system is prevented from being crashed due to the too large access flow to cause damage to data;
furthermore, when the access is used, a foreground user firstly selects the year, if cold data exceeding the last 2 years is selected, slower storage content needs to be called, the selected year serves as a query condition, the background records the cold data during the access, and when a relative search condition is input, the input keywords are uploaded to the foreground user for the access user to use according to the search condition;
in a specific embodiment of the present invention, in the step 2, a specific cold data compression algorithm adopted is LZMA2;
in a specific embodiment of the present invention, the time of the historical data in step 2 is set to 2 years.
By adopting the scheme, the smart city evaluation index data management method and the smart city evaluation index data management system disclosed by the invention have the following advantages:
(1) According to the smart city assessment index data management method and system, the smart city assessment indexes are collected in a partition mode according to the geographic space positions, so that comprehensive collection of assessment data can be achieved with low cost, the organization structure of personnel in administrative districts is fully utilized, and collection resistance is low; in the storage, a storage disk array is formed on a plurality of distributed storage servers; the method can be flexibly set according to specific cities, and the storage cost and the data storage safety are considered; the use of the whole storage system cannot be influenced by the fault of a certain node;
(2) According to the intelligent city evaluation index data management method and system, data cleaning and data mining are carried out on the data, the data cleaning finds and corrects the problem evaluation index data, and the quality of the acquired data is improved through processing and analysis; finding out hidden information from a plurality of data which seems to be unrelated; the city planning is assisted to provide strong decision support, and the scientificity and advancement of city management are enhanced; the data is desensitized, privacy safety of residents is maintained, and in a sudden situation, when transient access flow is overlarge, access contact of users with ordinary permission is actively broken, only the users with higher permission and an administrator are allowed to access, and the data is prevented from being damaged due to downtime of a system caused by overlarge access flow;
in summary, the smart city assessment index data management method and system disclosed by the invention make full use of the existing city structure, take account of the data storage cost and the data storage security, and make full use of the existing data to find out the implicit information; the city planning is assisted to provide decision support, the scientificity and the advancement of city management are enhanced, the protection of user privacy is enhanced, and the access to a data system is improved.
The conception, the specific technical solutions and the technical effects produced by the present invention will be further described with reference to the following detailed description so as to fully understand the objects, the features and the effects of the present invention.
Drawings
FIG. 1 is a diagram of a basic structure of a smart city assessment index data management system according to the present invention.
Detailed Description
The following describes several preferred embodiments of the present invention to make the technical contents thereof clearer and easier to understand. The present invention may be embodied in many different forms of embodiments, which are exemplary descriptions and the scope of the present invention is not limited to the embodiments described herein.
Example management of evaluation index data of market A
Step 1, collecting smart city evaluation index data: the step is strongly bound with the geographical location information of the city and is greatly influenced by the geographical location information related to the city;
the evaluation index data of the existing smart city is complex in various aspects of city development, and the smart city is large and complex in complexity. However, the city evaluation index data is acquired in step 1 according to the related geographic spatial position information, so that evaluation dimensionality of the evaluation index data can be enhanced, the administrative division set by the city A is fully utilized, workers in the administrative division can be well mobilized to complete acquisition of the index data, the acquisition of the spatial position information is bound, when a smart city construction modification suggestion is subsequently provided, the feedback solution can be directly traced back, the evaluation data acquisition of the city is more comprehensive, and the good and comprehensive index data acquisition is the basis for completing the subsequent steps.
Then, step 2 is carried out, and the evaluation index data collected in the step 1 is stored;
the evaluation index data in the step 1 can be respectively stored on a plurality of distributed storage servers, and the disks on the storage servers can form a RAID5 disk array, wherein RAID is a technology which combines a plurality of independent physical disks according to different RAID levels to form a disk group, logically looks like a large disk, can provide larger storage capacity or higher storage performance than a single physical disk, and can provide data redundancy backup of different levels. The RAID5 specifically adopted in the market adopts parity check, the reliability is strong, the data can be damaged only when 2 disks are damaged simultaneously by the system, the data can be reconstructed by the system according to the stored parity check bits only when 1 disk is damaged, the storage access service is temporarily provided, the storage cost and the storage safety are considered by constructing the disk array, and the extra data read-write capacity can be improved by adopting the storage mode;
the storage system for city data management adopts two storage devices with different rates, the cost of the low-rate storage device is lower, the data management system can store historical cold data generated 2 years ago in a low-speed storage area in the storage system, and the historical cold data 2 years ago can be stored in the low-speed storage area after being highly compressed through a high-compression LZMA2 algorithm, so that the storage space is further saved; the market reduces the storage cost and gives consideration to the safety through the hybrid use of the disk array and the high-speed and low-speed storage media.
Step 3, data management and data maintenance are carried out after the data stored in the step 2 are collected;
wherein the data management comprises data cleaning and data mining;
the data cleaning mainly provides functions of missing value cleaning and abnormal value cleaning, and subsequent workload can be greatly reduced through data cleaning, so that resources are indirectly saved, and the method is more green and environment-friendly. The data cleaning in the city is mainly realized by manual participation to form supervised data cleaning, the core of cleaning work is composed of problem data discovery and data correction, if abnormal data and repeated records exist, the abnormal data and the repeated records can be found manually in a management system, and the abnormal data and the repeated records are selected and deleted by manual supervision; if the missing value of the index data exists, corresponding supplement is carried out manually.
After data cleaning is finished, data mining is carried out on the city A, the evaluation index data range of the smart city is wide, the field is wide, the base number is large, the quantity is large, the data types are rich, if only sampling investigation is carried out on the stored data according to a traditional data using method, a random analysis method is adopted to evaluate and analyze the data, and the comprehensively collected index data is undoubtedly greatly wasted; the data mining of the city A is embodied in city planning, namely, the hidden relation information is found out from the data which seems to be unrelated and unrelated to the people through deep mining of city natural geographic information data such as environment, geology, water resources and the like of the city A and social humanistic information such as social economy, social culture, population information and the like; therefore, scientific and advanced decision support is made for city planning and city management.
Data mining of the city A can also be used in the field of disaster prevention, early warning information of emergencies such as artificial or natural disasters and terrorist events can be timely obtained by deeply mining index data collected by the city A, effective measures are timely taken for prevention, and emergency handling capacity and safety precaution capacity are improved; the method is used as a large landmark event in the construction of smart cities, and by utilizing a highly integrated data network and comprehensively analyzing and extracting data, the data mining analysis can timely and comprehensively reflect the mainstream will of the current society, so that the method is favorable for comprehensively mastering social and folk meaning, and the public service capability of governments and enterprises is promoted to be improved;
in the aspect of data maintenance, safety maintenance, monitoring maintenance, detection maintenance and the like are required, wherein the safety maintenance is to perform desensitization treatment on acquired index information, particularly relates to citizen privacy. For the construction of a smart city, the citizen gives away privacy rights, a management system needs to carry out safety protection, desensitizes key information and protects the citizen privacy from being disclosed; and the operation and maintenance monitoring function is provided for the running system, when monitoring finds abnormality, an alarm can be generated in time, related operation and maintenance personnel are informed to check and carry out corresponding processing in time, the generation of on-line faults is reduced to the maximum extent, and the influence of the faults is reduced. In addition, in the operation process of the index data management system in the market A, a detected log report is output, all records in the data processing and maintaining process are recorded into the detection log, and the generation of the detection log can help operation and maintenance personnel to master the operation state of the index data management system in multiple dimensions and multiple directions, so that the stability and the value of the system operation are greatly improved.
Step 4, inputting the data with improved quality into a smart city evaluation index data management system for people to access and use;
the access and the use comprise access management and access security; the operation and maintenance management personnel in the city A realize access management, the operation and maintenance management personnel can create and add and delete accessible users and open different access authorities for different access users, and the access management in the city A is mainly influenced by index data management operation feedback. If the data management system in the city A encounters an emergency in operation, the transient access flow is too large, the management system can be down, through the setting of access safety, when the access quantity of the management server reaches a threshold value, the access of all users with common authority can be actively cut off, the access of an administrator and users with higher authority is only ensured, the damage to data and the system caused by the sudden failure of the index data management system is avoided, the access of common users is recovered after the access quantity is continuously reduced for a period of time, and the normal operation of the data management system is protected through the setting of access safety in the city A.
When the access is used, the foreground user firstly takes the selected year as a query condition, the background records the selected year during the access, and inputs a relative retrieval condition to the storage server, and the input keyword uploads the retrieved index data to the foreground user for the access user to use according to the retrieval condition.
In a comprehensive view, the normal operation of the smart city assessment index data management system in city A not only finds balance between construction cost and construction safety, but also performs subsequent index data mining, so that city A is greatly improved for city planning, public service capacity improvement and disaster prevention capacity improvement, the assistance is great in the process of building a smart city, and the intelligent process of the city is accelerated.
In summary, according to the technical scheme, the smart city evaluation indexes are collected in a partition mode according to the geographic spatial position, comprehensive collection of evaluation data is achieved with low cost, and after data indexes to be improved are given subsequently, backtracking feedback solution can be well carried out according to spatial position information; and the storage cost and the storage safety are considered; the use of the whole storage system cannot be influenced by the fault of a certain node; the quality of the acquired data is improved through processing and analysis; the city planning and management are facilitated to be more scientific and advanced; and index data related to the citizen privacy are desensitized, the citizen privacy is protected, and finally, the access to a data system is completed, so that the related loss caused by downtime is avoided.
The foregoing detailed description of the preferred embodiments of the invention has been presented. It should be understood that numerous modifications and variations could be devised by those skilled in the art in light of the present teachings without departing from the inventive concepts. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the prior art according to the concept of the present invention should be within the scope of protection defined by the claims.

Claims (7)

1. A smart city assessment index data management method and system are characterized by comprising the following steps:
step 1, collecting smart city evaluation index data;
step 2, storing the evaluation index data acquired in the step 1;
step 3, data management and data maintenance are carried out after the data stored in the step 2 are collected;
and 4, inputting the data subjected to quality improvement into a smart city evaluation index data management system for people to access and use.
2. The method and system for managing smart city assessment index data according to claim 1, wherein in step 1,
acquiring the evaluation index data, and refining the final evaluation index acquisition to a street in sequence on the basis of administrative divisions; the task of index data acquisition can be implemented on a specific street, and incomplete data acquisition caused by lack of relevant index information of department urban areas in the subsequent process is avoided; or repeated collection is caused, and resources are wasted; in the data acquisition process, data are acquired according to the geographic and spatial position information, and after data indexes to be improved are given in subsequent steps, backtracking feedback solution can be better carried out according to the spatial position information.
3. The method and system for managing smart city assessment index data according to claim 2, wherein in step 2,
the evaluation index data are stored in a distributed manner, the evaluation index data are respectively stored in a plurality of storage servers, and a certain disk array is formed on the plurality of storage servers;
the specific selection of the disk array can be flexibly selected according to the evaluation index data amount to be stored and the specific urban situation, and the storage cost and the storage safety are considered;
the storage system is provided with a high-speed storage area and a low-speed storage area; wherein the high-speed storage area is used for storing relevant index data which are collected and are collected recently.
4. The method and system of claim 3 wherein the smart city assessment index data management method and system,
the low-speed storage area in the storage system is mainly used for storing the historical data of the evaluation indexes of the smart city, wherein the historical data is mainly based on the current time of the acquisition time interval; in order to save storage capacity and reduce storage cost, the storage system adopts a high-density compression algorithm aiming at the historical data of the evaluation index of the smart city, and the historical data of the evaluation index of the smart city is subjected to high-density compression and then stored in low-rate storage equipment.
5. The method and system for managing smart city assessment index data according to claim 1, wherein in step 3,
the data management comprises data cleaning and data mining;
the data cleaning is mainly realized by manual participation to form supervised data cleaning; the core of the cleaning strategy is to find problem evaluation index data and correct evaluation index data; if abnormal data and repeated records exist, deleting the data by manual supervision; if the missing value exists, corresponding supplement is carried out manually;
the data mining can be used in the fields of city planning, social sentiment, disaster prevention and the like.
6. The method and system for managing smart city assessment index data according to claim 1, wherein in step 3,
the data maintenance comprises safety maintenance, monitoring maintenance, detection maintenance and the like;
the safety maintenance in the data maintenance comprises the steps of carrying out data desensitization processing on the acquired and received information and carrying out desensitization safety processing on the relevant acquired citizen information in the data maintenance; the rights and interests of the citizens are maintained,
the monitoring maintenance is to provide an operation and maintenance monitoring function, perform related operation and maintenance monitoring, generate an alarm when monitoring finds abnormality, inform related operation and maintenance personnel to check and perform corresponding processing in time, reduce the generation of on-line faults and reduce the influence of the faults;
the detection maintenance outputs a detection log report, and based on the log generated by the detection maintenance, the operation and maintenance personnel can be helped to master the operation state of the index data management system in multiple dimensions and multiple directions, so that the stability and the value of the system operation are improved.
7. The method and system for managing smart city assessment index data according to claim 1, wherein in step 4,
the access comprises access management and access security;
the access management comprises that users which can be accessed by adding and deleting can be created, different access rights are opened for different access users, and related contents accessed by users who access data can be recorded to form a log;
the access safety mainly means that certain protection measures are executed when burst and transient access flow are overlarge, and the data is prevented from being damaged due to downtime of a system caused by overlarge access flow;
when the access is used, the foreground user firstly uses the selected year as a query condition, and inputs the relative search condition, and then uploads the searched data to the foreground user for the access user to use according to the search condition after inputting the relative search condition.
CN202210765910.3A 2022-06-30 2022-06-30 Smart city evaluation index data management method and system Pending CN115146953A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210765910.3A CN115146953A (en) 2022-06-30 2022-06-30 Smart city evaluation index data management method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210765910.3A CN115146953A (en) 2022-06-30 2022-06-30 Smart city evaluation index data management method and system

Publications (1)

Publication Number Publication Date
CN115146953A true CN115146953A (en) 2022-10-04

Family

ID=83411015

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210765910.3A Pending CN115146953A (en) 2022-06-30 2022-06-30 Smart city evaluation index data management method and system

Country Status (1)

Country Link
CN (1) CN115146953A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116029619A (en) * 2023-03-29 2023-04-28 佛山市龙生光启科技有限公司 Data processing method and system for smart city planning

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116029619A (en) * 2023-03-29 2023-04-28 佛山市龙生光启科技有限公司 Data processing method and system for smart city planning
CN116029619B (en) * 2023-03-29 2023-07-28 佛山市龙生光启科技有限公司 Data processing method and system for smart city planning

Similar Documents

Publication Publication Date Title
CN114143020B (en) Rule-based network security event association analysis method and system
CN107577771B (en) Big data mining system
CN102737127B (en) Massive data storage method
CN111090779A (en) Cloud storage and retrieval analysis method for case-handling exploration evidence-taking data
CN107610421A (en) A kind of geo-hazard early-warning analysis system and method
CN105656698A (en) Intelligent monitoring structure and method for network application system
CN102902743A (en) Retrieval and reconstruction method for emergency plans
CN103838847A (en) Data organization method oriented to sea-cloud collaboration network computing network
CN113220539A (en) Intelligent detection system for visual analysis of security situation perception multi-source data
CN109241223A (en) The recognition methods of behavior whereabouts and platform
CN105224888A (en) A kind of data of magnetic disk array protection system based on safe early warning technology
CN112446549A (en) Urban garbage intelligent supervision platform based on big data
CN115809183A (en) Method for discovering and disposing information-creating terminal fault based on knowledge graph
CN115146953A (en) Smart city evaluation index data management method and system
CN112732680A (en) Data warehouse design method
CN115664703A (en) Attack tracing method based on multi-dimensional information
CN111414355A (en) Offshore wind farm data monitoring and storing system, method and device
CN115640158A (en) Detection analysis method and device based on database
CN115840656A (en) Automatic operation and maintenance method and system for application program based on fault self-healing
CN112910974B (en) System and method based on block chain system architecture
Wang et al. GDMS: a geospatial data mining system for abnormal event detection and visualization
CN112115174A (en) KYC method and system based on graph computing technology
CN112799880A (en) Protection system and method for preventing data leakage
Wu et al. The design of distributed power big data analysis framework and its application in residential electricity analysis
CN111444229A (en) System for analyzing virus-related personnel and working method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination