CN111694832A - Resource management method and system for internet data center - Google Patents
Resource management method and system for internet data center Download PDFInfo
- Publication number
- CN111694832A CN111694832A CN202010566425.4A CN202010566425A CN111694832A CN 111694832 A CN111694832 A CN 111694832A CN 202010566425 A CN202010566425 A CN 202010566425A CN 111694832 A CN111694832 A CN 111694832A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- information
- useless
- resource management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a resource management method and a resource management system of an internet data center, in particular to a resource management system of the internet data center, which comprises a data acquisition module, a data processing module, a useless data eliminating module, a data storage module, a data retrieval module, a data distribution module and a data deleting module, wherein the data acquisition module, the data processing module, the useless data eliminating module, the data storage module, the data retrieval module, the data distribution module and the data deleting module are sequentially connected. The invention effectively protects the safety and stability of data resources, can remove useless data, further enhances the management performance, and can reasonably plan and distribute internet resources to realize automatic operation.
Description
Technical Field
The invention relates to the technical field of resource management, in particular to a resource management method and system of an internet data center.
Background
The 21 st century is a data age, and with popularization and application of new technologies such as 'big cloud moving intelligence' and the like, the collection, storage and application of big data have directly influenced our work and life. The power enterprises are also inevitably confronted with the impact of the wave of big data information. In recent years, the informatization construction of power enterprises is rapidly developed, a large amount of structured, semi-structured and unstructured data is accumulated, and great results and benefits are obtained through years of efforts. However, in the face of huge data resources of power enterprises, only one corner of the iceberg can be effectively utilized. The electric power business relates to a plurality of specialties such as operation and inspection, marketing, regulation and control, and has multiple knowledge points and numerous and complicated businesses. When other services or data information needs to be researched and analyzed, the ways of making a call for communication, visiting a consulting expert, manually calling data, searching paper data and the like are usually only needed, time and labor are consumed, and data acquisition is not accurate enough and not comprehensive enough.
With the continuous improvement of the informatization level and the continuous accumulation of data resources, the requirement of the rapid development of big data on the data resources is higher and higher, but the current cross-professional data acquisition needs offline coordination, so that the number of chains is large, the time is long, the efficiency is low, the data change cost is high, and the excavation and development of big data values face a great obstacle.
Disclosure of Invention
Based on the technical problems in the background art, the invention provides a resource management method and system for an internet data center.
The invention provides a resource management method of an internet data center, which comprises the following steps:
s1 data acquisition: acquiring resource requirements required by executing work submitted by a user, wherein the resource requirements comprise service data information;
and S2 data processing: transmitting the service data information to a data processing module for data processing, and converting the format of the service data information into a common data format;
s3 garbage culling: transmitting the data information with the common format to a useless information eliminating module for screening the data information, eliminating the useless data information and storing useful data information;
s4 data storage: storing the data information in the data transmission data memory with the useless data information removed;
s5 data retrieval: the data information in the data memory is transmitted to a data retrieval module, the data retrieval module collects and cleans source data of the service data, a distributed index information base is constructed, and the collected and cleaned service data is retrieved according to a retrieval key word and the distributed index information base;
s6 data allocation: performing data distribution processing on the retrieved data, and distributing the data to corresponding users;
s7 data deletion: and deleting the distributed data from the data memory.
A resource management system of an internet data center comprises a data acquisition module, a data processing module, a useless data eliminating module, a data storage module, a data retrieval module, a data distribution module and a data deleting module, wherein the data acquisition module, the data processing module, the useless data eliminating module, the data storage module, the data retrieval module, the data distribution module and the data deleting module are sequentially connected
Preferably, the data obtaining module is configured to obtain a resource requirement required for executing a job submitted by a user, where the resource requirement includes service data information.
Preferably, the data processing module is configured to convert a format of the service data information into a common data format.
Preferably, the useless data removing module is configured to remove useless data information and store useful data information.
Preferably, the data storage module is configured to store the data information in the data transmission data storage from which the useless data information is removed.
Preferably, the data retrieval module is configured to collect and clean source data of the service data, construct a distributed index information base, and retrieve the collected and cleaned service data according to the retrieval key word and the distributed index information base.
Preferably, the data distribution module is configured to perform data distribution processing on the retrieved data and distribute the data to corresponding users.
Preferably, the data deleting module is configured to delete the allocated data from the data storage.
According to the resource management method and system of the internet data center, the safety and stability of data resources are effectively protected, useless data can be eliminated, the management performance is further enhanced, meanwhile, the internet resources can be reasonably planned and distributed, and automatic operation is achieved.
Drawings
Fig. 1 is a schematic diagram of a resource management system of an internet data center according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Referring to fig. 1, a resource management method of an internet data center includes the following steps:
s1 data acquisition: acquiring resource requirements required by executing work submitted by a user, wherein the resource requirements comprise service data information;
and S2 data processing: transmitting the service data information to a data processing module for data processing, and converting the format of the service data information into a common data format;
s3 garbage culling: transmitting the data information with the common format to a useless information eliminating module for screening the data information, eliminating the useless data information and storing useful data information;
s4 data storage: storing the data information in the data transmission data memory with the useless data information removed;
s5 data retrieval: the data information in the data memory is transmitted to a data retrieval module, the data retrieval module collects and cleans source data of the service data, a distributed index information base is constructed, and the collected and cleaned service data is retrieved according to a retrieval key word and the distributed index information base;
s6 data allocation: performing data distribution processing on the retrieved data, and distributing the data to corresponding users;
s7 data deletion: and deleting the distributed data from the data memory.
A resource management system of an internet data center comprises a data acquisition module, a data processing module, a useless data removing module, a data storage module, a data retrieval module, a data distribution module and a data deleting module, wherein the data acquisition module, the data processing module, the useless data removing module, the data storage module, the data retrieval module, the data distribution module and the data deleting module are sequentially connected.
In the invention, the data acquisition module is used for acquiring resource requirements required by executing work submitted by a user, and the resource requirements comprise service data information.
In the invention, the data processing module is used for converting the format of the service data information into a common data format.
In the invention, the useless data removing module is used for removing useless data information and storing useful data information.
In the invention, the data storage module is used for storing the data information in the data transmission data memory with the useless data information removed.
In the invention, the data retrieval module is used for collecting and cleaning source data of the service data, constructing a distributed index information base and retrieving the collected and cleaned service data according to the retrieval key words and the distributed index information base.
In the invention, the data distribution module is used for carrying out data distribution processing on the retrieved data and distributing the data to corresponding users.
In the invention, the data deleting module is used for deleting the distributed data from the data memory.
The invention comprises the following steps: data acquisition: acquiring resource requirements required by executing work submitted by a user, wherein the resource requirements comprise service data information; data processing: transmitting the service data information to a data processing module for data processing, and converting the format of the service data information into a common data format; and (3) useless data elimination: transmitting the data information with the common format to a useless information eliminating module for screening the data information, eliminating the useless data information and storing useful data information; data storage: storing the data information in the data transmission data memory with the useless data information removed; and (3) data retrieval: the data information in the data memory is transmitted to a data retrieval module, the data retrieval module collects and cleans source data of the service data, a distributed index information base is constructed, and the collected and cleaned service data is retrieved according to a retrieval key word and the distributed index information base; data allocation: performing data distribution processing on the retrieved data, and distributing the data to corresponding users; and (3) deleting data: and deleting the distributed data from the data memory.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (9)
1. A resource management method of an Internet data center is characterized by comprising the following steps:
s1 data acquisition: acquiring resource requirements required by executing work submitted by a user, wherein the resource requirements comprise service data information;
and S2 data processing: transmitting the service data information to a data processing module for data processing, and converting the format of the service data information into a common data format;
s3 garbage culling: transmitting the data information with the common format to a useless information eliminating module for screening the data information, eliminating the useless data information and storing useful data information;
s4 data storage: storing the data information in the data transmission data memory with the useless data information removed;
s5 data retrieval: the data information in the data memory is transmitted to a data retrieval module, the data retrieval module collects and cleans source data of the service data, a distributed index information base is constructed, and the collected and cleaned service data is retrieved according to a retrieval key word and the distributed index information base;
s6 data allocation: performing data distribution processing on the retrieved data, and distributing the data to corresponding users;
s7 data deletion: and deleting the distributed data from the data memory.
2. A resource management system of an internet data center is characterized by comprising a data acquisition module, a data processing module, a useless data removing module, a data storage module, a data retrieval module, a data distribution module and a data deletion module, wherein the data acquisition module, the data processing module, the useless data removing module, the data storage module, the data retrieval module, the data distribution module and the data deletion module are sequentially connected.
3. The system as claimed in claim 2, wherein the data acquiring module is configured to acquire resource requirements for performing the work submitted by the user, and the resource requirements include service data information.
4. The system as claimed in claim 2, wherein the data processing module is configured to convert the service data information format into a common data format.
5. The resource management system of the internet data center as claimed in claim 2, wherein the useless data removing module is configured to remove useless data information and store useful data information.
6. The system as claimed in claim 2, wherein the data storage module is configured to store the data information in the data transmission data storage without the useless data information.
7. The resource management system of an internet data center as claimed in claim 2, wherein the data retrieval module is configured to collect and clean the source data of the service data, construct a distributed index information base, and retrieve the collected and cleaned service data according to the retrieval key word and the distributed index information base.
8. The resource management system of the internet data center as claimed in claim 2, wherein the data distribution module is configured to perform data distribution processing on the retrieved data and distribute the data to corresponding users.
9. The resource management system of an internet data center as claimed in claim 2, wherein the data deleting module is configured to delete the allocated data from the data storage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010566425.4A CN111694832A (en) | 2020-06-19 | 2020-06-19 | Resource management method and system for internet data center |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010566425.4A CN111694832A (en) | 2020-06-19 | 2020-06-19 | Resource management method and system for internet data center |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111694832A true CN111694832A (en) | 2020-09-22 |
Family
ID=72482167
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010566425.4A Pending CN111694832A (en) | 2020-06-19 | 2020-06-19 | Resource management method and system for internet data center |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111694832A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112903339A (en) * | 2021-01-19 | 2021-06-04 | 澜途集思生态科技集团有限公司 | Pollution source identification method and system |
| CN115062061A (en) * | 2022-06-27 | 2022-09-16 | 艾象科技(深圳)股份有限公司 | Commodity ERP management system and ERP management method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120136836A1 (en) * | 2010-11-29 | 2012-05-31 | Beijing Z & W Technology Consulting Co., Ltd. | Cloud Storage Data Storing and Retrieving Method, Apparatus and System |
| CN111158917A (en) * | 2019-12-31 | 2020-05-15 | 新浪网技术(中国)有限公司 | Resource management method and system for internet data center |
| CN111242559A (en) * | 2019-12-20 | 2020-06-05 | 南京南瑞信息通信科技有限公司 | Data resource management platform and method |
-
2020
- 2020-06-19 CN CN202010566425.4A patent/CN111694832A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120136836A1 (en) * | 2010-11-29 | 2012-05-31 | Beijing Z & W Technology Consulting Co., Ltd. | Cloud Storage Data Storing and Retrieving Method, Apparatus and System |
| CN111242559A (en) * | 2019-12-20 | 2020-06-05 | 南京南瑞信息通信科技有限公司 | Data resource management platform and method |
| CN111158917A (en) * | 2019-12-31 | 2020-05-15 | 新浪网技术(中国)有限公司 | Resource management method and system for internet data center |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112903339A (en) * | 2021-01-19 | 2021-06-04 | 澜途集思生态科技集团有限公司 | Pollution source identification method and system |
| CN115062061A (en) * | 2022-06-27 | 2022-09-16 | 艾象科技(深圳)股份有限公司 | Commodity ERP management system and ERP management method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Lundin et al. | Smart cities: A case study in waste monitoring and management | |
| CN1196298C (en) | Alarm management system and method for network management system | |
| CN111694832A (en) | Resource management method and system for internet data center | |
| JP3587120B2 (en) | Questionnaire response analysis system | |
| CN112433998B (en) | Multisource heterogeneous data acquisition and convergence system and method based on power system | |
| CN111327677B (en) | Industrial Internet of things resource scheduling system and method based on edge calculation | |
| CN101141370A (en) | Gridding service based electric power enterprise real-time data processing method | |
| CN110109906B (en) | Data storage system and method | |
| CN101146267A (en) | A SMS query analysis system and method | |
| CN108376181A (en) | Log services platform based on ELK | |
| CN102664760A (en) | Alarming method for communication system, equipment and communication system | |
| CN109213767A (en) | A kind of account data management method suitable for block chain | |
| Kumar et al. | Mapping technological trajectories for energy storage device through patent citation network | |
| JP6200376B2 (en) | In-vehicle information system and information processing method thereof | |
| JP5314570B2 (en) | Accumulated data reconstruction system, reconstruction method, and program | |
| CN108763281A (en) | A kind of business intelligence analysis platform and system based on ETL | |
| CN110928922B (en) | Public policy analysis model deployment method and system based on big data mining | |
| CN112906382A (en) | Policy text multi-label labeling method and system based on graph neural network | |
| CN111882113A (en) | Enterprise mobile banking user prediction method and device | |
| CN101471846A (en) | Network event analysis and management system | |
| Castro Lundin et al. | Smart cities: A case study in waste monitoring and management | |
| CN115879880A (en) | RPA (resilient packet Access) acquisition method and system for power industry expansion data | |
| CN115510682A (en) | New energy automobile waste battery recycling bin site selection planning method and system and terminal equipment | |
| CN100488219C (en) | Method for traffic data gathering and analysis statistic | |
| CN113479508A (en) | Garbage classification management method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |