CN113032379A - Distribution network operation and inspection-oriented multi-source data acquisition method - Google Patents

Distribution network operation and inspection-oriented multi-source data acquisition method Download PDF

Info

Publication number
CN113032379A
CN113032379A CN202110282493.2A CN202110282493A CN113032379A CN 113032379 A CN113032379 A CN 113032379A CN 202110282493 A CN202110282493 A CN 202110282493A CN 113032379 A CN113032379 A CN 113032379A
Authority
CN
China
Prior art keywords
data
source
service
interface
database
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110282493.2A
Other languages
Chinese (zh)
Other versions
CN113032379B (en
Inventor
李晨迪
薛艺为
张延旭
李智斌
冯诺旼
霍建彬
党卫军
刘佳
郝方舟
孙奇珍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Power Supply Bureau of Guangdong Power Grid Co Ltd
Original Assignee
Guangzhou Power Supply Bureau of Guangdong Power Grid Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Power Supply Bureau of Guangdong Power Grid Co Ltd filed Critical Guangzhou Power Supply Bureau of Guangdong Power Grid Co Ltd
Priority to CN202110282493.2A priority Critical patent/CN113032379B/en
Publication of CN113032379A publication Critical patent/CN113032379A/en
Application granted granted Critical
Publication of CN113032379B publication Critical patent/CN113032379B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2308Concurrency control
    • G06F16/2315Optimistic concurrency control

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a distribution network operation and inspection oriented multi-source data acquisition method, which adopts a micro-service framework to provide data information required to be synchronized through a target system and comprises the following steps: s1, the data source system actively or passively pushes data information; s2, after the target system receives the request, the following steps are carried out: s21, providing different analysis data models for different data receiving modes respectively, and analyzing the data; s22, caching data; s23, caching by adopting an asynchronous multithreading processing queue; s24, establishing a mapping relation between the synchronous field and the database field, keeping the field attributes consistent, and mapping data; and S25, persisting the data in a database table to complete data synchronization. According to the invention, through establishment of the acquisition standard of multi-source data, the access flexibility of the multi-source data under multiple platforms is improved, the data quality problem is reduced, the system application capability is improved, the inspection system application capability is improved, the equipment research and judgment accuracy is ensured, and the reliability of the net rack is improved.

Description

Distribution network operation and inspection-oriented multi-source data acquisition method
Technical Field
The invention relates to the technical field of power distribution networks, in particular to a distribution network operation and inspection multi-source data acquisition method.
Background
The distribution network is at the end of the whole power grid and is a window facing the society of power enterprises, the operation management of the distribution network is directly related to thousands of households, and the social responsibility and influence are huge. With the continuous development of society, higher and higher requirements are put forward on lean management of distribution networks. Due to the comprehensive development of the construction of the intelligent power distribution room, a large amount of secondary monitoring equipment data and data (such as production business data, equipment ledger data, project material data and the like) of the original data support platform are subjected to correlation analysis.
Due to the influence of the stage and the technical property of each business system in constructing and implementing the data management system and other economic and human factors, a large amount of business data adopting different storage modes are accumulated, the adopted data management systems are quite different from simple file databases to complex network databases, and therefore heterogeneous data sources are formed. At present, the access is realized through technical modes such as HTTP, Webservice, files and the like. However, at present, multi-source heterogeneous data cannot be accessed quickly and accurately, and meanwhile, a multi-source data access system can generate a concurrency problem, so that the processing stability is influenced, and the data quality is influenced.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a distribution network operation and inspection oriented multi-source data acquisition method, which aims to solve the problems that the processing stability and the data quality are influenced due to the fact that the concurrency quantity is generated in the conventional multi-source data access mode, improve the multi-source data access flexibility under multiple platforms, reduce the data quality problem, improve the application capability of an inspection system, ensure the accuracy of system data analysis and improve the reliability of a net rack through the establishment of multi-source data acquisition specifications.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows.
The distribution network operation and inspection multi-source data acquisition oriented method adopts a micro-service framework and provides data information required to be synchronized through a target system, and comprises the following steps:
s1, the data source system actively or passively pushes data information;
s2, after the target system receives the request, the following steps are carried out:
s21, providing different analysis data models for different data receiving modes respectively, and analyzing the data;
s22, caching data;
s23, caching by adopting an asynchronous multithreading processing queue;
s24, establishing a mapping relation between the synchronous field and the database field, keeping the field attributes consistent, and mapping data;
and S25, persisting the data in a database table to complete data synchronization.
According to the technical scheme, when the data source system actively pushes the data information, the data source system calls a web service interface of the target system through the transit system, and the data information is pushed in a character string mode.
Further optimizing the technical scheme, the data information access process specifically comprises the following steps:
s10, splitting the data access service according to actual requirements, and deploying a plurality of data processing services;
s20, presetting an interface protocol, and handing over a corresponding interface key to a data pushing platform, wherein the data pushing platform receives service pushing data to an inlet of multi-source data, and the inlet receiving service provides a unified inlet service interface for acquiring a data source according to configuration;
s30, after the pushed data enter the entrance to receive service, the data enter the database to be stored in the special cache table through the safety check of the interface secret key, and the cache ID is sent to the queue cache service;
s40, extracting the data to be processed from the database by the buffer ID identification in the multiple data processing service request queue service, and separating and respectively servicing the two functions of the received data and the processed data by the queue buffer service forwarding identification;
and S50, reading the cache from the database according to the identifier, verifying whether the numerical characters of the cache meet the interface specification through data inspection, and converting the numerical characters of the cache into database table objects through data structure model mapping.
According to the technical scheme, when the data source system pushes data information passively, the data source system provides a data query interface, and the target system issues a timing task to call the query interface regularly to acquire synchronous data.
Further optimizing the technical scheme, the data information access process specifically comprises the following steps:
an interface protocol is configured in advance, an interface is accessed regularly to obtain data through system task scheduling, the obtained unstructured data are preprocessed and converted, the preprocessed and converted data are cached in a database, and identification information is sent to a queue service;
and the data processing service reads information from the cache according to the identification, and automatically acquires and stores the data through the steps of data model conversion, numerical value verification and database processing.
The technical scheme is further optimized, and the data text transmission mode is that a data source system provides data in a file mode; and the target system issues a timing task and reads the file from the text server at a timing.
Due to the adoption of the technical scheme, the technical progress of the invention is as follows.
The invention applies the main data management idea to manage the multi-source heterogeneous data, can ensure the system coordination, has universal reuse to the service data and ensures the correctness of the data. The multi-source data access flexibility under multiple platforms can be improved, the data quality problem is reduced, the system application capacity is improved, the inspection system application capacity is improved, and the equipment research and judgment accuracy is ensured based on the multi-source data acquisition standard establishment. Through the collection standard of multisource data, improved data transmission ability, improved data quality, improved the reliability of rack.
The method can access multi-source heterogeneous data in real time, quickly and accurately; designing a multi-source data acquisition format, carrying out object analysis according to data sources, and formulating an access data template; a technical implementation mode is established, and a data transmission technical route is standardized; a data interaction mechanism is designed, effective verification and feedback are carried out on problem data, and the data problem can be found and solved.
When the system has large synchronous data volume, the interface response speed can be effectively improved through the data caching technology, the data is cached firstly, then the rest flow is processed by the asynchronous thread, the system synchronization performance is improved, and the system operation stability is ensured.
The invention ensures the key of synchronization accuracy through a data mapping technology, establishes the mapping relation between the synchronization field and the database field, and keeps the field attributes consistent. And finally, persisting the data in a database table to complete the synchronous process.
The invention constructs diversified data analysis models. The data transmission form between systems is different, and some forms are character string form or file form. Different data receiving modes are provided with different analytical data models respectively, the method can be widely applied to a multi-data source system, and the expandability principle of the interface is met.
The queue cache service of the present invention is responsible for managing the distribution of data access cache identities. Meanwhile, the cache ID identifications in the multiple data processing service request queue services extract the data to be processed from the database, and the received data and the processed data can be separated and respectively serviced through the queue cache service forwarding identifications. The entrance receiving service business is light, the data processing service supports expansion as required, the problem of concurrency generated by a multi-source data access system is solved, and the processing stability is ensured.
Drawings
FIG. 1 is a schematic flow diagram of the present invention;
FIG. 2 is a flow chart illustrating the deployment of multiple data processing services according to actual requirements.
Detailed Description
The invention will be described in further detail below with reference to the figures and specific examples.
An intelligent logistics business code generation system based on cross-platform technology, which is combined with fig. 1 to fig. 2, adopts a micro-service framework to provide data information required to be synchronized through a target system, and comprises the following steps:
and S1, the data source system actively or passively pushes data information.
S2, after receiving the request, the target system starts to complete data synchronization after a series of processing such as data parsing, data caching, queue processing caching, data mapping, and data persistence, and the method specifically includes the following steps:
and S21, providing different analysis data models for different data receiving modes respectively, and analyzing the data.
And S22, data caching is carried out. The system has larger synchronous data volume, the data cache can effectively improve the response speed of the interface, the data is cached firstly, and then the rest flow is processed by an asynchronous thread, so that the synchronous performance of the system is improved, and the running stability of the system is ensured.
And S23, adopting asynchronous multithreading processing queue buffer. Asynchronous multithreading queue caching guarantees data safety, and each thread processes data of one queue independently.
And S24, data mapping is the key for ensuring the synchronization accuracy, a mapping relation between the synchronization field and the database field is established, the field attributes are kept consistent, and data mapping is carried out.
And S25, persisting the data in a database table, and finishing the synchronization process.
When the data source system actively pushes the data information, the data source system calls a webservice interface of the target system through the transit system, and pushes the data information in a character string mode.
When the data source system actively pushes data information, the data information access process specifically comprises the following steps:
and S10, splitting the data access service according to actual requirements, and deploying a plurality of data processing services, including a data entry receiving service, a queue cache service and a data processing service.
S20, presetting an interface protocol, and handing over a corresponding interface key to a data push platform (application), wherein the data push platform (application) receives service push data to an entrance of multi-source data through a fixed format, the entrance receiving service provides a uniform entrance service interface for acquiring a data source according to configuration, and the source mode comprises HTTP, Webservice, files and the like.
S30, after the pushed data enter the entrance to receive service, the data enter the database to be stored in the special buffer table through the safety check of the interface secret key, and the buffer ID is sent to the queue buffer service.
And S40, the queue buffer service is responsible for managing the distribution of the data access buffer identification. Meanwhile, the cache ID identifications in the multiple data processing service request queue services extract the data to be processed from the database, and the received data and the processed data can be separated and respectively serviced through the queue cache service forwarding identifications. The entrance receiving service business is light, the data processing service supports expansion as required, the problem of concurrency generated by a multi-source data access system is solved, and the processing stability is ensured.
S50, the multi-source data processing service automatically requests the queue service for the cache identification, after obtaining the cache identification, reads the cache from the database according to the identification, firstly, the data inspection is carried out, whether the numerical characters of the cache accord with the interface specification is verified, and then, the cache is mapped by the data structure model and converted into the database table object. And performing addition, deletion and modification operations on the table objects according to the actual service, and triggering subsequent functions through Java reflection.
Besides the above data access by adopting other platform (application) push modes, the multi-source data access service also supports an active pull mode to acquire data. When the data source system pushes data information passively, the data source system provides a data query interface, the target system issues a timing task to call the query interface at regular time, synchronous data are obtained, and the follow-up process is consistent with the processing flow of the target system.
When the data source system passively pushes data information, the data information access process specifically includes the following steps:
an interface protocol is configured in advance, an interface is accessed at regular time to acquire data through system task scheduling, the acquired unstructured data (such as a text file) is preprocessed and converted, the preprocessed and converted data is cached in a database, and identification information is sent to a queue service.
The data processing service is the same as a conventional access mode, reads information from the cache according to the identification, and automatically acquires and stores the data through the steps of data model conversion, numerical value verification and database processing.
The data text transmission is in a form that a data source system provides data in a file mode. And the target system issues a timing task and reads the file from the text server at a timing. The flow of the data obtained by the target system analysis is consistent with the above.
Before the steps are carried out, an analysis model and a mapping model are required to be constructed.
The invention constructs diversified data analysis models, and the data transmission modes among systems are different, namely, the data transmission modes are character string modes or file modes. Different data receiving modes are provided with different analytical data models respectively, the method can be widely applied to a multi-data source system, and the expandability principle of the interface is met.
The steps of the invention for configuring the mapping model are as follows:
and establishing a universal unified webservice interface. According to the requirement of interface universality, the target system adopts a soap protocol to issue a webservcie interface, unifies and standardizes the general fields of the interface, and provides the fields for each heterogeneous system to be called. The webservice interface has high stability and safety. The data interface has higher stability and safety, can improve the operating efficiency of the system, and effectively protects the message safety of the user.
And establishing a mapping model which is convenient to configure. When data of a data source system is docked, the data to be received is various, and at this time, for the various data, a target system needs to be adapted and mapped with the data of each heterogeneous system. The data and the database field relation are accessed through the mapping of the field relation, and the effect of accurately receiving the data is achieved.
The invention applies the main data management idea to manage the multi-source heterogeneous data, can ensure the system coordination, has universal reuse to the service data and ensures the correctness of the data. The data access flexibility can be improved, the data quality problem can be reduced, the system application capacity can be improved, and the equipment research and judgment accuracy can be ensured based on the acquisition standard establishment of multi-source data. Through the collection standard of multi-source data, the data transmission capability is improved, and the data quality is improved.
When the system has large synchronous data volume, the interface response speed can be effectively improved through the data caching technology, the data is cached firstly, then the rest flow is processed by the asynchronous thread, the system synchronization performance is improved, and the system operation stability is ensured.
The invention ensures the key of synchronization accuracy through a data mapping technology, establishes the mapping relation between the synchronization field and the database field, and keeps the field attributes consistent. And finally, persisting the data in a database table to complete the synchronous process.
The invention constructs diversified data analysis models. The data transmission form between systems is different, and some forms are character string form or file form. Different data receiving modes are provided with different analytical data models respectively, the method can be widely applied to a multi-data source system, and the expandability principle of the interface is met.

Claims (6)

1. The distribution network operation and inspection oriented multi-source data acquisition method is characterized in that a micro-service framework is adopted, and data information required to be synchronized is provided through a target system, and the method comprises the following steps:
s1, the data source system actively or passively pushes data information;
s2, after the target system receives the request, the following steps are carried out:
s21, providing different analysis data models for different data receiving modes respectively, and analyzing the data;
s22, caching data;
s23, caching by adopting an asynchronous multithreading processing queue;
s24, establishing a mapping relation between the synchronous field and the database field, keeping the field attributes consistent, and mapping data;
and S25, persisting the data in a database table to complete data synchronization.
2. The distribution network operation and inspection-oriented multi-source data acquisition method as claimed in claim 1, wherein when the data source system actively pushes data information, the data source system calls a webservice interface of a target system through a transit system to push the data information in a character string.
3. The distribution network operation and maintenance oriented multi-source data acquisition method according to claim 1, wherein the data information access process specifically comprises the following steps:
s10, splitting the data access service according to actual requirements, and deploying a plurality of data processing services;
s20, presetting an interface protocol, and handing over a corresponding interface key to a data pushing platform, wherein the data pushing platform receives service pushing data to an inlet of multi-source data, and the inlet receiving service provides a unified inlet service interface for acquiring a data source according to configuration;
s30, after the pushed data enter the entrance to receive service, the data enter the database to be stored in the special cache table through the safety check of the interface secret key, and the cache ID is sent to the queue cache service;
s40, extracting the data to be processed from the database by the buffer ID identification in the multiple data processing service request queue service, and separating and respectively servicing the two functions of the received data and the processed data by the queue buffer service forwarding identification;
and S50, reading the cache from the database according to the identifier, verifying whether the numerical characters of the cache meet the interface specification through data inspection, and converting the numerical characters of the cache into database table objects through data structure model mapping.
4. The distribution network operation and maintenance oriented multi-source data acquisition method as claimed in claim 1, wherein when the data source system passively pushes data information, the data source system provides a data query interface, and the target system issues a timing task to regularly call the query interface to acquire synchronous data.
5. The distribution network operation and maintenance oriented multi-source data acquisition method according to claim 4, wherein the data information access process specifically comprises the following steps:
an interface protocol is configured in advance, an interface is accessed regularly to obtain data through system task scheduling, the obtained unstructured data are preprocessed and converted, the preprocessed and converted data are cached in a database, and identification information is sent to a queue service;
and the data processing service reads information from the cache according to the identification, and automatically acquires and stores the data through the steps of data model conversion, numerical value verification and database processing.
6. The distribution network operation and inspection oriented multi-source data acquisition method as claimed in claim 1, wherein the data text transmission is in a form that a data source system provides data in a file mode; and the target system issues a timing task and reads the file from the text server at a timing.
CN202110282493.2A 2021-03-16 2021-03-16 Distribution network operation and inspection-oriented multi-source data acquisition method Active CN113032379B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110282493.2A CN113032379B (en) 2021-03-16 2021-03-16 Distribution network operation and inspection-oriented multi-source data acquisition method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110282493.2A CN113032379B (en) 2021-03-16 2021-03-16 Distribution network operation and inspection-oriented multi-source data acquisition method

Publications (2)

Publication Number Publication Date
CN113032379A true CN113032379A (en) 2021-06-25
CN113032379B CN113032379B (en) 2022-07-22

Family

ID=76471134

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110282493.2A Active CN113032379B (en) 2021-03-16 2021-03-16 Distribution network operation and inspection-oriented multi-source data acquisition method

Country Status (1)

Country Link
CN (1) CN113032379B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113835786A (en) * 2021-09-30 2021-12-24 四川新网银行股份有限公司 Data docking system, method and computer-readable storage medium
CN117076574A (en) * 2023-10-16 2023-11-17 北京持安科技有限公司 Method and device capable of arranging multiple data sources for synchronous aggregation of data
CN117171534A (en) * 2023-11-03 2023-12-05 济南二机床集团有限公司 Multi-source heterogeneous data acquisition method, system, device and medium for numerical control machine tool

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104239505A (en) * 2014-09-12 2014-12-24 何苗 Situated oriented real-time two-way pushing synchronous processing system
CN107729366A (en) * 2017-09-08 2018-02-23 广东省建设信息中心 A kind of pervasive multi-source heterogeneous large-scale data synchronization system
WO2019213775A1 (en) * 2018-05-11 2019-11-14 Imagine Communications Corp. Distributed ledger platform for computing applications
US10545893B1 (en) * 2019-01-11 2020-01-28 Arm Limited Interrupt controller and method of operation of an interrupt controller
CN111784130A (en) * 2020-06-19 2020-10-16 国电南瑞南京控制系统有限公司 Power distribution network Internet of things management system, data processing method and storage medium
CN111930529A (en) * 2020-10-09 2020-11-13 上海富友支付服务股份有限公司 Data synchronization method, module and system based on message queue and micro-service
CN112100265A (en) * 2020-09-17 2020-12-18 博雅正链(北京)科技有限公司 Multi-source data processing method and device for big data architecture and block chain
CN112131286A (en) * 2020-11-26 2020-12-25 畅捷通信息技术股份有限公司 Data processing method and device based on time sequence and storage medium
CN112269820A (en) * 2020-10-30 2021-01-26 浪潮云信息技术股份公司 Method and platform for realizing data batch synchronization based on CMSP

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104239505A (en) * 2014-09-12 2014-12-24 何苗 Situated oriented real-time two-way pushing synchronous processing system
CN107729366A (en) * 2017-09-08 2018-02-23 广东省建设信息中心 A kind of pervasive multi-source heterogeneous large-scale data synchronization system
WO2019213775A1 (en) * 2018-05-11 2019-11-14 Imagine Communications Corp. Distributed ledger platform for computing applications
US10545893B1 (en) * 2019-01-11 2020-01-28 Arm Limited Interrupt controller and method of operation of an interrupt controller
CN111784130A (en) * 2020-06-19 2020-10-16 国电南瑞南京控制系统有限公司 Power distribution network Internet of things management system, data processing method and storage medium
CN112100265A (en) * 2020-09-17 2020-12-18 博雅正链(北京)科技有限公司 Multi-source data processing method and device for big data architecture and block chain
CN111930529A (en) * 2020-10-09 2020-11-13 上海富友支付服务股份有限公司 Data synchronization method, module and system based on message queue and micro-service
CN112269820A (en) * 2020-10-30 2021-01-26 浪潮云信息技术股份公司 Method and platform for realizing data batch synchronization based on CMSP
CN112131286A (en) * 2020-11-26 2020-12-25 畅捷通信息技术股份有限公司 Data processing method and device based on time sequence and storage medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113835786A (en) * 2021-09-30 2021-12-24 四川新网银行股份有限公司 Data docking system, method and computer-readable storage medium
CN113835786B (en) * 2021-09-30 2023-04-28 四川新网银行股份有限公司 Data docking system, method and computer readable storage medium
CN117076574A (en) * 2023-10-16 2023-11-17 北京持安科技有限公司 Method and device capable of arranging multiple data sources for synchronous aggregation of data
CN117076574B (en) * 2023-10-16 2024-01-23 北京持安科技有限公司 Method and device capable of arranging multiple data sources for synchronous aggregation of data
CN117171534A (en) * 2023-11-03 2023-12-05 济南二机床集团有限公司 Multi-source heterogeneous data acquisition method, system, device and medium for numerical control machine tool
CN117171534B (en) * 2023-11-03 2024-03-19 济南二机床集团有限公司 Multi-source heterogeneous data acquisition method, system, device and medium for numerical control machine tool

Also Published As

Publication number Publication date
CN113032379B (en) 2022-07-22

Similar Documents

Publication Publication Date Title
CN113032379B (en) Distribution network operation and inspection-oriented multi-source data acquisition method
CN109756364B (en) Micro-service performance optimization system and analysis method based on log analysis
CN105045820B (en) Method for processing video image information of high-level data and database system
US20100330969A1 (en) Method and apparatus for managing profile information of mobile terminal in mobile communications system
CN104599032A (en) Distributed memory power grid construction method and system for resource management
CN110609782B (en) Micro-service optimization system and method based on big data
CN103092866B (en) Data monitoring method and supervising device
CN103645904A (en) Cache realization method of interface calling
CN108228683A (en) A kind of distributed intelligence electric network data analysis platform based on cloud computing
CN114968953A (en) Log storage and retrieval method, system, terminal equipment and medium
CN111913933A (en) Power grid historical data management method and system based on unified support platform
KR20080041911A (en) Apparatus for processing of integrated data of various sensor networks and its method
CN102026228A (en) Statistical method and equipment for communication network performance data
CN111143468A (en) Multi-database data management method based on MPP distributed technology
CN113761079A (en) Data access method, system and storage medium
CN110879753B (en) GPU acceleration performance optimization method and system based on automatic cluster resource management
CN115858672A (en) Power terminal management method and device, electronic equipment and storage medium
EP2442235A1 (en) Method adapting to mobile search interface, search server and system thereof
CN112687267A (en) Internet of things data semantic processing system
CN113055447A (en) Power equipment state data acquisition and intelligent analysis device and method
CN110740046B (en) Method and device for analyzing service contract
CN112883110A (en) Terminal big data distribution method, storage medium and system based on NIFI
CN112306992A (en) Big data platform based on internet
CN116644039B (en) Automatic acquisition and analysis method for online capacity operation log based on big data
CN112115140B (en) Universal full-text search engine real-time data synchronization method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant