CN114202365A - Monitoring method based on real-time data of marketing system in power industry - Google Patents
Monitoring method based on real-time data of marketing system in power industry Download PDFInfo
- Publication number
- CN114202365A CN114202365A CN202111532784.9A CN202111532784A CN114202365A CN 114202365 A CN114202365 A CN 114202365A CN 202111532784 A CN202111532784 A CN 202111532784A CN 114202365 A CN114202365 A CN 114202365A
- Authority
- CN
- China
- Prior art keywords
- data
- monitoring
- consumer
- information
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 81
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000005012 migration Effects 0.000 claims abstract description 32
- 238000013508 migration Methods 0.000 claims abstract description 32
- 238000013515 script Methods 0.000 claims abstract description 27
- 230000008569 process Effects 0.000 claims abstract description 13
- 238000007405 data analysis Methods 0.000 claims abstract description 11
- 238000007726 management method Methods 0.000 claims abstract description 11
- 238000013500 data storage Methods 0.000 claims abstract description 8
- 230000002159 abnormal effect Effects 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims description 10
- 238000005192 partition Methods 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 6
- 238000012423 maintenance Methods 0.000 claims description 6
- 230000007246 mechanism Effects 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 3
- 230000008030 elimination Effects 0.000 claims description 3
- 238000003379 elimination reaction Methods 0.000 claims description 3
- 238000004519 manufacturing process Methods 0.000 claims 1
- 230000005611 electricity Effects 0.000 abstract description 2
- 238000004140 cleaning Methods 0.000 description 3
- 238000011084 recovery Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0202—Market predictions or forecasting for commercial activities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/06—Energy or water supply
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Marketing (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Game Theory and Decision Science (AREA)
- Public Health (AREA)
- Water Supply & Treatment (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Primary Health Care (AREA)
- Tourism & Hospitality (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a monitoring method based on real-time data of a marketing system in the power industry, which is characterized by comprising a data storage module, a data analysis module, an API access module, a consumer management module and a monitoring module; the data storage module keeps the required monitoring data on the monitoring server through source data synchronization and source server bypass flow monitoring; the data analysis module sets different monitoring indexes for the acquired various data; the API access module is used for notifying corresponding personnel of the abnormal condition in real time and taking corresponding measures in time; the consumer management module comprises a kafka component; the monitoring module maintains the migration tasks and scripts through data migration monitoring. The invention can greatly improve the efficiency of data query, shorten the working period and reduce the manual on-duty time; once data problems occur, the system can inform the users through channels such as short messages and mails, and can know the whole electricity marketing, checking and receiving process at any time and any place.
Description
Technical Field
The invention relates to the field of marketing monitoring in the power industry, in particular to a monitoring method based on real-time data of a marketing system in the power industry.
Background
Aiming at the problems that in the existing electric power industry marketing system, all function points of the reading, checking and receiving business are controlled dispersedly and operated complicatedly, for business personnel, the risk of misoperation exists in monitoring all data, the accurate operation can be realized by means of high-grade professionals, the personnel cost is high, the optimal regulation and control time is easy to miss, therefore, the reading, checking and receiving work needs to be continuously optimized, the reading, checking and receiving control is enhanced, the damage to the interests of users can be avoided, and the stability of the system is guaranteed.
Disclosure of Invention
The invention aims to provide a monitoring method based on real-time data of a marketing system in the power industry, which is used for displaying various indexes concerned by business personnel to a graphical interface after cleaning the data through a bypass device under the condition of not influencing the performance of a server of the original marketing system so as to solve the problems in the background technology.
In order to achieve the purpose, the invention adopts the following technical scheme:
a monitoring method based on real-time data of a marketing system in the power industry is characterized by comprising a data storage module, a data analysis module, an API access module, a consumer management module and a monitoring module; the data storage module keeps the required monitoring data on the monitoring server through source data synchronization and source server bypass flow monitoring; the data analysis module sets different monitoring indexes such as automatic meter reading rate, electric charge recovery rate, bill pushing rate and the like according to different service scenes of the reading and checking service for various acquired data, knows the service condition anytime and anywhere, and performs real-time monitoring and early warning on the service; the API access module is used for realizing channel modes such as short messages, mails and the like for abnormal conditions in real time, informing corresponding personnel and taking corresponding measures in time; the consumer management module comprises a kafka component; the monitoring module monitors the data migration, maintains the migration tasks and the scripts, monitors the data migration process, and ensures that the migration tasks of each database are visible and abnormal data can be processed in time.
The data analysis module comprises a database analysis comparison tool, is a tool for ensuring a data synchronization result, needs to be connected with a plurality of databases, configures a source end and a target end of each data synchronization channel, and establishes a synchronization link; the difference between the two data sources is analyzed, and a processing rule basis is provided for subsequent synchronization of the data of the heterogeneous base table; because the marketing system is composed of multiple data sources, different network strategies need to be opened for manual data cross-database checking, and operations such as multiple leading-in and leading-out are carried out for comparison. By establishing a database comparison tool, the consistency of the data of the source end and the target end is checked regularly, and a processing script is generated for the data with difference, so that the closed-loop processing can be performed on the data synchronization process, and the accuracy of the data synchronization is further ensured.
The consumer management module is a further application to kafka (open source streaming platform) components; the kafka component is used by simple configuration alone, and high-performance execution of data synchronization cannot be guaranteed; in order to ensure that consumed information is timely and effective, a heartbeat detection mechanism is added, and heartbeat information is stored in a remote Dictionary server, namely a remote Dictionary service, so that the IO of a database is prevented from being influenced by the storage in the database; in addition, in order to establish a stable and controllable information consumption process, the functions of starting and stopping, detailed inquiry, monitoring and the like are added, and the whole process is visual and controllable; the method specifically comprises the following steps:
1) consumer registration: in order to monitor all consumers, each consumer registers the consumer in the redis after being started;
2) heartbeat registration: in order to timely and effectively detect the current consumer information in the redis, a heartbeat detection mechanism is added, and the consumer 30s sends heartbeat information to the redis to prove that the consumer is still online;
3) consumer elimination: polling all consumers in the redis, and eliminating consumer nodes which do not send heartbeats for 90 s;
4) consumer start and pause consumption: consumer consumption can be manually initiated and suspended;
5) consumer monitoring: displaying whether the current running state of each consumer is normal or not in a chart form; displaying error reasons for the stopped nodes, processing the errors, and clicking to continue consumption;
6) consumer consumption details: displaying the consumption data volume and the data volume to be consumed of the partition consumed by the consumer;
7) consumer consumption performance: displaying the consumption performance (data volume consumed per minute) of the consumer in a broken line graph form;
8) consumer consumption summary: showing the consumption subject of the consumer, wherein the consumption subject comprises a plurality of partitions, and the consumed data quantity and the consumed quantity of each partition;
consumer consumption overall performance: the consumption performance (data volume consumed per minute) of each consumer is shown in the form of a broken line graph.
The data migration is a work carried out for reducing historical data before carrying out data synchronization, and comprises the following functions;
1) and (3) database configuration: configuring a required database comprising information such as a user name, a password, an IP address, a port and the like, and storing the information; the configuration is to provide basic information for the connection;
connecting databases of the database script files to be executed, deploying and connecting a plurality of databases at the same time, and acting on the connected databases at the same time when the database script files are executed;
2) data migration task maintenance: maintaining information such as a task name and a task rule at the time of data migration, and simultaneously supporting uploading or editing of a database migration script, a processing program and the like;
3) and (3) engine information maintenance: maintaining engine information, such as name, ip, etc.;
4) log query: recording a data migration task execution log, and inquiring task execution log information according to the task name and the task information;
5) and (3) task monitoring: and recording a data migration task execution log, monitoring a task execution result and providing a query display function.
The monitoring module also comprises a monitoring billboard, and specifically comprises the following functions.
1) Monitoring the connection condition of the database: monitoring the connection condition of the database, displaying the connection or failure condition of the connection statistical database, and displaying the information of the connected or failed database;
2) monitoring kafka connection condition: kafka displays information such as ip, port, etc. of the producing and consuming end.
3) Monitoring released information: inquiring the acquired release plan, and displaying release plan information such as to-be-released plan information, to-be-released program package information, released version information and the like.
4) Monitoring the replacement file: counting the replacement times of the program files, wherein the program files can be inquired according to program versions or years, and the replacement times of related configuration files are counted, such as: the times of replacing entity files, the times of replacing protocol files and the like;
5) and (3) script execution monitoring: and counting data such as script execution quantity, script execution success quantity, script execution failure quantity and the like.
Compared with the prior art, the invention has the beneficial effects that:
the invention provides a real-time data monitoring method, which is used for displaying various indexes concerned by business personnel to a graphical interface after cleaning data through bypass equipment under the condition of not influencing the performance of a server of an original marketing system, helping the business personnel to find problem conditions in time, greatly improving the efficiency of data query, shortening the working period and reducing the manual guard time. Once data problems occur, the system can inform the users through channels such as short messages and mails, and can know the whole electricity marketing, checking and receiving process at any time and any place.
Drawings
Fig. 1 is a schematic diagram of a monitoring method based on real-time data of a marketing system in the power industry according to the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it is to be understood that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments, and all other embodiments obtained by those skilled in the art without any inventive work based on the embodiments of the present invention belong to the scope of the present invention.
As shown in fig. 1, a monitoring method based on real-time data of a marketing system in the power industry is characterized by comprising a data storage module, a data analysis module, an API access module, a consumer management module and a monitoring module; the data storage module keeps the required monitoring data on the monitoring server through source data synchronization and source server bypass flow monitoring; the data analysis module sets different monitoring indexes such as automatic meter reading rate, electric charge recovery rate, bill pushing rate and the like according to different service scenes of the reading and checking service for various acquired data, knows the service condition anytime and anywhere, and performs real-time monitoring and early warning on the service; the API access module is used for realizing channel modes such as short messages, mails and the like for abnormal conditions in real time, informing corresponding personnel and taking corresponding measures in time; the consumer management module comprises a kafka component; the monitoring module monitors the data migration, maintains the migration tasks and the scripts, monitors the data migration process, and ensures that the migration tasks of each database are visible and abnormal data can be processed in time.
The data analysis module comprises a database analysis comparison tool, is a tool for ensuring a data synchronization result, needs to be connected with a plurality of databases, configures a source end and a target end of each data synchronization channel, and establishes a synchronization link; the difference between the two data sources is analyzed, and a processing rule basis is provided for subsequent synchronization of the data of the heterogeneous base table; because the marketing system is composed of multiple data sources, different network strategies need to be opened for manual data cross-database checking, and operations such as multiple leading-in and leading-out are carried out for comparison. By establishing a database comparison tool, the consistency of the data of the source end and the target end is checked regularly, and a processing script is generated for the data with difference, so that the closed-loop processing can be performed on the data synchronization process, and the accuracy of the data synchronization is further ensured.
The consumer management module is a further application to kafka (open source streaming platform) components; the kafka component is used by simple configuration alone, and high-performance execution of data synchronization cannot be guaranteed; in order to ensure that consumed information is timely and effective, a heartbeat detection mechanism is added, and heartbeat information is stored in a remote Dictionary server, namely a remote Dictionary service, so that the IO of a database is prevented from being influenced by the storage in the database; in addition, in order to establish a stable and controllable information consumption process, the functions of starting and stopping, detailed inquiry, monitoring and the like are added, and the whole process is visual and controllable; the method specifically comprises the following steps:
1) consumer registration: in order to monitor all consumers, each consumer registers the consumer in the redis after being started;
2) heartbeat registration: in order to timely and effectively detect the current consumer information in the redis, a heartbeat detection mechanism is added, and the consumer 30s sends heartbeat information to the redis to prove that the consumer is still online;
3) consumer elimination: polling all consumers in the redis, and eliminating consumer nodes which do not send heartbeats for 90 s;
4) consumer start and pause consumption: consumer consumption can be manually initiated and suspended;
5) consumer monitoring: displaying whether the current running state of each consumer is normal or not in a chart form; displaying error reasons for the stopped nodes, processing the errors, and clicking to continue consumption;
6) consumer consumption details: displaying the consumption data volume and the data volume to be consumed of the partition consumed by the consumer;
7) consumer consumption performance: displaying the consumption performance (data volume consumed per minute) of the consumer in a broken line graph form;
8) consumer consumption summary: showing the consumption subject of the consumer, wherein the consumption subject comprises a plurality of partitions, and the consumed data quantity and the consumed quantity of each partition;
consumer consumption overall performance: the consumption performance (data volume consumed per minute) of each consumer is shown in the form of a broken line graph.
The data migration is a work carried out for reducing historical data before carrying out data synchronization, and comprises the following functions;
1) and (3) database configuration: configuring a required database comprising information such as a user name, a password, an IP address, a port and the like, and storing the information; the configuration is to provide basic information for the connection;
connecting databases of the database script files to be executed, deploying and connecting a plurality of databases at the same time, and acting on the connected databases at the same time when the database script files are executed;
2) data migration task maintenance: maintaining information such as a task name and a task rule at the time of data migration, and simultaneously supporting uploading or editing of a database migration script, a processing program and the like;
3) and (3) engine information maintenance: maintaining engine information, such as name, ip, etc.;
4) log query: recording a data migration task execution log, and inquiring task execution log information according to the task name and the task information;
5) and (3) task monitoring: and recording a data migration task execution log, monitoring a task execution result and providing a query display function.
The monitoring module also comprises a monitoring billboard, and specifically comprises the following functions.
1) Monitoring the connection condition of the database: monitoring the connection condition of the database, displaying the connection or failure condition of the connection statistical database, and displaying the information of the connected or failed database;
2) monitoring kafka connection condition: kafka displays information such as ip, port, etc. of the producing and consuming end.
3) Monitoring released information: inquiring the acquired release plan, and displaying release plan information such as to-be-released plan information, to-be-released program package information, released version information and the like.
4) Monitoring the replacement file: counting the replacement times of the program files, wherein the program files can be inquired according to program versions or years, and the replacement times of related configuration files are counted, such as: the times of replacing entity files, the times of replacing protocol files and the like;
5) and (3) script execution monitoring: and counting data such as script execution quantity, script execution success quantity, script execution failure quantity and the like.
The embodiment provides a real-time data monitoring method, which is used for displaying various indexes concerned by business personnel to a graphical interface after cleaning data through bypass equipment under the condition that the performance of an original marketing system server is not influenced, so that the business personnel can find problem conditions in time, the efficiency of data query is greatly improved, the work period is shortened, and the manual guard time is reduced. For example, on a marketing system in the power industry, monitoring indexes concerned by the service can be screened out according to the importance of the service, for example, part of indexes of important processes such as monthly-turning meter reading opening, meter reading, electric charge calculation and the like are monitored, a threshold value of the monitoring index is set in the early period, once a data problem occurs, the data problem can be notified through channels such as short messages and mails, and the whole process of reading, checking, and accepting can be known anytime and anywhere.
The foregoing shows and describes the general principles, essential features, and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, and that the preferred embodiments of the invention and described in the specification are only preferred embodiments of the invention and are not intended to limit the invention, and that various changes and modifications may be made without departing from the novel spirit and scope of the invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (5)
1. A monitoring method based on real-time data of a marketing system in the power industry is characterized by comprising a data storage module, a data analysis module, an API access module, a consumer management module and a monitoring module; the data storage module keeps the required monitoring data on the monitoring server through source data synchronization and source server bypass flow monitoring; the data analysis module sets different monitoring indexes for various acquired data according to different service scenes on the copying, checking and receiving service; the API access module is used for notifying corresponding personnel of the abnormal condition in real time and taking corresponding measures in time; the consumer management module comprises a kafka component; the monitoring module monitors the data migration, maintains the migration tasks and the scripts, monitors the data migration process, and ensures that the migration tasks of each database are visible and abnormal data can be processed in time.
2. The electric power industry marketing system real-time data-based monitoring method of claim 1, wherein: the data analysis module comprises a database analysis comparison tool, is a tool for ensuring a data synchronization result, needs to be connected with a plurality of databases, configures a source end and a target end of each data synchronization channel, and establishes a synchronization link; and the difference between the two data sources is analyzed, and a processing rule basis is provided for subsequent synchronization of the data of the heterogeneous base table.
3. The electric power industry marketing system real-time data-based monitoring method of claim 1, wherein: the consumer management module is a further application to kafka (open source streaming platform) components; the kafka component is used by simple configuration alone, and high-performance execution of data synchronization cannot be guaranteed; in order to ensure that consumed information is timely and effective, a heartbeat detection mechanism is added, and heartbeat information is stored in a remote Dictionary server, namely a remote Dictionary service, so that the IO of a database is prevented from being influenced by the storage in the database; the method specifically comprises the following steps:
1) consumer registration: in order to monitor all consumers, each consumer registers the consumer in the redis after being started;
2) heartbeat registration: in order to timely and effectively detect the current consumer information in the redis, a heartbeat detection mechanism is added, and the consumer 30s sends heartbeat information to the redis to prove that the consumer is still online;
3) consumer elimination: polling all consumers in the redis, and eliminating consumer nodes which do not send heartbeats for 90 s;
4) consumer start and pause consumption: consumer consumption can be manually initiated and suspended;
5) consumer monitoring: displaying whether the current running state of each consumer is normal or not in a chart form; displaying error reasons for the stopped nodes, processing the errors, and clicking to continue consumption;
6) consumer consumption details: displaying the consumption data volume and the data volume to be consumed of the partition consumed by the consumer;
7) consumer consumption performance: displaying the consumption performance (data volume consumed per minute) of the consumer in a broken line graph form;
8) consumer consumption summary: showing the consumption subject of the consumer, wherein the consumption subject comprises a plurality of partitions, and the data quantity and the consumption quantity of each partition are paid;
9) consumer consumption overall performance: the consumption performance (data volume consumed per minute) of each consumer is shown in the form of a broken line graph.
4. The electric power industry marketing system real-time data-based monitoring method of claim 1, wherein: the data migration is a work carried out for reducing historical data before carrying out data synchronization, and comprises the following functions;
1) and (3) database configuration: configuring a required database comprising information such as a user name, a password, an IP address, a port and the like, and storing the information; the configuration is to provide basic information for the connection;
connecting databases of the database script files to be executed, deploying and connecting a plurality of databases at the same time, and acting on the connected databases at the same time when the database script files are executed;
2) data migration task maintenance: maintaining information such as a task name and a task rule at the time of data migration, and simultaneously supporting uploading or editing of a database migration script, a processing program and the like;
3) and (3) engine information maintenance: maintaining engine information, such as name, ip, etc.;
4) log query: recording a data migration task execution log, and inquiring task execution log information according to the task name and the task information;
5) and (3) task monitoring: and recording a data migration task execution log, monitoring a task execution result and providing a query display function.
5. The electric power industry marketing system real-time data-based monitoring method of claim 1, wherein: the monitoring module also comprises a monitoring billboard, and specifically comprises the following functions.
1) Monitoring the connection condition of the database: monitoring the connection condition of the database, displaying the connection or failure condition of the connection statistical database, and displaying the information of the connected or failed database;
2) monitoring kafka connection condition: kafka display information, including ip and port of production and consumption end;
3) monitoring released information: inquiring the acquired release plan, and displaying the information of the to-be-released plan, the information of the to-be-released program package and the information of the released version;
4) monitoring the replacement file: counting the replacement times of the program files, wherein the replacement times of the related configuration files can be counted by inquiring according to the program version or year;
5) and (3) script execution monitoring: and counting data such as script execution quantity, script execution success quantity, script execution failure quantity and the like.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111532784.9A CN114202365A (en) | 2021-12-15 | 2021-12-15 | Monitoring method based on real-time data of marketing system in power industry |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111532784.9A CN114202365A (en) | 2021-12-15 | 2021-12-15 | Monitoring method based on real-time data of marketing system in power industry |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114202365A true CN114202365A (en) | 2022-03-18 |
Family
ID=80653902
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111532784.9A Pending CN114202365A (en) | 2021-12-15 | 2021-12-15 | Monitoring method based on real-time data of marketing system in power industry |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114202365A (en) |
Citations (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105761010A (en) * | 2016-02-24 | 2016-07-13 | 国网山东省电力公司 | Method and system for real-time monitoring of group enterprise audit based on real-time data acquisition |
| CN105871605A (en) * | 2016-03-30 | 2016-08-17 | 国网江西省电力科学研究院 | Operation and maintenance monitoring platform based on big power marketing data |
| US20160321308A1 (en) * | 2015-05-01 | 2016-11-03 | Ebay Inc. | Constructing a data adaptor in an enterprise server data ingestion environment |
| CN106533791A (en) * | 2016-12-12 | 2017-03-22 | 武汉烽火信息集成技术有限公司 | End-to-end business quality optimization apparatus and method based on big data platform |
| CN106777164A (en) * | 2016-12-20 | 2017-05-31 | 东软集团股份有限公司 | A kind of Data Migration cluster and data migration method |
| JP2017162152A (en) * | 2016-03-09 | 2017-09-14 | キヤノン株式会社 | Data migration system, and method for controlling data migration system |
| US20170286412A1 (en) * | 2016-03-29 | 2017-10-05 | Wipro Limited | System and method for database migration with target platform scalability |
| CN109257440A (en) * | 2018-10-29 | 2019-01-22 | 南京南瑞信息通信科技有限公司 | A kind of service discovery and client load equalization methods based on service register center |
| CN109859068A (en) * | 2018-12-25 | 2019-06-07 | 广东电网有限责任公司信息中心 | A kind of electric network data real-time synchronization system based on resource pool technology |
| CN110223146A (en) * | 2019-06-06 | 2019-09-10 | 国网北京市电力公司 | Client's power purchase services entire process monitoring system and method |
| CN110489247A (en) * | 2019-08-22 | 2019-11-22 | 深圳前海环融联易信息科技服务有限公司 | A kind of real-time integrated approach of data and device |
| CN110515925A (en) * | 2019-08-27 | 2019-11-29 | 江苏华库数据技术有限公司 | Method based on across engine database realization data Life cycle online management |
| CN110532225A (en) * | 2019-09-03 | 2019-12-03 | 北京百度网讯科技有限公司 | Storage engines switching method, device, electronic equipment and medium |
| CN111104393A (en) * | 2019-12-17 | 2020-05-05 | 深圳追一科技有限公司 | Data migration method and device, electronic equipment and storage medium |
| WO2020215799A1 (en) * | 2019-04-24 | 2020-10-29 | 深圳先进技术研究院 | Log analysis-based mongodb data migration monitoring method and apparatus |
| CN111897878A (en) * | 2020-08-25 | 2020-11-06 | 中国工商银行股份有限公司 | Main and auxiliary data synchronization method and system |
| CN112073265A (en) * | 2020-08-31 | 2020-12-11 | 帷幄匠心科技（杭州）有限公司 | Internet of things monitoring method and system based on distributed edge computing |
| CN112434050A (en) * | 2020-10-16 | 2021-03-02 | 广东电力信息科技有限公司 | Data synchronization method and device of power grid business processing system and business processing system |
| CN113127412A (en) * | 2021-04-23 | 2021-07-16 | 深圳市酷开网络科技股份有限公司 | Data migration method and device, computer equipment and storage medium |
| CN113190516A (en) * | 2021-05-26 | 2021-07-30 | 中国工商银行股份有限公司 | Data synchronization monitoring method and device |
| CN113656503A (en) * | 2021-08-20 | 2021-11-16 | 北京健康之家科技有限公司 | Data synchronization method, device and system and computer readable storage medium |
-
2021
- 2021-12-15 CN CN202111532784.9A patent/CN114202365A/en active Pending
Patent Citations (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160321308A1 (en) * | 2015-05-01 | 2016-11-03 | Ebay Inc. | Constructing a data adaptor in an enterprise server data ingestion environment |
| CN105761010A (en) * | 2016-02-24 | 2016-07-13 | 国网山东省电力公司 | Method and system for real-time monitoring of group enterprise audit based on real-time data acquisition |
| JP2017162152A (en) * | 2016-03-09 | 2017-09-14 | キヤノン株式会社 | Data migration system, and method for controlling data migration system |
| US20170286412A1 (en) * | 2016-03-29 | 2017-10-05 | Wipro Limited | System and method for database migration with target platform scalability |
| CN105871605A (en) * | 2016-03-30 | 2016-08-17 | 国网江西省电力科学研究院 | Operation and maintenance monitoring platform based on big power marketing data |
| CN106533791A (en) * | 2016-12-12 | 2017-03-22 | 武汉烽火信息集成技术有限公司 | End-to-end business quality optimization apparatus and method based on big data platform |
| CN106777164A (en) * | 2016-12-20 | 2017-05-31 | 东软集团股份有限公司 | A kind of Data Migration cluster and data migration method |
| CN109257440A (en) * | 2018-10-29 | 2019-01-22 | 南京南瑞信息通信科技有限公司 | A kind of service discovery and client load equalization methods based on service register center |
| CN109859068A (en) * | 2018-12-25 | 2019-06-07 | 广东电网有限责任公司信息中心 | A kind of electric network data real-time synchronization system based on resource pool technology |
| WO2020215799A1 (en) * | 2019-04-24 | 2020-10-29 | 深圳先进技术研究院 | Log analysis-based mongodb data migration monitoring method and apparatus |
| CN110223146A (en) * | 2019-06-06 | 2019-09-10 | 国网北京市电力公司 | Client's power purchase services entire process monitoring system and method |
| CN110489247A (en) * | 2019-08-22 | 2019-11-22 | 深圳前海环融联易信息科技服务有限公司 | A kind of real-time integrated approach of data and device |
| CN110515925A (en) * | 2019-08-27 | 2019-11-29 | 江苏华库数据技术有限公司 | Method based on across engine database realization data Life cycle online management |
| CN110532225A (en) * | 2019-09-03 | 2019-12-03 | 北京百度网讯科技有限公司 | Storage engines switching method, device, electronic equipment and medium |
| CN111104393A (en) * | 2019-12-17 | 2020-05-05 | 深圳追一科技有限公司 | Data migration method and device, electronic equipment and storage medium |
| CN111897878A (en) * | 2020-08-25 | 2020-11-06 | 中国工商银行股份有限公司 | Main and auxiliary data synchronization method and system |
| CN112073265A (en) * | 2020-08-31 | 2020-12-11 | 帷幄匠心科技（杭州）有限公司 | Internet of things monitoring method and system based on distributed edge computing |
| CN112434050A (en) * | 2020-10-16 | 2021-03-02 | 广东电力信息科技有限公司 | Data synchronization method and device of power grid business processing system and business processing system |
| CN113127412A (en) * | 2021-04-23 | 2021-07-16 | 深圳市酷开网络科技股份有限公司 | Data migration method and device, computer equipment and storage medium |
| CN113190516A (en) * | 2021-05-26 | 2021-07-30 | 中国工商银行股份有限公司 | Data synchronization monitoring method and device |
| CN113656503A (en) * | 2021-08-20 | 2021-11-16 | 北京健康之家科技有限公司 | Data synchronization method, device and system and computer readable storage medium |
Non-Patent Citations (6)
| Title |
|---|
| CHAO‑TUNG YANG 等: "The implementation of data storage and analytics platform for big data lake of electricity usage with spark", THE JOURNAL OF SUPERCOMPUTING, vol. 77, 13 November 2020 (2020-11-13), pages 5934, XP037449473, DOI: 10.1007/s11227-020-03505-6 * |
| 李世斌;郭永振;唐刚;: "国产数据库选型测评指标体系", 计算机系统应用, no. 08, 15 August 2020 (2020-08-15), pages 266 - 270 * |
| 王永超;鲁鸣鸣;: "面向金融行业的大数据迁移的研究与实现", 计算机工程与应用, no. 13, 1 July 2018 (2018-07-01), pages 93 - 99 * |
| 王飞鸣 等: "基于智能电网调度控制的系统数据总线技术", 电子设计工程, vol. 28, no. 5, 31 March 2020 (2020-03-31), pages 139 - 142 * |
| 程永奇: "电力营销大型数据迁移及测试", 电力信息化, vol. 7, no. 3, 15 March 2009 (2009-03-15), pages 91 - 93 * |
| 赵亚强 等: "关于大数据时代数据迁移关键技术的研究", 数字技术与应用, vol. 37, no. 12, 31 December 2019 (2019-12-31), pages 29 - 30 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107302466B (en) | Big data analysis platform and method for dynamic loop monitoring system | |
| CN108365985A (en) | A kind of cluster management method, device, terminal device and storage medium | |
| CN111176879A (en) | Fault repairing method and device for equipment | |
| CN103200050A (en) | Server hardware state monitoring method and server hardware state monitoring system | |
| CN105071969A (en) | JMX (Java Management Extensions)-based customization real-time monitoring and automatic exception handling system and method | |
| CN106407030A (en) | Failure processing method and system for storage cluster system | |
| CN108599977B (en) | System and method for monitoring system availability based on statistical method | |
| CN109901969B (en) | Design method and device of centralized monitoring management platform | |
| CN112416902A (en) | One-key inspection method for host and database | |
| CN112865311B (en) | Method and device for monitoring message bus of power system | |
| CN111431754A (en) | Fault analysis method and system for power distribution and utilization communication network | |
| CN111159165A (en) | Electric power underground low-power-consumption edge computing system and method based on cloud platform | |
| CN115529595A (en) | Method, device, equipment and medium for detecting abnormity of log data | |
| CN113468159A (en) | Data application full-link management and control method and system | |
| WO2015187001A2 (en) | System and method for managing resources failure using fast cause and effect analysis in a cloud computing system | |
| CN113111261A (en) | Data processing method of cloud platform, cloud platform and panoramic analysis system | |
| CN117290180A (en) | Monitoring method, equipment and medium based on time sequence data analysis equipment operation state | |
| CN111224819A (en) | Distributed messaging system | |
| CN108964957B (en) | Method for monitoring data communication service quality and big data system | |
| CN114202365A (en) | Monitoring method based on real-time data of marketing system in power industry | |
| CN112214459A (en) | Resource processing flow log collection system based on event mechanism | |
| CN111274083A (en) | Method and system for distributed monitoring and acquisition of server hardware indexes | |
| CN113537824A (en) | Power grid data full link monitoring system | |
| CN114244685A (en) | Cloud service center access exception handling system | |
| CN113765717A (en) | Operation and maintenance management system based on secret-related special computing platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |