WO2016004652A1

WO2016004652A1 - Intelligent power usage management method and system based on ami and j2ee

Info

Publication number: WO2016004652A1
Application number: PCT/CN2014/082782
Authority: WO
Inventors: 罗华永; 辜文斌; 朱海萍; 黄继勇; 宋卫平; 何灵慧; 沈磊
Original assignee: 四川中电启明星信息技术有限公司
Priority date: 2014-07-07
Filing date: 2014-07-23
Publication date: 2016-01-14
Also published as: CN104123134A; CN104123134B; PH12017500225A1

Abstract

An intelligent power usage method based on AMI and J2EE, comprising the following steps: according to different service requirements, assigning an acquisition task according to the configuration condition requirements of data to be acquired; executing the acquisition task by automatically issuing an acquisition instruction to an acquisition terminal or a measurement device according to the requirements, and obtaining various data of the acquisition terminal or the measurement device; checking data, including checking service rules, checking data integrity, and checking data quality of the acquired data so as to check whether the data results are correct; and storing the data, including storing the data obtained from the acquisition terminal or the measurement device to a cache region, and storing the data in batches when the data in the cache region reaches a set amount. The intelligent power usage management system comprises a sensor, a serial server, a communication service circuit and an acquisition terminal, and conducts automatic or manual supplementary acquisition by employing a technical means to ensure the data integrity, without adding hardware facilities.

Description

Intelligent electricity data management method and system based on AMI and J2EE

The invention relates to the field of electrical data management, power data collection, display and intelligent monitoring, and in particular to an intelligent power data management method and system based on AMI and J2EE.

Background technique

Currently widely used in the United States is the Advanced Measurement System AMI, and the important one is the Metrology Data Management System (MDMS). MDMS is a database with analysis tools that, when used in conjunction with the AMI automated data handset system, handles and stores meter values and interacts with other information systems, such as power information systems, billing systems, and power grids. , power outage management system, power quality management and load forecasting system, mobile workgroup management, geographic information system, transformer load management system.

A basic function of MDMS is to validate, edit, and estimate AMI data to ensure that the flow of data to the above information system or software is complete and accurate even when the communication network terminal and user side fail.

According to the needs of business development, major power companies in China have established power information collection systems for different types of users from the 1990s to the present, mainly related to oral energy harvesting systems, power load management systems, customer electric energy harvesting systems, and low voltage. Centralized meter reading system and distribution automation system, and the installation of various electric energy collection terminals has a certain scale. The power information collection system uses microelectronics and computer networks, sensing and other technologies to automatically read and process meter data, and comprehensively process the electricity consumption information of urban residents. It mainly realizes electricity data collection, electricity data management, meter control, marketing business comprehensive application, meter operation and maintenance management. The existing acquisition system can not meet the collection requirements of different types of users and different types of energy, lack of unified planning and unified standard specifications. Often, one measurement point should install several collection terminals and exchange data with the respective system main stations. This not only causes great waste of resources such as manpower and material resources, but also increases the burden of metering equipment, affecting the accuracy of metering and the reliable operation of equipment.

For example, the user's power information intelligent collection system focuses on data collection, analysis and prediction, and reduces the functions of data inspection and data mining, so that the integrity and correctness of the data cannot be guaranteed.

To this end, an acquisition system that compensates for data integrity is designed, such as power consumption information with a backup concentrator, mainly by failing to transmit power data to the primary station when communication between the primary concentrator and the primary station fails. When the communication between the main concentrator and the collector fails and the power consumption data cannot be collected in real time, the startup and switching to the standby concentrator, the standby concentrator continues to send the power data from the main concentrator that has not been sent to the primary station to The primary station, and continues to collect the power usage data collected by the collector and send it to the primary station to reduce the defect of data integrity. However, this method is solved by adding hardware devices, which inevitably increases the input cost and increases the investment benefit recovery period.

Summary of the invention

The object of the present invention is to provide an intelligent power data management method and system based on AMI and J2EE, and adopt technical means to automatically or manually compensate for the data integrity without adding hardware facilities.

The invention is realized by the following technical solutions: The intelligent power data management method based on AMI and J2EE includes the following steps:

Step A: Collection task assignment: According to different business requirements, according to the configuration requirements of the data to be collected, the allocation task is performed; Step B: Acquisition task execution: After step A, according to the prepared collection task, automatically send the acquisition instruction to the collection terminal or the measurement device according to the requirements, and obtain various types of data of the collection terminal or the measurement device;

Step C: Data check: Perform data check, data integrity check, and data quality check on the data collected in step B to check whether the data result is correct or not; Step D, Data storage: The data collected by the collection terminal or the measurement device is divided into one type of real-time data, two types of historical data, and three types of event data according to business needs, and corresponding message queues are respectively established, and the data is stored in the buffer area to reach the setting. Batch storage after volume.

Further, in order to better implement the method of the present invention, the step A includes:

Step A.l, data collection: intelligent power data management system for Q/GDW 376.1-2009 agreement,

Compatible development and feature development of conventional protocols such as MODBUS, according to different business needs, collecting energy consumption equipment data through smart meters, concentrators, and collectors, collecting environmental temperature data, radiation, wind speed, pressure and other data through sensors;

Step A.2. Data Filtering: The response message obtained from the measurement device consisting mainly of sensors and the collection terminal mainly composed of the smart meter, the concentrator, and the collector is passed through various built-in functions of the intelligent power data management system. The filter performs data matching and filtering, and finally converts the data and information that the intelligent power data management system can recognize.

Further, in order to better implement the method of the present invention, the step B includes the following steps: Step B1, collecting communication protocols of various mainstream collecting terminals or measuring devices on the market; Step B.2 Analyze the communication rules for these protocols, find commonalities, and develop compatible communication packets. Step B.3. Perform minimum-differentiated development for the personality communication rules of mainstream collection devices. Step B.4, package into a large commonality, small Heterogeneous compatibility communication API; Step B.5. Set up a test environment and test the mainstream acquisition equipment.

Step B.6. Modify the procedure according to the test results;

Step B.7. Complete the collection task execution process.

Further, in order to better implement the method of the present invention, the step C includes the following steps: Step Cl, data collection process: collection task information received by the management interface, according to specific configuration conditions The task is performed when the components are divided into components. According to the configuration conditions, the communication protocol of the target collection terminal is matched with the API in the analysis of the intelligent power data management protocol, and the data processing layer of the data processing layer is automatically converted by the intelligent power data management layer, and automatically The collection task sends an encrypted acquisition instruction that the collection device can recognize to the collection terminal, and the intelligent power data management data processing layer decrypts the encrypted data fed back by the collection terminal, and converts the collected data into intelligent power consumption data management. The format that the system can recognize and store.

Step C.2. Data quality inspection: Provide effective data inspection indicators to check the rationality and validity of the collected data;

Step C.3. Inspection results: The data is verified by the intelligent power data management system according to the data verification indicators set by the service specifications to achieve data integrity and correctness;

Step C.4, after step C.3, if the collected data is qualified data or the data is collected successfully, step D will be performed; if the collected data is unqualified or the data is unsuccessful, the data will be supplemented. The choice, when you choose to make up, perform step C.1, when you choose not to make up, perform step 0.

Further, in order to better implement the method of the present invention, step C.3 further includes the following steps: Step C3.1, Acquisition quality check: Check the execution quality of the collection task, and collect statistical data. Success rate, complete rate of collection;

Step C3.2, real-time recall: differential data collected after the data check is completed Communication.

An intelligent power data management method and system based on AMI and J2EE, comprising a sensor, a serial port server, a communication service circuit, and a collection terminal, wherein the sensor is connected to a communication service circuit through a serial port server, and the communication service circuit is connected to the collection terminal, The collection terminal includes a smart meter, a concentrator and a collector; the communication service circuit is provided with a filter chain for matching and filtering data of response messages of the obtained terminal or measuring device of the sensor, the smart meter, the concentrator, the collector, and the like. The IoHandler service processing layer is configured to complete the step B, the step C, and the step D; the filter chain layer includes a link layer filter, an encryption filter, and a request response filter. , an application layer filter, an event filter, a heartbeat filter, a clock peer filter, an identity authentication filter, an uplink message queue filter, and a downlink message queue filter; the IoHandler service processing layer passes the data layer through the filtering chain layer Processing is ultimately translated into business data for storage.

Further, in order to better implement the system of the present invention, TCP/IP communication is used and communication is performed between the serial port server and the communication service circuit, and JMX monitoring is adopted; communication between the collection terminal and the communication service circuit is performed. It uses TCP/IP communication and uses JMX monitoring.

Further, in order to better implement the system of the present invention, an IOService communication service is employed in the communication service circuit.

Compared with the prior art, the present invention has the following advantages and beneficial effects:

(1) The invention adopts technical means to automatically or manually replenish the data without the need to increase the hardware facilities, so as to achieve data integrity.

(2) The invention is based on the national grid company's finishing planning requirements and a series of standard specifications. All the collection standards and specifications are standardized and easy to adapt to various collection requirements.

(3) The present invention has a set of configurable, complete and validated data inspection indicators. Ensure the accuracy and validity of the data while ensuring data integrity.

(4) The invention reduces the input cost under the premise of ensuring complete functions, and has the advantages of relatively stable and high efficiency.

(5) The data acquisition implementation of the present invention implements an automatic or manual revocation method using non-blocking flow channel technology to ensure data integrity and effectiveness.

(6) The data inspection of the present invention adopts a configurable inspection index method to realize configurability and adjustment of data inspection, and designs a complete data inspection index scheme.

DRAWINGS

Figure 1 is a flow chart of the method of the present invention.

2 is a diagram of the system and data acquisition process of the present invention.

FIG. 3 is a communication monitoring diagram of JMX monitoring according to the present invention.

detailed description

The present invention will be described in detail below with reference to the embodiments, but the embodiments of the present invention are not limited thereto.

J2EE, a technical architecture that is completely different from traditional application development, contains many components, which can simplify and standardize the development and deployment of application systems, thereby improving portability, security and reuse value.

AMI, advanced metering infrastructure (AMI) is a complete network and system for measuring, collecting, storing, analyzing, using and transmitting user electricity data, electricity price information and system health. Demand response.

MDMS, measurement data management system. Is a database with analysis tools that can be used with the AMI Automatic Data Phone System (ADCS) to process and store meters It is an important part of the AMI system.

JMX, JMX is an application programming interface, a collection of scalable objects and methods that can be used to flexibly develop seamlessly integrated systems across a range of heterogeneous operating system platforms, system architectures, and network transport protocols. Network and Service Management Applications It provides user interface guidance, Java classes, and specifications for developing integrated systems, network, and network management applications.

Example 1

First, open the device in the system, complete the opening process, and then complete the intelligent power data management method based on AMI and J2EE. As shown in Figure 1, the following steps are included:

Step A: Collection task assignment: According to different business requirements, according to the configuration requirements of the data to be collected, the assignment task is assigned;

Step B. Acquisition task execution: After step A, according to the prepared collection task, automatically send the acquisition instruction to the collection terminal or measurement device according to the requirements, and obtain various types of data of the collection terminal or the measurement device;

Step C. Data check: Perform a series of checks on the data collected by step B, including business rule check, data integrity check, and data quality check, to check whether the data result is correct or not.

Step D: Data storage: The data collected by the collection terminal or the measurement device is divided into a type of real-time data, two types of historical data, and three types of event data according to business needs, respectively, corresponding message queues are established, and the data is stored in the cache. After the area reaches the set amount, it is stored in batches.

When the step D is completed, the data collection will be completed, and the completion step will be completed.

Example 2:

This embodiment is optimized on the basis of the above embodiment, and the device in the system is first turned on. After completing the opening process, complete the following steps:

Step A. Collection task assignment: According to different business requirements, according to the configuration requirements of the data to be collected, the assignment task is assigned, including the following steps:

Step Al, data acquisition: Intelligent power data management system for Q/GDW 376.1-2009 protocol, MODBUS and other acquisition terminal conventional protocol compatible development and feature development, according to different business needs, through smart meters, concentrators, collectors Collect energy consumption equipment data, collect environmental temperature data, radiation, wind speed, pressure and other data through sensors;

Step B: Acquisition task execution: After step A, according to the prepared collection task, automatically send the acquisition instruction to the collection terminal or measurement device according to the requirements, and obtain various data of the collection terminal or the measurement device, and the data acquisition overall Designed based on uniform specification requirements and standards, it is perfectly compatible with a wide range of acquisition requirements, including the following steps:

Step B1, collect communication protocols of various mainstream collection terminals or measurement devices on the market; Step B.2, analyze communication rules for these protocols, find commonality, and develop compatible communication packets; Step B.3, for mainstream acquisition Personalized communication rules of the device, for minimum differential development; Step B.4, packaged into a large commonality, small heterogeneous compatibility communication API;

Step B.5. Set up a test environment and test the mainstream acquisition equipment.

Step B.6. Modify the procedure according to the test results;

Step B.7. Complete the collection task execution process. Step C: Data check: The data collected in step B is subjected to a series of checks including business rule check, data integrity check, data quality check, etc., to check whether the data result is correct or not, and data acquisition is implemented. The non-blocking flow channel technology is used to realize the automatic or manual call mode to ensure the integrity and validity of the data. The data check adopts the configurable check indicator method to realize the configurable and adjustable data check, and designs a complete set. The data check indicator scheme, the step C includes the following steps:

Step Cl, data collection process: The collection task information received by the management interface is executed according to the specific configuration conditions when the collection task is divided into components, and the communication protocol matching the target collection terminal according to the configuration condition corresponds to the intelligent power consumption data management protocol. The API in the analysis, through the intelligent power data management data processing layer, performs data conversion on the API acquisition instruction, automatically sends the encrypted acquisition instruction that the collection device can recognize to the collection terminal according to the collection task, and the intelligent power data management data processing layer The encrypted data fed back by the collection terminal is algorithmically decrypted, and the collected data is converted into a format that the intelligent power data management system can recognize and store.

Step D: Data storage: The data collected by the collection terminal or the measurement device is divided into a type of real-time data, two types of historical data, and three types of event data according to business needs, and corresponding data is respectively established. The queue is stored in the buffer after the data is stored in the buffer area.

Example 3:

This embodiment is further optimized on the basis of the above embodiments, and further, in order to better implement the method of the present invention, step C.3 further includes the following steps:

Step C3.1, Collection quality inspection: Check the execution quality of the collection task, the success rate of statistical data collection, and the complete rate of collection;

Step C3.2. Real-time call collection: The differential acquisition communication is found after the data check is completed. Real-time recall, according to the received real-time data collection requirements, through remote technical means, automatically send acquisition commands, real-time call terminal or measurement equipment data. The invention collects various information in the real-time electricity unit, mainly includes information such as illuminance, temperature, humidity, smoke, pressure, flow, power consumption, equipment status, etc., real-time display, intelligent control and abnormal event monitoring and alarm.

Example 4:

The intelligent power data management system based on AMI and J2EE, as shown in FIG. 2, includes a sensor, a serial port server, a communication service circuit, and a collection terminal, wherein the sensor is connected to a communication service circuit through a serial port server, and the communication service circuit is connected and collected. a terminal, the collection terminal includes a smart meter, a concentrator, and a collector; and the communication service circuit is configured to perform data matching on response messages of the obtained terminal or measurement device of the sensor, the smart meter, the concentrator, the collector, and the like. Filtering the filter chain layer; the communication service circuit is provided with a loHandler service processing layer for completing step B, step C, step D; the filter chain layer includes a link layer filter, an encryption filter, Request response filter, application layer filter, event filter, heartbeat filter, clock peer filter, identity authentication filter, uplink message queue filter, and downlink message queue filter; the loHandler service processing through the filtering chain layer The layer ultimately transforms the processing of the data objects into business data for storage. Data collection is based on hardware devices such as concentrators, collectors, smart meters, sensors, and serial servers. It uses tcp/ip protocol and lOService communication service, and links layer filters and encryption filters set through the filtering chain layer. Request response filters, event filters, etc. collect and filter data, continue object processing (class I, class, parameter, event, modbus data) set by the data processing layer, data quality check, mining, data bulk inventory It is finally converted into business data for storage.

The data collected by the sensor is collected by using a sensor such as an illuminance sensor, a temperature sensor, a humidity sensor, a smoke sensor, and a pressure sensor provided in the measuring device; and the smart meter, the collector, and the concentrator are used The collection terminal collects information such as traffic, power consumption, and device status, and transmits the information to the communication service circuit, and the link layer filter, the encryption filter, and the request response filter on the filter chain layer set therein. The application layer filter, the event filter, the heartbeat filter, the clock peer filter, the identity authentication filter, the uplink message queue filter, and the downlink message queue filter are filtered accordingly, and the filter chain layer is not filtered. The same data is erased, the filtered data continues to be transformed through object processing (Class I, Class II, parameters, events, modbus data) set by the data processing layer, data quality check, mining, data bulk inventory to finally convert Store for business data.

The invention is mainly used for the operation display and intelligent monitoring of the electric equipment, the real-time operation of the electric equipment, the real-time parameters of the micro-environment, the linkage display and the intelligent control, when the electric equipment is unattended, the various possible occurrences Abnormal events are predicted, and various faults that have occurred are recorded and automatically notified to the responsible person.

The invention can liberate people from the daily heavy labor on the one hand, and can improve the efficiency of equipment use on the other hand, which is particularly important for China that is intelligently reducing emissions, increasing efficiency and reducing pollution. Example 5:

This embodiment is further optimized on the basis of the above embodiments. Further, in order to better implement the system of the present invention, TCP/IP communication is adopted when communicating between the serial port server and the communication service circuit. JMX monitoring; TCP/IP communication and JMX monitoring are used when communicating between the acquisition terminal and the communication service circuit.

The system monitors the status information of the controlled resource in real time through JMX. When the status of the controlled resource is abnormal, the monitoring system alarms by sending an email or sending a short message.

As shown in Figure 3, the system uses JXM monitoring set up by the JMX agent layer to collect controlled resource status information. The JMI agent layer runs on the same machine as the controlled resources. The controlled resource status information collected by the agent layer is sent to the monitoring application client management program of the monitoring system through the JMX distributed service layer component. The monitoring application client management program receives the monitored resource status information sent by the monitoring application agent and processes the information.

A variety of presentation methods are implemented in the data presentation, which not only displays the basic data, but also implements various parameters (personnel density, air humidity, ambient temperature, raw data, special conditions, etc.) through data mining and data analysis. Various predictions of electrical energy data.

The invention satisfies the requirements of information system authority management, uniformly manages enterprise identity data, and centrally manages all controlled resource objects or resource abstract objects, thereby effectively improving management efficiency and reducing production and management costs.

The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention in any way. Any simple modification or equivalent change to the above embodiment in accordance with the technical spirit of the present invention. All fall within the scope of protection of the present invention

Claims

M ^ ^

1. Intelligent power data management method based on AMI and J2EE, characterized in that: the following steps are included:

2. The AMI and J2EE-based intelligent power consumption data management method according to claim 1, wherein: the step A comprises:

Step Al, data acquisition: Intelligent power data management system for Q/GDW 376.1-2009 protocol, MODBUS and other acquisition terminal conventional protocol compatible development and feature development, according to different business needs, through smart meters, concentrators, collectors Collect energy consumption equipment data, including ambient temperature data, radiation data, wind speed data, and pressure data through sensors; Step A.2, Data Filtering: Measurement equipment consisting mainly of sensors and mainly by smart meters and concentrators The response message obtained by the collection terminal composed of the collector is matched and filtered by various built-in filters of the intelligent power data management system, and finally converted into data and signals recognizable by the intelligent power data management system. Interest.

3. The AMI and J2EE-based intelligent power consumption data management method according to claim 1, wherein: the step B comprises the following steps:

Step B.6. Modify the procedure according to the test results;

Step B.7. Complete the collection task execution process.

4. The AMI and J2EE-based intelligent power consumption data management method according to claim 1, wherein: the step C comprises the following steps:

Step C.3, Inspection results: Set by the intelligent power data management system according to the business specifications The data verification indicator verifies the data to achieve the integrity and correctness of the data; Step C.4, after step C.3, if the collected data is qualified data or the data is successfully collected, step D is performed; If the collected data is unqualified or the data is unsuccessful, the data will be selected. When the candidate is selected, the process C.1 is executed. When the selection is not made, the process is executed.

5. The AMI and J2EE-based intelligent power consumption data management method according to claim 4, wherein: step C.3 further comprises the following steps:

Step C3.2. Real-time call collection: The differential acquisition communication is found after the data check is completed.

6. Intelligent power consumption data management system based on AMI and J2EE, comprising: a sensor, a serial port server, a communication service circuit, and a collection terminal, wherein the sensor is connected to a communication service circuit through a serial port server, and the communication service circuit is connected and collected. a terminal, the collection terminal includes a smart meter, a concentrator, and a collector; and the communication service circuit is configured to perform data matching on response messages of the obtained terminal or measurement device of the sensor, the smart meter, the concentrator, the collector, and the like. Filtering the filter chain layer; the communication service circuit is provided with a loHandler service processing layer for completing step B, step C, step D; the filter chain layer includes a link layer filter, an encryption filter, Request response filter, application layer filter, event filter, heartbeat filter, clock peer filter, identity authentication filter, uplink message queue filter, and downlink message queue filter; the loHandler service processing through the filtering chain layer The layer transforms the data object processing into business data. Reserve.

7. The AMI and J2EE based intelligent power data management system according to claim 6, The utility model is characterized in that TCP/IP communication is used in communication between the serial port server and the communication service circuit and JMX monitoring is adopted; when communication is performed between the collection terminal and the communication service circuit,

TCP/IP communication and JMX monitoring.

8. The AMI and J2EE-based intelligent power consumption data management system according to claim 6, wherein: the IOService communication service is used in the communication service circuit.