AU2014405046B2 - System, method and apparatuses for data processing in power system - Google Patents

System, method and apparatuses for data processing in power system Download PDF

Info

Publication number
AU2014405046B2
AU2014405046B2 AU2014405046A AU2014405046A AU2014405046B2 AU 2014405046 B2 AU2014405046 B2 AU 2014405046B2 AU 2014405046 A AU2014405046 A AU 2014405046A AU 2014405046 A AU2014405046 A AU 2014405046A AU 2014405046 B2 AU2014405046 B2 AU 2014405046B2
Authority
AU
Australia
Prior art keywords
data
power system
data stream
stream
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
AU2014405046A
Other versions
AU2014405046A1 (en
Inventor
Jinlin AN
Xiaopei CHENG
Guo MA
Zhihui YANG
Qin Zhou
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Accenture Global Services Ltd
Original Assignee
Accenture Global Services Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Accenture Global Services Ltd filed Critical Accenture Global Services Ltd
Publication of AU2014405046A1 publication Critical patent/AU2014405046A1/en
Application granted granted Critical
Publication of AU2014405046B2 publication Critical patent/AU2014405046B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
    • H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
    • H02J13/00028—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment involving the use of Internet protocols
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
    • H02J13/00032—Systems characterised by the controlled or operated power network elements or equipment, the power network elements or equipment not otherwise provided for
    • H02J13/00034—Systems characterised by the controlled or operated power network elements or equipment, the power network elements or equipment not otherwise provided for the elements or equipment being or involving an electric power substation
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J2203/00—Indexing scheme relating to details of circuit arrangements for AC mains or AC distribution networks
    • H02J2203/20—Simulating, e g planning, reliability check, modelling or computer assisted design [CAD]
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J3/00—Circuit arrangements for ac mains or ac distribution networks
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
    • Y02E60/00—Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
    • Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
    • Y04S40/00—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them
    • Y04S40/20—Information technology specific aspects, e.g. CAD, simulation, modelling, system security

Landscapes

  • Engineering & Computer Science (AREA)
  • Power Engineering (AREA)
  • Supply And Distribution Of Alternating Current (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

System, method and apparatuses for data processing in a power system and a tangible computer readable medium are disclosed. In an embodiment, the system comprises at least one processor; and at least one memory storing computer executable instructions. The at least one memory and the computer executable instructions are configured to, with the at least one processor, cause the system to: group data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation; send the data in the data stream to one or more data processing nodes based on the power system resource groups associated therewith; and process the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith. A low-cost solution for a large scale real-time processing in the power system is provided, which is efficient, expansible and enables online changes of data processing processes.

Description

(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization
International Bureau (43) International Publication Date 3 March 2016 (03.03.2016)
Figure AU2014405046B2_D0001
(10) International Publication Number
WIPOIPCT
WO 2016/029367 Al (51) International Patent Classification:
H02J13/00 (2006.01) (21) International Application Number:
PCT/CN2014/085227 (22) International Filing Date:
August 2014 (26.08.2014) (25) Filing Language: English (26) Publication Language: English (71) Applicant (for all designated States except US): ACCENTURE GLOBAL SERVICES LIMITED [IE/IE]; 3 Grand Canal Plaza, Grand Canal Street Upper, Dublin, 4 (IE).
(72) Inventors; and (71) Applicants for US only)·. MA, Guo [CN/CN]; Accenture, 21/F West Tower, World Financial Center, No.l East 3rd Ring Middle Road, Chaoyang District, Beijing 100020 (CN). YANG, Zhihui [CN/CN]; Accenture, 21/F West Tower, World Financial Center, No.l East 3rd Ring Middle Road, Chaoyang District, Beijing 100020 (CN). ZHOU, Qin [US/CN]; Accenture, 21/F West Tower, World Financial Center, No.l East 3rd Ring Middle Road, Chaoyang District, Beijing 100020 (CN). AN, Jinlin [CN/CN]; Accenture, 21/F West Tower, World Financial Center, No.l East 3rd Ring Middle Road, Chaoyang District, Beijing 100020 (CN). CHENG, Xiaopei [CN/CN]; Accenture, 21/F West Tower, World Financial Center, No.l East 3rd Ring Middle Road, Chaoyang District, Beijing 100020 (CN).
(74) Agent: KING & WOOD MALLESONS; 20th Floor, East Tower, World Financial Centre, No.l Dongsanhuan Zhonglu, Chaoyang District, Beijing 100020 (CN).
(81) Designated States (unless otherwise indicated, for every kind of national protection available)·. AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JP, KE, KG, KN, KP, KR,
KZ, LA, LC, LK, LR, LS, LT, LU, LY, MA, MD, ME,
MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW.
(84) Designated States (unless otherwise indicated, for every kind of regional protection available)·. ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, [Continued on next page] (54) Title: SYSTEM, METHOD AND APPARATUSES FOR DATA PROCESSING IN POWER SYSTEM
WO 2016/029367 Al
Figure AU2014405046B2_D0002
( EnJ )
Fig. 4 (57) Abstract: System, method and apparatuses for data processing in a power system and a tangible computer readable medium are disclosed. In an embodiment, the system comprises at least one processor; and at least one memory storing computer executable instructions. The at least one memory and the computer executable instructions are configured to, with the at least one processor, cause the system to: group data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation; send the data in the data stream to one or more data processing nodes based on the power system resource groups associated therewith; and process the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith. A lowcost solution for a large scale real-time processing in the power system is provided, which is efficient, expansible and enables online changes of data processing processes.
WO 2016/029367 Al llllllllllllllllllllllllllllllllllllllllllllllllll^
SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, Published:
GW, KM, ML, MR, NE, SN, TD, TG). — internationai search repOrt (Art. 21(3))
Declarations under Rule 4.17:
— of inventorship (Rule 4.17 (iv))
WO 2016/029367
PCT/CN2014/085227
SYSTEM, METHOD AND APPARATUSES FOR DATA
PROCESSING IN POWER SYSTEM
TECHNICAL FIELD [0001] Embodiments of the present disclosure relate to the field of power system and more particularly to a system, method, and apparatuses of data processing in the power system and a tangible computer readable medium therefor.
BACKGROUND [0002] Various industries have networks associated with them. One such industry is the utility industry that manages a power grid. The power grid may include one or all of the following: electricity generation, electric power transmission, and electricity distribution. Electricity may be generated using generating stations, such as a coal fire power plant, a nuclear power plant, etc. For efficiency purposes, the generated electrical power is stepped up to a very high voltage (such as, for example, 345K Volts) and transmitted over transmission lines. The transmission lines may transmit the power long distances, such as across state lines or across international boundaries, until it reaches its wholesale customer, which may be a company that owns the local distribution network. The transmission lines may terminate at a transmission substation, which may step down the very high voltage to an intermediate voltage (such as, for ex ample, 138K Volts). From a transmission substation, smaller transmission lines (such as, for example, sub-transmission lines) transmit the intermediate voltage to distribution substations. At the distribution substations, the intennediate voltage may be again stepped down to a medium voltage (such as, for example, from 4K Volts to 23K Volts). One or more feeder circuits may emanate from the distribution substations. For example, four to tens of feeder circuits may emanate from the distribution substation. The feeder circuit is a 3-phase circuit comprising 4 wires (three wires for each of the 3 phases and one wire for neutral). Feeder circuits may be routed either above ground (on poles) or underground. The voltage on the feeder circuits may be tapped off periodically using distribution transformers, which step down the voltage from medium voltage to the consumer voltage (such as, for example, 120V). The
2014405046 19 Mar 2018 consumer voltage may then be used by the consumers.
[0003] One or more power companies, whose main responsibility is to supply reliable and economic electricity to their customers, manage the power grid, including planning, operation, and maintenance related to the power grid. In order to improve management efficiency and reduce management cost, the power companies have attempted to upgrade the power grid to be a “smart grid” by applying the state-of-the-art IT and power engineering technologies. The development of the smart grid requires a huge number of sensing devices or systems, such as Advanced Metering Infrastructures (AMI), Phase Measurement Units (PMU) and other online monitoring devices. These devices will generate a large volume of data and the data scale can be at a TB level. For example, in China, a provincial power company usually plans to install more than 10 million meters, which might generate nearly 4 TB data every month. Besides, Fig. 1 illustrates the data growth trend from recent research, from which it can be seen that the data volume will increase dramatically with the development of advanced distribution automation and AMI, and nearly reaches 800TB, which is a rather huge number of data. At the same time, it requires rapid data processing so as to provide useful information in time. Hence, the utilities are facing great challenges, especially, in memory computing and database storage.
[0004] Therefore, there is a need in the art for an improved solution for data processing and storage, more particularly for a large volume of real-time data.
SUMMARY OF THE DISCLOSURE [0005] In one aspect, the present invention provides a system for data processing in a power system, including at least one processor, and at least one memory storing computer executable instructions, wherein the at least one memory and the computer executable instructions are configured to, with the at least one processor, cause the system to group data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation, send the data in the data stream to one or more data processing nodes depending on current buffered message size and current waiting time and based on the power system resource groups associated therewith, and process the data in the data
2014405046 19 Mar 2018 stream at the one or more data processing nodes based on the power system resource groups associated therewith.
[0006] In an embodiment of the present disclosure, the grouping data in the data stream may comprise determining the power system resources respectively associated with the data in the data stream based on measurement point identification information contained within the data in the data stream and correlation between power system resources and measurement point identification information defined in the data model; and determining the power system resource groups associated with the data in the stream according to the determined power system resources and the hierarchy of the power grid operation defined in the data model.
[0007] In another embodiment of the present disclosure, the sending the data in the data stream may be dependent on current buffered message size and current waiting time.
[0008] In a further embodiment of the present disclosure, the data in the data stream may be sent when the current buffered message size reaches a size threshold considering current network load conditions.
[0009] In a still further embodiment of the present disclosure, the data in the data stream may be sent when the current waiting time is longer than a time threshold considering current network load conditions.
[0010] In a yet further embodiment of the present disclosure, the data in the data stream may be cached in the one or more data processing nodes for processing and the data in the data stream are further stored in a database, wherein corresponding data are loaded from the database to a cache of a data processing node in case of fault recovery or newly starting of the data processing node.
[0011] In a still yet further embodiment of the present disclosure, the data in the data stream may be stored in tables by year and a name for a table comprises information on the year, and wherein a key for each of the data is formed by an identification of a power system resource associated therewith and measurement time in a form of time shift in millisecond within the year of the data time.
[0012] In a further embodiment of the present disclosure, the data in the data stream may be split into one or more segments according to power system resources associated therewith and the one or more segments are parallelly and distributively
2014405046 19 Mar 2018 written to multiple regions of the database in a chronological order based on the keys for the data. Particularly, the data in the data stream are stored in the data base in formats that are respectively suitable for their own data types and suitable for data processing.
[0013] In a still further embodiment of the present disclosure, the processing the data in the data stream may be based on a distributive streaming computing architecture, and the data storage is based on a distributive database [0014] In another aspect, the present invention provides a method for data processing in a power system, including grouping data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation, sending the data in the data stream to one or more data processing nodes depending on current buffered message size and current waiting time and based on the power system resource groups associated therewith, and processing the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
[0015] In another aspect, the present invention provides an apparatus for data processing in a power system, the apparatus including a data grouping module configured to group data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation, a data sending module configured to send the data in the data stream to one or more data processing nodes depending on current buffered message size and current waiting time and based on the power system resource groups associated therewith, and a data processing module configured to process the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
[0016] In another aspect, the present invention provides an apparatus for data processing in a power system, the apparatus including means for grouping data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation, means for sending the data
2014405046 19 Mar 2018 in the data stream to one or more data processing nodes depending on current buffered message size and current waiting time and based on the power system resource groups associated therewith, and means for processing the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
[0017] In yet another aspect, the present invention provides a tangible computer-readable medium having a plurality of instructions executable by a processor to perform data processing in a power system, the tangible computer-readable medium includes instructions configured to perform steps of the method according to any one of
Claims 11 to 20.
[0018] With embodiments of the present disclosure, the data stream are grouped at the one or more receiving nodes based on the power system resource groups associated with data and distributed to and processed at processing nodes in accordance with the power system resource groups. In the present disclosure, there is provided a low-cost solution for a large scale real-time processing in the power system, which is efficient, expansible and enables online changes of data processing processes.
BRIEF DESCRIPTION OF THE DRAWINGS [0019] The above and other features of the present disclosure will become 20 more apparent through detailed explanation on the embodiments as illustrated in the embodiments with reference to the accompanying drawings wherein like reference numbers represent same or similar components throughout the accompanying drawings of the present disclosure, wherein:
[0020] Fig. 1 schematically illustrates a curve of electronic power data 25 growth according to recent research results in the prior art;
[0021] Fig. 2 schematically illustrates a diagram of exemplary architecture for the power rigid in which embodiments of the present disclosure can be implemented according to an embodiment of the present disclosure;
[0022] Fig. 3 schematically illustrates a diagram of data processing and data 30 storage according to an embodiment of the present disclosure;
[0023] Fig. 4 schematically illustrates a flow chart of a method for data processing in power system according to an embodiment of the present disclosure;
[0024] Figs. 5A to 5C schematically illustrate diagrams of power gird operation hierarchy, exemplary raw data, and exemplary mapped data according to an embodiment of the present disclosure;
2014405046 19 Mar 2018
5a
WO 2016/029367
PCT/CN2014/085227 [0025] Fig. 6 schematically illustrates a diagram of data processing operations in event of fault recovery according to an embodiment of the present disclosure;
[0026] Figs. 7A and 7B schematically illustrate diagrams of example data table design according to an embodiment of the present disclosure;
[0027] Figs. 8A and 8B schematically illustrate diagrams of exemplary data storage manner according to an embodiment of the present disclosure;
[0028] Figs. 9A and 9B schematically illustrate case simulation results according to an embodiment of the present disclosure;
[0029] Fig. 10 schematically illustrates a block diagram of a system for data processing in a power system according to an embodiment of the present disclosure;
[0030] Fig. 11 schematically illustrates a block diagram of an apparatus for data processing in a power system according to an embodiment of the present disclosure;
[0031] Fig. 12 schematically illustrates a block diagram of another apparatus for data processing in a power system according to another embodiment of the present disclosure; and [0032] Fig. 13 schematically illustrates a general computer system, programmable to be a specific computer system, which may represent any of the computing devices referenced herein.
DETAILED DESCRIPTION OF EMBODIMENTS [0033] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the embodiments. However, it is apparent to the skilled in the art that implementation of the present disclosure may not have these details and the present disclosure is not limited to the particular embodiments as introduced herein. On the contrary, any arbitrary combination of the following features and elements may be considered to implement and practice the present disclosure, regardless of whether they involve different embodiments. Thus, the following aspects, features and embodiments are only for illustrative purposes, and should not be understood as elements or limitations of
WO 2016/029367
PCT/CN2014/085227 the appended claims, unless otherwise explicitly specified in the claims. Additionally, in some instances, well known methods and structures have not been described in detail so as not to unnecessarily obscure the embodiments of the present disclosure.
[0034] In the current power system, a great deal of data will be generated per day and rapid data processing is required to provide useful information in time. Hence, in the present disclosure, a solution for data processing in power system is proposed to enable the data to be processed in real time, or in near real time so as to meet the requirements of the current power system.
[0035] Fig. 2 schematically illustrates a diagram of exemplary architecture for the power system in which embodiments of the present disclosure can be implemented according to an embodiment of the present disclosure. As illustrated in Fig. 2, data sources 110-1 to 110-n, such as various monitoring systems, monitoring devices, sensors, meters, etc., generate various types of data, these data are transmitted to a real-time processing & storage system 130 through a real-time data bus 120-1 or a real-time event bus 120-2. In the real-time processing & storage system 130, a real-time processing module 140 receives these data and processes based on information obtained from the data model 160 and information contained within the data and stores processed results into the storage 150. Via a unified information accessing module 170, various analysis and applications 180 can access the data model 160 and processes results or other data in the storage 150. This architecture as illustrated in the present disclosure will provide not only a real-time data processing and storage for a high volume of data but a rather good reliability, scalability and a ready data access, detailed description will be made to the real-time processing & storage hereinafter with reference to Figs. 3 to 12.
[0036] Fig. 3 schematically illustrates a diagram of data processing and data storage according to an embodiment of the present disclosure. As illustrated, data source 110 including e.g. Supervisory Control And Data Acquisition (SCADA) system, device monitoring devices, AMI, etc. provide data generated or acquired by them to the real-time processing system 140. Herein, the real-time processing system 140 may be based on a distributive stream processing technology, such as Apache Storm system, which is a distributed real-time computation system for processing fast, large streams of data. The real-time processing module 140 may comprise one or more receiving nodes
WO 2016/029367
PCT/CN2014/085227
141- 1, 141-2,... 141-m; one or more data processing nodes 142-1, 142-2, 142-3,
142- 4, ...,142-k-l, 142-k; and optionally, one or more data outputting nodes
143- 1,...143-j. The one or more receiving nodes are configured to receive the data stream from the data sources 110, which may be called as spouts in the Apache Stonn system. The one or more data processing nodes 142-1, 142-2, 142-3, 142-4, ..., 142-k-l, 142-k each contains a plurality of processes therein and are configured to process the data sent to them, which may be called as bolts in in the Apache Storm system. The one or more data outputting nodes 143-1, 143-j may be configured to collect processed results from the processing nodes and sent them to the data storage 150 for storing, which may also be called as bolts in the Apache Storm system. The receiving, processing and outputting may be performed in a distributed way utilizing distributed computing, for example based on clouding computing. Therefore, a cloud computing platform 190 may be provided to perform the data streaming processing. Finally, results obtained from the data stream processing can be stored into the data storage 150, which may have at least one database therein, and optionally the database may be a distributive database, such as Hbase™, which is the Hadoop database, an open-source, distributed, versioned, non-relational database modeled after Google's Bigtable.
[0037] A flow chart of a method for data processing in a power system according to an embodiment of the present disclosure is shown in Fig. 4. As illustrated in Fig. 4, first as step S401, data in a data stream at one or more data receiving node are grouped based on power system resource groups associated therewith. The power system power system resource groups associated therewith can be determined based on measurement point identification and the data model for the power system.
[0038] In the power grid, there is usually provided with a data model defining a hierarchy of power grid operation, which may cover various originations, for example, various elements and objects in transmission network, distribution network and customer domains and may provide a uniform and centralized data view to various data in the power grid. Fig. 5A schematically illustrates an exemplary data model according to an embodiment of the present disclosure. As illustrated, in the exemplary data model, power devices are arranged in a hierarchy of power grid operation in power transmission, power distribution and customer domains. For example, for power
WO 2016/029367
PCT/CN2014/085227 transmission, there are different voltage levels for electric equipment, such as 500kV, 220kV, and so on; for a certain voltage level, there are different types of electric equipment, such as substation, lines, etc.; for a certain type of electric equipment at a certain level, such as substation at 500KV, there are different electric equipment such as ST0082, ST0083, etc. Each substation ST0082, ST0083 further includes different electronic devices, such as busbar section, capacitor, circuit breaker, transformer and so on, each of which contains a plurality of measurement points, such as active power, inactive power, bottom oil temperature, etc. Therefore, such a data model clearly defines the hierarchy of the power grid operations. Besides, in the data model, there is contained identification information on electric equipment, electric devices, and measurement points, which reflects the correlation between these components and their identification. Based on the information, the data in data stream may be grouped.
[0039] Fig. 5B illustrates an exemplary raw data received from a data source. As illustrated in Fig. 5B, the raw data includes measurement ID “MeasID”, which is an identification of measurement point associated with the data; measurement time “timeStamp”, which indicates the time at which the data is measured; measurement value “Value”, which indicates the value of the measured data; data quality “Quality”, which indicates the quality of the data, with “0” representing a high quality. From information contained in the data, especially the measurement ID “MeasID,” and correlation provided in the data model, a power system resource associated with the data may be first determined, for example by searching the corresponding table in the data model using the measurement ID “MeasID” as searching condition. Thus, the measurement point or power system resource with which a measurement record is associated may be determined, by using the measurement point identification as contained in the data. Furthermore, based on the date model, an electric device which the measurement point belongs to, for example TRI 122, may be further determined. Based on the data model, the power system resource group in which the electric device belongs to may be determined. For example, for transformer TRI 122, it may be clearly seen from the data model that it belongs to the power system resource group ST0082, i.e., substation ST0082.
[0040] The determined information on power system resource identification and the power system resource group can be included into the data for later use. An
WO 2016/029367
PCT/CN2014/085227 exemplary mapped data is illustrated in Fig. 5C only for a purpose of illustration. As illustrated, in addition to the information contained in the raw data, the mapped data further contains “PSRID” which indicates the identification of the power system resource and “PSRGrpID” which indicates the identification of the power system resource group.
[0041] Referring back to Fig. 4, at step S402, the data in the data stream are sent to one or more processing nodes based on the power system resource group associated therewith. After the data in the data stream are grouped,they will be sent to the following processing nodes for further processing, based on power system resource group associated therewith. That is to say, data belonging to the same power system resource group will be sent to the same one or more processing nodes.
[0042] In an embodiment of the present disclosure, the message passing may be further optimized to improve transmission efficiency. Inventors notice that, for a certain message bus, the performance is a variant which changes according to the message size and there is usually an optimal message size which can achieve a best performance. For example, as far as the Apache Storm system which uses zeroMQ as internal message bus is concerned, the best performance can be achieved at a message size of 100k. The following Table 1 gives the relationship between performance and message size in the Apache Storm system.
Table 1 Relationship Between Performance and the Message Size
Size 200 IK 1.5k 10K 100K 500K 1M
Producer/Consumer (msg/s) 19k/9k 10k/7.5k 9.2k/6k 4k/3k 585/582 109/109 31/34
Throughput 1.8M 7.5M 9M 30M 58M 54.5M 34M
[0043] From Table 1, it is clear that a best performance is achieved when the message size is 100k and a larger or smaller size will not provide better performance. In view of this discovery, in the present disclosure, an optimization algorithm is designed, which considers both the bus performance and the deadline for transmission of the real-time data, which can be, for example, expressed as follows:
BooleanSend = (t>=T*a*w) or (s>S*b*w)
Wherein BolleanSend is a boolean value that determines whether to transmit the data, t denotes the current waiting time; T is the maximum transmission delay time allowed for
WO 2016/029367
PCT/CN2014/085227 real-time data, S is the amount of current buffered real-time data; S is the maximum number of data per message,, which is determined by the optimal message size and the data size, for example 4.17k (i.e., 100k/24) in a case that the optimal message size is 100k and each data has a size of 24 bytes; w denotes a network load ratio in a value ranging from 0 to 1, which reflects network load conditions, i.e., current network load or bandwidth; a is an optimization ratio for delay time; and b is an optimization ratio for message size. Values of a, b are optimization ratio to enable data to be transmitted in a small size, which may be set according to network load conditions. For example, their default values may be set as for example 1, however, in the event the network load is relatively lighter, the values of a and b may be set as a lower value.
[0044] Therefore, in embodiments of the present disclosure, the sending of data in the data stream may be dependent on current buffered message size and current waiting time. For example, the data in the data stream will be sent when the current buffered message size reaches a size threshold considering the current network load conditions. Additionally, or alternatively, the data in the data stream will be sent when the current waiting time is longer than a time threshold considering the current network load conditions. In such a way, it may allow message to be transmitted when the message reaches a specified size to obtain an optimal performance, or transmitted in a smaller size when the network is idle so that the real-time performance of data transmission can be ensured.
[0045] Reference is made back to Fig. 4, at step S403, the data in the data stream at the one or more data processing nodes are processed based on the power system resource groups associated therewith. At each processing node, there are running one or more processes for processing the data sent thereto. These processes may be configured according to the type of the power system resource group and updated as required. At each of the processing node, the processing algorithms or processes can be easily updated or changed online by embedded script executing engine such as python, etc., and/or java reflection mechanism. The processing of the data is known in the art and thus detailed description about the operations of these processing nodes will not be elaborated herein for a purpose of simplification.
[0046] In embodiments of the present disclosure, the data in the data stream belonging to the same power system resource group will be sent to the same one or
WO 2016/029367
PCT/CN2014/085227 more processing nodes and at these processing nodes, the data can be processed simultaneously, which may realize a real-time data processing in power system especially for a large scale real-time data. Besides, in the present disclosure, the processing process nodes may be based on distributed stream computing technology and thus it possesses a good expansibility, which means the stream computing clusters can be increased dynamically to meet new requirements, such as when the data amount increases, or it requires decreasing the time cost. In addition, according to the present disclosure, various types of data processing are performed according to the related PSR group, which reduces repetitive data transmission and improve the efficiency of data processing. Moreover, since data in the data stream belonging to the same PSR will be mapped, packaged and sent to the same one processing node, it may facilitate to achieve a power gird operation oriented data processing.
[0047] In addition, in order to ensure both high efficiency and high reliability of the data processing, in embodiments of the present disclosure, the data sent to each of the processing nodes are cached in the processing node and at the same time raw data are also stored in a database such as HBase. The cached data will be used for data processing while the data stored in the database can be used in event of fault recovery or initiating of one or more processing nodes. For example, the data may be loaded from the database first when a processing node is restarted due to for example a fault.
[0048] Fig. 6 illustrates a flow chart of data processing operations in the event of fault recovery according to an embodiment of the present disclosure. As illustrated, the data will be first loaded from the database to the cache at step 601 and the processing node begins to receive the grouped data at step 602 and then caches the received data in the cache. At step 603, the processing node further stores the received data into the database for using in the event of e.g., a failure recovery. Then the data are obtained and processed by processes at step 604 and the processed results are stored into the database at step 605. After the data was processed successfully, at step 606, an ACK may be sent to the receiving node as a reply.
[0049] From the flow chart, it can be seen that even if there is a failure, the raw data can still be obtained from the database and thus it may provide a higher reliability. Moreover, it may perfonn similar operation when the number of data
WO 2016/029367
PCT/CN2014/085227 increase substantially and it requires more processing nodes to process these data.
[0050] In addition to the above, in the present disclosure, there is also provided an application-oriented data storage solution so as to achieve high performance of large-scale real-time data storage and accessing, which will be detailed next with reference to Figs. 7 to 12.
[0051] Reference will be first made to Figs. 7A and 7B, which show an example data storage table designs according to an embodiment of the present disclosure. In the present disclosure, it proposes to store the measurement data by year
i.e., annual measurement data will be stored in one same table and data for different years will be stored in different table. The annual measurement data table may have a table name such as “Historydata_2014” to include the information about the year of measurement time of the data stored therein. The table may comprise a row key “Rowkey” for identifying a piece of data. More particularly, the row key “Rowkey” may comprise two parts, i.e., information on power system resource and infonnation on measurement time. The infonnation on power system resource can be the power system resource identification “PSRID”. The “PSRID” is the unified id of the power system resource as mentioned hereinbefore, which has a data type of unsigned int (4 bytes). The information on measurement time may only contain information on month and day without the year, as information on the year can be reflected by the name of table. Particularly, the information on measurement time used herein is not in a usual format of time but represented time shift in millisecond within the year of the data time. This means the information on measurement time does not include information about the year and it uses the time shift from, for example, 0:00 am of the first day in this year. Thus, the information on measurement time may be designed as an unsigned int format,
4 bytes. Therefore, in embodiments of the present disclosure, the row key only needs bytes, which will save the storage space greatly comparing with the design of the row key in the prior art.
[0052] In addition, column family “CF”, column “qualifier”, and Value may be included. The ”CF” denotes the family which the data belong to, wherein ‘r’ refers to the raw data; “s” refers to statistic data; “e” refers to the event. The column qualifier is a code representing the measurement type and the format of the value. The measurement type and the format of the value can be determined by using the code to
WO 2016/029367
PCT/CN2014/085227 perform a search in a measurement type and format definition table as illustrated in Fig. 7B. The “Value” stores the data in a format which is represented by the column qualifier. Additionally, a “Region” may be included, which denotes the position in which the measure data are stored. The “Region” may be a number pre-assigned according to data scale and computing resources to avoid any influence on the performance of the automatic adjustment.
[0053] In a traditional method, a row key is usually used but this would require about 24 bytes, while in the present disclosure, by using the PSRID and the time shift in milliseconds, it only requires 8 bytes. Therefore, the traditional row key will occupy nearly 3 times storage space larger than the row key of the present disclosure, which means a great storage space saving. Besides, in the present disclosure, the data in the data stream are stored in the data base in formats that are respectively suitable for their own data types and suitable for data processing instead of only in a string format. For example, numerical values, such as voltage, current, power, and so on, are stored in a format of e.g., double, instead of string as commonly used. . The types of data such as double, float, etc., require less storage space than string, and they can be processed directly without conversion. Thus, it may not only save the storage space but also improve the processing efficiency. In addition, if a new type of measurement data is to be added, the only action needed is to insert a piece of record into the table of Fig.7B to define the measurement type and the value format.
[0054] Fig. 8A illustrates a diagram of the parallel storage of the data according to an embodiment of the present disclosure. According to the present disclosure, the data may be stored into the database parallelly and distributively in a chronological record. In the present disclosure, the row key is composed of PSRID and time shift in milliseconds. The data will be split into multiple segments based on the PSRID and parallelly stores the segments into different regions in time order, as illustrated in Fig. 8B. Due to the special design of the row key, in database such as HBase, the storing process will be performed automatically because the HBase per se can support such an mechanism.
[0055] Such a storage manner may provide an application-oriented data access. As is known, the application usually will access data belonging to a same power system resource group at a certain time period, the way of storing the data in the
WO 2016/029367
PCT/CN2014/085227 database will facilitate the accessing of the data greatly because all the data required are usually stored in a region continuously, as illustrated in Fig. 8B. This data storage manner will ensure data can be accessed in a rather high efficiency when they are accessed by PSR and time period. Therefore, in embodiments of the present disclosure, the data storage solution will help to achieve high data access performance.
[0056] The above-described storage solution not only supports large-scale real-time data storage but also provides a good expansibility. Moreover, it is quite suitable for big data analysis, for example it may be easily integrated with other analytical components of Hadoop ecosystem.
[0057] Figs. 9A and 9B schematically illustrate case simulation results according to an embodiment of the present disclosure. In simulations, 3 to 15 host nodes are used, each with a 16G memory, 8-core CPU, IT storage, 1Gbit Network; 3 million meters are used as data sources each with 33 measurement data. Fig. 9A illustrates the data process and writing performance, wherein the X-axis shows the number of host nodes, the Y-axis shows the number of meters that are processed and written per second. From Fig. 9A, it is clear that the process and writing performance increases nearly linearly as the clusters increases and it achieves 50, 000 meters/sec (45 million meters/15minutes) write performance for 15 host nodes. Fig. 9B illustrates data reading performance obtained from case simulations. From the table, it is clear that the data can be read in a very short time and for the same number of meters, the larger amount of threads may provide a higher read performance.
[0058] Therefore, with embodiment of the present disclosure, it enables to process and store high volume real-time data at a lot-cost and high performance, which facilitate to extract information from the real-time data and make better business decision in time. Besides, it provides a critical and fundamental solution for a large and wildly distributed real-time data processing and storage for the utilities.
[0059] In the present disclosure, there is also provided a system for data processing in a power system, and hereinbelow this system will be described with reference to Fig. 10, which schematically illustrates a block diagram of a system for data processing in a power system according to an embodiment of the present disclosure.
[0060] As illustrated in Fig. 10, the system 1000 comprises at least one processor 1010; and at least one memory 1020 storing computer executable instructions
WO 2016/029367
PCT/CN2014/085227
1030. The at least one memory 1020 and the computer executable instructions 1030 configured to, with the at least one processor 1010, cause the system 1000 to group data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation; send the data in the data stream to one or more data processing nodes based on the power system resource groups associated therewith; and process the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
[0061] Particularly, in an embodiment of the present disclosure the grouping data in the data stream to be processed may comprise determining the power system resources respectively associated with the data in the data stream based on measurement point identification information contained within the data in the data stream and correlation between power system resources and measurement point identification information defined in the data model; and determining the power system resource groups associated with the data in the stream according to the determined power system resources and the hierarchy of the power grid operation defined in the data model.
[0062] In embodiments of the present disclosure, the sending of data in the data stream may be optimized so as to achieve a higher performance. For example, the sending of data may be dependent on current buffered message size and current waiting time. The data in the data stream may be sent when the current buffered message size reaches a size threshold considering current network load conditions. Or alternatively, the data in the data stream may be sent when the current waiting time is longer than a time threshold considering current network load conditions.
[0063] In embodiments of the present disclosure, the data in the data stream may be cached in the one or more data processing nodes for processing and the data in the data stream are further stored in a database. In case of fault recovery or newly starting of a processing node, corresponding data may be loaded from the database to a cache of the data processing node. The data in the data stream may be stored in tables by year and a name for a table comprises information on the year. A key for each of the data may be formed by an identification of a power system resource associated therewith and measurement time in a form of time shift in millisecond within the year of the data time.
WO 2016/029367
PCT/CN2014/085227 [0064] In embodiments of the present disclosure, the data in the data stream may be split into one or more segments according to power system resources associated therewith and the one or more segments are parallelly and distributively written to multiple regions of the database in a chronological order based on the keys for the data.
Furthermore, the data in the data stream may be stored in the data base in formats that are respectively suitable for their own data types and suitable for data processing.
[0065] In embodiments of the present disclosure, the processing of data in the data stream may be based on a distributive streaming computing architecture, such as Apache Storm system and the data storage is based on distributive database such as
HBase.
[0066] In Fig. 11, there is illustrated an apparatus for data processing in a power system according to an embodiment of the present disclosure. The apparatus 1100 comprises: a data grouping module 1110a data sending module 1120, and a data processing module 1130. The data grouping module 1110 may be configured to group data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation. The data sending module 1120 may be configured to send the data in the data stream to one or more data processing nodes based on the power system resource groups associated therewith. The data processing module 1130 may be configured to process the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
[0067] In an embodiment of the present disclosure, the data grouping module 1110 may first determine power system resources respectively associated with the data in the data stream, based on measurement point identification information contained within the data in the data stream and correlation between power system resources and measurement point identification information defined the data model. Then according to the determined power system resources and the hierarchy of the power grid operation defined in the data mode, the data grouping module 1110 may in turn determine the power system resource groups associated with the data in the stream.
[0068] In another embodiment of the present disclosure, the data sending module 1120 may be further configured to send the data in the data stream dependent on
WO 2016/029367
PCT/CN2014/085227 current buffered message size and current waiting time. For example, the data in the data stream can be sent when the current buffered message size reaches a size threshold considering current network load conditions. Additionally or alternatively, the data in the data stream can be sent when the current waiting time is longer than a time threshold considering the current network load conditions.
[0069] In embodiments of the present disclosure, the data in the data stream may be cached in the one or more data processing nodes for processing. At the same time, an optional data storing module 1140 may store the data in the data stream into a database. In case of fault recovery or initiating of a data processing node, corresponding data are loaded from the database to a cache of the data processing node. The data storing module 1140 may be configured to store the data in the data stream in tables by year. The name for a table may comprise information on the year, and a key for each of the data may be formed by an identification of a power system resource associated therewith and measurement time in a fonn of time shift in millisecond within the year of the data time. The data in the data stream may be split into one or more segments according to PSRID for the data and the one or more segments are parallelly and distributively written to multiple regions of the database in a chronological order based on their the keys for the data. Particularly, the data in the data stream are stored in the data base in formats that are respectively suitable for their own data types and suitable for data processing.
[0070] In addition, in embodiments of the present disclosure, the processing the data in the data stream is based on a distributive streaming computing architecture and the data storage is based on a distributive database.
[0071] In Fig. 12, there is further illustrated another apparatus for data 25 processing in a power system according to another embodiment of the present disclosure. The apparatus 1200 comprises: means 1210 for grouping data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation; means 1220 for sending the data in the data stream to one or more data processing nodes based on the power system resource groups associated therewith and means 1230 for processing the data in the data stream at the one or more data processing nodes based on the power system resource
WO 2016/029367
PCT/CN2014/085227 groups associated therewith.
[0072] As illustrated in Fig. 12, the apparatus 1200 may additionally comprise means 1240 for storing data in the data stream into a database. In case of fault recovery or newly starting of a data processing node, corresponding data are loaded from the database to a cache of the data processing node. The means 1240 for storing data may be further configured to store the data in the data stream in tables by year and a name for a table comprises information on the year, and wherein a key for each of the data may be formed by an identification of a power system resource associated therewith and measurement time in a form of time shift in millisecond within the year of the data time. Moreover, the data in the data stream may be split into one or more segments according to PSRID for the data and the one or more segments are parallelly and distributively written to multiple regions of the database in a chronological order based on their the keys for the data. Particularly, the data in the data stream are stored in the data base in formats that are respectively suitable for their own data types and suitable for data processing.
[0073] Furthermore, there is provided a tangible computer-readable medium having a plurality of instructions executable by a processor to perform data processing in a power system, the tangible computer-readable medium may comprise instructions configured to perform steps of the method according to any embodiments of method of the present disclosure.
[0074] It should be noted that operations of respective modules or means as comprised in the system 1000, apparatus 1100, and apparatus 1200 substantially correspond to respective method steps as previously described. Therefore, for detailed operations of respective modules or means in the system 1000, apparatus 1100, and apparatus 1200, please refer to the previous descriptions of the methods of the present disclosure with reference to Figs. 2 to 9B.
[0075] Besides, although hereinbefore specific embodiments are presented, they are only given for a purpose of illustration so as to enable the skilled in the art to understanding the idea of the present disclosure completely and thoroughly so that they can practice the solution of the present disclosure. From the teaching as provided herein, the skilled in the art can conceive various modifications; all these modifications should be fallen within the scope of the appendix claims. For example, although
WO 2016/029367
PCT/CN2014/085227 stream processing system is described in a topology comprising data receiving nodes, data processing nodes and data outputting nodes, it is also possible to use a stream processing topology without separate data outputting nodes. In embodiment of the present disclosure, data belonging to certain electronic equipment at certain voltage level, such as ST0082 are divided into a same power system resource group; however, it is also possible to divide data belonging to a certain or certain type of electric device (e.g., transformer, TRI 122) in the certain electronic equipment ST0082 such as transformer into same power system resource group. Besides, in order to improve the transmission efficiency, there is provided a specific optimization approach; however, it is also possible to conceive other different optimization approach from the teaching provided herein.
[0076] In Fig. 13 is further illustrated a general computer system 1300, which may represent any of the computing devices referenced herein. For instance, the general computer system 1300 may represent—in part or in its entirety—the control center, the head end, the integrated network operations and management system (NOMS), the fault, performance, and configuration management (FPCM) module, or any other computing devices referenced herein such as the end devices, the meters, the telemetry interface modules (TIUs), the collectors, and/or any networked components such as routers, switches or servers as discussed herein. The computer system 1300 may include an ordered listing of a set of instructions 1302 that may be executed to cause the computer system 1300 to perform any one or more of the methods or computer-based functions disclosed herein. The computer system 1300 may operate as a stand-alone device or may be connected, e.g., using the network 115, 125, to other computer systems or peripheral devices.
[0077] In a networked deployment, the computer system 1300 may operate in the capacity of a server or as a client-user computer in a server-client user network environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. The computer system 1300 may also be implemented as or incorporated into various devices, such as a personal computer or a mobile computing device capable of executing a set of instructions 1302 that specify actions to be taken by that machine, including and not limited to, accessing the network 115, 125 through any fonn of browser. Further, each of the systems described may include any collection of
WO 2016/029367
PCT/CN2014/085227 sub-systems that individually or jointly execute a set, or multiple sets, of instructions to perform one or more computer functions.
[0078] The computer system 1300 may include a processor 1307, such as a central processing module (CPU) and/or a graphics processing module (GPU). The processor 1307 may include one or more general processors, digital signal processors, application specific integrated circuits, field programmable gate arrays, digital circuits, optical circuits, analog circuits, combinations thereof, or other now known or later-developed devices for analyzing and processing data. The processor 1307 may implement the set of instructions 1302 or other software program, such as manually-programmed or computer-generated code for implementing logical functions. The logical function or any system element described may, among other functions, process and/or convert an analog data source such as an analog electrical, audio, or video signal, or a combination thereof, to a digital data source for audio-visual purposes or other digital processing purposes such as for compatibility with computer processing or networked communication.
[0079] The computer system 1300 may include a memory 1305 on a bus 1320 for communicating information. Code operable to cause the computer system to perform any of the acts or operations described herein may be stored in the memory 1305. The memory 1305 may be a random-access memory, read-only memory, programmable memory, hard disk drive or any other type of volatile or non-volatile memory or storage device.
[0080] The computer system 1300 may also include a disk, solid-state drive optical drive module 1315. The disk drive module 1315 may include a non-transitory or tangible computer-readable medium 1340 in which one or more sets of instructions
1302, e.g., software, can be embedded. Further, the instructions 1302 may perform one or more of the operations as described herein. The instructions 1302 may reside completely, or at least partially, within the memory 1305 and/or within the processor 1307 during execution by the computer system 1300. The database or any other databases described above may be stored in the memory 1305 and/or the disk module
1315.
[0081] The memory 1305 and the processor 1307 also may include computer-readable media as discussed above. A “computer-readable medium,”
WO 2016/029367
PCT/CN2014/085227 “computer-readable storage medium,” “machine readable medium,” “propagated-signal medium,” and/or “signal-bearing medium” may include any device that includes, stores, communicates, propagates, or transports software for use by or in connection with an instruction executable system, apparatus, or device. The machine-readable medium may selectively be, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium.
[0082] Additionally, the computer system 1300 may include an input device 1325, such as a keyboard or mouse, configured for a user to interact with any of the components of system 1300, including user selections or menu entries of display menus. It may further include a display 1330, such as a liquid crystal display (LCD), a cathode ray tube (CRT), or any other display suitable for conveying information. The display 1330 may act as an interface for the user to see the functioning of the processor 1307, or specifically as an interface with the software stored in the memory 1305 or the drive module 1315.
[0083] The computer system 1300 may include a communication interface 1336 that enables communications via the communications network 125. The network 125 may include wired networks, wireless networks, or combinations thereof. The communication interface 1336 networks may enable communications via any number of communication standards, such as Ethernet AVB, 802.11, 802.13, 802.20, WiMax, or other communication standards.
[0084] Accordingly, the system may be realized in hardware, software, or a combination of hardware and software. The system may be realized in a centralized fashion in at least one computer system or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system or other apparatus adapted for carrying out the methods described herein is suited. A typical combination of hardware and software may be a general-purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein. Such a programmed computer may be considered a special-purpose computer.
[0085] As described herein, any modules or processing boxes are defined to include software, hardware or some combination thereof executable by the processor 1307. Software modules may include instructions stored in the memory 1305, or other
WO 2016/029367
PCT/CN2014/085227 memory device, that are executable by the processor 1307 or other processors.
Hardware modules may include various devices, components, circuits, gates, circuit boards, and the like that are executable, directed, and/or controlled for performance by the processor 1307.
[0086] The system may also be embedded in a computer program product, which includes all the features enabling the implementation of the operations described herein and which, when loaded in a computer system, is able to carry out these operations. Computer program in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function, either directly or after either or both of the following: a) conversion to another language, code or notation;
b) reproduction in a different material form.
[0087] By far, the present disclosure has been described with reference to the accompanying drawings through particular preferred embodiments. However, it should be noted that the present disclosure is not limited to the illustrated and provided particular embodiments, but various modification may be made within the scope of the present disclosure.
[0088] Further, the embodiments of the present disclosure can be implemented in software, hardware or the combination thereof. The hardware part can be implemented by a special logic; the software part can be stored in a memory and executed by a proper instruction execution system such as a microprocessor or a dedicated designed hardware. Those normally skilled in the art may appreciate that the above method and system can be implemented with a computer-executable instructions and/or control codes contained in the processor, for example, such codes provided on a bearer medium such as a magnetic disk, CD, or DVD-ROM, or a programmable memory such as a read-only memory (firmware) or a data bearer such as an optical or electronic signal bearer. The apparatus and its components in the present embodiments may be implemented by hardware circuitry, for example, a very large scale integrated circuit or gate array, a semiconductor such as logical chip or transistor, or a programmable hardware device such as a field-programmable gate array, or a programmable logical device, or implemented by software executed by various kinds of processors, or implemented by combination of the above hardware circuitry and
2014405046 19 Mar 2018 software, for example, by firmware.
[0089] While various embodiments of the disclosure have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the disclosure. Accordingly, the disclosure is not to be restricted except in light of the attached claims and their equivalents.
[0090] Throughout this specification and claims which follow, unless the context requires otherwise, the word “comprise”, and variations such as “comprises” and “comprising”, will be understood to mean the inclusion of a stated feature or step, or group of features or steps, but not the exclusion of any other feature or step, or group of features or steps.
[0091] Any reference to prior art in this specification is not, and should not be taken as an acknowledgement, or any suggestion that, the prior art forms part of the common general knowledge.
2014405046 19 Mar 2018

Claims (9)

  1. The claims defining the invention are as follows:
    1. A system for data processing in a power system, including:
    5 at least one processor; and at least one memory storing computer executable instructions, wherein the at least one memory and the computer executable instructions are configured to, with the at least one processor, cause the system to:
    group data in a data stream at one or more data receiving nodes based on
    10 power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation;
    send the data in the data stream to one or more data processing nodes depending on current buffered message size and current waiting time and based on the
    15 power system resource groups associated therewith; and process the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
  2. 2. A system according to Claim 1, wherein the grouping data in the data
    20 stream includes determining the power system resources respectively associated with the data in the data stream based on measurement point identification information contained within the data in the data stream and correlation between power system resources and measurement point identification information defined in the data model; and
    25 determining the power system resource groups associated with the data in the stream according to the determined power system resources and the hierarchy of the power grid operation defined in the data model.
    30 3. A system according to either Claim 1 or Claim 2, wherein the data in the data stream are sent when the current buffered message size reaches a size threshold considering current network load conditions.
    4. A system according to any one of the preceding claims, wherein the data in
    2014405046 19 Mar 2018 the data stream are sent when the current waiting time is longer than a time threshold considering current network load conditions.
    5. A system according to any one of the preceding claims, wherein the data in
    5 the data stream are cached in the one or more data processing nodes for processing and the data in the data stream are further stored in a database, wherein corresponding data are loaded from the database to a cache of a data processing node in case of fault recovery or initiating of the data processing node.
    10 6. A system according to any one of the preceding claims, wherein the data in the data stream are stored in tables by year and a name for a table includes information on the year, and wherein a key for each of the data is formed by an identification of a power system resource associated therewith and measurement time in a form of time shift in millisecond within the year of the data time.
    7. A system according to Claim 6, wherein the data in the data stream are split into one or more segments according to power system resources associated therewith and the one or more segments are distributively and in parallel written to multiple regions of the database in a chronological order based on the keys for the
    20 data.
    8. A system according to either Claim 6 or Claim 7, wherein the data in the data stream are stored in the data base in formats that are respectively suitable for their own data types and suitable for data processing.
    25 9. A system according to any one of the preceding claims, wherein the processing the data in the data stream is based on a distributive streaming computing architecture and the data storage is based on a distributive database.
    10. A method for data processing in a power system, including:
    30 grouping data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation;
    sending the data in the data stream to one or more data processing nodes
    2014405046 19 Mar 2018 depending on current buffered message size and current waiting time and based on the power system resource groups associated therewith; and processing the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
    11. A method according to Claim 10, wherein the grouping data in the data stream includes:
    determining the power system resources respectively associated with the data in the data stream based on measurement point identification information contained
    10 within the data in the data stream and correlation between power system resources and measurement point identification information defined in the data model; and determining the power system resource groups associated with the data in the stream according to the determined power system resources and the hierarchy of the power grid operation defined in the data model.
    12. A method according to either Claim 10 or Claim 11, wherein the data in the data stream are sent when the current buffered message size reaches a size threshold considering current network load conditions.
    13. A method according to any one of Claims 10 to 12, wherein the data in the data stream are sent when the current waiting time is longer than a time threshold considering current network load conditions.
    25 14. A method according to any one of Claims 10 to 13, wherein the data in the data stream are cached in the one or more data processing nodes for processing and the data in the data stream are further stored in a database, wherein corresponding data are loaded from the database to a cache a data processing node in case of fault recovery or initiating of the data processing node.
    15. A method according to any one of Claims 10 to 14, wherein the data in the data stream are stored in tables by year and a name for a table includes information regarding the year, and wherein a key for each of the data is formed by an identification of a power system resource associated therewith and measurement time
    2014405046 19 Mar 2018 in a form of time shift in milliseconds within the year of the data time.
    16. A method according to Claim 15, wherein the data in the data stream are split into one or more segments according to power system resources associated
    5 therewith and the one or more segments are distributively and in parallel written to multiple regions of the database in a chronological order based on the keys for the data.
    17. A method according to either Claim 15 or Claim 16, wherein the data in
    10 the data stream are stored in the data base in formats that are respectively suitable for their own data types and suitable for data processing.
    18. A method according to any one of Claims 10 to 17, wherein processing the data in the data stream is based on a distributive streaming computing architecture
    15 and the data storage is based on a distributive database.
    19. An apparatus for data processing in a power system, the apparatus including:
    a data grouping module configured to group data in a data stream at one or
    20 more data receiving nodes based on power system resource groups associated therewith, which are determined partially based on a data model for the power system defining a hierarchy of power grid operation;
    a data sending module configured to send the data in the data stream to one or more data processing nodes depending on current buffered message size and
    25 current waiting time and based on the power system resource groups associated therewith; and a data processing module configured to process the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
    20. An apparatus for data processing in a power system, the apparatus including:
    means for grouping data in a data stream at one or more data receiving nodes based on power system resource groups associated therewith, which are determined
    2014405046 19 Mar 2018 partially based on a data model for the power system defining a hierarchy of power grid operation;
    means for sending the data in the data stream to one or more data processing nodes depending on current buffered message size and current waiting time and based
    5 on the power system resource groups associated therewith; and means for processing the data in the data stream at the one or more data processing nodes based on the power system resource groups associated therewith.
    21. A tangible computer-readable medium having a plurality of instructions 10 executable by a processor to perform data processing in a power system, the tangible computer-readable medium including instructions configured to perform steps of the method according to any one of Claims 10 to 18.
    WO 2016/029367
    PCT/CN2014/085227
    Fig. 1
    Analysis and Applications 180
    1/9
    Fig. 2
    WO 2016/029367
    PCT/CN2014/085227
    Data Storage 150
    Data Sources 110
    Real-time Processing 140
    Cloud Computing Platform 190 kJ-JLi—EJ·
    Fig. 3
    2/9
    Fig. 4
    WO 2016/029367
    PCT/CN2014/085227
    Company I -- Transmission (--503KV
    I I I I I 1
    I I I I
    Substation SWS2
    B Bushel-Section
    B - Capacitor E3 Breaker B«Transformer L-TB-MiK φs , Ϊ - j B-220kV
    --TR1122
    I 1-- Measurement
    I I I--Active Power
    I I I - - Reactive Power
    I I 1-- Bottom Oi Temperature
    I | |--Cool Fan Current
    1 | | - -Cool Fan Status
    I | | - -Maintenance Status
    I j (--Capacity , , ......
    I φ- Others
    TR1123 £3 -Otherdevices
    1.....
    ST0Q83
    Une
    B-»Distributloo
    Fig. 5A
    Raw Data:
    measID, timeStamp , Value, Quality
    10001.20140424102330556, 220.5,0
    10002.20140424102330556, 221.0, 0
    10003.20140424102330556, 220.9, 0
    10004.20140424102330556, 356.2, 0
    Fig. 5B
  3. 3/9
    WO 2016/029367
    PCT/CN2014/085227
    Mapped Data :
    PSRGrpID, PSRID,MeasType, measID, timestamp , Value, Quality 10000012,2000231 ,Uab, 10001,20140424102330556 , 220.5, 0
    10000012.2000231, Ubc, 10002,20140424102330556 , 221.0, 0
    10000012.2000231, Uca, 10003,20140424102330556 ,220.9,0 10000012,2000231 ,R 10004, 20140424102330556,356.2,0
    Fig. 5C
  4. 4/9
    WO 2016/029367
    PCT/CN2014/085227
    RowKey CF Qualifier Value 2000231557628128 r i 1 110.53 2000231557628921 s 23 1 2000231557628983 I e 1001 “<p:MessageTypeOutLimit xmlns:p=http://www.example.org/powerEventSchema> <p:outLimitFlag>1</p:outLimitFlag> <p:limitValue>60.0</p:limitValue> <p:currentValue»67.88429</p:currentValue> <p:starttime>2013-05-14 02:04:20</p:starttime> <p:Measuretime>MT-P</p:MeasName> </p: MessageT y peOutLim it”
    Fig. 7A
    Measurement type Code Value format Uab 1 double ... la 14 double ... P double Q 28 double KWH 29 double KVAR 30 double SwithStat ........101.................... byte Event ................1001................. String ,,,
    Fig. 7B
  5. 5/9
    WO 2016/029367
    PCT/CN2014/085227
    Data Stream
    2000231
    2000231
    2000231
    2000231.
    HBase
    Uab,20140424102330556,220.5, 0 ,Ubc,20140424102330556, 221.0,0 ,Uca,20140424102330556, 220.9, 0 P.20140424102330556.356.2. 0
    Uab, 20140424102330556, 221.3,0 Ubc, 20140424102330556, 222.3,0 .,□620140424102330556, 221.5,0
    PSRID, MeasType, timeStamp , Value, Quality
    Segment 1
    J Segment 2 3 Segment n
    Region n
    Hostl
    Host 2
    Host m
    Fig. 8A
    Applications
    Fig. 8B
  6. 6/9
    WO 2016/029367
    PCT/CN2014/085227
    Fig. 9A
    No# Case description Time cost(s) 1 1 Thread, 1 meter, 1 day data 0.063 2 1 Thread, 10 meter, 1 day data 0.156 3 2 Thread, 10 meter, 1 day data 0.087 4 10 Thread, 100 meter, 1 day data 0.243
    Fig. 9B
  7. 7/9
    WO 2016/029367
    PCT/CN2014/085227
    System 1000
    Processor 1010
    I
    Memory 1020 Computer Executable Instructions 1030
    Fig. 10
    Fig. 11
  8. 8/9
    WO 2016/029367
    PCT/CN2014/085227
    1300
    Fig. 12
    Fig. 13
  9. 9/9
AU2014405046A 2014-08-26 2014-08-26 System, method and apparatuses for data processing in power system Active AU2014405046B2 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/085227 WO2016029367A1 (en) 2014-08-26 2014-08-26 System, method and apparatuses for data processing in power system

Publications (2)

Publication Number Publication Date
AU2014405046A1 AU2014405046A1 (en) 2017-04-13
AU2014405046B2 true AU2014405046B2 (en) 2018-06-28

Family

ID=55398582

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2014405046A Active AU2014405046B2 (en) 2014-08-26 2014-08-26 System, method and apparatuses for data processing in power system

Country Status (3)

Country Link
CN (1) CN107078541B (en)
AU (1) AU2014405046B2 (en)
WO (1) WO2016029367A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115081158B (en) * 2022-08-23 2022-11-11 成都中科合迅科技有限公司 Graphic element display method based on digital expression

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120310559A1 (en) * 2011-05-31 2012-12-06 Cisco Technology, Inc. Distributed data collection for utility grids
US20130219279A1 (en) * 2012-02-21 2013-08-22 Ambient Corporation Aggregating nodes for efficient network management system visualization and operations

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100369355C (en) * 2005-09-09 2008-02-13 东南大学 Full networked digital protection platform
US10845399B2 (en) * 2007-04-03 2020-11-24 Electro Industries/Gaugetech System and method for performing data transfers in an intelligent electronic device
CN201518429U (en) * 2009-10-26 2010-06-30 江西省电力科学研究院 Electric energy qualitative data concentrator for digitalization transforming plant
WO2012116748A1 (en) * 2011-03-03 2012-09-07 Abb Technology Ag A control device for controlling a circuit breaker, and methods
US8964360B2 (en) * 2013-02-06 2015-02-24 Jonathan D. Trout System to connect and multiplex sensor signals

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120310559A1 (en) * 2011-05-31 2012-12-06 Cisco Technology, Inc. Distributed data collection for utility grids
US20130219279A1 (en) * 2012-02-21 2013-08-22 Ambient Corporation Aggregating nodes for efficient network management system visualization and operations

Also Published As

Publication number Publication date
CN107078541B (en) 2019-11-22
WO2016029367A1 (en) 2016-03-03
CN107078541A (en) 2017-08-18
AU2014405046A1 (en) 2017-04-13

Similar Documents

Publication Publication Date Title
US10191529B2 (en) Real-time data management for a power grid
Rusitschka et al. Smart grid data cloud: A model for utilizing cloud computing in the smart grid domain
US9652723B2 (en) Electrical transformer failure prediction
EP2537001B1 (en) Utility grid command filter system
US20090281673A1 (en) Method and system for managing a power grid
CN105069690A (en) Power grid operating data processing method
CN105007294B (en) Power transmission and transformation equipment state monitoring big data quickly receives and dissemination system
JP2019530394A (en) Enhanced single grid management application for power grid systems
BR112013003660B1 (en) CENTRAL POWER INSTALLATION SYSTEM
CN103955510A (en) Massive electricity marketing data integration method uploaded by ETL cloud platform
You et al. Data architecture for the next-generation power grid: Concept, framework, and use case
Ma et al. Design and implementation of smart city big data processing platform based on distributed architecture
CN103489139A (en) Comprehensive analysis and management system for urban distribution network planning
Ma et al. Review of power spatio-temporal big data technologies for mobile computing in smart grid
AU2012241193B2 (en) Method and system for managing a power grid
Malik et al. A common data architecture for energy data analytics
AU2014405046B2 (en) System, method and apparatuses for data processing in power system
Benhaddou et al. Big data processing for smart grids
AU2015230786A1 (en) Method and system for managing a power grid
Kovačević et al. Combining real-time processing streams to enable demand response in smart grids
Xia et al. Hyperscale AMI system design and construction practice
Chen et al. Research on Information Interaction Technology Between Multi-service Application Systems of Power Grid
Zhou et al. Application of big data processing technology in the intelligent network management system
Li et al. A service performance based dynamic provisioning approach in containerized cloud environments
Lu et al. Technology Architecture for Source-Grid-Load-Storage Collaborative Control

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)