WO2024233643A1 - Systems and methods for performing machine learning and data analytics in hybrid systems - Google Patents
Systems and methods for performing machine learning and data analytics in hybrid systems Download PDFInfo
- Publication number
- WO2024233643A1 WO2024233643A1 PCT/US2024/028331 US2024028331W WO2024233643A1 WO 2024233643 A1 WO2024233643 A1 WO 2024233643A1 US 2024028331 W US2024028331 W US 2024028331W WO 2024233643 A1 WO2024233643 A1 WO 2024233643A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- machine learning
- learning model
- power transformer
- server
- historical data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/50—Testing of electric apparatus, lines, cables or components for short-circuits, continuity, leakage current or incorrect line connections
- G01R31/62—Testing of transformers
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/26—Oils; Viscous liquids; Paints; Inks
- G01N33/28—Oils, i.e. hydrocarbon liquids
- G01N33/2835—Specific substances contained in the oils or fuels
- G01N33/2841—Gas in oils, e.g. hydrogen in insulating oils
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
Definitions
- setting adaptive thresholds for power transformer systems may be complex due to the amount of time and magnitude of effort involved in the identification of said adaptive thresholds. Accordingly, an automatic threshold setting mechanism may be desirable. It may thus be preferable to train machine learning models to set such adaptive thresholds.
- training machine learning models in an embedded device may prove challenging due to the lower specifications of such systems. This problem may be further aggravated if the training of the machine learning model must be perfonned regularly onboard, which is the case when the machine learning model is used as a digital twin of an electrical system for monitoring and diagnostics.
- the present application and the resultant patent thus provide a method for performing machine learning and data analytics.
- the method may include the steps of: determining a quantum of historical data associated with a machine learning model; determining an order associated with the machine learning model; determining whether a latency associated with the machine learning model is critical; selecting a server from a plurality 7 of servers based at least in part on the quantum of historical data, the order, and the latency; and training the machine learning model using the server.
- the present application and the resultant patent further provide a method for performing machine learning and data analytics.
- the method may include the steps of: determining a quantum of historical data associated with a machine learning model; determining an order associated with the machine learning model; determining whether a latency associated with the machine learning model is critical; selecting a from a plurality of servers based at least in part on the quantum of historical data, the order, and the latency; training the machine learning model using the server; and determining, using the machine learning model, a condition deterioration associated with a power transformer system.
- the present application and the resultant patent further provide a power transformer system.
- the power transformer system may include: a power transformer; and a dissolved gas analyzer analytics engine, wherein the dissolved gas analyzer analytics engine is configured to: receive a trained machine learning model from a server, and wherein training the machine learning model comprises: determining a quantum of historical data associated with a machine learning model; determining an order associated with the machine learning model; determining whether a latency associated with the machine learning model is critical; selecting a server from a plurality of servers based at least in part on the quantum of historical data, the order, and the latency; and training the machine learning model using the server; and determine, using the trained machine learning model, a condition deterioration associated with the power transformer.
- FIG. 1 is a flow chart depicting a pre-calculated deployment configuration method for performing machine learning and data analytics in a hybrid system, in accordance with one or more example embodiments of the disclosure.
- FIG. 2 is a schematic diagram depicting a deployment architecture for performing machine learning and data analytics in a hybrid system, in accordance with the pre-calculated deployment configuration method of FIG. 1.
- FIG. 3 is a schematic diagram depicting a portion of a deployment architecture for performing machine learning and data analytics in a hybrid system, in accordance with the deployment architecture of FIG. 2.
- FIG. 4 is a schematic diagram depicting a portion of a deployment architecture for performing machine learning and data analytics in a hybrid system, in accordance with the deployment architecture of FIG. 2.
- FIG. 5 is a schematic diagram depicting a portion of a deployment architecture for performing machine learning and data analytics in a hybrid system, in accordance with the deployment architecture of FIG. 2.
- FIG. 6 is a schematic diagram depicting a portion of a deployment architecture for performing machine learning and data analytics in a hybrid system, in accordance with the deployment architecture of FIG. 2.
- FIG. 7 is a flow chart depicting a method for performing machine learning and data analytics in a hybrid system, in accordance with one or more example embodiments of the disclosure.
- FIG. 8 is a flow chart depicting an application of a pre-calculated deployment configuration method to a dissolved gas analyzer analytics engine and a dissolved gas analyzer machine learning training and execution module, in accordance with the precalculated deployment configuration method of FIG. 1.
- FIG. 1 is a flow chart 100 of a pre-calculated deployment configuration method for performing machine learning and data analytics in a hybrid system.
- the flow chart 100 may be applicable to different kinds of physical-digital systems, including power transformer systems.
- the quantum of historical data associated with the machine learning model training is first evaluated.
- the machine learning model may be evaluated if its training requiresa medium quantum of historical data. If the machine learning model does not require a medium quantum of historical data, the machine learning model may be evaluated to determine if it requires a low quantum of historical data at block 102B or a large quantum of historical data at 102C.
- the amount of historical data that is associated with a low quantum of historical data, a medium quantum of historical data, and a large quantum of historical data may be defined by an operator.
- the machine learning model may be evaluated to determine its order.
- the machine learning model is associated with a medium quantum of historical data, the machine learning model is parameterized to have a moderately high order. If the machine learning model is determined to not perform as expected with the moderately high order representation, then the machine learning model associated with the medium quantum of historical data is parameterized to have a highly complex order.
- the machine learning model is associated with a low quantum of historical data, the machine learning model is parameterized to have a reduced order. If the machine learning model is determined to not perform as expected with the reduced order representation, then the machine learning model having the low quantum of historical data is parameterized to have a moderately high order.
- the machine learning model associated with the low quantum of historical data is parameterized to have a highly complex order.
- the machine learning model is concluded to have a highly complex order.
- an edge or embedded device may be selected for deployment of the machine learning model.
- the machine learning model may be associated with a moderately high order at block 104 A and further the task accomplished by the model is latency critical at block 106, then the machine learning model may be configured to undergo a model dimensionality reduction at block 110. Subsequently, the machine learning model may then be configured to undergo incremental training on an embedded or edge device at block 112. After the model is configured to undergo incremental training at an embedded or edge device at block 112, an embedded or edge device may be selected at block 108 for deployment of the machine learning model.
- the machine learning model may then be determined at block 114 if a Free and Open- Source ghost (FOG) server is available. If a FOG server is available, at block 116, the machine learning model may be deployed at the FOG server. After the machine learning model has been deployed at the FOG server at block 116, it may be determined whether a cloud server is available at block 118. If a cloud sen' er is available, then the machine learning model that is deployed at the FOG server may then be configured to undergo conditional training at the cloud server at block 120. If no cloud server is available, then the machine learning model that is deployed at the FOG server may further be configured to undergo conditional training at the FOG server at block 122.
- FOG Free and Open- Source Ghost
- the machine learning model may undergo a model dimensionality reduction at block 110. Subsequently, the machine learning model may then be configured to undergo incremental training on an embedded or edge device at block 112. After the model is configured to undergo incremental training at an embedded or edge device at block 112, an embedded or edge device may be selected at block 108 for deployment of the machine learning model.
- no FOG server is available at block 116. it may be determined if a cloud server is available to deploy the machine learning model at block 124. Additionally, at block 124, if the machine learning model includes a highly complex order at block 104C, it may be determined whether a cloud server is available to deploy the machine learning model.
- a machine learning model that includes a highly complex order at block 104C may include alow quantum of historical data at 102B, a medium quantum of historical data at block 102A, or a large quantum of historical data at 102C.
- the machine learning model is deployed at the cloud server.
- the machine learning model that is deployed at the cloud server may then undergo conditional training at the cloud server.
- the machine learning model may undergo a model dimensionality reduction at block 128. Subsequently, at block 130, it may be determined whether a FOG server is available.
- the machine learning model may be deployed at the FOG server. After the machine learning model has been deployed at the FOG server at block 116, it may be determined whether a cloud server is available at block 118. If a cloud server is available, then the machine learning model that is deployed at the FOG server may then undergo conditional training at the cloud server at block 120. If no cloud server is available, then the machine learning model that is deployed at the FOG server may further undergo conditional training at the FOG server at block 122. However, if no F OG server is available at block 130, the machine learning model may undergo another model dimensionality reduction at block 110.
- the deployment configuration may then be updated to incorporate machine learning model incremental training on an embedded or edge device at block 112.
- an embedded or edge device may be selected at block 108 for deployment of the machine learning model.
- FIG. 2 is a schematic diagram 200 depicting a deployment architecture for performing machine learning and data analytics in a hybrid system, in accordance with the pre-calculated deployment configuration method 100.
- the deployment architecture may include an embedded or edge device 202, a FOG server 204, and a cloud server 206.
- the embedded or edge device 202 may include a model serializer 208.
- an embedded or edge device machine learning model training and execution module 210 an embedded or edge device data storage 212, an embedded or edge device human-machine interface and reporting module 214, and an embedded or edge device analytic engine 222.
- the embedded or edge device can be a power transformer dissolved gas analyzer 220, relay 214, real time controller 216, etc.
- the embedded or edge device 202 may further include other relevant components.
- the embedded or edge device analytic engine 222 may be configured to perform data analytics at an asset level.
- the embedded or edge device machine learning model training and execution module 210 may be configured to perform incremental training and execution of a machine learning model.
- the embedded or edge device machine learning model training and execution module 210 may be configured to train and/or retrain machine learning models of a reduced complexity online.
- the embedded or edge device analytic engine 222 and embedded or edge device machine learning model training and execution module 210 may work as a standalone or in conjunction.
- the output of the calculations done in the embedded or edge device machine learning analytic engine 222 may be used as an input by the machine learning model executing in embedded or edge device machine learning model training and execution module 210.
- the output of the machine learning model executing in the machine learning model training and execution module 210 may be used as an input by the statistical model executing in the embedded or edge device analytic engine 222.
- the embedded or edge device machine learning model training and execution module 210 may also be configured to execute the machine learning model online.
- a graphics processing unit GPU may be provided along with the edge server 202 in order to run resource-intensive training and execution of a machine learning model.
- the embedded or edge device model serializer module 208 may be configured to reconstruct a machine learning model from received structural details of the machine learning model and the corresponding weight matrix representation.
- the embedded or edge device model serializer module 208 may be configured to perform mathematical operations using the weight matrix representation and the structural details to reconstruct the model and subsequently the machine learning training and execution model may be configured to execute the machine learning model based on a predefined schedule.
- the FOG server 204 may include a FOG server data storage 224, a FOG server human-machine interface and reporting module 226. a FOG server analytic engine 228, a FOG server machine learning training and execution module 230, and a FOG server machine learning deployment module 232.
- the FOG sen' er 204 may further include other relevant components.
- the FOG server human-machine interface and reporting module 226 may be configured to output graphs and charts for review by an operator.
- the FOG server analytic engine 228 may be configured to perform data science analytics at a plant level and run algorithms.
- the FOG server machine learning training and execution module 230 may be configured to train, retrain, and/or execute neural networks, classification models, deep learning models, and/or machine learning models.
- the FOG server machine learning deployment module 232 may be configured to convert the machine learning model retrained by the FOG server machine learning training and execution module 230 to a weight matrix representation and transmit the structural details of the machine learning model and the weight matrix representation to the embedded or edge device 202.
- the weight matrix representation may be transmitted as a binary large object (BLOB).
- the FOG server machine learning deployment module 232 may be configured to deploy the machine learning model to more than one edge device, for example, the edge server 202.
- the FOG server machine learning training and execution module 230 may be configured to train multiple machine learning models of reduced complexity using data received from the one or more embedded or edge devices, for example, the edge server 202.
- the multiple machine learning models may be trained based on a priority list provided by an operator.
- the parameters and weights associated with each machine learning model may be transmitted to each embedded or edge device, for example, the edge server 202. after the machine learning model has been trained.
- the FOG server machine learning training and execution module 230 may be configured to simultaneously retrain machine learning models of moderate complexity for execution at the FOG server 204.
- the FOG server machine learning training and execution module 230 may be configured to reconstruct a machine learning model from received structural details of the machine learning model and the corresponding weight matrix representation from the cloud server 206.
- the FOG server machine learning training and execution module 230 may be configured to perform mathematical operations using the weight matrix representation and the structural details to execute the machine learning model based on a predefined schedule.
- the cloud server 206 may include a cloud server data storage 234, a cloud server human-machine interface and reporting module 236, a cloud server machine learning training and execution module 238, a cloud server machine learning deployment module 240, and a cloud server analytic engine 242.
- the cloud server human-machine interface and reporting module 236 may be configured to output graphs and charts for review by an operator.
- the cloud server machine learning training and execution module 238 may be configured to build, train, and/or execute neural networks, classification models, deep learning models, and/or machine learning models.
- the cloud server machine learning deployment module 240 may be configured to convert the machine learning model output by the cloud server machine learning training and execution module 238 to a weight matrix representation and transmit the weight matrix representation and the structural details of the machine learning model to one or more FOG servers, for example, FOG server 204, and/or one or more embedded or edge devices, for example, edge device 202.
- the weight matrix representation may be transmitted as a BLOB.
- the cloud sen' er machine learning deployment module 240 may be configured to deploy the machine learning model output to at least one FOG server, for example, the FOG server 204, and/or at least one edge device, for example, the edge server 202.
- the cloud server analytic engine 242 may be configured to perform data science analytics at a fleet level and run algorithms.
- the cloud server machine learning training and execution module 238 may be configured to train multiple machine learning models of reduced complexity using data received from the one or more embedded or edge devices, for example, the edge device 202. Multiple machine learning models may be trained based on a priority list provided by an operator. The parameters and weights associated with each machine learning model may be transmitted to each embedded or edge device, for example, the edge device 202, after the machine learning model has been trained.
- the cloud server machine learning training and execution module 238 may be configured to simultaneously retrain machine learning models of high complexity for execution at the cloud server 206.
- the cloud server machine learning deployment module 240 may be configured to transmit the weight matrix representation to the FOG server 204 and/or the edge device 202.
- the FOG server machine learning deployment module 232 may be configured to transmit the weight matrix representation to the edge device 202.
- the weight matrix representation When the weight matrix representation is received at the edge device 202, the weight matrix representation may be loaded to a main memory' of the edge device 202. The weight matrix representation may be used to reconstruct the model and load it to the main memory via the model serializer 208.
- the edge device 202 may then execute the machine learning model corresponding to the weight matrix representation via the edge device machine learning training and execution module 210.
- the edge device 202 and/or the FOG server 204 may be configured to transmit non-operational data associated with the machine learning model to the cloud server 206.
- one or more edge devices 202 may be connected to the FOG server 204, and data may be sent to the FOG server machine learning training and execution module 230 from the one or more edge devices 202 to retrain the respective machine learning models for each edge device 202.
- one or more edge devices 202 may be connected to the cloud server 206, and data may be sent to the cloud server machine learning training and execution module 238 from the one or more edge devices 202 to retrain the respective machine learning models for each edge device 202.
- the edge device 202 may be used to perform functions including, but not limited to, reduced order state and parameter estimation, forecasting, static limit-based fault diagnosis and prognosis, time critical intelligent decision making, reduced order digital twin simulations, and control algorithm executions.
- Some examples of machine learning models that may be trained, retrained, and/or executed on the cloud server 206 include AutoRegressive Integrated Moving Average (ARIMA) models, SARIMA models (ARIMA models with a seasonal component), artificial neural networks (ANNs), multilayer perceptron (MLP) models, recurrent neural network (RNN) models, and Tiny ML models.
- ARIMA AutoRegressive Integrated Moving Average
- SARIMA models ARIMA models with a seasonal component
- ANNs artificial neural networks
- MLP multilayer perceptron
- RNN recurrent neural network
- Tiny ML models Tiny ML models.
- the FOG server 204 may be used to perform functions including, but not limited to. statistical parametrization, state and parameter estimation, forecasting, trend-based non-time critical fault diagnosis and prognosis, nontime critical intelligent decision making, and moderate order digital twin simulations.
- machine learning models that may be trained, retrained, and/or executed on the cloud server 206 include ARIMA models, SARIMA models, K-means models, ANNs, MLP models, RNN models. Deep AR models, Neural Prophet models, and support vector machine (SVM) models.
- the cloud server 206 may be used to perform functions including, but not limited to, statistical parametrization, state and parameter estimation, forecasting, trend-based non-time critical fault diagnosis and prognosis, nontime critical intelligent decision making, and highly non-linear digital twin simulations.
- Some examples of machine learning models that may be trained, retrained, and/or executed on the cloud server 206 include ANNs, MLP models, RNN models, DeepAR models, convolutional neural networks (CNNs), Prophet models, Neural Prophet models, SVM models, and Random Forest models.
- FIG. 3 is a schematic diagram 300 depicting a portion of a deployment architecture for performing machine learning and/or data analytics in a hybrid system, in accordance with the deployment architecture of FIG. 2.
- the schematic diagram 300 may illustrate a FOG server 302 and an edge device 304 working together to train and execute a machine learning model.
- the FOG server 302 may include a machine learning module in connection with a FOG server machine learning execution module and a FOG server machine learning training module.
- the FOG server machine learning execution module and the FOG server machine learning training module may be configured to be connected to a FOG server database and a FOG server orchestrator.
- the FOG server database may be configured to be connected to a FOG server analytics engine and a reporting module.
- the FOG server orchestrator may be configured to be connected to a FOG server input/output (IO) interface.
- IO FOG server input/output
- the embedded or edge device 304 may include a central processing unit (CPU) that includes a cache, a list of time-critical tasks, and an asset-level machine learning model execution module.
- the edge server 304 may further include a main memory in connection with at least one memory controller
- the FOG server I/O interface may be configured to be connected to the embedded or edge device I/O interface.
- the FOG server 302 may be configured to perform plant-level data visualization and reporting for a particular power plant, execute plant-level data analytics, execute moderately complex machine learning algorithms, perform periodic machine learning model retraining, and perform reporting to an operator via I/O interfaces.
- the FOG server 302 may also be configured to support the deployment of a machine learning model at an embedded or edge device, and the FOG server 302 may be configured to be connected to multiple edge devices simultaneously.
- the FOG server 302 may be configured to be connected to a cloud server to obtain updated machine learning models from the cloud server and to transmit long-term historical data to the cloud server.
- the embedded or edge device 304 may be configured to perform asset-level data visualization and reporting for a particular asset, execute asset-level data analytics, execute limited machine learning algorithms, and perform reporting to an operator via I/O interfaces.
- the embedded or edge device 304 may also be configured to perform onboard incremental model retraining and/or receive trained machine learning models from the FOG server 302.
- the trained machine learning model may be represented in a weight matrix representation when it is received from the FOG server 302.
- the edge device 304 may be configured to be connected to a cloud server to obtain updated machine learning models from the cloud server and to transmit short-term historical data to the cloud server.
- FIG. 4 is a schematic diagram 400 depicting a portion of a deployment architecture for performing data analytics in a hybrid system, in accordance with the deployment architecture of FIG. 2.
- the schematic diagram 400 may illustrate a cloud server 402 and an embedded or edge device 404 working together to train and execute a machine learning model.
- the cloud server 402 may include a data storage, a human machine interface and reporting module, a machine learning training and execution module, a machine learning deployment module, and an analytic engine.
- the embedded or edge device 404 may include a CPU that includes a cache, a list of time-critical tasks, and an asset-level machine learning model execution module.
- the edge server 304 may further include a main memory in connection with at least one memory controller.
- the cloud server may be configured to be connected to the embedded or edge device.
- the cloud server 402 may be configured to perform fleet-level data visualization and reporting for a particular fleet, execute fleet-level data analytics, execute highly complex machine learning algorithms, perform machine learning model building and on-demand machine learning model retraining, and perform reporting to an operator via I/O interfaces.
- the cloud server 402 may also be configured to support the deployment of a machine learning model at an embedded or edge device, and the cloud server 402 may be configured to be connected to multiple embedded or edge devices simultaneously.
- the machine learning model may be represented in a weight matrix representation.
- the embedded or edge device 404 may be configured to perform asset-level data visualization and reporting for a particular asset, execute asset-level data analytics, execute limited machine learning algorithms, and perform reporting to an operator via I/O interfaces.
- the embedded or edge device 404 may also be configured to perform onboard incremental model retraining and/or receive trained machine learning models from the cloud server 402.
- the trained machine learning model may be represented in a weight matrix representation when it is received from the cloud server 402.
- FIG. 5 is a schematic diagram 500 depicting a portion of a deployment architecture for performing machine learning and data analytics in a hybrid system, in accordance with the deployment architecture of FIG. 2.
- the schematic diagram 500 may illustrate a standalone embedded or edge device 502 for training a machine learning model.
- the embedded or edge device 502 may include a CPU that includes a cache, a list of time- critical tasks, and an asset-level machine learning model execution module.
- the embedded or edge device 502 may further include a main memory in connection with at least one memory controller. .
- the embedded or edge device 502 may be configured to perform asset-level data visualization and reporting for a particular asset, execute asset-level data analytics, execute minimal or tiny machine learning algorithms, and perform reporting to an operator via I/O interfaces.
- the embedded or edge device 502 may also be configured to perform onboard incremental model retraining.
- FIG. 6 is a schematic diagram 600 depicting a portion of a deployment architecture for performing data analytics in a hybrid system, in accordance with the deployment architecture of FIG. 2.
- the schematic diagram 600 may illustrate a standalone embedded or edge device 602 working in conjunction with a GPU 604 to train a machine learning model.
- the embedded or edge device 602 may include a CPU that includes a cache, a list of time-critical tasks, and an asset-level machine learning model execution module.
- the edge server 602 may further include a main memory in connection with at least one memory controller.
- the embedded or edge device I/O interface may be further configured to be connected to the GPU 604.
- the embedded or edge device 602, in combination with the GPU 604, may be configured to perform asset-level data visualization and reporting for a particular asset, execute asset-level data analytics, execute minimal or tiny machine learning algorithms at the CPU and complex machine learning algorithms at the GPU 604. and perform reporting to an operator via I/O interfaces.
- the embedded or edge device 602, in combination with the GPU 604, may also be configured to perform online incremental model retraining and/or machine learning retraining at the GPU 604.
- FIG. 7 is a flow chart 700 depicting a method for performing machine learning and data analytics in a hybrid system.
- the deployment architecture and the online training strategy is formulated based on an offline analysis performed in accordance with the pre-calculated deployment configuration method depicted in FIG. 1.
- offline analysis of the machine learning model may be performed prior to deployment of a machine learning model.
- an analysis of the complexity of the machine learning model may be performed prior to deployment of a machine learning model.
- a platform availability check may be performed to determine if an edge server, a FOG server, and/or a cloud server is available.
- a task assessment based on accuracy, latency, and user interaction requirements may be conducted.
- a predefined logic path in accordance with the pre-calculated deployment configuration method may be followed to select a platform and/or a training method for the machine learning model.
- the machine learning model may be initially deployed.
- the initial deployment may be performed at a target platform708, which may be an embedded or edge device 708A, a FOG server 708B, or a cloud server 708C.
- the machine learning model may be subjected to continued training, and the strategy for the continued training may vary depending on the location of the initial deployment. If the machine learning model is initially deployed at the cloud server 708C, then the machine learning model may undergo big data training at the cloud server 708C at block 710.
- the machine learning model may undergo medium data training at the FOG server 708B at block 712 or big data training at the cloud server 708C at block 710. If the machine learning model is initially deployed at the embedded or edge device 708 A, then the machine learning model may undergo incremental training at the embedded or edge device 708 A at block 714, medium data training at the FOG server 708B at block 712, or big data training at the cloud server 708C at block 710.
- FIG. 8 is a flow 7 chart 800 depicting an application of a pre-calculated deployment configuration method to a dissolved gas analyzer analytics engine and a dissolved gas analyzer machine learning training and execution module, in accordance with the pre-calculated deployment configuration method of FIG. 1.
- a power transformer system may determine if an event has occurred at the power transformer. If it is determined that an event has occurred, an analytic service running on the analytics engine module may be configured to analyze the event. In order to analyze the event, the analytics engine may be configured to receive a historical database of data associated with a dissolved gas analyzer of the power transformer system and the most recent data and/or real-time data associated with the dissolved gas analyzer of the power transformer system.
- a dissolved gas analyzer analytics engine and/or machine learning training and execution module running on the platform may be configured to compute statistical and graphical parameters such as a median, a mean or a weighted mean (including a standard deviation or a weighted standard deviation), a 95 th percentile value, a range, an Infinity norm, an L2 norm, a ratio of L2 norms, an inner product, an angle between L2 norms which are determined over a variety of time periods (day over day, week over week, month over month, year over year), and a machine learning model for fault prediction .
- statistical and graphical parameters such as a median, a mean or a weighted mean (including a standard deviation or a weighted standard deviation), a 95 th percentile value, a range, an Infinity norm, an L2 norm, a ratio of L2 norms, an inner product, an angle between L2 norms which are determined over a variety of time periods (day over day, week over week, month over month, year over year), and
- the dissolved gas analyzer analytics engine and/or machine learning training and execution module may be configured to perform functions using these values, including, but not limited to, statistical parametrization, state and parameter estimation, forecasting, trend-based non-time critical fault diagnosis and prognosis, non-time critical intelligent decision making, and moderate order digital twin simulations.
- machine learning models that may be executed on the dissolved gas analyzer machine learning training and execution module include ARIMA models, SARIMA models, K-means models, ANNs, MLP models, RNN models, DeepAR models, Neural Prophet models, and SVM models.
- the dissolved gas analyzer analytics engine and/or machine learning training and execution module may be configured to compute a rate of change of gas concentrations during the event over a first time period.
- the first time period may be specified by an operator.
- an initial risk may be calculated in the dissolved gas analyzer analytics engine and/or machine learning training and execution module, for instance via machine learning model or statistical parameters or graphical visualization of gas concentrations or their rate of changes.
- the dissolved gas analyzer analytics engine and/or machine learning training and execution module may be configured to compute machine learning models or statistical parameters or graphical visualization of gas concentrations and their rate of changes over -multiple time periods in the historical database to determine the health trajectory.
- time periods may be of a similar period length to the first time period.
- historical data may be from a previous year, a previous month, a previous week, or a previous day.
- the dissolved gas analyzer analytics engine and/or machine learning, training, execution model may thus compute the various parameters using year-over-year data, month-over-month data, week- ov er- week data, or day-over-day data.
- the dissolved gas analyzer analytics engine and/or machine learning training and execution module may be configured to calculate a detailed risk level using the trend trajectory over multiple time periods.
- the dissolved gas analyzer machine learning training and execution module may use a machine learning model to calculate the detailed risk to the power transformers.
- the dissolved gas analyzer analytics engine and/or machine learning training and execution module may be configured to calculate an incremental condition deterioration of the power transformer health based on the initial risk and the second detailed risk evaluation.
- the incremental condition deterioration of the power transformer may be calculated using the machine learning and execution model or analytics engine at the dissolved gas analyzer.
- the dissolved gas analyzer machine learning training and execution module may receive the machine learning model from a server, where the machine learning model may be trained at the server. Other calculations that may be performed by the dissolved gas analyzer analytics engine and/or machine learning training and execution module may include gradient calculation, fault detection, and adaptive threshold estimation.
- the analytics engine and/or machine learning training and execution module may be configured to report the health status of the transformer, which is indicative of the condition deterioration, to an operator.
- a method for performing machine learning and data analytics comprising: determining a quantum of historical data associated with a machine learning model; determining an order associated with the machine learning model; determining whether a latency associated with the machine learning model is critical; selecting a server from a plurality of servers based at least in part on the quantum of historical data, the order, and the latency; and training the machine learning model using the server.
- the plurality of servers comprises at least a cloud server, a Free and Open-Source ghost (FOG) server, and an embedded or edge server.
- FOG Free and Open-Source ghost
- the quantum of historical data associated with the machine learning model comprises one of a low quantum of historical data, a medium quantum of historical data, or a high quantum of historical data.
- the order associated with the machine learning model comprises one of a reduced order, a moderately high order, or a complex order.
- any preceding clause further comprising: calculating a first rate of change associated with an event in a power transformer system, wherein the event occurs during a first time period; calculating, using the machine learning model, a first risk associated with the power transformer system based at least in part on the first rate of change; calculating a second rate of change associated with the power transformer system, wherein the second rate of change is determined over a second time period; calculating, using the machine learning model, a second risk associated with the power transformer system based at least in part on the second rate of change; and determining a condition deterioration associated with the power transformer system based at least in part on the first risk and the second risk.
- a method for performing data analytics comprising: determining a quantum of historical data associated with a machine learning model; determining an order associated with the machine learning model; determining whether a latency associated with the machine learning model is critical; selecting a server from a plurality of servers based at least in part on the quantum of historical data, the order, and the latency; training the machine learning model using the server; and determining, using the machine learning model, a condition deterioration associated with a power transformer system.
- the plurality 7 of servers comprises at least a cloud server, a Free and Open-Source ghost (FOG) server, and an embedded or edge server.
- the quantum of historical data associated with the machine learning model comprises one of a low quantum of historical data, a medium quantum of historical data, or a high quantum of historical data.
- the determination, using the machine learning model, of the condition deterioration associated with the power transformer system further comprises: calculating a first rate of change associated with an event in the power transformer system, wherein the event occurs during a first time period; calculating, using the machine learning model, a first risk associated with the power transformer system based at least in part on the first rate of change; calculating a second rate of change associated with the power transformer system, wherein the second rate of change is determined over a second time period; calculating, using the machine learning model, a second risk associated with the power transformer system based at least in part on the second rate of change; and determining the condition deterioration associated with the power transformer system based at least in part on the first risk and the second risk.
- a power transformer comprising: a power transformer; and a dissolved gas analyzer analytics engine, wherein the dissolved gas analyzer analytics engine is configured to: receive a trained machine learning model from a server, and wherein training the machine learning model comprises: determining a quantum of historical data associated with a machine learning model; determining an order associated with the machine learning model; determining whether a latency associated with the machine learning model is critical; selecting a server from a plurality of servers based at least in part on the quantum of historical data, the order, and the latency; and training the machine learning model using the server; and determine, using the trained machine learning model, a condition deterioration associated with the power transformer.
- the plurality of servers comprises at least a cloud server, a Free and Open-Source ghost (FOG) server, and an embedded or edge server/ 17.
- the quantum of historical data associated with the machine learning model comprises one of a low quantum of historical data, a medium quantum of historical data, or a high quantum of historical data.
- the determination, using the machine learning model, of the condition deterioration associated with the power transformer system comprises: calculating a first rate of change associated with an event in the power transformer system, wherein the event occurs during a first time period; calculating, using the machine learning model, a first risk associated with the power transformer system based at least in part on the first rate of change; calculating a second rate of change associated with the power transformer system, wherein the second rate of change is determined over a second time period; calculating, using the machine learning model, a second risk associated with the power transformer system based at least in part on the second rate of change; and determining the condition deterioration associated with the power transformer based at least in part on the first risk and the second risk.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Computational Linguistics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Power Engineering (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Supply And Distribution Of Alternating Current (AREA)
- Remote Monitoring And Control Of Power-Distribution Networks (AREA)
Abstract
Description
Claims
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP24729680.9A EP4710254A1 (en) | 2023-05-11 | 2024-05-08 | Systems and methods for performing machine learning and data analytics in hybrid systems |
| CN202480026921.7A CN121359136A (en) | 2023-05-11 | 2024-05-08 | Systems and methods for performing machine learning and data analytics in hybrid systems |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/315,887 US20240378493A1 (en) | 2023-05-11 | 2023-05-11 | Systems and methods for performing machine learning and data analytics in hybrid systems |
| US18/315,887 | 2023-05-11 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2024233643A1 true WO2024233643A1 (en) | 2024-11-14 |
| WO2024233643A8 WO2024233643A8 (en) | 2025-10-16 |
Family
ID=91302064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2024/028331 Ceased WO2024233643A1 (en) | 2023-05-11 | 2024-05-08 | Systems and methods for performing machine learning and data analytics in hybrid systems |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US20240378493A1 (en) |
| EP (1) | EP4710254A1 (en) |
| CN (1) | CN121359136A (en) |
| WO (1) | WO2024233643A1 (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200292608A1 (en) * | 2019-03-13 | 2020-09-17 | General Electric Company | Residual-based substation condition monitoring and fault diagnosis |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2593844A4 (en) * | 2010-07-16 | 2017-05-31 | The Trustees of Columbia University in the City of New York | Machine learning for power grids |
| US9665843B2 (en) * | 2013-06-03 | 2017-05-30 | Abb Schweiz Ag | Industrial asset health profile |
| US11055450B2 (en) * | 2013-06-10 | 2021-07-06 | Abb Power Grids Switzerland Ag | Industrial asset health model update |
| US9699205B2 (en) * | 2015-08-31 | 2017-07-04 | Splunk Inc. | Network security system |
| JP6496274B2 (en) * | 2016-05-27 | 2019-04-03 | ファナック株式会社 | Machine learning device, failure prediction device, machine system and machine learning method for learning life failure condition |
| US11516311B2 (en) * | 2021-01-22 | 2022-11-29 | Avago Technologies International Sales Pte. Limited | Distributed machine-learning resource sharing and request routing |
| JP7683474B2 (en) * | 2021-12-21 | 2025-05-27 | トヨタ自動車株式会社 | Core quality estimation system, core quality estimation method, and program |
| WO2024144841A1 (en) * | 2022-12-28 | 2024-07-04 | Schlumberger Technology Corporation | Inference as a service utilizing edge computing techniques |
| US20240289165A1 (en) * | 2023-02-24 | 2024-08-29 | Toyota Motor Engineering & Manufacturing North America, Inc. | System framework for software and hardware configuration determination for vehicle applications with cloud and edge computing |
-
2023
- 2023-05-11 US US18/315,887 patent/US20240378493A1/en active Pending
-
2024
- 2024-05-08 WO PCT/US2024/028331 patent/WO2024233643A1/en not_active Ceased
- 2024-05-08 EP EP24729680.9A patent/EP4710254A1/en active Pending
- 2024-05-08 CN CN202480026921.7A patent/CN121359136A/en active Pending
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200292608A1 (en) * | 2019-03-13 | 2020-09-17 | General Electric Company | Residual-based substation condition monitoring and fault diagnosis |
Non-Patent Citations (1)
| Title |
|---|
| GUO MIAN ET AL: "Computation Offloading for Machine Learning in Industrial Environments", IECON 2020 THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, IEEE, 18 October 2020 (2020-10-18), pages 4465 - 4470, XP033860407, DOI: 10.1109/IECON43393.2020.9255001 * |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4710254A1 (en) | 2026-03-18 |
| US20240378493A1 (en) | 2024-11-14 |
| CN121359136A (en) | 2026-01-16 |
| WO2024233643A8 (en) | 2025-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Ong et al. | Predictive maintenance model for IIoT-based manufacturing: A transferable deep reinforcement learning approach | |
| US11232368B2 (en) | System for predicting equipment failure events and optimizing manufacturing operations | |
| US20220146993A1 (en) | Machine learning method and machine learning device for learning fault conditions, and fault prediction device and fault prediction system including the machine learning device | |
| EP3729209B1 (en) | Combined learned and dynamic control method | |
| Idri et al. | Design of radial basis function neural networks for software effort estimation | |
| EP3923213B1 (en) | Method and computing system for performing a prognostic health analysis for an asset | |
| GB2620602A (en) | Training of a machine learning model for predictive maintenance tasks | |
| CN110309537B (en) | Intelligent health prediction method and system for aircraft | |
| CN112132394B (en) | Power plant circulating water pump predictive state evaluation method and system | |
| CN119292752B (en) | Carrier rocket software control method and decision device based on SAC | |
| CN117923331B (en) | A load control system and method based on crane hoisting | |
| CN114257806A (en) | Industrial camera fault prediction method and device, computer equipment and storage medium | |
| Nickpasand et al. | LSTM RNN in support of manufacturing simulation-based digital twin; a case from offshore wind turbine production | |
| EP3413153A1 (en) | Method and distributed control system for carrying out an automated industrial process | |
| US20240378493A1 (en) | Systems and methods for performing machine learning and data analytics in hybrid systems | |
| CN116980307A (en) | Operation and maintenance failure analysis methods, devices and computer equipment | |
| CN112785074B (en) | Equipment maintenance and repair opportunity determination system and method based on deep learning | |
| CN119312080A (en) | A dynamic cost-sensitive fault diagnosis system based on AC-DCC model | |
| CN116384876A (en) | Dynamic Inventory of Spare Parts Based on Wiener Process-Production Control Method, System and Medium | |
| CN118502994B (en) | A distributed storage fault prediction method and system based on machine learning | |
| Gutschi et al. | A conceptual modeling framework for evaluating the performance of predictive maintenance for modern, real-world production systems using potentials and risks of Industry 4.0 | |
| US20240144108A1 (en) | Real-time production throughput prediction with machine learning | |
| CN120633392B (en) | Real-time evaluation method for reliability of offshore autonomous water surface ship mechanical equipment | |
| CN120805990B (en) | A Smart Weight Prediction Method for Dynamic Scenarios | |
| KR102522634B1 (en) | Methods, devices, and systems for automating maintenance operations of network equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 24729680 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2024729680 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| ENP | Entry into the national phase |
Ref document number: 2024729680 Country of ref document: EP Effective date: 20251211 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2024729680 Country of ref document: EP |