US20180203959A1 - Virtual sensor for virtual asset - Google Patents

Virtual sensor for virtual asset Download PDF

Info

Publication number
US20180203959A1
US20180203959A1 US15/848,480 US201715848480A US2018203959A1 US 20180203959 A1 US20180203959 A1 US 20180203959A1 US 201715848480 A US201715848480 A US 201715848480A US 2018203959 A1 US2018203959 A1 US 2018203959A1
Authority
US
United States
Prior art keywords
virtual
physical
sensor
asset
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/848,480
Inventor
Runar Heggelien Refsnaes
Arnulf Hagen
Asle Heide Vaskinn
Knut Morten Okstad
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fedem Technology AS
Original Assignee
Fedem Technology AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fedem Technology AS filed Critical Fedem Technology AS
Priority to US15/848,480 priority Critical patent/US20180203959A1/en
Assigned to FEDEM TECHNOLOGY AS reassignment FEDEM TECHNOLOGY AS ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: Hagen, Arnulf, Okstad, Knut Morten, REFSNAES, RUNAR HEGGLIEN, Vaskinn, Asle Heide
Publication of US20180203959A1 publication Critical patent/US20180203959A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G06F17/5009
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M5/00Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings
    • G01M5/0008Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings of bridges
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M15/00Testing of engines
    • G01M15/14Testing gas-turbine engines or jet-propulsion engines
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M5/00Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings
    • G01M5/0033Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings by determining damage, crack or wear
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M5/00Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings
    • G01M5/0041Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings by determining deflection or stress
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M5/00Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings
    • G01M5/0066Investigating the elasticity of structures, e.g. deflection of bridges or air-craft wings by exciting or detecting vibration or acceleration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • G06F30/23Design optimisation, verification or simulation using finite element methods [FEM] or finite difference methods [FDM]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/02CAD in a network environment, e.g. collaborative CAD or distributed simulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/04Constraint-based CAD
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2111/00Details relating to CAD techniques
    • G06F2111/20Configuration CAD, e.g. designing by assembling or positioning modules selected from libraries of predesigned modules
    • G06F2217/02
    • G06F2217/04
    • G06F2217/06

Definitions

  • the Internet of Things provides an integrated network that brings together edge systems with a cloud environment where edge data can be monitored, analyzed, and used to control edge systems.
  • An edge machine may communicate with a physical asset and the cloud platform may generate a simulation or virtual model that mimics the behavior of the physical asset from a remote location.
  • virtual modeling has grown in the fields of energy (e.g., oil platforms, wind turbines, power plants, solar panels, etc.), healthcare (e.g., diagnostic equipment, treatment equipment, etc.), transportation (e.g., aircraft, locomotives, automobiles, etc.) as well as many others.
  • the virtual model refers to a computerized simulation model of a physical asset such as a machine, equipment, group of machines/equipment, and the like.
  • the virtual model may be generated based on computer animated design (CAD) models, design drawings, construction details, measurements, and the like, of the asset.
  • CAD computer animated design
  • the virtual model may be calibrated based on sensor data from the asset disposed on the edge.
  • the data is obtained from sensors (i.e., hardware) installed on the asset which can measure various parameters such as acceleration, velocity, force, power, movement, and the like.
  • the sensor data can be used to simulate a status, working condition, position, or the like, of the physical asset in virtual space.
  • the virtual model is often meant to be an up-to-date and accurate digital replica of the properties and states of the physical asset, which may include one or more of shape, position, gesture, status, motion, and the like.
  • related art virtual modeling approaches are limited due to the type and location of physical sensor installations within a physical structure.
  • Another issue with physical sensors is that the physical sensors cost money to acquire, install, and maintain.
  • sensor data can be vast and difficult to sift through in real-time. Because of this, current sensor analysis does not provide sufficient real-time analysis of sensor readings and results in a poor assessment of the state of a physical structure at a given time.
  • FIG. 1 is a diagram illustrating a simulation system including a virtual asset in accordance with an example embodiment.
  • FIG. 2 is a diagram illustrating a user interface for attaching a virtual sensor to a virtual asset in accordance with an example embodiment.
  • FIG. 3 is a diagram illustrating virtual sensors capturing data from a virtual asset in accordance with an example embodiment.
  • FIG. 4 is a diagram illustrating a method for sensing data from a virtual asset using a virtual sensor in accordance with an example embodiment.
  • FIG. 5 is a diagram illustrating a computing system for sensing data from a virtual asset using a virtual sensor in accordance with an example embodiment.
  • the example embodiments relate to virtual sensors which may be used to compliment physical sensors or used instead of physical sensors in a system which performs real-time structural analysis of a physical asset based on simulations performed on a virtual model (also referred to as a digital twin) of the physical asset.
  • the asset may be any type of asset used that may be included in an Internet of Things (IoT) environment or a stand-alone environment, and may include, for example, a wind turbine, a crane, a winch, an oil platform, an aircraft, a locomotive, a gas turbine, a building, a bridge, and the like. It should be appreciated that the type of asset is not limited.
  • Data of the physical asset may be transmitted to a host system of the virtual model.
  • the sensors may include proximity sensors, accelerometers, temperature, pressure, image, gas, chemical, gauges, and others.
  • the sensor data may be acquired by multiple sensors attached at various locations dispersed throughout a surface of the physical asset.
  • the sensor data from the physical asset may be used to generate and apply a virtual force to a corresponding virtual asset.
  • the virtual force may be used to mimic the force being applied to the physical asset. Accordingly, monitoring and analysis may be performed on the virtual asset to assess productivity, generate alerts, and determine corrective action associated with the physical asset.
  • the example embodiments are directed to virtual sensors that can be attached or otherwise associated with a virtual model of a physical asset.
  • Virtual sensors do not have a cost associated therewith nor do they consume time by requiring a physical install. Instead, virtual sensors can be added from a remote location (e.g., via a user interface, etc.) Furthermore, increasing the amount of virtual sensors does not increase hardware costs.
  • virtual sensors can be placed at dynamic monitoring locations (e.g., hot spots) based on a current state of the physical asset rather than predefined locations as with physical sensors. Through the use of virtual sensors on the virtual model, the amount of physical sensors on the physical structure can be reduced in comparison to previous monitoring techniques thus reducing sensor hardware costs, installation costs, and maintenance costs.
  • Data from the physical sensors may be transformed into virtual information (e.g., motion, translation, rotation, position, reactionary force, etc.) and applied to a structure of a corresponding virtual asset in real-time.
  • the data sensed from the physical asset may be used to generate and apply a virtual force to the virtual asset that mimics the real world force being applied to the physical asset.
  • virtual sensors may be used to detect translations, rotations, stresses, etc. that occur as a result of the virtual force being applied to the virtual structure of the virtual asset.
  • the virtual sensors can be placed anywhere along the virtual asset and can be used to acquire data from the simulation.
  • there are no hardware, installation, or maintenance costs associated with adding virtual sensors Accordingly, increasing the number of virtual sensors does not increase cost.
  • virtual sensors can be added at locations on the virtual asset that differ from locations at which physical sensors are located on the physical structure and even places that are not accessible on the physical structure (e.g., inside of a beam made of steel, etc.).
  • the data that is sensed by the virtual sensors may be used to compliment data that is sensed by physical sensors or it may be used instead of the data from physical sensors.
  • Virtual sensors can be used to sense data from a virtual component of the virtual model as if connected to the physical asset. In this case, the overall motion of the virtual component may be determined by data from a physical sensor.
  • Virtual sensors attached to the virtual model can include different sensor types than the physical sensors attached to the physical structure. Examples of physical and virtual sensors include motion, force and moment sensors or strain gauges. Virtual sensors can be added remotely to the monitoring system at any time, without interrupting the operation. As a result, a re-analysis based on historical data is capable of being performed for locations which have not previously been considered.
  • the physical sensor measurements acquired from the real asset may be processed onsite or in a remote environment (e.g., a cloud computing environment) in a real-time structural analysis via a multi-body simulation based on a corresponding virtual asset.
  • Readings from virtual sensors sensing data from and about the virtual asset may be extracted from the simulation model and made available for an online access system.
  • Measurements from virtual sensors can be extracted with a same format, type and communication protocol as measurements taken from physical sensors of traditional monitoring solutions. Accordingly, existing programs and user interfaces can still be used, replacing feed from physical sensors by feed from virtual sensors.
  • Real-time data feed and analysis enables operational decision making. Control actions such as yawing direction of a wind turbine can be simulated in advance of a control decision, considering consequences for both power production and structural lifetime. In addition, by recording an accurate and reliable history of structural responses (overview over extreme and fatigue events) enables cost-efficient prolongation of life beyond design lifetime.
  • FIG. 1 illustrates a simulation system 100 including a virtual asset 120 in accordance with an example embodiment.
  • the virtual asset 120 is a digital replica, or digital model of a physical asset 110 .
  • the real asset 110 is a wind turbine, however, the embodiments are not limited thereto and the asset may be any desired asset or structure such as a bridge, a crane, a winch, a platform, a rig, and the like.
  • the software described herein e.g., application, program, service, code, etc.
  • the asset 110 may be coupled to or otherwise in communication with an industrial edge computing system 112 .
  • the industrial edge system 112 may include an edge device, an asset control system, an intervening edge server, and the like.
  • the virtual asset 120 may be hosted by a host platform 122 such as a web server, a cloud platform, an on-premises server, or the like.
  • the host platform 122 may communicate with the edge system 112 via a network to receive data about the physical asset 110 and the provide control signals for controlling the physical asset 110 .
  • Observations and measurements captured or sensed by physical sensors attached to or otherwise associated with the physical asset 110 may be fed by the edge system 112 to the host platform 122 .
  • An actuator 124 may generate motions in a virtual environment according to the physical sensor measurement data and applied in a simulation model to the virtual asset 120 by stimulating the virtual asset 120 with a corresponding force.
  • the real asset 110 is a physical system in the real world.
  • the virtual asset 120 (also referred to as digital twin) is a numerical model established by a simulation software. That is, the virtual asset 120 is a digital copy or replica of the real asset 110 and may have the same virtual dimensions, material properties, constraints, etc. as the physical characteristics of the real asset 110 .
  • the virtual asset 120 may be a numerical representation of the real asset 110 and may follow or otherwise mimic its motions and dynamical behavior.
  • the virtual behavior of the virtual asset 120 may be captured by one or more virtual sensors 125 described herein.
  • Physical sensors 115 may be used to observe the response of the physical asset 110 and may be used to measure the dynamical motions, material deformations, and the like, of the physical asset 110 .
  • the virtual sensors 125 may be used to observe the response of the virtual asset 120 and measure the same motions and deformations.
  • the physical sensors 115 can be of any physical kind (when installed on the real system), and likewise, the virtual sensors 125 can be any virtual kind (when placed on the digital twin). In some embodiments, the physical sensors 115 may be less in number than the virtual sensors 125 . That is, the virtual sensors 125 may be placed at different and additional locations on the virtual asset 120 than the physical sensors 115 are placed on the real asset 110 .
  • the system 100 enables the virtual asset 120 to be monitored and analyzed at more locations and at a finer level than the physical asset 110 .
  • the virtual sensors 125 may be of different types of sensors than the physical sensors 115 attached to the physical asset 110 , and are not limited to being of the same type as the physical sensors 115 .
  • actuators are devices which convert energy into motions such as a motor, and the like.
  • the actuator 124 may be used to prescribe motions of a numerical model based on input data received from the measurements of the physical asset 110 .
  • observations may be made in the real world by physical sensor 115 measurements, which are transferred to the numerical model of the digital twin.
  • the actuators 124 may be placed on the virtual asset 120 and used to stimulate the virtual asset 120 with motions according to sensor measurements taken from the physical asset 110 .
  • the virtual sensors 125 may determine stress and/or damage that occurs to the virtual asset 120 based on the stimulation.
  • a fast and accurate numerical solver is provided for the simulation model.
  • Sensor measurements on the physical asset 110 can trigger a numerical solver process in the simulation model, updating the state of the virtual asset 120 .
  • the solver process may be as fast as, or faster than, the sensor measurement sampling of the physical sensors 115 to be capable of keeping track with the physical asset 110 .
  • Another aspect of the system 100 is the ability to predict structural responses of the physical asset 110 based on future events. For example, by estimating the development of a future load situation, different control decisions can be simulated in advance of the performed actions, evaluating consequences for both power production and structural loading.
  • the system and method described herein may be used to perform real-time based structural analysis of a physical asset based on analysis of a corresponding virtual asset.
  • Data acquired from the physical asset may be fed into the simulation model such as shown in FIG. 1 , in real-time.
  • the application software described herein may convert the physical measurements and other data acquired from the real asset into movement data or position data (e.g., rotations, translations, position, acceleration, strain, force, etc.) in the virtual space.
  • movement data or position data e.g., rotations, translations, position, acceleration, strain, force, etc.
  • the application may create input data for the simulation model based on sensor data acquired from the real asset.
  • the physical asset described herein may correspond to a machine or equipment for use in industry, healthcare, manufacture, etc.
  • assets include a wind turbine, a winch, a crane, a bridge, an oil platform, and the like, which include materials such as metal, concrete, and the like.
  • the application may generate input data for the simulation model (e.g., the virtual asset) during a pre-processing step.
  • the application may determine a beam deformation of the real asset which may be used to identify virtual forces that can be used to drive the simulation model such that it mimics the behavior of the real asset.
  • position and movement data such as accelerometer data from the real asset is used to generate an observable attribute of the virtual asset such as position or movement data for the virtual asset.
  • acceleration data may be used to generate position data in the virtual environment.
  • Other types of observable attribute data may be generated and applied to the virtual model based on data from the physical asset.
  • Other examples of observable attributes include rotation, translation, acceleration, orientation, a fixed position, strain, force, pressure, sound, and the like.
  • the transformation process uses information about a structure of the real asset to generate a transfer function that transforms the acquired data into the observable attribute or attributes in the virtual environment. Based on the structure of the real asset, a determination of how the structure of the real asset reacts to movement (e.g., measured by accelerometers, motion sensors, etc.) can be mapped into position and movement data in the virtual environment.
  • FIG. 2 illustrates an example of a user interface 200 which enables a user the ability to insert or otherwise attach virtual sensors (e.g., virtual sensor 220 ) to a virtual model 210 of an asset.
  • virtual sensors e.g., virtual sensor 220
  • a user may move a cursor 230 to a position of the virtual model 210 at which the user desires to add a virtual sensor, and the user may press a selection (e.g., input pad, mouse click, vocal command, etc.) which causes the software to add a virtual sensor 220 to the virtual model 210 of the asset.
  • the addition of the virtual sensor 220 creates position for data to be sensed and output.
  • the virtual sensor 220 may start working immediately after being added to the virtual model 210 .
  • the data sensing may include measuring an observable attribute such as position, movement, velocity, strain, pressure, sound, etc., of the virtual model 210 in virtual space.
  • the user interface may also provide a menu that gives the user the ability to determine the type of data (i.e., attribute or attributes) to be sensed, the data format that the data is to be provided in, and other details.
  • the von Mises stress is selected as the data to be sensed.
  • the virtual sensor 220 may perform a special kind of readout from the virtual model 210 .
  • the virtual sensor 220 (instead of an output from a model) may be referred to as a box which is placed on the object (e.g., virtual asset) being monitored. Upon this placement, a spot on the model is determined at which data is to be extracted from.
  • the placement of the virtual sensor 220 opens a channel to the underlying runtime. Upon opening this channel, the data desired may be selected (e.g., velocity, positions, inclinations, reaction forces, etc.) via a menu of the user interface. The user may also select a frequency at which the data is to be read and the packaging standard that the data should be encapsulated with.
  • the spot at which the virtual sensor 220 is placed may receive a unique identification from the system. Accordingly, any application or device can access the model/sensor using the ID and read this virtual sensor like the application would when reading a physical sensor data stream.
  • the naming of a virtual sensor is more of branding.
  • FIG. 3 illustrates a process of virtual sensors capturing data from a virtual asset in accordance with an example embodiment.
  • a virtual asset is simulated in 320 based on asset data sensed in 310 .
  • the simulated movement may be performed in 320 based on a physical sensor measurements captured from the real asset in 310 .
  • the sensed movement is captured from a physical sensor disposed on a top of the real asset during the sensed asset movement in 310 .
  • the virtual asset includes multiple virtual sensors (VS 1 , VS 2 , VS 3 ) positioned at different vertical positions of the virtual asset.
  • FIG. 3 illustrates a process of virtual sensors capturing data from a virtual asset in accordance with an example embodiment.
  • deflection versus angle ratios 330 for three vertical positions on a virtual asset reacting to a concentrated force acting on a tower top of a physical asset are identified and plotted as a graph in 330 .
  • deflection versus angle (R y ) is plotted on the graph 330 .
  • the application described herein may also perform analytical estimation of linear acceleration compensation (dynamic factor).
  • linear acceleration compensation dynamic factor
  • one method is to measure the direction of the gravitational pull on the accelerometer. This is used in simpler inclinometer designs as an accelerometer typically has a superior quality to cost ratio.
  • measuring the direction of the gravitational pull is not straightforward because it is difficult if not impossible to separate it directly from the total acceleration.
  • the linear acceleration may in certain systems be compensated for.
  • the use of virtual sensors can reduce the number of hardware sensors that are needed to measure physical locations on the real asset.
  • virtual forces that are created based on the real asset can be applied to the virtual asset enabling virtual sensors to be added on the virtual model at different places than at which physical sensors are located on the real asset.
  • the virtual sensors reduce cost and resources.
  • an operator may have access to the very top of the wind turbine in the physical (real) world allowing real sensors to be placed at the to of the turbine.
  • the remainder of the wind turbine is difficult to access, especially while in operation.
  • virtual sensors can be used in any location on the virtual asset that are difficult to access with real sensors on the real, physical asset.
  • Hot spots are points on a virtual structure where virtual sensors (e.g., strain gauges) can be placed based on previous knowledge where damage will likely occur on the physical structure.
  • virtual sensors e.g., strain gauges
  • One of the advantages provided by this method is that new virtual sensors can be positioned at other places on the virtual structure where physical sensors are not present or not capable of being placed on the real structure.
  • the example embodiments can be used as an operational tuning to fine tune the balance between damage assessment and energy acquired to find a cost efficient balance between the two such that the wind turbine is not running in conditions that are cost negative from a damage to the wind turbine perspective.
  • FIG. 4 illustrates a method 400 for sensing data from a virtual asset using a virtual sensor in accordance with an example embodiment.
  • the method 400 may be performed by a computing system that hosts a virtual asset.
  • the computing system may include a cloud platform, a server, an industrial computing system, an asset controller, an intervening industrial server, and the like.
  • the method includes executing a virtual model in virtual space.
  • the virtual model may include a digital model of a physical asset located in physical space and may be executed based on sensor data sensed of the physical asset in operation.
  • the sensor data may include raw data received directly from a sensor attached or otherwise associated with the physical asset, or it may include data from an analytic application, or the like, which monitors the operation of the physical asset.
  • the virtual model may include a three-dimensional (3D) simulation of the physical asset, and an observable attribute being sensed from the virtual asset may correspond to a change in position or a change in state of the 3D simulation in virtual space.
  • the method includes determining a position of a virtual sensor on a structure of the virtual model.
  • the position of the virtual sensor in virtual space may be determined based on pixel coordinates of the virtual sensor position within a visual interface that is simulating and displaying the virtual asset.
  • the position may include an X coordinate, a Y coordinate, or multiple X coordinates and/or multiple Y coordinates.
  • the method may further include attaching the virtual sensor to the virtual asset such as to a virtual component which corresponds to a physical component of the physical asset.
  • the method may include displaying the virtual model via a user interface, and detecting a command, via the user interface, for attaching the virtual sensor at a position of a component on the virtual model.
  • the detecting, via the user interface may also include detecting a selection of a type of data to be sensed by the virtual sensor from among a plurality of types of data such as velocity, inclination, acceleration, reactionary forces, and the like.
  • Physical sensors are often limited in their locations on a physical asset. For example, it may not be possible to embed a physical sensor with a steel beam of a wind turbine. However, the example embodiments provide the ability for embedding the virtual sensor within an interior of the virtual component which is not accessible to a physical sensor on the corresponding physical component of the physical asset.
  • the virtual sensor may be embedded within a steel beam in the virtual space.
  • the method includes sensing an observable attribute of the virtual model in virtual space at the position of the virtual sensor on the structure of the virtual model, and in 440 , transmitting information about the virtually sensed attribute sensed via the virtual sensor to a system associated with the physical asset.
  • the observable attribute of the virtual model in virtual space may correspond to an actual attribute of the physical asset that is observer by mimicking a movement of the physical asset in physical space based on data being fed to the virtual model from the edge including the physical asset.
  • the observable attribute of the virtual asset may include one or more of a movement, a position, a force, a strain, a pressure, a sound, a radiation, and/or the like which may be observed from the virtual model in virtual space.
  • the virtual sensor may be placed on or otherwise attached to a virtual structure of the virtual model.
  • the position may be determined by detecting movement information of a virtual structure of the virtual asset based on transformed and applied virtual position information.
  • the detecting of the movement of the virtual structure of the virtual asset may be performed by one or more virtual sensors that are positioned on the virtual asset.
  • the virtual sensors may detect a change in position (e.g., X axis, Y axis, and Z axis) of structural components of the virtual asset.
  • the method may further include assigning a unique identifier to the virtual sensor based on the position of the virtual model at which the virtual sensor is attached.
  • the identifier may be a code, a serial number, a tag, etc., which uniquely identifies the sensor and its position on the virtual model.
  • the method may include receiving a request from an application for registering with the virtual sensor based on the unique identifier, and transmitting the virtually sensed movement to the registered application.
  • FIG. 5 illustrates a computing system 500 for sensing data from a virtual asset using a virtual sensor in accordance with an example embodiment.
  • the computing system 500 may be a database, cloud platform, streaming platform, a workstation, an on-premises computing system, and the like.
  • the computing system 500 may be distributed across multiple devices.
  • the computing system 500 includes a network interface 510 , a processor 520 , an output 530 , and a storage device 540 such as a memory.
  • the computing system 500 may include other components such as a display, an input unit, a receiver, a transmitter, and the like.
  • the network interface 510 may transmit and receive data over a network such as the Internet, a private network, a public network, and the like.
  • the network interface 510 may be a wireless interface, a wired interface, or a combination thereof.
  • the processor 520 may include one or more processing devices each including one or more processing cores. In some examples, the processor 520 is a multicore processor or a plurality of multicore processors. Also, the processor 520 may be fixed or it may be reconfigurable.
  • the output 530 may output data to an embedded display of the computing system 500 , an externally connected display, a display connected to the cloud, another device, and the like.
  • the storage device 540 is not limited to a particular storage device and may include any known memory device such as RAM, ROM, hard disk, and the like, and may or may not be included within the cloud environment.
  • the storage 540 may store software modules or other instructions which can be executed by the processor 520 to perform the method 400 shown in FIG. 4 .
  • the network interface 510 may receive sensor data that is sensed in association with an operation of a physical asset in physical space.
  • the sensor data may be received from an edge device such as a device coupled to the asset, an asset control system, an industrial PC, an intervening edge server, and the like.
  • the processor 520 may execute or otherwise run a virtual model in virtual space of the asset.
  • the virtual model may include a digital model or digital representation of the physical asset and may be executed by the processor 520 based on the received sensor data.
  • the virtual model may have one or more virtual sensors attached thereto or otherwise associated therewith.
  • the processor 520 may determine a position of a virtual sensor on a structure of the virtual model, sense an observable attribute of the virtual model in virtual space at the position of the virtual sensor on the structure of the virtual model, and transmit information about the virtually sensed attribute to a system (e.g., application, device, network, asset, etc.) associated with the physical asset.
  • a system e.g., application, device, network, asset, etc.
  • the processor 520 may manage a user interface through which a user can manipulate placement, data sensing types, and the like, of virtual sensors with respect to the virtual asset.
  • the processor 520 may attach a virtual sensor to a virtual component of the virtual model in response to a user command received via the user interface.
  • the virtual sensor may be attached to an exterior of a component of the virtual asset (e.g., the exterior of a beam, stack, flare, etc.).
  • the processor 520 may embed the virtual sensor within an interior of the virtual component which is not accessible to a physical sensor on the corresponding physical component of the physical asset. Accordingly, the virtual sensor may sense data on the virtual asset that is not capable of being sensed using a physical sensor on the physical asset.
  • the processor 520 may detect a command, via the user interface, of a selection of a type of data to be sensed by the virtual sensor from among a plurality of types of data.
  • the data types include velocity, movement, displacement, force, and the like.
  • the processor 520 may assign a unique identifier to the virtual sensor based on the position of the virtual model at which the virtual sensor is attached. For example, the unique identifier may be automatically assigned in response to the user attaching a virtual sensor to the virtual asset via the user interface.
  • a system e.g., analytic application, device, etc.
  • the processor 520 may receive a request from the requesting system for registering with the virtual sensor based on the unique identifier, register the system for data communication, and transmit the virtually sensed movement to the registered system on a periodic basis, continuous basis, or the like.
  • the above-described examples of the disclosure may be implemented using computer programming or engineering techniques including computer software, firmware, hardware or any combination or subset thereof.
  • the methods described herein may be implemented via one or more software applications (e.g., program, application, code, module, service, etc.) executing on one or more computing devices. Any such resulting program, having computer-readable code, may be embodied or provided within one or more non transitory computer-readable media, thereby making a computer program product, i.e., an article of manufacture, according to the discussed examples of the disclosure.
  • the non-transitory computer-readable media may be, but is not limited to, a fixed drive, diskette, optical disk, magnetic tape, flash memory, semiconductor memory such as read-only memory (ROM), and/or any transmitting/receiving medium such as the Internet, cloud storage, the internet of things, or other communication network or link.
  • the article of manufacture containing the computer code may be made and/or used by executing the code directly from one medium, by copying the code from one medium to another medium, or by transmitting the code over a network.
  • the computer programs may include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language.
  • the terms “machine-readable medium” and “computer-readable medium” refer to any computer program product, apparatus, cloud storage, internet of things, and/or device (e.g., magnetic discs, optical disks, memory, programmable logic devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal.
  • PLDs programmable logic devices
  • the term “machine-readable signal” refers to any signal that may be used to provide machine instructions and/or any other kind of data to a programmable processor.

Abstract

Provided are systems and methods for monitoring a physical asset using virtual sensors sensing data of a virtual asset corresponding to the physical asset. In one example, the method includes executing a virtual model in virtual space, the virtual model including a digital model of a physical asset located in physical space and being executed based on sensor data sensed of an operation of the physical asset, determining a position of a virtual sensor on a structure of the virtual model, sensing an observable attribute of the virtual model in virtual space at the position of the virtual sensor on the structure of the virtual model, the observable attribute of the virtual model in virtual space corresponding to an actual attribute of the physical asset in physical space, and transmitting information about the virtually sensed attribute sensed via the virtual sensor to a system associated with the physical asset.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit under 35 USC § 119(e) of U.S. Provisional Patent Application No. 62/446,033, filed on Jan. 13, 2017, and of U.S. Provisional Patent Application No. 62/446,374, filed on Jan. 14, 2017, filed in the United States Patent and Trademark Office, both of which are incorporated herein by reference for all purposes.
  • BACKGROUND
  • The Internet of Things (IoT) provides an integrated network that brings together edge systems with a cloud environment where edge data can be monitored, analyzed, and used to control edge systems. An edge machine may communicate with a physical asset and the cloud platform may generate a simulation or virtual model that mimics the behavior of the physical asset from a remote location. For example, virtual modeling has grown in the fields of energy (e.g., oil platforms, wind turbines, power plants, solar panels, etc.), healthcare (e.g., diagnostic equipment, treatment equipment, etc.), transportation (e.g., aircraft, locomotives, automobiles, etc.) as well as many others. The virtual model, or digital twin, refers to a computerized simulation model of a physical asset such as a machine, equipment, group of machines/equipment, and the like. The virtual model may be generated based on computer animated design (CAD) models, design drawings, construction details, measurements, and the like, of the asset. Also, the virtual model may be calibrated based on sensor data from the asset disposed on the edge. In many cases, the data is obtained from sensors (i.e., hardware) installed on the asset which can measure various parameters such as acceleration, velocity, force, power, movement, and the like. The sensor data can be used to simulate a status, working condition, position, or the like, of the physical asset in virtual space. This pairing of the virtual and physical worlds allows analysis of data and monitoring of physical assets to address problems before they even occur, prevent downtime, develop new opportunities, and plan for the future based on simulations.
  • The virtual model is often meant to be an up-to-date and accurate digital replica of the properties and states of the physical asset, which may include one or more of shape, position, gesture, status, motion, and the like. However, related art virtual modeling approaches are limited due to the type and location of physical sensor installations within a physical structure. Another issue with physical sensors is that the physical sensors cost money to acquire, install, and maintain. Furthermore, sensor data can be vast and difficult to sift through in real-time. Because of this, current sensor analysis does not provide sufficient real-time analysis of sensor readings and results in a poor assessment of the state of a physical structure at a given time. In addition, preprogrammed and simplified (generic) mathematical algorithms used for digital conversion and structure analysis become inadequate upon changed needs or conditions, for example, when the physical structure begins to deteriorate or complex scenarios develop in and around the physical asset. Accordingly, what is needed is an improved way of monitoring and diagnosing a physical asset through a virtual asset in real-time.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Features and advantages of the example embodiments, and the manner in which the same are accomplished, will become more readily apparent with reference to the following detailed description taken in conjunction with the accompanying drawings.
  • FIG. 1 is a diagram illustrating a simulation system including a virtual asset in accordance with an example embodiment.
  • FIG. 2 is a diagram illustrating a user interface for attaching a virtual sensor to a virtual asset in accordance with an example embodiment.
  • FIG. 3 is a diagram illustrating virtual sensors capturing data from a virtual asset in accordance with an example embodiment.
  • FIG. 4 is a diagram illustrating a method for sensing data from a virtual asset using a virtual sensor in accordance with an example embodiment.
  • FIG. 5 is a diagram illustrating a computing system for sensing data from a virtual asset using a virtual sensor in accordance with an example embodiment.
  • Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals will be understood to refer to the same elements, features, and structures. The relative size and depiction of these elements may be exaggerated or adjusted for clarity, illustration, and/or convenience.
  • DETAILED DESCRIPTION
  • In the following description, specific details are set forth in order to provide a thorough understanding of the various example embodiments. It should be appreciated that various modifications to the embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the disclosure. Moreover, in the following description, numerous details are set forth for the purpose of explanation. However, one of ordinary skill in the art should understand that embodiments may be practiced without the use of these specific details. In other instances, well-known structures and processes are not shown or described in order not to obscure the description with unnecessary detail. Thus, the present disclosure is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
  • The example embodiments relate to virtual sensors which may be used to compliment physical sensors or used instead of physical sensors in a system which performs real-time structural analysis of a physical asset based on simulations performed on a virtual model (also referred to as a digital twin) of the physical asset. The asset may be any type of asset used that may be included in an Internet of Things (IoT) environment or a stand-alone environment, and may include, for example, a wind turbine, a crane, a winch, an oil platform, an aircraft, a locomotive, a gas turbine, a building, a bridge, and the like. It should be appreciated that the type of asset is not limited. Data of the physical asset, for example, data sensed by on one or more physical sensors placed on or about the asset may be transmitted to a host system of the virtual model. The sensors may include proximity sensors, accelerometers, temperature, pressure, image, gas, chemical, gauges, and others. In one example, the sensor data may be acquired by multiple sensors attached at various locations dispersed throughout a surface of the physical asset. The sensor data from the physical asset may be used to generate and apply a virtual force to a corresponding virtual asset. The virtual force may be used to mimic the force being applied to the physical asset. Accordingly, monitoring and analysis may be performed on the virtual asset to assess productivity, generate alerts, and determine corrective action associated with the physical asset.
  • Related art monitoring approaches are limited in the number, type and location of physical sensor installations on a physical structure. For example, a person typically has access to the top of a wind turbine where the power supply is located. However, it may be difficult to gain access to the rotor and the blades of the wind turbine, especially while the wind turbine is active. In addition to the difficulty accessing locations on the physical asset, physical sensors can be expensive to acquire, install, and maintain. Therefore, from a monitoring perspective, hardware monitoring can be costly and difficult to adequately measure all areas of an asset. From a software perspective, current technology does not provide sufficient real-time analysis of sensor readings and thus creates a poor assessment of the state of a structure in real time. In addition, preprogrammed and simplified (generic) mathematical algorithms can become inadequate when conditions change or complex scenarios associated with the asset occur.
  • The example embodiments are directed to virtual sensors that can be attached or otherwise associated with a virtual model of a physical asset. Virtual sensors do not have a cost associated therewith nor do they consume time by requiring a physical install. Instead, virtual sensors can be added from a remote location (e.g., via a user interface, etc.) Furthermore, increasing the amount of virtual sensors does not increase hardware costs. In addition, virtual sensors can be placed at dynamic monitoring locations (e.g., hot spots) based on a current state of the physical asset rather than predefined locations as with physical sensors. Through the use of virtual sensors on the virtual model, the amount of physical sensors on the physical structure can be reduced in comparison to previous monitoring techniques thus reducing sensor hardware costs, installation costs, and maintenance costs.
  • Data from the physical sensors may be transformed into virtual information (e.g., motion, translation, rotation, position, reactionary force, etc.) and applied to a structure of a corresponding virtual asset in real-time. For example, the data sensed from the physical asset may be used to generate and apply a virtual force to the virtual asset that mimics the real world force being applied to the physical asset. Meanwhile, in the simulated environment, virtual sensors may be used to detect translations, rotations, stresses, etc. that occur as a result of the virtual force being applied to the virtual structure of the virtual asset. The virtual sensors can be placed anywhere along the virtual asset and can be used to acquire data from the simulation. As mentioned, there are no hardware, installation, or maintenance costs associated with adding virtual sensors. Accordingly, increasing the number of virtual sensors does not increase cost. Furthermore, virtual sensors can be added at locations on the virtual asset that differ from locations at which physical sensors are located on the physical structure and even places that are not accessible on the physical structure (e.g., inside of a beam made of steel, etc.).
  • The data that is sensed by the virtual sensors may be used to compliment data that is sensed by physical sensors or it may be used instead of the data from physical sensors. Virtual sensors can be used to sense data from a virtual component of the virtual model as if connected to the physical asset. In this case, the overall motion of the virtual component may be determined by data from a physical sensor. Virtual sensors attached to the virtual model can include different sensor types than the physical sensors attached to the physical structure. Examples of physical and virtual sensors include motion, force and moment sensors or strain gauges. Virtual sensors can be added remotely to the monitoring system at any time, without interrupting the operation. As a result, a re-analysis based on historical data is capable of being performed for locations which have not previously been considered.
  • The physical sensor measurements acquired from the real asset may be processed onsite or in a remote environment (e.g., a cloud computing environment) in a real-time structural analysis via a multi-body simulation based on a corresponding virtual asset. Readings from virtual sensors sensing data from and about the virtual asset may be extracted from the simulation model and made available for an online access system. Measurements from virtual sensors can be extracted with a same format, type and communication protocol as measurements taken from physical sensors of traditional monitoring solutions. Accordingly, existing programs and user interfaces can still be used, replacing feed from physical sensors by feed from virtual sensors. Real-time data feed and analysis enables operational decision making. Control actions such as yawing direction of a wind turbine can be simulated in advance of a control decision, considering consequences for both power production and structural lifetime. In addition, by recording an accurate and reliable history of structural responses (overview over extreme and fatigue events) enables cost-efficient prolongation of life beyond design lifetime.
  • FIG. 1 illustrates a simulation system 100 including a virtual asset 120 in accordance with an example embodiment. According to various aspects, the virtual asset 120 is a digital replica, or digital model of a physical asset 110. In this example, the real asset 110 is a wind turbine, however, the embodiments are not limited thereto and the asset may be any desired asset or structure such as a bridge, a crane, a winch, a platform, a rig, and the like. The software described herein (e.g., application, program, service, code, etc.) for controlling the virtual asset 120 and virtual sensors is based on the principle of observations and stimulations. The asset 110 may be coupled to or otherwise in communication with an industrial edge computing system 112. The industrial edge system 112 may include an edge device, an asset control system, an intervening edge server, and the like. Meanwhile, the virtual asset 120 may be hosted by a host platform 122 such as a web server, a cloud platform, an on-premises server, or the like. The host platform 122 may communicate with the edge system 112 via a network to receive data about the physical asset 110 and the provide control signals for controlling the physical asset 110.
  • Observations and measurements captured or sensed by physical sensors attached to or otherwise associated with the physical asset 110 may be fed by the edge system 112 to the host platform 122. An actuator 124 may generate motions in a virtual environment according to the physical sensor measurement data and applied in a simulation model to the virtual asset 120 by stimulating the virtual asset 120 with a corresponding force. In the example of the system 100 of FIG. 1, the real asset 110 is a physical system in the real world. In contrast, the virtual asset 120 (also referred to as digital twin) is a numerical model established by a simulation software. That is, the virtual asset 120 is a digital copy or replica of the real asset 110 and may have the same virtual dimensions, material properties, constraints, etc. as the physical characteristics of the real asset 110. In operation, the virtual asset 120 may be a numerical representation of the real asset 110 and may follow or otherwise mimic its motions and dynamical behavior. According to various aspects, the virtual behavior of the virtual asset 120 may be captured by one or more virtual sensors 125 described herein.
  • Physical sensors 115 may be used to observe the response of the physical asset 110 and may be used to measure the dynamical motions, material deformations, and the like, of the physical asset 110. Likewise, the virtual sensors 125 may be used to observe the response of the virtual asset 120 and measure the same motions and deformations. The physical sensors 115 can be of any physical kind (when installed on the real system), and likewise, the virtual sensors 125 can be any virtual kind (when placed on the digital twin). In some embodiments, the physical sensors 115 may be less in number than the virtual sensors 125. That is, the virtual sensors 125 may be placed at different and additional locations on the virtual asset 120 than the physical sensors 115 are placed on the real asset 110. Accordingly, the system 100 enables the virtual asset 120 to be monitored and analyzed at more locations and at a finer level than the physical asset 110. Furthermore, the virtual sensors 125 may be of different types of sensors than the physical sensors 115 attached to the physical asset 110, and are not limited to being of the same type as the physical sensors 115.
  • In the real world, actuators are devices which convert energy into motions such as a motor, and the like. In the simulation software, the actuator 124 may be used to prescribe motions of a numerical model based on input data received from the measurements of the physical asset 110. In the example of FIG. 1, observations may be made in the real world by physical sensor 115 measurements, which are transferred to the numerical model of the digital twin. To perform the transform, the actuators 124 may be placed on the virtual asset 120 and used to stimulate the virtual asset 120 with motions according to sensor measurements taken from the physical asset 110. Furthermore, the virtual sensors 125 may determine stress and/or damage that occurs to the virtual asset 120 based on the stimulation.
  • According to various embodiments, to establish a simulation-based system monitoring that is performed in real-time, a fast and accurate numerical solver is provided for the simulation model. Sensor measurements on the physical asset 110 can trigger a numerical solver process in the simulation model, updating the state of the virtual asset 120. Hence, the solver process may be as fast as, or faster than, the sensor measurement sampling of the physical sensors 115 to be capable of keeping track with the physical asset 110. Another aspect of the system 100 is the ability to predict structural responses of the physical asset 110 based on future events. For example, by estimating the development of a future load situation, different control decisions can be simulated in advance of the performed actions, evaluating consequences for both power production and structural loading.
  • The system and method described herein may be used to perform real-time based structural analysis of a physical asset based on analysis of a corresponding virtual asset. Data acquired from the physical asset may be fed into the simulation model such as shown in FIG. 1, in real-time. The application software described herein may convert the physical measurements and other data acquired from the real asset into movement data or position data (e.g., rotations, translations, position, acceleration, strain, force, etc.) in the virtual space. In order to stimulate the virtual asset, the application may create input data for the simulation model based on sensor data acquired from the real asset.
  • The physical asset described herein may correspond to a machine or equipment for use in industry, healthcare, manufacture, etc. Examples of assets include a wind turbine, a winch, a crane, a bridge, an oil platform, and the like, which include materials such as metal, concrete, and the like. During processing of the data acquired from the real asset, the application may generate input data for the simulation model (e.g., the virtual asset) during a pre-processing step. In order to generate the input data, the application may determine a beam deformation of the real asset which may be used to identify virtual forces that can be used to drive the simulation model such that it mimics the behavior of the real asset. In some of the examples herein, position and movement data such as accelerometer data from the real asset is used to generate an observable attribute of the virtual asset such as position or movement data for the virtual asset. For example, acceleration data may be used to generate position data in the virtual environment. Although, it should be appreciated that other types of observable attribute data may be generated and applied to the virtual model based on data from the physical asset. Other examples of observable attributes include rotation, translation, acceleration, orientation, a fixed position, strain, force, pressure, sound, and the like. The transformation process uses information about a structure of the real asset to generate a transfer function that transforms the acquired data into the observable attribute or attributes in the virtual environment. Based on the structure of the real asset, a determination of how the structure of the real asset reacts to movement (e.g., measured by accelerometers, motion sensors, etc.) can be mapped into position and movement data in the virtual environment.
  • FIG. 2 illustrates an example of a user interface 200 which enables a user the ability to insert or otherwise attach virtual sensors (e.g., virtual sensor 220) to a virtual model 210 of an asset. For example, a user may move a cursor 230 to a position of the virtual model 210 at which the user desires to add a virtual sensor, and the user may press a selection (e.g., input pad, mouse click, vocal command, etc.) which causes the software to add a virtual sensor 220 to the virtual model 210 of the asset. The addition of the virtual sensor 220 creates position for data to be sensed and output. The virtual sensor 220 may start working immediately after being added to the virtual model 210. The data sensing may include measuring an observable attribute such as position, movement, velocity, strain, pressure, sound, etc., of the virtual model 210 in virtual space. Although not shown, the user interface may also provide a menu that gives the user the ability to determine the type of data (i.e., attribute or attributes) to be sensed, the data format that the data is to be provided in, and other details. In the example of FIG. 2, the von Mises stress is selected as the data to be sensed.
  • The virtual sensor 220 may perform a special kind of readout from the virtual model 210. For example, the virtual sensor 220 (instead of an output from a model) may be referred to as a box which is placed on the object (e.g., virtual asset) being monitored. Upon this placement, a spot on the model is determined at which data is to be extracted from. Here, the placement of the virtual sensor 220 opens a channel to the underlying runtime. Upon opening this channel, the data desired may be selected (e.g., velocity, positions, inclinations, reaction forces, etc.) via a menu of the user interface. The user may also select a frequency at which the data is to be read and the packaging standard that the data should be encapsulated with. The spot at which the virtual sensor 220 is placed may receive a unique identification from the system. Accordingly, any application or device can access the model/sensor using the ID and read this virtual sensor like the application would when reading a physical sensor data stream. The naming of a virtual sensor is more of branding.
  • FIG. 3 illustrates a process of virtual sensors capturing data from a virtual asset in accordance with an example embodiment. Referring to FIG. 3, a virtual asset is simulated in 320 based on asset data sensed in 310. The simulated movement may be performed in 320 based on a physical sensor measurements captured from the real asset in 310. In this example, the sensed movement is captured from a physical sensor disposed on a top of the real asset during the sensed asset movement in 310. However, the virtual asset includes multiple virtual sensors (VS1, VS2, VS3) positioned at different vertical positions of the virtual asset. In the example of FIG. 3, deflection versus angle ratios 330 for three vertical positions on a virtual asset reacting to a concentrated force acting on a tower top of a physical asset are identified and plotted as a graph in 330. In this example, deflection versus angle (Ry) is plotted on the graph 330.
  • The application described herein may also perform analytical estimation of linear acceleration compensation (dynamic factor). When using an accelerometer to measure inclination, one method is to measure the direction of the gravitational pull on the accelerometer. This is used in simpler inclinometer designs as an accelerometer typically has a superior quality to cost ratio. In an accelerated system, measuring the direction of the gravitational pull is not straightforward because it is difficult if not impossible to separate it directly from the total acceleration. However, with some a priori information about the system, the linear acceleration may in certain systems be compensated for.
  • According to various embodiments, the use of virtual sensors can reduce the number of hardware sensors that are needed to measure physical locations on the real asset. As described herein, virtual forces that are created based on the real asset can be applied to the virtual asset enabling virtual sensors to be added on the virtual model at different places than at which physical sensors are located on the real asset. Furthermore, there is no need for maintenance, calibration, expense of paying for physical hardware, etc. with virtual sensors as they do not have a cost associated therewith. As a result, the virtual sensors reduce cost and resources. In the example of the wind turbine, an operator may have access to the very top of the wind turbine in the physical (real) world allowing real sensors to be placed at the to of the turbine. However, the remainder of the wind turbine is difficult to access, especially while in operation. According to various aspects, virtual sensors can be used in any location on the virtual asset that are difficult to access with real sensors on the real, physical asset.
  • Hot spots are points on a virtual structure where virtual sensors (e.g., strain gauges) can be placed based on previous knowledge where damage will likely occur on the physical structure. One of the advantages provided by this method is that new virtual sensors can be positioned at other places on the virtual structure where physical sensors are not present or not capable of being placed on the real structure. In operation, it is desirable to run a wind turbine in strong winds to generate the most energy, but the strong winds create the most stress on the turbine and also the most stress cycles. The example embodiments can be used as an operational tuning to fine tune the balance between damage assessment and energy acquired to find a cost efficient balance between the two such that the wind turbine is not running in conditions that are cost negative from a damage to the wind turbine perspective.
  • FIG. 4 illustrates a method 400 for sensing data from a virtual asset using a virtual sensor in accordance with an example embodiment. For example, the method 400 may be performed by a computing system that hosts a virtual asset. The computing system may include a cloud platform, a server, an industrial computing system, an asset controller, an intervening industrial server, and the like. Referring to FIG. 4, in 410, the method includes executing a virtual model in virtual space. The virtual model may include a digital model of a physical asset located in physical space and may be executed based on sensor data sensed of the physical asset in operation. Here, the sensor data may include raw data received directly from a sensor attached or otherwise associated with the physical asset, or it may include data from an analytic application, or the like, which monitors the operation of the physical asset. According to various aspects, the virtual model may include a three-dimensional (3D) simulation of the physical asset, and an observable attribute being sensed from the virtual asset may correspond to a change in position or a change in state of the 3D simulation in virtual space.
  • In 420, the method includes determining a position of a virtual sensor on a structure of the virtual model. The position of the virtual sensor in virtual space may be determined based on pixel coordinates of the virtual sensor position within a visual interface that is simulating and displaying the virtual asset. The position may include an X coordinate, a Y coordinate, or multiple X coordinates and/or multiple Y coordinates.
  • In some embodiments, the method may further include attaching the virtual sensor to the virtual asset such as to a virtual component which corresponds to a physical component of the physical asset. For example, the method may include displaying the virtual model via a user interface, and detecting a command, via the user interface, for attaching the virtual sensor at a position of a component on the virtual model. The detecting, via the user interface, may also include detecting a selection of a type of data to be sensed by the virtual sensor from among a plurality of types of data such as velocity, inclination, acceleration, reactionary forces, and the like. Physical sensors are often limited in their locations on a physical asset. For example, it may not be possible to embed a physical sensor with a steel beam of a wind turbine. However, the example embodiments provide the ability for embedding the virtual sensor within an interior of the virtual component which is not accessible to a physical sensor on the corresponding physical component of the physical asset. For example, the virtual sensor may be embedded within a steel beam in the virtual space.
  • In 430, the method includes sensing an observable attribute of the virtual model in virtual space at the position of the virtual sensor on the structure of the virtual model, and in 440, transmitting information about the virtually sensed attribute sensed via the virtual sensor to a system associated with the physical asset. For example, the observable attribute of the virtual model in virtual space may correspond to an actual attribute of the physical asset that is observer by mimicking a movement of the physical asset in physical space based on data being fed to the virtual model from the edge including the physical asset. As a non-limiting example, the observable attribute of the virtual asset may include one or more of a movement, a position, a force, a strain, a pressure, a sound, a radiation, and/or the like which may be observed from the virtual model in virtual space. For example, the virtual sensor may be placed on or otherwise attached to a virtual structure of the virtual model. The position may be determined by detecting movement information of a virtual structure of the virtual asset based on transformed and applied virtual position information. For example, the detecting of the movement of the virtual structure of the virtual asset may be performed by one or more virtual sensors that are positioned on the virtual asset. The virtual sensors may detect a change in position (e.g., X axis, Y axis, and Z axis) of structural components of the virtual asset.
  • Although not shown in FIG. 4, in some embodiments the method may further include assigning a unique identifier to the virtual sensor based on the position of the virtual model at which the virtual sensor is attached. The identifier may be a code, a serial number, a tag, etc., which uniquely identifies the sensor and its position on the virtual model. Furthermore, the method may include receiving a request from an application for registering with the virtual sensor based on the unique identifier, and transmitting the virtually sensed movement to the registered application.
  • FIG. 5 illustrates a computing system 500 for sensing data from a virtual asset using a virtual sensor in accordance with an example embodiment. For example, the computing system 500 may be a database, cloud platform, streaming platform, a workstation, an on-premises computing system, and the like. In some embodiments, the computing system 500 may be distributed across multiple devices. Referring to FIG. 5, the computing system 500 includes a network interface 510, a processor 520, an output 530, and a storage device 540 such as a memory. Although not shown in FIG. 5, the computing system 500 may include other components such as a display, an input unit, a receiver, a transmitter, and the like.
  • The network interface 510 may transmit and receive data over a network such as the Internet, a private network, a public network, and the like. The network interface 510 may be a wireless interface, a wired interface, or a combination thereof. The processor 520 may include one or more processing devices each including one or more processing cores. In some examples, the processor 520 is a multicore processor or a plurality of multicore processors. Also, the processor 520 may be fixed or it may be reconfigurable. The output 530 may output data to an embedded display of the computing system 500, an externally connected display, a display connected to the cloud, another device, and the like. The storage device 540 is not limited to a particular storage device and may include any known memory device such as RAM, ROM, hard disk, and the like, and may or may not be included within the cloud environment. The storage 540 may store software modules or other instructions which can be executed by the processor 520 to perform the method 400 shown in FIG. 4.
  • According to various aspects, the network interface 510 may receive sensor data that is sensed in association with an operation of a physical asset in physical space. For example, the sensor data may be received from an edge device such as a device coupled to the asset, an asset control system, an industrial PC, an intervening edge server, and the like. The processor 520 may execute or otherwise run a virtual model in virtual space of the asset. For example, the virtual model may include a digital model or digital representation of the physical asset and may be executed by the processor 520 based on the received sensor data. According to various embodiments, the virtual model may have one or more virtual sensors attached thereto or otherwise associated therewith. The processor 520 may determine a position of a virtual sensor on a structure of the virtual model, sense an observable attribute of the virtual model in virtual space at the position of the virtual sensor on the structure of the virtual model, and transmit information about the virtually sensed attribute to a system (e.g., application, device, network, asset, etc.) associated with the physical asset.
  • In some embodiments, the processor 520 may manage a user interface through which a user can manipulate placement, data sensing types, and the like, of virtual sensors with respect to the virtual asset. For example, the processor 520 may attach a virtual sensor to a virtual component of the virtual model in response to a user command received via the user interface. The virtual sensor may be attached to an exterior of a component of the virtual asset (e.g., the exterior of a beam, stack, flare, etc.). As another example, the processor 520 may embed the virtual sensor within an interior of the virtual component which is not accessible to a physical sensor on the corresponding physical component of the physical asset. Accordingly, the virtual sensor may sense data on the virtual asset that is not capable of being sensed using a physical sensor on the physical asset.
  • In some embodiments, the processor 520 may detect a command, via the user interface, of a selection of a type of data to be sensed by the virtual sensor from among a plurality of types of data. The data types include velocity, movement, displacement, force, and the like. In some embodiments, the processor 520 may assign a unique identifier to the virtual sensor based on the position of the virtual model at which the virtual sensor is attached. For example, the unique identifier may be automatically assigned in response to the user attaching a virtual sensor to the virtual asset via the user interface. Furthermore, a system (e.g., analytic application, device, etc.) may connect to or otherwise link with the virtual sensor by registering with the virtual sensor using the unique identifier. In this example, the processor 520 may receive a request from the requesting system for registering with the virtual sensor based on the unique identifier, register the system for data communication, and transmit the virtually sensed movement to the registered system on a periodic basis, continuous basis, or the like.
  • As will be appreciated based on the foregoing specification, the above-described examples of the disclosure may be implemented using computer programming or engineering techniques including computer software, firmware, hardware or any combination or subset thereof. For example, the methods described herein may be implemented via one or more software applications (e.g., program, application, code, module, service, etc.) executing on one or more computing devices. Any such resulting program, having computer-readable code, may be embodied or provided within one or more non transitory computer-readable media, thereby making a computer program product, i.e., an article of manufacture, according to the discussed examples of the disclosure. For example, the non-transitory computer-readable media may be, but is not limited to, a fixed drive, diskette, optical disk, magnetic tape, flash memory, semiconductor memory such as read-only memory (ROM), and/or any transmitting/receiving medium such as the Internet, cloud storage, the internet of things, or other communication network or link. The article of manufacture containing the computer code may be made and/or used by executing the code directly from one medium, by copying the code from one medium to another medium, or by transmitting the code over a network.
  • The computer programs (also referred to as programs, software, software applications, “apps”, or code) may include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms “machine-readable medium” and “computer-readable medium” refer to any computer program product, apparatus, cloud storage, internet of things, and/or device (e.g., magnetic discs, optical disks, memory, programmable logic devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The “machine-readable medium” and “computer-readable medium,” however, do not include transitory signals. The term “machine-readable signal” refers to any signal that may be used to provide machine instructions and/or any other kind of data to a programmable processor.
  • The above descriptions and illustrations of processes herein should not be considered to imply a fixed order for performing the process steps. Rather, the process steps may be performed in any order that is practicable, including simultaneous performance of at least some steps. Although the disclosure has been described in connection with specific examples, it should be understood that various changes, substitutions, and alterations apparent to those skilled in the art can be made to the disclosed embodiments without departing from the spirit and scope of the disclosure as set forth in the appended claims.

Claims (20)

What is claimed is:
1. A computing system comprising:
a network interface configured to receive sensor data that is sensed in association with an operation of a physical asset in physical space; and
a processor configured to execute a virtual model in virtual space, the virtual model comprising a digital model of the physical asset and being executed based on the received sensor data, wherein the processor is further configured to determine a position of a virtual sensor on a structure of the virtual model, sense an observable attribute of the virtual model in virtual space at the position of the virtual sensor on the structure of the virtual model, the observable attribute of the virtual model in virtual space corresponding to an actual attribute of the physical asset in physical space, and transmit information about the virtually sensed attribute sensed via the virtual sensor to a system associated with the physical asset.
2. The computing system of claim 1, wherein the virtual model comprises a three-dimensional (3D) simulation of the physical asset.
3. The computing system of claim 1, wherein the processor is further configured to attach the virtual sensor to a virtual component of the virtual model which corresponds to a physical component of the physical asset.
4. The computing system of claim 3, wherein the processor is configured to embed virtual sensor within an interior of the virtual component which is not accessible to a physical sensor on the corresponding physical component of the physical asset.
5. The computing system of claim 1, wherein the observable attribute sensed by the virtual sensor comprises one or more of a movement, a force, a strain, a pressure, a sound, and a radiation, observed from the virtual model in virtual space.
6. The computing system of claim 1, wherein the processor is further configured to output the virtual model for display via a user interface, and detect a command, via the user interface, for attaching the virtual sensor at the position on the virtual model.
7. The computing system of claim 6, wherein the processor is further configured to detect, via the user interface, a selection of a type of data to be sensed by the virtual sensor from among a plurality of types of data.
8. The computing system of claim 1, wherein the processor is further configured to assign a unique identifier to the virtual sensor based on the position of the virtual model at which the virtual sensor is attached.
9. The computing system of claim 8, wherein the processor is further configured to receive a request from an application for registering with the virtual sensor based on the unique identifier, and transmit the virtually sensed movement to the registered application.
10. A computer-implemented method comprising:
executing a virtual model in virtual space, the virtual model comprising a digital model of a physical asset located in physical space and being executed based on sensor data sensed of an operation of the physical asset;
determining a position of a virtual sensor on a structure of the virtual model;
sensing an observable attribute of the virtual model in virtual space at the position of the virtual sensor on the structure of the virtual model, the observable of the virtual model in virtual space corresponding to an actual attribute of the physical asset in physical space; and
transmitting information about the virtually sensed attribute sensed via the virtual sensor to a system associated with the physical asset.
11. The computer-implemented method of claim 10, wherein the virtual model comprises a three-dimensional (3D) simulation of the physical asset.
12. The computer-implemented method of claim 10, wherein the method further comprises attaching the virtual sensor to a virtual component of the virtual model which corresponds to a physical component of the physical asset.
13. The computer-implemented method of claim 12, wherein the method further comprises embedding the virtual sensor within an interior of the virtual component which is not accessible to a physical sensor on the corresponding physical component of the physical asset.
14. The computer-implemented method of claim 10, wherein the sensing of the observable attribute comprises sensing one or more of a movement, a force, a strain, a pressure, a sound, and a radiation, observed from the virtual model in virtual space.
15. The computer-implemented method of claim 10, further comprising displaying the virtual model via a user interface, and detecting a command, via the user interface, for attaching the virtual sensor at the position on the virtual model.
16. The computer-implemented method of claim 15, further comprising detecting, via the user interface, a selection of a type of data to be sensed by the virtual sensor from among a plurality of types of data.
17. The computer-implemented method of claim 10, further comprising assigning a unique identifier to the virtual sensor based on the position of the virtual model at which the virtual sensor is attached.
18. The computer-implemented method of claim 17, further comprising receiving a request from an application for registering with the virtual sensor based on the unique identifier, and transmitting the virtually sensed movement to the registered application.
19. A non-transitory computer readable medium having stored therein instructions that when executed cause a computer to perform a method comprising:
executing a virtual model in virtual space, the virtual model comprising a digital model of a physical asset located in physical space and being executed based on sensor data sensed of an operation of the physical asset;
determining a position of a virtual sensor on a structure of the virtual model;
sensing an observable attribute of the virtual model in virtual space at the position of the virtual sensor on the structure of the virtual model, the observable of the virtual model in virtual space corresponding to an actual attribute of the physical asset in physical space; and
transmitting information about the virtually sensed attribute sensed via the virtual sensor to a system associated with the physical asset.
20. The non-transitory computer-readable medium of claim 19, wherein the virtual model comprises a three-dimensional (3D) simulation of the physical asset, and the observable attribute comprises one or more of a movement, a force, a strain, a pressure, a sound, and a radiation, observed from the virtual model in virtual space.
US15/848,480 2017-01-13 2017-12-20 Virtual sensor for virtual asset Abandoned US20180203959A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/848,480 US20180203959A1 (en) 2017-01-13 2017-12-20 Virtual sensor for virtual asset

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762446033P 2017-01-13 2017-01-13
US201762446374P 2017-01-14 2017-01-14
US15/848,480 US20180203959A1 (en) 2017-01-13 2017-12-20 Virtual sensor for virtual asset

Publications (1)

Publication Number Publication Date
US20180203959A1 true US20180203959A1 (en) 2018-07-19

Family

ID=62840763

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/589,099 Active 2037-11-10 US10691847B2 (en) 2017-01-13 2017-05-08 Real-time damage determination of an asset
US15/848,480 Abandoned US20180203959A1 (en) 2017-01-13 2017-12-20 Virtual sensor for virtual asset

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US15/589,099 Active 2037-11-10 US10691847B2 (en) 2017-01-13 2017-05-08 Real-time damage determination of an asset

Country Status (1)

Country Link
US (2) US10691847B2 (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180302331A1 (en) * 2017-04-12 2018-10-18 General Electric Company Time-sensitive networking differentiation of traffic based upon content
US10814893B2 (en) 2016-03-21 2020-10-27 Ge Global Sourcing Llc Vehicle control system
JPWO2020246032A1 (en) * 2019-06-07 2020-12-10
CN112991742A (en) * 2021-04-21 2021-06-18 四川见山科技有限责任公司 Visual simulation method and system for real-time traffic data
US11072356B2 (en) 2016-06-30 2021-07-27 Transportation Ip Holdings, Llc Vehicle control system
CN113312730A (en) * 2021-06-25 2021-08-27 内蒙古京泰发电有限责任公司 Double-drive steam turbine rotor stress monitoring method
US11210537B2 (en) 2018-02-18 2021-12-28 Nvidia Corporation Object detection and detection confidence suitable for autonomous driving
US11308338B2 (en) 2018-12-28 2022-04-19 Nvidia Corporation Distance to obstacle detection in autonomous machine applications
US11307135B2 (en) * 2019-04-30 2022-04-19 Fabreeka International Holdings, Inc. Bearing pad
US20220198390A1 (en) * 2020-12-17 2022-06-23 International Business Machines Corporation Providing digital twin assets based off of work orders
US11436484B2 (en) * 2018-03-27 2022-09-06 Nvidia Corporation Training, testing, and verifying autonomous machines using simulated environments
US11520345B2 (en) 2019-02-05 2022-12-06 Nvidia Corporation Path perception diversity and redundancy in autonomous machine applications
US11537139B2 (en) 2018-03-15 2022-12-27 Nvidia Corporation Determining drivable free-space for autonomous vehicles
US11604470B2 (en) 2018-02-02 2023-03-14 Nvidia Corporation Safety procedure analysis for obstacle avoidance in autonomous vehicles
US11604967B2 (en) 2018-03-21 2023-03-14 Nvidia Corporation Stereo depth estimation using deep neural networks
US11610115B2 (en) 2018-11-16 2023-03-21 Nvidia Corporation Learning to generate synthetic datasets for training neural networks
US11648945B2 (en) 2019-03-11 2023-05-16 Nvidia Corporation Intersection detection and classification in autonomous machine applications
US11676364B2 (en) 2018-02-27 2023-06-13 Nvidia Corporation Real-time detection of lanes and boundaries by autonomous vehicles
US11694094B2 (en) 2018-03-21 2023-07-04 Swim.IT Inc Inferring digital twins from captured data
US11698272B2 (en) 2019-08-31 2023-07-11 Nvidia Corporation Map creation and localization for autonomous driving applications
US11704890B2 (en) 2018-12-28 2023-07-18 Nvidia Corporation Distance to obstacle detection in autonomous machine applications
US11769052B2 (en) 2018-12-28 2023-09-26 Nvidia Corporation Distance estimation to objects and free-space boundaries in autonomous machine applications
US11966838B2 (en) 2018-06-19 2024-04-23 Nvidia Corporation Behavior-guided path planning in autonomous machine applications
US11978266B2 (en) 2020-10-21 2024-05-07 Nvidia Corporation Occupant attentiveness and cognitive load monitoring for autonomous and semi-autonomous driving applications

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190138970A1 (en) * 2017-11-07 2019-05-09 General Electric Company Contextual digital twin
US11354615B2 (en) * 2017-11-21 2022-06-07 International Business Machines Corporation Blockchain-implemented digital agreement management for digital twin assets
US11676098B2 (en) * 2017-11-21 2023-06-13 International Business Machines Corporation Digital twin management in IoT systems
US11348120B2 (en) 2017-11-21 2022-05-31 International Business Machines Corporation Digital agreement management on digital twin ownership change
US20220042875A1 (en) * 2020-08-04 2022-02-10 Palo Alto Research Center Incorporated Methods and systems for damage evaluation of structural assets
CN114510768A (en) * 2022-02-25 2022-05-17 山东大学 Steel pipe concrete arch bridge construction monitoring method and system based on digital twinning

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090063087A1 (en) * 2007-08-31 2009-03-05 Caterpillar Inc. Virtual sensor based control system and method
WO2009047061A1 (en) * 2007-10-12 2009-04-16 Siemens Aktiengesellschaft Method and device for providing at least one input sensor signal for a control and/or monitoring application and control device
US20130275059A1 (en) * 2012-04-17 2013-10-17 Sikorsky Aircraft Corporation Hybrid virtual load monitoring system and method
US20140013339A1 (en) * 2012-07-09 2014-01-09 Electronics And Telecommunications Research Institute Apparatus and method for generating virtual sensor in sensor network
US20140025337A1 (en) * 2012-07-18 2014-01-23 International Business Machines Corporation Sensor Virtualization through Cloud Storage and Retrieval Mechanisms
US20140058709A1 (en) * 2011-02-28 2014-02-27 Critical Materials, Lda. Structural health management system and method based on combined physical and simulated data
US20160098501A1 (en) * 2014-10-06 2016-04-07 Ptc Inc. Virtual sensors supported by a computer aided design (cad) model and software
US20160189493A1 (en) * 2014-12-29 2016-06-30 Immersion Corporation Virtual sensor in a virtual environment
US20160237804A1 (en) * 2004-06-14 2016-08-18 Stylianos Papadimitriou Stress engineering assessment of risers and riser strings
US20160328883A1 (en) * 2015-05-05 2016-11-10 PTC, Inc. Augmented reality system
US20160378089A1 (en) * 2015-06-24 2016-12-29 Siemens Aktiengesellschaft Logical Position Sensor
US20170286572A1 (en) * 2016-03-31 2017-10-05 General Electric Company Digital twin of twinned physical system
US20170369127A1 (en) * 2014-12-30 2017-12-28 Centro Per Gli Studi Di Tecnica Navale - Cetena S.P.A. Structural monitoring system of the hull of a ship integrated with a navigation decision support system
US20180054376A1 (en) * 2016-08-22 2018-02-22 General Electric Company Internet of things associate
US20180203949A1 (en) * 2017-01-13 2018-07-19 Fedem Technology As Data transformation for a virtual asset
US20180275044A1 (en) * 2015-09-25 2018-09-27 Sikorsky Aircraft Corporation System and method for load-based structural health monitoring of a dynamical system
US20190017248A1 (en) * 2016-03-31 2019-01-17 Sumitomo Heavy Industries, Ltd. Excavator
US20190228777A1 (en) * 2004-06-14 2019-07-25 Wanda Papadimitriou Stress engineering assessment of risers and riser strings

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5754122A (en) * 1993-07-19 1998-05-19 Competitive Technologies, Inc. System and method for monitoring structures
JP3188838B2 (en) * 1996-03-28 2001-07-16 株式会社福岡機器製作所 Data collection device for fatigue analysis by rainflow method
US7243042B2 (en) * 2004-11-30 2007-07-10 Siemens Power Generation, Inc. Engine component life monitoring system and method for determining remaining useful component life
US8116990B2 (en) * 2007-10-19 2012-02-14 Ashok Koul Method and system for real-time prognosis analysis and usage based residual life assessment of turbine engine components and display
US8521443B2 (en) * 2008-10-16 2013-08-27 Oxfordian Method to extract parameters from in-situ monitored signals for prognostics
FR2938648B1 (en) * 2008-11-17 2012-03-16 Eads Europ Aeronautic Defence METHOD FOR EVALUATING THE AGING OF AN ELECTRONIC ASSEMBLY
CA2689744C (en) * 2009-01-08 2015-05-05 New Flyer Industries Canada Ulc System and method for monitoring operation of vehicles
EP2637010B1 (en) * 2012-03-05 2015-06-24 EADS Construcciones Aeronauticas, S.A. Method and system for monitoring a structure
US20140324377A1 (en) * 2013-04-30 2014-10-30 GM Global Technology Operations LLC Methods and systems of making fatigue block cycle test specifications for components and/or subsystems
EP2803968B1 (en) * 2013-05-13 2019-05-08 Siemens Industry Software NV A process for calculating fatigue and fatigue failure of structures
EP2821873B1 (en) * 2013-07-02 2016-10-05 Bell Helicopter Textron Inc. System and method of monitoring usage of a component in a helicopter by using torque measurements
DE102013215157B3 (en) * 2013-08-01 2014-10-30 Siemens Aktiengesellschaft Method for active or passive vibration damping
US10458342B2 (en) * 2013-09-17 2019-10-29 General Electric Company System and method for controlling operation of a gas turbine based power plant
US20150159867A1 (en) * 2013-12-05 2015-06-11 General Electric Company System and Method for Assessing Combustor Health During Operation
JP6215446B2 (en) * 2014-03-03 2017-10-18 株式会社日立製作所 Method of displaying material fatigue of machine and apparatus therefor
US9771880B2 (en) * 2014-05-16 2017-09-26 Fca Us Llc Real-time vehicle data acquisition and analysis
US10908048B2 (en) * 2015-05-14 2021-02-02 Kcf Technologies, Inc. Machine health monitoring system and method
US10683844B2 (en) * 2015-05-27 2020-06-16 Vestas Wind Systems A/S Control of a wind turbine taking fatigue measure into account
DK201570560A1 (en) * 2015-08-28 2017-03-27 Vestas Wind Sys As Wind Turbine Control Over-ride
US10422319B2 (en) * 2015-06-30 2019-09-24 Vestas Wind Systems A/S Control method and system for wind turbines
GB2545158B (en) * 2015-10-09 2019-07-03 Imperial Innovations Ltd Monitoring Fluid Dynamics
JP6693198B2 (en) * 2016-03-18 2020-05-13 株式会社Ihi Abnormality determination device and abnormality determination method
CN107238761A (en) * 2016-03-28 2017-10-10 通用电气公司 Switching amplifier, gradient amplifier and the method for estimating switching amplifier residual life
US10378426B2 (en) * 2016-12-16 2019-08-13 Caterpillar Inc. Useful life prediction system for cooling components

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160237804A1 (en) * 2004-06-14 2016-08-18 Stylianos Papadimitriou Stress engineering assessment of risers and riser strings
US20190228777A1 (en) * 2004-06-14 2019-07-25 Wanda Papadimitriou Stress engineering assessment of risers and riser strings
US20090063087A1 (en) * 2007-08-31 2009-03-05 Caterpillar Inc. Virtual sensor based control system and method
WO2009047061A1 (en) * 2007-10-12 2009-04-16 Siemens Aktiengesellschaft Method and device for providing at least one input sensor signal for a control and/or monitoring application and control device
US20140058709A1 (en) * 2011-02-28 2014-02-27 Critical Materials, Lda. Structural health management system and method based on combined physical and simulated data
US20130275059A1 (en) * 2012-04-17 2013-10-17 Sikorsky Aircraft Corporation Hybrid virtual load monitoring system and method
US20140013339A1 (en) * 2012-07-09 2014-01-09 Electronics And Telecommunications Research Institute Apparatus and method for generating virtual sensor in sensor network
US20140025337A1 (en) * 2012-07-18 2014-01-23 International Business Machines Corporation Sensor Virtualization through Cloud Storage and Retrieval Mechanisms
US20160098501A1 (en) * 2014-10-06 2016-04-07 Ptc Inc. Virtual sensors supported by a computer aided design (cad) model and software
US20160189493A1 (en) * 2014-12-29 2016-06-30 Immersion Corporation Virtual sensor in a virtual environment
US20170369127A1 (en) * 2014-12-30 2017-12-28 Centro Per Gli Studi Di Tecnica Navale - Cetena S.P.A. Structural monitoring system of the hull of a ship integrated with a navigation decision support system
US20160328883A1 (en) * 2015-05-05 2016-11-10 PTC, Inc. Augmented reality system
US20160378089A1 (en) * 2015-06-24 2016-12-29 Siemens Aktiengesellschaft Logical Position Sensor
US20180275044A1 (en) * 2015-09-25 2018-09-27 Sikorsky Aircraft Corporation System and method for load-based structural health monitoring of a dynamical system
US20170286572A1 (en) * 2016-03-31 2017-10-05 General Electric Company Digital twin of twinned physical system
US20190017248A1 (en) * 2016-03-31 2019-01-17 Sumitomo Heavy Industries, Ltd. Excavator
US20180054376A1 (en) * 2016-08-22 2018-02-22 General Electric Company Internet of things associate
US20180203949A1 (en) * 2017-01-13 2018-07-19 Fedem Technology As Data transformation for a virtual asset

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10814893B2 (en) 2016-03-21 2020-10-27 Ge Global Sourcing Llc Vehicle control system
US11072356B2 (en) 2016-06-30 2021-07-27 Transportation Ip Holdings, Llc Vehicle control system
US10447606B2 (en) * 2017-04-12 2019-10-15 General Electric Company Time-sensitive networking differentiation of traffic based upon content
US20180302331A1 (en) * 2017-04-12 2018-10-18 General Electric Company Time-sensitive networking differentiation of traffic based upon content
US11604470B2 (en) 2018-02-02 2023-03-14 Nvidia Corporation Safety procedure analysis for obstacle avoidance in autonomous vehicles
US11966228B2 (en) 2018-02-02 2024-04-23 Nvidia Corporation Safety procedure analysis for obstacle avoidance in autonomous vehicles
US11210537B2 (en) 2018-02-18 2021-12-28 Nvidia Corporation Object detection and detection confidence suitable for autonomous driving
US11676364B2 (en) 2018-02-27 2023-06-13 Nvidia Corporation Real-time detection of lanes and boundaries by autonomous vehicles
US11941873B2 (en) 2018-03-15 2024-03-26 Nvidia Corporation Determining drivable free-space for autonomous vehicles
US11537139B2 (en) 2018-03-15 2022-12-27 Nvidia Corporation Determining drivable free-space for autonomous vehicles
US11694094B2 (en) 2018-03-21 2023-07-04 Swim.IT Inc Inferring digital twins from captured data
US11604967B2 (en) 2018-03-21 2023-03-14 Nvidia Corporation Stereo depth estimation using deep neural networks
US11436484B2 (en) * 2018-03-27 2022-09-06 Nvidia Corporation Training, testing, and verifying autonomous machines using simulated environments
US11966838B2 (en) 2018-06-19 2024-04-23 Nvidia Corporation Behavior-guided path planning in autonomous machine applications
US11610115B2 (en) 2018-11-16 2023-03-21 Nvidia Corporation Learning to generate synthetic datasets for training neural networks
US11308338B2 (en) 2018-12-28 2022-04-19 Nvidia Corporation Distance to obstacle detection in autonomous machine applications
US11704890B2 (en) 2018-12-28 2023-07-18 Nvidia Corporation Distance to obstacle detection in autonomous machine applications
US11790230B2 (en) 2018-12-28 2023-10-17 Nvidia Corporation Distance to obstacle detection in autonomous machine applications
US11769052B2 (en) 2018-12-28 2023-09-26 Nvidia Corporation Distance estimation to objects and free-space boundaries in autonomous machine applications
US11520345B2 (en) 2019-02-05 2022-12-06 Nvidia Corporation Path perception diversity and redundancy in autonomous machine applications
US11897471B2 (en) 2019-03-11 2024-02-13 Nvidia Corporation Intersection detection and classification in autonomous machine applications
US11648945B2 (en) 2019-03-11 2023-05-16 Nvidia Corporation Intersection detection and classification in autonomous machine applications
US11307135B2 (en) * 2019-04-30 2022-04-19 Fabreeka International Holdings, Inc. Bearing pad
JP7384201B2 (en) 2019-06-07 2023-11-21 日本電信電話株式会社 Digital twin calculation device, digital twin calculation method and program
JPWO2020246032A1 (en) * 2019-06-07 2020-12-10
US11698272B2 (en) 2019-08-31 2023-07-11 Nvidia Corporation Map creation and localization for autonomous driving applications
US11713978B2 (en) 2019-08-31 2023-08-01 Nvidia Corporation Map creation and localization for autonomous driving applications
US11788861B2 (en) 2019-08-31 2023-10-17 Nvidia Corporation Map creation and localization for autonomous driving applications
US11978266B2 (en) 2020-10-21 2024-05-07 Nvidia Corporation Occupant attentiveness and cognitive load monitoring for autonomous and semi-autonomous driving applications
US11687879B2 (en) * 2020-12-17 2023-06-27 International Business Machines Corporation Providing digital twin assets based off of work orders
US20220198390A1 (en) * 2020-12-17 2022-06-23 International Business Machines Corporation Providing digital twin assets based off of work orders
CN112991742A (en) * 2021-04-21 2021-06-18 四川见山科技有限责任公司 Visual simulation method and system for real-time traffic data
CN113312730A (en) * 2021-06-25 2021-08-27 内蒙古京泰发电有限责任公司 Double-drive steam turbine rotor stress monitoring method

Also Published As

Publication number Publication date
US10691847B2 (en) 2020-06-23
US20180202892A1 (en) 2018-07-19

Similar Documents

Publication Publication Date Title
US20180203959A1 (en) Virtual sensor for virtual asset
JP6743657B2 (en) Patrol inspection system, patrol inspection device, patrol inspection method, program, and recording medium
EP3348983B1 (en) Data transformation for a virtual asset
Lee et al. Gage‐free stress estimation of a beam‐like structure based on terrestrial laser scanning
CN105045950A (en) Three-dimensional laser scan based bridge safety evaluation system
Martinez et al. Intelligent vision-based online inspection system of screw-fastening operations in light-gauge steel frame manufacturing
US20190155271A1 (en) Determining a change in asset performance using a digital twin
Natephra et al. BIM-based live sensor data visualization using virtual reality for monitoring indoor conditions
Mongelli et al. Quasi real-time FEM calibration by 3D displacement measurements of large shaking table tests using HPC resources
KR20150041590A (en) Methods and systems for dynamic workflow prioritization and tasking
CN107368463A (en) Tunnel nonlinear deformation Forecasting Methodology based on optical fiber grating sensing network data
Liu et al. A digital twin-based framework for simulation and monitoring analysis of floating wind turbine structures
CN114693114A (en) Monitoring method and device for underground space structure, computer equipment and storage medium
US20200160208A1 (en) Model sharing among edge devices
Davila Delgado et al. Modelling, management, and visualisation of structural performance monitoring data on BIM
Liu et al. Dynamical measurement system for wind turbine fatigue load
CN108445777A (en) The data conversion of fictitious assets
Johansen On developing a digital twin for fault detection in drivetrains of offshore wind turbines
Ayala-Chauvin et al. IoT Monitoring for Real-Time Control of Industrial Processes
Fu et al. Digital twin-driven smelting process management method for converter steelmaking
KR101309900B1 (en) Virtual factory system for industrial steel having fuctions of equipment analysis and control algorithm verification, and method for controlling thereof
Li et al. General Tikhonov regularization‐based load estimation of bridges considering the computer vision‐extracted prior information
US20210002004A1 (en) Automatic digital data feedback and utilization in aircraft part lifecycle
Dasari et al. An Exploratory Study on the Integration of Digital BIM and IOT in Structural Health Monitoring Practices
WO2021046847A1 (en) Method for designing anti-seismic support and hanger for building on the basis of three-dimensional model-simulation experimental data coupling

Legal Events

Date Code Title Description
AS Assignment

Owner name: FEDEM TECHNOLOGY AS, NORWAY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:REFSNAES, RUNAR HEGGLIEN;HAGEN, ARNULF;VASKINN, ASLE HEIDE;AND OTHERS;REEL/FRAME:044448/0049

Effective date: 20171220

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION