WO2019216941A1 - Inférence de qualité à partir de jumeaux numériques vivants dans des systèmes de fabrication activés par l'ido - Google Patents

Inférence de qualité à partir de jumeaux numériques vivants dans des systèmes de fabrication activés par l'ido Download PDF

Info

Publication number
WO2019216941A1
WO2019216941A1 PCT/US2018/049132 US2018049132W WO2019216941A1 WO 2019216941 A1 WO2019216941 A1 WO 2019216941A1 US 2018049132 W US2018049132 W US 2018049132W WO 2019216941 A1 WO2019216941 A1 WO 2019216941A1
Authority
WO
WIPO (PCT)
Prior art keywords
parameters
digital twin
new feature
twin
product
Prior art date
Application number
PCT/US2018/049132
Other languages
English (en)
Inventor
Sujit Rokka CHHETRI
Mohammad Abdullah Al Faruque
Arquimedes Martinez Canedo
Original Assignee
Siemens Corporation
The Regents Of The University Of California
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens Corporation, The Regents Of The University Of California filed Critical Siemens Corporation
Publication of WO2019216941A1 publication Critical patent/WO2019216941A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/243—Classification techniques relating to the number of classes
    • G06F18/2433—Single-class perspective, e.g. one-against-all classification; Novelty detection; Outlier detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques

Definitions

  • the present invention relates generally to methods, systems, and apparatuses related to a methodology for building Digital Twin of manufacturing systems from the Internet of Things (IoT) enabled sensors.
  • IoT Internet of Things
  • the methodologies described herein may be applied, for example, to perform quality inference and fault localization in various manufacturing environments.
  • a Digital Twin is the digital representation of a physical system.
  • a typical Digital Twin comprises data and models generated throughout the lifecycle of a system. Building a Digital Twin begins long before the physical system even exists in the real world and ends long after the system ceases to exist.
  • the Digital Twin provides an as- designed blueprint of the system consisting of requirements, conceptual designs, simulations, and system models.
  • the Digital Twin provides an as-produced view of the individual instances of the system consisting of their unique properties such as manufacturing data.
  • the Digital Twin provides an as-operated view of the individual instances of the system from insights generated from sensor data, service records, logs, etc.
  • the narrative of the Digital Twin is usually told chronologically from the beginning to the end, the most powerful aspect in the Digital Twin concept are the feedback loops that arise when the different views are compared.
  • the system operation can be optimized by analyzing how the system is currently operating (as-operated) against how it should be operating (as- designed).
  • the time-to-market of subsequent system instances can be accelerated by analyzing how previous instances were manufactured (as-manufactured) and deviate from the designed (as-designed).
  • Digital Twin is expected to play an important role in the next industrial revolution (Industry 4.0).
  • Digitalization is transforming the manufacturing industry. Government organizations (e.g., NASA, the Air Force, etc.) and businesses like SiemensTM are currently building Digital Twins of gas turbines, wind turbines, engines, and airplanes that allow them to manage the assets, optimize the system and fleets, and to monitor the system health and provide prognostics.
  • the concept of the Digital Twin was first used by NASA to describe a digital replica of physical systems in space maintained for diagnosis and prognosis.
  • a key enabler for creating a Digital Twin is the availability of a large number of built-in sensors and their historical data. Previously, due to the lack of cheap sensors and high-speed and reliable network, acquiring the data for the Digital Twin was costly.
  • IoT Internet-of-Things
  • the present invention describes a systems, methods, and apparatuses that perform quality inference from living Digital Twins in IoT-enabled manufacturing systems.
  • methodology described herein constructs a living Digital Twin of the manufacturing system by utilizing various IoT sensors (e.g., acoustic, vibration, magnetic, and/or power sensors). Based on these signals, a clustering algorithm is used to generate a fingerprint library that effectively represents the physical status or the Physical Twin of the system.
  • the Digital Twin is used for localizing the anomalous physical emissions that have the potential of resulting in key performance indicator (KPI) variation.
  • KPI key performance indicator
  • some embodiments of the present invention employ an algorithm for updating the Digital Twin, and inferring the KPI deviation.
  • the methodology described herein is able to update itself, infer KPI deviation and localize anomalous faults in the manufacturing system.
  • a method for quality inference in an Internet of things (IoT)-enabled manufacturing system includes generating a fingerprint library comprising a plurality of fingerprints. Each fingerprint corresponds to a digital twin of a product and comprises (i) a plurality of stored feature clusters; and (ii) a stored silhouette coefficient for each feature cluster.
  • Sensor values are collected from a plurality of IoT sensors monitoring a physical twin of the manufacturing system. New feature values are extracted from the sensor values. Parameters defining the digital twin of the product are identified, and the new feature values are segmented into new feature subgroups based on the parameters.
  • an anomaly detection process is performed that includes estimating new feature clusters for the new feature subgroups using the fingerprint library.
  • a current silhouette coefficient is determined for each new feature cluster. If the current silhouette coefficient for a new feature cluster deviates from a corresponding stored silhouette coefficient, the parameters of the digital twin of the product corresponding to the new feature cluster are identified. Additionally, the parameters are designated as being potentially anomalous. An alert may then be provided to one or more users identifying the parameters of the digital twin designated as being potentially anomalous. For example, in one embodiment, the alert is presented on a human machine interface (HMI) or other display. Alternatively, rather than providing an alert, a record may be created (e.g., in a log file or a database) indicating the potentially anomalous parameters.
  • HMI human machine interface
  • an article of manufacture for quality inference in an IoT-enabled manufacturing system comprises a non-transitory, tangible computer- readable medium holding computer-executable instructions for performing the method discussed above.
  • a system for quality inference in an IoT-enabled manufacturing system includes a database, IoT sensors, and a computing system comprising one or more processors.
  • the database stores a fingerprint library.
  • the IoT sensors generate sensor values corresponding to a physical twin of the manufacturing system.
  • the processors of the computing system extract new feature values from sensor values, identify parameters defining the digital twin of the product, and segment the new feature values are segmented into new feature subgroups based on the parameters.
  • the processors then perform anomaly detection process to determine whether the parameters of the digital twin are potentially anomalous. If the parameters are potentially anomalous, a record is created or an alert is provided to a user.
  • FIG. 1 shows an example Digital Twin for manufacturing, according to some embodiments
  • FIG. 2 shows a Digital Twin modeling methodology that may be used in some embodiments
  • FIG. 3 presents an algorithm for fingerprint library generation for a Digital Twin that may be used in some embodiments
  • FIG. 4 presents an algorithm for localizing deviation and checking for Digital Twin updating that may be used in some embodiments
  • FIG. 5 shows an experimental setup for modeling a Digital Twin
  • FIG. 6 presents an experimental setup for sensor position exploration
  • FIG. 7 shows classification accuracy score for various sensor positions
  • FIG. 8 shows scatter plots of clusters plotted with the first two principal components of the features for five clusters; [0010] FIG. 9 presents the silhouette coefficient of various clustering algorithms that may be used in different embodiments of the present invention.
  • FIG. 10 shows a test DTobject created using a CAD tool for checking anomaly localization capability of a Digital Twin
  • FIG. 11 shows example average receiver operating characteristic (ROC) curves for anomaly localization through four sensor data
  • FIG. 12 illustrates the accuracy of the Digital Twin's anomaly localization for each channel
  • FIG. 13 presents degradation test result for the Digital Twin
  • FIG. 14 shows the accuracy of the Digital Twin's KPI inference model
  • FIG. 15 presents a qualitative comparative study of various methods compared to the methodology employed by various embodiments of the present invention.
  • FIG. 16 illustrates an exemplary computing environment which may execute an application for performing quality inference from living digital twins in IoT-enabled manufacturing systems, according to some embodiments.
  • the following disclosure describes the present invention according to several embodiments directed at methods, systems, and apparatuses related to modeling and maintaining a living Digital Twin of a manufacturing system using off-the-shelf multi-sensors in Internet-of- Things (IoT) devices.
  • IoT Internet-of- Things
  • the methodology described herein is able to update itself and improve its fault localization and inferring dimensional tolerances.
  • FIG. 1 illustrates a framework 100 for applying digital twins to manufacturing applications, according to some embodiments.
  • the Digital Twin of the product DTobject starts its lifecycle in the design phase, where computer aided design and computer aided manufacturing tools are used to represent the product in the cyber-domain.
  • These product Digital Twins from design phase (Xi) then go through the production, where the Physical Twin of the system PTsystem takes raw materials, energy, and the DTobject to create its corresponding Physical Twins (Yi).
  • the Physical Twin of the system PTsystem maybe represented as a Cyber- Physical System (CPS), which comprises cyber-domain computing processes and physical domain components that communicate through a network.
  • CPS Cyber- Physical System
  • the cyber domain of the manufacturing system reacts in a deterministic manner corresponding to the product Digital Twin, for simplicity we consider combination of cyber and physical domain as the PTsystem.
  • the PTsystem is influenced by the manufacturing environment in a stochastic manner.
  • ⁇ object ⁇ represent the parameters that define the Digital Twin of the product (e.g., dimension, surface roughness, mechanical strength etc.), R ⁇ system— - , b h ⁇ n € L>o,/> € S. represent the parameters of the product
  • the framework 100 shown in FIG. 1 captures the interaction between these parameters using one or more IoT sensors.
  • a stochastic function /(. ) is modeled that performs three tasks.
  • the deviation in the DTobject parameter is localized from its Physical Twin PTobject.
  • the DTsystem is confirmed to be up-to-date (i.e., alive).
  • the Key Performance Indicator (KPI) deviation is inferred for the DTobject before creating the PTobject.
  • the DTobject may interrogate the DTsystem to infer about tolerance deviation due to the current status of the PTsystem.
  • KPI Key Performance Indicator
  • the manufacturing system comprises cyber and the physical domain.
  • the computing components in the cyber-domain have processes that communicate with the physical domain.
  • a cross-domain signal that is passed from the cyber-domain to the physical-domain has the possibility of impacting the physical domain characteristics. This phenomenon is more prominent in manufacturing system where the Digital Twin of the product causes the Physical Twin of the system to behave in a certain deterministic manner.
  • there exist physical emissions e.g., acoustic, vibration, magnetic, etc.
  • these emissions e.g., acoustic, vibration, magnetic, etc.
  • Equations 1 -4 represent the analog emissions as a result of deterministic function d(.) which is influenced by the Digital Twin parameters of the product DTobject and the Physical Twin parameters of the System PTsystem, and the non-deterministic environmental parameters E system. Moreover, for each of the analog emissions, the total number of parameters (a,b,g) may not be same.
  • non-trivial simulation based approach such as finite element analysis is utilized to model the deterministic part and explore relation between the DTobject, PTobject, and PTsystem.
  • the PTsystem parameters vary over time, and Esystem parameters affect the PTobject in a stochastic manner.
  • IoT sensors we explore the possibility of using IoT sensors to model and maintain a live DTsystem for product quality control.
  • the Digital Twin can be used for various purposes. As one example, the paragraphs that follow demonstrate that by maintaining a living Digital Twin once can infer about the possible deviation in quality of the product.
  • One of the Key Performance Indicator (KPI) that is utilized is the dimension (Kd) of the product.
  • FIG. 2 shows a methodology 200 for building the digital twin, according to some embodiments.
  • the Digital Twin from the IoT sensor data to perform three tasks: run-time localization of faults, regular update of the system Digital Twin, and KPI inference for product’s Digital Twin.
  • run-time localization in this example, we create and maintain an active fingerprint library of the individual IoT sensor data corresponding to the DTobject parameters. This fingerprint also captures the PTsystem and Eastern parameters during run-time. Then for localizing the faults, the deviation of the run-time IoT sensor data is compared with the fingerprint.
  • a voting scheme is used to check if majority of the fingerprints are deviating corresponding to few fingerprints.
  • a function ⁇ where the KPI is a function of DTobject, PTsystem and E system parameters, and the IoT sensor data.
  • various time domain features may be analyzed from IoT sensor data including, without limitation, energy; energy entropy; mean amplitude; maximum amplitude; minimum amplitude; median amplitude; mode of amplitude; peak to peak features (i.e., highest peaks, peak widths, peak prominence, etc.); root mean square values; skewness; standard deviation; zero crossing rate; kurtosis and frequency domain features such as mean frequency; median frequency; signal-to-noise ratio; power bandwidth; spectral centroid; spectral entropy; spectral flux; spectral roll off from short term 50 millisecond time domain windows (also known as short term Fourier transform) and continuous wavelet transform (CWT) (140 in total); 20 mel-frequency cepstral coefficients (MFCCs); etc.
  • PCA Principal Component Analysis
  • the features are synchronized and segmented into subgroups based on the parsed DTobject parameters For instance, the features are segmented based on conditions such as presence or absence of particular component’s movement (e.g., motors responsible for moving the 3D printer nozzle in X, Y, Z-Axes).
  • movement e.g., motors responsible for moving the 3D printer nozzle in X, Y, Z-Axes.
  • a clustering algorithm For generating the fingerprint of the parsed parameters of DTobject, a clustering algorithm is used to generate clusters that group the similar features into a single cluster. For analyzing the clustering algorithm and the corresponding fitness of cluster number, silhouette coefficient is calculated for each sample. It measures the similarity of the feature to its assigned cluster compared to other clusters, with high value representing its close match to the assigned cluster. It may be calculated as follows: where a(i) is the average intra-cluster distance, and b(i) is the mean of the nearest cluster distance (lowest average distance of i with all other points in other cluster where i is not a member). The clustering is carried out for each group of the features for all the analog emissions. The cluster centers, cluster number, and the corresponding average silhouette coefficient of all the analog emissions are stored in a library, effectively representing the fingerprint for the given parsed DTobject parameter.
  • FIG. 3 illustrates an algorithm 300 for generating the cluster fingerprint, according to some embodiments.
  • Line 3 estimates k clusters for each of the group in all channels and stores it in a library along with the corresponding average silhouette score. This clusters and the corresponding silhouette scores are used as the fingerprint to determine if the future analog emissions match the given product Digital Twin parameters.
  • the fingerprint library calculated using the algorithm 300 shown in FIG. 3 is used for detecting and localizing the anomalous physical signals corresponding to the DTobject while printing.
  • the algorithm 400 for detecting and localizing the deviation from the stored fingerprint is shown in FIG. 4. Algorithm 400 parses the features of the DTobject either run time or after the product’s Physical Twin has been created.
  • the fingerprint library uses the fingerprint library it estimates the new cluster labels for the parsed features in line 5. Using these labels and the features, the new silhouette coefficient for the parsed features are calculated in line 6 using Equation 5. If the calculated silhouette coefficient is less than the stored silhouette coefficient ⁇ threshold SCihreshoid then then the DTobject segment corresponding to the feature is marked as deviating from the previous fingerprint, and returned as containing possible anomaly.
  • the library of fingerprint for the DTobject has to be updated. However, before updating the library, it should be checked if the anomaly in the fingerprint is temporary or it is due to the degradation of the machine over time.
  • lines 10 in algorithm 400 keep tracks of all the DTobject variables that deviated. Then line 12 checks if more than featureThreshoid of the DTobject parameters deviated from the previous fingerprint. Then line 15 checks if more than groupThreshoid of the groups deviated from the previous fingerprint. Finally, line 18 checks if more than channelThreshoid of all the channels deviated. If these conditions are met then in line 19 the library for the Digital Twin is updated.
  • These thresholds for checking the deviation from the fingerprint can be varied for different channels and groups based on the amount of information leaked by each of the side-channels.
  • FIG. 5 shows an experimental setup for modeling the Digital Twin in this system, according to some embodiments.
  • an additive manufacturing system is utilized.
  • a fused deposition modeling based Cartesian additive manufacturing system is selected due to its widespread use in rapid prototyping 3D objects layer by layer.
  • the Digital Twin of the product i.e., the 3D object being created
  • the Digital Twin of the product is initially described using a Computer Aided Design (CAD) tools.
  • CAD Computer Aided Design
  • STL StereoLithography
  • CAM Computer Aided Manufacturing
  • the sample G/M-code comprises maximum of six parameters, G/M code specifying whether it is machine instruction or coordinate geometry information, travel feed-rate F of the nozzle head, the coordinates in XYZ-Axes each and amount of extrusion E.
  • the parsing algorithm in this case separates the DTobject based on presence or absence of 5 of these parameters, G/M, X, Y, Z, and E. Hence, . ⁇ r S2)
  • the PT system and E system implicitly affect the signals s a ⁇ f ), s v (t), s m ⁇ t), and sp(t ⁇ _ Hence, an exhaustive list of PT system and E system need not be explored for the modeling.
  • various G/M-code of the 3D-objects e.g., cube, pyramid, cylinder, etc.
  • 3D printer e.g., cube, pyramid, cylinder, etc.
  • FIG. 6 shows the experimental setup for sensor position exploration.
  • One of the challenges in IoT sensor based information extraction is figuring out non-intrusive position of the sensors. This task may also be machine specific.
  • the 3D printers’ external surface is considered for non-intrusively placing the sensors. Total of 28 uniform positions are selected.
  • TruePositives+TrueNegative as a metric for determining the placement of the sensors around the 3D printer. Accuracy score of IoT sensor data is shown in FIG. 7. It may be noticed that for different positions the classification accuracy is different. Based on these values single position for each of the sensors are selected. However, since four acoustic sensors are used, positions with top four classification accuracy are selected for the sensor placement.
  • Clustering algorithm Various algorithms may be used for creating clusters to generate the fingerprint including, without limitation, Mini batch K-means, Spectral Clustering, Ward, Agglomerative Clustering, Birch, and the Gaussian Mixture method.
  • Mini batch K-means Spectral Clustering
  • Ward Agglomerative Clustering
  • Birch the Gaussian Mixture method.
  • Gaussian Mixture method For each of the clustering algorithm, varying numbers of clusters are initialized, and the corresponding silhouette coefficient is calculated for measuring the fitness of the features into these clusters.
  • FIG. 10 shows the test DTobject created using a CAD tool for checking anomaly localization capability of the Digital Twin.
  • Flowrate should be maintained for uniform deposition of the filament while printing in fused deposition modeling based 3D printers. However, due to sudden slippage, faulty filament, etc., the flow of the filament may deviate from its nominal value.
  • the flowrate is a process specific parameter which is calculated as follows: where W is the width and H is the height of the line-segment being printed on the XY-plane, Q is the constant volumetric flow rate of the material. Q is estimated based on die swelling ration, pressure drop value and buckling pressure of the filament vfeed is the feed velocity of the filament and is calculated as:
  • the Digital Twin comprises fingerprint for the optimal flowrate in its library, and the corresponding clusters of the individual channels.
  • the corresponding features are passed to the Digital Twin, and the silhouetted coefficients corresponding to the DTobject are calculated.
  • algorithm 400 shown in FIG. 4
  • the analog emissions in each channel is labeled as either being within the deviation limit or exceeding the deviation limit of the silhouette coefficient.
  • the optimal threshold for making this decision, initially the threshold is varied and the corresponding accuracy of the detection mechanism is measured.
  • ROC Receiver Operating Characteristic
  • the threshold is set and the corresponding classification accuracy for the segments that has been degraded is calculated.
  • the accuracy of each channel in detecting the anomalous flowrate is shown in FIG. 12. Since the features are time stamped, the corresponding section of the DTobject may be calculated after the Digital Twin has marked the features to be anomalous.
  • FIG. 13 presents a table with the results for degradation analysis.
  • the table shows true negative rate, false positive rate and update decision taken for each channel for the old cluster.
  • the Digital Twin When the system degrades, we expect the Digital Twin to find higher negative labels being generated as the silhouette score will be lower than the average silhouette score stored for all the channels and groups. It can be seen that out of eleven channels four of them had the decision of not updating the cluster, and seven of them opting for updating the clusters. Hence, the clusters are updated by algorithm 400 (see FIG. 4). On the other hand, once the cluster have been updated, the analog emissions are labeled as true, hence we expect to see a higher true positive rate and a lower false negative rate. In the table shown in FIG. 13, it can be seen that only three of the channels gave the decision for updating the clusters again, however eight of them opted for not updating the cluster. This shows that the Digital Twin is able to update itself during degradation that causes emissions in multiple side-channels to vary.
  • the result of the KPI inference is shown in FIG. 14.
  • the mean absolute error value of the inference model trained with optimal flowrate range is measured. It can be seen in the figure that for optimal flowrate ranges the mean absolute error value is around 0.5 mm.
  • the flowrate of the PTsystem is varied with step size of +10% in positive direction (> 120%) and at the same time +10% in negative direction ( ⁇ 80%). It may be seen that in both directions when the system ages (degrades with increase or decrease in the flowrate), the DTsystem first has increase mean absolute error first. This is intuitive as the DTsystem has not been updated to the new fingerprint. However, once it has been updated the mean absolute error is lower.
  • FIG. 16 illustrates an exemplary computing environment 1600 which may execute an application for performing quality inference from living digital twins in IoT-enabled manufacturing systems, according to some embodiments.
  • the computing environment 1600 includes computer system 1610, which is one example of a computing system upon which embodiments of the invention may be implemented.
  • Computers and computing environments, such as computer system 1610 and computing environment 1600, are known to those of skill in the art and thus are described briefly herein.
  • the computer system 1610 may include a communication mechanism such as a system bus 1621 or other communication mechanism for communicating information within the computer system 1610.
  • the computer system 1610 further includes one or more processors 1620 coupled with the system bus 1621 for processing the information.
  • the processors 1620 may include one or more central processing units (CPUs), graphical processing units (GPUs), or any other processor known in the art.
  • the computer system 1610 also includes a system memory 1630 coupled to the bus 1621 for storing information and instructions to be executed by processors 1620.
  • the system memory 1630 may include computer readable storage media in the form of volatile and/or nonvolatile memory, such as read only memory (ROM) 1631 and/or random access memory (RAM) 1632.
  • the system memory RAM 1632 may include other dynamic storage device(s) (e.g., dynamic RAM, static RAM, and synchronous DRAM).
  • the system memory ROM 1631 may include other static storage device(s) (e.g., programmable ROM, erasable PROM, and electrically erasable PROM).
  • system memory 1630 may be used for storing temporary variables or other intermediate information during the execution of instructions by the processors 1620.
  • a basic input/output system (BIOS) 1633 contains the basic routines that help to transfer information between elements within computer system 1610, such as during start-up, may be stored in ROM 1631.
  • RAM 1632 may contain data and/or program modules that are immediately accessible to and/or presently being operated on by the processors 1620.
  • System memory 1630 may additionally include, for example, operating system 1634, application programs 1635, other program modules 1636 and program data 1637.
  • the application programs 1635 may include, for example, the one or more executable applications for performing quality inference.
  • the computer system 1610 also includes a disk controller 1640 coupled to the system bus 1621 to control one or more storage devices for storing information and instructions, such as a hard disk 1641 and a removable media drive 1642 (e.g., compact disc drive, solid state drive, etc.).
  • the storage devices may be added to the computer system 1610 using an appropriate device interface (e.g., a small computer system interface (SCSI), integrated device electronics, Universal Serial Bus (USB), or FireWire).
  • SCSI small computer system interface
  • USB Universal Serial Bus
  • FireWire FireWire
  • the computer system 1610 may also include a display controller 1665 coupled to the bus 1621 to control a display 1666, such as a liquid crystal display (LCD), for displaying information to a computer user such as anomaly detection alerts or other descriptive information related to production (KPIs).
  • the computer system includes an input interface 1660 and one or more input devices, such as a keyboard 1662 and a pointing device 1661, for interacting with a computer user and providing information to the processors 1620.
  • the pointing device 1661 may be, for example, a mouse or a pointing stick for communicating direction information and command selections to the processors 1620 and for controlling cursor movement on the display 1666.
  • the display 1666 may provide a touch screen interface which allows input to supplement or replace the communication of direction information and command selections by the pointing device 1661.
  • the computer system 1610 may perform a portion or all of the processing steps of embodiments of the invention in response to the processors 1620 executing one or more sequences of one or more instructions contained in a memory, such as the system memory 1630.
  • a memory such as the system memory 1630.
  • Such instructions may be read into the system memory 1630 from another computer readable medium, such as a hard disk 1641 or a removable media drive 1642.
  • the hard disk 1641 may contain one or more datastores and data files used by embodiments of the present invention. Datastore contents and data files may be encrypted to improve security.
  • the processors 1620 may also be employed in a multi-processing arrangement to execute the one or more sequences of instructions contained in system memory 1630.
  • hard-wired circuitry may be used in place of or in combination with software instructions. Thus, embodiments are not limited to any specific combination of hardware circuitry and software.
  • the computer system 1610 may include at least one computer readable medium or memory for holding instructions programmed according to embodiments of the invention and for containing data structures, tables, records, or other data described herein.
  • the term“computer readable medium” as used herein refers to any medium that participates in providing instructions to the processor 1620 for execution.
  • a computer readable medium may take many forms including, but not limited to, non-volatile media, volatile media, and transmission media.
  • Non-limiting examples of non-volatile media include optical disks, solid state drives, magnetic disks, and magneto-optical disks, such as hard disk 1641 or removable media drive 1642.
  • Non-limiting examples of volatile media include dynamic memory, such as system memory 1630.
  • Non-limiting examples of transmission media include coaxial cables, copper wire, and fiber optics, including the wires that make up the bus 1621.
  • Transmission media may also take the form of acoustic or light waves, such as those generated during radio wave and infrared data communications.
  • computer system 1610 may include modem 1672 for establishing communications over a network 1671 with components of the manufacturing system.
  • a 3D Printer 1680 is shown as one component that may be connected to the computer system 1610.
  • Modem 1672 may be connected to bus 1621 via user network interface 1670, or via another appropriate mechanism.
  • the 3D Printer 1680 is illustrated as being connected to the computer system 1610 over the network 1671 in the example presented in FIG. 16, in other embodiments of the present invention, the computer system 1610 may be directly connected to the 3D Printer 1680.
  • the computer system 1610 and the 3D Printer 1680 are co-located in the same room or in adjacent rooms, and the devices are connected using any transmission media generally known in the art.
  • Network 1671 may be any network or system generally known in the art, including the Internet, an intranet, a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a direct connection or series of connections, a cellular telephone network, or any other network or medium capable of facilitating communication between computer system 1610 and other computers (e.g., robot controller 1680).
  • the network 1671 may be wired, wireless or a combination thereof. Wired connections may be implemented using Ethernet, Universal Serial Bus (USB), RJ-l l or any other wired connection generally known in the art.
  • Wireless connections may be implemented using Wi-Fi, WiMAX, and Bluetooth, infrared, cellular networks, satellite or any other wireless connection methodology generally known in the art. Additionally, several networks may work alone or in communication with each other to facilitate communication in the network 1671.
  • the embodiments of the present disclosure may be implemented with any combination of hardware and software.
  • the embodiments of the present disclosure may be included in an article of manufacture (e.g., one or more computer program products) having, for example, computer-readable, non-transitory media.
  • the media has embodied therein, for instance, computer readable program code for providing and facilitating the mechanisms of the embodiments of the present disclosure.
  • the article of manufacture can be included as part of a computer system or sold separately.
  • An executable application comprises code or machine readable instructions for conditioning the processor to implement predetermined functions, such as those of an operating system, a context data acquisition system or other information processing system, for example, in response to user command or input.
  • An executable procedure is a segment of code or machine readable instruction, sub-routine, or other distinct section of code or portion of an executable application for performing one or more particular processes. These processes may include receiving input data and/or parameters, performing operations on received input data and/or performing functions in response to received input parameters, and providing resulting output data and/or parameters.
  • a graphical user interface comprises one or more display images, generated by a display processor and enabling user interaction with a processor or other device and associated data acquisition and processing functions.
  • the GUI also includes an executable procedure or executable application.
  • the executable procedure or executable application conditions the display processor to generate signals representing the GUI display images. These signals are supplied to a display device which displays the image for viewing by the user.
  • the processor under control of an executable procedure or executable application, manipulates the GUI display images in response to signals received from the input devices. In this way, the user may interact with the display image using the input devices, enabling user interaction with the processor or other device.
  • the term“component” can refer to either or both of: (i) a software component that causes an electronic device to accept various inputs and generate certain outputs; or (ii) an electronic input/output interface, such as a panel, frame, textbox, window or other portion of a GUI.
  • the functions and process steps herein may be performed automatically or wholly or partially in response to user command.
  • An activity (including a step) performed automatically is performed in response to one or more executable instructions or device operation without user direct initiation of the activity.

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Factory Administration (AREA)

Abstract

L'invention concerne un procédé d'inférence de qualité dans un système de fabrication activé par l'Internet des objets (IDO) comprenant la génération d'une bibliothèque d'empreintes digitales. Chaque empreinte digitale correspond à un jumeau numérique d'un produit et comprend (i) des groupes de caractéristiques stockées ; et (ii) un coefficient de silhouette stocké pour chaque groupe de caractéristiques. Des valeurs de capteur sont collectées à partir de capteurs IDO surveillant un jumeau physique du système de fabrication. Des valeurs caractéristiques sont extraites des valeurs de capteur. Des paramètres définissant le jumeau numérique sont identifiés et utilisés pour segmenter les valeurs de caractéristiques en sous-groupes de caractéristiques. Ensuite, des groupes de caractéristiques sont estimés pour les sous-groupes à l'aide de la bibliothèque d'empreintes digitales. Un coefficient de silhouette courant est déterminé pour chaque groupe de caractéristiques. Si le coefficient de silhouette courant s'écarte d'un coefficient de silhouette stocké correspondant, les paramètres du jumeau numérique correspondant au groupe de caractéristiques sont identifiés et désignés comme étant potentiellement anormaux. Une alerte peut ensuite être fournie à des utilisateurs identifiant les paramètres potentiellement anormaux.
PCT/US2018/049132 2018-05-08 2018-08-31 Inférence de qualité à partir de jumeaux numériques vivants dans des systèmes de fabrication activés par l'ido WO2019216941A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862668327P 2018-05-08 2018-05-08
US62/668,327 2018-05-08

Publications (1)

Publication Number Publication Date
WO2019216941A1 true WO2019216941A1 (fr) 2019-11-14

Family

ID=63638405

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2018/049132 WO2019216941A1 (fr) 2018-05-08 2018-08-31 Inférence de qualité à partir de jumeaux numériques vivants dans des systèmes de fabrication activés par l'ido

Country Status (1)

Country Link
WO (1) WO2019216941A1 (fr)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110989404A (zh) * 2019-12-30 2020-04-10 上海大学 一种汽车后桥装配生产线仿真方法
CN111026063A (zh) * 2019-12-25 2020-04-17 南方科技大学 数字孪生体构建方法、装置、计算机设备及存储介质
CN111538294A (zh) * 2019-11-15 2020-08-14 武汉理工大学 基于数字孪生的工业机器人制造系统可重构系统与方法
CN111652415A (zh) * 2020-05-22 2020-09-11 中国航空无线电电子研究所 管控无人机地面控制站生产数据的信息物理系统集成模型
CN111680286A (zh) * 2020-02-27 2020-09-18 中国科学院信息工程研究所 物联网设备指纹库的精细化方法
CN112614157A (zh) * 2020-12-17 2021-04-06 上海眼控科技股份有限公司 一种视频目标跟踪方法、装置、设备及存储介质
WO2021222384A1 (fr) * 2020-04-28 2021-11-04 Strong Force Intellectual Capital, Llc Systèmes et procédés de jumeau numérique de systèmes de transport
US11301597B2 (en) * 2018-11-20 2022-04-12 Institute For Information Industry Simulation apparatus and method
CN114493810A (zh) * 2022-04-14 2022-05-13 成都信息工程大学 物联网数据处理方法、装置及介质
CN114527425A (zh) * 2022-02-24 2022-05-24 杨邦会 一种基于数字孪生的矿井人员定位方法
CN114577332A (zh) * 2020-12-01 2022-06-03 国际商业机器公司 维护活动的优先化的方法、系统和计算机程序产品
US11501426B2 (en) 2020-09-17 2022-11-15 International Business Machines Corporation Tracking of mass-produced products
CN116129366A (zh) * 2023-04-19 2023-05-16 肯特智能技术（深圳）股份有限公司 基于数字孪生的园区监测方法及相关装置
US11853943B1 (en) * 2020-02-05 2023-12-26 Blue Yonder Group, Inc. Mixed-reality assisted dimensionality expansion and manipulation analytics
US11860712B1 (en) 2022-08-24 2024-01-02 International Business Machines Corporation Sensor fault prediction and resolution
CN117633697A (zh) * 2024-01-26 2024-03-01 西安艺琳农业发展有限公司 基于物联网的生猪智能监测方法及系统
CN117952323A (zh) * 2024-03-26 2024-04-30 大连豪森软件有限公司 一种基于数字孪生的产品创建系统、方法、设备及介质

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
AGNIVA BANERJEE ET AL: "Generating Digital Twin Models using Knowledge Graphs for Industrial Production Lines", WEBSCI 2017, 25 June 2017 (2017-06-25), pages 425 - 430, XP055520610, ISBN: 978-1-4503-4896-6, DOI: 10.1145/3091478.3162383 *
FEI TAO ET AL: "Digital twin-driven product design, manufacturing and service with big data", THE INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, vol. 94, no. 9-12, 16 March 2017 (2017-03-16), London, pages 3563 - 3576, XP055547858, ISSN: 0268-3768, DOI: 10.1007/s00170-017-0233-1 *
SUJIT ROKKA ET AL: "Digital Twin of Manufacturing Systems", 27 November 2017 (2017-11-27), XP055546673, Retrieved from the Internet <URL:http://aicps.eng.uci.edu/papers/digital-twin.pdf> [retrieved on 20190125] *

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11301597B2 (en) * 2018-11-20 2022-04-12 Institute For Information Industry Simulation apparatus and method
CN111538294B (zh) * 2019-11-15 2021-08-24 武汉理工大学 基于数字孪生的工业机器人制造系统可重构系统与方法
CN111538294A (zh) * 2019-11-15 2020-08-14 武汉理工大学 基于数字孪生的工业机器人制造系统可重构系统与方法
CN111026063A (zh) * 2019-12-25 2020-04-17 南方科技大学 数字孪生体构建方法、装置、计算机设备及存储介质
CN111026063B (zh) * 2019-12-25 2023-10-03 南方科技大学 数字孪生体构建方法、装置、计算机设备及存储介质
CN110989404A (zh) * 2019-12-30 2020-04-10 上海大学 一种汽车后桥装配生产线仿真方法
US11853943B1 (en) * 2020-02-05 2023-12-26 Blue Yonder Group, Inc. Mixed-reality assisted dimensionality expansion and manipulation analytics
US12118486B2 (en) 2020-02-05 2024-10-15 Blue Yonder Group, Inc. Mixed-reality assisted dimensionality expansion and manipulation analytics
CN111680286A (zh) * 2020-02-27 2020-09-18 中国科学院信息工程研究所 物联网设备指纹库的精细化方法
CN111680286B (zh) * 2020-02-27 2022-06-10 中国科学院信息工程研究所 物联网设备指纹库的精细化方法
WO2021222384A1 (fr) * 2020-04-28 2021-11-04 Strong Force Intellectual Capital, Llc Systèmes et procédés de jumeau numérique de systèmes de transport
CN111652415A (zh) * 2020-05-22 2020-09-11 中国航空无线电电子研究所 管控无人机地面控制站生产数据的信息物理系统集成模型
US11501426B2 (en) 2020-09-17 2022-11-15 International Business Machines Corporation Tracking of mass-produced products
CN114577332B (zh) * 2020-12-01 2024-04-02 国际商业机器公司 维护活动的优先化的方法、系统和计算机程序产品
CN114577332A (zh) * 2020-12-01 2022-06-03 国际商业机器公司 维护活动的优先化的方法、系统和计算机程序产品
CN112614157A (zh) * 2020-12-17 2021-04-06 上海眼控科技股份有限公司 一种视频目标跟踪方法、装置、设备及存储介质
CN114527425B (zh) * 2022-02-24 2023-01-10 中国科学院空天信息创新研究院 一种基于数字孪生的矿井人员定位方法
CN114527425A (zh) * 2022-02-24 2022-05-24 杨邦会 一种基于数字孪生的矿井人员定位方法
CN114493810B (zh) * 2022-04-14 2022-07-05 成都信息工程大学 物联网数据处理方法、装置及介质
CN114493810A (zh) * 2022-04-14 2022-05-13 成都信息工程大学 物联网数据处理方法、装置及介质
US11860712B1 (en) 2022-08-24 2024-01-02 International Business Machines Corporation Sensor fault prediction and resolution
CN116129366A (zh) * 2023-04-19 2023-05-16 肯特智能技术（深圳）股份有限公司 基于数字孪生的园区监测方法及相关装置
CN117633697A (zh) * 2024-01-26 2024-03-01 西安艺琳农业发展有限公司 基于物联网的生猪智能监测方法及系统
CN117633697B (zh) * 2024-01-26 2024-05-03 西安艺琳农业发展有限公司 基于物联网的生猪智能监测方法及系统
CN117952323A (zh) * 2024-03-26 2024-04-30 大连豪森软件有限公司 一种基于数字孪生的产品创建系统、方法、设备及介质

Similar Documents

Publication Publication Date Title
WO2019216941A1 (fr) Inférence de qualité à partir de jumeaux numériques vivants dans des systèmes de fabrication activés par l&#39;ido
Chhetri et al. QUILT: Quality inference from living digital twins in IoT-enabled manufacturing systems
Grezmak et al. Interpretable convolutional neural network through layer-wise relevance propagation for machine fault diagnosis
JP6811276B2 (ja) 多次元時系列におけるスパース・ニューラル・ネットワーク・ベース異常検出
EP3441947B1 (fr) Système et procédé de détermination de la durée restante de vie utile
US10831577B2 (en) Abnormality detection system, abnormality detection method, abnormality detection program, and method for generating learned model
Shi et al. An LSTM-autoencoder based online side channel monitoring approach for cyber-physical attack detection in additive manufacturing
US7565262B2 (en) Bayesian sensor estimation for machine condition monitoring
Zhang et al. Dynamic condition monitoring for 3D printers by using error fusion of multiple sparse auto-encoders
JP5301717B1 (ja) 設備状態監視方法およびその装置
Wang et al. Sensor fusion for online tool condition monitoring in milling
AU2012284460B2 (en) System of sequential kernel regression modeling for forecasting and prognostics
US20200143292A1 (en) Signature enhancement for deviation measurement-based classification of a detected anomaly in an industrial asset
Yu A nonlinear probabilistic method and contribution analysis for machine condition monitoring
US11215535B2 (en) Predictive maintenance for robotic arms using vibration measurements
US10565080B2 (en) Discriminative hidden kalman filters for classification of streaming sensor data in condition monitoring
Lu et al. Graph-based structural change detection for rotating machinery monitoring
CN102282516A (zh) 异常检测方法及异常检测系统
US12045047B2 (en) Fault diagnostics systems and methods
Denkena et al. Data-based ensemble approach for semi-supervised anomaly detection in machine tool condition monitoring
Prakash et al. Monitoring the degradation in the switching behavior of a hydraulic valve using recurrence quantification analysis and fractal dimensions
Akcan et al. Diagnosing bearing fault location, size, and rotational speed with entropy variables using extreme learning machine
Fahmi et al. Fault detection in the gas turbine of the Kirkuk power plant: An anomaly detection approach using DLSTM-Autoencoder
Silva et al. Damage detection for structural health monitoring of bridges as a knowledge discovery in databases process
Wang et al. Adaptive change detection for long-term machinery monitoring using incremental sliding-window

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18773053

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18773053

Country of ref document: EP

Kind code of ref document: A1