WO2022257925A1 - Fault prediction method and apparatus based on digital twin, server, and storage medium - Google Patents

Fault prediction method and apparatus based on digital twin, server, and storage medium Download PDF

Info

Publication number
WO2022257925A1
WO2022257925A1 PCT/CN2022/097396 CN2022097396W WO2022257925A1 WO 2022257925 A1 WO2022257925 A1 WO 2022257925A1 CN 2022097396 W CN2022097396 W CN 2022097396W WO 2022257925 A1 WO2022257925 A1 WO 2022257925A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
fault prediction
fault
real
trained
Prior art date
Application number
PCT/CN2022/097396
Other languages
French (fr)
Chinese (zh)
Inventor
崔岩
常青玲
侯宇灿
揭英达
Original Assignee
五邑大学
广东四维看看智能设备有限公司
中德(珠海)人工智能研究院有限公司
珠海市四维时代网络科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 五邑大学, 广东四维看看智能设备有限公司, 中德(珠海)人工智能研究院有限公司, 珠海市四维时代网络科技有限公司 filed Critical 五邑大学
Publication of WO2022257925A1 publication Critical patent/WO2022257925A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/04Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F30/00Computer-aided design [CAD]
    • G06F30/20Design optimisation, verification or simulation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/084Backpropagation, e.g. using gradient descent

Definitions

  • the present application belongs to the technical field of data mapping, and in particular relates to a digital twin-based fault prediction method, device, server and storage medium.
  • the embodiment of the present application provides a fault prediction method, device, server, and storage medium based on digital twins to realize early prediction of production line faults.
  • the embodiment of the present application provides a fault prediction method based on digital twins, including:
  • the simulation data is input into a pre-trained fault prediction model, and before the fault prediction result is obtained, the method further includes:
  • extracting the fault data in the real-time data includes:
  • the fault data in the real-time training data is extracted according to a preset fault data extraction model.
  • the pre-trained fault prediction model includes a generation network and a discrimination network
  • Import the fault data into the preset fault prediction model for training to obtain a pre-trained fault prediction model including:
  • the fault data is used as real data, the real data and the fake sample data are used as input, and the discrimination result is used as the output, and the discrimination result is used as the feedback input of the generation network, and according to the preset objective function
  • the discrimination network and the generation network are trained to obtain a pre-trained fault prediction model.
  • the preset objective function is:
  • D represents the generation network
  • G represents the confrontation network
  • E represents the expected function
  • x represents the fault data
  • x ⁇ pdata(x) represents the fault data obeys the pdata(x) distribution
  • z represents the noise data
  • z ⁇ p (z) indicates that the noise data obeys the p (z) distribution
  • D(x) indicates the output data after the fault data is imported into the generation network
  • G(z) indicates the output data after the noise data is imported into the judgment network.
  • the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model, including:
  • the simulation data and the data generated by the generating network according to the noise data are imported into the discriminant network, and the fault prediction result is output.
  • the method further includes:
  • the embodiment of the present application provides a digital twin-based fault prediction device, including:
  • the first acquisition module is used to acquire the real-time data of the target real object
  • a generating module configured to generate a digital twin virtual object according to the real-time data
  • the second acquisition module the simulation data in the digital twin virtual model
  • the fault prediction module is used to obtain the fault prediction result according to the simulation data and the pre-trained fault prediction model.
  • the device further includes:
  • the third obtaining module is used to obtain the real-time training data of the target real object
  • An extraction module configured to extract fault data in the real-time data samples
  • the training module is used to import fault data into a preset fault prediction model for training to obtain a pre-trained fault prediction model.
  • the extraction module includes:
  • the extraction unit is configured to extract fault data in the real-time training data according to a preset fault data extraction model.
  • the pre-trained fault prediction model includes a generation network and a discrimination network
  • the training modules include:
  • the fault data is used as real data, the real data and the fake sample data are used as input, and the discrimination result is used as the output, and the discrimination result is used as the feedback input of the generation network, and according to the preset objective function
  • the discrimination network and the generation network are trained to obtain a pre-trained fault prediction model.
  • the preset objective function is:
  • D represents the generation network
  • G represents the confrontation network
  • E represents the expected function
  • x represents the fault data
  • x ⁇ pdata(x) represents the fault data obeys the pdata(x) distribution
  • z represents the noise data
  • z ⁇ p (z) indicates that the noise data obeys the p (z) distribution
  • D(x) indicates the output data after the fault data is imported into the generation network
  • G(z) indicates the output data after the noise data is imported into the judgment network.
  • the fault prediction module includes:
  • the fault prediction unit is used to import the simulation data and the data generated by the generation network according to the noise data into the discrimination network, and output a fault prediction result.
  • the digital twin-based fault diagnosis equipment further includes:
  • the registration module is used to register simulation data and fault prediction results.
  • a sending module configured to send the registered simulation data and fault prediction results to the user terminal to instruct the user terminal to display a monitoring picture to the user, the monitoring picture including the operating status of the target real object and the marked fault prediction analyze.
  • an embodiment of the present application provides a server, including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the computer program is implemented when the processor executes the computer program.
  • a server including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the computer program is implemented when the processor executes the computer program. The method as described in the first aspect above.
  • an embodiment of the present application provides a storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method as described in the first aspect above is implemented.
  • a digital twin virtual object is generated according to the real-time data, the simulation data in the digital twin virtual model is obtained, and the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model . It can be seen that the embodiment of the present application can achieve the effect of accurate fault prediction for real objects (such as production lines or workshops, etc.) by combining the digital twin technology with the unsupervised learning characteristics of the pre-trained fault prediction model.
  • FIG. 1 is a schematic flow diagram of a digital twin-based fault prediction method provided in an embodiment of the present application
  • Fig. 2 is a schematic flow chart before step S108 in Fig. 1 of the digital twin-based fault prediction method provided by the embodiment of the present application;
  • Fig. 3 is a specific implementation flowchart of step S206 in Fig. 2 of the digital twin-based fault prediction method provided by the embodiment of the present application;
  • Fig. 4 is a schematic flow chart after step S204 in Fig. 2 of the digital twin-based fault prediction method provided by the embodiment of the present application;
  • FIG. 5 is a schematic structural diagram of a digital twin-based fault prediction device provided by an embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of a server provided by an embodiment of the present application.
  • Fig. 7 is the training process of the fault prediction model of the digital twin-based fault prediction method provided by the embodiment of the present application.
  • the term “if” may be construed, depending on the context, as “when” or “once” or “in response to determining” or “in response to detecting “.
  • the phrase “if determined” or “if [the described condition or event] is detected” may be construed, depending on the context, to mean “once determined” or “in response to the determination” or “once detected [the described condition or event] ]” or “in response to detection of [described condition or event]”.
  • references to "one embodiment” or “some embodiments” or the like in the specification of the present application means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application.
  • appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically stated otherwise.
  • the terms “including”, “comprising”, “having” and variations thereof mean “including but not limited to”, unless specifically stated otherwise.
  • Digital twin is a simulation process that makes full use of data such as physical models, sensor updates, and operating history, integrates multi-disciplinary, multi-physical quantities, multi-scale, and multi-probability, and completes the mapping in the virtual space to reflect the corresponding physical equipment. whole life cycle process.
  • a digital twin is a concept beyond reality that can be viewed as a digital twin of one or more important, interdependent equipment systems.
  • FIG. 1 it is a schematic flow diagram of a digital twin-based fault prediction method provided by the embodiment of the present application.
  • the method can be applied to a server connected to a sensor set on a target real object.
  • the server may be a computing device such as a cloud server, and the method may include the following steps:
  • Step S102 acquiring real-time data of the target real object.
  • the target real object refers to a real-world production line or workshop, etc.
  • real-time data includes static data (such as equipment parameters) and dynamic data (such as equipment operating status).
  • the real-time data of the target real object is collected through sensors installed on various devices in the production line or workshop.
  • Step S104 generating a digital twin virtual object according to the real-time data.
  • the digital twin virtual object refers to the digital twin corresponding to the target real object.
  • an editable logic controller is used to generate digital twin virtual objects based on real-time data.
  • Step S106 acquiring simulation data in the digital twin virtual model.
  • the simulation data refers to the data generated by the digital twin virtual model to dynamically map the operating conditions of the target real object according to the real-time data.
  • Step S108 according to the simulation data and the pre-trained fault prediction model, a fault prediction result is obtained.
  • the pre-trained fault prediction model includes a generative network and a discriminative network.
  • the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model, including: importing the simulation data and the data generated by the generation network based on the noise data into the discriminant network, and outputting the fault prediction result.
  • the fault prediction result is the fault equipment number, fault type, fault cause and fault time.
  • the simulation data and the data generated by the generation network based on the noise data are judged as real data or generated samples according to the discrimination network, so as to determine the fault data in the simulation data as the fault prediction result.
  • the embodiment of the present application provides a schematic flow chart before step S108 in Figure 1 of the digital twin-based fault prediction method, based on simulation data and pre-trained fault prediction
  • the model, before getting the fault prediction results also includes:
  • Step S202 acquiring real-time training data of the target real object.
  • real-time training data is obtained from open source datasets.
  • Step S204 extracting fault data in the real-time training data.
  • the fault data includes fault equipment number, fault type, fault content and fault time.
  • the named entity recognition is directly carried out on the real-time data, and the fault equipment number, fault type, fault content and fault time in the entity data are extracted.
  • the fault data extraction model can be trained on the basis of Bi-LSTM+CRF neural network.
  • the process of training the fault data extraction model on the Bi-LSTM+CRF neural network can be:
  • Step S206 importing the fault data into a preset fault prediction model for training to obtain a pre-trained fault prediction model.
  • the fault data is imported into the preset fault prediction model for training to obtain a pre-trained fault prediction model, including: importing the fault data and the data generated by the generation network based on the noise data to the discriminant network, and outputting the fault prediction result.
  • FIG. 3 it is a specific implementation flow chart of step S206 in FIG. 2 of the digital twin-based fault prediction method provided by the embodiment of the present application.
  • the fault data is imported into the preset fault prediction model for training, and the obtained Pre-trained failure prediction models, including:
  • Step S302 generating noise data.
  • the noise data is randomly generated variables, which are used to train the generation network to generate fake sample data.
  • Step S304 importing the noise data into the generation network to obtain fake sample data.
  • the generating network is preferably a naive Bayesian model.
  • Step S306 using the fault data as the real data, the real data and the fake sample data as the input, the discrimination result as the output, and the discrimination result as the feedback input of the generation network, and training the discrimination network and the generation network according to the preset objective function , to get the pre-trained fault prediction model.
  • the discriminant network is preferably a decision tree.
  • the preset objective function is:
  • D represents the generation network
  • G represents the confrontation network
  • E represents the expected function
  • X represents the fault data
  • x ⁇ pdata(x) represents the fault data obeys the pdata(x) distribution
  • z represents the noise data
  • z ⁇ p (z) indicates that the noise data obeys the p (z) distribution
  • D(x) indicates the output data after the fault data is imported into the generation network
  • G(z) indicates the output data after the noise data is imported into the judgment network.
  • pdata(x) distribution and p (z) distribution may respectively refer to Gaussian distribution, uniform distribution and the like.
  • steps S302 to S306 reference may be made to the training process of the fault prediction model as shown in FIG. 7 .
  • the named entity recognition technology is used to directly extract the fault data to train the fault prediction data, without additional manual data labeling, which reduces the difficulty of training the fault prediction model.
  • FIG. 4 it is a schematic flow chart after step S204 in FIG. 2 of the digital twin-based fault prediction method provided by the embodiment of the present application.
  • the trained fault prediction model after obtaining the fault prediction results, also includes:
  • Step S402 registering the simulation data and the fault prediction result.
  • Step S404 sending the registered simulation data and fault prediction results to the user terminal to instruct the user terminal to generate a monitoring screen according to the registered simulation data and fault prediction results, and display the monitoring screen to the user.
  • the monitoring screen includes the equipment generation of each equipment in the digital twin virtual model, the equipment operation status and the fault prediction results of the faulty equipment.
  • the simulation data and fault prediction results are obtained by combining the digital twin technology with the pre-trained fault prediction model, and a monitoring screen is generated according to the simulation data and fault prediction results for customers to view, so as to realize the user through monitoring.
  • the screen can check the running status of the target real object and the prediction and analysis of the faulty equipment in the target real object in real time, and detect the faulty equipment in time.
  • a digital twin virtual object is generated according to the real-time data, the simulation data in the digital twin virtual model is obtained, and the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model .
  • the effect of accurate fault prediction on real objects can be achieved by combining the digital twin technology with the unsupervised learning characteristics of the pre-trained fault prediction model.
  • Fig. 5 shows a structural block diagram of the digital twin-based fault prediction device provided by the embodiment of the present application. For the convenience of description, only the parts related to the embodiment of the present application are shown.
  • the digital twin-based fault prediction device includes:
  • the first obtaining module 51 is used to obtain the real-time data of the target real object
  • a generating module 52 configured to generate a digital twin virtual object according to the real-time data
  • the second acquisition module 53 the simulation data in the digital twin virtual model
  • the fault prediction module 54 is configured to obtain a fault prediction result according to the simulation data and the pre-trained fault prediction model.
  • the device further includes:
  • the third obtaining module is used to obtain the real-time training data of the target real object
  • An extraction module configured to extract fault data in the real-time data samples
  • the training module is used to import the fault data into a preset fault prediction model for training to obtain a pre-trained fault prediction model.
  • the extraction module includes:
  • the extraction unit is configured to extract fault data in the real-time training data according to a preset fault data extraction model.
  • the pre-trained fault prediction model includes a generation network and a discrimination network
  • the training modules include:
  • the fault data is used as real data, the real data and the fake sample data are used as input, and the discrimination result is used as the output, and the discrimination result is used as the feedback input of the generation network, and according to the preset objective function
  • the discrimination network and the generation network are trained to obtain a pre-trained fault prediction model.
  • the preset objective function is:
  • D represents the generation network
  • G represents the confrontation network
  • E represents the expected function
  • X represents the fault data
  • x ⁇ pdata(x) represents the fault data obeys the pdata(x) distribution
  • z represents the noise data
  • z ⁇ p (z) indicates that the noise data obeys the p (z) distribution
  • D(x) indicates the output data after the fault data is imported into the generation network
  • G(z) indicates the output data after the noise data is imported into the judgment network.
  • the fault prediction module includes:
  • the fault prediction unit is used to import the simulation data and the data generated by the generation network according to the noise data into the discrimination network, and output a fault prediction result.
  • the digital twin-based fault diagnosis equipment further includes:
  • the registration module is used to register simulation data and fault prediction results.
  • a sending module configured to send the registered simulation data and fault prediction results to the user terminal to instruct the user terminal to display a monitoring picture to the user, the monitoring picture including the operating status of the target real object and the marked fault prediction analyze.
  • FIG. 6 is a schematic structural diagram of a server provided by an embodiment of the present application.
  • the server 6 of this embodiment includes: at least one processor 60, a memory 61, and a computer program 62 stored in the memory 61 and operable on the at least one processor 60, so When the processor 60 executes the computer program 62, the steps in any of the foregoing method embodiments are implemented.
  • the server 6 may be a computing device such as a cloud server.
  • the server may include, but not limited to, a processor 60 and a memory 61 .
  • Fig. 6 is only an example of server 6, and does not constitute a limitation to server 6, and may include more or less components than those shown in the figure, or combine some components, or different components, for example It may also include input and output devices, network access devices, etc.
  • the so-called processor 60 can be a central processing unit (Central Processing Unit, CPU), and the processor 60 can also be other general processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit) , ASIC), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.
  • the storage 61 may be an internal storage unit of the server 6 in some embodiments, such as a hard disk or memory of the server 6 .
  • the memory 61 can also be an external storage device of the server 6 in other embodiments, such as a plug-in hard disk equipped on the server 6, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, flash memory card (Flash Card), etc.
  • the storage 61 may also include both an internal storage unit of the server 6 and an external storage device.
  • the memory 61 is used to store operating system, application program, boot loader (BootLoader), data and other programs, such as the program code of the computer program.
  • the memory 61 can also be used to temporarily store data that has been output or will be output.
  • the embodiment of the present application also provides a storage medium, the storage medium is a computer-readable storage medium, and the readable storage medium stores a computer program, and when the computer program is executed by a processor, it can realize the above-mentioned various method embodiments. in the steps.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • all or part of the processes in the methods of the above embodiments in the present application can be completed by instructing related hardware through computer programs, and the computer programs can be stored in a computer-readable storage medium.
  • the computer program When executed by a processor, the steps in the above-mentioned various method embodiments can be realized.
  • the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form.
  • the computer-readable medium may at least include: any entity or device capable of carrying computer program code, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random-access memory (RAM, Random Access Memory), electrical carrier signals, telecommunication signals, and software distribution media.
  • ROM read-only memory
  • RAM random-access memory
  • electrical carrier signals telecommunication signals
  • software distribution media Such as U disk, mobile hard disk, magnetic disk or CD, etc.
  • computer readable media may not be electrical carrier signals and telecommunication signals under legislation and patent practice.
  • the disclosed device/network device and method may be implemented in other ways.
  • the device/network device embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

Abstract

The present application is applicable to the technical field of data mapping, and provides a fault prediction method and apparatus based on digital twin, a server, and a storage medium. The method comprises: obtaining real-time data of a target real object; generating a digital twin virtual object according to the real-time data; obtaining simulation data in a digital twin virtual model; and obtaining a fault prediction result according to the simulation data and a pre-trained fault prediction model. Hence, in embodiments of the present application, accurate fault prediction of a real object (such as a production line or a workshop) can be realized by means of a combination of the digital twin technology and unsupervised learning characteristics of the pre-trained fault prediction model.

Description

基于数字孪生的故障预测方法、装置、服务器及存储介质Fault prediction method, device, server and storage medium based on digital twin 技术领域technical field
本申请属于数据映射技术领域,尤其涉及一种基于数字孪生的故障预测方法、装置、服务器及存储介质。The present application belongs to the technical field of data mapping, and in particular relates to a digital twin-based fault prediction method, device, server and storage medium.
背景技术Background technique
随着“工业4.0”的概念提出,工厂对生产线智能化的需求越来越高,但是大多数生产线不够智能化。现有技术中,一般采用后置报警的方式对生产线故障进行故障提示,但是这种后置报警的故障提示只能减少生产线故障造成的影响。With the introduction of the concept of "Industry 4.0", factories have higher and higher demand for intelligent production lines, but most production lines are not intelligent enough. In the prior art, a post-alarm method is generally used to provide fault prompts for production line faults, but such post-alarm fault prompts can only reduce the impact of production line faults.
发明内容Contents of the invention
本申请实施例提供了基于数字孪生的故障预测方法、装置、服务器及存储介质,实现对生产线故障的提前预测。The embodiment of the present application provides a fault prediction method, device, server, and storage medium based on digital twins to realize early prediction of production line faults.
第一方面,本申请实施例提供了一种基于数字孪生的故障预测方法,包括:In the first aspect, the embodiment of the present application provides a fault prediction method based on digital twins, including:
获取目标真实对象的实时数据;Obtain real-time data of the target real object;
根据所述实时数据生成数字孪生虚拟对象;generating a digital twin virtual object based on said real-time data;
获取所述数字孪生虚拟模型中的仿真数据;Obtain the simulation data in the digital twin virtual model;
根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果。According to the simulation data and the pre-trained fault prediction model, a fault prediction result is obtained.
在第一方面的一种可能的实现方式中,将所述仿真数据输入至预先训练的故障预测模型中,得到故障预测结果之前,还包括:In a possible implementation manner of the first aspect, the simulation data is input into a pre-trained fault prediction model, and before the fault prediction result is obtained, the method further includes:
获取目标真实对象的实时训练数据;Obtain real-time training data of the target real object;
提取所述实时数据样本中的故障数据;extracting fault data in the real-time data sample;
将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障预测模型。Import the fault data into the preset fault prediction model for training to obtain a pre-trained fault prediction model.
在第一方面的一种可能的实现方式中,提取所述实时数据中的故障数据,包括:In a possible implementation manner of the first aspect, extracting the fault data in the real-time data includes:
根据预先设定的故障数据抽取模型抽取所述实时训练数据中的故障数据。The fault data in the real-time training data is extracted according to a preset fault data extraction model.
在第一方面的一种可能的实现方式中,所述预先训练的故障预测模型包括生成网络和判别网络;In a possible implementation manner of the first aspect, the pre-trained fault prediction model includes a generation network and a discrimination network;
将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障预测模型,包括:Import the fault data into the preset fault prediction model for training to obtain a pre-trained fault prediction model, including:
生成噪声数据;generate noisy data;
将所述噪声数据导入至所述生成网络,得到假样本数据;importing the noise data into the generating network to obtain false sample data;
将所述故障数据作为真实数据,将所述真实数据和所述假样本数据作为输入,判别结果作为输出,并且将所述判别结果作为所述生成网络的反馈输入,根据预设的目标函数对所述判别网络和所述生成网络进行训练,得到预先训练的故障预测模型。The fault data is used as real data, the real data and the fake sample data are used as input, and the discrimination result is used as the output, and the discrimination result is used as the feedback input of the generation network, and according to the preset objective function The discrimination network and the generation network are trained to obtain a pre-trained fault prediction model.
在第一方面的一种可能的实现方式中,所述预设的目标函数为:In a possible implementation of the first aspect, the preset objective function is:
Figure PCTCN2022097396-appb-000001
Figure PCTCN2022097396-appb-000001
其中,
Figure PCTCN2022097396-appb-000002
表示预设的目标函数,D表示生成网络,G表示对抗网络,E表示期望函数,x表示故障数据,x~pdata(x)表示故障数据服从pdata(x)分布,z表示噪声数据,z~p (z)表示噪声数据服从p (z)分布,D(x)表示故障数据导入生成网络后输出的数据,G(z)表示噪声数据导入判定网络后输出的数据。
in,
Figure PCTCN2022097396-appb-000002
Represents the preset objective function, D represents the generation network, G represents the confrontation network, E represents the expected function, x represents the fault data, x~pdata(x) represents the fault data obeys the pdata(x) distribution, z represents the noise data, z~ p (z) indicates that the noise data obeys the p (z) distribution, D(x) indicates the output data after the fault data is imported into the generation network, and G(z) indicates the output data after the noise data is imported into the judgment network.
在第一方面的一种可能的实现方式中,根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果,包括:In a possible implementation manner of the first aspect, the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model, including:
将所述仿真数据和生成网络根据噪声数据生成的数据导入至判别网络,输出故障预测结果。The simulation data and the data generated by the generating network according to the noise data are imported into the discriminant network, and the fault prediction result is output.
在第一方面的一种可能的实现方式中,根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果之后,还包括:In a possible implementation manner of the first aspect, after the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model, the method further includes:
配准所述仿真数据和所述故障预测结果;registering the simulation data and the failure prediction results;
将配准后的仿真数据和故障预测结果发送至用户终端,以指示用户终端根据配准后的仿真数据和故障预测结果生成监控画面,并显示所述监控画面至用户。Sending the registered simulation data and fault prediction results to the user terminal to instruct the user terminal to generate a monitoring screen according to the registered simulation data and fault prediction results, and display the monitoring screen to the user.
第二方面,本申请实施例提供了一种基于数字孪生的故障预测装置,包括:In the second aspect, the embodiment of the present application provides a digital twin-based fault prediction device, including:
第一获取模块,用于获取目标真实对象的实时数据;The first acquisition module is used to acquire the real-time data of the target real object;
生成模块,用于根据所述实时数据生成数字孪生虚拟对象;A generating module, configured to generate a digital twin virtual object according to the real-time data;
第二获取模块,所述数字孪生虚拟模型中的仿真数据;The second acquisition module, the simulation data in the digital twin virtual model;
故障预测模块,用于根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果。The fault prediction module is used to obtain the fault prediction result according to the simulation data and the pre-trained fault prediction model.
在一种可能实现的方式中,所述装置还包括:In a possible implementation manner, the device further includes:
第三获取模块,用于获取目标真实对象的实时训练数据;The third obtaining module is used to obtain the real-time training data of the target real object;
提取模块,用于提取所述实时数据样本中的故障数据;An extraction module, configured to extract fault data in the real-time data samples;
训练模块,用于将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障 预测模型。The training module is used to import fault data into a preset fault prediction model for training to obtain a pre-trained fault prediction model.
在一种可能实现的方式中,所述提取模块包括:In a possible implementation manner, the extraction module includes:
抽取单元,用于根据预先设定的故障数据抽取模型抽取所述实时训练数据中的故障数据。The extraction unit is configured to extract fault data in the real-time training data according to a preset fault data extraction model.
在一种可能实现的方式中,所述预先训练的故障预测模型包括生成网络和判别网络;In a possible implementation manner, the pre-trained fault prediction model includes a generation network and a discrimination network;
所述训练模块,包括:The training modules include:
生成噪声数据;generate noisy data;
将所述噪声数据导入至所述生成网络,得到假样本数据;importing the noise data into the generating network to obtain false sample data;
将所述故障数据作为真实数据,将所述真实数据和所述假样本数据作为输入,判别结果作为输出,并且将所述判别结果作为所述生成网络的反馈输入,根据预设的目标函数对所述判别网络和所述生成网络进行训练,得到预先训练的故障预测模型。The fault data is used as real data, the real data and the fake sample data are used as input, and the discrimination result is used as the output, and the discrimination result is used as the feedback input of the generation network, and according to the preset objective function The discrimination network and the generation network are trained to obtain a pre-trained fault prediction model.
在一种可能实现的方式中,所述预设的目标函数为:In a possible implementation manner, the preset objective function is:
Figure PCTCN2022097396-appb-000003
Figure PCTCN2022097396-appb-000003
其中,
Figure PCTCN2022097396-appb-000004
表示预设的目标函数,D表示生成网络,G表示对抗网络,E表示期望函数,x表示故障数据,x~pdata(x)表示故障数据服从pdata(x)分布,z表示噪声数据,z~p (z)表示噪声数据服从p (z)分布,D(x)表示故障数据导入生成网络后输出的数据,G(z)表示噪声数据导入判定网络后输出的数据。
in,
Figure PCTCN2022097396-appb-000004
Represents the preset objective function, D represents the generation network, G represents the confrontation network, E represents the expected function, x represents the fault data, x~pdata(x) represents the fault data obeys the pdata(x) distribution, z represents the noise data, z~ p (z) indicates that the noise data obeys the p (z) distribution, D(x) indicates the output data after the fault data is imported into the generation network, and G(z) indicates the output data after the noise data is imported into the judgment network.
在一种可能实现的方式中,所述故障预测模块包括:In a possible implementation manner, the fault prediction module includes:
故障预测单元,用于将所述仿真数据和生成网络根据噪声数据生成的数据导入至判别网络,输出故障预测结果。The fault prediction unit is used to import the simulation data and the data generated by the generation network according to the noise data into the discrimination network, and output a fault prediction result.
在一种可能实现的方式中,所述基于数字孪生的故障诊断设备,还包括:In a possible implementation manner, the digital twin-based fault diagnosis equipment further includes:
配准模块,用于配准仿真数据和故障预测结果。The registration module is used to register simulation data and fault prediction results.
发送模块,用于将配准后的仿真数据和故障预测结果发送至用户终端,以指示用户终端显示监控画面至用户,所述监控画面包括所述目标真实对象的运行状态以及标记出的故障预测分析。A sending module, configured to send the registered simulation data and fault prediction results to the user terminal to instruct the user terminal to display a monitoring picture to the user, the monitoring picture including the operating status of the target real object and the marked fault prediction analyze.
第三方面,本申请实施例提供了一种服务器,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如上述第一方面所述的方法。In a third aspect, an embodiment of the present application provides a server, including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the computer program is implemented when the processor executes the computer program. The method as described in the first aspect above.
第四方面,本申请实施例提供了一种存储介质,所述计算机可读存储介质存储有计算机 程序,所述计算机程序被处理器执行时实现如上述第一方面所述的方法。In a fourth aspect, an embodiment of the present application provides a storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method as described in the first aspect above is implemented.
本申请实施例与现有技术相比存在的有益效果是:Compared with the prior art, the embodiments of the present application have the following beneficial effects:
本申请实施例中,通过获取目标真实对象的实时数据,根据实时数据生成数字孪生虚拟对象,获取数字孪生虚拟模型中的仿真数据,根据仿真数据,以及预先训练的故障预测模型,得到故障预测结果。可见,本申请实施例可以通过数字孪生技术结合预先训练的故障预测模型的无监督学习特性,达到对真实对象(例如生产线或者车间等)进行准确地故障预测的效果。In the embodiment of this application, by obtaining real-time data of the target real object, a digital twin virtual object is generated according to the real-time data, the simulation data in the digital twin virtual model is obtained, and the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model . It can be seen that the embodiment of the present application can achieve the effect of accurate fault prediction for real objects (such as production lines or workshops, etc.) by combining the digital twin technology with the unsupervised learning characteristics of the pre-trained fault prediction model.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the accompanying drawings that need to be used in the descriptions of the embodiments or the prior art will be briefly introduced below. Obviously, the accompanying drawings in the following description are only for the present application For some embodiments, those of ordinary skill in the art can also obtain other drawings based on these drawings without paying creative efforts.
图1是本申请实施例提供的基于数字孪生的故障预测方法的流程示意图;FIG. 1 is a schematic flow diagram of a digital twin-based fault prediction method provided in an embodiment of the present application;
图2是本申请实施例提供的基于数字孪生的故障预测方法的图1中步骤S108之前的流程示意图;Fig. 2 is a schematic flow chart before step S108 in Fig. 1 of the digital twin-based fault prediction method provided by the embodiment of the present application;
图3是本申请实施例提供的基于数字孪生的故障预测方法的图2中步骤S206的具体实现流程图;Fig. 3 is a specific implementation flowchart of step S206 in Fig. 2 of the digital twin-based fault prediction method provided by the embodiment of the present application;
图4是本申请实施例提供的基于数字孪生的故障预测方法的图2中步骤S204之后的流程示意图;Fig. 4 is a schematic flow chart after step S204 in Fig. 2 of the digital twin-based fault prediction method provided by the embodiment of the present application;
图5是本申请实施例提供的基于数字孪生的故障预测装置的结构示意图;FIG. 5 is a schematic structural diagram of a digital twin-based fault prediction device provided by an embodiment of the present application;
图6是本申请实施例提供的服务器的结构示意图;FIG. 6 is a schematic structural diagram of a server provided by an embodiment of the present application;
图7是本申请实施例提供的基于数字孪生的故障预测方法的故障预测模型的训练过程。Fig. 7 is the training process of the fault prediction model of the digital twin-based fault prediction method provided by the embodiment of the present application.
具体实施方式Detailed ways
以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、技术之类的具体细节,以便透彻理解本申请实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本申请。在其它情况中,省略对众所周知的系统、装置、电路以及方法的详细说明,以免不必要的细节妨碍本申请的描述。In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
应当理解,当在本申请说明书和所附权利要求书中使用时,术语“包括”指示所描述特征、整体、步骤、操作、元素和/或组件的存在,但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and/or components, but does not exclude one or more other Presence or addition of features, wholes, steps, operations, elements, components and/or collections thereof.
还应当理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。It should also be understood that the term "and/or" used in the description of the present application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.
如在本申请说明书和所附权利要求书中所使用的那样,术语“如果”可以依据上下文被解释为“当...时”或“一旦”或“响应于确定”或“响应于检测到”。类似地,短语“如果确定”或“如果检测到[所描述条件或事件]”可以依据上下文被解释为意指“一旦确定”或“响应于确定”或“一旦检测到[所描述条件或事件]”或“响应于检测到[所描述条件或事件]”。As used in this specification and the appended claims, the term "if" may be construed, depending on the context, as "when" or "once" or "in response to determining" or "in response to detecting ". Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be construed, depending on the context, to mean "once determined" or "in response to the determination" or "once detected [the described condition or event] ]” or “in response to detection of [described condition or event]”.
另外,在本申请说明书和所附权利要求书的描述中,术语“第一”、“第二”、“第三”等仅用于区分描述,而不能理解为指示或暗示相对重要性。In addition, in the description of the specification and appended claims of the present application, the terms "first", "second", "third" and so on are only used to distinguish descriptions, and should not be understood as indicating or implying relative importance.
在本申请说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此,在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例,而是意味着“一个或多个但不是所有的实施例”,除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”,除非是以其他方式另外特别强调。Reference to "one embodiment" or "some embodiments" or the like in the specification of the present application means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically stated otherwise. The terms "including", "comprising", "having" and variations thereof mean "including but not limited to", unless specifically stated otherwise.
为了方便理解本申请实施例,下面对一些本申请实施例涉及到的名称概念进行解释:In order to facilitate the understanding of the embodiments of the present application, the following explains the concepts of names involved in the embodiments of the present application:
数字孪生:数字孪生是充分利用物理模型、传感器更新、运行历史等数据,集成多学科、多物理量、多尺度、多概率的仿真过程,在虚拟空间中完成映射,从而反映相对应的实体装备的全生命周期过程。数字孪生是一种超越现实的概念,可以被视为一个或多个重要的、彼此依赖的装备系统的数字映射系统。Digital twin: Digital twin is a simulation process that makes full use of data such as physical models, sensor updates, and operating history, integrates multi-disciplinary, multi-physical quantities, multi-scale, and multi-probability, and completes the mapping in the virtual space to reflect the corresponding physical equipment. whole life cycle process. A digital twin is a concept beyond reality that can be viewed as a digital twin of one or more important, interdependent equipment systems.
下面将通过具体实施例对本申请实施例提供的技术方案进行介绍。The technical solutions provided by the embodiments of the present application will be introduced below through specific embodiments.
参见图1,为本申请实施例提供的基于数字孪生的故障预测方法的流程示意图,作为示例而非限定,该方法可以应用于服务器,该服务器与设置于目标真实对象的传感器之间连接,该服务器可以是云端服务器等计算设备,该方法可以包括以下步骤:Referring to FIG. 1 , it is a schematic flow diagram of a digital twin-based fault prediction method provided by the embodiment of the present application. As an example and not a limitation, the method can be applied to a server connected to a sensor set on a target real object. The server may be a computing device such as a cloud server, and the method may include the following steps:
步骤S102、获取目标真实对象的实时数据。Step S102, acquiring real-time data of the target real object.
其中,目标真实对象是指真实世界的生产线或车间等,实时数据包括静态数据(例如设备参数)和动态数据(例如设备运行状态)。具体应用中,通过设置在生产线或者车间中的各个设备上的传感器采集目标真实对象的实时数据。Wherein, the target real object refers to a real-world production line or workshop, etc., and real-time data includes static data (such as equipment parameters) and dynamic data (such as equipment operating status). In a specific application, the real-time data of the target real object is collected through sensors installed on various devices in the production line or workshop.
步骤S104、根据实时数据生成数字孪生虚拟对象。Step S104, generating a digital twin virtual object according to the real-time data.
其中,数字孪生虚拟对象是指与目标真实对象对应的数字孪生体。具体应用中,采用可 编辑逻辑控制器根据实时数据生成数字孪生虚拟对象。Among them, the digital twin virtual object refers to the digital twin corresponding to the target real object. In specific applications, an editable logic controller is used to generate digital twin virtual objects based on real-time data.
步骤S106、获取数字孪生虚拟模型中的仿真数据。Step S106, acquiring simulation data in the digital twin virtual model.
其中,仿真数据是指数字孪生虚拟模型根据实时数据动态映射目标真实对象的运行状况生成的数据。Among them, the simulation data refers to the data generated by the digital twin virtual model to dynamically map the operating conditions of the target real object according to the real-time data.
步骤S108、根据仿真数据,以及预先训练的故障预测模型,得到故障预测结果。Step S108 , according to the simulation data and the pre-trained fault prediction model, a fault prediction result is obtained.
其中,预先训练的故障预测模型包括生成网络和判别网络。Among them, the pre-trained fault prediction model includes a generative network and a discriminative network.
具体应用中,根据仿真数据,以及预先训练的故障预测模型,得到故障预测结果,包括:将仿真数据和生成网络根据噪声数据生成的数据导入至判别网络,输出故障预测结果。In a specific application, the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model, including: importing the simulation data and the data generated by the generation network based on the noise data into the discriminant network, and outputting the fault prediction result.
其中,故障预测结果为故障设备编号、故障类型、故障原因以及故障时间。Among them, the fault prediction result is the fault equipment number, fault type, fault cause and fault time.
可以理解的是,本申请实施例,根据判别网络对仿真数据和生成网络根据噪声数据生成的数据进行真实数据还是生成的样本进行判断,从而确定出仿真数据中的故障数据作为故障预测结果。It can be understood that, in the embodiment of the present application, the simulation data and the data generated by the generation network based on the noise data are judged as real data or generated samples according to the discrimination network, so as to determine the fault data in the simulation data as the fault prediction result.
在一种可选的实施方式中,如图2所示,为本申请实施例提供基于数字孪生的故障预测方法的图1中步骤S108之前的流程示意图,根据仿真数据,以及预先训练的故障预测模型,得到故障预测结果之前,还包括:In an optional implementation, as shown in Figure 2, the embodiment of the present application provides a schematic flow chart before step S108 in Figure 1 of the digital twin-based fault prediction method, based on simulation data and pre-trained fault prediction The model, before getting the fault prediction results, also includes:
步骤S202、获取目标真实对象的实时训练数据。Step S202, acquiring real-time training data of the target real object.
其中,实时训练数据是从开源数据集中获取的。Among them, real-time training data is obtained from open source datasets.
步骤S204、提取实时训练数据中的故障数据。Step S204, extracting fault data in the real-time training data.
其中,故障数据包括故障设备编号、故障类型、故障内容以及故障时间。Wherein, the fault data includes fault equipment number, fault type, fault content and fault time.
具体应用中,根据故障数据抽取模型直接对实时数据进行命名实体识别,提取出实体数据中故障设备编号、故障类型、故障内容以及故障时间。In the specific application, according to the fault data extraction model, the named entity recognition is directly carried out on the real-time data, and the fault equipment number, fault type, fault content and fault time in the entity data are extracted.
其中,故障数据抽取模型可以是在Bi-LSTM+CRF神经网络的基础上训练得到的。示例性地,在Bi-LSTM+CRF神经网络上训练得到故障数据抽取模型的过程可以是:Among them, the fault data extraction model can be trained on the basis of Bi-LSTM+CRF neural network. Exemplarily, the process of training the fault data extraction model on the Bi-LSTM+CRF neural network can be:
1、对实时训练数据中每个字进行标注,得到实时训练数据中每个字的标注类型,例如,对实时训练数据的每个字进行BIO标注,得到每个字的BIO标注类型。这里需要理解的是,所谓BIO标注,就是将每个元素标注为“B-X”、“I-X”或者“O”,其中,“B-X”表示此元素所在的片段属于X类型并且此元素在此片段的开头,“I-X”表示此元素所在的片段属于X类型并且此元素在此片段的中间位置,“O”表示不属于任何类型,“X”就是关键词所属的类别,本申请实施例的类别为故障设备编号、故障类型、故障内容以及故障时间等。1. Label each word in the real-time training data to obtain the label type of each word in the real-time training data, for example, perform BIO labeling on each word in the real-time training data to obtain the BIO label type of each word. What needs to be understood here is that the so-called BIO annotation is to mark each element as "B-X", "I-X" or "O", where "B-X" means that the segment where this element is located belongs to the X type and this element is in this segment. At the beginning, "I-X" indicates that the segment where the element is located belongs to the X type and the element is in the middle of the segment, "O" indicates that it does not belong to any type, and "X" is the category to which the keyword belongs. The category of the embodiment of this application is Faulty equipment number, fault type, fault content and fault time, etc.
2、将经过标注的实时训练数据输入Bi-LSTM神经网络模型,将实时训练数据划分为数 据段,每个数据段表示为x=(x1,x2,...,xn),其中,n表示数据段包含的字的数量,x{i}表示数据段的第i个字在字典中的id,进而可以得到每个字的one-hot向量,维数是字典大小。需说明的是,字典可以是预先下载的字符字典文件。2. Input the labeled real-time training data into the Bi-LSTM neural network model, divide the real-time training data into data segments, each data segment is expressed as x=(x1,x2,...,xn), where n represents The number of words contained in the data segment, x{i} represents the id of the i-th word in the data segment in the dictionary, and then the one-hot vector of each word can be obtained, and the dimension is the size of the dictionary. It should be noted that the dictionary may be a pre-downloaded character dictionary file.
3、将数据段输入至CRF神经网络模型,得到每个数据段对应的故障数据。3. Input the data segment into the CRF neural network model to obtain the fault data corresponding to each data segment.
4、根据预设的损失函数(例如绝对值损失函数)重复上述1-4的步骤,以训练Bi-LSTM神经网络模型和CRF神经网络模型,得到故障数据抽取模型。4. Repeat steps 1-4 above according to a preset loss function (such as an absolute value loss function) to train a Bi-LSTM neural network model and a CRF neural network model to obtain a fault data extraction model.
步骤S206、将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障预测模型。Step S206, importing the fault data into a preset fault prediction model for training to obtain a pre-trained fault prediction model.
具体应用中,将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障预测模型,包括:将故障数据和生成网络根据噪声数据生成的数据导入至判别网络,输出故障预测结果。In a specific application, the fault data is imported into the preset fault prediction model for training to obtain a pre-trained fault prediction model, including: importing the fault data and the data generated by the generation network based on the noise data to the discriminant network, and outputting the fault prediction result.
具体地,如图3所示,为本申请实施例提供的基于数字孪生的故障预测方法的图2中步骤S206的具体实现流程图,将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障预测模型,包括:Specifically, as shown in FIG. 3, it is a specific implementation flow chart of step S206 in FIG. 2 of the digital twin-based fault prediction method provided by the embodiment of the present application. The fault data is imported into the preset fault prediction model for training, and the obtained Pre-trained failure prediction models, including:
步骤S302、生成噪声数据。Step S302, generating noise data.
其中,噪声数据为随机生成变量,用来训练生成网络生成假样本数据。Among them, the noise data is randomly generated variables, which are used to train the generation network to generate fake sample data.
步骤S304、将噪声数据导入至生成网络,得到假样本数据。Step S304, importing the noise data into the generation network to obtain fake sample data.
其中,生成网络优选为朴素贝叶斯模型。Among them, the generating network is preferably a naive Bayesian model.
步骤S306、将故障数据作为真实数据,将真实数据和假样本数据作为输入,判别结果作为输出,并且将判别结果作为生成网络的反馈输入,根据预设的目标函数对判别网络和生成网络进行训练,得到预先训练的故障预测模型。Step S306, using the fault data as the real data, the real data and the fake sample data as the input, the discrimination result as the output, and the discrimination result as the feedback input of the generation network, and training the discrimination network and the generation network according to the preset objective function , to get the pre-trained fault prediction model.
其中,判别网络优选为决策树。Among them, the discriminant network is preferably a decision tree.
具体地,预设的目标函数为:Specifically, the preset objective function is:
Figure PCTCN2022097396-appb-000005
Figure PCTCN2022097396-appb-000005
其中,
Figure PCTCN2022097396-appb-000006
表示预设的目标函数,D表示生成网络,G表示对抗网络,E表示期望函数,X表示故障数据,x~pdata(x)表示故障数据服从pdata(x)分布,z表示噪声数据,z~p (z)表示噪声数据服从p (z)分布,D(x)表示故障数据导入生成网络后输出的数据,G(z)表示噪声数据导入判定网络后输出的数据。示例性地,pdata(x)分布、 p (z)分布分别可以是指高斯分别、均匀分布等。
in,
Figure PCTCN2022097396-appb-000006
Represents the preset objective function, D represents the generation network, G represents the confrontation network, E represents the expected function, X represents the fault data, x~pdata(x) represents the fault data obeys the pdata(x) distribution, z represents the noise data, z~ p (z) indicates that the noise data obeys the p (z) distribution, D(x) indicates the output data after the fault data is imported into the generation network, and G(z) indicates the output data after the noise data is imported into the judgment network. Exemplarily, pdata(x) distribution and p (z) distribution may respectively refer to Gaussian distribution, uniform distribution and the like.
示意性地,步骤S302-步骤S306的可参考如图7所示的故障预测模型的训练过程。Schematically, for steps S302 to S306, reference may be made to the training process of the fault prediction model as shown in FIG. 7 .
本申请实施例中,利用命名实体识别技术直接提取出故障数据对故障预测数据进行训练,不需要额外的人工进行数据标注,降低训练故障预测模型的训练难度。In the embodiment of the present application, the named entity recognition technology is used to directly extract the fault data to train the fault prediction data, without additional manual data labeling, which reduces the difficulty of training the fault prediction model.
在另一种可选的实施方式中,如图4所示,为本申请实施例提供的基于数字孪生的故障预测方法的图2中步骤S204之后的流程示意图,根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果之后,还包括:In another optional implementation, as shown in FIG. 4 , it is a schematic flow chart after step S204 in FIG. 2 of the digital twin-based fault prediction method provided by the embodiment of the present application. According to the simulation data, and The trained fault prediction model, after obtaining the fault prediction results, also includes:
步骤S402、配准仿真数据和故障预测结果。Step S402, registering the simulation data and the fault prediction result.
具体地,根据故障预测结果中的故障设备编号找到仿真数据对应的数字孪生虚拟模型中对应故障设备,然后给仿真数据对应的数字孪生虚拟模型中对应故障设备标记故障类型、故障原因以及故障时间。Specifically, find the corresponding faulty device in the digital twin virtual model corresponding to the simulation data according to the faulty device number in the fault prediction result, and then mark the fault type, fault cause and fault time for the corresponding faulty device in the digital twin virtual model corresponding to the simulation data.
步骤S404、将配准后的仿真数据和故障预测结果发送至用户终端,以指示用户终端根据配准后的仿真数据和故障预测结果生成监控画面,并显示监控画面至用户。Step S404, sending the registered simulation data and fault prediction results to the user terminal to instruct the user terminal to generate a monitoring screen according to the registered simulation data and fault prediction results, and display the monitoring screen to the user.
其中,监控画面包括数字孪生虚拟模型中各个设备的设备产生、设备运作状态以及故障设备的故障预测结果。Among them, the monitoring screen includes the equipment generation of each equipment in the digital twin virtual model, the equipment operation status and the fault prediction results of the faulty equipment.
可以理解的是,本申请实施例,通过数字孪生技术结合预先训练的故障预测模型得到仿真数据和故障预测结果,并根据仿真数据和故障预测结果生成监控画面显示给客户查看,以实现用户通过监控画面实时查看目标真实对象的运行状态以及目标真实对象中故障设备的预测分析,及时对故障设备进行检测。It can be understood that, in the embodiment of the present application, the simulation data and fault prediction results are obtained by combining the digital twin technology with the pre-trained fault prediction model, and a monitoring screen is generated according to the simulation data and fault prediction results for customers to view, so as to realize the user through monitoring. The screen can check the running status of the target real object and the prediction and analysis of the faulty equipment in the target real object in real time, and detect the faulty equipment in time.
本申请实施例中,通过获取目标真实对象的实时数据,根据实时数据生成数字孪生虚拟对象,获取数字孪生虚拟模型中的仿真数据,根据仿真数据,以及预先训练的故障预测模型,得到故障预测结果。可见,本申请实施例可以通过数字孪生技术结合预先训练的故障预测模型的无监督学习特性,达到对真实对象(例如生产线或者车间等)进行准确地故障预测的效果。In the embodiment of the present application, by obtaining real-time data of the target real object, a digital twin virtual object is generated according to the real-time data, the simulation data in the digital twin virtual model is obtained, and the fault prediction result is obtained according to the simulation data and the pre-trained fault prediction model . It can be seen that in the embodiment of the present application, the effect of accurate fault prediction on real objects (such as production lines or workshops) can be achieved by combining the digital twin technology with the unsupervised learning characteristics of the pre-trained fault prediction model.
应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that the sequence numbers of the steps in the above embodiments do not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiment of the present application.
对应于上文实施例所述的方法,图5示出了本申请实施例提供的基于数字孪生的故障预测装置的结构框图,为了便于说明,仅示出了与本申请实施例相关的部分。Corresponding to the method described in the above embodiment, Fig. 5 shows a structural block diagram of the digital twin-based fault prediction device provided by the embodiment of the present application. For the convenience of description, only the parts related to the embodiment of the present application are shown.
参照图5,该基于数字孪生的故障预测装置包括:Referring to Figure 5, the digital twin-based fault prediction device includes:
第一获取模块51,用于获取目标真实对象的实时数据;The first obtaining module 51 is used to obtain the real-time data of the target real object;
生成模块52,用于根据所述实时数据生成数字孪生虚拟对象;A generating module 52, configured to generate a digital twin virtual object according to the real-time data;
第二获取模块53,所述数字孪生虚拟模型中的仿真数据;The second acquisition module 53, the simulation data in the digital twin virtual model;
故障预测模块54,用于根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果。The fault prediction module 54 is configured to obtain a fault prediction result according to the simulation data and the pre-trained fault prediction model.
在一种可能实现的方式中,所述装置还包括:In a possible implementation manner, the device further includes:
第三获取模块,用于获取目标真实对象的实时训练数据;The third obtaining module is used to obtain the real-time training data of the target real object;
提取模块,用于提取所述实时数据样本中的故障数据;An extraction module, configured to extract fault data in the real-time data samples;
训练模块,用于将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障预测模型。The training module is used to import the fault data into a preset fault prediction model for training to obtain a pre-trained fault prediction model.
在一种可能实现的方式中,所述提取模块包括:In a possible implementation manner, the extraction module includes:
抽取单元,用于根据预先设定的故障数据抽取模型抽取所述实时训练数据中的故障数据。The extraction unit is configured to extract fault data in the real-time training data according to a preset fault data extraction model.
在一种可能实现的方式中,所述预先训练的故障预测模型包括生成网络和判别网络;In a possible implementation manner, the pre-trained fault prediction model includes a generation network and a discrimination network;
所述训练模块,包括:The training modules include:
生成噪声数据;generate noisy data;
将所述噪声数据导入至所述生成网络,得到假样本数据;importing the noise data into the generating network to obtain false sample data;
将所述故障数据作为真实数据,将所述真实数据和所述假样本数据作为输入,判别结果作为输出,并且将所述判别结果作为所述生成网络的反馈输入,根据预设的目标函数对所述判别网络和所述生成网络进行训练,得到预先训练的故障预测模型。The fault data is used as real data, the real data and the fake sample data are used as input, and the discrimination result is used as the output, and the discrimination result is used as the feedback input of the generation network, and according to the preset objective function The discrimination network and the generation network are trained to obtain a pre-trained fault prediction model.
在一种可能实现的方式中,所述预设的目标函数为:In a possible implementation manner, the preset objective function is:
Figure PCTCN2022097396-appb-000007
Figure PCTCN2022097396-appb-000007
其中,
Figure PCTCN2022097396-appb-000008
表示预设的目标函数,D表示生成网络,G表示对抗网络,E表示期望函数,X表示故障数据,x~pdata(x)表示故障数据服从pdata(x)分布,z表示噪声数据,z~p (z)表示噪声数据服从p (z)分布,D(x)表示故障数据导入生成网络后输出的数据,G(z)表示噪声数据导入判定网络后输出的数据。
in,
Figure PCTCN2022097396-appb-000008
Represents the preset objective function, D represents the generation network, G represents the confrontation network, E represents the expected function, X represents the fault data, x~pdata(x) represents the fault data obeys the pdata(x) distribution, z represents the noise data, z~ p (z) indicates that the noise data obeys the p (z) distribution, D(x) indicates the output data after the fault data is imported into the generation network, and G(z) indicates the output data after the noise data is imported into the judgment network.
在一种可能实现的方式中,所述故障预测模块包括:In a possible implementation manner, the fault prediction module includes:
故障预测单元,用于将所述仿真数据和生成网络根据噪声数据生成的数据导入至判别网络,输出故障预测结果。The fault prediction unit is used to import the simulation data and the data generated by the generation network according to the noise data into the discrimination network, and output a fault prediction result.
在一种可能实现的方式中,所述基于数字孪生的故障诊断设备,还包括:In a possible implementation manner, the digital twin-based fault diagnosis equipment further includes:
配准模块,用于配准仿真数据和故障预测结果。The registration module is used to register simulation data and fault prediction results.
发送模块,用于将配准后的仿真数据和故障预测结果发送至用户终端,以指示用户终端显示监控画面至用户,所述监控画面包括所述目标真实对象的运行状态以及标记出的故障预测分析。A sending module, configured to send the registered simulation data and fault prediction results to the user terminal to instruct the user terminal to display a monitoring picture to the user, the monitoring picture including the operating status of the target real object and the marked fault prediction analyze.
需要说明的是,上述装置/单元之间的信息交互、执行过程等内容,由于与本申请方法实施例基于同一构思,其具体功能及带来的技术效果,具体可参见方法实施例部分,此处不再赘述。It should be noted that the information interaction and execution process between the above-mentioned devices/units are based on the same concept as the method embodiment of the present application, and its specific functions and technical effects can be found in the method embodiment section. I won't repeat them here.
参照图6为本申请一实施例提供的服务器的结构示意图。如图6所示,该实施例的服务器6包括:至少一个处理器60处理器、存储器61以及存储在所述存储器61中并可在所述至少一个处理器60上运行的计算机程序62,所述处理器60执行所述计算机程序62时实现上述任意各个方法实施例中的步骤。Referring to FIG. 6 is a schematic structural diagram of a server provided by an embodiment of the present application. As shown in FIG. 6 , the server 6 of this embodiment includes: at least one processor 60, a memory 61, and a computer program 62 stored in the memory 61 and operable on the at least one processor 60, so When the processor 60 executes the computer program 62, the steps in any of the foregoing method embodiments are implemented.
所述服务器6可以是云端服务器等计算设备。该服务器可包括,但不仅限于,处理器60、存储器61。本领域技术人员可以理解,图6仅仅是服务器6的举例,并不构成对服务器6的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件,例如还可以包括输入输出设备、网络接入设备等。The server 6 may be a computing device such as a cloud server. The server may include, but not limited to, a processor 60 and a memory 61 . Those skilled in the art can understand that Fig. 6 is only an example of server 6, and does not constitute a limitation to server 6, and may include more or less components than those shown in the figure, or combine some components, or different components, for example It may also include input and output devices, network access devices, etc.
所称处理器60可以是中央处理单元(Central Processing Unit,CPU),该处理器60还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The so-called processor 60 can be a central processing unit (Central Processing Unit, CPU), and the processor 60 can also be other general processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit) , ASIC), off-the-shelf programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.
所述存储器61在一些实施例中可以是所述服务器6的内部存储单元,例如服务器6的硬盘或内存。所述存储器61在另一些实施例中也可以是所述服务器6的外部存储设备,例如所述服务器6上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。进一步地,所述存储器61还可以既包括所述服务器6的内部存储单元也包括外部存储设备。所述存储器61用于存储操作系统、应用程序、引导装载程序(BootLoader)、数据以及其他程序等,例如所述计算机程序的程序代码等。所述存储器61还可以用于暂时地存储已经输出或者将要输出的数据。The storage 61 may be an internal storage unit of the server 6 in some embodiments, such as a hard disk or memory of the server 6 . The memory 61 can also be an external storage device of the server 6 in other embodiments, such as a plug-in hard disk equipped on the server 6, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, flash memory card (Flash Card), etc. Further, the storage 61 may also include both an internal storage unit of the server 6 and an external storage device. The memory 61 is used to store operating system, application program, boot loader (BootLoader), data and other programs, such as the program code of the computer program. The memory 61 can also be used to temporarily store data that has been output or will be output.
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部 或者部分功能。实施例中的各功能单元、模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中,上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。另外,各功能单元、模块的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。上述系统中单元、模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and brevity of description, only the division of the above-mentioned functional units and modules is used for illustration. In practical applications, the above-mentioned functions can be assigned to different functional units, Completion of modules means that the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit, and the above-mentioned integrated units may adopt hardware It can also be implemented in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the above system, reference may be made to the corresponding process in the foregoing method embodiments, and details will not be repeated here.
本申请实施例还提供了一种存储介质,该存储介质为计算机可读存储介质,所述可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现可实现上述各个方法实施例中的步骤。The embodiment of the present application also provides a storage medium, the storage medium is a computer-readable storage medium, and the readable storage medium stores a computer program, and when the computer program is executed by a processor, it can realize the above-mentioned various method embodiments. in the steps.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实现上述实施例方法中的全部或部分流程,可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质至少可以包括:能够将计算机程序代码携带到的任何实体或装置、记录介质、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质。例如U盘、移动硬盘、磁碟或者光盘等。在某些司法管辖区,根据立法和专利实践,计算机可读介质不可以是电载波信号和电信信号。If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments in the present application can be completed by instructing related hardware through computer programs, and the computer programs can be stored in a computer-readable storage medium. The computer program When executed by a processor, the steps in the above-mentioned various method embodiments can be realized. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying computer program code, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random-access memory (RAM, Random Access Memory), electrical carrier signals, telecommunication signals, and software distribution media. Such as U disk, mobile hard disk, magnetic disk or CD, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunication signals under legislation and patent practice.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述或记载的部分,可以参见其它实施例的相关描述。In the above-mentioned embodiments, the descriptions of each embodiment have their own emphases, and for parts that are not detailed or recorded in a certain embodiment, refer to the relevant descriptions of other embodiments.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
在本申请所提供的实施例中,应该理解到,所揭露的装置/网络设备和方法,可以通过其它的方式实现。例如,以上所描述的装置/网络设备实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通讯连接可以是通过一些接口,装置或单元的 间接耦合或通讯连接,可以是电性,机械或其它的形式。In the embodiments provided in this application, it should be understood that the disclosed device/network device and method may be implemented in other ways. For example, the device/network device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units Or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
以上所述实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still implement the foregoing embodiments Modifications to the technical solutions described in the examples, or equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the application, and should be included in the Within the protection scope of this application.

Claims (10)

  1. 一种基于数字孪生的故障预测方法,其特征在于,包括:A method for fault prediction based on digital twins, characterized in that it includes:
    获取目标真实对象的实时数据;Obtain real-time data of the target real object;
    根据所述实时数据生成数字孪生虚拟对象;generating a digital twin virtual object based on said real-time data;
    获取所述数字孪生虚拟模型中的仿真数据;Obtain the simulation data in the digital twin virtual model;
    根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果。According to the simulation data and the pre-trained fault prediction model, a fault prediction result is obtained.
  2. 如权利要求1所述的基于数字孪生的故障预测方法,其特征在于,将所述仿真数据输入至预先训练的故障预测模型中,得到故障预测结果之前,还包括:The fault prediction method based on digital twins according to claim 1, wherein the simulation data is input into a pre-trained fault prediction model, and before the fault prediction result is obtained, it also includes:
    获取目标真实对象的实时训练数据;Obtain real-time training data of the target real object;
    提取所述实时数据样本中的故障数据;extracting fault data in the real-time data sample;
    将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障预测模型。Import the fault data into the preset fault prediction model for training to obtain a pre-trained fault prediction model.
  3. 如权利要求2所述的基于数字孪生的故障预测方法,其特征在于,提取所述实时数据中的故障数据,包括:The fault prediction method based on digital twins according to claim 2, wherein extracting the fault data in the real-time data comprises:
    根据预先设定的故障数据抽取模型抽取所述实时训练数据中的故障数据。The fault data in the real-time training data is extracted according to a preset fault data extraction model.
  4. 如权利要求2所述的基于数字孪生的故障预测方法,其特征在于,所述预先训练的故障预测模型包括生成网络和判别网络;The fault prediction method based on digital twins according to claim 2, wherein the pre-trained fault prediction model includes a generation network and a discrimination network;
    将故障数据导入至预设的故障预测模型进行训练,得到预先训练的故障预测模型,包括:Import the fault data into the preset fault prediction model for training to obtain a pre-trained fault prediction model, including:
    生成噪声数据;generate noisy data;
    将所述噪声数据导入至所述生成网络,得到假样本数据;importing the noise data into the generating network to obtain false sample data;
    将所述故障数据作为真实数据,将所述真实数据和所述假样本数据作为输入,判别结果作为输出,并且将所述判别结果作为所述生成网络的反馈输入,根据预设的目标函数对所述判别网络和所述生成网络进行训练,得到预先训练的故障预测模型。The fault data is used as real data, the real data and the fake sample data are used as input, and the discrimination result is used as the output, and the discrimination result is used as the feedback input of the generation network, and according to the preset objective function The discrimination network and the generation network are trained to obtain a pre-trained fault prediction model.
  5. 如权利要求4所述的基于数字孪生的故障预测方法,其特征在于,所述预设的目标函数为:The fault prediction method based on digital twins according to claim 4, wherein the preset objective function is:
    Figure PCTCN2022097396-appb-100001
    Figure PCTCN2022097396-appb-100001
    其中,
    Figure PCTCN2022097396-appb-100002
    表示预设的目标函数,D表示生成网络,G表示对抗网络,E表示期望函数,x表示故障数据,x~pdata(x)表示故障数据服从pdata(x)分布,z表示噪声数据,z~p (z)表示噪声数据服从p (z)分布,D(x)表示故障数据导入生成网络后输 出的数据,G(z)表示噪声数据导入判定网络后输出的数据。
    in,
    Figure PCTCN2022097396-appb-100002
    Represents the preset objective function, D represents the generation network, G represents the confrontation network, E represents the expected function, x represents the fault data, x~pdata(x) represents the fault data obeys the pdata(x) distribution, z represents the noise data, z~ p (z) indicates that the noise data obeys the p (z) distribution, D(x) indicates the output data after the fault data is imported into the generation network, and G(z) indicates the output data after the noise data is imported into the judgment network.
  6. 如权利要求1至5任一项所述的基于数字孪生的故障预测方法,其特征在于,根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果,包括:The digital twin-based fault prediction method according to any one of claims 1 to 5, wherein the fault prediction results are obtained according to the simulation data and the pre-trained fault prediction model, including:
    将所述仿真数据和生成网络根据噪声数据生成的数据导入至判别网络,输出故障预测结果。The simulation data and the data generated by the generating network according to the noise data are imported into the discriminant network, and the fault prediction result is output.
  7. 如权利要求1至5任一项所述的基于数字孪生的故障预测方法,其特征在于,根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果之后,还包括:The digital twin-based fault prediction method according to any one of claims 1 to 5, wherein, after obtaining the fault prediction result according to the simulation data and the pre-trained fault prediction model, further comprising:
    配准所述仿真数据和所述故障预测结果;registering the simulation data and the failure prediction result;
    将配准后的仿真数据和故障预测结果发送至用户终端,以指示用户终端根据配准后的仿真数据和故障预测结果生成监控画面,并显示所述监控画面至用户。Sending the registered simulation data and fault prediction results to the user terminal to instruct the user terminal to generate a monitoring screen according to the registered simulation data and fault prediction results, and display the monitoring screen to the user.
  8. 一种基于数字孪生的故障预测装置,其特征在于,包括:A fault prediction device based on digital twins, characterized in that it includes:
    第一获取模块,用于获取目标真实对象的实时数据;The first acquisition module is used to acquire the real-time data of the target real object;
    生成模块,用于根据所述实时数据生成数字孪生虚拟对象;A generating module, configured to generate a digital twin virtual object according to the real-time data;
    第二获取模块,用于获取所述数字孪生虚拟模型中的仿真数据;The second acquisition module is used to acquire the simulation data in the digital twin virtual model;
    预测模块,用于根据所述仿真数据,以及预先训练的故障预测模型,得到故障预测结果。The prediction module is used to obtain the fault prediction result according to the simulation data and the pre-trained fault prediction model.
  9. 一种服务器,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如权利要求1至7任一项所述的方法。A server, comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, wherein the computer program according to claims 1 to 7 is implemented when the processor executes the computer program. any one of the methods described.
  10. 一种存储介质,所述存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至7任一项所述的方法。A storage medium storing a computer program, wherein the computer program implements the method according to any one of claims 1 to 7 when executed by a processor.
PCT/CN2022/097396 2021-06-09 2022-06-07 Fault prediction method and apparatus based on digital twin, server, and storage medium WO2022257925A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110644072.X 2021-06-09
CN202110644072.XA CN113379123A (en) 2021-06-09 2021-06-09 Fault prediction method, device, server and storage medium based on digital twin

Publications (1)

Publication Number Publication Date
WO2022257925A1 true WO2022257925A1 (en) 2022-12-15

Family

ID=77573235

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/097396 WO2022257925A1 (en) 2021-06-09 2022-06-07 Fault prediction method and apparatus based on digital twin, server, and storage medium

Country Status (2)

Country Link
CN (1) CN113379123A (en)
WO (1) WO2022257925A1 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116026367A (en) * 2023-03-29 2023-04-28 中国人民解放军火箭军工程大学 Digital twin technology-based laser inertial measurement unit fault diagnosis method, system and equipment
CN116319260A (en) * 2023-05-09 2023-06-23 新华三技术有限公司 Network fault diagnosis method, device, equipment and storage medium
CN116776744A (en) * 2023-08-15 2023-09-19 工业云制造(四川)创新中心有限公司 Equipment manufacturing control method based on augmented reality and electronic equipment
CN116861204A (en) * 2023-09-05 2023-10-10 山东山森数控技术有限公司 Intelligent manufacturing equipment data management system based on digital twinning
CN116885858A (en) * 2023-09-08 2023-10-13 中国标准化研究院 Power distribution network fault processing method and system based on digital twin technology
CN116956720A (en) * 2023-07-19 2023-10-27 安徽斯维尔信息科技有限公司 Industrial digital twin simulation operation and maintenance system
CN116977122A (en) * 2023-07-06 2023-10-31 双龙软创(深圳)科技有限公司 Remote automatic monitoring method for dangerous rooms based on digital twin technology
CN116881672B (en) * 2023-09-05 2023-11-21 江西南昌济生制药有限责任公司 Fault detection model training method and device, electronic equipment and storage medium
CN117130351A (en) * 2023-09-18 2023-11-28 上海勘测设计研究院有限公司 New energy station area joint control protection system based on digital twin technology
CN117148048A (en) * 2023-10-30 2023-12-01 国网江苏省电力有限公司南通供电分公司 Power distribution network fault prediction method and system based on digital twin technology
CN117318033A (en) * 2023-09-27 2023-12-29 国网江苏省电力有限公司南通供电分公司 Power grid data management method and system combining data twinning
CN117349102A (en) * 2023-12-05 2024-01-05 网思科技股份有限公司 Digital twin operation and maintenance data quality inspection method, system and medium

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113379123A (en) * 2021-06-09 2021-09-10 中德(珠海)人工智能研究院有限公司 Fault prediction method, device, server and storage medium based on digital twin
CN113923000B (en) * 2021-09-29 2023-11-03 卡奥斯数字科技(青岛)有限公司 Security processing method and device, electronic equipment and storage medium
CN113844507B (en) * 2021-10-22 2023-10-10 暨南大学 Train simulation operation system construction method based on digital twin
CN113886973B (en) * 2021-10-25 2023-04-18 江苏远望仪器集团有限公司 Ship navigational speed processing method, device and processing equipment based on virtual-real mapping
CN114184883A (en) * 2021-11-22 2022-03-15 国网河南省电力公司漯河供电公司 Distribution network fault detection precision calculation method based on distribution network fault simulation
CN114218754A (en) * 2021-11-23 2022-03-22 中国电子产品可靠性与环境试验研究所((工业和信息化部电子第五研究所)(中国赛宝实验室)) Unmanned aerial vehicle digital twinning method, system, computer equipment and storage medium
CN114373047B (en) * 2021-12-29 2023-05-12 达闼机器人股份有限公司 Method, device and storage medium for monitoring physical world based on digital twin
CN114826440B (en) * 2022-03-31 2023-11-24 文山电视调频骨干转播台 Transmitter monitoring fault positioning method based on digital twinning
CN114897196B (en) * 2022-05-11 2023-01-13 山东大卫国际建筑设计有限公司 Operation management method, equipment and medium for office building water supply network
CN114707428B (en) * 2022-06-01 2022-09-02 中科航迈数控软件(深圳)有限公司 Method, device, terminal and storage medium for simulating unobservable links of numerical control machine tool
CN115356639B (en) * 2022-09-29 2023-04-18 深圳先进技术研究院 Intelligent health monitoring method and system for bidirectional lithium ion battery
CN116071039B (en) * 2022-12-21 2024-01-19 广州辰创科技发展有限公司 Fault diagnosis method based on fault tree
CN116011991B (en) * 2022-12-30 2023-12-19 中国电子科技集团公司第三十八研究所 Multi-user collaborative task guaranteeing method based on agent and backup technology
CN116108717B (en) * 2023-01-17 2023-09-26 中山大学 Traffic transportation equipment operation prediction method and device based on digital twin
CN116184293B (en) * 2023-03-01 2024-02-13 深圳市中科恒辉科技有限公司 Fault diagnosis method and alarm system based on digital twin lithium battery system
CN116451878A (en) * 2023-06-16 2023-07-18 山东捷瑞数字科技股份有限公司 Fault prediction method, device, equipment and medium based on digital twin technology
CN117289685B (en) * 2023-11-27 2024-02-02 青岛创新奇智科技集团股份有限公司 Production line fault prediction and self-healing method and system based on artificial intelligence

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190325572A1 (en) * 2018-04-20 2019-10-24 Siemens Healthcare Gmbh Real-time and accurate soft tissue deformation prediction
CN111008502A (en) * 2019-11-25 2020-04-14 北京航空航天大学 Fault prediction method for complex equipment driven by digital twin
CN111400930A (en) * 2020-04-09 2020-07-10 武汉大学 Power equipment small sample fault diagnosis method and system based on virtual and real twin space
CN111458142A (en) * 2020-04-02 2020-07-28 苏州智传新自动化科技有限公司 Sliding bearing fault diagnosis method based on generation of countermeasure network and convolutional neural network
CN111596604A (en) * 2020-06-12 2020-08-28 中国科学院重庆绿色智能技术研究院 Intelligent fault diagnosis and self-healing control system and method for engineering equipment based on digital twinning
CN112418455A (en) * 2020-11-28 2021-02-26 北京三维天地科技股份有限公司 Equipment failure prediction and health management system
CN113379123A (en) * 2021-06-09 2021-09-10 中德(珠海)人工智能研究院有限公司 Fault prediction method, device, server and storage medium based on digital twin

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111461338A (en) * 2020-03-06 2020-07-28 北京仿真中心 Intelligent system updating method and device based on digital twin
CN112382064B (en) * 2020-11-12 2023-01-20 广东电网有限责任公司 Power Internet of things fault early warning method and system based on digital twin technology

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190325572A1 (en) * 2018-04-20 2019-10-24 Siemens Healthcare Gmbh Real-time and accurate soft tissue deformation prediction
CN111008502A (en) * 2019-11-25 2020-04-14 北京航空航天大学 Fault prediction method for complex equipment driven by digital twin
CN111458142A (en) * 2020-04-02 2020-07-28 苏州智传新自动化科技有限公司 Sliding bearing fault diagnosis method based on generation of countermeasure network and convolutional neural network
CN111400930A (en) * 2020-04-09 2020-07-10 武汉大学 Power equipment small sample fault diagnosis method and system based on virtual and real twin space
CN111596604A (en) * 2020-06-12 2020-08-28 中国科学院重庆绿色智能技术研究院 Intelligent fault diagnosis and self-healing control system and method for engineering equipment based on digital twinning
CN112418455A (en) * 2020-11-28 2021-02-26 北京三维天地科技股份有限公司 Equipment failure prediction and health management system
CN113379123A (en) * 2021-06-09 2021-09-10 中德(珠海)人工智能研究院有限公司 Fault prediction method, device, server and storage medium based on digital twin

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116026367A (en) * 2023-03-29 2023-04-28 中国人民解放军火箭军工程大学 Digital twin technology-based laser inertial measurement unit fault diagnosis method, system and equipment
CN116319260A (en) * 2023-05-09 2023-06-23 新华三技术有限公司 Network fault diagnosis method, device, equipment and storage medium
CN116319260B (en) * 2023-05-09 2023-08-18 新华三技术有限公司 Network fault diagnosis method, device, equipment and storage medium
CN116977122A (en) * 2023-07-06 2023-10-31 双龙软创(深圳)科技有限公司 Remote automatic monitoring method for dangerous rooms based on digital twin technology
CN116977122B (en) * 2023-07-06 2024-04-19 双龙软创(深圳)科技有限公司 Remote automatic monitoring method for dangerous rooms based on digital twin technology
CN116956720B (en) * 2023-07-19 2024-01-30 安徽斯维尔信息科技有限公司 Industrial digital twin simulation operation and maintenance system
CN116956720A (en) * 2023-07-19 2023-10-27 安徽斯维尔信息科技有限公司 Industrial digital twin simulation operation and maintenance system
CN116776744A (en) * 2023-08-15 2023-09-19 工业云制造(四川)创新中心有限公司 Equipment manufacturing control method based on augmented reality and electronic equipment
CN116776744B (en) * 2023-08-15 2023-10-31 工业云制造(四川)创新中心有限公司 Equipment manufacturing control method based on augmented reality and electronic equipment
CN116881672B (en) * 2023-09-05 2023-11-21 江西南昌济生制药有限责任公司 Fault detection model training method and device, electronic equipment and storage medium
CN116861204A (en) * 2023-09-05 2023-10-10 山东山森数控技术有限公司 Intelligent manufacturing equipment data management system based on digital twinning
CN116861204B (en) * 2023-09-05 2023-12-08 山东山森数控技术有限公司 Intelligent manufacturing equipment data management system based on digital twinning
CN116885858A (en) * 2023-09-08 2023-10-13 中国标准化研究院 Power distribution network fault processing method and system based on digital twin technology
CN116885858B (en) * 2023-09-08 2023-12-08 中国标准化研究院 Power distribution network fault processing method and system based on digital twin technology
CN117130351A (en) * 2023-09-18 2023-11-28 上海勘测设计研究院有限公司 New energy station area joint control protection system based on digital twin technology
CN117130351B (en) * 2023-09-18 2024-03-19 上海勘测设计研究院有限公司 New energy station area joint control protection system based on digital twin technology
CN117318033A (en) * 2023-09-27 2023-12-29 国网江苏省电力有限公司南通供电分公司 Power grid data management method and system combining data twinning
CN117148048B (en) * 2023-10-30 2024-01-12 国网江苏省电力有限公司南通供电分公司 Power distribution network fault prediction method and system based on digital twin technology
CN117148048A (en) * 2023-10-30 2023-12-01 国网江苏省电力有限公司南通供电分公司 Power distribution network fault prediction method and system based on digital twin technology
CN117349102A (en) * 2023-12-05 2024-01-05 网思科技股份有限公司 Digital twin operation and maintenance data quality inspection method, system and medium
CN117349102B (en) * 2023-12-05 2024-03-15 网思科技股份有限公司 Digital twin operation and maintenance data quality inspection method, system and medium

Also Published As

Publication number Publication date
CN113379123A (en) 2021-09-10

Similar Documents

Publication Publication Date Title
WO2022257925A1 (en) Fault prediction method and apparatus based on digital twin, server, and storage medium
CN110363220B (en) Behavior class detection method and device, electronic equipment and computer readable medium
CN112990294B (en) Training method and device of behavior discrimination model, electronic equipment and storage medium
CN111915437A (en) RNN-based anti-money laundering model training method, device, equipment and medium
CN112434194A (en) Similar user identification method, device, equipment and medium based on knowledge graph
CN112036187A (en) Context-based video barrage text auditing method and system
CN112883990A (en) Data classification method and device, computer storage medium and electronic equipment
CN114143049A (en) Abnormal flow detection method, abnormal flow detection device, storage medium and electronic equipment
CN114584377A (en) Flow anomaly detection method, model training method, device, equipment and medium
CN101414352A (en) Information processing apparatus, information processing method, and program
CN115774784A (en) Text object identification method and device
CN113706207A (en) Order transaction rate analysis method, device, equipment and medium based on semantic analysis
CN113987188A (en) Short text classification method and device and electronic equipment
CN113591881A (en) Intention recognition method and device based on model fusion, electronic equipment and medium
CN111611981A (en) Information identification method and device and information identification neural network training method and device
CN110929033A (en) Long text classification method and device, computer equipment and storage medium
CN110715799A (en) Method and device for detecting mechanical state of circuit breaker and terminal equipment
CN116911883B (en) Agricultural product anti-counterfeiting tracing method and cloud platform based on AI (advanced technology) authentication technology and tracing quantification
CN114005005B (en) Double-batch standardized zero-instance image classification method
CN113723524B (en) Data processing method based on prediction model, related equipment and medium
CN117591813B (en) Complex equipment fault diagnosis method and system based on multidimensional features
CN113111713B (en) Image detection method and device, electronic equipment and storage medium
CN110728615B (en) Steganalysis method based on sequential hypothesis testing, terminal device and storage medium
CN117011213A (en) Training method and related device for defect detection model
CN117271674A (en) Method and device for identifying field type, electronic equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22819523

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE