CN116089228A

CN116089228A - Equipment state information processing method, device, equipment and storage medium

Info

Publication number: CN116089228A
Application number: CN202310024293.6A
Authority: CN
Inventors: 李敏
Original assignee: Alibaba Cloud Computing Ltd
Current assignee: Alibaba Cloud Computing Ltd
Priority date: 2023-01-09
Filing date: 2023-01-09
Publication date: 2023-05-09

Abstract

The embodiment of the application provides a device state information processing method, device, equipment and storage medium. In the embodiment of the application, aiming at the component monitoring requirement of the target equipment, a digital twin model of the target equipment is obtained, the historical operation state of the twin model is replayed, in the replay process, the historical operation state of a twin component in the digital twin model is monitored, and the target twin component meeting the monitoring condition or generating abnormality is highlighted. The component monitoring is carried out based on the historical running state of the twin component in the playback process, so that the accuracy of a component monitoring result can be greatly improved; through playback of historical running states of the digital twin model and protruding display of the target twin assembly, visualization of the component monitoring process can be achieved, and the component monitoring process is more visual and reliable. Furthermore, the component monitoring can be more targeted through configuration operation, so that the efficiency of component monitoring is improved, and resources are saved.

Description

Equipment state information processing method, device, equipment and storage medium

Technical Field

The present disclosure relates to the field of digital twin visualization technologies, and in particular, to a device status information processing method, apparatus, device, and storage medium.

Background

Along with the wider and wider application of the internet of things, the abnormal situations of the internet of things equipment are more and more, so that the abnormal diagnosis of the internet of things equipment becomes important in the scene of the internet of things. Generally, abnormality diagnosis is performed on the internet of things equipment depending on the historical operation state of the internet of things equipment, and abnormal components in the internet of things equipment are found through backtracking of the historical operation state, so that abnormality processing is performed.

At present, the historical running state of the Internet of things equipment is traced back, and the method is mainly realized by searching and analyzing the historical log data of the Internet of things equipment stored locally or uploaded to the cloud. The backtracking mode directly based on the log data is not high in accuracy of finding abnormal parts and is not intuitive.

Disclosure of Invention

Aspects of the present application provide a device state information processing method, apparatus, device, and storage medium, which are used for discovering components meeting monitoring conditions and performing salient display in a mode of playing back historical operating states through a digital twin model, so as to improve accuracy and intuitiveness of component discovery.

The embodiment of the application provides a device state information processing method, which comprises the following steps: acquiring a digital twin model of a target device, wherein the digital twin model is associated with historical attribute time sequence data corresponding to the target device and comprises at least one twin component corresponding to the target device; responding to configuration operation, and configuring target twin attributes to be monitored and target monitoring conditions corresponding to the target twin attributes for the target twin components in the at least one twin component; according to the historical attribute time sequence data, carrying out playback of the historical operation state of the digital twin model in a twin visual interface, and monitoring the historical operation state of the target twin assembly according to the target twin attribute in the playback process; and under the condition that the historical running state of the target twin component meets the target monitoring condition, the target twin component is highlighted.

The embodiment of the application also provides a device state information processing method, which comprises the following steps: acquiring a digital twin model of a target device, wherein the digital twin model is associated with historical attribute time sequence data of the target device and comprises at least one twin component corresponding to the target device; according to the historical attribute time sequence data, playing back the historical running state of the digital twin model, and monitoring the historical running state of the at least one twin component in the playing back process; and under the condition that the target twin component with abnormal historical operating state is monitored, the target twin component is highlighted.

The embodiment of the application provides a device state information processing apparatus, which comprises: the acquisition module is used for acquiring a digital twin model of the target equipment, wherein the digital twin model is associated with historical attribute time sequence data corresponding to the target equipment and comprises at least one twin component corresponding to the target equipment; the configuration module is used for responding to configuration operation, and configuring target twin attributes to be monitored and target monitoring conditions corresponding to the target twin attributes for the target twin components in the at least one twin component; the playback module is used for playing back the historical running state of the digital twin model in a twin visual interface according to the historical attribute time sequence data; the monitoring module is used for monitoring the historical running state of the target twin assembly according to the target twin attribute in the playback process of the playback module; and the display module is used for displaying the target twin component in a protruding mode under the condition that the monitoring module monitors that the historical operation state of the target twin component meets the target monitoring condition.

The embodiment of the application also provides electronic equipment, which comprises: a memory and a processor; the memory is used for storing a computer program; the processor is coupled to the memory, and is configured to execute the computer program to implement steps in any of the device state information processing methods provided in the embodiments of the present application.

The present embodiments also provide a computer-readable storage medium storing a computer program, which when executed by a processor, causes the processor to implement steps in any of the device state information processing methods provided in the embodiments of the present application.

In the embodiment of the application, aiming at the component monitoring requirement of the target equipment, a digital twin model of the target equipment is obtained, the historical operation state of twin components in the digital twin model is monitored through playback of the historical operation state of the digital twin model, the configured target twin components can be monitored through configuration operation according to configured twin attributes and monitoring conditions, all components in the digital twin model can be monitored uniformly, and the target twin components which meet the monitoring conditions or are abnormal are monitored to be highlighted. The component monitoring is performed based on the historical running state of the twin component in the playback process, and compared with a retrieval analysis scheme based on log data, the accuracy of a component monitoring result can be greatly improved; in addition, through playback of the historical running state of the digital twin model and protruding display of the target twin assembly, visualization of the component monitoring process can be achieved, and the component monitoring process is more visual and reliable.

Further, component monitoring is allowed to be carried out by configuration operation aiming at the configured twin component, twin attribute and monitoring condition, so that the component monitoring is more targeted, the accuracy of a component monitoring result is improved, unnecessary component monitoring operation can be saved, the efficiency of component monitoring is improved, and monitoring resources and cost are saved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:

fig. 1 is a schematic structural diagram of a device management system based on digital twinning according to an embodiment of the present application;

fig. 2a is a schematic diagram of an application scenario provided in an embodiment of the present application;

fig. 2b is a schematic diagram of another application scenario provided in an embodiment of the present application;

fig. 3 is a flow chart of a method for processing device status information according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a twinning visual interface provided by an embodiment of the present application;

fig. 5 is a flowchart of another method for processing device status information according to an embodiment of the present application;

Fig. 6 is a schematic structural diagram of an apparatus status information processing device according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

For the purposes, technical solutions and advantages of the present application, the technical solutions of the present application will be clearly and completely described below with reference to specific embodiments of the present application and corresponding drawings. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

Aiming at the technical problems that whether abnormal parts exist in the Internet of things equipment or not is found by the existing historical log data stored locally or uploaded to the cloud, the accuracy existing in the Internet of things equipment is not high and is not visual enough, the embodiment of the application provides an equipment state information processing method, device and storage medium. The component monitoring is performed based on the historical running state of the twin component in the playback process, and compared with a retrieval analysis scheme based on log data, the accuracy of a component monitoring result can be greatly improved; in addition, through playback of the historical running state of the digital twin model and protruding display of the target twin assembly, visualization of the component monitoring process can be achieved, and the component monitoring process is more visual and reliable.

Further, in some embodiments, component monitoring is allowed to be performed by configuration operation for configured twin components, twin attributes and monitoring conditions, so that component monitoring can be more targeted, accuracy of component monitoring results can be improved further, unnecessary component monitoring operation can be saved, efficiency of component monitoring can be improved, and monitoring resources and cost can be saved.

The following describes in detail the technical solutions provided by the embodiments of the present application with reference to the accompanying drawings.

In order to realize the monitoring of the target device, the embodiment of the application provides a device management system based on digital twinning, as shown in fig. 1, the system comprises: a twinning scene modeling module 10 and a twinning scene playback module 20.

The twin scene modeling module 10 has twin scene modeling capability, and is mainly used for constructing a digital twin model for a target device, and is responsible for providing the digital twin model of the target device for the twin scene playback module 20. Further, according to the application requirement, the twin scene modeling module 10 may also construct a digital twin model for other devices in the application scene where the target device is located, so as to form a digital twin scene corresponding to the whole application scene.

In this embodiment, the digital twin model of the target device is a mapping of the target device in the digital world, including at least one twin component corresponding to the target device, each twin component corresponding to one device component on the target device. The digital twin model and the target equipment are provided with two-way association, real-time data and states of the target equipment can be reflected to the digital twin model in real time or in quasi-real time, and some information can be fed back to the target equipment based on the digital twin model, so that the actions or states of the target equipment are interfered. In addition, the digital twin model has visualization capabilities (i.e., can be displayed).

In this embodiment, the digital twin model constructed by the twin scene modeling module 10 has the capability of associating the attribute field corresponding to the target device with the historical attribute time series data (i.e., associating the attribute field corresponding to the target device with the historical attribute time series data) in addition to the capability of representing the real-time data and the state of the target device in real time or near real time. Based on this, after a digital twin model of the target device is constructed, the digital twin model may be associated with the attribute fields of the target device and the corresponding historical attribute timing data. The target device has some attributes, the attributes can have different values according to different running states of the target device, and the values of the attributes at different historical moments form historical attribute time sequence data.

In this embodiment, the digital twin model is enabled to have the capability of playing back the historical running state by associating the digital twin model with the attribute field corresponding to the target device and the historical attribute time sequence data. The method provides a basis for the playback of the historical operating state through the digital twin model, and the monitoring of the historical operating state of the twin components in the digital twin model during the playback.

The twinning scene playback module 20 may provide a twinning visual interface and have the capability of historical operating state playback of digital twinning models. In the embodiment of the application, the implementation form of the twinning visual interface is not limited, and all interface forms capable of carrying out digital twinning model display are suitable for the embodiment of the application.

Specifically, the twin scene playback module 20 may acquire a digital twin model of the target device constructed by the twin scene modeling module 10, and display the digital twin model in the twin visual interface; and according to the historical attribute time sequence data associated with the digital twin model, playing back the historical running state of the digital twin model in a twin visual interface, completing monitoring of the historical running state of the twin component in the playing back process, and when the twin component meeting the monitoring condition (such as an abnormal twin component or a twin component needing performance optimization) is found, highlighting the twin component so as to remind a user that the twin component meets the monitoring condition and needs to pay important attention, thereby playing an obvious reminding role. The component monitoring is carried out based on the historical running state of the twin component in the playback process, and compared with a retrieval analysis scheme based on log data, the accuracy of a component monitoring result can be greatly improved; in addition, through playback of the historical running state of the digital twin model and protruding display of the target twin assembly, visualization of the component monitoring process can be achieved, and the component monitoring process is more visual and reliable.

In some embodiments, the twin scene playback module 20 may uniformly monitor the historical running states of each twin component during the playback process, discover the target twin component that meets the monitoring conditions according to the preset monitoring conditions, and highlight the target twin component.

In other embodiments, the twinning scene playback module 20 allows for the selection of a target twinning component to be monitored by a configuration operation, and configures a target twinning attribute to be monitored and a target monitoring condition corresponding to the target twinning attribute for the selected target twinning component. In this way, in the playback process, the historical operation state of the target twin component can be monitored with emphasis according to the target twin attribute, and the target twin component is highlighted under the condition that the historical operation state of the target twin component is monitored to meet the target monitoring condition. Through configuration operation, component monitoring is carried out aiming at the configured twin component, twin attribute and monitoring condition, so that the component monitoring is more targeted, the accuracy of a component monitoring result is improved further, unnecessary component monitoring operation can be saved, the efficiency of component monitoring is improved, and monitoring resources and cost are saved. In the following examples, emphasis will be placed on this embodiment.

In the present embodiment, the deployment implementation of the twin scene modeling module 10 and the twin scene playback module 20 is not limited. In some application scenarios, the twinning scenario modeling module 10 and the twinning scenario playback module 20 may be deployed on the same device. In other applications, the twinning scene modeling module 10 and the twinning scene playback module 20 may be distributed and deployed on different devices. This will be described in connection with the application scenario shown in fig. 2 a-2 b:

in the home internet of things scenario shown in fig. 2a, a user backtracks the historical running state of the intelligent home appliance through the terminal device 11 (illustrated by a notebook computer in fig. 2 a) to find out whether an abnormal component exists in the intelligent home appliance, wherein the monitored intelligent home appliance is the target device. The target device may be one intelligent home appliance in a home internet of things scene, may be a plurality of intelligent home appliances in a home internet of things scene, or may be all intelligent home appliances in a home internet of things scene. In the scenario shown in fig. 2a, the twin scenario playback module 20 in the system shown in fig. 1 may be deployed on the terminal device 11, and the twin scenario modeling module 10 may be deployed on the cloud server 12. Based on this, the terminal device 11 may perform anomaly monitoring on the intelligent home appliance (i.e. the target device) that is desired to be monitored in the home internet of things scene by tracing back the historical operating state of the device.

Specifically, as shown in step (1) of fig. 2a, the terminal device 11 acquires a digital twin model of the target device from the cloud server 12, and presents the digital twin model in a twin visual interface, where the digital twin model correlates historical attribute time series data corresponding to the target device, and includes at least one twin component corresponding to the target device. Continuing to refer to the step (2), in response to the configuration operation, configuring the target twin attribute to be monitored and the target monitoring condition corresponding to the target twin attribute for the target twin component in the at least one twin component. As shown in step (3), the terminal device 11 reports the target twin attribute and the corresponding target monitoring condition to the cloud server 12 for the cloud server 12 to store; wherein step (3) is an optional step. Next, referring to steps (4) and (5), the terminal device 11 plays back the historical operation state of the digital twin model in the twin visual interface according to the historical attribute time sequence data, and monitors the historical operation state of the target twin component according to the target twin attribute in the playback process; finally, referring to step (6), the terminal device 11 highlights the target twin component when it is monitored that the historical operation state of the target twin component meets the target monitoring condition.

In the scenario of the clothing intelligent manufacturing plant shown in fig. 2b, the plant management and control equipment 21 is deployed in the edge cloud node close to the clothing intelligent manufacturing plant, and the historical operation states of the production line equipment are traced back by the plant management and control equipment 21, so that various production line equipment in the clothing intelligent manufacturing plant can be monitored to find out which production line equipment has faults and needs maintenance or replacement, and which production line equipment has low efficiency and needs to be optimized. In the scenario shown in fig. 2b, the twinning scenario playback module 20 in the system shown in fig. 1 may be deployed on a plant management and control device 21, and the twinning scenario modeling module 10 may be deployed on a cloud server 22. Based on this, the plant management and control device 21 can perform abnormality and performance monitoring on the production line device (i.e., the target device) which is desired to be monitored in the clothing intelligent manufacturing plant scene at the same time by tracing back the historical operation state of the device.

Specifically, as shown in step (1) of fig. 2b, the plant management and control device 21 acquires a digital twin model of the target device from the cloud server 22, and presents the digital twin model in the twin visual interface, where the digital twin model correlates historical attribute time series data corresponding to the target device, and includes at least one twin component corresponding to the target device. Continuing to refer to the step (2), in response to the configuration operation, configuring the target twin attribute to be monitored and the target monitoring condition corresponding to the target twin attribute for the target twin component in the at least one twin component. As shown in step (3), reporting the target twin attribute and the corresponding target monitoring condition to the cloud server 22 for the cloud server 22 to store; step (3) is an optional step. Next, referring to steps (4) and (5), the plant management and control device 21 plays back the historical operation state of the digital twin model in the twin visual interface according to the historical attribute time sequence data, and monitors the historical operation state of the target twin component according to the target twin attribute in the playback process; finally, referring to step (6), the plant management and control device 21 highlights the target twin component when it is monitored that the historical operating state of the target twin component meets the target monitoring condition.

In the scenario shown in fig. 2a and 2b, an example is illustrated in which the terminal device 11 or the plant management device 21 acquires a digital twin model of the target device from the

cloud server

12 or 22, which can be constructed by the twin scenario modeling module 10 deployed on the

cloud server

12 or 22 according to the related information of the target device. In addition, the twin scene modeling module 10 may also be deployed directly on the terminal device 11 or the plant management and control device 21, and is responsible for constructing a digital twin model of the target device.

Here, the digital twin model of the target device may be constructed by other devices and provided to the terminal device 11 or the plant management device 21, in addition to the twin scene modeling module 10 provided in the embodiment of the present application, and in the embodiment of the present application, the construction process of the digital twin model of the target device is not limited.

For a detailed implementation procedure of each step in the above-mentioned scene embodiment, reference may be made to the description in the following method embodiment, which is not described in detail herein.

Fig. 3 is a flow chart of a device status information processing method according to an embodiment of the present application. As shown in fig. 3, the method includes:

301. A digital twin model of the target device is obtained, the digital twin model being associated with historical attribute timing data corresponding to the target device and comprising at least one twin component corresponding to the target device.

302. And responding to the configuration operation, and configuring the target twin attribute to be monitored and the target monitoring condition corresponding to the target twin attribute aiming at the target twin assembly in the at least one twin assembly.

303. And playing back the historical running state of the digital twin model in the twin visual interface according to the historical attribute time sequence data.

304. And during playback, monitoring the historical running state of the target twin component according to the configured target twin attribute.

305. And under the condition that the historical running state of the target twin component meets the target monitoring condition, the target twin component is highlighted.

The equipment state information processing method provided by the embodiment of the application can be applied to equipment state information processing equipment. The device state information processing device may be a terminal device deployed in an environment where the target device is located, as shown in fig. 2 a. The device state information processing device may also be an edge device in an edge cloud node that is closer to the scene in which the target device is located, as shown in fig. 2 b. The terminal device as the method execution subject may be a smart phone, a tablet computer, a notebook computer, a wearable device, a vehicle-mounted device, an intelligent home appliance, and the like, and in fig. 2a, a notebook computer is illustrated as an example. Edge cloud nodes refer to computing platforms in the scene in which the proximate target device is located, including a series of edge infrastructures therein including, but not limited to: internet data center (Internet Data Center, IDC), wireless room or cluster, operator's communication network, core network devices, base stations, edge gateways, home gateways, computing devices and/or storage devices, and the like, and corresponding network environments.

In this embodiment, the target device may be an entity device with a monitoring requirement in various application scenarios. For example, the target device may be an internet of things device in an internet of things scenario. For example, the target device may be a vehicle in the vehicle-mounted internet of things, an electronic tag on the vehicle, a data collector, a sound device, an air conditioner, and other internet of things devices; the intelligent household appliance can also be industrial equipment in the industrial Internet of things, various sensors and other Internet of things equipment, and can also be various intelligent household appliances in the household Internet of things shown in fig. 2a, such as an air conditioner, a washing machine, an electric cooker, a refrigerator, an intelligent television, an intelligent lamp, an intelligent switch and the like. For another example, the target device may be various production devices in the smart factory system, for example, the clothing smart factory shown in fig. 2b, and the target device may be various production line devices such as various sewing devices, cut-parts devices, printing devices, and the like. For another example, the target device may be a camera, an electronic eye, or other various monitoring devices in a smart traffic scene. As another example, the target device may also be a temperature sensor, humidity sensor, camera, etc. in a smart agriculture scenario.

In this embodiment, the monitoring of the target device mainly refers to a process of monitoring the target device based on the historical operating state of the target device. The process of monitoring the target device based on its historical operating state may vary depending on the monitoring requirements. The monitoring requirement for the target device may be an abnormal monitoring requirement, a performance optimization monitoring requirement or a state monitoring requirement. The abnormal monitoring requirement refers to a monitoring requirement for finding whether the target device has an abnormal component, and whether the target device has an abnormal component can be found based on the historical running state of the target device. The performance optimization monitoring requirement refers to a monitoring requirement for finding whether a component requiring performance optimization exists in the target device, and then based on the historical operating state of the target device, it can be found whether the component requiring performance optimization exists in the target device. The state monitoring requirement refers to a monitoring requirement for focusing on a historical operation state of a certain key component in the target device, and the historical operation state of the certain key component in the target device can be focused on based on the historical operation state of the target device.

In this embodiment, a digital twin model of the target device is obtained, and a historical operating state of the target device is traced back and forth by adopting the digital twin model of the target device. Specifically, by associating the digital twin model with the historical attribute time sequence data corresponding to the target device, the historical running state of the digital twin model can be replayed according to the historical attribute time sequence data, so that the historical running state of the target device can be traced back. The historical operation state of the target device includes the historical operation state of each device component in the target device, and in this embodiment, the historical operation state of the target device is reflected by the historical operation state of the digital twin model, and the historical operation state of the corresponding device component in the target device is reflected by the historical operation state of the twin component.

In addition, in this embodiment, the twin component can be flexibly selected through configuration operation according to application requirements, and an attribute dimension to be monitored and a monitoring condition corresponding to the attribute dimension can be configured for the selected twin component. For convenience of distinction, a selected twin component is referred to as a target twin component, a twin attribute configured for the target twin component is referred to as a target twin attribute, and a monitoring condition corresponding to the target twin attribute is referred to as a target monitoring condition. Based on this, the target twin attribute to be monitored and the target monitoring condition corresponding to the target twin attribute may be configured for the target twin component in response to the configuration operation.

In an alternative embodiment, a twinning visual interface may be provided. The twin visual interface is used for displaying the digital twin model and the playback process of the digital twin model on the one hand, and can be used as a man-machine interaction interface on the other hand for responding to configuration operation, so that a user can select a target twin component and configure target twin attributes and target monitoring conditions. Based on this, a process of configuring a target twin attribute to be monitored and a target monitoring condition corresponding to the target twin attribute for a target twin component in response to a configuration operation includes: determining a selected target twinning component in response to component selection operations in a twinning visual interface in which a digital twinning model and a selectable twinning component are simultaneously displayed; responding to configuration operation initiated aiming at the target twin component, and displaying twin attribute configuration items and monitoring condition configuration items; in response to the configuration operation of the twin attribute configuration item and the monitoring condition configuration item, the target twin attribute configured for the target twin component and the monitoring condition corresponding to the target twin attribute are obtained.

Optionally, as shown in fig. 4, one implementation form of the twinning visual interface includes three left, middle and right regions, where the left region includes at least one component list region for displaying twinning components that can be selected, for example, twinning components 1-N, and a user can select a target twinning component through a click operation; the middle region is a display region of the digital twin model for carrying the digital twin model and playback of the digital twin model; the right side area is a data presentation area that may present some data related to the target device, the digital twin model, or the playback process, such as a graph of the change in the target twin attribute, an overall operational performance curve of the digital twin model, and anomaly cues, which may include, but are not limited to: abnormality type, degree of abnormality, abnormal part, etc. As described herein, FIG. 4 illustrates only one implementation of a twinning visual interface and is not so limited. For example, the twinning visual interface may contain only two regions, one region for displaying a twinning control that can be selected, one region for carrying a digital twinning model and playback of the digital twinning model. For another example, the digital twinned visual interface may also include a menu bar and a display area through which a user may initiate various interactive operations, such as configuration operations.

The target device will be different according to the application scenario, and accordingly, the target twin component, the target twin attribute, and the target monitoring condition will be different. For example, in the case where the target device is an intelligent air conditioner, the target twin component to be monitored may be a heater of the intelligent air conditioner, the target twin attribute to be monitored may be a temperature of the heater, and in the case of performing anomaly monitoring, the target monitoring condition may be anomaly when the target monitoring condition is greater than a set temperature threshold. In the case that the target device is a refrigerator device, the target twin component to be monitored may be a fan in the refrigerator device, the target twin attribute to be monitored may be a rotation speed, and in the case of performing anomaly monitoring, the target monitoring condition may be an anomaly when the rotation speed threshold is smaller than a set rotation speed threshold.

After the digital twin model is obtained and the target twin component, the target twin attribute and the target monitoring condition to be monitored are configured, the historical running state of the digital twin model can be played back in the twin visual interface according to the historical attribute time sequence data associated with the digital twin model. The historical attribute time sequence data comprises time sequence data required by the digital twin model to successfully simulate the historical operation state of the target equipment, such as attribute values for describing the operation states of all equipment components in the target equipment at all times in a historical period. The playback process is a video playing process and the video content is the historical operating state of the digital twin model. The playback of the historical running state of the digital twin model refers to controlling the state change of each twin component in the digital twin model according to the historical attribute time sequence data so as to reappear the historical running state of the digital twin model and reappear the historical running state of the target equipment.

In the present embodiment, the duration of the historical operating state playback of the digital twin model is not limited. For example, the historical operating state of the digital twinning model over a longer historical period may be played back as well as the historical operating state of the digital twinning model over a shorter historical period. For another example, the historical operating state of the digital twin model in the default historical period may be played back, or the historical period may be selected by the user, and the historical operating state of the digital twin model in the user selected historical period may be played back.

In an alternative embodiment, assuming that the historical attribute time series data associated with the digital twin model is the historical attribute time series data in the first historical period, the historical running state of the digital twin model in the first historical period can be played back in the twin visual interface by default according to the historical attribute time series data.

In another alternative embodiment, the user may make a selection of a history period through a twinning visual interface. Based on the method, a target historical period needing to be played back can be determined in response to a period selection operation on the twin visual interface, and a time sequence data segment corresponding to the target historical period is extracted from the time sequence data of the historical attribute; and playing back the historical running state of the digital twin model in the target historical period according to the time sequence data in the time sequence data segment. Specifically, according to the time sequence data in the time sequence data segment, the running states of all the twin components in the digital twin model are controlled, so that the historical running states of the digital twin model in the target historical period are replayed.

Further, during playback, the historical operating state of the target twinning assembly may be monitored according to the target twinning attributes configured as described above. The historical operating state herein mainly refers to the historical operating state that the target twin component presents under the target twin attribute. The historical running state of the target twin component under the target twin attribute can be represented by some historical attribute values under the target twin attribute, based on the historical running state, the historical attribute values of the target twin component under the target twin attribute can be monitored in the playback process, the historical attribute values reflect the historical running state of the target twin component, and when the historical attribute values or changes thereof are located in an attribute value range or an attribute value change range defined by the target monitoring condition, the historical running state of the target twin component is determined to meet the target monitoring condition.

Optionally, the historical attribute value of the target twin component under the target twin attribute may be acquired in real time for the target twin component during playback, and the attribute value of the target twin component acquired in real time under the target twin attribute is referred to as the historical attribute value due to playback of the historical running state. For example, taking the example that the target device is an intelligent air conditioner, the target twin component is a heater in the intelligent air conditioner, the target twin attribute is the temperature of the heater, during the process of playing back the running state in 7 days of the upper week through a digital twin model of the intelligent air conditioner, the temperature values of the heater at all times in 7 days of the upper week can be collected, the change of the temperature values is monitored, and when the temperature values are larger than a set temperature threshold, the heater is indicated to be abnormal. Alternatively, in the case where the historical attribute timing data includes a historical attribute value of the target twin component under the target twin attribute, the historical attribute value of the target twin component under the target twin attribute may also be obtained from the historical attribute timing data. Here, the historical attribute time series data may not include the historical attribute value of the target twin component under the target twin attribute, as long as the time series data required for realizing playback of the historical operating state of the target device is included.

Under the condition that the historical running state of the target twin component meets the target monitoring condition, the target twin component is highlighted to identify the abnormality of the target twin component or the requirement of performance optimization and the like. In the embodiment, the historical running state of the playback target device is simulated based on the digital twin model in a visual mode on the twin visual interface, deduction is not needed through retrieving and analyzing historical log data, the backtracking efficiency is higher, the backtracking process is more visual, and the backtracking result is more reliable. In addition, in the backtracking process, the display effect of the target twin assembly is highlighted, so that a user can conveniently and accurately identify the target twin assembly, and the error and leakage of the investigation information can be reduced.

In the examples of the present application, the implementation of highlighting the target twinning assembly is not limited. Several exemplary ways of highlighting are given below:

mode 1: in the configuration operation, the target twinning component can be configured with visual description information corresponding to the target monitoring condition, wherein the visual description information is used for describing target visual properties and/or associated target visual contents corresponding to the target twinning component when the historical running state of the target twinning component meets the target monitoring condition. The target visualization attributes may be, but are not limited to: the color of the target twinning component, highlighting, or adding a marker line, etc. The object visual content can be any content related to the object twin component, which is displayed in any form, for example, the anomaly type or anomaly description information of the object twin component, which can be displayed in a popup window or floating layer mode; or, the abnormal prompt content which can be displayed in an animation mode can be, for example, animation for displaying the fracture of the target twin component, animation for displaying the overheat of the target twin component or animation for displaying the running speed of the target twin component is too low; alternatively, it may be an anchor point pointing to a target twinning component.

Based on the above, under the condition that the historical operation state of the target twin component is monitored to meet the target monitoring condition, the method for highlighting the target twin component comprises the following steps: under the condition that the historical running state of the target twin component meets the monitoring condition, generating target visual attributes and/or target visual contents according to the visual description information; and highlighting the target twin component according to the target visualization attribute and/or the target visualization content. For example, if the visual descriptive information requires highlighting the target twin component with a highlighting color value in the event of an anomaly of the target twin component, the target twin component may be highlighted with the highlighting color value. For another example, if the visual description information requires that an animation reflecting the abnormality information be displayed in the associated region of the target twin component in the case where the abnormality occurs in the target twin component, the animation reflecting the abnormality information may be displayed in the associated region of the target twin component. For another example, if the visual description information requires that the target twin component be prominently displayed with a highlighting color value and an animation reflecting the abnormality information at the same time in the case that the target twin component is abnormal, the target twin component may be displayed with the highlighting color value and the animation reflecting the abnormality information may be displayed in an associated region of the target twin component.

Mode 2: under the condition that the historical operation state of the target twin component meets the target monitoring condition, determining whether the target twin component is blocked by other twin components according to the relative position relationship and/or inclusion relationship between the target twin component and the other twin components; and when the object twinning assembly is determined to be blocked by other twinning assemblies, performing transparency processing on other assemblies for blocking the object twinning assembly so as to highlight the object twinning assembly.

Mode 3: under the condition that the historical running state of the target twin component meets the target monitoring condition, determining whether the target twin component is in the central area of the twin visual interface according to the display position of the target twin component on the twin visual interface; and when the target twinning assembly is determined not to be in the central area of the twinning visual interface, rotating the target twinning assembly to the central area so as to highlight the target twinning assembly.

Mode 4: under the condition that the historical operation state of the target twin component meets the target monitoring condition, determining whether the size ratio of the target twin component to the twin visual interface is in a set ratio range according to the size of the target twin component and the size of the twin visual interface; and when the size ratio of the target twin component and the twin visual interface is not in the set ratio range, scaling the target twin component so as to highlight the target twin component.

Here, the above-described modes 1 to 4 may be used alternatively or in combination in any mode.

Further, in the above-described mode 2, it may be determined whether the target twin assembly is blocked by the other twin assembly, based on the relative positional relationship between the target twin assembly and the other twin assembly; determining whether the target twin component is blocked by other twin components according to the inclusion relation between the target twin component and the other twin components; or determining whether the target twin assembly is occluded by other twin assemblies according to the relative position relationship and the inclusion relationship between the target twin assembly and the other twin assemblies.

Wherein determining whether the target twin assembly is occluded by the other twin assembly based on the relative positional relationship between the target twin assembly and the other twin assembly comprises: determining whether a first twin component with coordinates larger than those of the target twin component exists on the observation coordinate axis according to the three-dimensional coordinates of the target twin component and other twin components in the twin visual interface; if the first twin component exists, determining that the target twin component is blocked by the first twin component. In this embodiment, a coordinate system is constructed with the length and width of the twinning visual interface as the x-axis and the y-axis, and the direction of the vertical twinning visual interface as the z-axis, the z-axis being the observation coordinate axis, the positive direction of each coordinate axis being as shown in fig. 4, in which each twinning component has its own three-dimensional coordinates and dimensions; if the z-axis coordinate of a certain twin component is larger than the z-axis coordinate of a target twin component, and the twin component has a certain width or height, the twin component has a certain shielding to the target twin component, and the twin component is recorded as a first twin component. The first twin component with shielding on the target twin component can be one or more, and no matter how many the first twin component is, the first twin component can be subjected to the transparency treatment, for example, the transparency of the first twin component can be improved, so that the purpose of carrying out the transparency treatment on the first twin component is achieved.

Wherein determining whether the target twin assembly is occluded by the other twin assembly based on the containment relationship between the target twin assembly and the other twin assembly comprises: determining whether a second twin component containing the target twin component exists in the twin visual interface according to the inclusion relation between the twin components recorded in the model description file of the digital twin model; if the second twin component exists, determining that the target twin component is blocked by the second twin component. Wherein the inclusion relationship may also be referred to as a parent-child relationship, when one twin component is included by another twin component, the twin component of the outer layer may cause an occlusion to the twin component of the inner layer. The object of highlighting the target twinning assembly can be achieved by a transparentizing treatment of the second twinning assembly comprising the target twinning assembly.

It is described herein that no transparentization process is required for other twinning components on the digital twinning model that do not obscure the target twinning components. In addition, in the case where the above aspect 2 is combined with the above aspect 1, when the first twin component and/or the second twin component that obscures the target twin component are subjected to the transparency process, the target twin component may be highlighted according to the visualization attribute corresponding to the target twin component and/or the associated target visualization content.

In the above manner 3, whether the target twin component is in the central area of the twin visual interface may be determined according to the display position of the target twin component on the twin visual interface; and when the target twinning assembly is determined not to be in the central area of the twinning visual interface, rotating the target twinning assembly to the central area so as to highlight the target twinning assembly. The display position of the target twin component on the twin visual interface may be a center position of the target twin component, or an average position of the target twin component, or coordinates of a point on the target twin component that is farthest from the origin of coordinates, or coordinates of a point on the target twin component that is closest to the origin of coordinates, which is not limited.

Wherein when the target twin assembly is rotated to the central region of the twin visual interface when it is determined that the target twin assembly is not located in the central region, the digital twin model may be rotated to rotate the target twin assembly to the central region. In an alternative embodiment, the digital twinning model may be rotated in any direction, as long as the target twinning assembly is rotated to the central region. In another alternative embodiment, the rotation direction and rotation angle of the digital twin model can be determined according to the relative position relationship between the target twin component and the central region; and rotating the digital twin model according to the rotation direction and the rotation angle so as to rotate the target twin assembly to the central area for display. According to the relative position relation between the target twin assembly and the central area, the closer rotation direction and the smaller rotation angle can be determined, so that the target twin assembly can be quickly rotated to the central area for display.

In the above manner 4, when it is monitored that the historical operating state of the target twin component meets the target monitoring condition, determining whether the size ratio of the target twin component to the twin visual interface is within the set ratio range according to the size of the target twin component and the size of the twin visual interface; and when the size ratio of the target twin component and the twin visual interface is not in the set ratio range, scaling the target twin component so as to highlight the target twin component. Specifically, if the size ratio is smaller than the lower limit value of the set ratio range, the size of the target twin assembly is smaller, and the target twin assembly can be appropriately enlarged, so that the size ratio of the target twin assembly to the twin visual interface is located in the set ratio range; if the dimension ratio is greater than the upper limit value of the set ratio range, the dimension of the target twin assembly is larger, and the target twin assembly can be properly reduced, so that the dimension ratio of the target twin assembly and the twin visual interface is located in the set ratio range.

Further, in the process of reducing or amplifying the target twin component, in order to ensure that the proportional relation of each twin component in the whole digital twin model is unchanged, the whole digital twin model can be reduced or amplified in the same proportion so as to achieve the purpose of highlighting and displaying the target twin component.

In the above or below embodiments of the present application, when it is monitored that the historical running state of the target twin component meets the target monitoring condition, the playback picture may be collected, so as to obtain at least one frame of playback picture, and the at least one frame of playback picture is sent to the preset device; wherein, at least one frame of playback picture contains the historical running state of the target twin component. The preset device can be a mobile phone or a wearable device for monitoring a user so as to conveniently and timely check or know the historical running state of the target twin component which is abnormal or needs to be optimized; alternatively, the preset device may be a server device to store the playback frames for later querying or further analysis.

In the embodiment of the method, aiming at the component monitoring requirement of the target equipment, a digital twin model of the target equipment is obtained, the historical operation state of twin components in the digital twin model is monitored in the playback process by playing back the historical operation state of the digital twin model, the configured target twin components can be monitored in a targeted mode through configuration operation according to the configured twin attributes and the monitoring conditions, and the target twin components which meet the monitoring conditions or are abnormal are monitored to be highlighted. The component monitoring is performed based on the historical running state of the twin component in the playback process, and compared with a retrieval analysis scheme based on log data, the accuracy of a component monitoring result can be greatly improved; in addition, through playback of the historical running state of the digital twin model and protruding display of the target twin component, visualization of the component monitoring process can be achieved, the component monitoring process is more visual, a user can accurately identify the target twin component, and error and leakage of investigation information can be reduced. Further, component monitoring is allowed to be carried out by configuration operation aiming at the configured twin component, twin attribute and monitoring condition, so that the component monitoring is more targeted, the accuracy of a component monitoring result is improved, unnecessary component monitoring operation can be saved, the efficiency of component monitoring is improved, and monitoring resources and cost are saved.

In addition to the above method embodiment, the present application further provides another method for processing device status information, as shown in fig. 5, where the method includes:

501. acquiring a digital twin model of the target equipment, wherein the digital twin model is associated with historical attribute time sequence data of the target equipment and comprises at least one twin component corresponding to the target equipment;

502. according to the historical attribute time sequence data, playing back the historical running state of the digital twin model, and monitoring the historical running state of at least one twin component in the playing back process;

503. and under the condition that the target twin component with abnormal historical operation state is monitored, the target twin component is highlighted.

This embodiment differs from the embodiment shown in fig. 3 in that in this embodiment, the configuration operation and the configuration process are absent, and in that during playback, abnormality monitoring is performed uniformly for each twin component. The detailed implementation of each step in this embodiment is the same as or similar to the detailed implementation of the corresponding step in the embodiment shown in fig. 3, and will not be described here again.

In the embodiment of the method, aiming at the component monitoring requirement of the target equipment, a digital twin model of the target equipment is obtained, the historical operation state of twin components in the digital twin model is monitored in the playback process by playing back the historical operation state of the digital twin model, all the components in the digital twin model are monitored uniformly, and the target twin components which meet the monitoring condition or are abnormal are highlighted. The component monitoring is performed based on the historical running state of the twin component in the playback process, and compared with a retrieval analysis scheme based on log data, the accuracy of a component monitoring result can be greatly improved; in addition, through playback of the historical running state of the digital twin model and protruding display of the target twin component, visualization of the component monitoring process can be achieved, the component monitoring process is more visual, a user can accurately identify the target twin component, and error and leakage of investigation information can be reduced.

Fig. 6 is a schematic structural diagram of an apparatus status information processing device according to an embodiment of the present application. As shown in fig. 6, the apparatus includes:

an obtaining module 61, configured to obtain a digital twin model of the target device, where the digital twin model is associated with historical attribute time series data corresponding to the target device, and includes at least one twin component corresponding to the target device;

a configuration module 62, configured to configure, in response to a configuration operation, a target twinning attribute to be monitored and a target monitoring condition corresponding to the target twinning attribute for a target twinning component in the at least one twinning component;

a playback module 63, configured to play back the historical running state of the digital twin model in the twin visual interface according to the historical attribute time sequence data;

a monitoring module 64 for monitoring a historical operating state of the target twinning assembly according to the target twinning attribute during playback of the playback module;

the display module 65 is configured to highlight the target twin component when the monitoring module monitors that the historical operating state of the target twin component meets the target monitoring condition.

In an alternative embodiment, configuration module 62 is specifically configured to: determining a selected target twinning component in response to component selection operation in a twinning visual interface, wherein a digital twinning model and the selectable twinning component are displayed in the twinning visual interface; responding to configuration operation initiated aiming at a target twin component, and displaying a twin attribute configuration item and a monitoring condition configuration item; in response to the configuration operation of the twin attribute configuration item and the monitoring condition configuration item, the target twin attribute configured for the target twin component and the monitoring condition corresponding to the target twin attribute are obtained.

In an alternative embodiment, configuration module 62 is further configured to: and responding to the configuration operation, configuring visual description information corresponding to the target monitoring condition for the target twin component, wherein the visual description information is used for describing target visual attributes and/or associated target visual contents corresponding to the target twin component.

Accordingly, the display module 65 is specifically configured to: under the condition that the historical running state of the target twin component meets the monitoring condition, generating target visual attributes and/or target visual contents according to the visual description information; and highlighting the target twin component according to the target visualization attribute and/or the target visualization content.

In an alternative embodiment, the playback module 63 is specifically configured to: responding to time period selection operation on the twin visual interface, determining a target historical time period to be played back, and extracting a time sequence data segment corresponding to the target historical time period from the historical attribute time sequence data; and playing back the historical running state of the digital twin model in the target historical period according to the time sequence data in the time sequence data segment.

In an alternative embodiment, the monitoring module 64 is specifically configured to: in the playback process, monitoring a historical attribute value of the target twin component under the target twin attribute, wherein the historical attribute value reflects the historical running state of the target twin component; and when the historical attribute value or the change thereof is positioned in the attribute value range or the attribute value change range defined by the target monitoring condition, determining that the historical operating state of the target twin component meets the target monitoring condition.

In an alternative embodiment, the display module 65 is specifically configured to: and under the condition that the historical operation state of the target twin assembly is monitored to meet the target monitoring condition, executing at least one of the following operations to highlight the target twin assembly:

when the target twin component is shielded by other twin components, other components shielding the target twin component are subjected to transparency treatment;

rotating the target twinning assembly to a central region when the target twinning assembly is not in the central region of the twinning visual interface;

and when the size ratio of the target twin component and the twin visual interface is not in the set ratio range, scaling the target twin component.

In an alternative embodiment, presentation module 65 is further configured to perform at least one of the following:

determining that the target twin component is blocked by other twin components according to the relative position relationship and/or inclusion relationship between the target twin component and the other twin components;

according to the display position of the target twinning assembly on the twinning visual interface, determining that the target twinning assembly is not positioned in the central area of the twinning visual interface;

and determining that the size ratio of the target twin component to the twin visual interface is not in the set ratio range according to the size of the target twin component and the size of the twin visual interface.

In an alternative embodiment, the presentation module 65 is specifically configured to, when determining that the target twinning assembly is occluded by another twinning assembly: determining whether a first twin component with coordinates larger than those of the target twin component exists on the observation coordinate axis according to the three-dimensional coordinates of the target twin component and other twin components in the twin visual interface; if the first twin component exists, determining that the target twin component is blocked by the first twin component; and/or determining whether a second twin component comprising the target twin component exists in the twin visual interface according to the inclusion relation between the twin components recorded in the model description file of the digital twin model; if the second twin component exists, determining that the target twin component is blocked by the second twin component.

In an alternative embodiment, the display module 65 is specifically configured to, when rotating the target twinning assembly to the central region: when the target twin component is not located in the central area of the twin visual interface, determining the rotation direction and the rotation angle of the digital twin model according to the relative position relation between the target twin component and the central area; and rotating the digital twin model according to the rotation direction and the rotation angle so as to rotate the target twin assembly to the central area for display.

In an alternative embodiment, the monitoring module 64 is further configured to: under the condition that the historical running state of the target twin component meets the target monitoring condition is monitored, collecting playback pictures to obtain at least one frame of playback picture, and sending the at least one frame of playback picture to preset equipment; wherein, at least one frame of playback picture contains the historical running state of the target twin component.

The apparatus shown in fig. 6 may perform the method of the embodiment shown in fig. 3, and its implementation principles and technical effects will not be repeated. The specific manner in which the various modules perform the operations of the apparatus shown in fig. 6 in the above embodiments has been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application. As shown in fig. 7, the electronic device includes: a memory 71 and a processor 72.

The memory 71 is used for storing computer programs and may be configured to store various other data to support operations on the electronic device. Examples of such data include instructions, contact data, messages, pictures, videos, etc. for any application or method operating on an electronic device.

A processor 72 coupled to the memory 71 for executing the computer program in the memory 71 for: acquiring a digital twin model of the target equipment, wherein the digital twin model is associated with historical attribute time sequence data corresponding to the target equipment and comprises at least one twin component corresponding to the target equipment; responding to configuration operation, and configuring target twin attributes to be monitored and target monitoring conditions corresponding to the target twin attributes for the target twin components in the at least one twin component; according to the historical attribute time sequence data, playing back the historical operation state of the digital twin model in a twin visual interface, and monitoring the historical operation state of the target twin assembly according to the target twin attribute in the playing back process; and under the condition that the historical running state of the target twin component meets the target monitoring condition, the target twin component is highlighted.

In an alternative embodiment, processor 72, in response to the configuring operation, is specifically configured to, when configuring the target twin component of the at least one twin component with the target twin attribute to be monitored and the target monitoring condition corresponding to the target twin attribute: determining a selected target twinning component in response to component selection operation in a twinning visual interface, wherein a digital twinning model and the selectable twinning component are displayed in the twinning visual interface; responding to configuration operation initiated aiming at a target twin component, and displaying a twin attribute configuration item and a monitoring condition configuration item; in response to the configuration operation of the twin attribute configuration item and the monitoring condition configuration item, the target twin attribute configured for the target twin component and the monitoring condition corresponding to the target twin attribute are obtained.

In an alternative embodiment, processor 72 is further configured to: and responding to the configuration operation, configuring visual description information corresponding to the target monitoring condition for the target twin component, wherein the visual description information is used for describing target visual attributes and/or associated target visual contents corresponding to the target twin component. Accordingly, when the processor 72 highlights the target twin component in the case that the historical operating state of the target twin component is monitored to meet the target monitoring condition, the processor is specifically configured to: under the condition that the historical running state of the target twin component meets the monitoring condition, generating target visual attributes and/or target visual contents according to the visual description information; and highlighting the target twin component according to the target visualization attribute and/or the target visualization content.

In an alternative embodiment, processor 72 is specifically configured to, in playing back the historical operating state of the digital twinning model in the twinning visualization interface based on the historical attribute timing data: responding to time period selection operation on the twin visual interface, determining a target historical time period to be played back, and extracting a time sequence data segment corresponding to the target historical time period from the historical attribute time sequence data; and playing back the historical running state of the digital twin model in the target historical period according to the time sequence data in the time sequence data segment.

In an alternative embodiment, processor 72 is specifically configured to, during playback, monitor the historical operating state of the target twin component based on the target twin attribute: in the playback process, monitoring a historical attribute value of the target twin component under the target twin attribute, wherein the historical attribute value reflects the historical running state of the target twin component; and when the historical attribute value or the change thereof is positioned in the attribute value range or the attribute value change range defined by the target monitoring condition, determining that the historical operating state of the target twin component meets the target monitoring condition.

In an alternative embodiment, the processor 72 is specifically configured to, when it monitors that the historical operating state of the target twin assembly meets the target monitoring condition, highlight the target twin assembly: and under the condition that the historical operation state of the target twin assembly is monitored to meet the target monitoring condition, executing at least one of the following operations to highlight the target twin assembly:

In an alternative embodiment, processor 72 is further configured to perform at least one of the following:

In an alternative embodiment, processor 72 is specifically configured to, when determining that the target twin is occluded by the other twin based on the relative positional relationship and/or inclusion between the target twin and the other twin: determining whether a first twin component with coordinates larger than those of the target twin component exists on the observation coordinate axis according to the three-dimensional coordinates of the target twin component and other twin components in the twin visual interface; if the first twin component exists, determining that the target twin component is blocked by the first twin component; and/or determining whether a second twin component comprising the target twin component exists in the twin visual interface according to the inclusion relation between the twin components recorded in the model description file of the digital twin model; if the second twin component exists, determining that the target twin component is blocked by the second twin component.

In an alternative embodiment, the processor 72 is specifically configured to, when the target twinning assembly is not in the central region of the twinning visualization interface, rotate the target twinning assembly to the central region: when the target twin component is not located in the central area of the twin visual interface, determining the rotation direction and the rotation angle of the digital twin model according to the relative position relation between the target twin component and the central area; and rotating the digital twin model according to the rotation direction and the rotation angle so as to rotate the target twin assembly to the central area for display.

In an alternative embodiment, processor 72 is further configured to: under the condition that the historical running state of the target twin component meets the target monitoring condition is monitored, collecting playback pictures to obtain at least one frame of playback picture, and sending the at least one frame of playback picture to preset equipment; wherein, at least one frame of playback picture contains the historical running state of the target twin component.

Further, as shown in fig. 7, the electronic device further includes: communication component 73, display 74, power component 75, audio component 76, and other components. Only some of the components are schematically shown in fig. 7, which does not mean that the electronic device only comprises the components shown in fig. 7. In addition, the components within the dashed box in fig. 7 are optional components, not necessarily optional components, depending on the product form of the electronic device. The electronic device in this embodiment may be implemented as a terminal device such as a desktop computer, a notebook computer, a smart phone, or an internet of things (Internet of Things, IOT) device, or may be a server device such as a conventional server, a cloud server, or a server array. If the electronic device of the embodiment is implemented as a terminal device such as a desktop computer, a notebook computer, or a smart phone, the electronic device may include components within the dashed-line frame in fig. 7; if the electronic device of the embodiment is implemented as a server device such as a conventional server, a cloud server, or a server array, the components within the dashed box in fig. 7 may not be included.

The embodiment of the present application further provides an electronic device, where the structure of the electronic device is the same as or similar to that of the electronic device shown in fig. 7, and specifically may be implemented with reference to the structure of the electronic device shown in fig. 7, and the difference between the electronic device provided in the embodiment of the present application and the electronic device shown in fig. 7 is mainly that: the functions implemented by a processor executing a computer program stored in memory are different. The electronic device provided in this embodiment may have a processor executing a computer program stored in a memory, and may be configured to: acquiring a digital twin model of the target equipment, wherein the digital twin model is associated with historical attribute time sequence data of the target equipment and comprises at least one twin component corresponding to the target equipment; according to the historical attribute time sequence data, playing back the historical running state of the digital twin model, and monitoring the historical running state of at least one twin component in the playing back process; and under the condition that the target twin component with abnormal historical operation state is monitored, the target twin component is highlighted.

The electronic device of the foregoing embodiments of the present application may perform the method of the embodiment shown in fig. 3 or fig. 5, and the implementation principle and technical effects thereof are not repeated, and the detailed description of the foregoing related operations is described in the embodiments related to the method, which will not be described in detail herein.

Accordingly, embodiments of the present application also provide a computer readable storage medium storing a computer program, which when executed by a processor, causes the processor to implement the steps of the method embodiments shown in fig. 3 or fig. 5.

Accordingly, embodiments of the present application also provide a computer program product comprising a computer program/instructions which, when executed by a processor, cause the processor to carry out the steps of the method embodiments shown in fig. 3 or fig. 5 described above.

The Memory may be implemented by any type or combination of volatile or non-volatile Memory devices, such as Static Random-Access Memory (SRAM), electrically erasable programmable Read-Only Memory (Electrically Erasable Programmable Read Only Memory, EEPROM), erasable programmable Read-Only Memory (Erasable Programmable Read Only Memory, EPROM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk, or optical disk.

The communication component is configured to facilitate wired or wireless communication between the device in which the communication component is located and other devices. The device where the communication component is located can access a wireless network based on a communication standard, such as a mobile communication network of WiFi,2G, 3G, 4G/LTE, 5G, etc., or a combination thereof. In one exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component further includes a near field communication (Near Field Communication, NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on radio frequency identification (Radio Frequency Identification, RFID) technology, infrared data association (Infrared Data Association, irDA) technology, ultra Wideband (UWB) technology, blueTooth (BT) technology, and other technologies.

The display includes a screen, which may include a liquid crystal display (Liquid Crystal Display, LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or sliding action, but also the duration and pressure associated with the touch or sliding operation.

The power supply component provides power for various components of equipment where the power supply component is located. The power components may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the devices in which the power components are located.

The audio component described above may be configured to output and/or input an audio signal. For example, the audio component includes a Microphone (MIC) configured to receive external audio signals when the device in which the audio component is located is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may be further stored in a memory or transmitted via a communication component. In some embodiments, the audio assembly further comprises a speaker for outputting audio signals.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-readable storage media (including, but not limited to, magnetic disk storage, CD-ROM (Compact Disc Read-Only Memory), optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In one typical configuration, a computing device includes one or more processors (Central Processing Unit, CPUs), input/output interfaces, network interfaces, and memory.

The memory may include volatile memory in a computer-readable medium, random access memory (Random Access Memory, RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of computer-readable media.

Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase-change memory (Phase-change Random Access Memory, PRAM), static Random Access Memory (SRAM), dynamic random access memory (Dynamic Random Access Memory, DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital versatile disks (Digital Video Disc, DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by the computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.

The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.

Claims

1. A device state information processing method, characterized by comprising:

acquiring a digital twin model of a target device, wherein the digital twin model is associated with historical attribute time sequence data corresponding to the target device and comprises at least one twin component corresponding to the target device;

responding to configuration operation, and configuring target twin attributes to be monitored and target monitoring conditions corresponding to the target twin attributes for the target twin components in the at least one twin component;

according to the historical attribute time sequence data, carrying out playback of the historical operation state of the digital twin model in a twin visual interface, and monitoring the historical operation state of the target twin assembly according to the target twin attribute in the playback process;

and under the condition that the historical running state of the target twin component meets the target monitoring condition, the target twin component is highlighted.

2. The method of claim 1, wherein configuring the target twin component of the at least one twin component with the target twin attribute to be monitored and the target monitoring condition corresponding to the target twin attribute in response to the configuring operation comprises:

determining a selected target twinned component in response to a component selection operation in a twinned visual interface in which the digital twinned model and the selectable twinned component are displayed;

responding to configuration operation initiated aiming at the target twin component, and displaying twin attribute configuration items and monitoring condition configuration items;

and responding to the configuration operation of the twin attribute configuration item and the monitoring condition configuration item, and acquiring a target twin attribute configured for the target twin component and a monitoring condition corresponding to the target twin attribute.

3. The method as recited in claim 1, further comprising:

responding to configuration operation, configuring visual description information corresponding to the target monitoring condition for the target twin component, wherein the visual description information is used for describing target visual attributes and/or associated target visual contents corresponding to the target twin component;

Accordingly, under the condition that the historical operation state of the target twin assembly is monitored to meet the target monitoring condition, the target twin assembly is highlighted, and the method comprises the following steps:

generating the target visual attribute and/or target visual content according to the visual description information under the condition that the historical running state of the target twin component meets the monitoring condition;

and highlighting the target twinning component according to the target visualization attribute and/or the target visualization content.

4. The method of claim 1, wherein playing back the historical operating state of the digital twin model in a twin visualization interface based on the historical attribute timing data comprises:

responding to the time period selection operation on the twinning visual interface, determining a target historical time period needing to be played back, and extracting a time sequence data segment corresponding to the target historical time period from the historical attribute time sequence data;

and playing back the historical running state of the digital twin model in the target historical period according to the time sequence data in the time sequence data segment.

5. The method of claim 1, wherein monitoring the historical operating state of the target twin component during playback from the target twin attribute comprises:

During playback, monitoring a historical attribute value of the target twin component under the target twin attribute, wherein the historical attribute value reflects a historical running state of the target twin component;

and when the historical attribute value or the change thereof is positioned in the attribute value range or the attribute value change range defined by the target monitoring condition, determining that the historical operating state of the target twin assembly meets the target monitoring condition.

6. The method of any of claims 1-5, wherein highlighting the target twin assembly if it is monitored that the historical operating state of the target twin assembly meets the target monitoring condition comprises:

and under the condition that the historical operation state of the target twin assembly is monitored to meet the target monitoring condition, performing at least one of the following operations to highlight the target twin assembly:

when the target twin component is shielded by other twin components, performing transparency treatment on the other components shielding the target twin component;

rotating the target twinning assembly to a central region of the twinning visualization interface when the target twinning assembly is not in the central region;

And when the size ratio of the target twin component to the twin visual interface is not in the set ratio range, scaling the target twin component.

7. The method of claim 6, further comprising at least one of:

determining that the target twin component is blocked by other twin components according to the relative position relationship and/or inclusion relationship between the target twin component and other twin components;

according to the display position of the target twin assembly on the twin visual interface, determining that the target twin assembly is not located in the central area of the twin visual interface;

and determining that the size ratio of the target twin assembly to the twin visual interface is not in a set ratio range according to the size of the target twin assembly and the size of the twin visual interface.

8. The method of claim 7, wherein determining that the target twin component is occluded by other twin components based on the relative positional relationship and/or containment relationship between the target twin component and other twin components, comprises:

determining whether a first twin component with coordinates larger than those of the target twin component exists on an observation coordinate axis according to the three-dimensional coordinates of the target twin component and other twin components in the twin visual interface; if the first twin component exists, determining that the target twin component is blocked by the first twin component;

And/or

Determining whether a second twin component containing the target twin component exists in the twin visual interface according to the inclusion relation between the twin components recorded in the model description file of the digital twin model; if the second twin assembly exists, determining that the target twin assembly is occluded by the second twin assembly.

9. The method of claim 6, wherein rotating the target twinning assembly to a central region of the twinning visualization interface when the target twinning assembly is not in the central region comprises:

when the target twin component is not located in the central area of the twin visual interface, determining the rotation direction and the rotation angle of the digital twin model according to the relative position relation between the target twin component and the central area;

and rotating the digital twin model according to the rotation direction and the rotation angle so as to rotate the target twin assembly to the central area for display.

10. The method of any one of claims 1-5, further comprising:

under the condition that the historical running state of the target twin component meets the target monitoring condition is monitored, collecting playback pictures to obtain at least one frame of playback picture, and sending the at least one frame of playback picture to preset equipment; wherein the at least one frame of playback picture contains the historical running state of the target twin component.

11. A device state information processing method, characterized by comprising:

acquiring a digital twin model of a target device, wherein the digital twin model is associated with historical attribute time sequence data of the target device and comprises at least one twin component corresponding to the target device;

according to the historical attribute time sequence data, playing back the historical running state of the digital twin model, and monitoring the historical running state of the at least one twin component in the playing back process;

and under the condition that the target twin component with abnormal historical operating state is monitored, the target twin component is highlighted.

12. A device state information processing apparatus, characterized by comprising:

the acquisition module is used for acquiring a digital twin model of the target equipment, wherein the digital twin model is associated with historical attribute time sequence data corresponding to the target equipment and comprises at least one twin component corresponding to the target equipment;

the configuration module is used for responding to configuration operation, and configuring target twin attributes to be monitored and target monitoring conditions corresponding to the target twin attributes for the target twin components in the at least one twin component;

The playback module is used for playing back the historical running state of the digital twin model in a twin visual interface according to the historical attribute time sequence data;

the monitoring module is used for monitoring the historical running state of the target twin assembly according to the target twin attribute in the playback process of the playback module;

and the display module is used for displaying the target twin component in a protruding mode under the condition that the monitoring module monitors that the historical operation state of the target twin component meets the target monitoring condition.

13. An electronic device, comprising: a memory and a processor; the memory is used for storing a computer program; the processor being coupled to the memory for executing the computer program for implementing the steps of the method of any one of claims 1-10 and 11.

14. A computer readable storage medium storing a computer program, which when executed by a processor causes the processor to carry out the steps of the method of any one of claims 1-10 and 11.