CN113986965A

CN113986965A - Data processing method based on monitoring operation and maintenance system and monitoring operation and maintenance system

Info

Publication number: CN113986965A
Application number: CN202111164020.9A
Authority: CN
Inventors: 张鑫
Original assignee: Alibaba China Co Ltd
Current assignee: Alibaba China Co Ltd
Priority date: 2021-09-30
Filing date: 2021-09-30
Publication date: 2022-01-28

Abstract

The embodiment of the invention provides a data processing method based on a monitoring operation and maintenance system and the monitoring operation and maintenance system, wherein the monitoring operation and maintenance system is provided with an access module, a data module, a service module and an application module, and the method comprises the following steps: the access module is accessed to the Internet of things equipment in different data systems; the data module receives the equipment data which are reported by the access module and aim at the accessed Internet of things equipment, and processes the equipment data in real time according to the requirements of the data system; and the service module provides services for each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to a data system. According to the embodiment of the invention, the integrated operation, maintenance and monitoring system is created, and the requirements of the Internet of things equipment on operation, maintenance and monitoring are met.

Description

Data processing method based on monitoring operation and maintenance system and monitoring operation and maintenance system

Technical Field

The invention relates to the technical field of data processing, in particular to a data processing method based on a monitoring operation and maintenance system and the monitoring operation and maintenance system.

Background

With the development of the Internet of Things technology, the number of Internet of Things devices that can support accessing the Internet of Things is increasing, for example, to manage a data center campus, hundreds of thousands of IoT (Internet of Things) devices may be deployed in the data center campus, and the types of IoT devices accessed in the data center campus are hundreds.

In the current internet of things technology, monitoring of a certain area is mainly realized by simply combining a plurality of pieces of hardware, but the requirements for operation and monitoring generated along with massive internet of things equipment are difficult to meet.

Disclosure of Invention

In view of the above problems, it is proposed to provide a data processing method and apparatus based on a monitoring operation and maintenance system, which overcome the above problems or at least partially solve the above problems, and includes:

a data processing method based on a monitoring operation and maintenance system, wherein the monitoring operation and maintenance system is provided with an access module, a data module, a service module and an application module, and comprises the following steps:

the access module is accessed to the Internet of things equipment in different data systems;

the data module receives the equipment data which are reported by the access module and aim at the accessed Internet of things equipment, and processes the equipment data according to the requirements of a data system;

and the service module provides services for each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to a data system.

Optionally, the accessing module accesses internet of things devices in different data systems, including:

the access module calls an Internet of things platform accessed by Internet of things equipment in different data systems, and the Internet of things platform adopts a first object model adaptive to the monitoring operation and maintenance system;

and/or the access module creates a second object model aiming at the Internet of things equipment accessed into different data systems and establishes mapping between the second object model and the Internet of things equipment.

Optionally, the method further comprises:

the data module stores the device data in a preset time sequence database.

Optionally, the processing the device data in real time according to the requirement of the data system includes:

the data module forwards the equipment data;

and/or calling a calculation example of a data system to calculate the equipment data;

and/or generating an alarm event aiming at the equipment data according to an alarm rule of a data system.

Optionally, before the real-time processing of the device data according to the requirement of the data system, the method further includes:

and the data module is used for preprocessing the equipment data.

Optionally, the method further comprises:

and the data module generates a control instruction when triggering a device control event configured by the tenant object, and sends the control instruction to the Internet of things device through the access module.

Optionally, a plurality of tenant objects in the application module share the same service in the service module.

A monitoring operation and maintenance system having an access module, a data module, a service module, and an application module, wherein:

the access module is used for accessing the Internet of things equipment in different data systems;

the data module is used for receiving the equipment data which are reported by the access module and aim at the accessed Internet of things equipment, and processing the equipment data according to the requirements of a data system;

the service module is used for providing services for each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to a data system.

A server comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, wherein the computer program, when executed by the processor, implements the monitoring operation and maintenance system-based data processing method as described above.

A computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements a monitoring operation and maintenance system-based data processing method as described above.

The embodiment of the invention has the following advantages:

according to the embodiment of the invention, the access module is accessed to the Internet of things equipment in different data systems, the data module receives the equipment data which are reported by the access module and aim at the accessed Internet of things equipment, and processes the equipment data according to the requirements of the data system, the service module provides services for each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to one data system, so that an integrated operation, maintenance and monitoring system is created, and the requirements of the Internet of things equipment on operation, maintenance and monitoring are met.

Drawings

In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the description of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1a is a flowchart illustrating steps of a data processing method based on a monitoring operation and maintenance system according to an embodiment of the present invention;

FIG. 1b is a monitoring operation and maintenance system architecture diagram according to an embodiment of the present invention;

fig. 2 is a flowchart illustrating steps of another data processing method based on a monitoring operation and maintenance system according to an embodiment of the present invention;

fig. 3 is a flowchart illustrating steps of another data processing method based on a monitoring operation and maintenance system according to an embodiment of the present invention;

fig. 4 is a flowchart illustrating steps of another data processing method based on a monitoring operation and maintenance system according to an embodiment of the present invention;

fig. 5 is a block diagram of a monitoring operation and maintenance system according to an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In practical application, there are a large amount of thing networking coverage areas, like the Data Center garden, at present, in the Data Center garden, can deploy the IoT (Internet of Things) equipment of hundreds of thousands of scales for the digital garden is found, and the intellectuality fortune dimension can be realized to the digital garden based on IDC (Internet Data Center ) business scene, thereby guarantee garden safety, has promoted garden operating efficiency.

However, in the coverage area of the internet of things, the following problems to be solved urgently exist in the operation and maintenance monitoring process of massive internet of things equipment:

(1) in the current data center campus, a large number of IoT devices need to be managed, but the manufacturers and models of the IoT devices are numerous, and access protocols that different IoT devices can support are different, which increases access cost.

(2) Different IoT equipment needs to be controlled according to a data system, so that an equipment account system is split, manufacturers of different equipment need to perform research and development deployment respectively, and further, the delivered equipment quality is uneven, and user experience is influenced.

(3) The IoT device data has a high requirement on the calculation timeliness, so that the calculation timeliness of massive time series data cannot be guaranteed.

In the embodiment of the invention, in order to solve the problem of increasing the management efficiency of the IoT equipment, an IoT monitoring operation and maintenance integrated scheme is provided, which is based on an IoT platform to construct a uniform equipment model access layer, a multi-tenant account management system to control various types of data, and a time sequence database and a uniform computing platform, so that the IoT equipment is efficiently monitored and operated.

The following is a detailed description:

referring to fig. 1a, a flowchart illustrating steps of a data processing method based on a monitoring operation and maintenance system according to an embodiment of the present invention is shown; referring to fig. 1b, the monitoring operation and maintenance system has a unified access layer, a data processing layer, a data service layer, and a tenant support layer.

(1) Unified access layer (i.e. access module)

The unified access layer can abstract model attributes of the IoT equipment, performs unified access management on heterogeneous equipment, multiplexes high available middlebox capability of the converged cloud IoT, is compatible with other gateways, direct connection equipment and other NVR (Network Video Recorder) access schemes, shields equipment bottom layer differences, and mainly completes functions including equipment authentication, equipment networking, application keep-alive, remote control upgrading and data communication.

(2) Data processing layer (data module)

The data processing layer can be responsible for storing and accessing data, and can process massive time series data reported by the IoT equipment, such as GPS road spectrum data, acousto-optic/anti-metal tag response data, and destroy production line operation data. The data processing layer has rule execution capacity, can perform preliminary processing such as pre-calculation, filtering and aggregation on data, stores the data in a cloud native time sequence database, supports the calculation requirements of complex expression calculation, index statistics, data path extremely-fast tracking rendering and the like by utilizing the characteristics of efficient reading and writing, high compression ratio storage, time sequence data interpolation and the like of a time sequence engine, and finally serves a foreground real-time visualization center.

(3) Data service layer (service module)

The data service layer can provide reusable services, and the data service layer can manage metadata, mainly manage metadata information such as tenant account information, equipment information and basic rule configuration information, and provide basic management functions such as model definition of equipment information, manufacturer model state inquiry and parameter setting.

(4) Tenant support layer (application module)

The platform serves different business fields and can be divided into different tenant objects according to the business fields. Data generated in tenants must be stored in current tenants, and data among tenants cannot be seen mutually

The tenant support layer can adopt a multi-tenant architecture sharing the application programs and the database, and the architecture mode has the advantage of high efficiency.

The tenant support layer mainly solves two problems, namely tenant information transparent transmission and data layer tenant isolation, and the main functions can comprise tenant account registration, tenant identity verification and identification, tenant role authority configuration and tenant identity implantation data isolation.

Specifically, the method can comprise the following steps:

step 101, an access module accesses Internet of things equipment in different data systems;

the monitoring operation and maintenance system can comprise an access module, a data module, a service module and an application module, and the monitoring operation and maintenance is cooperatively realized among all layers.

In the access module, internet of things devices in different data systems can be accessed, wherein the internet of things devices in different data systems can be heterogeneous devices, and access protocols supported by different internet of things devices are also different, and the access protocols can include: 4G/5G, Wifi 5/6, NB-IoT (narrowband Internet of things), Zigbee (purple peak), Bluetooth (Bluetooth), Ethernet (Ethernet) and other protocols.

The internet of things device may be divided into a complex device, a simple device, and a composite device, for example, as shown in fig. 1b, the complex device composed of the IOT SDK and the IOT Agent may include a plurality of different sub-devices.

Through accessing the internet of things equipment with different data systems, the problem that the account system is cracked due to the fact that the equipment is respectively controlled according to the data systems in the prior art can be solved. And heterogeneous equipment in different data systems supports different access protocols, and the access module is uniformly accessed, so that the equipment access cost is reduced, and the deployment efficiency is improved.

In practical applications, the access mode of the access module may be divided into an access mode of an IoT platform and an access mode with an SDK.

(1) Access mode of IoT platform:

for the access mode of the IoT platform, the access module can call an internet of things platform accessed by internet of things devices in different data systems, the internet of things platform can adopt an adapter model adapted to a monitoring operation and maintenance system, and thus the adapter model is used as a unified access standard, the access module does not need to be additionally developed, a manufacturer side needs to newly build a device product and define and develop a physical model of the device product, wherein the physical model of the device is a digital representation of an entity (such as a sensor, a vehicle-mounted device, a building, a factory and the like) on the internet of things platform, and can set attributes (describing what the entity is), services (describing what the entity can do), and events (describing what information the entity can provide externally) to complete the definition of product functions in three dimensions. In the monitoring operation and maintenance system, the equipment can report the information attribute and the event information, the server can issue the setting equipment attribute and the calling service instruction,

the object model is a standard, and can simultaneously restrict a manufacturer and a business party, wherein the manufacturer develops the functions of hardware equipment according to the object model, and the business party can control the hardware from the access module according to the object model.

In the access module, by fusing the capabilities of an IoT platform, a VCS platform and the like, the system can encapsulate an Application Programming Interface (API) of the internet of things, so that the IoT platform is fused in the system as an access mode, and therefore, all the capabilities of the IoT can be supported in the system, and further, in the monitoring operation and maintenance process, safe and reliable connection communication capability can be provided, mass equipment can be connected downwards, and equipment data collection and cloud collection are supported; and a cloud API is provided upwards, and the server issues the command to the equipment end by calling the cloud API, so that remote control is realized.

In the access module, by multiplexing the IoT capability, the access module can provide SDKs (Software Development kits) of different Development environments to a manufacturer side, and the manufacturer can develop the SDKs according to an object model and then burn the SDKs into hardware to access the access module by downloading the SDKs,

through the above manner, a lower-layer physical communication access manner can be shielded, communication interaction between the data module and the access module is limited to a specific communication manner, such as RPC (Remote Procedure Call), hypertext Transfer Protocol (HTTP), MetaQ (distributed message middleware), without concern for an internal development manner of device hardware and different networking communication manners, for example, communication protocols such as direct analysis bluetooth and Zigbee (Zigbee) can be accessed even for an internet of things device supporting different access protocols.

On the other hand, for defined equipment products, such as intelligent cabinets, the object model standardizes the equipment functions and the access parameters, the internet of things equipment can not be limited to fixed manufacturers, the manufacturers can tender the equipment, and the manufacturers with poor quality and poor after-sales can be replaced. Therefore, manufacturers need to comply with the object model specification, and therefore upper-layer codes do not need to be changed, and repeated development cost is effectively avoided.

(2) The access mode with the SDK is as follows:

the method with the SDK is a legacy access method for stock equipment, and can be subsequently migrated to an IoT platform. In this case, generally, a manufacturer does not support access to the IoT platform or has no secondary development capability, the access module needs to perform a small amount of development and configuration work, the manufacturer SDK is introduced, and the object model is formulated, so that the configuration service invokes the mapping rule, and the service in the object model can be mapped to the manufacturer SDK, that is, the mapping between the object model and the internet of things device is established.

102, a data module receives device data which are reported by an access module and aim at accessed Internet of things devices, and processes the device data according to the requirements of a data system;

after the equipment data of the internet of things equipment is collected, the equipment data can be reported through the access module, so that the equipment data reported by the access module can be received in the data module of the monitoring operation and maintenance system, and the equipment data can be processed according to different requirements.

In one example, the device data may be a time series data, and after being preprocessed, the time series data may be stored in a preset time series database, and the real-time data may be calculated in real time, so as to ensure the calculation timeliness of the device data.

The time sequence data is a series of data with time sequence, for example, a GPS sensor can be used for monitoring the moving and transporting process of high-value assets in a machine room. The GPS sensor can acquire various state data such as longitude and latitude, speed, direction, vibration data and the like, and data such as signal intensity, electric quantity and the like of the GPS. The acquired massive time series data can be used for real-time warning and big data analysis, so that the monitoring of high-value assets is realized, and the transportation efficiency and quality of logistics merchants are inspected.

When the time sequence data are calculated in real time, for example, various real-time alarm rules, time range overrun, abnormal vibration, entering a safety electronic fence area, deviating from a preset route, filtering dirty data and the like are carried out. These real-time calculations have high requirements on timeliness, and once an abnormal condition occurs, a logistics dealer needs to be contacted timely to confirm the condition.

By calculating the equipment data in real time, the calculation real-time performance can be effectively ensured.

In practical application, in the data module, the device data can be preprocessed first, and then after preprocessing, the device data can be stored according to the requirement of the data system, and meanwhile, function calculation, forwarding and alarm event generation can be performed to alarm.

The data processing procedure in the data processing layer (i.e. data module) is described below with reference to fig. 1 b:

(1) pretreatment of

The process of preprocessing the device data (i.e. the reported data in fig. 1 b) may specifically be as follows:

the data processing layer carries out aggregation filtering on the received equipment data, and then carries out rapid data filtering and analysis processing by combining with streaming engine collocation rules such as Blink and the like, so that the timeliness is further improved.

In the aggregation filtering process, an aggregation rule and a filtering rule may be set in a data processing layer, after receiving device data reported by a unified access layer (i.e., an access module), the device data may be aggregated according to a preset aggregation rule, and then, the device data may be filtered according to a preset filtering rule.

For example, the latitude and longitude data uploaded at regular time by the GPS may have a positioning drift phenomenon due to some reasons of signals or devices, and such data is dirty data.

The metal detection alarm data uploaded by the metal detection door equipment can trigger a plurality of pieces of alarm data in a short time due to high detection sensitivity, and not all the alarm data need to be reported to a service system (namely a data system) to generate a verification work order, an aggregation rule is set in a data processing layer, and only one piece of alarm data is output to a service module (a data service layer) when the alarm data of the same type of the same equipment is in a fixed time window (for example, 5 minutes).

The purpose of aggregation filtering is to preprocess the reported data, so that the data quality is higher, meanwhile, the use of a data service layer is facilitated, and the business process is simplified.

(2) Storing

The device data can be completely stored in the time sequence database, the time sequence database removes the single-table size limitation of the traditional relational data, and the storage query performance of the streaming time sequence data is greatly improved.

(3) Function computation

According to the business requirements, the calculation examples of the data system can be called to calculate the equipment data, so that more flexible real-time data processing can be carried out.

In addition, the preprocessed device data can be transmitted to a corresponding offline calculation example, and the reported data can flow to an offline calculation table, so that predefined offline calculation is performed, for example, daily-to-annular ratio of the previous day of the number of alarms of the access control of one machine room is counted regularly every day.

After offline computing, the data is stored in a relational database, which is a conventional database, such as mysql (relational database management system), and the relational database may be used to store metadata, such as object models of products, manufacturers, models, access manners, configuration rules of devices, tenant information, cloud account number, and other fixed information.

(3) Forwarding

After being processed by the configuration rule in the data processing layer, the device data can be directly forwarded to the data service layer (i.e., a service module) to trigger a corresponding service, or directly forwarded to a data warehouse (e.g., a DataHub).

(4) Alarm event

Alarm rules can be configured in the monitoring operation and maintenance system, and when the alarm rules are triggered by data reported to the data processing layer, alarm events can be generated according to the alarm rules. Therefore, the problem of equipment fault can be found and positioned in time and can be processed in time.

For example, when alarm rule configuration is performed, a rule with an attribute greater than, less than, or within a certain interval to generate an alarm may be selected, for example, if the value of the speed attribute reported by the GPS is set to exceed 80km/h, an alarm datum is generated.

In an embodiment of the present invention, the method further includes:

the data module generates a control instruction when triggering a device control event configured by the tenant object, and sends the control instruction to the Internet of things device through the access module.

In practical application, the device attribute is defined in the attribute of an object model, the device event is defined in an event in the object model and uploaded to an access module when triggered by hardware equipment, a device control command is defined in a service of the object model, an interface invokeService (calling service) encapsulated by the access module is called by a data service layer, and a device id, a service name and a service parameter are transmitted.

The tenant object can configure a device control event, namely, an attribute policy is set, when the device control event is triggered in the data module, it can be understood that a state reported by the device matches the attribute policy, a corresponding control instruction can be generated, and the control instruction is sent to the internet of things device through the access module so as to control the internet of things device.

For example, in the case of configuring a low power rule of the maintenance robot, when the power of the maintenance robot is lower than a set threshold, the platform issues an instruction to allow the robot to suspend the current operation, and returns to charge the charging pile.

In one example, in the data module, equipment problems and routing inspection can be quickly and timely handled by a work order scheduling system of a multiplex data center.

The work order scheduling system of the multiplex data center is used for rapidly and timely processing equipment problems and the inspection work order system is the core capability of field operation and maintenance of the machine room, and the work of various personnel such as the parking place of the machine room can be abstracted into various work orders, such as maintenance orders, server loading orders, removal orders, material output warehousing orders, box entering orders and the like.

The personnel in the machine room are provided with handheld PDA equipment (provided with modules for scanning, RFID induction and the like), can handle various work orders on the palm, and can authorize the access control permission of the machine room according to the work orders. The work order scheduling system can distribute the work orders of the same type and the same packages to the same processor or the processor closest to the same package, so that the processor is prevented from reducing invalid transition time.

In addition, the alarm event center can also reuse a work order scheduling system, and the equipment inspection and maintenance are distributed to the field personnel of the machine room as a work order for processing.

Step 103, the service module provides services to each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to a data system.

In the embodiment of the invention, a plurality of tenant objects in the application module share the same service in the service module.

In the service module, various services can be integrated, and the services can be provided for each tenant object in the application module according to the data provided by the data module. The tenant object corresponds to a data system, such as an asset management data system, a security management data system, and the like.

In practical applications, different data systems may share the same service, so that a middlebox service may be provided in the service module on the architecture to support the business operation of the upper layer.

The middle platform service is relative to the service development service, and the framework extracts public services of equipment such as access deployment, metadata management, rule setting, fault alarm, command control, after-sale performance investigation of manufacturers, algorithm input and the like from a service side, so that the decoupling of equipment management and upper-layer service is realized.

For example, two service parties of a machine room field security service and a machine room asset operation have respective operation systems, although camera equipment is used, a security service development camera is biased to personnel stealing behavior and personnel intrusion identification, the camera of the asset operation is used for monitoring whether an asset post puts assets into an intelligent cabinet, belongs to different service, budget, manufacturer and different algorithm teams for butt joint, but both parties have the requirement of managing the camera, and the part of common service is abstracted and standardized from a data system to be a middle platform service.

In the service module, the service module is divided into three centers according to functions: the system comprises an alarm event center, a user center and an equipment center, wherein the equipment center, the alarm event center and other components are service capabilities required by each data system, and relatively speaking, service attributes are weak, so that the components can be decoupled from a service layer to form a middle platform service, development and repeated construction of development teams in each service field are avoided, the component reuse efficiency is improved, and the repeated development cost is saved.

In one example, an alarm event center can manage services related to equipment alarms, and specifically includes sub-functions of subscription notification, rule definition, work order management, large-screen report forms and the like, rule matching can be set in the alarm event center, personnel notification is performed on various alarm events triggered by rules, a function of ignoring and deleting inquiry is provided, and basic indexes such as types, time interval distribution, processing response standard reaching rate and the like of the alarm events are counted; the user center is used for managing services related to the tenant object, and specifically comprises sub-functions of tenant registration, tenant management, authority configuration and the like, so that the user center can manage basic information of the tenant, such as tenant name, cloud account number, owner, authorized associated account, sub-account authority and the like; the equipment center is used for managing basic information of the manufacturer model number of the equipment at an off-line state deployment position and the like, and specifically comprises sub-functions of model definition, control upgrading, information management, after-sale maintenance and the like.

In addition, metadata can be defined and managed in a data module, the metadata can comprise data such as equipment information, object models and account information, and after the data is defined, the metadata can be stored in a traditional relational database.

In the monitoring operation and maintenance system, the tenant objects can be divided according to the service field, and due to the adoption of a multi-tenant architecture, data among the tenant objects can be isolated and protected, and the data authority can be finely controlled.

Each tenant has a tenant id, all data query and operation are carried with the tenant id, and data isolation is carried out according to the tenant id, so that data among the tenants can be invisible.

In the monitoring operation and maintenance system, two problems of tenant information transmission and data layer tenant isolation can be solved by adopting a tenant isolation form of a shared application program and a database.

1. Application (Spring boot) isolation: tenant Context is stored in tenant information in application by using thread local, and the tenant information transparent transmission support among applications is http request, rpc request and message middleware, wherein the http request: the front end puts the combined information in the cookie, the back end analyzes the tenant information in the request head, and analyzes the tenant Context through the http filter; the HSF requests: adding a corresponding HSF filter; message middleware: and uniformly transmitting the added tenant field.

2. Database isolation (here MySQL is taken as an example): the Mybatis plug-in the String boot supports interception of all SQL submitted to the DAO layer, dynamically acquires tenant id variables in the application context, and automatically adds screening of the tenant id to WHERE conditions of a SELCT statement when query is executed; when the write operation is executed, the tenant id is automatically inserted into the data table, and the development cost of the code in the tenant transformation process is greatly reduced.

According to the embodiment of the invention, the access module is accessed to the Internet of things equipment in different data systems, the data module receives the equipment data which are reported by the access module and aim at the accessed Internet of things equipment, and processes the equipment data in real time according to the requirements of the data system, the service module provides services for each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to one data system, so that the integrated operation, maintenance and monitoring system is created, and the requirements of the Internet of things equipment on operation, maintenance and monitoring are met.

In the embodiment of the invention, the access module is accessed to the internet of things equipment in different data systems, the data module receives the equipment data which is reported by the access module and aims at the accessed internet of things equipment, and processes the equipment data in real time according to the requirements of the data system, the service module provides services for each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to one data system, so that the integrated operation, maintenance and monitoring system is created, and the requirements of the internet of things equipment on operation, maintenance and monitoring are met.

Referring to fig. 2, a flowchart illustrating steps of another data processing method based on a monitoring operation and maintenance system according to an embodiment of the present invention is shown, and specifically may include the following steps:

step 201, an access module calls an internet of things platform accessed by internet of things equipment in different data systems, wherein the internet of things platform adopts a first object model adaptive to a monitoring operation and maintenance system;

in the monitoring operation and maintenance system, the Internet of things platform can adopt a first object model adaptive to the monitoring operation and maintenance system, and Internet of things equipment in different data systems is accessed into the Internet of things platform, so that the Internet of things platform is called by an access module, the IoT multiplexing capability is realized, and the repeated development cost can be effectively avoided without any change of upper-layer codes.

In practical application, for an access mode of an IoT platform, an access module can call an internet of things platform accessed by internet of things devices in different data systems, the internet of things platform can adopt an object model adaptive to a monitoring operation and maintenance system, and thus the object model serves as a unified access standard, the access module does not need additional development, a manufacturer side needs to create a new device product, and defines and develops an object model of the device product, wherein the object model of the device is a digital representation of an entity (such as a sensor, a vehicle-mounted device, a building, a factory and the like) on the internet of things platform, and can set attributes (describing what the entity is), services (describing what the entity can do), and an event (describing which information the entity can provide externally) to complete definition of product functions in three dimensions. In the monitoring operation and maintenance system, the equipment can report the information attribute and the event information, the server can issue the setting equipment attribute and the calling service instruction,

On the other hand, for defined equipment products, such as intelligent cabinets, the object model standardizes the equipment functions and the access parameters, the internet of things equipment can not be limited to fixed manufacturers, the manufacturers can tender the equipment, and the manufacturers with poor quality and poor after-sales can be replaced. Therefore, manufacturers need to comply with the object model specification, and the upper-layer code does not need to be changed, so that the repeated development cost is effectively avoided.

Step 202, a data module receives device data, which is reported by an access module and aims at the accessed internet of things device, and processes the device data according to the requirement of a data system;

after the device data of the internet of things device is collected, the device data can be reported through the access module, so that the device data reported by the access module can be received in the data module of the monitoring operation and maintenance system.

The equipment data can be a time sequence data, after being preprocessed, the equipment data can be stored in a preset time sequence database, and real-time calculation can be carried out on the real-time data, so that the calculation timeliness of the equipment data is ensured.

Step 203, the service module provides services to each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to a data system.

In the embodiment of the invention, the access module is used for calling the Internet of things platform accessed by the Internet of things equipment in different data systems, the Internet of things platform adopts the first object model matched with the monitoring operation and maintenance system, the data module receives the equipment data, reported by the access module, of the accessed Internet of things equipment and processes the equipment data in real time according to the requirements of the data system, the service module provides services for each tenant object in the application module according to the data provided by the data module, each tenant object corresponds to one data system, so that the integrated operation, maintenance and monitoring system is created, the operation, maintenance and monitoring requirements of the Internet of things equipment are met, and the repeated development cost is effectively avoided by calling the Internet of things platform.

Referring to fig. 3, a flowchart illustrating steps of another data processing method based on a monitoring operation and maintenance system according to an embodiment of the present invention is shown, which may specifically include the following steps:

step 301, the access module creates a second object model for the internet of things devices accessing different data systems, and establishes a mapping between the second object model and the internet of things devices.

The second object model aiming at the Internet of things equipment accessed to different data systems can be created in the access module, and then the mapping between the second object model and the Internet of things equipment is established, so that the Internet of things equipment accessed to different data systems can be achieved.

In practical application, when a manufacturer does not support access to an IoT platform or has no secondary development capability, an access module needs to perform a small amount of development and configuration work, a manufacturer SDK is introduced, and a physical model is formulated, so that a mapping rule is called by configuration service, and the service in the physical model can be mapped to the manufacturer SDK, that is, mapping between the physical model and the internet of things device is established.

Step 302, a data module receives device data, which is reported by an access module and aims at the accessed internet of things device, and processes the device data in real time according to the requirement of a data system;

Step 303, the service module provides services to each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to a data system.

In the embodiment of the invention, an access module creates a second object model for accessing the internet of things equipment in different data systems, and establishes mapping between the second object model and the internet of things equipment, a data module receives equipment data for the accessed internet of things equipment reported by the access module and processes the equipment data in real time according to the requirements of the data system, a service module provides services for each tenant object in an application module according to the data provided by the data module, and each tenant object corresponds to one data system, so that the integrated operation, maintenance and monitoring system is created, the operation, maintenance and monitoring requirements of the internet of things equipment are met, and the method is suitable for accessing the internet of things equipment of different data systems under the condition that an internet of things platform cannot be called.

Referring to fig. 4, a flowchart illustrating steps of another data processing method based on a monitoring operation and maintenance system according to an embodiment of the present invention is shown, which may specifically include the following steps:

step 401, an access module accesses internet of things equipment in different data systems;

Step 402, a data module receives device data, which is reported by an access module and aims at the accessed Internet of things device;

In step 403, the data module preprocesses the device data.

After the data module receives the device data, the device data can be preprocessed, specifically, the data module performs aggregation filtering on the received device data, and then rapid data filtering and analysis processing are performed by combining streaming engine collocation rules such as Blink and the like, so that timeliness is further improved.

In the aggregation filtering process, an aggregation rule and a filtering rule may be set in the data module, after receiving the device data reported by the access module, the device data may be aggregated according to a preset aggregation rule, and then the device data is filtered according to a preset filtering rule.

In step 404, the data module stores the device data in a preset time series database.

After preprocessing, the device data can be stored in a preset time sequence database, and the time sequence database removes the single-table size limitation of the traditional relational data, so that the storage and query performance of the streaming time sequence data is greatly improved.

Step 405, the data module processes the device data according to the requirements of the data system;

different data processing requirements can be met for different data systems, and the data module can process equipment data in real time according to the requirements of the data systems. Thus, the calculation timeliness is ensured.

In an embodiment of the present invention, step 405 may include:

substep 4051, the data module forwards the device data;

in practical application, after the data module is processed, the device data can be directly forwarded to the service module to trigger a corresponding service, or directly forwarded to a data warehouse of the data system.

And/or, sub-step 4052, invoking a computing instance of the data system to compute the device data;

in practical application, a calculation example of a data system can be called according to business requirements, and equipment data can be calculated so as to perform more flexible real-time data processing.

In addition, the preprocessed device data can be transmitted to an offline calculation example, the reported data can flow to an offline calculation table, and defined offline calculation is performed, for example, a daily-to-annular ratio of the previous day of the number of alarms of the access control of one machine room is counted regularly every day.

And/or, sub-step 4053, generating an alarm event for the device data according to alarm rules of the data system.

Alarm rules can be configured in the monitoring operation and maintenance system, and when the alarm rules are triggered by data reported to the data module, alarm events can be generated according to the alarm rules. Therefore, the problem of equipment fault can be found and positioned in time and can be processed in time.

Step 406, the service module provides services to each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to a data system.

In the embodiment of the invention, the access module is accessed to the internet of things equipment in different data systems, the data module receives equipment data, reported by the access module, of the accessed internet of things equipment, the equipment data is preprocessed and can be stored in a preset time sequence database, the equipment data is processed in real time according to the requirements of the data system, the service module provides services for each tenant object in the application module according to the data provided by the data module, and each tenant object corresponds to one data system, so that the integrated operation, maintenance and monitoring system is created, and the requirements of the internet of things equipment on operation, maintenance and monitoring are met.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 5, a schematic structural diagram of a monitoring operation and maintenance system provided in an embodiment of the present invention is shown, where the monitoring operation and maintenance system includes an access module 501, a data module 502, a service module 503, and an application module 504, where:

the access module 501 is configured to access internet of things devices in different data systems;

the data module 502 is configured to receive the device data, which is reported by the access module 501 and is for the accessed internet of things device, and process the device data in real time according to the requirement of the data system;

the service module 503 is configured to provide services to each tenant object in the application module 504 according to the data provided by the data module 502, where each tenant object corresponds to a data system.

In the embodiment of the present invention, when the access module is used for accessing internet of things devices in different data systems, the access module is specifically configured to:

calling an Internet of things platform accessed by Internet of things equipment in different data systems, wherein the Internet of things platform adopts a first object model matched with the monitoring operation and maintenance system;

and/or creating a second object model aiming at the Internet of things equipment accessed into different data systems, and establishing the mapping between the second object model and the Internet of things equipment.

In an embodiment of the present invention, the data module is further configured to store the device data in a preset time sequence database.

In an embodiment of the present invention, when the data module is used for processing the device data in real time according to the requirement of the data system, the data module is specifically configured to:

forwarding the device data;

In an embodiment of the present invention, the data module is further configured to perform preprocessing on the device data.

In an embodiment of the present invention, the data module is further configured to generate a control instruction when a device control event configured by the tenant object is triggered, and send the control instruction to the internet of things device through the access module.

In an embodiment of the present invention, a plurality of tenant objects in the application module share the same service in the service module.

An embodiment of the present invention further provides a server, which may include a processor, a memory, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, implements the data processing method based on the monitoring operation and maintenance system as described above.

An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the data processing method based on the monitoring operation and maintenance system is implemented.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The method based on the monitoring operation and maintenance system and the monitoring operation and maintenance system are introduced in detail, and a specific example is applied in the text to explain the principle and the implementation of the invention, and the description of the above embodiment is only used to help understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A data processing method based on a monitoring operation and maintenance system is characterized in that the monitoring operation and maintenance system is provided with an access module, a data module, a service module and an application module, and comprises the following steps:

2. The method of claim 1, wherein the accessing module accesses the internet of things devices in different data systems, and comprises:

3. The method of claim 1 or 2, further comprising:

the data module stores the device data in a preset time sequence database.

4. The method of claim 3, wherein the real-time processing of the device data according to the requirements of the data system comprises:

the data module forwards the equipment data;

5. The method of claim 4, further comprising, prior to said processing said device data in real-time according to the requirements of the data system:

and the data module is used for preprocessing the equipment data.

6. The method of claim 1, further comprising:

7. The method of claim 1, wherein a plurality of tenant objects in the application module share a same service in the service module.

8. A monitoring operation and maintenance system is characterized in that the monitoring operation and maintenance system is provided with an access module, a data module, a service module and an application module, wherein:

9. A server, comprising a processor, a memory, and a computer program stored on the memory and capable of running on the processor, wherein the computer program, when executed by the processor, implements the monitoring operation and maintenance system-based data processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the monitoring operation and maintenance system-based data processing method according to any one of claims 1 to 7.