CN112702877B - Cabinet interior remote monitoring and diagnosis method and system, cabinet device and storage medium - Google Patents

Abstract

The invention discloses a cabinet interior remote monitoring and diagnosing method and system, a cabinet device and a storage medium, wherein the cabinet interior remote monitoring and diagnosing method comprises the following steps: collecting multi-source data in the cabinet, and dividing the multi-source data into a plurality of data groups according to unit time; respectively preprocessing the data groups and generating corresponding standard data groups, and then establishing a standard data set; selecting a standard data group in the standard data set to synthesize a cabinet monitoring graph, and synthesizing the cabinet monitoring graphs into a cabinet dynamic display graph at different time intervals to dynamically display a cabinet visual model; and the cabinet dynamic display diagram is subjected to authority fragmentation according to functions so as to carry out remote fault diagnosis on different functions, solve the problem that the targeted diagnosis on the internal faults of the cabinet cannot be carried out remotely in the prior art, and realize the remote diagnosis on the specific faults of the single equipment.

Description

Remote monitoring and diagnosis method and system inside cabinet, cabinet device and storage medium

technical field

The invention relates to the technical field of remote processing, in particular to a method and system for remote monitoring and diagnosis inside a cabinet, a cabinet device and a storage medium.

Background technique

With the development of digital technology, the process of digital transformation in various fields has also accelerated. In the process of digital transformation, data processing centers that meet the needs of large-scale storage and centralized storage of data continue to emerge. Currently, the monitoring of data processing centers mainly focuses on power and environment. Equipment, such as power distribution, uninterruptible power supply, air conditioning, fire protection, monitoring, anti-theft alarm and other subsystems, take measures such as 24-hour staff on duty and regular inspections of environmental equipment to ensure the effective work of the data processing center.

However, the core components in the data processing center are specific business application equipment. These equipment are usually placed in the cabinet and exist in the form of standard chassis. They have the characteristics of multi-service and multi-vendor. Different businesses and equipment from different manufacturers require specific professionals for maintenance. Often, when specific problems occur, manufacturers’ personnel go to the data processing center to solve them. The management efficiency and management security of the data processing center also greatly increase the maintenance cost. Moreover, when the on-site personnel operate the equipment inside the cabinet, the operation may be wrong, and multi-expert consultation cannot be carried out on the fault. Or, for example, the safety problems that the strong electrical equipment in the cabinet in the power system will bring to the operator.

Therefore, with the continuous expansion of the data processing center, it is very important to design a remote monitoring and diagnosis method and system inside the cabinet.

SUMMARY OF THE INVENTION

The main purpose of the present invention is to provide a method and system for remote monitoring and diagnosis inside a cabinet, a cabinet device and a storage medium, which aim to solve the problem of inability to remotely diagnose the internal faults of the cabinet in a targeted manner in the prior art.

To achieve the above object, the present invention provides a method for remote monitoring and diagnosis inside a cabinet. In one embodiment, the method for remote monitoring and diagnosis inside a cabinet includes the following steps:

Collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups according to unit time;

After the data sets are preprocessed and corresponding standard data sets are generated, standard data sets are established;

Selecting standard data sets in the standard data set to synthesize the cabinet monitoring graph, and synthesizing the cabinet monitoring graphs at different time periods into the cabinet dynamic display graph for dynamic display of the visual model of the cabinet;

The dynamic display diagram of the cabinet is divided into permissions according to functions, so as to perform remote fault diagnosis for different functions.

In one embodiment, the multi-source data includes at least: dynamic images inside the cabinet, images inside the cabinet, and voiceprint data inside the cabinet.

In one embodiment, after the data sets are preprocessed and corresponding standard data sets are generated, a standard data set is established, including:

Preprocess the multi-source data in each data set to generate a standard data set with fixed position sorting;

The standard data set is established according to time sequence to create a standard data set.

In one embodiment, the standard data set in the standard data set is selected to synthesize the cabinet monitoring graph, and the cabinet monitoring graphs at different time periods are synthesized into the cabinet dynamic display graph for dynamic display of the visual model of the cabinet, including:

respectively selecting at least one standard data group in the standard data set to synthesize the corresponding cabinet monitoring graph;

Combine the cabinet monitoring diagrams at different time periods into the cabinet dynamic display diagram;

The cabinet monitoring diagram in the cabinet dynamic display diagram performs the dynamic display of the cabinet visual model according to the time sequence.

In an embodiment, the method further includes: respectively selecting at least one standard data group in the standard data set to synthesize a corresponding cabinet monitoring diagram, including: selecting two standards in the standard data set that are adjacent in time or in position respectively. The data is grouped to synthesize the corresponding cabinet monitoring diagram.

In one embodiment, the standard data set is used to form a partial image inside the cabinet; the two standard data sets that are adjacent in time or position in the standard data set are respectively selected to synthesize a corresponding cabinet monitoring map, including:

Perform feature extraction on two local images adjacent in time or position to obtain corresponding feature points;

performing similarity measurement on the feature points to obtain matched feature point pairs;

Obtaining the spatial coordinate transformation parameter of the local image according to the feature point pair;

Image registration is performed using the space coordinate transformation parameters to synthesize a cabinet monitoring map.

In order to achieve the above object, the present invention also provides a remote monitoring and diagnosis system inside the cabinet, the system includes:

Multi-source data acquisition module: used to collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups according to unit time;

Multi-source data processing module: used to preprocess the data sets and generate corresponding standard data sets, and then establish standard data sets;

Cabinet monitoring map synthesis module: used to select standard data sets in the standard data set to synthesize the cabinet monitoring map;

Cabinet visual model dynamic display module: It is used to synthesize the cabinet monitoring diagrams at different time periods into the cabinet dynamic display diagram for dynamic display of the cabinet visual model;

Remote fault diagnosis module: It is used to divide the dynamic display diagram of the cabinet according to the function to perform authority segmentation, so as to carry out remote fault diagnosis for different functions.

In one embodiment, the cabinet monitoring map synthesis module is further used for:

At least one standard data group in the standard data set is respectively selected to synthesize a corresponding cabinet monitoring graph.

In order to achieve the above object, the present invention also provides a cabinet device, the cabinet device includes a memory, a processor, and a remote monitoring and diagnosis program inside the cabinet stored in the memory and running on the processor. When the remote monitoring and diagnosis program is executed by the processor, each step of the above-mentioned method for remote monitoring and diagnosis inside a cabinet is implemented.

In order to achieve the above object, the present invention also provides a storage medium, the storage medium stores a remote monitoring and diagnosis program inside the cabinet, and the remote monitoring and diagnosis program inside the cabinet realizes the above-mentioned remote monitoring and diagnosis inside the cabinet when the remote monitoring and diagnosis program inside the cabinet is executed by the processor. the various steps of the method.

The method and system for remote monitoring and diagnosis inside the cabinet, the cabinet device and the storage medium provided by the present invention have at least the following technical effects:

Since the collection of multi-source data inside the cabinet is adopted, the multi-source data is divided into multiple data groups according to the time unit; the data groups are preprocessed to form standard data groups; the local parts corresponding to the standard data groups are selected. The technical scheme of synthesizing a complete cabinet dynamic display diagram through image synthesis can not only ensure the accuracy of the local information of the cabinet, but also display the overall situation inside the cabinet globally; the dynamic display diagram of the cabinet can be authorized according to the function. Fragmentation is used to perform remote fault diagnosis for different functions, solve the problem of inability to remotely perform targeted diagnosis of cabinet internal faults in the prior art, and realize remote diagnosis of specific faults of a single device.

Description of drawings

FIG. 1 is a schematic structural diagram of a cabinet device involved in an embodiment of the present invention;

2 is a schematic flowchart of a first embodiment of a method for remote monitoring and diagnosis inside a cabinet according to the present invention;

FIG. 3 is a detailed flowchart of step S120 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention;

FIG. 4 is a detailed flowchart of step S130 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention;

FIG. 5 is a detailed flowchart of step S131 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention;

FIG. 6 is a detailed flowchart of step S1311 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention;

7 is a schematic structural diagram of the remote monitoring and diagnosis system inside the cabinet of the present invention;

The realization, functional characteristics and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Detailed ways

It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

In order to solve the problem in the prior art that the fault inside the cabinet cannot be remotely diagnosed in a targeted manner, the present application adopts the collection of multi-source data inside the cabinet, and divides the multi-source data into multiple data groups according to time units; The data sets are preprocessed to form standard data sets; the partial images corresponding to the standard data sets are selected to synthesize a complete dynamic display diagram of the cabinet; the dynamic display map of the cabinet is divided into functional rights and remote fault diagnosis is carried out for different functions. The technical solution is to realize the remote diagnosis of the specific fault of a single device.

In order to better understand the above technical solutions, the exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the application will be more thoroughly understood, and will fully convey the scope of the application to those skilled in the art.

Those skilled in the art can understand that the structure of the cabinet device shown in FIG. 1 does not constitute a limitation on the cabinet device, and the cabinet device may include more or less components than those shown in the figure, or combine some components, or arrange different components .

The processor 1100 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above-mentioned method may be completed by an integrated logic circuit of hardware in the processor 1100 or an instruction in the form of software. The processor 1100 described above may be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC) off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components . Various methods, steps, and logical block diagrams disclosed in the embodiments of the present invention can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The software module may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art. The storage medium is located in the memory 1200, and the processor 1100 reads the information in the memory 1200, and completes the steps of the above method in combination with its hardware.

It can be understood that the memory 1200 in the embodiment of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be Read Only Memory (ROM), Programmable Read Only Memory (PROM), Erasable Programmable Read Only Memory (Erasable PROM, EPROM), Electrically Erasable Memory Except programmable read-only memory (Electrically EPROM, EEPROM) or flash memory. The volatile memory may be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double DataRate SDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (Synchlink DRAM, SLDRAM) and Direct memory bus random access memory (Direct Rambus RAM, DRRAM). The memory 1200 of the systems and methods described in the embodiments of the present invention is intended to include, but not be limited to, these and any other suitable types of memory.

The cabinet device structure of the present application also includes: rail module, wireless charging module, motion pressure control module, self-adjusting carrier module, wireless transmission terminal, wireless transmission access point, etc. A complete cabinet monitoring product is realized through these modules.

Among them, the track module is a passive device, located on the side panel of the cabinet, as a fixing device of the self-adjusting carrier module, and the self-adjusting carrier module can move forward and backward along the track direction. The rail modules can be deployed on the inside of each panel of the cabinet according to actual needs. They can be deployed in a straight line or curved according to requirements. The degree of curvature must meet the motion requirements of the self-adjusting carrier module.

Wireless charging module: The wireless charging module is mainly used to be fixed inside the cabinet, and wirelessly charges other modules in the cabinet such as the motion pressure control module, self-adjusting carrier module, wireless transmission terminal, etc. through the connection with the power supply inside the cabinet to ensure these The module works automatically for a long time.

Motion pressure control module: It is mainly used for remote monitoring and diagnosis, and simple operations such as panel buttons are required. The motion pressure controller performs the pressing action, and the motion pressure control module is carried to the corresponding position through the self-adjusting motion module. The motion pressure control device may be a telescopic needle type, and may also be pressed by a pen type press, so as to realize mechanical operation of the buttons on the panel.

Self-adjusting carrier module: It can move according to the control command on the slide rail, can carry multi-source data acquisition module, motion pressure control module, wireless transmission module, etc., can move forward and backward according to the preset format, and move to the specified Position, etc., the self-adjusting carrier module includes a battery and a wireless charging terminal, stays at a preset fixed position for charging through the wireless charging module, and provides power to the modules carried on it, such as a motion pressure control module and a wireless transmission module. Wait.

Wireless transmission terminal: The wireless transmission module mainly uses 5G, WiFi6 and other large-capacity transmission methods to transmit high-definition video streams, pictures, etc. Taking the 4Mbps data transmission of a single-point video stream as an example, the transmission rate of 5G and WiFi6 can theoretically reach 10Gbps , in theory, it can carry about 2000 channels of data access. Combined with the different transmission time of each terminal, the large-capacity transmission can meet the data transmission requirements of each cabinet of a large-scale data processing center; the transmission carrier frequency adopts the frequency band greater than 5GHz, mainly This is because many cabinet panel openings are currently around 5-6mm, which can effectively reduce low-frequency stray leakage while ensuring heat dissipation.

Wireless transmission access point: It is used as a data access point to carry a large amount of data collection. The selection of 5G and WiFi6 mainly considers the access of a large amount of data, while reducing the number of large-scale data processing center access points and reducing operations. cost.

In this embodiment of the present application, the processor 1100 may be configured to invoke a remote monitoring and diagnosis program inside the cabinet stored in the memory 1200, and perform the following operations:

Collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups according to unit time;

After the data sets are preprocessed and corresponding standard data sets are generated, standard data sets are established;

Selecting standard data sets in the standard data set to synthesize the cabinet monitoring graph, and synthesizing the cabinet monitoring graphs at different time periods into the cabinet dynamic display graph for dynamic display of the visual model of the cabinet;

The dynamic display diagram of the cabinet is divided into permissions according to functions, so as to perform remote fault diagnosis for different functions.

In this embodiment of the present application, the processor 1100 may be configured to invoke a remote monitoring and diagnosis program inside the cabinet stored in the memory 1200, and perform the following operations:

Preprocess the multi-source data in each data set to generate a standard data set with fixed position sorting;

The standard data set is established according to time sequence to create a standard data set.

In this embodiment of the present application, the processor 1100 may be configured to invoke a remote monitoring and diagnosis program inside the cabinet stored in the memory 1200, and perform the following operations:

respectively selecting at least one standard data group in the standard data set to synthesize the corresponding cabinet monitoring graph;

Combine the cabinet monitoring diagrams at different time periods into the cabinet dynamic display diagram;

The cabinet monitoring diagram in the cabinet dynamic display diagram performs the dynamic display of the cabinet visual model according to the time sequence.

In this embodiment of the present application, the processor 1100 may be configured to invoke a remote monitoring and diagnosis program inside the cabinet stored in the memory 1200, and perform the following operations:

Two standard data sets that are adjacent in time or position in the standard data set are respectively selected to synthesize the corresponding cabinet monitoring map.

In this embodiment of the present application, the processor 1100 may be configured to invoke a remote monitoring and diagnosis program inside the cabinet stored in the memory 1200, and perform the following operations:

Perform feature extraction on two local images adjacent in time or position to obtain corresponding feature points;

performing similarity measurement on the feature points to obtain matched feature point pairs;

Obtaining the spatial coordinate transformation parameter of the local image according to the feature point pair;

Image registration is performed using the space coordinate transformation parameters to synthesize a cabinet monitoring map.

Since the cabinet device provided by the embodiment of the present application is the cabinet device used to implement the method of the embodiment of the present application, based on the method introduced in the embodiment of the present application, those skilled in the art can understand the specific structure and deformation of the cabinet device, Therefore, it is not repeated here. All the cabinet devices used in the methods of the embodiments of the present application belong to the scope of protection of the present application. The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.

For software implementation, the techniques described in the embodiments of the present invention may be implemented through modules (eg, procedures, functions, etc.) that perform the functions described in the embodiments of the present invention. Software codes may be stored in memory and executed by a processor. The memory can be implemented in the processor or external to the processor.

Based on the above-described structure, embodiments of the present invention are proposed.

Referring to FIG. 2 , FIG. 2 is a schematic flowchart of the first embodiment of the remote monitoring and diagnosis method inside the cabinet according to the present invention, which includes the following steps:

Step S110 , collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups per unit time.

In this embodiment, the cabinets described in this application include at least one or more, the multi-source data is data inside the cabinet, and the multi-source data includes dynamic images inside the cabinet, such as high-definition video up to 1080P or higher ; Internal images of the cabinet, such as high-definition pictures and high-definition infrared pictures inside the cabinet; voiceprint data inside the cabinet, such as the ambient sound in the high-fidelity cabinet; The collected data can also be the signal of the electromagnetic field in the cabinet, and the above data is the inside of the cabinet. Non-contact signals, because these multi-source data are distributed in all corners of the cabinet, therefore, the multi-source data acquisition module is carried by the self-adjusting carrier module inside the cabinet for acquisition, and the collected non-contact signals, that is, non-electrical signals, are converted into processing an electrical signal that the device can recognize.

In this embodiment, within a predetermined time, the multi-source data acquisition model is carried by the self-adjusting carrier module inside the cabinet, and moves along the track located on the side of the cabinet to form a front-to-back or from back-to-front The sampling period, for example, can collect multi-source data in the process of moving through the multi-source data acquisition module, or collect data during continuous motion, or collect data statically according to the preset position, which can be set on the track Multiple nodes, formulate rules to collect multi-source data of a node or several nodes;

In this embodiment, after collecting the multi-source data inside the cabinet, the collected data is divided into multiple data groups according to the unit time. The data is divided into unit time t ₀ , t ₁ , t ₂ , ..., t _n according to t discontinuity, and the multi-source data in each unit time is taken as a data group, where t=T/N, N is preset The value of N can be preset according to the actual development requirements. When the value of N is smaller, the more multi-source data in the divided unit time, the longer the corresponding unit time and the larger the data group formed. The smaller the number of monitoring pictures; when the value of N is larger, the less multi-source data in the divided unit time, the shorter the corresponding unit time and the smaller the data group formed, and the larger the number of finally synthesized cabinet monitoring pictures. .

Step S120: After preprocessing the data sets and generating corresponding standard data sets, a standard data set is established.

In this embodiment, the multi-source data in the divided multiple data groups are preprocessed respectively, and after standard data groups with fixed format sorting are generated, the generated standard data groups are respectively passed through a high-speed wireless communication module, such as 5G /WiFi6 is transmitted to the data processing center in real time, and the data processing center combines multiple sets of standard data sets t ₀ , t ₁ , t ₂ , ..., t _n in the acquired sampling period T to establish a T ₀ , T ₁ , T ₂ , ..., T _n standard datasets.

Referring to FIG. 3 , FIG. 3 is a detailed schematic flow chart of step S120 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention, including the following steps:

Step S121 , preprocess the multi-source data in each data set to generate a standard data set with fixed position sorting.

In this embodiment, the multi-source data in the divided data groups are preprocessed respectively. For example, the voiceprint data in the cabinet is generated by spectrogram, and the high-definition infrared images in the cabinet are preprocessed. Processing, image extraction of the video stream data collected inside the cabinet, etc.; the preprocessed multi-source data is formed into a set of standard data groups with fixed positions such as video stream, picture, infrared, voiceprint, etc.

Step S122, establishing the standard data set according to the time sequence of the standard data group.

In this embodiment, because the data volume of the preprocessed standard data group is large, the transmission speed is too slow, and at the same time, there is the problem of shielding the wireless signal inside the cabinet. A large amount of information inside each cabinet of the data processing center is effectively transmitted to the background, which improves the monitoring accuracy, can effectively improve the degree of digital monitoring inside the cabinet, and at the same time replace the bandwidth requirements of traditional cabinet internal models that require wired transmission; standard data groups are transmitted through 5G, After the transmission mode of large broadband such as WiFi6 is sent to the data processing center, multiple sets of standard data sets are combined, and the standard data sets are established according to the time sequence to establish a standard data set.

Since the multi-source data in each data set is preprocessed, a standard data set with fixed position sorting is generated, and the standard data set is sent to the data processing center through 5G, WiFi6 and other large-bandwidth transmission methods, and all the standard data sets are sent to the data processing center. The technical scheme of combining the above-mentioned standard data sets and establishing standard data sets according to the time sequence, realizes the division and transmission of multi-source data, and provides standard data conditions for the synthesis of cabinet monitoring diagrams.

Step S130, selecting standard data sets in the standard data set to synthesize a cabinet monitoring graph, and synthesizing the cabinet monitoring graphs at different time periods into a cabinet dynamic display graph for dynamic display of the cabinet visual model.

In this embodiment, at least one standard data group in the standard data set is respectively selected to synthesize the corresponding cabinet monitoring graph, and the cabinet monitoring graphs at different time periods are synthesized into the cabinet dynamic display graph, and the cabinet monitor graph in the cabinet dynamic display graph The cabinet visual model is dynamically displayed according to the time sequence.

Referring to FIG. 4 , FIG. 4 is a detailed schematic flow chart of step S130 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention, including the following steps:

Step S131, at least one standard data group in the standard data set is respectively selected to synthesize a corresponding cabinet monitoring graph.

In this embodiment, the process of forming the cabinet monitoring map involves the process of image synthesis. Image synthesis refers to extracting the required object area from all input images, and then using the relevant technology of image processing to determine the color, brightness, noise, etc., so that it can be seamlessly spliced into the new image background; in this application, a standard data set in the standard data set can be selected to form a cabinet monitoring map, and when a standard data set is selected to form a monitoring map , there is no need to combine with other standard data sets for image synthesis; two standard data sets that are adjacent in time or position in the standard data set can also be selected to synthesize the corresponding cabinet monitoring map, which needs to be combined with other standard data sets for image synthesis .

Referring to FIG. 5 , FIG. 5 is a detailed schematic flow chart of step S131 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention, including:

Step S1311, respectively selecting two standard data sets that are adjacent in time or position in the standard data set to synthesize a corresponding cabinet monitoring graph.

In this embodiment, the standard data group is used to form a local image inside the cabinet, and the local video stream and image collection of the cabinet in unit time is performed according to the multi-source data acquisition module, and the two adjacent time points and adjacent position information are collected. synthesizing several partial video streams or partial images to form a corresponding complete cabinet monitoring map, for example, using partial images contained in one or more standard data sets in T ₁ , T ₂ , . . . , T _n to combine , to synthesize the corresponding cabinet monitoring diagram.

In this embodiment, two local video streams or local images of adjacent time points and adjacent location information are synthesized into a complete overall video stream and image in the cabinet. The main processes are as follows: feature extraction, image deformation, image Fusion mixing; wherein, feature extraction is to detect feature points in all input images for image registration, and the process of image registration is: establishing the geometric correspondence between the images so that they can be processed in a common frame of reference. Transform, compare and analyze, which can be roughly divided into the following categories: algorithms that directly use the pixel values of an image, such as correlation methods; algorithms for frequency domain processing, such as FFT-based methods; algorithms for low-level features, usually using Edges and corners, for example, feature-based methods; advanced feature algorithms, usually used to overlap parts of image objects, feature relationships, such as graph theory methods; the specific image registration process is described in steps S13111 to S13114, not here Repeat.

Image Warping: Image warping refers to reprojecting one of the images after image registration, placing that image on a larger canvas.

Image Fusion Blending: Image blending is the process of changing the grayscale of the image near the border, removing these gaps, and creating a blended image to achieve a smooth transition between images. Blending modes are used to merge the two layers together.

In this embodiment, the most important task before the cabinet monitoring image is synthesized is image registration. The process of image registration is based on one image, and other images are composited on it through a certain algorithm. The purpose is to make the images consistent in time and space. In the process of multi-source data acquisition, the local images collected may be caused by different fields of view of cameras, different focal lengths of lenses, differences in the number of frames per image unit time, and movement of cameras. There are errors. Therefore, the image registration work is completed first, and then the cabinet monitoring map is synthesized, which can reduce the error; the method of image registration can be summarized as relative registration and absolute registration: relative registration refers to the selection of more One of the images is used as a reference image, and other related images are registered with it, and its coordinate system is arbitrary. Absolute registration means that a control grid is first defined, and all images are registered with respect to this grid, that is, the geometric correction of each component image is completed separately to realize the unification of the coordinate system, and relative registration is mainly used in this application.

Referring to FIG. 6 , FIG. 6 is a detailed schematic flow chart of step S1311 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention, including the following steps:

S13111, respectively perform feature extraction on two local images adjacent in time or in position to obtain corresponding feature points.

In this embodiment, the feature point is a representative part of the local image, and the feature point can be the edge, contour, curve intersection or high curvature point of the local image. Commonly used feature extraction algorithms are: edge point extraction method, corner extraction method, etc., these feature extraction algorithms are used to extract feature points corresponding to two local images that are adjacent in time or in position.

S13112: Perform similarity measurement on the feature points to obtain matched feature point pairs.

In this embodiment, the similarity measure is used to comprehensively evaluate a measure of the degree of similarity between two feature points, so as to establish a geometric correspondence between local images. The closer the two feature points are, the more similar they are. The larger the metric, and the farther the two feature points are, the smaller their similarity metric will be. By performing the similarity metric on the feature points, a feature point pair with close feature points, that is, with a large similarity metric, is obtained.

S13113: Obtain the spatial coordinate transformation parameters of the local image according to the feature point pair.

In this embodiment, by measuring the similarity of the feature points, the matching feature point pairs are obtained, the geometric correspondence of the local images is established, and an appropriate polynomial is selected to fit the translation between the two images in the common spatial coordinate system. , rotation and affine transformation to obtain the spatial coordinate transformation parameters of the local image.

S13114, using the spatial coordinate transformation parameters to perform image registration to synthesize a cabinet monitoring map.

In this embodiment, the spatial coordinate change parameter is the configuration control point of the local image, and image registration can be achieved according to the configuration control point. The determination rule for the number of configuration control points is: a polynomial of degree n. n+1)*(n+2)/2; for example, for a first-order polynomial, select at least 3 configuration control points; for a second-order polynomial, select at least 6 configuration control points, and select an appropriate polynomial according to the actual situation to determine the configuration control point The number of points, that is, to determine the spatial coordinate change parameters, through the configuration control points for image registration, after the deformation of the local image and image fusion, the cabinet monitoring map is synthesized.

Since feature extraction is performed on two local images that are adjacent in time or location to obtain corresponding feature points, and similarity measurement is performed on the feature points to obtain matching feature point pairs, according to the feature points For the spatial coordinate transformation parameters of the obtained partial image, the spatial coordinate transformation parameters are used to perform image registration, so that the images are consistent in time and space, and errors in the synthesis of cabinet monitoring images are reduced.

Step S132, synthesizing the cabinet monitoring graphs at different time periods into a cabinet dynamic display graph.

In this embodiment, the synthesized cabinet monitoring diagram is completely displayed, so as to realize the real presentation of the controlled scene, realize the digital transformation of monitoring, adopt the B/S display method, adapt to a variety of browsers, and meet the needs of different control terminals. At the same time, for the digital model of the real scene displayed, the operation of the real device can be realized by operating the digital model on the browser side.

In step S133, the cabinet monitoring diagram in the cabinet dynamic display diagram is dynamically displayed according to the chronological order of the rack visual model.

In this embodiment, the dynamic display diagram of the cabinet is a visual model, which dynamically displays the cabinet according to the time sequence of the synthesized cabinet monitoring diagram, so that the equipment inside the cabinet can be monitored more intuitively.

In step S140, the dynamic display diagram of the cabinet is divided into permissions according to functions, so as to perform remote fault diagnosis for different functions.

In this embodiment, different devices in the cabinet of the data processing center may correspond to different functions and different manufacturers, and remote fault diagnosis needs to be carried out in a targeted manner. Therefore, the dynamic display diagram of the cabinet is sharded according to the pre-specified sharding principle. , which is provided to different operation and maintenance personnel in the form of browser display to avoid data security risks caused by excessive permissions; maintenance personnel can dynamically display the observed cabinets, conduct data analysis, fault judgment, etc., and command according to the fault analysis situation The motion pressure control module performs the pressing operation.

Due to the use of real-time collection of multi-source data with video data as the main data without affecting the existing equipment inside the cabinet, and the high-definition fast collection method of regional time-sharing, the collected multi-source data is collected through 5G, High-speed wireless transmission such as WiFi6 is transmitted to the data processing center; the time-sharing high-definition local images are synthesized as a whole using the existing algorithms of the data processing center to form a high-definition image photo of the inside of the cabinet composed of time-sharing videos or pictures , provided for maintenance personnel; when providing maintenance personnel of different manufacturers to synthesize real pictures, the operation authority for different business processes is divided and provided to remote operation and maintenance personnel, which effectively solves the problems caused by the maintenance of multiple equipment and multiple manufacturers. remote access to the control will bring risks to the entire system; at the same time, the use of pin-type, pen-type and other push-type function modules, according to the results of the remote personnel’s judgment and analysis of the problem, to achieve remote control and push The device operates the buttons inside the cabinet.

Based on the same inventive concept, the present invention also provides a remote monitoring and diagnosis system inside the cabinet, as shown in FIG. 7 , which is a schematic structural diagram of the remote monitoring and diagnosis system inside the cabinet according to the present invention. The system includes: a multi-source data acquisition module 10 , the multi-source data processing module 20, the cabinet monitoring map synthesis module 30, the cabinet visual model dynamic display module 40, the remote fault diagnosis module 50, etc., each module will be described below:

Multi-source data collection module 10: used for collecting multi-source data inside the cabinet, dividing the multi-source data into multiple data groups according to time units, using high-definition video (above 1080P), high-definition pictures, high-definition The ambient sound in the real cabinet, high-definition infrared pictures, and the signal of the electromagnetic field in the cabinet are collected without contact, and the non-electrical signal is converted into an electrical signal.

Multi-source data processing module 20: used to preprocess the data sets respectively to form standard data sets, mainly used for video stream preprocessing, picture preprocessing, voiceprint signal processing idiom spectrogram, electromagnetic signal preprocessing and other functions ; After the processing is completed, a location-related information data group is formed, including video streams, high-definition pictures, infrared pictures, spectrogram pictures, electromagnetic environment information, and the like.

Cabinet monitoring map synthesis module 30: used to select partial images corresponding to standard data sets to synthesize a complete cabinet dynamic display map; the cabinet monitoring map synthesis module 30 is also used to obtain each standard data set and combine it into a standard data set; One or more sets of standard data sets in the standard data set are combined to form a dynamic display diagram of multiple cabinets; , The local video streams and images of adjacent location information are synthesized to form a complete overall video stream and image in the cabinet.

The cabinet visual model dynamic display module 40 is used to dynamically display the cabinet visual model according to the time sequence of the cabinet dynamic display diagram; the cabinet visual model dynamic display module 40 completely displays the synthesized cabinet picture, realizing The real presentation of the controlled scene realizes the digital transformation of monitoring, adopts the B/S display method, adapts to a variety of browsers, and meets the needs of different control terminals; at the same time, for the digital model of the displayed real scene, it can be The operation of the digital model of the terminal realizes the operation of the real device.

Remote fault diagnosis module 50: used to perform functional rights segmentation on the dynamic display diagram of the cabinet and perform remote fault diagnosis for different functions; different equipment in the cabinet of the data processing center may correspond to different functions and different manufacturers, and needs to be targeted for The remote fault diagnosis module 50 provides the corresponding operation and maintenance personnel with authority in the form of function fragmentation, so as to avoid data security risks caused by excessive authority.

Since the multi-source data acquisition module is used to collect multi-source data inside the cabinet, the multi-source data is divided into multiple data groups according to time units; the multi-source data processing module preprocesses the data groups and generates corresponding data groups. After the standard data set is created, a standard data set is established; the cabinet monitoring map synthesis module selects the standard data set in the standard data set to synthesize the cabinet monitoring map; the cabinet visual model dynamic display module synthesizes the cabinet monitoring map at different time periods into the cabinet dynamic display map In order to dynamically display the visual model of the cabinet; the remote fault diagnosis module divides the dynamic display diagram of the cabinet according to the function, and performs the technical scheme of remote fault diagnosis for different functions, forming a complete remote fault diagnosis of a single device diagnostic system.

Based on the same inventive concept, an embodiment of the present application further provides a storage medium, where the storage medium stores a remote monitoring and diagnosis program inside a cabinet, and when the remote monitoring and diagnosis program inside the cabinet is executed by a processor, the above-mentioned cabinet interior is realized The various steps of the remote monitoring and diagnosis method can achieve the same technical effect. In order to avoid repetition, they will not be repeated here.

Since the storage medium provided by the embodiments of the present application is the storage medium used to implement the methods of the embodiments of the present application, based on the methods introduced in the embodiments of the present application, those skilled in the art can understand the specific structure and deformation of the storage medium, Therefore, it is not repeated here. All storage media used in the methods of the embodiments of the present application belong to the scope of protection of the present application.

The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

It should be noted that, in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not preclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.

Although the preferred embodiments of the present invention have been described, additional changes and modifications to these embodiments may occur to those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment and all changes and modifications that fall within the scope of the present invention.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention. Thus, provided that these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims (10)

1. A method for remote monitoring and diagnosis inside a cabinet, wherein the method comprises: Collecting multi-source data inside the cabinet, dividing the multi-source data into multiple data groups per unit time, wherein the multi-source data acquisition module is carried by the self-adjusting carrier module disposed inside the cabinet to collect the multi-source data ; Each data group includes multi-source data collected in a corresponding unit time, and the more the data groups are divided, the more the number of synthesized cabinet monitoring graphs; After the data sets are preprocessed and corresponding standard data sets are generated, standard data sets are established; Selecting standard data sets in the standard data set to synthesize the cabinet monitoring graph, and synthesizing the cabinet monitoring graphs at different time periods into the cabinet dynamic display graph for dynamic display of the visual model of the cabinet; The dynamic display diagram of the cabinet is divided into permissions according to functions, so as to perform remote fault diagnosis for different functions. 2 . The method for remote monitoring and diagnosis inside a cabinet according to claim 1 , wherein the multi-source data at least comprises: dynamic images inside the cabinet, images inside the cabinet, and voiceprint data inside the cabinet. 3 . 3. The method for remote monitoring and diagnosis inside a cabinet according to claim 2, characterized in that, after the data sets are preprocessed and corresponding standard data sets are generated respectively, a standard data set is established, comprising: Preprocess the multi-source data in each data set to generate a standard data set with fixed position sorting; The standard data set is established according to time sequence to create a standard data set. 4. The method for remote monitoring and diagnosis inside a cabinet according to claim 3, wherein the standard data set in the standard data set is selected to synthesize the cabinet monitoring graph, and the cabinet monitoring graphs at different time periods are synthesized into the cabinet dynamic display graph to form a cabinet monitoring graph. Dynamic display of cabinet visual model, including: respectively selecting at least one standard data group in the standard data set to synthesize the corresponding cabinet monitoring graph; Combine the cabinet monitoring diagrams at different time periods into the cabinet dynamic display diagram; The cabinet monitoring diagram in the cabinet dynamic display diagram performs the dynamic display of the cabinet visual model according to the time sequence. 5. The method for remote monitoring and diagnosis inside a cabinet according to claim 4, wherein said selecting at least one standard data set in the standard data set respectively to synthesize a corresponding cabinet monitoring chart comprises: selecting respectively a standard data set from the standard data set Two standard data adjacent in time or position are combined to synthesize the corresponding cabinet monitoring map. 6 . The method for remote monitoring and diagnosis inside a cabinet according to claim 5 , wherein the standard data group is used to form a partial image inside the cabinet; the two adjacent time or position adjacent to the standard data set are respectively selected. 7 . Standard data is combined to synthesize the corresponding cabinet monitoring chart, including: Perform feature extraction on two local images adjacent in time or position to obtain corresponding feature points; performing similarity measurement on the feature points to obtain matched feature point pairs; Obtaining the spatial coordinate transformation parameter of the local image according to the feature point pair; Image registration is performed using the space coordinate transformation parameters to synthesize a cabinet monitoring map. 7. A remote monitoring and diagnosis system inside a cabinet, wherein the system comprises: Multi-source data collection module: used to collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups according to unit time, wherein the multi-source data collection is carried by the self-adjusting carrier module arranged inside the cabinet a module to collect the multi-source data; each data group includes the multi-source data collected in a corresponding unit time, and the more the divided data groups are, the more the number of synthesized cabinet monitoring graphs is; Multi-source data processing module: used to preprocess the data sets and generate corresponding standard data sets, and then establish standard data sets; Cabinet monitoring map synthesis module: used to select standard data sets in the standard data set to synthesize the cabinet monitoring map; Cabinet visual model dynamic display module: It is used to synthesize the cabinet monitoring diagrams at different time periods into the cabinet dynamic display diagram for dynamic display of the cabinet visual model; Remote fault diagnosis module: It is used to divide the dynamic display diagram of the cabinet according to the function to perform authority segmentation, so as to carry out remote fault diagnosis for different functions. 8. The cabinet interior remote monitoring and diagnosis system according to claim 7, wherein the cabinet monitoring graph synthesis module is further used for: At least one standard data group in the standard data set is respectively selected to synthesize a corresponding cabinet monitoring graph. 9. A cabinet device, characterized in that, the cabinet device comprises a memory, a processor, and a remote monitoring and diagnosis program inside the cabinet that is stored in the memory and can be run on the processor, and the remote monitoring and diagnosis program inside the cabinet When the program is executed by the processor, each step of the method for remote monitoring and diagnosis inside a cabinet according to any one of claims 1-6 is implemented. 10. A computer-readable storage medium, wherein the computer-readable storage medium stores a remote monitoring and diagnosis program inside a cabinet, and when the remote monitoring and diagnosis program inside the cabinet is executed by a processor, the methods of claims 1-6 are implemented Each step of the remote monitoring and diagnosis method in any one of the cabinets.

Images