CN112702877B - Cabinet interior remote monitoring and diagnosis method and system, cabinet device and storage medium - Google Patents
Cabinet interior remote monitoring and diagnosis method and system, cabinet device and storage medium Download PDFInfo
- Publication number
- CN112702877B CN112702877B CN202011492210.9A CN202011492210A CN112702877B CN 112702877 B CN112702877 B CN 112702877B CN 202011492210 A CN202011492210 A CN 202011492210A CN 112702877 B CN112702877 B CN 112702877B
- Authority
- CN
- China
- Prior art keywords
- cabinet
- monitoring
- standard data
- diagnosis
- data set
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 134
- 238000000034 method Methods 0.000 title claims abstract description 74
- 238000003745 diagnosis Methods 0.000 title claims abstract description 54
- 238000003860 storage Methods 0.000 title claims abstract description 22
- 238000010586 diagram Methods 0.000 claims abstract description 50
- 230000006870 function Effects 0.000 claims abstract description 31
- 230000000007 visual effect Effects 0.000 claims abstract description 23
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 8
- 238000012545 processing Methods 0.000 claims description 19
- 230000009466 transformation Effects 0.000 claims description 16
- 230000015572 biosynthetic process Effects 0.000 claims description 15
- 238000003786 synthesis reaction Methods 0.000 claims description 15
- 238000000605 extraction Methods 0.000 claims description 12
- 238000005259 measurement Methods 0.000 claims description 5
- 238000013480 data collection Methods 0.000 claims description 4
- 230000011218 segmentation Effects 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 abstract description 5
- 238000013467 fragmentation Methods 0.000 abstract description 3
- 238000006062 fragmentation reaction Methods 0.000 abstract description 3
- 238000004171 remote diagnosis Methods 0.000 abstract description 3
- 238000010863 targeted diagnosis Methods 0.000 abstract description 2
- 230000005540 biological transmission Effects 0.000 description 21
- 230000008569 process Effects 0.000 description 16
- 230000033001 locomotion Effects 0.000 description 13
- 238000012423 maintenance Methods 0.000 description 9
- 238000004590 computer program Methods 0.000 description 7
- 239000000306 component Substances 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000002156 mixing Methods 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 4
- 230000004927 fusion Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005672 electromagnetic field Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000004378 air conditioning Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000008358 core component Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000017525 heat dissipation Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011524 similarity measure Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
- H05K7/00—Constructional details common to different types of electric apparatus
- H05K7/14—Mounting supporting structure in casing or on frame or rack
- H05K7/1485—Servers; Data center rooms, e.g. 19-inch computer racks
- H05K7/1488—Cabinets therefor, e.g. chassis or racks or mechanical interfaces between blades and support structures
- H05K7/1494—Cabinets therefor, e.g. chassis or racks or mechanical interfaces between blades and support structures having hardware for monitoring blades, e.g. keyboards, displays
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
- H05K7/00—Constructional details common to different types of electric apparatus
- H05K7/14—Mounting supporting structure in casing or on frame or rack
- H05K7/1485—Servers; Data center rooms, e.g. 19-inch computer racks
- H05K7/1498—Resource management, Optimisation arrangements, e.g. configuration, identification, tracking, physical location
Landscapes
- Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Alarm Systems (AREA)
Abstract
Description
技术领域technical field
本发明涉及远程处理技术领域,尤其涉及一种机柜内部远程监控诊断方法及系统、机柜装置和存储介质。The invention relates to the technical field of remote processing, in particular to a method and system for remote monitoring and diagnosis inside a cabinet, a cabinet device and a storage medium.
背景技术Background technique
数字化技术的发展,各个领域的数字化转型也加快了进程,在数字化转型的过程中,满足数据的规模存储、集中存储需求的数据处理中心不断涌现,当前数据处理中心的监控主要集中在动力、环境设备,如配电、不间断电源、空调、消防、监控、防盗报警等子系统,采取24小时专人值班,定时巡查环境设备等措施,保证数据处理中心有效工作。With the development of digital technology, the process of digital transformation in various fields has also accelerated. In the process of digital transformation, data processing centers that meet the needs of large-scale storage and centralized storage of data continue to emerge. Currently, the monitoring of data processing centers mainly focuses on power and environment. Equipment, such as power distribution, uninterruptible power supply, air conditioning, fire protection, monitoring, anti-theft alarm and other subsystems, take measures such as 24-hour staff on duty and regular inspections of environmental equipment to ensure the effective work of the data processing center.
然而,数据处理中心中的核心部件是具体的业务应用设备,这些设备通常放在机柜内以标准机箱形式存在,具有多业务、多厂商的特点,对于具体机柜内部的监管呈现多样化的趋势,不同的业务、不同的厂商设备都需要具体的专业人员进行维护,往往是出现具体问题时,厂家人员到数据处理中心去解决,有时因为很小的问题需要厂家人员到现场进行处理,即影响了数据处理中心的管理效率、管理安全,也让维护成本大幅提高。且现场人员操作机柜内部的设备时,操作可能出现错误,不能对故障进行多专家会诊等。或者如电力系统中机柜中的强电设备会给操作人员带来的安全性问题等。However, the core components in the data processing center are specific business application equipment. These equipment are usually placed in the cabinet and exist in the form of standard chassis. They have the characteristics of multi-service and multi-vendor. Different businesses and equipment from different manufacturers require specific professionals for maintenance. Often, when specific problems occur, manufacturers’ personnel go to the data processing center to solve them. The management efficiency and management security of the data processing center also greatly increase the maintenance cost. Moreover, when the on-site personnel operate the equipment inside the cabinet, the operation may be wrong, and multi-expert consultation cannot be carried out on the fault. Or, for example, the safety problems that the strong electrical equipment in the cabinet in the power system will bring to the operator.
因此,随着数据处理中心规模的不断扩大,设计一种机柜内部远程监控诊断方法及系统是至关重要的。Therefore, with the continuous expansion of the data processing center, it is very important to design a remote monitoring and diagnosis method and system inside the cabinet.
发明内容SUMMARY OF THE INVENTION
本发明主要目的在于提供一种机柜内部远程监控诊断方法及系统、机柜装置和存储介质,旨在解决现有技术中不能远程对机柜内部故障进行针对性诊断的问题。The main purpose of the present invention is to provide a method and system for remote monitoring and diagnosis inside a cabinet, a cabinet device and a storage medium, which aim to solve the problem of inability to remotely diagnose the internal faults of the cabinet in a targeted manner in the prior art.
为实现上述目的,本发明提供一种机柜内部远程监控诊断方法,在一实施例中,所述机柜内部远程监控诊断方法包括以下步骤:To achieve the above object, the present invention provides a method for remote monitoring and diagnosis inside a cabinet. In one embodiment, the method for remote monitoring and diagnosis inside a cabinet includes the following steps:
进行机柜内部多源数据的采集,将所述多源数据按单位时间划分为多个数据组;Collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups according to unit time;
对所述数据组分别进行预处理并生成对应的标准数据组后,建立标准数据集;After the data sets are preprocessed and corresponding standard data sets are generated, standard data sets are established;
选取所述标准数据集中的标准数据组以合成机柜监控图,将不同时段机柜监控图合成机柜动态展示图以进行机柜可视模型动态展示;Selecting standard data sets in the standard data set to synthesize the cabinet monitoring graph, and synthesizing the cabinet monitoring graphs at different time periods into the cabinet dynamic display graph for dynamic display of the visual model of the cabinet;
将所述机柜动态展示图根据功能进行权限分片,以对不同的功能进行远程故障诊断。The dynamic display diagram of the cabinet is divided into permissions according to functions, so as to perform remote fault diagnosis for different functions.
在一实施例中,所述多源数据至少包括:机柜内部动态影像、机柜内部图像以及机柜内部声纹数据。In one embodiment, the multi-source data includes at least: dynamic images inside the cabinet, images inside the cabinet, and voiceprint data inside the cabinet.
在一实施例中,所述对所述数据组分别进行预处理并生成对应的标准数据组后,建立标准数据集,包括:In one embodiment, after the data sets are preprocessed and corresponding standard data sets are generated, a standard data set is established, including:
对各数据组中的多源数据进行预处理,生成具有固定位置排序的标准数据组;Preprocess the multi-source data in each data set to generate a standard data set with fixed position sorting;
将所述标准数据组根据时间顺序建立标准数据集。The standard data set is established according to time sequence to create a standard data set.
在一实施例中,所述选取所述标准数据集中的标准数据组以合成机柜监控图,将不同时段机柜监控图合成机柜动态展示图以进行机柜可视模型动态展示,包括:In one embodiment, the standard data set in the standard data set is selected to synthesize the cabinet monitoring graph, and the cabinet monitoring graphs at different time periods are synthesized into the cabinet dynamic display graph for dynamic display of the visual model of the cabinet, including:
分别选取所述标准数据集中的至少一个标准数据组以合成对应的机柜监控图;respectively selecting at least one standard data group in the standard data set to synthesize the corresponding cabinet monitoring graph;
将不同时段机柜监控图合成机柜动态展示图;Combine the cabinet monitoring diagrams at different time periods into the cabinet dynamic display diagram;
所述机柜动态展示图中的机柜监控图根据时间顺序进行机柜可视模型动态展示。The cabinet monitoring diagram in the cabinet dynamic display diagram performs the dynamic display of the cabinet visual model according to the time sequence.
在一实施例中,还包括:所述分别选取所述标准数据集中的至少一个标准数据组以合成对应的机柜监控图,包括:分别选取标准数据集中时间相邻或位置相邻的两个标准数据组以合成对应的机柜监控图。In an embodiment, the method further includes: respectively selecting at least one standard data group in the standard data set to synthesize a corresponding cabinet monitoring diagram, including: selecting two standards in the standard data set that are adjacent in time or in position respectively. The data is grouped to synthesize the corresponding cabinet monitoring diagram.
在一实施例中,采用所述标准数据组组成机柜内部的局部图像;所述分别选取标准数据集中时间相邻或位置相邻的两个标准数据组以合成对应的机柜监控图,包括:In one embodiment, the standard data set is used to form a partial image inside the cabinet; the two standard data sets that are adjacent in time or position in the standard data set are respectively selected to synthesize a corresponding cabinet monitoring map, including:
对时间相邻或位置相邻的两个局部图像分别进行特征提取以获取对应的特征点;Perform feature extraction on two local images adjacent in time or position to obtain corresponding feature points;
对所述特征点进行相似性度量,以获取匹配的特征点对;performing similarity measurement on the feature points to obtain matched feature point pairs;
根据所述特征点对得到所述局部图像的空间坐标变换参数;Obtaining the spatial coordinate transformation parameter of the local image according to the feature point pair;
采用所述空间坐标变换参数进行图像配准以合成机柜监控图。Image registration is performed using the space coordinate transformation parameters to synthesize a cabinet monitoring map.
为实现上述目的,本发明还提供一种机柜内部远程监控诊断系统,所述系统包括:In order to achieve the above object, the present invention also provides a remote monitoring and diagnosis system inside the cabinet, the system includes:
多源数据采集模块:用于进行机柜内部多源数据的采集,将所述多源数据按单位时间划分为多个数据组;Multi-source data acquisition module: used to collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups according to unit time;
多源数据处理模块:用于对所述数据组分别进行预处理并生成对应的标准数据组后,建立标准数据集;Multi-source data processing module: used to preprocess the data sets and generate corresponding standard data sets, and then establish standard data sets;
机柜监控图合成模块:用于选取所述标准数据集中的标准数据组以合成机柜监控图;Cabinet monitoring map synthesis module: used to select standard data sets in the standard data set to synthesize the cabinet monitoring map;
机柜可视模型动态展示模块:用于将不同时段机柜监控图合成机柜动态展示图以进行机柜可视模型动态展示;Cabinet visual model dynamic display module: It is used to synthesize the cabinet monitoring diagrams at different time periods into the cabinet dynamic display diagram for dynamic display of the cabinet visual model;
远程故障诊断模块:用于将所述机柜动态展示图根据功能进行权限分片,以对不同的功能进行远程故障诊断。Remote fault diagnosis module: It is used to divide the dynamic display diagram of the cabinet according to the function to perform authority segmentation, so as to carry out remote fault diagnosis for different functions.
在一实施例中,所述机柜监控图合成模块还用于:In one embodiment, the cabinet monitoring map synthesis module is further used for:
分别选取所述标准数据集中的至少一个标准数据组以合成对应的机柜监控图。At least one standard data group in the standard data set is respectively selected to synthesize a corresponding cabinet monitoring graph.
为实现上述目的,本发明还提供一种机柜装置,所述机柜装置包括存储器、处理器以及存储在所述存储器并可在所述处理器上运行的机柜内部远程监控诊断程序,所述机柜内部远程监控诊断程序被所述处理器执行时实现如上所述的机柜内部远程监控诊断方法的各个步骤。In order to achieve the above object, the present invention also provides a cabinet device, the cabinet device includes a memory, a processor, and a remote monitoring and diagnosis program inside the cabinet stored in the memory and running on the processor. When the remote monitoring and diagnosis program is executed by the processor, each step of the above-mentioned method for remote monitoring and diagnosis inside a cabinet is implemented.
为实现上述目的,本发明还提供一种存储介质,所述存储介质存储有机柜内部远程监控诊断程序,所述机柜内部远程监控诊断程序被处理器执行时实现如上所述的机柜内部远程监控诊断方法的各个步骤。In order to achieve the above object, the present invention also provides a storage medium, the storage medium stores a remote monitoring and diagnosis program inside the cabinet, and the remote monitoring and diagnosis program inside the cabinet realizes the above-mentioned remote monitoring and diagnosis inside the cabinet when the remote monitoring and diagnosis program inside the cabinet is executed by the processor. the various steps of the method.
本发明提供的机柜内部远程监控诊断方法及系统、机柜装置和存储介质,至少具有以下技术效果:The method and system for remote monitoring and diagnosis inside the cabinet, the cabinet device and the storage medium provided by the present invention have at least the following technical effects:
由于采用了进行机柜内部多源数据的采集,将所述多源数据根据时间单位划分为多个数据组;对所述数据组分别进行预处理以形成标准数据组;选取标准数据组对应的局部图像合成完整的机柜动态展示图的技术方案,通过分时多点合成图像,既可以保证机柜局部信息的精度,又可以进行全局显示机柜内部整体情况;将所述机柜动态展示图根据功能进行权限分片,以对不同的功能进行远程故障诊断,解决现有技术中不能远程对机柜内部故障进行针对性诊断的问题,实现对单个设备具体故障的远程诊断。Since the collection of multi-source data inside the cabinet is adopted, the multi-source data is divided into multiple data groups according to the time unit; the data groups are preprocessed to form standard data groups; the local parts corresponding to the standard data groups are selected. The technical scheme of synthesizing a complete cabinet dynamic display diagram through image synthesis can not only ensure the accuracy of the local information of the cabinet, but also display the overall situation inside the cabinet globally; the dynamic display diagram of the cabinet can be authorized according to the function. Fragmentation is used to perform remote fault diagnosis for different functions, solve the problem of inability to remotely perform targeted diagnosis of cabinet internal faults in the prior art, and realize remote diagnosis of specific faults of a single device.
附图说明Description of drawings
图1为本发明实施例涉及的机柜装置结构示意图;FIG. 1 is a schematic structural diagram of a cabinet device involved in an embodiment of the present invention;
图2为本发明机柜内部远程监控诊断方法的第一实施例的流程示意图;2 is a schematic flowchart of a first embodiment of a method for remote monitoring and diagnosis inside a cabinet according to the present invention;
图3为本发明机柜内部远程监控诊断方法的第一实施例步骤S120的一个细化流程示意图;FIG. 3 is a detailed flowchart of step S120 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention;
图4为本发明机柜内部远程监控诊断方法的第一实施例步骤S130的一个细化流程示意图;FIG. 4 is a detailed flowchart of step S130 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention;
图5为本发明机柜内部远程监控诊断方法的第一实施例步骤S131的一个细化流程示意图;FIG. 5 is a detailed flowchart of step S131 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention;
图6为本发明机柜内部远程监控诊断方法的第一实施例步骤S1311的一个细化流程示意图;FIG. 6 is a detailed flowchart of step S1311 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention;
图7为本发明机柜内部远程监控诊断系统的结构示意图;7 is a schematic structural diagram of the remote monitoring and diagnosis system inside the cabinet of the present invention;
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments.
具体实施方式Detailed ways
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
本申请为解决现有技术中不能远程对机柜内部故障进行针对性诊断的问题,采用了进行机柜内部多源数据的采集,将所述多源数据根据时间单位划分为多个数据组;对所述数据组分别进行预处理以形成标准数据组;选取标准数据组对应的局部图像合成完整的机柜动态展示图;将所述机柜动态展示图进行功能权限分片并针对不同的功能进行远程故障诊断的技术方案,实现对单个设备具体故障的远程诊断。In order to solve the problem in the prior art that the fault inside the cabinet cannot be remotely diagnosed in a targeted manner, the present application adopts the collection of multi-source data inside the cabinet, and divides the multi-source data into multiple data groups according to time units; The data sets are preprocessed to form standard data sets; the partial images corresponding to the standard data sets are selected to synthesize a complete dynamic display diagram of the cabinet; the dynamic display map of the cabinet is divided into functional rights and remote fault diagnosis is carried out for different functions. The technical solution is to realize the remote diagnosis of the specific fault of a single device.
为了更好地理解上述技术方案,下面将参照附图更详细地描述本申请的示例性实施例。虽然附图中显示了本申请的示例性实施例,然而应当理解,可以以各种形式实现本申请而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本申请,并且能够将本申请的范围完整的传达给本领域的技术人员。In order to better understand the above technical solutions, the exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the application will be more thoroughly understood, and will fully convey the scope of the application to those skilled in the art.
本领域技术人员可以理解,图1所示的机柜装置结构并不构成对机柜装置的限定,机柜装置可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the structure of the cabinet device shown in FIG. 1 does not constitute a limitation on the cabinet device, and the cabinet device may include more or less components than those shown in the figure, or combine some components, or arrange different components .
处理器1100可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器1100中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器1100可以是通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器1200,处理器1100读取存储器1200中的信息,结合其硬件完成上述方法的步骤。The
可以理解,本发明实施例中的存储器1200可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(Read Only Memory,ROM)、可编程只读存储器(Programmable ROM,PROM)、可擦除可编程只读存储器(Erasable PROM,EPROM)、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double DataRate SDRAM,DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DRRAM)。本发明实施例描述的系统和方法的存储器1200旨在包括但不限于这些和任意其它适合类型的存储器。It can be understood that the
本申请机柜装置结构还包含:轨道模块、无线充电模块、运动压式控制模块、自调节运载模块、无线传输终端、无线传输接入点等,通过这些模块实现一个完整的机柜监控产品。The cabinet device structure of the present application also includes: rail module, wireless charging module, motion pressure control module, self-adjusting carrier module, wireless transmission terminal, wireless transmission access point, etc. A complete cabinet monitoring product is realized through these modules.
其中,轨道模块为无源装置,位于机柜侧板,作为自调节运载模块的固定装置,自调节运载模块可以沿着轨道方向进行前进、后退运动。轨道模块根据实际需求可以部署在机柜各个面板内侧,可以直线部署,也可以根据需求进行弯曲部署,弯曲程度要满足自调节运载模块的运动要求。Among them, the track module is a passive device, located on the side panel of the cabinet, as a fixing device of the self-adjusting carrier module, and the self-adjusting carrier module can move forward and backward along the track direction. The rail modules can be deployed on the inside of each panel of the cabinet according to actual needs. They can be deployed in a straight line or curved according to requirements. The degree of curvature must meet the motion requirements of the self-adjusting carrier module.
无线充电模块:无线充电模块主要用于固定在机柜内部,通过与机柜内部电源的连接以无线方式给运动压式控制模块、自调节运载模块、无线传输终端等机柜的其他模块进行充电,保证这些模块长期自动工作。Wireless charging module: The wireless charging module is mainly used to be fixed inside the cabinet, and wirelessly charges other modules in the cabinet such as the motion pressure control module, self-adjusting carrier module, wireless transmission terminal, etc. through the connection with the power supply inside the cabinet to ensure these The module works automatically for a long time.
运动压式控制模块:主要用来远程进行监控诊断时,需要进行面板按钮等简单操作,运动压式控制器进行按压动作,通过自调节运动模块将运动压式控制模块运载到相应的位置,所述运动压式控制器件可以是伸缩针式,还可以采用笔式按压进行按压,实现对面板上的按钮进行机械操作。Motion pressure control module: It is mainly used for remote monitoring and diagnosis, and simple operations such as panel buttons are required. The motion pressure controller performs the pressing action, and the motion pressure control module is carried to the corresponding position through the self-adjusting motion module. The motion pressure control device may be a telescopic needle type, and may also be pressed by a pen type press, so as to realize mechanical operation of the buttons on the panel.
自调节运载模块:可在滑轨上根据控制命令进行运动,可承载多源数据采集模块,运动压式控制模块,无线传输模块等,可以按照预设定的格式进行前进、后退,运动到指定位置等,所述自调节运载模块包含电池以及无线充电终端,停留在预设固定位置通过无线充电模块进行充电,并提供给承载在其上的模块进行供电如运动压式控制模块、无线传输模块等。Self-adjusting carrier module: It can move according to the control command on the slide rail, can carry multi-source data acquisition module, motion pressure control module, wireless transmission module, etc., can move forward and backward according to the preset format, and move to the specified Position, etc., the self-adjusting carrier module includes a battery and a wireless charging terminal, stays at a preset fixed position for charging through the wireless charging module, and provides power to the modules carried on it, such as a motion pressure control module and a wireless transmission module. Wait.
无线传输终端:无线传输模块主要采用5G、WiFi6等大容量的传输方式实现对高清视频流、图片等进行传输,以单点视频流4Mbps数据传输为例,5G、WiFi6传输速率理论上可以达到10Gbps,理论上可以承载2000路左右的数据接入,结合各个终端传输不同时性,大容量的传输可以满足大规模的数据处理中心每个机柜的数据传输需求;传输载频采用大于5GHz频段,主要是因为当前很多机柜面板开孔在5-6mm左右,可以保证散热的同时,有效减少低频杂散的泄露。Wireless transmission terminal: The wireless transmission module mainly uses 5G, WiFi6 and other large-capacity transmission methods to transmit high-definition video streams, pictures, etc. Taking the 4Mbps data transmission of a single-point video stream as an example, the transmission rate of 5G and WiFi6 can theoretically reach 10Gbps , in theory, it can carry about 2000 channels of data access. Combined with the different transmission time of each terminal, the large-capacity transmission can meet the data transmission requirements of each cabinet of a large-scale data processing center; the transmission carrier frequency adopts the frequency band greater than 5GHz, mainly This is because many cabinet panel openings are currently around 5-6mm, which can effectively reduce low-frequency stray leakage while ensuring heat dissipation.
无线传输接入点:作为数据接入点使用,承载大数据量的收取,采用5G、WiFi6选型主要考虑大数据量的接入,同时降低大规模数据处理中心接入点的数量,降低运营成本。Wireless transmission access point: It is used as a data access point to carry a large amount of data collection. The selection of 5G and WiFi6 mainly considers the access of a large amount of data, while reducing the number of large-scale data processing center access points and reducing operations. cost.
在本申请实施例中,处理器1100可以用于调用存储在存储器1200中的机柜内部远程监控诊断程序,并执行以下操作:In this embodiment of the present application, the
进行机柜内部多源数据的采集,将所述多源数据按单位时间划分为多个数据组;Collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups according to unit time;
对所述数据组分别进行预处理并生成对应的标准数据组后,建立标准数据集;After the data sets are preprocessed and corresponding standard data sets are generated, standard data sets are established;
选取所述标准数据集中的标准数据组以合成机柜监控图,将不同时段机柜监控图合成机柜动态展示图以进行机柜可视模型动态展示;Selecting standard data sets in the standard data set to synthesize the cabinet monitoring graph, and synthesizing the cabinet monitoring graphs at different time periods into the cabinet dynamic display graph for dynamic display of the visual model of the cabinet;
将所述机柜动态展示图根据功能进行权限分片,以对不同的功能进行远程故障诊断。The dynamic display diagram of the cabinet is divided into permissions according to functions, so as to perform remote fault diagnosis for different functions.
在本申请实施例中,处理器1100可以用于调用存储在存储器1200中的机柜内部远程监控诊断程序,并执行以下操作:In this embodiment of the present application, the
对各数据组中的多源数据进行预处理,生成具有固定位置排序的标准数据组;Preprocess the multi-source data in each data set to generate a standard data set with fixed position sorting;
将所述标准数据组根据时间顺序建立标准数据集。The standard data set is established according to time sequence to create a standard data set.
在本申请实施例中,处理器1100可以用于调用存储在存储器1200中的机柜内部远程监控诊断程序,并执行以下操作:In this embodiment of the present application, the
分别选取所述标准数据集中的至少一个标准数据组以合成对应的机柜监控图;respectively selecting at least one standard data group in the standard data set to synthesize the corresponding cabinet monitoring graph;
将不同时段机柜监控图合成机柜动态展示图;Combine the cabinet monitoring diagrams at different time periods into the cabinet dynamic display diagram;
所述机柜动态展示图中的机柜监控图根据时间顺序进行机柜可视模型动态展示。The cabinet monitoring diagram in the cabinet dynamic display diagram performs the dynamic display of the cabinet visual model according to the time sequence.
在本申请实施例中,处理器1100可以用于调用存储在存储器1200中的机柜内部远程监控诊断程序,并执行以下操作:In this embodiment of the present application, the
分别选取标准数据集中时间相邻或位置相邻的两个标准数据组以合成对应的机柜监控图。Two standard data sets that are adjacent in time or position in the standard data set are respectively selected to synthesize the corresponding cabinet monitoring map.
在本申请实施例中,处理器1100可以用于调用存储在存储器1200中的机柜内部远程监控诊断程序,并执行以下操作:In this embodiment of the present application, the
对时间相邻或位置相邻的两个局部图像分别进行特征提取以获取对应的特征点;Perform feature extraction on two local images adjacent in time or position to obtain corresponding feature points;
对所述特征点进行相似性度量,以获取匹配的特征点对;performing similarity measurement on the feature points to obtain matched feature point pairs;
根据所述特征点对得到所述局部图像的空间坐标变换参数;Obtaining the spatial coordinate transformation parameter of the local image according to the feature point pair;
采用所述空间坐标变换参数进行图像配准以合成机柜监控图。Image registration is performed using the space coordinate transformation parameters to synthesize a cabinet monitoring map.
由于本申请实施例提供的机柜装置,为实施本申请实施例的方法所采用的机柜装置,故而基于本申请实施例所介绍的方法,本领域所属人员能够了解该机柜装置的具体结构及变形,故而在此不再赘述。凡是本申请实施例的方法所采用的机柜装置都属于本申请所欲保护的范围。上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。Since the cabinet device provided by the embodiment of the present application is the cabinet device used to implement the method of the embodiment of the present application, based on the method introduced in the embodiment of the present application, those skilled in the art can understand the specific structure and deformation of the cabinet device, Therefore, it is not repeated here. All the cabinet devices used in the methods of the embodiments of the present application belong to the scope of protection of the present application. The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.
对于软件实现,可通过执行本发明实施例所述功能的模块(例如过程、函数等)来实现本发明实施例所述的技术。软件代码可存储在存储器中并通过处理器执行。存储器可以在处理器中或在处理器外部实现。For software implementation, the techniques described in the embodiments of the present invention may be implemented through modules (eg, procedures, functions, etc.) that perform the functions described in the embodiments of the present invention. Software codes may be stored in memory and executed by a processor. The memory can be implemented in the processor or external to the processor.
基于上述结构,提出本发明的实施例。Based on the above-described structure, embodiments of the present invention are proposed.
参照图2,图2为本发明机柜内部远程监控诊断方法的第一实施例的流程示意图,包括以下步骤:Referring to FIG. 2 , FIG. 2 is a schematic flowchart of the first embodiment of the remote monitoring and diagnosis method inside the cabinet according to the present invention, which includes the following steps:
步骤S110,进行机柜内部多源数据的采集,将所述多源数据按单位时间划分为多个数据组。Step S110 , collect multi-source data inside the cabinet, and divide the multi-source data into multiple data groups per unit time.
在本实施例中,本申请所描述的机柜至少包括一个甚至多个,所述多源数据为机柜内部的数据,所述多源数据包括机柜内部动态影像,例如达到1080P以上的高清晰度视频;机柜内部图像,例如机柜内部高清晰图片、高清晰度红外图片;机柜内部声纹数据,例如高保真机柜内环境声音;采集的数据还可以是机柜内电磁场的信号,以上数据为机柜内部的无接触信号,因为这些多源数据遍布在机柜内部的各个角落,因此,通过机柜内部的自调节运载模块承载多源数据采集模块进行采集,将采集的这些无接触信号即非电信号转换为处理器可识别的电信号。In this embodiment, the cabinets described in this application include at least one or more, the multi-source data is data inside the cabinet, and the multi-source data includes dynamic images inside the cabinet, such as high-definition video up to 1080P or higher ; Internal images of the cabinet, such as high-definition pictures and high-definition infrared pictures inside the cabinet; voiceprint data inside the cabinet, such as the ambient sound in the high-fidelity cabinet; The collected data can also be the signal of the electromagnetic field in the cabinet, and the above data is the inside of the cabinet. Non-contact signals, because these multi-source data are distributed in all corners of the cabinet, therefore, the multi-source data acquisition module is carried by the self-adjusting carrier module inside the cabinet for acquisition, and the collected non-contact signals, that is, non-electrical signals, are converted into processing an electrical signal that the device can recognize.
在本实施例中,在设置规定时间内,通过机柜内部的自调节运载模块承载多源数据采集模型,沿着位于机柜侧面的轨道进行前进,形成一个由前到后、或者由后到前的采样周期,例如,可以通过多源数据采集模块采集在前进过程中的多源数据,也可以在连续运动过程中进行数据采集,也可以根据预设位置静止进行数据采集,可以在该轨道上设置多个节点,制定规则采集某个节点或某几个节点的多源数据;In this embodiment, within a predetermined time, the multi-source data acquisition model is carried by the self-adjusting carrier module inside the cabinet, and moves along the track located on the side of the cabinet to form a front-to-back or from back-to-front The sampling period, for example, can collect multi-source data in the process of moving through the multi-source data acquisition module, or collect data during continuous motion, or collect data statically according to the preset position, which can be set on the track Multiple nodes, formulate rules to collect multi-source data of a node or several nodes;
在本实施例中,进行机柜内部多源数据的采集后,将采集的数据按单位时间划分为多个数据组,例如,设置采集规定时间T内机柜内部的多源数据,将采集的多源数据按照t间断进行单位时间t0,t1,t2,...,tn划分,将各单位时间内的多源数据作为一个数据组,其中,t=T/N,N为预设值,N可以根据实际开发需求进行预设,当N的值越小时,被划分的单位时间内的多源数据越多,对应的单位时间越长与形成的数据组越大,最终合成的机柜监控图数量越少;当N的值越大时,被划分的单位时间内的多源数据越少,对应的单位时间越短与形成的数据组越小,最终合成的机柜监控图数量越多。In this embodiment, after collecting the multi-source data inside the cabinet, the collected data is divided into multiple data groups according to the unit time. The data is divided into unit time t 0 , t 1 , t 2 , ..., t n according to t discontinuity, and the multi-source data in each unit time is taken as a data group, where t=T/N, N is preset The value of N can be preset according to the actual development requirements. When the value of N is smaller, the more multi-source data in the divided unit time, the longer the corresponding unit time and the larger the data group formed. The smaller the number of monitoring pictures; when the value of N is larger, the less multi-source data in the divided unit time, the shorter the corresponding unit time and the smaller the data group formed, and the larger the number of finally synthesized cabinet monitoring pictures. .
步骤S120,对所述数据组分别进行预处理并生成对应的标准数据组后,建立标准数据集。Step S120: After preprocessing the data sets and generating corresponding standard data sets, a standard data set is established.
在本实施例中,对划分后的多个数据组内部的多源数据分别进行预处理,生成具有固定格式排序的标准数据组后,将生成的标准数据组分别通过高速无线通信模块,例如5G/WiFi6实时传输至数据处理中心,数据处理中心根据获取到的采样周期T内的多组标准数据组t0,t1,t2,...,tn进行组合,建立一个T0,T1,T2,...,Tn标准数据集。In this embodiment, the multi-source data in the divided multiple data groups are preprocessed respectively, and after standard data groups with fixed format sorting are generated, the generated standard data groups are respectively passed through a high-speed wireless communication module, such as 5G /WiFi6 is transmitted to the data processing center in real time, and the data processing center combines multiple sets of standard data sets t 0 , t 1 , t 2 , ..., t n in the acquired sampling period T to establish a T 0 , T 1 , T 2 , ..., T n standard datasets.
参照图3,图3为本发明机柜内部远程监控诊断方法的第一实施例步骤S120的一个细化流程示意图,包括以下步骤:Referring to FIG. 3 , FIG. 3 is a detailed schematic flow chart of step S120 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention, including the following steps:
步骤S121,对各数据组中的多源数据进行预处理,生成具有固定位置排序的标准数据组。Step S121 , preprocess the multi-source data in each data set to generate a standard data set with fixed position sorting.
在本实施例中,对划分后的各数据组内部的多源数据分别进行预处理,例如,对机柜内部的声纹数据进行语谱图的生成,对机柜内部的高清晰度红外图片进行预处理,对机柜内部采集到的视频流数据进行图像提取等;将预处理后的多源数据组成一组由视频流、图片、红外、声纹等具有固定位置排序的标准数据组。In this embodiment, the multi-source data in the divided data groups are preprocessed respectively. For example, the voiceprint data in the cabinet is generated by spectrogram, and the high-definition infrared images in the cabinet are preprocessed. Processing, image extraction of the video stream data collected inside the cabinet, etc.; the preprocessed multi-source data is formed into a set of standard data groups with fixed positions such as video stream, picture, infrared, voiceprint, etc.
步骤S122,将所述标准数据组根据时间顺序建立标准数据集。Step S122, establishing the standard data set according to the time sequence of the standard data group.
在本实施例中,因为预处理后的标准数据组的数据量较大导致传输速度过慢,同时存在机柜内部无线信号屏蔽的问题,因此,采用5G、WiFi6等大宽带的传输方式,可以让数据处理中心每个机柜内部的大量信息有效传输到后台,提高了监控精度,可以有效提升机柜内部数字化监控程度,同时替代了传统机柜内部型号需要有线传输的带宽需求;将标准数据组通过5G、WiFi6等大宽带的传输方式发送至数据处理中心后,对多组标准数据组进行组合,并将所述标准数据组根据时间顺序建立标准数据集。In this embodiment, because the data volume of the preprocessed standard data group is large, the transmission speed is too slow, and at the same time, there is the problem of shielding the wireless signal inside the cabinet. A large amount of information inside each cabinet of the data processing center is effectively transmitted to the background, which improves the monitoring accuracy, can effectively improve the degree of digital monitoring inside the cabinet, and at the same time replace the bandwidth requirements of traditional cabinet internal models that require wired transmission; standard data groups are transmitted through 5G, After the transmission mode of large broadband such as WiFi6 is sent to the data processing center, multiple sets of standard data sets are combined, and the standard data sets are established according to the time sequence to establish a standard data set.
由于采用了对各数据组中的多源数据进行预处理,生成具有固定位置排序的标准数据组,将所述标准数据组通过5G、WiFi6等大宽带的传输方式发送至数据处理中心,将所述标准数据组进行组合并根据时间顺序建立标准数据集的技术方案,实现对多源数据的划分与传输,为机柜监控图的合成提供标准数据条件。Since the multi-source data in each data set is preprocessed, a standard data set with fixed position sorting is generated, and the standard data set is sent to the data processing center through 5G, WiFi6 and other large-bandwidth transmission methods, and all the standard data sets are sent to the data processing center. The technical scheme of combining the above-mentioned standard data sets and establishing standard data sets according to the time sequence, realizes the division and transmission of multi-source data, and provides standard data conditions for the synthesis of cabinet monitoring diagrams.
步骤S130,选取所述标准数据集中的标准数据组以合成机柜监控图,将不同时段机柜监控图合成机柜动态展示图以进行机柜可视模型动态展示。Step S130, selecting standard data sets in the standard data set to synthesize a cabinet monitoring graph, and synthesizing the cabinet monitoring graphs at different time periods into a cabinet dynamic display graph for dynamic display of the cabinet visual model.
在本实施例中,分别选取所述标准数据集中的至少一个标准数据组以合成对应的机柜监控图,将不同时段机柜监控图合成机柜动态展示图,所述机柜动态展示图中的机柜监控图根据时间顺序进行机柜可视模型动态展示。In this embodiment, at least one standard data group in the standard data set is respectively selected to synthesize the corresponding cabinet monitoring graph, and the cabinet monitoring graphs at different time periods are synthesized into the cabinet dynamic display graph, and the cabinet monitor graph in the cabinet dynamic display graph The cabinet visual model is dynamically displayed according to the time sequence.
参照图4,图4为本发明机柜内部远程监控诊断方法的第一实施例步骤S130的一个细化流程示意图,包括以下步骤:Referring to FIG. 4 , FIG. 4 is a detailed schematic flow chart of step S130 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention, including the following steps:
步骤S131,分别选取所述标准数据集中的至少一个标准数据组以合成对应的机柜监控图。Step S131, at least one standard data group in the standard data set is respectively selected to synthesize a corresponding cabinet monitoring graph.
在本实施例中,形成机柜监控图的过程涉及到图像合成的过程,图像合成是指从所有输入图像中提取出需要的物体区域,然后利用图像处理的相关技术对该区域的颜色、亮度、噪声等进行调整,使其能够无缝拼接到新的图像背景中;在本申请中,可以选取所述标准数据集中的一个标准数据组形成机柜监控图,当选取一个标准数据组形成监控图时,无需与其他标准数据组结合进行图像合成;还可以分别选取标准数据集中时间相邻或位置相邻的两个标准数据组以合成对应的机柜监控图,需要与其他标准数据组结合进行图像合成。In this embodiment, the process of forming the cabinet monitoring map involves the process of image synthesis. Image synthesis refers to extracting the required object area from all input images, and then using the relevant technology of image processing to determine the color, brightness, noise, etc., so that it can be seamlessly spliced into the new image background; in this application, a standard data set in the standard data set can be selected to form a cabinet monitoring map, and when a standard data set is selected to form a monitoring map , there is no need to combine with other standard data sets for image synthesis; two standard data sets that are adjacent in time or position in the standard data set can also be selected to synthesize the corresponding cabinet monitoring map, which needs to be combined with other standard data sets for image synthesis .
参照图5,图5为本发明机柜内部远程监控诊断方法的第一实施例步骤S131的一个细化流程示意图,包括:Referring to FIG. 5 , FIG. 5 is a detailed schematic flow chart of step S131 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention, including:
步骤S1311,分别选取标准数据集中时间相邻或位置相邻的两个标准数据组以合成对应的机柜监控图。Step S1311, respectively selecting two standard data sets that are adjacent in time or position in the standard data set to synthesize a corresponding cabinet monitoring graph.
在本实施例中,采用所述标准数据组组成机柜内部的局部图像,根据多源数据采集模块进行单位时间内的机柜局部视频流、图像采集,将相邻时间点、相邻位置信息的两个局部视频流或局部图像进行合成,形成对应的完整的机柜监控图,例如,利用T1,T2,...,Tn中一组或者多组标准数据组中包含的局部图像进行联合,以合成对应的机柜监控图。In this embodiment, the standard data group is used to form a local image inside the cabinet, and the local video stream and image collection of the cabinet in unit time is performed according to the multi-source data acquisition module, and the two adjacent time points and adjacent position information are collected. synthesizing several partial video streams or partial images to form a corresponding complete cabinet monitoring map, for example, using partial images contained in one or more standard data sets in T 1 , T 2 , . . . , T n to combine , to synthesize the corresponding cabinet monitoring diagram.
在本实施例中,将相邻时间点、相邻位置信息的两个局部视频流或局部图像进行合成一幅完整的机柜内整体视频流、图像,主要过程如下:特征提取、图像变形、图像融合混合;其中,特征提取为检测所有输入图像中的特征点以进行图像配准,所述图像配准的过程为:建立图像之间的几何对应关系,以便在共同的参照系中对它们进行变换,比较和分析,它大致可分为以下几类:直接使用图像的像素值的算法,例如,相关方法;用于频域处理的算法,例如基于FFT的方法;低级特征的算法,通常使用边和角,例如,基于特征的方法;高级特征的算法,通常用于重叠图像对象的部分,特征关系,如图论方法;具体的图像的配准过程如步骤S13111至S13114所述,这里不再赘述。In this embodiment, two local video streams or local images of adjacent time points and adjacent location information are synthesized into a complete overall video stream and image in the cabinet. The main processes are as follows: feature extraction, image deformation, image Fusion mixing; wherein, feature extraction is to detect feature points in all input images for image registration, and the process of image registration is: establishing the geometric correspondence between the images so that they can be processed in a common frame of reference. Transform, compare and analyze, which can be roughly divided into the following categories: algorithms that directly use the pixel values of an image, such as correlation methods; algorithms for frequency domain processing, such as FFT-based methods; algorithms for low-level features, usually using Edges and corners, for example, feature-based methods; advanced feature algorithms, usually used to overlap parts of image objects, feature relationships, such as graph theory methods; the specific image registration process is described in steps S13111 to S13114, not here Repeat.
图像变形:图像变形是指重新投影图像配准后的其中一个图像,将该图像放在更大的画布上。Image Warping: Image warping refers to reprojecting one of the images after image registration, placing that image on a larger canvas.
图像融合混合:图像融合是改变边界附近图像的灰度,去除这些间隙,并创建混合图像,从而实现图像之间的平滑过渡。混合模式用于将两个层合并在一起。Image Fusion Blending: Image blending is the process of changing the grayscale of the image near the border, removing these gaps, and creating a blended image to achieve a smooth transition between images. Blending modes are used to merge the two layers together.
在本实施例中,在机柜监控图合成之前最重要的工作就是图像配准,图像配准的过程是以一幅图像作为基础,把其他的图像通过一定算法复合在其上,图像配准的目的是使图像满足时间和空间上的一致,在多源数据采集过程中,可能因为摄像头的视野不同、镜片的焦距不同、图像单位时间的帧数的差异、摄像头的移动等导致采集的局部图像存在误差,因此,先完成图像的配准工作,再进行机柜监控图的合成,能降低误差;图像配准的方式可以概括为相对配准和绝对配准两种:相对配准是指选择多图像中的一张图像作为参考图像,将其它的相关图像与之配准,其坐标系统是任意的。绝对配准是指先定义一个控制网格,所有的图像相对于这个网格来进行配准,也就是分别完成各分量图像的几何校正来实现坐标系的统一,本申请主要采用相对配准。In this embodiment, the most important task before the cabinet monitoring image is synthesized is image registration. The process of image registration is based on one image, and other images are composited on it through a certain algorithm. The purpose is to make the images consistent in time and space. In the process of multi-source data acquisition, the local images collected may be caused by different fields of view of cameras, different focal lengths of lenses, differences in the number of frames per image unit time, and movement of cameras. There are errors. Therefore, the image registration work is completed first, and then the cabinet monitoring map is synthesized, which can reduce the error; the method of image registration can be summarized as relative registration and absolute registration: relative registration refers to the selection of more One of the images is used as a reference image, and other related images are registered with it, and its coordinate system is arbitrary. Absolute registration means that a control grid is first defined, and all images are registered with respect to this grid, that is, the geometric correction of each component image is completed separately to realize the unification of the coordinate system, and relative registration is mainly used in this application.
参照图6,图6为本发明机柜内部远程监控诊断方法的第一实施例步骤S1311的一个细化流程示意图,包括以下步骤:Referring to FIG. 6 , FIG. 6 is a detailed schematic flow chart of step S1311 of the first embodiment of the method for remote monitoring and diagnosis inside a cabinet according to the present invention, including the following steps:
S13111,对时间相邻或位置相邻的两个局部图像分别进行特征提取以获取对应的特征点。S13111, respectively perform feature extraction on two local images adjacent in time or in position to obtain corresponding feature points.
在本实施例中,所述特征点为局部图像中具有代表性的部分,该特征点可以是局部图像的边缘、轮廓、曲线交叉点或者高曲率点,常用的特征提取算法有:边缘点提取方法、角点提取方法等,采用这些特征提取算法提取时间相邻或位置相邻的两个局部图像对应的特征点。In this embodiment, the feature point is a representative part of the local image, and the feature point can be the edge, contour, curve intersection or high curvature point of the local image. Commonly used feature extraction algorithms are: edge point extraction method, corner extraction method, etc., these feature extraction algorithms are used to extract feature points corresponding to two local images that are adjacent in time or in position.
S13112,对所述特征点进行相似性度量,以获取匹配的特征点对。S13112: Perform similarity measurement on the feature points to obtain matched feature point pairs.
在本实施例中,所述相似性度量用于综合评定两个特征点之间相近程度的一种度量,以建立局部图像之间的几何对应关系,两个特征点越接近,它们的相似性度量也就越大,而两个特征点越远,它们的相似性度量也就越小,通过对特征点进行相似性度量,以获取特征点接近即相似性度量大的特征点对。In this embodiment, the similarity measure is used to comprehensively evaluate a measure of the degree of similarity between two feature points, so as to establish a geometric correspondence between local images. The closer the two feature points are, the more similar they are. The larger the metric, and the farther the two feature points are, the smaller their similarity metric will be. By performing the similarity metric on the feature points, a feature point pair with close feature points, that is, with a large similarity metric, is obtained.
S13113,根据所述特征点对得到所述局部图像的空间坐标变换参数。S13113: Obtain the spatial coordinate transformation parameters of the local image according to the feature point pair.
在本实施例中,通过对特征点进行相似性度量,获取匹配的特征点对,建立局部图像的几何对应关系,选择一个适当的多项式在共同的空间坐标系中拟合两图像之间的平移、旋转和仿射变换,得到局部图像的空间坐标变换参数。In this embodiment, by measuring the similarity of the feature points, the matching feature point pairs are obtained, the geometric correspondence of the local images is established, and an appropriate polynomial is selected to fit the translation between the two images in the common spatial coordinate system. , rotation and affine transformation to obtain the spatial coordinate transformation parameters of the local image.
S13114,采用所述空间坐标变换参数进行图像配准以合成机柜监控图。S13114, using the spatial coordinate transformation parameters to perform image registration to synthesize a cabinet monitoring map.
在本实施例中,所述空间坐标变化参数为局部图像的配置控制点,根据该配置控制点可实现图像配准,配置控制点数量的确定规则为:n次多项式,配置控制点至少选择(n+1)*(n+2)/2;例如,一次多项式,配置控制点至少选择3个;二次多项式,配置控制点至少选择6个,根据实际情况选择适当的多项式,从而确定配置控制点的数量,即确定空间坐标变化参数,通过该配置控制点进行图像配准,在经过对局部图像的变形与图像融合,从而合成机柜监控图。In this embodiment, the spatial coordinate change parameter is the configuration control point of the local image, and image registration can be achieved according to the configuration control point. The determination rule for the number of configuration control points is: a polynomial of degree n. n+1)*(n+2)/2; for example, for a first-order polynomial, select at least 3 configuration control points; for a second-order polynomial, select at least 6 configuration control points, and select an appropriate polynomial according to the actual situation to determine the configuration control point The number of points, that is, to determine the spatial coordinate change parameters, through the configuration control points for image registration, after the deformation of the local image and image fusion, the cabinet monitoring map is synthesized.
由于采用了对时间相邻或位置相邻的两个局部图像分别进行特征提取以获取对应的特征点,对所述特征点进行相似性度量,以获取匹配的特征点对,根据所述特征点对得到所述局部图像的空间坐标变换参数,采用所述空间坐标变换参数进行图像配准,使图像满足时间和空间上的一致,降低机柜监控图合成的误差。Since feature extraction is performed on two local images that are adjacent in time or location to obtain corresponding feature points, and similarity measurement is performed on the feature points to obtain matching feature point pairs, according to the feature points For the spatial coordinate transformation parameters of the obtained partial image, the spatial coordinate transformation parameters are used to perform image registration, so that the images are consistent in time and space, and errors in the synthesis of cabinet monitoring images are reduced.
步骤S132,将不同时段机柜监控图合成机柜动态展示图。Step S132, synthesizing the cabinet monitoring graphs at different time periods into a cabinet dynamic display graph.
在本实施例中,将合成的机柜监控图完整的展示出来,实现被控场景的真实呈现,实现监控的数字化转型,采用B/S展示方式,适配多种浏览器,满足不同控制终端的需求;同时,针对展示的真实场景的数字化模型,可以通过对浏览器端的数字化模型的操作实现对真实设备的操作。In this embodiment, the synthesized cabinet monitoring diagram is completely displayed, so as to realize the real presentation of the controlled scene, realize the digital transformation of monitoring, adopt the B/S display method, adapt to a variety of browsers, and meet the needs of different control terminals. At the same time, for the digital model of the real scene displayed, the operation of the real device can be realized by operating the digital model on the browser side.
步骤S133,所述机柜动态展示图中的机柜监控图根据时间顺序进行机柜可视模型动态展示。In step S133, the cabinet monitoring diagram in the cabinet dynamic display diagram is dynamically displayed according to the chronological order of the rack visual model.
在本实施例中,所述机柜动态展示图为一个可视模型,它将合成的机柜监控图根据时间顺序进行机柜的动态展示,可以更加直观的对机柜内部的设备进行监测。In this embodiment, the dynamic display diagram of the cabinet is a visual model, which dynamically displays the cabinet according to the time sequence of the synthesized cabinet monitoring diagram, so that the equipment inside the cabinet can be monitored more intuitively.
步骤S140,将所述机柜动态展示图根据功能进行权限分片,以对不同的功能进行远程故障诊断。In step S140, the dynamic display diagram of the cabinet is divided into permissions according to functions, so as to perform remote fault diagnosis for different functions.
在本实施例中,数据处理中心的机柜内不同的设备可能对应不同的功能、不同的厂家,需要针对性进行远程故障诊断,因此将机柜动态展示图按照预先指定的分片原则进行权限分片,以浏览器展示的方式提供给不同的操作维护人员,避免权限过大引发的数据安全风险;维护人员可以根据观测到的机柜实景动态展示,进行数据分析、故障判决等,根据故障分析情况指挥运动压式控制模块进行按压操作。In this embodiment, different devices in the cabinet of the data processing center may correspond to different functions and different manufacturers, and remote fault diagnosis needs to be carried out in a targeted manner. Therefore, the dynamic display diagram of the cabinet is sharded according to the pre-specified sharding principle. , which is provided to different operation and maintenance personnel in the form of browser display to avoid data security risks caused by excessive permissions; maintenance personnel can dynamically display the observed cabinets, conduct data analysis, fault judgment, etc., and command according to the fault analysis situation The motion pressure control module performs the pressing operation.
由于采用了在不影响现有机柜内部设备的前提下,通过以视频数据为主要数据的多源数据实时采集,采用区域分时的高清晰度快速采集方式,将采集的多源数据通过5G、WiFi6等高速率无线传输传送到数据处理中心;利用数据处理中心已有的算法对分时高清晰度的局部图像进行整体合成,形成一幅由分时视频或图片组成的机柜内部的高清图像照片,提供給维护人员使用;在提供給不同厂家的维护人员合成实景图片时,对不同的业务处理进行操作权限分片,提供給远程操作维护人员,有效解决了多设备、多厂家的维护时引起的管理混乱、设备数据安全的问题,控制由于远程接入对整个系统带来风险;同时,利用针式、笔式等按压式功能模块,根据远程人员对问题的判决分析结果,实现远程控制按压设备对机柜内部的按钮进行操作。Due to the use of real-time collection of multi-source data with video data as the main data without affecting the existing equipment inside the cabinet, and the high-definition fast collection method of regional time-sharing, the collected multi-source data is collected through 5G, High-speed wireless transmission such as WiFi6 is transmitted to the data processing center; the time-sharing high-definition local images are synthesized as a whole using the existing algorithms of the data processing center to form a high-definition image photo of the inside of the cabinet composed of time-sharing videos or pictures , provided for maintenance personnel; when providing maintenance personnel of different manufacturers to synthesize real pictures, the operation authority for different business processes is divided and provided to remote operation and maintenance personnel, which effectively solves the problems caused by the maintenance of multiple equipment and multiple manufacturers. remote access to the control will bring risks to the entire system; at the same time, the use of pin-type, pen-type and other push-type function modules, according to the results of the remote personnel’s judgment and analysis of the problem, to achieve remote control and push The device operates the buttons inside the cabinet.
基于同一发明构思,本发明还提供一种机柜内部远程监控诊断系统,如图7所示,图7为本发明机柜内部远程监控诊断系统的结构示意图,所述系统包括:多源数据采集模块10、多源数据处理模块20、机柜监控图合成模块30、机柜可视模型动态展示模块40、远程故障诊断模块50等,下面将对各个模块进行展开描述:Based on the same inventive concept, the present invention also provides a remote monitoring and diagnosis system inside the cabinet, as shown in FIG. 7 , which is a schematic structural diagram of the remote monitoring and diagnosis system inside the cabinet according to the present invention. The system includes: a multi-source
多源数据采集模块10:用于进行机柜内部多源数据的采集,将所述多源数据根据时间单位划分为多个数据组,采用高清晰度视频(1080P以上),高清晰度图片,高保真机柜内环境声音,高清晰度红外图片、机柜内电磁场的信号等进行无接触信号采集,将非电信号转化成电信号。Multi-source data collection module 10: used for collecting multi-source data inside the cabinet, dividing the multi-source data into multiple data groups according to time units, using high-definition video (above 1080P), high-definition pictures, high-definition The ambient sound in the real cabinet, high-definition infrared pictures, and the signal of the electromagnetic field in the cabinet are collected without contact, and the non-electrical signal is converted into an electrical signal.
多源数据处理模块20:用于对所述数据组分别进行预处理以形成标准数据组,主要用于视频流预处理、图片预处理、声纹信号处理成语谱图、电磁信号预处理等功能;处理完成之后,形成位置相关信息数据组包含视频流、高清图片、红外图片、语谱图图片、电磁环境信息等。Multi-source data processing module 20: used to preprocess the data sets respectively to form standard data sets, mainly used for video stream preprocessing, picture preprocessing, voiceprint signal processing idiom spectrogram, electromagnetic signal preprocessing and other functions ; After the processing is completed, a location-related information data group is formed, including video streams, high-definition pictures, infrared pictures, spectrogram pictures, electromagnetic environment information, and the like.
机柜监控图合成模块30:用于选取标准数据组对应的局部图像合成完整的机柜动态展示图;所述机柜监控图合成模块30还用于获取各标准数据组并组合成标准数据集;将所述标准数据集中的一组或多组标准数据组进行联合,以融合成多个机柜动态展示图;根据多源数据采集模块10采集单个时间点的机柜局部视频流、图像,将相邻时间点、相邻位置信息的局部视频流、图像进行合成,形成一幅完整的机柜内整体视频流、图像。Cabinet monitoring map synthesis module 30: used to select partial images corresponding to standard data sets to synthesize a complete cabinet dynamic display map; the cabinet monitoring
机柜可视模型动态展示模块40:用于将所述机柜动态展示图根据时间顺序进行机柜可视模型动态展示;所述机柜可视模型动态展示模块40将合成的机柜图片完整的展示出来,实现被控场景的真实呈现,实现监控的数字化转型,采用B/S展示方式,适配多种浏览器,满足不同控制终端的需求;同时,针对展示的真实场景的数字化模型,可以通过对浏览器端的数字化模型的操作实现对真实设备的操作。The cabinet visual model
远程故障诊断模块50:用于将所述机柜动态展示图进行功能权限分片并针对不同的功能进行远程故障诊断;数据处理中心机柜内不同的设备可能对应不同的功能、不同的厂家,需要针对性进行远程故障诊断,所述远程故障诊断模块50采用功能分片的方式提供給对应操作维护人员权限,避免权限过大引发的数据安全风险。Remote fault diagnosis module 50: used to perform functional rights segmentation on the dynamic display diagram of the cabinet and perform remote fault diagnosis for different functions; different equipment in the cabinet of the data processing center may correspond to different functions and different manufacturers, and needs to be targeted for The remote
由于采用了多源数据采集模块进行机柜内部多源数据的采集,将所述多源数据根据时间单位划分为多个数据组;多源数据处理模块对所述数据组分别进行预处理并生成对应的标准数据组后,建立标准数据集;机柜监控图合成模块选取所述标准数据集中的标准数据组以合成机柜监控图;机柜可视模型动态展示模块将不同时段机柜监控图合成机柜动态展示图以进行机柜可视模型动态展示;远程故障诊断模块将所述机柜动态展示图根据功能进行权限分片并针对不同的功能进行远程故障诊断的技术方案,形成一个完整的对单个设备具体故障的远程诊断系统。Since the multi-source data acquisition module is used to collect multi-source data inside the cabinet, the multi-source data is divided into multiple data groups according to time units; the multi-source data processing module preprocesses the data groups and generates corresponding data groups. After the standard data set is created, a standard data set is established; the cabinet monitoring map synthesis module selects the standard data set in the standard data set to synthesize the cabinet monitoring map; the cabinet visual model dynamic display module synthesizes the cabinet monitoring map at different time periods into the cabinet dynamic display map In order to dynamically display the visual model of the cabinet; the remote fault diagnosis module divides the dynamic display diagram of the cabinet according to the function, and performs the technical scheme of remote fault diagnosis for different functions, forming a complete remote fault diagnosis of a single device diagnostic system.
基于同一发明构思,本申请实施例还提供了一种存储介质,所述存储介质存储有机柜内部远程监控诊断程序,所述机柜内部远程监控诊断程序被处理器执行时实现如上所述的机柜内部远程监控诊断方法的各个步骤,且能达到相同的技术效果,为避免重复,这里不再赘述。Based on the same inventive concept, an embodiment of the present application further provides a storage medium, where the storage medium stores a remote monitoring and diagnosis program inside a cabinet, and when the remote monitoring and diagnosis program inside the cabinet is executed by a processor, the above-mentioned cabinet interior is realized The various steps of the remote monitoring and diagnosis method can achieve the same technical effect. In order to avoid repetition, they will not be repeated here.
由于本申请实施例提供的存储介质,为实施本申请实施例的方法所采用的存储介质,故而基于本申请实施例所介绍的方法,本领域所属人员能够了解该存储介质的具体结构及变形,故而在此不再赘述。凡是本申请实施例的方法所采用的存储介质都属于本申请所欲保护的范围。Since the storage medium provided by the embodiments of the present application is the storage medium used to implement the methods of the embodiments of the present application, based on the methods introduced in the embodiments of the present application, those skilled in the art can understand the specific structure and deformation of the storage medium, Therefore, it is not repeated here. All storage media used in the methods of the embodiments of the present application belong to the scope of protection of the present application.
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.
应当注意的是,在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的部件或步骤。位于部件之前的单词“一”或“一个”不排除存在多个这样的部件。本发明可以借助于包括有若干不同部件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。It should be noted that, in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not preclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.
尽管已描述了本发明的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例作出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本发明范围的所有变更和修改。Although the preferred embodiments of the present invention have been described, additional changes and modifications to these embodiments may occur to those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be construed to include the preferred embodiment and all changes and modifications that fall within the scope of the present invention.
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit and scope of the invention. Thus, provided that these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011492210.9A CN112702877B (en) | 2020-12-16 | 2020-12-16 | Cabinet interior remote monitoring and diagnosis method and system, cabinet device and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011492210.9A CN112702877B (en) | 2020-12-16 | 2020-12-16 | Cabinet interior remote monitoring and diagnosis method and system, cabinet device and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112702877A CN112702877A (en) | 2021-04-23 |
CN112702877B true CN112702877B (en) | 2022-04-15 |
Family
ID=75508682
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011492210.9A Active CN112702877B (en) | 2020-12-16 | 2020-12-16 | Cabinet interior remote monitoring and diagnosis method and system, cabinet device and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112702877B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114140982A (en) * | 2021-12-09 | 2022-03-04 | 北京航空航天大学 | A wireless sputum accumulation alarm based on phlegm sound sensor |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102508989B (en) * | 2011-09-27 | 2015-04-29 | 福建省电力有限公司 | Dynamic power grid panorama display system on basis of virtual reality |
CN103281391A (en) * | 2013-06-06 | 2013-09-04 | 四川艾普视达数码科技有限公司 | Monitoring system for financial industry |
CN103714564A (en) * | 2013-12-17 | 2014-04-09 | 国网信通亿力科技有限责任公司 | Machine room ambient temperature three-dimensional dynamic real-time monitoring system and method |
CN106657906B (en) * | 2016-12-13 | 2020-03-27 | 国家电网公司 | Information equipment monitoring system with self-adaptive scene virtual reality function |
CN111443259A (en) * | 2020-03-30 | 2020-07-24 | 国网山东省电力公司德州供电公司 | Active power distribution network fault diagnosis method and system based on local abnormal factor detection |
-
2020
- 2020-12-16 CN CN202011492210.9A patent/CN112702877B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN112702877A (en) | 2021-04-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10854006B2 (en) | AR-enabled labeling using aligned CAD models | |
JP6902926B2 (en) | Systems and methods for producing improved stereographic video of the aircraft construction process | |
Sun et al. | Three-dimensional structural displacement measurement using monocular vision and deep learning based pose estimation | |
US20200186783A1 (en) | Synthesis of transformed image views | |
CN106534780A (en) | Three-dimensional panoramic video monitoring device and video image processing method thereof | |
CN110610486B (en) | Monocular image depth estimation method and device | |
CN103942843A (en) | Fairway and ship three-dimensional model dynamic presenting method based on video | |
CN118038332B (en) | Regional warning method and system based on intelligent video identification | |
CN112712487A (en) | Scene video fusion method and system, electronic equipment and storage medium | |
CN112702877B (en) | Cabinet interior remote monitoring and diagnosis method and system, cabinet device and storage medium | |
CN106020489A (en) | Industrial-design simulation system | |
CN114494427A (en) | Method, system and terminal for detecting illegal behavior of person standing under suspension arm | |
CN118657747A (en) | A multi-modal fusion fault detection method, system and electronic equipment based on audio-visual-visible light-infrared | |
Ciamarra et al. | Temporal surface frame anomalies for deepfake video detection | |
Zhai et al. | Image real-time augmented reality technology based on spatial color and depth consistency | |
Ding et al. | Video Frame Interpolation with Stereo Event and Intensity Cameras | |
Callemein et al. | Anyone here? Smart embedded low-resolution omnidirectional video sensor to measure room occupancy | |
CN118351572A (en) | Personnel detection method and related device | |
CN112233193A (en) | Power transformation equipment fault diagnosis method based on multispectral image processing | |
CN115050010B (en) | Migration learning method for three-dimensional object detector | |
CN117830568A (en) | A power metaverse modeling system and remote maintenance guidance method thereof | |
Seitner et al. | Trifocal system for high-quality inter-camera mapping and virtual view synthesis | |
CN114155400B (en) | Image processing method, device and equipment | |
Alshadoodee et al. | Digital camera in movement tracking on FPGA board DE2 | |
CN105323572A (en) | Stereo image processing system, device and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP03 | Change of name, title or address |
Address after: Building 7, 5th Floor, Zijin R&D Entrepreneurship Center, No. 89 Shengli Road, Moling Street, Jiangning District, Nanjing City, Jiangsu Province, 210000 (Jiangning Development Zone) Patentee after: Nanjing Liwei Zhilian Technology Co.,Ltd. Country or region after: China Patentee after: SHENZHEN ZNV TECHNOLOGY Co.,Ltd. Address before: No. 888 Zhengfang Middle Road, Jiangning Economic and Technological Development Zone, Nanjing City, Jiangsu Province Patentee before: NANJING ZNV SOFTWARE Co.,Ltd. Country or region before: China Patentee before: SHENZHEN ZNV TECHNOLOGY Co.,Ltd. |
|
CP03 | Change of name, title or address |