CN115499337A - Data quality management system based on scene analysis - Google Patents

Data quality management system based on scene analysis Download PDF

Info

Publication number
CN115499337A
CN115499337A CN202211234931.9A CN202211234931A CN115499337A CN 115499337 A CN115499337 A CN 115499337A CN 202211234931 A CN202211234931 A CN 202211234931A CN 115499337 A CN115499337 A CN 115499337A
Authority
CN
China
Prior art keywords
data
analysis
quality management
network
communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202211234931.9A
Other languages
Chinese (zh)
Other versions
CN115499337B (en
Inventor
陈军
张灿彬
薛建波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Red Net Technology Co ltd
Original Assignee
Jiangsu Red Net Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Red Net Technology Co ltd filed Critical Jiangsu Red Net Technology Co ltd
Priority to CN202211234931.9A priority Critical patent/CN115499337B/en
Publication of CN115499337A publication Critical patent/CN115499337A/en
Application granted granted Critical
Publication of CN115499337B publication Critical patent/CN115499337B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823Errors, e.g. transmission errors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823Errors, e.g. transmission errors
    • H04L43/0829Packet loss
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q9/00Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Arrangements For Transmission Of Measured Signals (AREA)

Abstract

The invention relates to a data quality management system based on scene analysis, which comprises a data quality management server based on scene analysis, a data storage server, communication gateways, network switches, field data acquisition terminals and control terminals, wherein the data quality management server based on scene analysis is in data connection with at least one communication gateway through a communication network, the communication gateways are in data connection with the data storage server, at least one control terminal and a plurality of network switches through the communication network, and the network switches are in data connection with a plurality of field data acquisition terminals through the communication network. The invention has the advantages of simple system structure, strong system operation maintenance and expansion capability, high data sampling, detection and evaluation operation efficiency and precision and high data analysis operation efficiency.

Description

Data quality management system based on scene analysis
Technical Field
The invention relates to a data quality management system based on scene analysis, belonging to the technical field of artificial intelligence and information.
Background
In the present day that big data is continuously developed and people's daily life is gradually digitalized, the quality of daily received data directly affects the operation efficiency and precision of a plurality of devices, and simultaneously causes great influence on the operation stability of intelligent control devices and automatic control systems, aiming at the problem, various signal quality detection systems are currently developed, for example, patent technologies such as ' a data quality detection method and system ' with the patent application number of ' 110465489X ', although the system structure is relatively fixed when the system is operated according to the current system, the system structure is expanded, the daily maintenance difficulty and cost are relatively high, meanwhile, when the communication data quality analysis and judgment are carried out, the comprehensiveness of the data analysis is poor, the work efficiency and precision of the data analysis and processing are relatively poor, and in addition, the communication data quality analysis and processing precision is easily affected further due to the insufficient analysis data, in addition, the intelligence degree of the data analysis and processing operation is relatively low in the current data analysis, and the data analysis and processing precision is also affected, and the data analysis and operation efficiency is also poor.
Disclosure of Invention
In order to solve the defects in the prior art, the invention provides a data quality management system based on scene analysis.
A data quality management system based on scene analysis comprises a data quality management server based on scene analysis, a data storage server, communication gateways, network switches, field data acquisition terminals and control terminals, wherein the data quality management server based on scene analysis is in data connection with at least one communication gateway through a communication network, the communication gateways are in data connection with the data storage server, at least one control terminal and a plurality of network switches through the communication network, the network switches are in data connection with a plurality of field data acquisition terminals through the communication network, and the field data acquisition terminals are distributed at the positions of data sources and are in data connection with data source equipment through the communication network.
Furthermore, the data quality management server based on the scene analysis is a system taking a big data computing system as a bottom service platform, and is additionally provided with at least one data analysis sub-server based on a cloud computing platform and at least one deep learning simulation sub-server, wherein the data analysis sub-server based on the cloud computing platform and the deep learning simulation sub-server are mutually connected through a communication gateway, and are also connected with the data quality management server based on the scene analysis and the data storage server through the communication gateway.
Furthermore, the deep learning simulation sub-server is provided with an artificial neural network service platform based on a BP neural network system, an LSTM time sequence neural network system and a CNN neural network system; the data analysis sub-server of the cloud computing platform is provided with any one or more of an image capturing software system, a data retrieval software system, a data comparison analysis software system and an image data processing software system.
Furthermore, the field data acquisition terminal comprises at least two bearing shells, communication ports, power connection ports, monitoring cameras, microphones, temperature and humidity sensors, illuminating lamps, brightness sensors, data transmission circuits and operation driving circuits, wherein at least one of the bearing shells is internally provided with the data transmission circuit, the outer side surface of the bearing shell where the data transmission circuit is positioned is provided with a plurality of communication ports and one communication port, each communication port is connected with the data transmission circuit, the data transmission circuit is also electrically connected with the power connection ports, the operation driving circuit is positioned in the other bearing shell, the outer surface of the bearing shell corresponding to the operation driving circuit is provided with at least one power connection port, at least one temperature and humidity sensor, at least one illuminating lamp and at least one microphone, and the upper end surface of the bearing shell where the operation driving circuit is positioned is provided with one monitoring camera and at least one brightness sensor, the axis of the monitoring camera, the front end surface and the upper end surface of the bearing shell are respectively at 0-90 degrees, the illuminating lamp and the temperature and humidity sensor are all embedded on the outer side surface of the bearing shell and are uniformly distributed around the axis of the bearing shell, the optical axis of the microphone is vertically distributed with the outer side surface of the bearing shell, the microphone is embedded on the front end surface of the bearing shell, the power supply connecting port is positioned at the rear end surface of the bearing shell, meanwhile, 1-4 communication ports are additionally arranged on the rear end surface of the bearing shell, each power supply connecting port and each communication port are electrically connected with the operation driving circuit, the operation driving circuit is electrically connected with the monitoring camera, the microphone, the temperature and humidity sensor, the illuminating lamp and the brightness sensor, the power supply connecting port of the bearing shell where the data transmission circuit is positioned is electrically connected with one of the power supply connecting ports at the rear end surface of the bearing shell where the operation driving circuit is positioned through a lead wire, meanwhile, the communication port of the bearing shell where the driving circuit is located is operated to establish data connection with one communication port of the bearing shell where the data transmission circuit is located through a data line.
Furthermore, bear the shell lateral surface and establish a plurality of and its up end and the perpendicular connection spout that distributes of lower terminal surface, pass through connecting strip interconnect between the connection spout of two adjacent bearing shells, and each bears the shell and distributes along vertical direction from the top down, the bearing shell that moves drive circuit place simultaneously is located the top, each bears the shell bottom and all establishes four at least elastic cushion that encircle its lower terminal surface mid point equipartition, and two adjacent bearing shells offset through elastic cushion.
Furthermore, the monitoring camera is any one or two of a CCD camera and a 3D scanning camera, the monitoring camera is hinged to the upper end face of the bearing shell through a three-dimensional rotary table mechanism, at least one angle sensor is arranged on the three-dimensional rotary table mechanism, and the three-dimensional rotary table mechanism and the angle sensor are both electrically connected with the operation driving circuit.
Furthermore, the operation driving circuit comprises a data processing circuit, an MOS driving circuit, a multi-path voltage-stabilized power supply circuit and a crystal oscillator clock circuit which are based on any one of a DSP chip and an FPGA chip, the data processing circuit is respectively electrically connected with the multi-path voltage-stabilized power supply circuit and the crystal oscillator clock circuit through the MOS driving circuit, and the MOS driving circuit is electrically connected with a communication port, a power supply connecting port, a monitoring camera, a microphone, a temperature and humidity sensor, a lighting lamp and a brightness sensor and is electrically connected with the data transmission circuit through the power supply connecting port and the communication port.
A management method of a data quality management system based on scene analysis comprises the following steps:
s1, system construction, namely firstly constructing a data quality management server based on scene analysis, assembling the data quality management server based on the scene analysis, an operation terminal, a data storage server and at least one communication gateway in a control room, then assembling each field data acquisition terminal and a corresponding network switch at the position of a corresponding data source to be detected, establishing data connection between the field data acquisition terminal and the data source to be detected, finally establishing data connection between the data quality management server based on the scene analysis, the data storage server, the communication gateway, the network switch, the field data acquisition terminal and the operation terminal through a communication network, allocating independent data addressing addresses for each data storage server, the communication gateway, the network switch, the field data acquisition terminal and the operation terminal through the data quality management server based on the scene analysis, and establishing data connection between the data quality management server based on the scene analysis and an external communication network connected with the data source to be detected through the communication gateway;
s2, data acquisition, namely after the step S1 is completed, on one hand, the field data acquisition terminal continuously acquires network communication data at a data source to be detected through a communication port at regular intervals, transmits the acquired data to a data quality management server based on scene analysis and temporarily stores the acquired data in a data storage server; on the other hand, environmental state data of a data source to be detected during operation are synchronously collected through a monitoring camera, a microphone, a temperature and humidity sensor and a brightness sensor, and then the collected environmental data are transmitted to a data quality management server based on scene analysis and are temporarily stored in a data storage server; finally, the data quality management server for scene analysis synchronously acquires network data from the data acquired from the external communication network directly in the same time period and temporarily stores the network data in the data storage server
S3, comparing and analyzing data, namely comparing and analyzing the network communication data, the environmental state data and the data obtained by an external communication network in a centralized manner by a data analysis sub-server based on a cloud computing platform of a data quality management server based on scene analysis, so as to obtain data at the position of a data source and judge the attenuation and loss of the data transmitted by the network, obtain the data quality analysis result of the current time period, store the data quality analysis result of the current time period in a data storage server, analyze the data of each time period in sequence according to the time sequence, and finally perform subsequent secondary analysis on the analysis result of the data of each time period, so that the quality condition of the current network data can be obtained, and the analysis results are respectively output through an operation terminal;
s4, intelligently analyzing, namely continuously tracking and synchronously simulating the operation process of the data analysis sub-server based on the cloud computing platform by the deep learning simulation sub-server of the data quality management server based on scene analysis when the data analysis of the step S3 is carried out, so that on one hand, the current network data analysis judgment logic is obtained; and on the other hand, a current network data quality fluctuation rule is obtained, then the network data analysis judgment logic and the network data quality fluctuation rule are fed back to the data analysis sub-server based on the cloud computing platform, and the data analysis result of the data analysis sub-server based on the cloud computing platform is verified.
The invention has the advantages of simple system structure, strong system operation maintenance and expansion capability, high data sampling, detection and evaluation efficiency and precision, high data analysis efficiency and high data analysis intelligentization degree, and effectively introduces the equipment operation scene as reference in the data analysis process, thereby effectively improving the data quality analysis efficiency and precision.
Drawings
The invention is described in detail below with reference to the drawings and the detailed description;
FIG. 1 is a schematic flow diagram of the process of the present invention;
FIG. 2 is a schematic structural diagram of a field data acquisition terminal;
FIG. 3 is a schematic diagram of the data combing process of the present invention.
Detailed Description
In order to facilitate the implementation of the technical means, creation features, achievement of the purpose and the efficacy of the invention, the invention is further described below with reference to specific embodiments.
As shown in fig. 1 and 2, a data quality management system based on scene analysis includes a data quality management server 1 based on scene analysis, a data storage server 2, a communication gateway 3, a network switch 4, field data acquisition terminals 5 and control terminals 6, where the data quality management server 1 based on scene analysis establishes data connection with at least one communication gateway 3 through a communication network, the communication gateway 3 additionally establishes data connection with the data storage server 2, at least one control terminal 6 and a plurality of network switches 4 through a communication network, the network switch 4 additionally establishes data connection with a plurality of field data acquisition terminals 5 through a communication network, and a plurality of field data acquisition terminals 5 are distributed at each data source location and establish data connection with data source devices through a communication network.
In this embodiment, the data quality management server 1 based on the scene analysis is a system using a big data computing system as a bottom service platform, and is additionally provided with at least one data analysis sub-server based on a cloud computing platform and at least one deep learning simulation sub-server, the data analysis sub-server and the deep learning simulation sub-server based on the cloud computing platform are mutually connected through a communication gateway, and are also connected with the data quality management server and the data storage server based on the scene analysis through the communication gateway.
It is important to explain that the deep learning simulation sub-server is provided with an artificial neural network service platform based on a BP neural network system, an LSTM time series neural network system and a CNN neural network system; the data analysis sub-server of the cloud computing platform is provided with any one or more of an image capturing software system, a data retrieval software system, a data comparison analysis software system and an image data processing software system.
It should be noted that the field data collecting terminal 5 includes a carrying shell 51, a communication port 52, a power connection port 53, a monitoring camera 54, a microphone 55, a temperature and humidity sensor 56, an illumination lamp 57, a brightness sensor 58, a data transmission circuit 59, and an operation driving circuit 50, wherein at least two carrying shells 51 are provided, the data transmission circuit 59 is provided in at least one carrying shell 51, and a plurality of communication ports 52 and one communication port are provided on an outer side surface of the carrying shell 51 where the data transmission circuit 59 is located, each communication port 52 is connected to the data transmission circuit 59, the data transmission circuit 59 is further electrically connected to the power connection port 53, the operation driving circuit 50 is located in another carrying shell 51, the outer surface of the carrying shell 51 corresponding to the operation driving circuit 50 is provided with at least one power connection port 53, at least one temperature and humidity sensor 56, at least one illumination lamp 57, and at least one microphone 55, a monitoring camera 54 and at least one brightness sensor 58 are arranged on the upper end surface of the bearing shell 51 where the operation driving circuit 50 is located, the axis of the monitoring camera 58 and the front end surface and the upper end surface of the bearing shell 51 are respectively at 0-90 degrees, the illuminating lamp 57 and the temperature and humidity sensor 56 are embedded on the outer side surface of the bearing shell 51 and uniformly distributed around the axis of the bearing shell 51, the optical axes of the illuminating lamp 57 and the temperature and humidity sensor 56 are vertically distributed with the outer side surface of the bearing shell 51, the microphone 55 is embedded on the front end surface of the bearing shell 51, the power supply connecting port 53 is positioned on the rear end surface of the bearing shell 51, 1-4 communication ports 52 are additionally arranged on the rear end surface of the bearing shell 51, each power supply connecting port 530 and each communication port 52 are electrically connected with the operation driving circuit 50, and the operation driving circuit 50 is additionally electrically connected with the monitoring camera 54, the microphone 55, the temperature and humidity sensor 56, the illuminating lamp 57, the brightness sensor 58 is electrically connected, the power connection port 53 of the carrying shell 51 where the data transmission circuit 59 is located is electrically connected with one of the power connection ports 53 at the back end face of the carrying shell 51 where the operation driving circuit 50 is located through a conducting wire, and meanwhile, the communication port 52 of the carrying shell 51 where the operation driving circuit 50 is located is in data connection with one of the communication ports 52 of the carrying shell 51 where the data transmission circuit 59 is located through a data wire.
Meanwhile, the outer side surface of the bearing shell 51 is provided with a plurality of connecting sliding grooves 511 which are vertically distributed with the upper end surface and the lower end surface of the bearing shell, the connecting sliding grooves 511 of two adjacent bearing shells 51 are mutually connected through connecting strips 512, each bearing shell 51 is distributed from top to bottom along the vertical direction, the bearing shell 51 where the driving circuit 50 operates simultaneously is positioned at the top, the bottom of each bearing shell 51 is provided with at least four elastic cushion blocks 513 uniformly distributed around the midpoint of the lower end surface of each bearing shell, and the two adjacent bearing shells 51 are abutted through the elastic cushion blocks 513.
In addition, the monitoring camera 54 is any one or two of a CCD camera and a 3D scanning camera, the monitoring camera 54 is hinged to the upper end surface of the bearing shell 51 through a three-dimensional turntable mechanism 541, at least one angle sensor 542 is arranged on the three-dimensional turntable mechanism 541, and both the three-dimensional turntable mechanism 541 and the angle sensor 542 are electrically connected to the operation driving circuit 50.
The data connection and the electrical connection between systems are realized through the arranged communication port and the power supply connection port, and meanwhile, the data connection and the power supply connection between the external equipment can be realized;
simultaneously in operation:
monitoring the camera: carrying out video signal acquisition, image shooting acquisition and image information capturing identification on the surrounding environment of the operation position of the data source equipment and the working state of personnel;
a microphone: collecting audio signals at the running position of data source equipment, and collecting and judging equipment noise when the working state of a worker is collected through the audio signals;
temperature and humidity sensor: collecting environmental data of temperature and humidity at the operation position of data source equipment to realize the collection of the influence state data of environmental temperature and humidity change on the operation state of the equipment;
light, luminance sensor: the monitoring camera light source is matched with each other, so that the environment lighting conditions of the monitoring camera during operation are identified and supplemented, and the image information acquisition quality of the monitoring camera is improved.
In this embodiment, the operation driving circuit 50 includes a data processing circuit based on any one of a DSP chip and an FPGA chip, an MOS driving circuit, a multi-path voltage-stabilized power supply circuit, and a crystal oscillator clock circuit, the data processing circuit is electrically connected to the multi-path voltage-stabilized power supply circuit and the crystal oscillator clock circuit through the MOS driving circuit, and the MOS driving circuit is electrically connected to the communication port 52, the power connection port 53, the monitoring camera 54, the microphone 55, the temperature and humidity sensor 56, the illuminating lamp 57, and the brightness sensor 58, and is electrically connected to the data transmission circuit 59 through the power connection port 53 and the communication port 52.
As shown in fig. 3, a method for managing a data quality management system based on scene analysis includes the following steps:
s1, system construction, namely firstly constructing a data quality management server based on scene analysis, assembling the data quality management server based on the scene analysis, an operation terminal, a data storage server and at least one communication gateway in a control room, then assembling each field data acquisition terminal and a corresponding network switch at the position of a corresponding to-be-detected data source, establishing data connection between the field data acquisition terminal and the to-be-detected data source, finally establishing data connection for the data quality management server based on the scene analysis, the data storage server, the communication gateway, the network switch, the field data acquisition terminal and the operation terminal through the communication network, allocating independent data addressing addresses for the data storage server, the communication gateway, the network switch, the field data acquisition terminal and the operation terminal through the data quality management server based on the scene analysis, and establishing data connection between the data quality management server based on the scene analysis and an external communication network connected with the to-be-detected data source through the communication gateway;
s2, data acquisition, namely after the step S1 is completed, on one hand, the field data acquisition terminal continuously acquires network communication data at a data source to be detected through a communication port at regular intervals, transmits the acquired data to a data quality management server based on scene analysis and temporarily stores the acquired data in a data storage server; on the other hand, environmental state data of a data source to be detected during operation are synchronously collected through a monitoring camera, a microphone, a temperature and humidity sensor and a brightness sensor, and then the collected environmental data are transmitted to a data quality management server based on scene analysis together and are temporarily stored in a data storage server; finally, the data quality management server for scene analysis synchronously acquires network data from the data acquired from the external communication network directly in the same time period and temporarily stores the network data in the data storage server
S3, comparing and analyzing data, namely comparing and analyzing the network communication data, the environmental state data and the data obtained by an external communication network in a centralized manner by a data analysis sub-server based on a cloud computing platform of a data quality management server based on scene analysis, so as to obtain data at the position of a data source and judge the attenuation and loss of the data transmitted by the network, obtain the data quality analysis result of the current time period, store the data quality analysis result of the current time period in a data storage server, analyze the data of each time period in sequence according to the time sequence, and finally perform subsequent secondary analysis on the analysis result of the data of each time period, so that the quality condition of the current network data can be obtained, and the analysis results are respectively output through an operation terminal;
s4, intelligently analyzing, namely continuously tracking and synchronously simulating the operation process of the data analysis sub-server based on the cloud computing platform by the deep learning simulation sub-server of the data quality management server based on scene analysis when the data analysis of the step S3 is carried out, so that on one hand, the current network data analysis judgment logic is obtained; and on the other hand, a current network data quality fluctuation rule is obtained, then the network data analysis judgment logic and the network data quality fluctuation rule are fed back to the data analysis sub-server based on the cloud computing platform, and the data analysis result of the data analysis sub-server based on the cloud computing platform is verified.
The invention has the advantages of simple system structure, strong system operation maintenance and expansion capability, high data sampling, detection and evaluation operation efficiency and precision, high data analysis operation efficiency and high data analysis intelligent degree, and effectively introduces the equipment operation scene as reference in the data analysis process, thereby effectively improving the data quality analysis efficiency and precision.
The foregoing shows and describes the general principles and broad features of the present invention and advantages thereof. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are described in the specification and illustrated only to illustrate the principle of the present invention, but that various changes and modifications may be made therein without departing from the spirit and scope of the present invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.

Claims (8)

1. The data quality management system based on the scene analysis is characterized by comprising a data quality management server based on the scene analysis, a data storage server, communication gateways, network switches, field data acquisition terminals and control terminals, wherein the data quality management server based on the scene analysis is in data connection with at least one communication gateway through a communication network, the communication gateways are in data connection with the data storage server, the at least one control terminal and the network switches through the communication network, the network switches are in data connection with the field data acquisition terminals through the communication network, and the field data acquisition terminals are distributed at the positions of data sources and are in data connection with data source equipment through the communication network.
2. The data quality management system based on scene analysis according to claim 1, wherein the data quality management server based on scene analysis is a system with a big data computing system as a bottom service platform, and is further provided with at least one data analysis sub-server based on a cloud computing platform and at least one deep learning simulation sub-server, and the data analysis sub-server based on the cloud computing platform and the deep learning simulation sub-server are mutually connected through a communication gateway and are further connected with the data quality management server based on scene analysis and the data storage server through the communication gateway.
3. The data quality management system based on scene analysis according to claim 2, wherein the deep learning simulation sub-server is provided with an artificial neural network service platform based on a BP neural network system, an LSTM time series neural network system and a CNN neural network system; the data analysis sub-server of the cloud computing platform is provided with any one or more of an image capturing software system, a data retrieval software system, a data comparison analysis software system and an image data processing software system.
4. The data quality management system based on scene analysis according to claim 1, wherein the field data collection terminal comprises at least two carrier cases, at least one of the carrier cases is provided with a data transmission circuit, the outer side of the carrier case where the data transmission circuit is located is provided with a plurality of communication ports and one communication port, each communication port is connected with the data transmission circuit, the data transmission circuit is further electrically connected with the power connection port, the operation driving circuit is located in the other carrier case, the outer surface of the carrier case corresponding to the operation driving circuit is provided with at least one power connection port, at least one temperature and humidity sensor, at least one microphone and at least one illuminating lamp, the microphone is embedded in the front end face of the bearing shell, the power supply connecting port is located at the rear end face of the bearing shell, 1-4 communication ports are additionally arranged on the rear end face of the bearing shell, the power supply connecting port and the communication ports are electrically connected with the operation driving circuit, the operation driving circuit is electrically connected with the monitoring camera, the microphone, the temperature and humidity sensor, the illuminating lamp and the brightness sensor, and the power supply connecting port of the bearing shell where the data transmission circuit is located is electrically connected with one of the power supplies at the rear end face of the bearing shell where the operation driving circuit is located through a lead wire The connection ports are electrically connected, and meanwhile, the communication port of the bearing shell where the driving circuit is located is operated to establish data connection with one communication port of the bearing shell where the data transmission circuit is located through a data line.
5. The data quality management system based on the scene analysis according to claim 4, wherein the outer side of the bearing shell is provided with a plurality of connecting sliding grooves which are vertically distributed on the upper end surface and the lower end surface of the bearing shell, the connecting sliding grooves of two adjacent bearing shells are connected with each other through connecting strips, the bearing shells are vertically distributed from top to bottom, the bearing shell where the operating driving circuit is located at the top, the bottom of each bearing shell is provided with at least four elastic cushion blocks which are uniformly distributed around the midpoint of the lower end surface, and the two adjacent bearing shells are abutted through the elastic cushion blocks.
6. The data quality management system based on the scene analysis according to claim 4, wherein the monitoring camera is shared by any one or two of a CCD camera and a 3D scanning camera, the monitoring camera is hinged with the upper end face of the bearing shell through a three-dimensional turntable mechanism, at least one angle sensor is arranged on the three-dimensional turntable mechanism, and the three-dimensional turntable mechanism and the angle sensor are both electrically connected with the operation driving circuit.
7. The data quality management system based on the scene analysis according to claim 4, wherein the operation driving circuit comprises a data processing circuit based on any one of a DSP chip and an FPGA chip, an MOS driving circuit, a multi-path voltage-stabilized power supply circuit and a crystal oscillator clock circuit, the data processing circuit is electrically connected with the multi-path voltage-stabilized power supply circuit and the crystal oscillator clock circuit through the MOS driving circuit, and the MOS driving circuit is electrically connected with the communication port, the power supply connection port, the monitoring camera, the microphone, the temperature and humidity sensor, the illuminating lamp and the brightness sensor and is electrically connected with the data transmission circuit through the power supply connection port and the communication port.
8. The method for managing a scene-analysis-based data quality management system according to claim 1, wherein the method for managing the scene-analysis-based data quality management server comprises the following steps:
s1, system construction, namely firstly constructing a data quality management server based on scene analysis, assembling the data quality management server based on the scene analysis, an operation terminal, a data storage server and at least one communication gateway in a control room, then assembling each field data acquisition terminal and a corresponding network switch at the position of a corresponding data source to be detected, establishing data connection between the field data acquisition terminal and the data source to be detected, finally establishing data connection between the data quality management server based on the scene analysis, the data storage server, the communication gateway, the network switch, the field data acquisition terminal and the operation terminal through a communication network, allocating independent data addressing addresses for each data storage server, the communication gateway, the network switch, the field data acquisition terminal and the operation terminal through the data quality management server based on the scene analysis, and establishing data connection between the data quality management server based on the scene analysis and an external communication network connected with the data source to be detected through the communication gateway;
s2, data acquisition, namely after the step S1 is completed, on one hand, the field data acquisition terminal continuously acquires network communication data at a data source to be detected through a communication port at regular intervals, transmits the acquired data to a data quality management server based on scene analysis and temporarily stores the acquired data in a data storage server; on the other hand, environmental state data of a data source to be detected during operation are synchronously collected through a monitoring camera, a microphone, a temperature and humidity sensor and a brightness sensor, and then the collected environmental data are transmitted to a data quality management server based on scene analysis and are temporarily stored in a data storage server; finally, the data quality management server for scene analysis synchronously acquires network data from the data acquired from the external communication network directly in the same time period and temporarily stores the network data in the data storage server
S3, comparing and analyzing data, namely comparing and analyzing the network communication data, the environmental state data and the data obtained by an external communication network in a centralized manner by a data analysis sub-server based on a cloud computing platform of a data quality management server based on scene analysis, so as to obtain data at the position of a data source and judge the attenuation and loss of the data transmitted by the network, obtain the data quality analysis result of the current time period, store the data quality analysis result of the current time period in a data storage server, analyze the data of each time period in sequence according to the time sequence, and finally perform subsequent secondary analysis on the analysis result of the data of each time period, so that the quality condition of the current network data can be obtained, and the analysis results are respectively output through an operation terminal;
s4, intelligently analyzing, namely continuously tracking and synchronously simulating the operation process of the data analysis sub-server based on the cloud computing platform by the deep learning simulation sub-server of the data quality management server based on scene analysis when the data analysis of the step S3 is carried out, so that on one hand, the current network data analysis judgment logic is obtained; and on the other hand, a current network data quality fluctuation rule is obtained, then the network data analysis judgment logic and the network data quality fluctuation rule are fed back to the data analysis sub-server based on the cloud computing platform, and the data analysis result of the data analysis sub-server based on the cloud computing platform is verified.
CN202211234931.9A 2022-10-10 2022-10-10 Data quality management system based on scene analysis Active CN115499337B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211234931.9A CN115499337B (en) 2022-10-10 2022-10-10 Data quality management system based on scene analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211234931.9A CN115499337B (en) 2022-10-10 2022-10-10 Data quality management system based on scene analysis

Publications (2)

Publication Number Publication Date
CN115499337A true CN115499337A (en) 2022-12-20
CN115499337B CN115499337B (en) 2023-04-18

Family

ID=84473617

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211234931.9A Active CN115499337B (en) 2022-10-10 2022-10-10 Data quality management system based on scene analysis

Country Status (1)

Country Link
CN (1) CN115499337B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116346840A (en) * 2023-04-17 2023-06-27 南京埃尔乔亿自控设备有限公司 Data analysis management system and method under multi-server scene
CN116545750A (en) * 2023-06-06 2023-08-04 江苏意宏科技有限公司 Network security data analysis system and method based on big data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103209501A (en) * 2013-04-16 2013-07-17 杭州三云科技有限公司 Kiln smoke detecting system based on wireless sensor network
CN103647686A (en) * 2013-12-19 2014-03-19 北京伊神华虹系统工程技术有限公司 Data monitoring and management system and method
JP2014064121A (en) * 2012-09-20 2014-04-10 Oki Electric Ind Co Ltd Data collection system, data collection method, neighbor information management server, gateway device, sensor node, monitoring server, and program
CN107241400A (en) * 2017-05-26 2017-10-10 河南职业技术学院 A kind of industrial zone information interaction system based on Internet of Things
CN112291369A (en) * 2020-12-28 2021-01-29 南京斯酷环境科技有限公司 Environment-friendly remote online data monitoring system and method based on Internet

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014064121A (en) * 2012-09-20 2014-04-10 Oki Electric Ind Co Ltd Data collection system, data collection method, neighbor information management server, gateway device, sensor node, monitoring server, and program
CN103209501A (en) * 2013-04-16 2013-07-17 杭州三云科技有限公司 Kiln smoke detecting system based on wireless sensor network
CN103647686A (en) * 2013-12-19 2014-03-19 北京伊神华虹系统工程技术有限公司 Data monitoring and management system and method
CN107241400A (en) * 2017-05-26 2017-10-10 河南职业技术学院 A kind of industrial zone information interaction system based on Internet of Things
CN112291369A (en) * 2020-12-28 2021-01-29 南京斯酷环境科技有限公司 Environment-friendly remote online data monitoring system and method based on Internet

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
王忠文;刘志芳;: "基于云技术的电力数据采集与管理终端系统" *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116346840A (en) * 2023-04-17 2023-06-27 南京埃尔乔亿自控设备有限公司 Data analysis management system and method under multi-server scene
CN116346840B (en) * 2023-04-17 2023-11-24 南京埃尔乔亿自控设备有限公司 Data analysis management system and method under multi-server scene
CN116545750A (en) * 2023-06-06 2023-08-04 江苏意宏科技有限公司 Network security data analysis system and method based on big data

Also Published As

Publication number Publication date
CN115499337B (en) 2023-04-18

Similar Documents

Publication Publication Date Title
CN115499337B (en) Data quality management system based on scene analysis
CN110784511B (en) Intelligent street lamp system based on edge internet of things agent
CN112418194B (en) Video monitoring system and method for intelligent community
CN113037620B (en) Intelligent edge computing gateway
CN111985352B (en) AI front-end substation inspection video real-time identification method and system
CN110807460B (en) Transformer substation intelligent patrol system based on image recognition and application method thereof
CN105049814A (en) Method and system for monitoring motion track of analyst
CN112437165A (en) Remote monitoring type real-time monitoring system and method for detection workflow
KR101907349B1 (en) Manufacturing machine remote management system using optical image sensing and smart technology
CN205961333U (en) Cell -phone camera module multimode while testing of group device
CN105301524A (en) Server indicating lamp monitoring system and method
CN112383752A (en) Visual monitoring system of electric power computer lab
CN111783727A (en) Automatic meter reading method and system based on machine vision and edge computing technology
CN109194916B (en) Movable shooting system with image processing module
CN112966552B (en) Routine inspection method and system based on intelligent identification
CN107610260B (en) Intelligent attendance system and attendance method based on machine vision
CN206977764U (en) A kind of public classroom illumination intelligence control system of colleges and universities
CN112615435A (en) State monitoring system, method and server
CN115442739B (en) Temporary communication processing method and device for subway construction, electronic equipment and medium
CN105916278A (en) Video positioning-based control device and operating method therefor
CN115665682A (en) Wireless data acquisition and video monitoring system and method based on 5G Internet of things
KR20200045058A (en) smart sensing and monitoring system of risk detection for small business to switch to smart factories, and method thereof
CN110688912A (en) IPv6 cloud interconnection-based online face search positioning system and method
CN113705952A (en) Intelligent building management and control system based on field information
CN209845008U (en) Cluster monitoring system based on system on chip

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant