CN112327777A - Data acquisition system and method - Google Patents
Data acquisition system and method Download PDFInfo
- Publication number
- CN112327777A CN112327777A CN202011269708.9A CN202011269708A CN112327777A CN 112327777 A CN112327777 A CN 112327777A CN 202011269708 A CN202011269708 A CN 202011269708A CN 112327777 A CN112327777 A CN 112327777A
- Authority
- CN
- China
- Prior art keywords
- data
- server
- data acquisition
- monitoring
- converter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
- G05B19/4183—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM] characterised by data acquisition, e.g. workpiece identification
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/31—From computer integrated manufacturing till monitoring
- G05B2219/31282—Data acquisition, BDE MDE
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention provides a data acquisition system and a data acquisition method. The data acquisition system and the method realize data acquisition and configuration through the BS mode, and a user can access data under the condition of network intercommunication with the server, so that the problem of single fault is avoided, read-write separation is realized, and the pressure of a main node is reduced. Meanwhile, the system also supports the collection of a general protocol and various statistical reports, and can meet the requirements of more clients.
Description
Technical Field
The invention relates to the field of industrial control systems, in particular to a data acquisition system and a data acquisition method.
Background
Energy infrastructures such as power grids are typically driven by multi-stage control systems that observe system conditions and respond to reach local stable operating points. The integration of network control systems with other networks makes them vulnerable to various kinds of damage, malicious attacks, and network threats. For example, power utility companies often use communication networks and software applications to keep the amount of power generated within a range that meets demand. However, communication networks and software applications are vulnerable to network attacks, which have proven to be able to disable critical controllers and cause highly disruptive power interruptions. Long-term failure of critical systems in the power grid, water/wastewater, public health, transportation, banking and industry can stop economic activities, cause confusion, and spread life-threatening safety hazards. Accordingly, there is a need to develop a secure and resilient monitoring system that can protect infrastructure system assets and critical functions and can help those system assets and critical functions survive and recover quickly from interruptions. The computer-based production process control and scheduling automation system can monitor and control on-site operating equipment so as to realize various functions of data acquisition, equipment control, measurement, parameter adjustment, various signal alarms and the like. However, most of the existing systems are based on a C/S (Client-Server) architecture, although the processing capability of a Client computer can be fully exerted, and many jobs can be submitted to a Server after being processed by the Client, so the Client response speed is high, but a special Client installation program is required, the distribution function is weak, rapid deployment, installation and configuration cannot be realized for a user group with multiple points and wide range and without network conditions, the development and maintenance costs are high, the system can be completed only by technical personnel with certain professional levels, and once upgrading occurs, and then the programs of all the clients need to be changed.
Moreover, all real-time data in the existing system are stored in the same database and data table, once a large number of point locations exist, reading and writing of a large amount of data can occur, and at the moment, the refreshing of the real-time data of the page can be delayed for a long time. Meanwhile, due to the limited configuration function, the realized report and analysis functions are limited, and sometimes the requirements of customers cannot be met.
Disclosure of Invention
In order to solve the above problems in the prior art, the technical solution provided by the embodiment of the present application is as follows:
a method of data acquisition comprising the steps of:
configuring a monitoring server ID, a data converter ID and a storage node ID in the control server 1, wherein the ID represents a device unique identification code;
the database cluster master node 31 acquires the ID of the monitoring server and the ID of the storage node from the configuration management system, sorts the storage nodes according to the IDs, numbers the storage nodes from 1, and acquires the number n of the storage nodes;
the database cluster master node 31 acquires the IDs of all the monitoring servers from the control server 1, and maps the IDs of the monitoring servers and the number n of storage nodes;
a parameter setting module 21 in the server 2 sets data acquisition parameters and stores the parameters into a configuration file; the data acquisition parameters include: monitoring period, data converter ID, mapping relation between ID of monitoring server and number of storage nodes, address of equipment to be monitored, detection item of each equipment and standard value of each detection item;
the control server 1 inquires the configuration file configured in the monitoring server 2, monitors ports of different protocols at the same time, and acquires data information according to the corresponding data converter ID if connection can be successfully established;
the data information acquisition method comprises the following steps:
the instruction sending module 22 selects a corresponding communication protocol from the unified communication interfaces according to the port type of the data converter 6 every other monitoring period, and sends a data acquisition instruction to the sensor 7 through the data converter 6;
after receiving the data acquisition instruction transmitted by the data converter 6, the sensor 7 acquires data corresponding to each item to be monitored detected of the equipment according to the data acquisition parameters contained in the instruction, and then returns the acquired data to the monitoring server 2 through the data converter 6;
the data analysis module 23 selects a corresponding data transmission protocol from the unified data transmission protocol interface according to the type of the device to be monitored, and receives the collected data transmitted back by the data converter 6; the data analysis module 23 judges whether the acquired data is abnormal according to the standard value of each detection item set by the parameter setting module 21; if the data collected by each detection item is within the range of the standard value, the collected data is judged to meet the requirements, otherwise, the collected data is judged to be abnormal, and the alarm module 25 sends alarm information to the control server 1 and the user terminal 5.
According to one aspect of the invention, the data converter ID includes one of a register address, an IP address, and a port number.
According to an aspect of the present invention, the data analysis module 23 further checks the collected data, if the check fails, the data analysis module 23 discards the collected data, and if the check succeeds, the data storage module 24 selects a corresponding data storage protocol from the unified data storage interface according to the type of the device to be monitored, and stores the collected data in the local database of the monitoring server 2 and the database server cluster 3.
According to one aspect of the invention, the communication protocol comprises an RS232/485 protocol, a TCP/IP protocol, a Modbus data transmission protocol, an OPC data transmission protocol and an MQTT data transmission protocol, and the data acquisition command comprises the address of the device to be monitored and the detection item of each device.
A data acquisition system comprising: the system comprises a control server 1, a database server cluster 3, a network server 4, a user side 5 and at least one monitoring component 8; the monitoring component comprises a monitoring server 2, at least one data converter 6 and at least one sensor 7; the monitoring server 2 is connected with the control server 1, the database server cluster 3, the network server 4 and the data converter 6 through a network, and the data converter 6 is connected with at least one sensor 7 through a serial port; the monitoring server 2 comprises a parameter setting module 21, an instruction sending module 22, a data analysis module 23, a data storage module 24 and an alarm module 25; the parameter setting module 21 is configured to set data acquisition parameters and store the data acquisition parameters into a configuration file; the database cluster master node 31 acquires the IDs of all the monitoring servers from the control server 1, and maps the IDs of the monitoring servers and the number n of storage nodes; a parameter setting module 21 in the server 2 sets data acquisition parameters and stores the parameters into a configuration file; the data acquisition parameters include: monitoring period, data converter ID, mapping relation between ID of monitoring server and number of storage nodes, address of equipment to be monitored, detection item of each equipment and standard value of each detection item; the instruction sending module 22 is configured to select a corresponding communication protocol from the unified communication interfaces according to the type of the device to be monitored every other monitoring period, and send a data acquisition instruction to the sensor 7 through the data converter 6; the data analysis module 23 is configured to select a corresponding data transmission protocol from the unified data transmission protocol interfaces according to the type of the device to be monitored, receive the collected data sent back by the data converter 6, and check the collected data.
According to one aspect of the invention, the data acquisition parameters include: monitoring period, address of the equipment to be monitored, detection item of each equipment and standard value of each detection item.
According to an aspect of the present invention, the data analysis module 23 is further configured to determine whether the collected data is abnormal according to the standard value of each detection item set by the parameter setting module 21.
According to an aspect of the present invention, the alarm module 25 is configured to send alarm information to the control server 1 and the user terminal 5 when the data analysis module 23 determines that the collected data is abnormal.
According to one aspect of the invention, said sensor 7 is of the type of any one of a temperature sensor, a humidity sensor, a flow sensor, a pressure sensor.
A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the data acquisition method.
Compared with the prior art, the invention has the following beneficial effects: the data acquisition system and the method realize data acquisition and configuration through the BS mode, and a user can access data under the condition of network intercommunication with the server, so that the problem of single fault is avoided, read-write separation is realized, and the pressure of a main node is reduced. Meanwhile, the system also supports the collection of a general protocol and various statistical reports, and can meet the requirements of more clients.
Drawings
FIG. 1 is a diagram of the hardware architecture of a preferred embodiment of the data acquisition system of the present invention;
fig. 2 is a functional block diagram of the monitoring server according to the present invention.
Detailed Description
The technical solution of the present invention is described in detail below with reference to the accompanying drawings and the detailed description.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.
Fig. 1 is a diagram showing a hardware architecture of a preferred embodiment of the data acquisition system of the present invention. The system mainly comprises a control server 1, a database server cluster 3, a network server 4, a user terminal 5 and at least one monitoring component 8. The monitoring component comprises a monitoring server 2, at least one data converter 6, at least one sensor 7. The monitoring server 2 is connected with the control server 1, the database server cluster 3, the network server 4 and the data converter 6 through a network, and the data converter 6 is connected with at least one sensor 7 through a serial port (such as an RS485 interface).
The user terminal 5 accesses the network server 4 through a Web webpage, data is inquired from the database server cluster 3, and the control server 1 is used for instantly displaying data and alarm information and the like acquired by the monitoring server 2. The system adopts a B/S (Browser/Server) architecture, has strong distributivity and zero maintenance of the client. If a network and a browser exist, business processing such as inquiry, browsing and the like can be carried out at any time and any place. Browser-server users can access data under the condition of network intercommunication with the server, and meanwhile, the system also supports the collection of general coordination, which is the development direction of the current application system. The BS is an improvement of the C/S architecture along with the rise of the Internet technology, and is specially called as a B/S mode in order to be distinguished from the traditional C/S mode. Under the structure, a work interface is entered through a W3 Browser, a few parts of business logic are realized in a front end (Browser), and main business logic is realized in a Server end (Server), so that a three-layer (3-tier) structure is formed. This greatly simplifies the client computer load (hence the term thin client), reduces the overhead costs of system maintenance and upgrades, and reduces the Total Cost (TCO) for the user. The BS has the main characteristics of strong distributivity, convenient maintenance, simple development, strong sharing property and low total ownership cost. The invention realizes data acquisition and configuration and various statistical reports through the BS mode, and can meet the requirements of more customers.
The database server cluster 3 comprises a master node 31 and at least one storage node. The storage nodes presented in fig. 1 comprise a first storage node 32 and a second storage node 33. After the data in one database in the database server cluster 3 is updated, the updated data can be automatically synchronized to other databases. The master node 31 may perform read and write operations that automatically synchronize data to the storage nodes when a write operation causes a change in the data. While slave databases are typically read-only and accept data synchronized by the master node 31. The master database of one master node 31 may have a plurality of storage node databases, and one storage node database may have only one master database. The above-mentioned framework of the database server cluster 3 can avoid the problem of individual failure well, and realize the read-write separation, reduce the pressure of the master node 31.
Each sensor 7 is used to collect information of the device to be monitored. Types of sensors 7 include, but are not limited to, temperature sensors, humidity sensors, flow sensors, pressure sensors. Preferably, the sensor 7 is any one of the above-mentioned sensors.
The monitoring components 8 may be configured in a predetermined number according to the needs of the IT room. For example one monitoring component 8 is arranged for each IT room of each plant.
Database software is installed in the monitoring server 2 and used for storing the acquired data in the data storage module 24. The data storage module 24 backs up local data into the database server cluster 3 every predetermined period. At intervals, the monitoring server 2 sends data acquisition instructions to the sensors 7 via the data converter 6. The sensor 7 returns the acquired data to the monitoring server 2 through the data converter 6, and the monitoring server 2 analyzes and stores the acquired data. And if the acquired data is abnormal, sending alarm information to the control server 1 and the user terminal 5. The database software may be a relational database or a non-relational database.
The monitoring server 2 comprises a communication interface, a data transmission protocol interface, a data storage interface and the like. The communication interface packages the communication protocols of different devices together, and the different devices can be accessed through the unified communication interface. The data transmission protocol interface packages the data transmission protocols of different devices together, and the collected data of different devices can be transmitted back to the monitoring server 2 through the uniform data transmission protocol interface. The data storage interfaces package the data storage protocols of different devices together, and the collected data of different devices can be stored through the uniform data storage interface.
When the system is started, the control server 1 inquires the configuration file configured in the monitoring server 2, and monitors the ports of different protocols at the same time. If the connection can be successfully established, data information is obtained according to the corresponding data converter ID. The configuration file configured in the monitoring server 2 may be performed by:
configuring a monitoring server ID, a data converter ID and a storage node ID in the control server 1, wherein the ID represents a device unique identification code;
the control server 1 generates a system unique identification code for each monitoring server and storage node based on the network connection detection result, which is guaranteed to be unique to all machines in the same network. Alternatively, the IDs of the monitoring server, the data converters, and the storage nodes and the corresponding configuration files obtained from the topology of the hardware may be configured directly in the control server 1 by a human.
The database cluster master node 31 acquires the ID of the monitoring server 2 and the ID of the storage node from the configuration management system, sorts the storage nodes by ID, numbers the storage nodes from 1, and acquires the number n of the storage nodes. Intercepting a plurality of continuous bits of the ID of the monitoring server, calculating the numerical value of the ID according to a 16-system, mapping the numerical value and the number of the storage node, and distributing the monitoring server to the corresponding storage node according to the mapping result.
After allocating the monitoring servers to the storage nodes according to the mapping relationship between the monitoring servers and the storage nodes, the database cluster master node 31 acquires the IDs of all the monitoring servers from the control server 1, and maps the IDs of the monitoring servers and the number n of the storage nodes. The database cluster master node 31 accordingly completes the assignment of all the monitoring servers.
The database cluster master node 31 redistributes the monitoring servers 2 according to the running state of the storage nodes; the database cluster master node 31 needs to monitor the operating status of the storage nodes (e.g., the first storage node 32, the second storage node 33), and the database cluster master node 31 monitors whether the storage nodes are online through heartbeat.
When the storage node is down, the heartbeat between the database cluster main node 31 and the storage node is abnormal, and at this time, the database cluster main node 31 starts a monitoring server redistribution process. The current residual storage nodes are sequenced, and then the storage nodes are remapped according to the ID of each monitoring server and are redistributed.
When the storage node resumes operation, the heartbeat between the database cluster master node 31 and the storage node resumes, and at this time, the database cluster master node 31 also starts the monitoring server reallocation process. The redistribution process is the same as the redistribution process when the system is down.
When the system needs to add a storage node, the control server 1 notifies the database cluster owner node 31 of the newly added storage node information, and the database cluster owner node 31 starts a monitoring server reallocation process. The redistribution process is identical to the process described above.
The data converter ID in the configuration file comprises one of a register address, an IP address and a port number. Can be flexibly configured according to the types of different protocols, such as:
a) modbus TCP protocol:
monitoring the IP +502 port of the data converter, if the connection can be successfully established, acquiring corresponding original data according to the configured register address, data type and data length, calculating and analyzing the acquired original data according to the service requirement, and finally storing the acquired original data into a database, so that the value can be quickly inquired on a monitoring page.
For example:
HOST:127.0.0.1
port 502
40001 of register address coding;
MODBUS function code: 3
And (4) slave station address: 1
Data type: float
Whether to reverse: whether or not
b) OPC protocol:
if the connection can be successfully established according to the IP, the port and the domain of the opposite side in the configuration, corresponding original data is obtained according to the configured tag name, and the obtained original data is calculated, analyzed and finally stored according to the service requirement, and is also stored in a database, so that the value can be quickly inquired on a monitoring page.
For example:
HOST:127.0.0.1
Domain：””
User：admin
password: ab123456
Tag:moni1.test1.k1
c) MQTT protocol:
monitoring is carried out according to the IP, the port, the user name, the password, the client ID and the theme of the opposite side in the configuration, if equipment uploads, the monitoring is received in a callback, corresponding original data is obtained according to the configured tag name, the obtained original data is calculated, analyzed and finally stored according to the service requirement, and meanwhile, the obtained original data is also stored in a database, so that the value can be rapidly inquired on a monitoring page.
For example:
HOST:127.0.0.1
port: 8038
User：admin
Password: ab123456
Test client name
subject-testTopic
In the configuration file, each monitoring server and each storage node have a unique identification ID. During system initialization, the storage management node relatively equally distributes data points to each storage node according to a distribution algorithm. The allocation algorithm may be any existing load balancing algorithm. If the storage node is down in the system operation process, the database cluster main node 31 redistributes the data points shared by the node to other storage nodes which normally operate according to the mapping relation between the ID of the monitoring server and the number of the storage nodes; the system adopts an ID-based allocation algorithm, thereby greatly reducing manual operation, having stronger self-adaptability and improving the working efficiency of the whole system.
Referring to fig. 2, a functional block diagram of the monitoring server 2 shown in fig. 1 is shown. The monitoring server 2 comprises a parameter setting module 21, an instruction sending module 22, a data analysis module 23, a data storage module 24 and an alarm module 25. The parameter setting module 21 is configured to set data acquisition parameters and store the parameters as a configuration file. The data acquisition parameters include: the monitoring period, the ID of the data converter, the mapping relation between the ID of the monitoring server and the number of the storage nodes, the address of the equipment to be monitored, the detection item of each equipment, the standard value of each detection item and the like. For example, if the device to be monitored is an air conditioner compressor, and the detection items are the temperature, the pressure and the flow rate of the air conditioner compressor, the temperature, the pressure and the flow rate of the air conditioner compressor will be acquired each time data of the air conditioner compressor is collected.
The instruction sending module 22 is configured to select a corresponding communication protocol from the unified communication interfaces according to the type of the device to be monitored every other monitoring period, and send a data acquisition instruction to the sensor 7 through the data converter 6. For example, if the device to be monitored is an air conditioner compressor and the monitoring period is 5 seconds, the instruction sending module 22 selects an RS232/485 communication protocol every 5 seconds, and sends a data acquisition instruction to the sensor 7 through the data converter 6. The data acquisition instruction comprises the address of the equipment to be monitored, the detection item of each equipment and the like. The data converter 6 is configured to convert the format of the data acquisition command into a format recognizable by the sensor 7, i.e., in this embodiment, converting the TCP/IP format into the RS485 format.
After receiving the data acquisition instruction transmitted by the data converter 6, the sensor 7 acquires data corresponding to each item to be monitored detected of the device according to the data acquisition parameters contained in the instruction, and then returns the acquired data to the monitoring server 2 through the data converter 6. The data converter 6 is configured to convert the data collected by the sensor 7 into a format that can be recognized by the monitoring server 2, in this embodiment, the RS485 format is converted into a TCP/IP format.
The data analysis module 23 is configured to select a corresponding data transmission protocol from the unified data transmission protocol interfaces according to the type of the device to be monitored, receive the collected data sent back by the data converter 6, and check the collected data. For example, if the device to be monitored is an air conditioner compressor, the data analysis module 23 selects a Modbus data transmission protocol to receive the collected data sent back by the data converter 6.
The data analysis module 23 checks the acquired data by: and judging whether the acquired data meets the requirements of the selected data transmission protocol. For example, the Modbus data transmission protocol specifies that the beginning of the data is 1 or 3, and if the beginning of the collected data returned by the data converter 6 is not 1 or 3, the verification fails, and the data analysis module 23 will discard the collected data.
If the data analysis module 23 successfully verifies the collected data, the data storage module 24 selects a corresponding data storage protocol from the unified data storage interface according to the type of the device to be monitored, and stores the collected data in the local database of the monitoring server 2 and the database server cluster 3. For example, if the data storage protocol is an XML (Extensible Markup Language) protocol, the data storage module 24 selects the XML data storage protocol and stores the collected data as an XML file. The successful verification of the acquired data by the data analysis module 23 means that: the collected data meets the requirements of the selected data transmission protocol. For example, the Modbus data transmission protocol specifies that the beginning of the data is 1 or 3, and if the beginning of the collected data returned by the data converter 6 is 1 or 3, the verification is successful.
The data analysis module 23 is further configured to determine whether the acquired data is abnormal according to the standard value of each detection item set by the parameter setting module 21. And if the data collected by each detection item is within the range of the standard value, judging that the collected data meets the requirements, otherwise, judging that the collected data is abnormal. For example, assume that the parameter setting module 21 sets the temperature standard value to-10 ℃ -40 ℃, and if the acquired temperature value is 42 ℃, it is determined that the monitored device temperature value is abnormal.
The alarm module 25 is configured to send alarm information to the control server 1 and the user side 5 when the data analysis module 23 determines that the acquired data is abnormal. The alarm information includes: the address of the device to be monitored, the collected data and the like with the abnormality, wherein the data with the abnormality is displayed in a striking format (for example, marked as red).
The user terminal 5 can log in the network server 4 to obtain the data collected by the monitoring server 2 from the database server cluster 3.
According to the data acquisition system of the invention, a data acquisition method is also provided, which comprises the following steps:
the parameter setting module 21 sets the data acquisition parameters and stores them as a configuration file.
The data acquisition parameters include: the monitoring period, the ID of the data converter, the mapping relation between the ID of the monitoring server and the number of the storage nodes, the address of the equipment to be monitored, the detection item of each equipment, the standard value of each detection item and the like. For example, the detection items may be temperature, pressure, flow rate, and the like.
The instruction sending module 22 selects a corresponding communication protocol from the unified communication interface according to the type of the device to be monitored every other monitoring period, and sends a data acquisition instruction to the sensor 7 through the data converter 6.
The communication protocol comprises an RS232/485 protocol, a TCP/IP protocol, a Modbus data transmission protocol, an OPC data transmission protocol, an MQTT data transmission protocol and the like, and the data acquisition instruction comprises the address of the equipment to be monitored, the detection item of each equipment and the like. The data converter 6 is configured to convert the format of the data acquisition command into a format recognizable by the sensor 7, i.e., in this embodiment, converting the TCP/IP format into the RS485 format.
After receiving the data acquisition instruction transmitted by the data converter 6, the sensor 7 acquires data corresponding to each item to be monitored detected of the device according to the data acquisition parameters contained in the instruction, and then returns the acquired data to the monitoring server 2 through the data converter 6. The data converter 6 is configured to convert the data collected by the sensor 7 into a format that can be recognized by the monitoring server 2, in this embodiment, the RS485 format is converted into a TCP/IP format.
The data analysis module 23 selects a corresponding data transmission protocol from the unified data transmission protocol interface according to the type of the device to be monitored, receives the collected data returned by the data converter 6, and verifies the collected data.
For example, the data transmission protocol includes: modbus data transmission protocol, OPC data transmission protocol, MQTT data transmission protocol and the like.
The data analysis module 23 checks the acquired data by: and judging whether the acquired data meets the requirements of the selected data transmission protocol. For example, the Modbus data transmission protocol specifies that the header of the data is 1 or 3, and if the header of the collected data returned by the data converter 6 is not 1 or 3, the verification fails and the data analysis module 23 discards the collected data.
If the data analysis module 23 successfully verifies the collected data, the data storage module 24 selects a corresponding data storage protocol from the unified data storage interface according to the type of the device to be monitored, and stores the collected data in the local database of the monitoring server 2 and the database server cluster 3.
The successful verification of the acquired data by the data analysis module 23 means that: the collected data meets the requirements of the selected data transmission protocol. For example, the Modbus data transmission protocol specifies that the header of the data is 1 or 3, and if the header of the collected data returned by the data converter 6 is 1 or 3, the verification is successful.
The data analysis module 23 judges whether the collected data is abnormal according to the standard value of each detection item set by the parameter setting module 21. If the data collected by each detection item is within the range of the standard value, the collected data is judged to meet the requirements, otherwise, the collected data is judged to be abnormal, and the alarm module 25 sends alarm information to the control server 1 and the user terminal 5.
The alarm information includes: the address of the device to be monitored, the collected data and the like with the abnormality, wherein the data with the abnormality is displayed in a striking format (for example, marked as red).
After the system collects the data, the system calculates according to the rules and formulas configured in the system, and stores the calculated real-time value into the database. The reading and writing of the data are separated, so that no delay exists when the page is displayed. The user can configure the project base map in a customized manner, and data can be bound after the base map is configured, however, the system not only can display the collected real-time data, but also can perform formula configuration, for example, when the value is greater than or less than a certain value, a certain icon is displayed, the picture can be uploaded in a customized manner by the user, and for example, the sum or the maximum number of the values can be calculated after the values are selected and displayed.
After the real-time data acquisition configuration is finished, statistical analysis can be configured, most requirements can be met based on statistics built in the system, and if a user wants to expand or add displayed icons, flexible configuration can be performed in a diagram configuration function of the system.
Specifically, the following is a monitoring example after the data acquisition system of the present invention is deployed:
the environment control machine room project of a certain company needs to monitor the real-time values of temperature and humidity in IT machine rooms of various factories in the whole country in real time, needs to monitor and alarm, and needs to have the statistical analysis trend of temperature and humidity historical records.
Firstly, database software and running software need to be installed in a project server, configuration file information of the project, such as gateway server addresses, elements and gateway configuration, needs to be configured after installation, and virtual data and entity sensors are corresponding through a mapping relation.
Then, temperature and humidity sensors are installed in the factory building, then gateways are installed in each factory and configured with themes such as: LD1, ld2.. simultaneously, the information in the gateway that needs to configure the server corresponds to server IP, port, subject name, client ID, user name, password, and also needs to configure the information in the gateway that corresponds to the variable and the sensor, such as the temperature of a sensor corresponding to v1, the humidity of a sensor corresponding to v2, and the like.
At this time, the server software can acquire the values of the sensors:
{ "v 1": 21.52 "," v2 ": 75.62", "v 3": 23.42 "," v4 ": 70.65" }, and then according to the temperature of which sensor the v1 corresponds to and the humidity of which sensor the v2 corresponds to, the data can be corresponded
After the real-time data exist, a configuration function in a program is used for uploading a system background picture to display the acquired data on the system, an alarm rule is configured, and when the temperature is higher than 26 ℃, the interface number is red, and meanwhile, the system can send alarm information to related personnel in the modes of short messages, mails and the like.
In the company, as long as the network is communicated with the server, the real-time data can be accessed through the browser, and the system has the authority to only see the data configured by the administrator and can also inquire the data report corresponding to the sensor.
Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.
Claims (10)
1. A data acquisition method is characterized by comprising the following steps:
configuring a monitoring server ID, a data converter ID and a storage node ID in the control server 1, wherein the ID represents a device unique identification code;
the database cluster master node 31 acquires the ID of the monitoring server and the ID of the storage node from the configuration management system, sorts the storage nodes according to the IDs, numbers the storage nodes from 1, and acquires the number n of the storage nodes;
the database cluster master node 31 acquires the IDs of all the monitoring servers from the control server 1, and maps the IDs of the monitoring servers and the number n of storage nodes;
a parameter setting module 21 in the server 2 sets data acquisition parameters and stores the parameters into a configuration file; the data acquisition parameters include: monitoring period, data converter ID, mapping relation between ID of monitoring server and number of storage nodes, address of equipment to be monitored, detection item of each equipment and standard value of each detection item;
the control server 1 inquires the configuration file configured in the monitoring server 2, monitors ports of different protocols at the same time, and acquires data information according to the corresponding data converter ID if connection can be successfully established;
the data information acquisition method comprises the following steps:
the instruction sending module 22 selects a corresponding communication protocol from the unified communication interfaces according to the port type of the data converter 6 every other monitoring period, and sends a data acquisition instruction to the sensor 7 through the data converter 6;
after receiving the data acquisition instruction transmitted by the data converter 6, the sensor 7 acquires data corresponding to each item to be monitored detected of the equipment according to the data acquisition parameters contained in the instruction, and then returns the acquired data to the monitoring server 2 through the data converter 6;
the data analysis module 23 selects a corresponding data transmission protocol from the unified data transmission protocol interface according to the type of the device to be monitored, and receives the collected data transmitted back by the data converter 6; the data analysis module 23 judges whether the acquired data is abnormal according to the standard value of each detection item set by the parameter setting module 21; if the data collected by each detection item is within the range of the standard value, the collected data is judged to meet the requirements, otherwise, the collected data is judged to be abnormal, and the alarm module 25 sends alarm information to the control server 1 and the user terminal 5.
2. The data acquisition method according to claim 1, characterized in that: the data converter ID comprises one of a register address, an IP address and a port number.
3. The data acquisition method according to claim 1, characterized in that: the data analysis module 23 further checks the acquired data, if the check fails, the data analysis module 23 discards the acquired data, and if the check succeeds, the data storage module 24 selects a corresponding data storage protocol from the unified data storage interface according to the type of the device to be monitored, and stores the acquired data in the local database of the monitoring server 2 and the database server cluster 3.
4. The data acquisition method according to claim 1, characterized in that: the communication protocol comprises an RS232/485 protocol, a TCP/IP protocol, a Modbus data transmission protocol, an OPC data transmission protocol and an MQTT data transmission protocol, and the data acquisition instruction comprises the address of the equipment to be monitored and the detection item of each equipment.
5. A data acquisition system, comprising: the system comprises a control server 1, a database server cluster 3, a network server 4, a user side 5 and at least one monitoring component 8; the monitoring component comprises a monitoring server 2, at least one data converter 6 and at least one sensor 7; the monitoring server 2 is connected with the control server 1, the database server cluster 3, the network server 4 and the data converter 6 through a network, and the data converter 6 is connected with at least one sensor 7 through a serial port; the monitoring server 2 comprises a parameter setting module 21, an instruction sending module 22, a data analysis module 23, a data storage module 24 and an alarm module 25; the parameter setting module 21 is configured to set data acquisition parameters and store the data acquisition parameters into a configuration file; the database cluster master node 31 acquires the IDs of all the monitoring servers from the control server 1, and maps the IDs of the monitoring servers and the number n of storage nodes; a parameter setting module 21 in the server 2 sets data acquisition parameters and stores the parameters into a configuration file; the data acquisition parameters include: monitoring period, data converter ID, mapping relation between ID of monitoring server and number of storage nodes, address of equipment to be monitored, detection item of each equipment and standard value of each detection item; the instruction sending module 22 is configured to select a corresponding communication protocol from the unified communication interfaces according to the type of the device to be monitored every other monitoring period, and send a data acquisition instruction to the sensor 7 through the data converter 6; the data analysis module 23 is configured to select a corresponding data transmission protocol from the unified data transmission protocol interfaces according to the type of the device to be monitored, receive the collected data sent back by the data converter 6, and check the collected data.
6. The data acquisition system of claim 5, wherein: the data acquisition parameters include: monitoring period, address of the equipment to be monitored, detection item of each equipment and standard value of each detection item.
7. The data acquisition system of claim 5, wherein: the data analysis module 23 is further configured to determine whether the acquired data is abnormal according to the standard value of each detection item set by the parameter setting module 21.
8. The data acquisition system of claim 7, wherein: the alarm module 25 is configured to send alarm information to the control server 1 and the user side 5 when the data analysis module 23 determines that the acquired data is abnormal.
9. The data acquisition system of claim 5, wherein: the sensor 7 is any one of a temperature sensor, a humidity sensor, a flow sensor and a pressure sensor.
10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, is adapted to carry out the data acquisition method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011269708.9A CN112327777A (en) | 2020-11-13 | 2020-11-13 | Data acquisition system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011269708.9A CN112327777A (en) | 2020-11-13 | 2020-11-13 | Data acquisition system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112327777A true CN112327777A (en) | 2021-02-05 |
Family
ID=74318855
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011269708.9A Pending CN112327777A (en) | 2020-11-13 | 2020-11-13 | Data acquisition system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112327777A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114138809A (en) * | 2021-12-08 | 2022-03-04 | 纳里健康科技有限公司 | Database read-write separation method and platform |
| CN114172971A (en) * | 2021-10-22 | 2022-03-11 | 杭州鸿雁电力电气有限公司 | Gateway application system and method compatible with multiple different protocol sub-devices |
| CN114546519A (en) * | 2022-01-26 | 2022-05-27 | 华北电力大学 | Industrial control safety data acquisition system and method |
| CN114584593A (en) * | 2022-03-28 | 2022-06-03 | 中国电子科技集团公司第三十八研究所 | Data acquisition system and method based on cluster state perception |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101846985A (en) * | 2009-03-25 | 2010-09-29 | 鸿富锦精密工业（深圳）有限公司 | Remote data acquisition system and method |
| CN102737127A (en) * | 2012-06-20 | 2012-10-17 | 厦门聚海源物联网络技术有限公司 | Massive data storage method |
| CN105912678A (en) * | 2016-04-13 | 2016-08-31 | 北京思特奇信息技术股份有限公司 | Data storage method, data reading method and corresponding system |
| CN110008289A (en) * | 2019-03-01 | 2019-07-12 | 国电南瑞科技股份有限公司 | A kind of relational database, grid model data storage and search method |
| CN110765190A (en) * | 2019-09-30 | 2020-02-07 | 北京淇瑀信息科技有限公司 | Method and device for automatically expanding database cluster and electronic equipment |
-
2020
- 2020-11-13 CN CN202011269708.9A patent/CN112327777A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101846985A (en) * | 2009-03-25 | 2010-09-29 | 鸿富锦精密工业（深圳）有限公司 | Remote data acquisition system and method |
| CN102737127A (en) * | 2012-06-20 | 2012-10-17 | 厦门聚海源物联网络技术有限公司 | Massive data storage method |
| CN105912678A (en) * | 2016-04-13 | 2016-08-31 | 北京思特奇信息技术股份有限公司 | Data storage method, data reading method and corresponding system |
| CN110008289A (en) * | 2019-03-01 | 2019-07-12 | 国电南瑞科技股份有限公司 | A kind of relational database, grid model data storage and search method |
| CN110765190A (en) * | 2019-09-30 | 2020-02-07 | 北京淇瑀信息科技有限公司 | Method and device for automatically expanding database cluster and electronic equipment |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114172971A (en) * | 2021-10-22 | 2022-03-11 | 杭州鸿雁电力电气有限公司 | Gateway application system and method compatible with multiple different protocol sub-devices |
| CN114138809A (en) * | 2021-12-08 | 2022-03-04 | 纳里健康科技有限公司 | Database read-write separation method and platform |
| CN114546519A (en) * | 2022-01-26 | 2022-05-27 | 华北电力大学 | Industrial control safety data acquisition system and method |
| CN114546519B (en) * | 2022-01-26 | 2023-10-03 | 华北电力大学 | Industrial control safety data acquisition system and method |
| CN114584593A (en) * | 2022-03-28 | 2022-06-03 | 中国电子科技集团公司第三十八研究所 | Data acquisition system and method based on cluster state perception |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112327777A (en) | Data acquisition system and method | |
| US8626908B2 (en) | Distributed capture and aggregation of dynamic application usage information | |
| CN102156447B (en) | Basic automation-based plant-level equipment management and alarming system and method | |
| CN110659109B (en) | System and method for monitoring openstack virtual machine | |
| US11131972B2 (en) | Performance optimization in a building automation system | |
| CN103295155B (en) | Security core service system method for supervising | |
| WO2020151483A1 (en) | Stress testing system for internet-of-things platform, method, device, and server | |
| CN112671560A (en) | High-availability distributed real-time alarm processing method and system | |
| CN105159964A (en) | Log monitoring method and system | |
| AU2016330769A1 (en) | Monitoring of field devices via a communication network | |
| CN111242807B (en) | Method for accessing substation data into ubiquitous power Internet of things | |
| CN105335271A (en) | State monitoring apparatus and comprehensive monitoring system and method | |
| CN102571476B (en) | A kind of method and apparatus of monitoring terminal command line in real time | |
| CN104052631A (en) | Equipment information collecting method, device and system | |
| US20110099273A1 (en) | Monitoring apparatus, monitoring method, and a computer-readable recording medium storing a monitoring program | |
| CN104468274A (en) | Cluster monitor and management method and system | |
| CN114244676A (en) | Intelligent IT integrated gateway system | |
| CN107070744A (en) | Server monitoring method | |
| CN112395172A (en) | Visual display method based on application software automation monitoring data | |
| Safrianti et al. | Real-time network device monitoring system with simple network management protocol (snmp) model | |
| CN114584429A (en) | Industrial intelligent internet of things gateway | |
| CN110677293B (en) | Alarm system based on machine room operation and maintenance management platform | |
| US10554625B2 (en) | Integrated PCS functional competency assessment | |
| CN110995525A (en) | Router detection method based on maintenance matrix | |
| KR101358131B1 (en) | Method and system for managing centralized programable logic controller using simple network management protocol |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210205 |