CN116319858A - Intelligent ship Internet of things data operation and maintenance monitoring method and system - Google Patents
Intelligent ship Internet of things data operation and maintenance monitoring method and system Download PDFInfo
- Publication number
- CN116319858A CN116319858A CN202310099965.XA CN202310099965A CN116319858A CN 116319858 A CN116319858 A CN 116319858A CN 202310099965 A CN202310099965 A CN 202310099965A CN 116319858 A CN116319858 A CN 116319858A
- Authority
- CN
- China
- Prior art keywords
- data
- measuring point
- time
- internet
- things
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 52
- 238000012423 maintenance Methods 0.000 title claims abstract description 33
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000005540 biological transmission Effects 0.000 claims abstract description 76
- 238000011084 recovery Methods 0.000 claims abstract description 23
- 230000002159 abnormal effect Effects 0.000 claims abstract description 17
- 238000005259 measurement Methods 0.000 claims description 19
- 238000007689 inspection Methods 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 16
- 238000004364 calculation method Methods 0.000 abstract description 6
- 238000005516 engineering process Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000005111 flow chemistry technique Methods 0.000 description 3
- 230000005856 abnormality Effects 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
- H04L41/064—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis involving time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides an operation and maintenance monitoring method and system for intelligent ship internet of things data, which are characterized in that internet of things data uploaded by an intelligent ship are obtained, business rules of each measuring point data in the internet of things data are defined and stored in a database table, a window function calculated by real-time flow is adopted to count real-time measuring point data to be monitored according to a preset window size and a time interval, then a specific judging method is adopted to judge abnormal transmission data, when abnormal transmission is found, information is sent to a message queue to form alarm information, when the measuring point data are transmitted and recovered, a transmission recovery message of the measuring point data is sent again, finally a background business system reads the database table and consumes the message queue, the alarm message and the transmission recovery message of each measuring point data are read, and the real-time monitoring of the intelligent ship internet of things data is realized in a chart mode. The throughput capacity of the whole system is guaranteed by fully utilizing the distributed high concurrency advantage of big data calculation.
Description
Technical Field
The invention relates to the technical field of big data processing, in particular to an intelligent ship internet of things data operation and maintenance monitoring method and system.
Background
With the wide application of the internet of things, a large number of ships start to develop towards intelligence. The number of vessels in global album is 300 tens of thousands, the AIS data increment of the vessels per minute is 2W, and the vessels have data of a plurality of small fishing vessels, short barge, passenger ship records and the like, so that the vessels realize large and extensible sensor data collection and multi-channel shore data connection. Data management such as acquisition and analysis of mass data becomes the basis of high-efficiency data analysis.
The traditional offline data processing process has the problem of long processing time due to huge data volume. In addition, offline computing is a batch processing technology, a certain amount of data needs to be accumulated before each computing, and delay of data processing is high. Aiming at the business characteristics of the Internet of things of the ship, how to timely and accurately analyze and monitor the Internet of things data uploaded by the ship is a technical problem to be solved at present, so that a data operation and maintenance monitoring technology capable of supporting real-time processing of mass data is needed.
Disclosure of Invention
In order to solve the problems, the invention provides an intelligent ship Internet of things data operation and maintenance monitoring method, which monitors the acquired intelligent ship Internet of things data in real time by adopting a window function of a real-time stream processing technology in a big data stream processing frame and combining with data quality requirements defined in service requirements, timely alarms when finding problems, monitors the Internet of things transmission and data quality of the intelligent ship, and ensures the overall throughput capacity of a system by fully utilizing the distributed high concurrency advantage of big data calculation. The invention further relates to an intelligent ship Internet of things data operation and maintenance monitoring system.
The technical scheme of the invention is as follows:
the intelligent ship internet of things data operation and maintenance monitoring method is characterized by comprising the following steps of:
data acquisition and setting: acquiring internet of things data uploaded by the intelligent ship, and publishing each intelligent ship measuring point data in the internet of things data to a message queue in real time for caching; setting a business rule of each measuring point data according to business requirements, and storing the business rule into a database table;
and (3) data association step of the Internet of things: consuming each measuring point data in the message queue, correlating with a database table, and acquiring real-time measuring point data to be monitored in each measuring point data and corresponding service rules thereof;
quality inspection and transmission monitoring: based on a window function in a big data stream processing frame, counting real-time measuring point data to be monitored according to the window size and time interval of the preset window function to obtain a plurality of measuring point quality data in a certain time period, and updating the measuring point quality data into a database table;
recording the last update time of each measuring point data in a database table, comparing the difference value between the last update time of each measuring point data and the current time with a preset time threshold value, and if the difference value between the last update time of a certain measuring point data and the current time is larger than the preset time threshold value, sending an alarm message of interruption of the data transmission of the measuring point data and issuing the alarm message into a message queue; after the transmission of the measuring point data is recovered, a transmission recovery message of the measuring point data is sent out and is released to a message queue;
and a data quality display step: and reading a database table, acquiring the trend of the quality data of each measuring point along with the change of time, consuming a message queue, reading an alarm message and a transmission recovery message of the data of each measuring point, displaying in a chart mode, and realizing the real-time operation and maintenance monitoring of the data of the Internet of things of the intelligent ship.
Preferably, in the step of obtaining and defining data, the service rule includes a time interval range, an alarm range and a numerical fluctuation range.
Preferably, in the quality inspection and transmission monitoring step, the real-time numerical value fluctuation range of each measuring point data in the database table is recorded, the real-time numerical value fluctuation range is compared with a preset fluctuation threshold, and if the real-time numerical value fluctuation range of a certain measuring point data is larger than the preset fluctuation threshold, an alarm message of abnormal data transmission of the measuring point data is sent out and issued to the message queue; and after the data transmission of the measuring point is normal, a transmission recovery message of the data of the measuring point is sent out and is released to a message queue.
Preferably, in the quality inspection and transmission monitoring step, the measurement point quality data includes the number of measurement points, a maximum time interval, a minimum time interval, the number of measurement points which do not meet the range requirement, the number of measurement points with abnormal fluctuation, the average value, variance, standard deviation, maximum value and minimum value of measurement points in a window.
An intelligent ship internet of things data operation and maintenance monitoring system is characterized by comprising a data acquisition and setting module, an internet of things data association module, a quality inspection and transmission monitoring module and a data quality display module which are connected in sequence,
the data acquisition and setting module acquires the Internet of things data uploaded by the intelligent ship, and distributes the intelligent ship measuring point data in the Internet of things data to the message queue in real time for caching; setting a business rule of each measuring point data according to business requirements, and storing the business rule into a database table;
the data association module of the Internet of things consumes each measuring point data in the message queue and associates the measuring point data with the database table to acquire real-time measuring point data to be monitored in each measuring point data and corresponding service rules;
the quality inspection and transmission monitoring module is used for counting real-time measuring point data to be monitored according to the window size and the time interval of a preset window function based on the window function in the big data stream processing frame, obtaining a plurality of measuring point quality data in a certain time period and updating the measuring point quality data into a database table;
recording the last update time of each measuring point data in a database table, comparing the difference value between the last update time of each measuring point data and the current time with a preset time threshold value, and if the difference value between the last update time of a certain measuring point data and the current time is larger than the preset time threshold value, sending an alarm message of interruption of the data transmission of the measuring point data and issuing the alarm message into a message queue; after the transmission of the measuring point data is recovered, a transmission recovery message of the measuring point data is sent out and is released to a message queue;
the data quality display module is used for reading the database table, obtaining the trend of the quality data of each measuring point along with the change of time, consuming the message queue, reading the alarm message and the transmission recovery message of the data of each measuring point, displaying in a chart mode, and realizing the real-time operation and maintenance monitoring of the data of the Internet of things of the intelligent ship.
Preferably, the service rules include a time interval range, an alarm range and a numerical fluctuation range.
Preferably, the quality inspection and transmission monitoring module further records the real-time numerical value fluctuation range of each measuring point data in the database table, compares the real-time numerical value fluctuation range with a preset fluctuation threshold, and if the real-time numerical value fluctuation range of a certain measuring point data is larger than the preset fluctuation threshold, sends out an alarm message of abnormal data transmission of the measuring point data and issues the alarm message to the message queue; and after the data transmission of the measuring point is normal, a transmission recovery message of the data of the measuring point is sent out and is released to a message queue.
Preferably, the measuring point quality data comprises the number of measuring points, the maximum time interval, the minimum time interval, the number of measuring points which do not meet the range requirement, the number of measuring points with abnormal fluctuation, the average value, variance, standard deviation, maximum value and minimum value of measuring points in a window.
The beneficial effects of the invention are as follows:
the invention provides an intelligent ship internet of things data operation and maintenance monitoring method, which comprises the steps of sequentially setting data acquisition and setting, internet of things data association, quality inspection and transmission monitoring and data quality display, wherein the steps cooperate with each other to form internet of things data uploaded by an intelligent ship, define each intelligent ship measuring point data in the internet of things data, set business rules of each measuring point data according to business requirement definition, such as related requirements of time interval range, alarm range and the like of each measuring point data, and store the business rules in a database table; meanwhile, data transmission is monitored, abnormal data transmission is judged by adopting a specific judging method, when abnormal data transmission (such as overlarge data interval and abnormal fluctuation) is found, a message is sent to a message queue to form alarm information, so that the data transmission and quality of the internet of things of the intelligent ship are monitored, and various data quality reports and alarms are output in real time. Aiming at the characteristics of the intelligent ship, the distributed high concurrency advantage of big data calculation is fully utilized, real-time analysis is carried out on the accessed massive intelligent ship Internet of things measuring point data, and the throughput capacity of the whole system is ensured. In the data processing process of real-time calculation, each working node can be horizontally expanded, and the real-time processing requirement of massive data of the Internet of things is met.
The invention also relates to an intelligent ship Internet of things data operation and maintenance monitoring system, which corresponds to the intelligent ship Internet of things data operation and maintenance monitoring method, and can be understood as a system for realizing the intelligent ship Internet of things data operation and maintenance monitoring method.
Drawings
Fig. 1 is a flowchart of an intelligent ship internet of things data operation and maintenance monitoring method.
Fig. 2 is a schematic diagram of an intelligent ship internet of things data operation and maintenance monitoring method.
Detailed Description
The present invention will be described below with reference to the accompanying drawings.
The invention relates to an intelligent ship internet of things data operation and maintenance monitoring method, wherein a flow chart of the method is shown in fig. 1, and the method sequentially comprises the following steps:
data acquisition and setting: acquiring internet of things data uploaded by the intelligent ship, and publishing each intelligent ship measuring point data in the internet of things data to a message queue in real time for caching; setting (defining) business rules of each measuring point data according to business requirements and storing the business rules into a database table;
specifically, as shown in fig. 2, firstly, internet of things data uploaded by an intelligent ship is obtained from an internet of things platform, each intelligent ship measuring point data in the internet of things data is marked, namely Topic is iot _msg, and the data is issued to a message queue Datahub in real time for caching; then, the measuring point data in the data of the Internet of things, which is required to be subjected to data analysis, are arranged, each measuring point data service rule is defined, namely, the related requirements such as the time interval range, the alarm range, the numerical fluctuation range and the like of each measuring point data are defined, and the related requirements are stored in a database table iot _rule;
for example, the measurement point data A is defined, the time interval is required to be 10 seconds, the range is required to be 0-200, and the numerical fluctuation range is +/-10. And defining measurement point data B, wherein the time interval is required to be 20s, the range is required to be-10-30, and the numerical fluctuation range is +/-10. And forming two records by the two business rules, and inserting the two records into a database table iot _rule.
And (3) data association step of the Internet of things: and (3) docking the message queue Datahub, consuming each measuring point data in the message queue, correlating with a database table iot _rule, and acquiring real-time data related to the measuring point data A, B to be monitored in each measuring point data and corresponding service rules thereof.
Quality inspection and transmission monitoring: based on a window function in a big data stream processing frame, counting real-time measuring point data to be monitored according to the window size and time interval of the preset window function to obtain a plurality of measuring point quality data in a certain time period, and updating the measuring point quality data into a database table;
recording the last update time of each measuring point data in a database table, comparing the difference value between the last update time of each measuring point data and the current time with a preset time threshold value, and if the difference value between the last update time of a certain measuring point data and the current time is larger than the preset time threshold value, sending an alarm message of interruption of the data transmission of the measuring point data and issuing the alarm message into a message queue; after the transmission of the measuring point data is recovered, a transmission recovery message of the measuring point data is sent out and is released to a message queue;
preferably, the real-time numerical value fluctuation range of each measuring point data in the database table is recorded, the real-time numerical value fluctuation range is compared with a preset fluctuation threshold, and if the real-time numerical value fluctuation range of a certain measuring point data is larger than the preset fluctuation threshold, an alarm message of abnormal data transmission of the measuring point is sent out and is issued to a message queue; and after the data transmission of the measuring point is normal, a transmission recovery message of the data of the measuring point is sent out and is released to a message queue.
Specifically, a window function of real-time flow calculation in a big data flow processing frame is adopted, real-time measuring point data to be monitored is counted according to a preset window size, a plurality of sampling statistic windows are formed, data in the sampling statistic windows are subjected to statistic analysis, a statistic result is output to a database table according to a preset time interval, a quality analysis result of the plurality of measuring point data is formed, meanwhile, transmission of the measuring point data is monitored, and when transmission abnormality (such as overlarge data interval, fluctuation abnormality and the like) is found, a message is sent to a message queue to form alarm information;
further, with a sliding window (HOP), defining a window size of 1 HOP and a sliding step of 10min, the real-time calculation will output data quality results within a window of one hour at intervals of 10 minutes. And then starting a task, calculating and counting the measuring point data stream in real time according to the defined window size and interval to obtain related statistical data such as the number of measuring points in a range of 1h, the maximum time interval, the minimum time interval, the number of measuring points which do not meet the range requirement, the number of measuring points with abnormal fluctuation, the average value, variance, standard deviation, maximum value, minimum value and the like of the measuring points in the window, and writing the statistical data into a database table iot _qa.
Finally, the last updating time of each measuring point data in the database table is recorded, the difference value between the last updating time of each measuring point data and the current time is compared with a preset time threshold value, if the difference value between the last updating time of a certain measuring point data and the current time is larger than the preset time threshold value (for example, 10 min), an alarm message of interruption of the transmission of the measuring point data is sent out, the alarm message is written into a message queue Datahub, and the alarm message is marked, namely, topic is iot _alarm; after the transmission of the measurement point data is recovered, a transmission recovery message of the measurement point data is sent out, and is also written into a message queue Datahub, and the transmission recovery message is marked, namely topic is iot _alarm.
And a data quality display step: the background service system reads a database table iot _qa, acquires the trend of the quality data of each measuring point along with the time, displays the trend in a front-end page in a chart mode, simultaneously consumes a message queue Datahub, topic is iot _alarm, reads an alarm message and a transmission recovery message of each measuring point data, displays the alarm message and the transmission recovery message in the front-end in a chart mode, and realizes the real-time operation and maintenance monitoring of the intelligent ship Internet of things data.
The invention also relates to an intelligent ship Internet of things data operation and maintenance monitoring system which corresponds to the intelligent ship Internet of things data operation and maintenance monitoring method and can be understood as a system for realizing the method, wherein the system comprises a data acquisition and setting module, an Internet of things data association module, a quality inspection and transmission monitoring module and a data quality display module which are connected in sequence,
the data acquisition and setting module acquires the Internet of things data uploaded by the intelligent ship, and distributes the intelligent ship measuring point data in the Internet of things data to the message queue in real time for caching; setting a business rule of each measuring point data according to business requirements, and storing the business rule into a database table;
the data association module of the Internet of things consumes each measuring point data in the message queue and associates the measuring point data with the database table to acquire real-time measuring point data to be monitored in each measuring point data and corresponding service rules;
quality inspection and transmission monitoring module: based on a window function in a big data stream processing frame, counting real-time measuring point data to be monitored according to the window size and time interval of the preset window function to obtain a plurality of measuring point quality data in a certain time period, and updating the measuring point quality data into a database table;
recording the last update time of each measuring point data in a database table, comparing the difference value between the last update time of each measuring point data and the current time with a preset time threshold value, and if the difference value between the last update time of a certain measuring point data and the current time is larger than the preset time threshold value, sending an alarm message of interruption of the data transmission of the measuring point data and issuing the alarm message into a message queue; after the transmission of the measuring point data is recovered, a transmission recovery message of the measuring point data is sent out and is released to a message queue;
the data quality display module is used for reading the database table, obtaining the trend of the quality data of each measuring point along with the change of time, consuming the message queue, reading the alarm message and the transmission recovery message of the data of each measuring point, displaying in a chart mode, and realizing the real-time operation and maintenance monitoring of the data of the Internet of things of the intelligent ship.
Preferably, the business rules include a time interval range, an alarm range, and a numerical fluctuation range.
Preferably, the time interval range is 10s, the alarm range is 0-200, and the numerical fluctuation range is + -10.
Preferably, the quality inspection and transmission monitoring module further records the real-time numerical value fluctuation range of each measuring point data in the database table, compares the real-time numerical value fluctuation range with a preset fluctuation threshold, and if the real-time numerical value fluctuation range of a certain measuring point data is larger than the preset fluctuation threshold, sends out an alarm message of abnormal data transmission of the measuring point data and issues the alarm message to the message queue; and after the data transmission of the measuring point is normal, a transmission recovery message of the data of the measuring point is sent out and is released to a message queue.
Preferably, the measurement point quality data includes the number of measurement points, the maximum time interval, the minimum time interval, the number of measurement points which do not meet the range requirement, the number of measurement points with abnormal fluctuation, the average value, variance, standard deviation, maximum value and minimum value of measurement points in a window.
The invention provides an objective and scientific intelligent ship internet of things data operation and maintenance monitoring method and system, which are characterized in that a real-time flow processing technology in a big data flow processing frame is adopted, the advantage of distributed high concurrency is fully utilized, the acquired intelligent ship internet of things data is monitored in real time by combining with the data quality requirement defined in service requirements, and an alarm is given in time when a problem is found, so that the monitoring of the internet of things data transmission and quality of the intelligent ship is realized, and the overall throughput capacity of the system is ensured.
It should be noted that the above-described embodiments will enable those skilled in the art to more fully understand the invention, but do not limit it in any way. Therefore, although the present invention has been described in detail with reference to the drawings and examples, it will be understood by those skilled in the art that the present invention may be modified or equivalent, and in all cases, all technical solutions and modifications which do not depart from the spirit and scope of the present invention are intended to be included in the scope of the present invention.
Claims (8)
1. The intelligent ship internet of things data operation and maintenance monitoring method is characterized by comprising the following steps of:
data acquisition and setting: acquiring internet of things data uploaded by the intelligent ship, and publishing each intelligent ship measuring point data in the internet of things data to a message queue in real time for caching; setting a business rule of each measuring point data according to business requirements, and storing the business rule into a database table;
and (3) data association step of the Internet of things: consuming each measuring point data in the message queue, correlating with a database table, and acquiring real-time measuring point data to be monitored in each measuring point data and corresponding service rules thereof;
quality inspection and transmission monitoring: based on a window function in a big data stream processing frame, counting real-time measuring point data to be monitored according to the window size and time interval of the preset window function to obtain a plurality of measuring point quality data in a certain time period, and updating the measuring point quality data into a database table;
recording the last update time of each measuring point data in a database table, comparing the difference value between the last update time of each measuring point data and the current time with a preset time threshold value, and if the difference value between the last update time of a certain measuring point data and the current time is larger than the preset time threshold value, sending an alarm message of interruption of the data transmission of the measuring point data and issuing the alarm message into a message queue; after the transmission of the measuring point data is recovered, a transmission recovery message of the measuring point data is sent out and is released to a message queue;
and a data quality display step: and reading a database table, acquiring the trend of the quality data of each measuring point along with the change of time, consuming a message queue, reading an alarm message and a transmission recovery message of the data of each measuring point, displaying in a chart mode, and realizing the real-time operation and maintenance monitoring of the data of the Internet of things of the intelligent ship.
2. The method for monitoring operation and maintenance of data of the internet of things of intelligent ships according to claim 1, wherein in the step of obtaining and defining data, the service rule comprises a time interval range, an alarm range and a numerical fluctuation range.
3. The method for monitoring the operation and maintenance of the data of the internet of things of the intelligent ship according to claim 2, wherein in the quality inspection and transmission monitoring step, the real-time numerical value fluctuation range of each measuring point data in the database table is recorded, the real-time numerical value fluctuation range is compared with a preset fluctuation threshold, and if the real-time numerical value fluctuation range of a certain measuring point data is larger than the preset fluctuation threshold, an alarm message of abnormal data transmission of the measuring point is sent out and is issued to a message queue; and after the data transmission of the measuring point is normal, a transmission recovery message of the data of the measuring point is sent out and is released to a message queue.
4. The method for monitoring the operation and maintenance of the data of the internet of things of the intelligent ship according to claim 1, wherein in the quality inspection and transmission monitoring step, the measurement point quality data comprises the number of measurement points, the maximum time interval, the minimum time interval, the number of measurement points which do not meet the range requirement, the number of measurement points with abnormal fluctuation, the average value, the variance, the standard deviation, the maximum value and the minimum value of the measurement points in a window.
5. An intelligent ship internet of things data operation and maintenance monitoring system is characterized by comprising a data acquisition and setting module, an internet of things data association module, a quality inspection and transmission monitoring module and a data quality display module which are connected in sequence,
the data acquisition and setting module acquires the Internet of things data uploaded by the intelligent ship, and distributes the intelligent ship measuring point data in the Internet of things data to the message queue in real time for caching; setting a business rule of each measuring point data according to business requirements, and storing the business rule into a database table;
the data association module of the Internet of things consumes each measuring point data in the message queue and associates the measuring point data with the database table to acquire real-time measuring point data to be monitored in each measuring point data and corresponding service rules;
the quality inspection and transmission monitoring module is used for counting real-time measuring point data to be monitored according to the window size and the time interval of a preset window function based on the window function in the big data stream processing frame, obtaining a plurality of measuring point quality data in a certain time period and updating the measuring point quality data into a database table;
recording the last update time of each measuring point data in a database table, comparing the difference value between the last update time of each measuring point data and the current time with a preset time threshold value, and if the difference value between the last update time of a certain measuring point data and the current time is larger than the preset time threshold value, sending an alarm message of interruption of the data transmission of the measuring point data and issuing the alarm message into a message queue; after the transmission of the measuring point data is recovered, a transmission recovery message of the measuring point data is sent out and is released to a message queue;
the data quality display module is used for reading the database table, obtaining the trend of the quality data of each measuring point along with the change of time, consuming the message queue, reading the alarm message and the transmission recovery message of the data of each measuring point, displaying in a chart mode, and realizing the real-time operation and maintenance monitoring of the data of the Internet of things of the intelligent ship.
6. The intelligent marine internet of things data operation and maintenance monitoring system of claim 5, wherein the business rules include a time interval range, an alarm range, and a numerical fluctuation range.
7. The intelligent ship internet of things data operation and maintenance monitoring system according to claim 5, wherein the quality inspection and transmission monitoring module further records a real-time numerical value fluctuation range of each measuring point data in the database table, compares the real-time numerical value fluctuation range with a preset fluctuation threshold, and if the real-time numerical value fluctuation range of a certain measuring point data is larger than the preset fluctuation threshold, sends out an alarm message of abnormal data transmission of the measuring point and sends the alarm message to the message queue; and after the data transmission of the measuring point is normal, a transmission recovery message of the data of the measuring point is sent out and is released to a message queue.
8. The intelligent ship internet of things data operation and maintenance monitoring system according to claim 5, wherein the measuring point quality data comprises the number of measuring points, a maximum time interval, a minimum time interval, the number of measuring points which do not meet the range requirement, the number of measuring points with abnormal fluctuation, the average value, the variance, the standard deviation, the maximum value and the minimum value of measuring points in a window.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310099965.XA CN116319858A (en) | 2023-02-10 | 2023-02-10 | Intelligent ship Internet of things data operation and maintenance monitoring method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310099965.XA CN116319858A (en) | 2023-02-10 | 2023-02-10 | Intelligent ship Internet of things data operation and maintenance monitoring method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116319858A true CN116319858A (en) | 2023-06-23 |
Family
ID=86800394
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310099965.XA Pending CN116319858A (en) | 2023-02-10 | 2023-02-10 | Intelligent ship Internet of things data operation and maintenance monitoring method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116319858A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116902177A (en) * | 2023-09-14 | 2023-10-20 | 山东航宇游艇发展有限公司 | Yacht abnormal state intelligent monitoring method and system based on Internet of things |
| CN117149897A (en) * | 2023-10-31 | 2023-12-01 | 成都交大光芒科技股份有限公司 | Big data alarm information hierarchical display system and method based on double-buffer technology |
-
2023
- 2023-02-10 CN CN202310099965.XA patent/CN116319858A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116902177A (en) * | 2023-09-14 | 2023-10-20 | 山东航宇游艇发展有限公司 | Yacht abnormal state intelligent monitoring method and system based on Internet of things |
| CN116902177B (en) * | 2023-09-14 | 2023-12-08 | 山东航宇游艇发展有限公司 | Yacht abnormal state intelligent monitoring method and system based on Internet of things |
| CN117149897A (en) * | 2023-10-31 | 2023-12-01 | 成都交大光芒科技股份有限公司 | Big data alarm information hierarchical display system and method based on double-buffer technology |
| CN117149897B (en) * | 2023-10-31 | 2024-01-26 | 成都交大光芒科技股份有限公司 | Big data alarm information hierarchical display system and method based on double-buffer technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116319858A (en) | Intelligent ship Internet of things data operation and maintenance monitoring method and system | |
| US10402511B2 (en) | System for maintenance recommendation based on performance degradation modeling and monitoring | |
| CN112084224B (en) | Data management method, system, equipment and medium | |
| CN113672600A (en) | Anomaly detection method and system | |
| CN116451848A (en) | Satellite telemetry data prediction method and device based on space-time attention mechanism | |
| CN112183906A (en) | Machine room environment prediction method and system based on multi-model combined model | |
| CN111581056A (en) | Software engineering database maintenance and early warning system based on artificial intelligence | |
| CN114169604A (en) | Performance index abnormality detection method, abnormality detection device, electronic apparatus, and storage medium | |
| CN114595113A (en) | Anomaly detection method and device in application system and anomaly detection function setting method | |
| CN111400265B (en) | Storage method based on large-redundancy time sequence data | |
| CN116860562A (en) | Method and system for monitoring data quality of data center | |
| CN117215258A (en) | Numerical control machine tool real-time state monitoring system and method based on Flink | |
| CN116016288A (en) | Flow monitoring method, device, equipment and storage medium of industrial equipment | |
| CN116431997A (en) | Dynamic threshold calculation method, device and equipment in operation and maintenance monitoring field | |
| CN113806615B (en) | KPI (Key performance indicator) abnormity early warning method of intelligent IT operation and maintenance system | |
| CN116300564A (en) | Automatic monitoring operation and maintenance platform supporting cross-region and cross-cluster mixed infrastructure | |
| US20220335347A1 (en) | Time-series anomaly prediction and alert | |
| CN113036917A (en) | Power distribution network monitoring information monitoring system and method based on machine learning | |
| CN112530505A (en) | Hard disk delay detection method and device and computer readable storage medium | |
| CN111917565A (en) | Real-time alarm statistical method and system | |
| CN115033457B (en) | Multi-source data real-time acquisition method and system capable of monitoring and early warning | |
| CN117827937B (en) | Monitoring method, system and storage medium based on multi-source data integration and data mining | |
| CN116208464B (en) | Broadcast transmitter fault big data information analysis method and system based on cloud computing | |
| CN111428440B (en) | Automatic time sequence log sample labeling method and device based on conditional probability | |
| CN110018477B (en) | Classification processing method and device for ADAS sensor data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |