CN115941421A - Data screening method, system, equipment and medium for dual-backup observation data center - Google Patents
Data screening method, system, equipment and medium for dual-backup observation data center Download PDFInfo
- Publication number
- CN115941421A CN115941421A CN202310138648.4A CN202310138648A CN115941421A CN 115941421 A CN115941421 A CN 115941421A CN 202310138648 A CN202310138648 A CN 202310138648A CN 115941421 A CN115941421 A CN 115941421A
- Authority
- CN
- China
- Prior art keywords
- observation
- data
- equipment
- target
- backup
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Testing Or Calibration Of Command Recording Devices (AREA)
- Arrangements For Transmission Of Measured Signals (AREA)
Abstract
The invention discloses a method, a system, equipment and a medium for screening data of a double-backup observation data center, which relate to the field of ocean observation, and the method comprises the following steps: determining an observation equipment information linked list at the current moment according to a set fault strategy; finding an observation device information table of the target observation device in an observation device information linked list according to the obtained observation device codes in the observation elements, thereby determining whether the target observation device is a double-backup observation device; if the target observation device is a double-backup observation device, finding the observation device information table of the corresponding virtual main device in the observation device information chain table according to the virtual main device code in the observation device information table of the target observation device; and judging whether the observation elements are the data required by the target virtual main equipment or not according to the data type and the data source in the observation equipment information table of the virtual main equipment. The invention can avoid the data loss of the data center, thereby providing complete data for the forecasting system and further improving the forecasting accuracy.
Description
Technical Field
The invention relates to the field of marine observation, in particular to a method, a system, equipment and a medium for screening data of a dual-backup observation data center.
Background
The marine observation and forecast system consists of a marine observation network, a data transmission network, a forecast system, an information service system and a disaster evaluation system, mainly has the functions of acquiring and transmitting hydrological meteorological elements and manufacturing and distributing forecast information products, and has very important significance for people life, marine economic construction, disaster prevention and reduction, national defense safety and scientific research. The marine observation network comprises an automatic marine meteorological observation system of a marine station, a buoy, a volunteer ship/survey ship marine meteorological observation system, a radar, a drifting buoy, a seabed base, a submerged buoy and the like, and has the main functions of realizing the on-site acquisition of the marine meteorological elements and providing data for the manufacture of forecast information products; the data transmission network adopts communication modes such as optical fiber, satellite, CDMA/GPRS and the like to realize data transmission and product distribution; the forecasting system provides forecasting products by combining experience statistics and numerical forecasting; the information system provides information products to serve users.
In recent years, with the use of the automatic observation system for the marine station, automatic observation has become a main means for marine observation instead of manual observation. Many ocean observation fields are positioned at the edge of an island, and some ocean observation fields are even built on an island, so that traffic and communication are very inconvenient.
At present, a set of observation equipment is adopted in an observation field in an ocean station, and certain types of observation element data are invalid for a period of time when equipment is regularly maintained every month; when a data acquisition unit of an observation sensor or observation equipment fails, particularly at night, the repair of the failure generally needs several hours, and some of the failures need 1 day or even several days, so that the data in the data center is seriously lost, complete data cannot be provided for a forecasting system, and the forecasting accuracy is influenced.
Disclosure of Invention
Based on this, embodiments of the present invention provide a method, a system, a device, and a medium for screening data in a dual-backup observation data center, so as to avoid data loss in the data center, thereby providing complete data for a forecasting system and further improving the accuracy of forecasting.
In order to achieve the purpose, the invention provides the following scheme:
a method for screening data of a double-backup observation data center comprises the following steps:
acquiring a plurality of observation elements sent by target observation equipment at the current moment; the target observation equipment is actual observation equipment arranged at a target observation station; the observation elements include: observing device codes, data types, observation times and observation data values;
determining an observation equipment information linked list at the current moment according to a set fault strategy; the observation device information linked list comprises observation device information tables of actual observation devices of all observation sites in the monitored area and an observation device information table of the virtual master device; if the observation station is provided with two pieces of actual observation equipment which are backed up with each other, the observation station corresponds to a virtual main equipment, and the two pieces of actual observation equipment which are backed up with each other are double-backup observation equipment; the observation device information table includes: observing equipment codes, data types, observation station information, whether the equipment is virtual master equipment or not, data sources of all observation data values, virtual master equipment codes and communication state information;
finding an observation device information table of the target observation device in an observation device information linked list at the current moment according to observation device codes in each observation element sent by the target observation device;
determining whether the target observation equipment is double backup observation equipment or not according to an observation equipment information table of the target observation equipment;
when the target observation device is a double-backup observation device, finding a target virtual main device and an observation device information table of the target virtual main device in the observation device information chain table according to a virtual main device code in the observation device information table of the target observation device; the target virtual master device is a virtual master device corresponding to the target observation station;
judging whether each observation element sent by the target observation equipment at the current moment is data required by the target virtual main equipment or not according to the data type in the observation equipment information table of the target virtual main equipment and the data source of each observation value;
and if so, storing the observation data values in the observation elements sent by the target observation equipment at the current moment into a database of the target virtual main equipment.
Optionally, determining the observation device information linked list at the current time according to the set fault policy specifically includes:
judging whether the actual observation equipment of each observation station in the current monitoring area has communication fault or data fault according to a set fault strategy; the communication fault is a fault of a communication link state; the data fault is a fault of an observed data value;
for an observation station with double backup observation devices, if the double backup observation devices have communication faults, updating a first data source in an observation device information chain table at the previous moment to another actual observation device which is backed up with the double backup observation devices, and determining the updated observation device information chain table as the observation device information chain table at the current moment; the first data source is a data source of all observed data values in an observation device information table of the virtual main device corresponding to the double backup observation devices;
for an observation station with double backup observation devices, if a certain observation data value of the double backup observation devices has a fault, updating a second data source in an observation device information linked list at the previous moment into another actual observation device which is backed up with the double backup observation devices, and determining the updated observation device information linked list as the observation device information linked list at the current moment; the second data source is a data source of the observation data value with the fault in the observation equipment information table of the virtual main equipment corresponding to the double backup observation equipment;
and for the observation station with the double backup observation devices, if the double backup observation devices have no communication fault or data fault, determining the observation device information linked list at the previous moment as the observation device information linked list at the current moment.
Optionally, according to a set fault policy, determining whether a communication fault or a data fault occurs in an actual observation device of each observation station in a current monitoring area, specifically including:
detecting the communication link state or the observation data value of the actual observation equipment of each observation station in the current monitoring area;
if the communication link state of the actual observation equipment is that the data receiving time is longer than the set alarm time, determining that the actual observation equipment has communication faults;
and if a certain observed data value of the actual observation equipment exceeds the set quality range, determining that the observed data value of the actual observation equipment has a fault.
Optionally, determining whether the target observation device is a dual-backup observation device according to the observation device information table of the target observation device specifically includes:
and when the 'whether the target observation equipment is the virtual main equipment' in the observation equipment information table of the target observation equipment is false and the 'virtual main equipment code' is not empty, determining that the target observation equipment is double-backup observation equipment.
Optionally, the obtaining of the observation element sent by the target observation device specifically includes:
acquiring a data packet sent by target observation equipment; the data packet includes: a data packet header flag, an observation device code, a data type, an observation time, an observation data value, a data validation code and a data end flag;
performing data sub-packaging and data validation on the data packet to obtain a validated data packet;
and analyzing the data of the validated data packet to obtain the observation elements.
Optionally, a data source in the observation device information table of the actual observation device is empty, and a data source in the observation device information table of the virtual host device is an actual observation device in the observation site corresponding to the virtual host device;
whether the observation device information table of the actual observation device is false or not, and whether the observation device information table of the virtual master device is true or not.
Optionally, after determining whether a communication fault or a data fault occurs in the actual observation device of each observation station in the monitoring area at the current time according to the set fault policy, the method further includes:
and if the communication fault occurs in the actual observation equipment or at least one observation data value of the actual observation equipment fails, sending an alarm signal.
The invention also provides a data screening system of the double-backup observation data center, which comprises the following steps:
the data acquisition module is used for acquiring a plurality of observation elements sent by target observation equipment at the current moment; the target observation equipment is actual observation equipment arranged at a target observation station; the observation elements include: observing device codes, data types, observation times and observation data values;
the observation device information linked list updating module is used for determining the observation device information linked list at the current moment according to the set fault strategy; the observation device information linked list comprises observation device information tables of actual observation devices of all observation sites in the monitoring area and an observation device information table of the virtual master device; if the observation station is provided with two actual observation devices which are backups of each other, the observation station corresponds to a virtual main device, and the two actual observation devices which are backups of each other are double-backup observation devices; the observation device information table includes: observing equipment codes, data types, observation station information, whether the equipment is virtual master equipment or not, data sources of all observation data values, virtual master equipment codes and communication state information;
the observation device information table determining module is used for finding the observation device information table of the target observation device in the observation device information linked list at the current moment according to the observation device codes in the observation elements sent by the target observation device;
the double-backup observation device judging module is used for determining whether the target observation device is a double-backup observation device according to the observation device information table of the target observation device;
a virtual master device information table determining module, configured to, when the target observation device is a dual-backup observation device, find the observation device information tables of the target virtual master device and the target virtual master device in the observation device information chain table according to a virtual master device code in the observation device information table of the target observation device; the target virtual master device is a virtual master device corresponding to the target observation station;
the data screening module is used for judging whether each observation element sent by the target observation equipment at the current moment is the data required by the target virtual main equipment or not according to the data type in the observation equipment information table of the target virtual main equipment and the data source of each observation value;
and the data storage module is used for storing the observation data values in the observation elements sent by the target observation equipment at the current moment into a database of the target virtual master equipment if the observation elements sent by the target observation equipment are the data required by the target virtual master equipment.
The invention also provides electronic equipment, which comprises a memory and a processor, wherein the memory is used for storing the computer program, and the processor runs the computer program to enable the electronic equipment to execute the double-backup observation data center data screening method.
The invention also provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to realize the data screening method for the double-backup observation data center.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects:
the embodiment of the invention provides a method, a system, equipment and a medium for screening data of a double-backup observation data center, which comprises the steps of firstly, determining an observation equipment information linked list at the current moment according to a set fault strategy; if the target observation equipment is double-backup observation equipment, finding the observation equipment information table of the corresponding virtual main equipment in the observation equipment information linked list according to the virtual main equipment code in the observation equipment information table of the target observation equipment; the method is suitable for observation stations of double backup observation equipment, the observation stations are provided with two actual observation equipment which are mutually backup, and the data of a data center can be prevented from being seriously lost due to the fault of the observation equipment, so that complete data are provided for a forecasting system, the forecasting accuracy is improved, in the screening process, the observation equipment information linked list is updated in real time according to a set fault strategy, when the double backup observation equipment has a fault, the accuracy of the observation equipment information linked list can be ensured, the integrity and the effectiveness of the data are ensured, and the intelligent screening of the data is realized.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of a data screening method for a dual-backup observation data center according to an embodiment of the present invention;
fig. 2 is a schematic view of observation information setting of the actual observation device 1;
FIG. 3 is a schematic view of observation information setting of a virtual master device;
fig. 4 is a schematic structural diagram of a data screening system of a dual-backup observation data center according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Example one
The method for screening the data of the double-backup observation data center is used for the automatic observation system of the marine station hydrological weather. The method is suitable for double backup observation devices, namely redundant observation is adopted at an observation station, two sets of actual observation devices are built, the two sets of actual observation devices work independently and are backup to each other, and each set of actual observation device has a unique observation device code.
Referring to fig. 1, the method includes:
step 101: acquiring a plurality of observation elements sent by target observation equipment at the current moment; the target observation equipment is actual observation equipment arranged at a target observation station; the observation elements include: observation device code, data type, observation time, and observation data value.
Step 102: and determining an observation equipment information linked list at the current moment according to the set fault strategy.
The observation device information linked list comprises observation device information tables of actual observation devices of all observation sites in the monitored area and an observation device information table of the virtual master device; if the observation station is provided with two actual observation devices which are backups of each other, the observation station corresponds to a virtual main device, and the two actual observation devices which are backups of each other are double-backup observation devices; the observation device information table includes: observation device coding, data type, observation site information, whether the observation site is a virtual master device, data source of each observation data value, virtual master device coding and communication state information.
Step 103: and finding the observation device information table of the target observation device in the observation device information linked list at the current moment according to the observation device codes in the observation elements sent by the target observation device.
Step 104: and determining whether the target observation equipment is double backup observation equipment or not according to the observation equipment information table of the target observation equipment.
Step 105: and when the target observation equipment is double-backup observation equipment, finding the target virtual main equipment and the observation equipment information table of the target virtual main equipment in the observation equipment information chain table according to the virtual main equipment code in the observation equipment information table of the target observation equipment.
The target virtual master device is a virtual master device corresponding to the target observation station.
Step 106: and judging whether each observation element sent by the target observation equipment at the current moment is the data required by the target virtual main equipment or not according to the data type in the observation equipment information table of the target virtual main equipment and the data source of each observation value.
Step 107: and if the observation elements sent by the target observation equipment are the data required by the target virtual master equipment, storing the observation data values in the observation elements sent by the target observation equipment at the current moment into a database of the target virtual master equipment.
In one example, step 102 specifically includes:
1) Judging whether the actual observation equipment of each observation station in the current monitoring area has communication fault or data fault according to a set fault strategy; the communication fault is a fault in a communication link state; the data failure is a failure in an observed data value, specifically:
detecting the communication link state or the observation data value of actual observation equipment of each observation station in the current monitoring area; if the communication link state of the actual observation equipment is that the data receiving time is longer than the set alarm time, determining that the actual observation equipment has communication faults; and if a certain observed data value of the actual observation equipment exceeds the set quality range, determining that the observed data value of the actual observation equipment has a fault.
2) For an observation station with double backup observation devices, if the double backup observation devices have communication faults, updating a first data source in an observation device information chain table at the previous moment to another actual observation device which is backed up with the double backup observation devices, and determining the updated observation device information chain table as the observation device information chain table at the current moment; the first data source is a data source of all observed data values in an observation device information table of the virtual main device corresponding to the double backup observation devices.
3) For an observation station with double backup observation devices, if a certain observation data value of the double backup observation devices fails, updating a second data source in an observation device information chain table at the previous moment to another actual observation device which is backup for the double backup observation devices, and determining the updated observation device information chain table as the observation device information chain table at the current moment; and the second data source is the data source of the observation data value with the fault in the observation equipment information table of the virtual main equipment corresponding to the double backup observation equipment.
4) And for the observation station with the double backup observation devices, if the double backup observation devices have no communication fault or data fault, determining the observation device information linked list at the previous moment as the observation device information linked list at the current moment.
5) And for any actual observation equipment of any observation station in the monitored area, if the actual observation equipment has communication fault or at least one observation data value of the actual observation equipment has fault, sending an alarm signal.
In one example, step 104 specifically includes:
and when the ' virtual master device is not false and the ' virtual master device code ' in the observation device information table of the target observation device is not empty, determining that the target observation device is a double-backup observation device.
In one example, step 101 specifically includes:
acquiring a data packet sent by target observation equipment; the data packet includes: a data packet header flag, an observation device code, a data type, an observation data value, a data validation code, and a data end flag.
And performing data sub-packaging and data validation on the data packet to obtain a validated data packet.
And analyzing the data of the verified data packet to obtain the observation elements.
In an example, a data source in the observation device information table of the actual observation device is empty, and a data source in the observation device information table of the virtual master device is an actual observation device in the observation site corresponding to the virtual master device.
The "whether the observation device information table of the actual observation device is the virtual master device" is false, and the "whether the observation device information table of the virtual master device is the virtual master device" is true.
In practical application, a more specific implementation process of the data screening method for the dual-backup observation data center is as follows:
firstly, a design scheme of multithreading concurrent data interaction and data processing is provided in data monitoring software to realize the management of multi-channel communication of a plurality of stations and a plurality of sets of equipment, a virtual main device is virtualized in a data center for an observation station adopting redundant observation, namely the observation station with double backup observation devices, and is used for storing actual observation data, and the virtual main device can respectively select one or more observation elements from the observation data of the two sets of actual observation devices through manual intervention or system intelligent fault diagnosis to be used as the actual observation elements of the virtual main device. And generating real-time data, punctual message data, integral point real-time data and delayed monthly report files required by business operation by adopting the data of the virtual master equipment, and providing the files to a forecasting system.
When two sets of actual observation equipment have partial sensor faults or equipment is maintained or when the whole set of observation equipment has faults, the data center software system based on redundant observation is automatically switched to backup equipment through manual intervention or fault diagnosis to acquire data, so that the integrity and the effectiveness of the data are ensured, enough time is won for maintenance and repair of the observation equipment, and a person on duty does not need to immediately maintain, so that the burden of the person on duty is reduced. Through demonstration application, the monitoring software runs stably, each function meets business operation requirements, more efficient services are provided for ocean development and management, ocean disaster prevention and reduction, ocean safe navigation guarantee and ocean control, and the important role of ocean observation in promoting economic development is fully played.
The method for screening the data of the double backup observation data center comprises the following specific steps:
step 1:
each set of actual observation equipment establishes an observation equipment information table in data center software, and a plurality of observation equipment form an observation equipment information linked list and store information linked list data in a database. In this embodiment, for an observation station that uses dual backup observation devices, a virtual master device table (i.e., an observation device information table of a virtual master device) is added, and the virtual master device table is the same as the field name of the observation device information table of an actual observation device, except that the field setting content is slightly different. The observation device information table includes observation site information and observation information.
The observation station information comprises a center station name, a center station name code, a sea station serial number, a sea station name code, an equipment code, a sea station area number, a sea station longitude, a sea station latitude, a sea station site, a barometric sensor sea-pulling, an annual average temperature of the observation station, a high tide and low tide sequencing method and the like.
The observation information includes: the method comprises the following steps of observation equipment coding, each observation data value (such as wind direction, wind speed, air temperature, relative humidity, air pressure, rainfall, visibility, surface seawater temperature, surface seawater salinity and tide), data source of each observation data value (which can be the actual observation equipment 1 or the actual observation equipment 2, and the data source of each observation data value can be different), observation type (observation, visual observation and non-measurement), maximum value of the observation data value, minimum value of the observation data value, observation filling value, alarm of the continuous change of the observation value for minutes, alarm of the change of the observation value exceeding percentage within continuous minutes, difference value larger than that, allowable error value and the like.
The difference of the actual observation equipment and the virtual main equipment is mainly that the data source of the observation information is set differently, and the data source of the virtual main equipment is automatically updated regularly according to a certain algorithm in the thread of intelligent automatic diagnosis and update of an observation equipment information linked list. Fig. 2 shows the observation information setting of the actual observation device 1, and the data source is empty; FIG. 3 is an observation setting of a virtual master device, with a data source set as a default source.
For an observation site with double backup observation devices, a virtual main device table is created, and a unique observation device code of the virtual main device is set, wherein the virtual main device table is stored in a database. The virtual master device table is the same as the observation device information table of the actual observation device, and is one of the observation device information linked lists, and the virtual master device table only assigns "whether it is a virtual master device" in the table as true (true).
The observation device information table includes an observation device code, observation site information, whether the observation site is a virtual master device, a data source (effective when the observation site is a virtual master device) of each observation data value, a virtual master device code (the dual backup observation device is a virtual master device code, otherwise, it is empty), and communication status information. And the management of a plurality of sets of actual observation equipment is realized through the observation equipment information linked list. When software is started or system setting is changed, an observation device information linked list is created or updated, and each actual observation device is managed.
Step 2:
the method comprises the steps of establishing a data receiving thread and a data processing thread aiming at each communication mode of each set of actual observation equipment, carrying out data analysis and data storage in the data processing thread, judging whether the actual observation equipment is double-backup observation equipment or not according to an observation equipment information linked list, indicating the actual observation equipment is the double-backup observation equipment if a virtual main equipment code in the observation equipment information linked list is not empty, judging whether each observation element is data required by the virtual main equipment or not if the actual observation equipment is the double-backup observation equipment, and storing an observation data value in the observation element into a database of the virtual main equipment if the actual observation equipment is the double-backup observation equipment.
The specific screening process is as follows:
And step 3:
and intelligently and automatically diagnosing and updating the information linked list of the observation equipment.
And establishing an intelligent automatic diagnosis updating thread of the information linked list of the observation equipment, and updating the information linked list of the observation equipment at regular time. The intelligent automatic diagnosis updating thread is the basis for ensuring the integrity and the effectiveness of the data of the virtual main equipment.
The method is characterized in that the observation device information linked list is updated mainly by 'data sources of all observation data values', and the updating is realized regularly in 'an intelligent automatic diagnosis updating thread of the observation device information linked list'. The 'data source of each observed data value' is the basis for realizing data screening.
The received data information and communication state information in the observation device information linked list are updated during data receiving and analyzing.
The method comprises the steps of detecting the state of a communication link by setting a fault strategy, detecting the quality of an observed data value, generating fault information by fault diagnosis, and giving an alarm in the modes of sound, animation and the like.
The setting of the fault strategy comprises the following steps: detecting the state of a communication link; (2) The observed data values are quality tested, and the fault strategy setting interface of the quality test is shown as the observed information setting part of fig. 4. Specifically, the method comprises the following steps:
(1) Communication link state detection
And traversing the information linked list of the observation equipment, judging whether the last data receiving time of each communication is more than the set alarm time according to the communication use condition of each set of actual observation equipment in the linked list, and if so, sending an alarm signal.
And if all communications of a certain double-backup observation device are in failure, setting the data source of each observation data value of the observation device information table of the virtual main device corresponding to the double-backup observation device as another set of double-backup observation device.
(2) Quality detection of observed data values
Starting an observation data value quality detection thread, and reading an observation data value when the timing is interrupted, wherein the observation data value comprises: air temperature, air pressure, temperature, rainfall, visibility, wind speed, wind direction, surface seawater temperature, surface seawater salinity and tides. And traversing the observation equipment information linked list, and sequentially performing quality detection on each observation data value of each set of actual observation equipment, wherein the detection method comprises range detection and continuity detection. Wherein the range inspection comprises extreme range inspection, instrument range inspection, levina criterion and Grabbs criterion; continuity tests include gradient tests, xiphophora tests and constant tests. For example, whether the observed data value exceeds a set quality range is judged, and if the observed data value exceeds the set quality range, the observed data value is stored in a fault information base and is subjected to alarm processing; if the quality of the observation data does not exceed the set quality range, judging whether the observation data value meets the set continuity condition, if not, storing the observation data value into a fault information base and carrying out alarm processing, and if so, waiting for next interruption.
And when the observed data value exceeds a set quality range or does not meet a set continuity condition, judging whether the observed data value is a double-backup observing device, and when the double-backup observing device detects that a certain observed data value is abnormal, setting the data source of the observed data value in the observing device information table of the virtual main device corresponding to the double-backup observing device as another set of double-backup observing device.
And 4, step 4: data processing layer thread management
The observation device information linked list stores the state information of each line of each set of actual observation device, and judges whether the data interaction thread and the data processing thread of the line are normal or not according to the time of the line receiving data finally. When the difference between the last data receiving time of the line and the current system time is larger than a fixed value, for internet access communication and wireless communication, closing the Socket of the line, and then stopping the corresponding data interaction thread and data processing thread; for serial port communication, stopping a data processing thread, closing a serial port, opening the serial port, and loading a monitoring event; for Beidou communication, beidou data processing threads of all stations are stopped, then serial ports are closed, then the serial ports are opened, and monitoring events are loaded.
Specifically, the method comprises the following steps:
for network port communication and wireless communication, the data receiving and processing flow of the data center is as follows:
in the data interaction thread, waiting for the interruption of the internet access, triggering the interruption of the internet access after receiving data sent by the observation equipment through the communication equipment, reading all the data sent this time, finding a data cache queue corresponding to the sending end IP address in the system through the sending end IP address, adding the data received this time to the tail part of the data cache queue, returning and waiting for the interruption again.
The corresponding data processing thread waits for the timed interrupt, judges whether data exists in a data cache queue corresponding to the data processing thread after the timed interrupt, and returns to wait for the next timed interrupt if no data exists; if the data exists, reading the content of the data cache queue in a first-in first-out mode, analyzing the data, storing the data, judging whether the data is double-backup observation equipment or not according to the encoding of the observation equipment, if the data is not the double-backup observation equipment, returning to wait for the next time of timed interruption, if the data is the double-backup observation equipment, sequentially judging whether each observation element is the data required by the virtual main device or not, if the data is the required data, storing the observation data value in the observation element into a database of the virtual main device, and returning to wait for the next time of timed interruption.
For Beidou communication, the data receiving and processing flow of the data center is as follows:
the server of the data center is generally only provided with a Beidou communication receiver for receiving data transmitted by a plurality of observation devices communicating in a Beidou mode, and the Beidou communication receiver is connected with the server through a cable and communicates through a serial port. After the software is started, the serial port is opened, and a monitor is added.
Waiting for the serial port to be interrupted in the monitor, after the serial port is interrupted, fetching data from the serial port, acquiring a Beidou number of a sender, judging whether a data processing thread is started or not through the Beidou number of the sender, and if not, starting a corresponding data processing thread. And finding a data cache queue corresponding to the Beidou number in the system, adding the data received this time to the tail part of the data cache queue, returning and waiting for the serial port interruption again.
The corresponding data processing thread waits for the timed interrupt, judges whether data exists in a data cache queue corresponding to the data processing thread after the timed interrupt, and returns to wait for the next timed interrupt if no data exists; if the data exists, reading the content of the data cache queue in a first-in first-out mode, analyzing the data and storing the data, judging whether the data is double-backup observation equipment or not according to the encoding of the observation equipment, if the data is not the double-backup observation equipment, returning to wait for the next time of timed interruption, if the data is the double-backup observation equipment, sequentially judging whether each observation element is the data required by the virtual main device or not, if the data is the required data, storing the observation data value in the observation element into a database of the virtual main device, and returning to wait for the next time of timed interruption.
According to the data screening method for the double-backup observation data center, when the double-backup observation device fails, the data center automatically updates the observation device information linked list through fault diagnosis, switches to the backup device to acquire data, guarantees the accuracy of the observation device information linked list, further guarantees the integrity and effectiveness of the data, and achieves intelligent screening of the data.
Example two
In order to implement the method corresponding to the above embodiment to achieve the corresponding functions and technical effects, a dual-backup observation data center data screening system is provided below.
Referring to fig. 4, the system includes:
a data obtaining module 401, configured to obtain, at a current moment, a plurality of observation elements sent by a target observation device; the target observation equipment is actual observation equipment arranged at a target observation station; the observation elements include: observation device code, data type, observation time, and observation data value.
An observation device information linked list updating module 402, configured to determine an observation device information linked list at the current time according to a set fault policy; the observation device information linked list comprises observation device information tables of actual observation devices of all observation sites in the monitored area and an observation device information table of the virtual master device; if the observation station is provided with two pieces of actual observation equipment which are backed up with each other, the observation station corresponds to a virtual main equipment, and the two pieces of actual observation equipment which are backed up with each other are double-backup observation equipment; the observation device information table includes: observation device coding, data type, observation site information, whether the observation site is a virtual master device, data source of each observation data value, virtual master device coding and communication state information.
An observation device information table determining module 403, configured to find the observation device information table of the target observation device in the observation device information linked list at the current time according to the observation device code in each observation element sent by the target observation device.
A dual backup observation device determining module 404, configured to determine whether the target observation device is a dual backup observation device according to the observation device information table of the target observation device.
A virtual master device information table determining module 405, configured to, when the target observation device is a dual-backup observation device, find the target virtual master device and the observation device information tables of the target virtual master device in the observation device information chain table according to a virtual master device code in the observation device information table of the target observation device; the target virtual master device is a virtual master device corresponding to the target observation station.
And a data screening module 406, configured to determine, according to the data type and the data source of each observation value in the observation device information table of the target virtual host device, whether each observation element sent by the target observation device at the current time is data required by the target virtual host device.
A data storage module 407, configured to store, if the observation element sent by the target observation device is data required by the target virtual host device, an observation data value in each observation element sent by the target observation device at the current time into a database of the target virtual host device.
EXAMPLE III
The embodiment provides an electronic device, which includes a memory and a processor, where the memory is used for storing a computer program, and the processor runs the computer program to make the electronic device execute the data screening method of the dual-backup observation data center in the first embodiment.
Optionally, the electronic device may be a server.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the method for screening data in a dual backup observation data center according to the first embodiment of the present invention is implemented.
In the present specification, the embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the description of the method part.
The principles and embodiments of the present invention have been described herein using specific examples, which are provided only to help understand the method and the core concept of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the foregoing, the description is not to be taken in a limiting sense.
Claims (10)
1. A data screening method for a double-backup observation data center is characterized by comprising the following steps:
acquiring a plurality of observation elements sent by target observation equipment at the current moment; the target observation equipment is actual observation equipment arranged at a target observation station; the observation elements include: observing device codes, data types, observation times and observation data values;
determining an observation equipment information linked list at the current moment according to a set fault strategy; the observation device information linked list comprises observation device information tables of actual observation devices of all observation sites in the monitoring area and an observation device information table of the virtual master device; if the observation station is provided with two actual observation devices which are backups of each other, the observation station corresponds to a virtual main device, and the two actual observation devices which are backups of each other are double-backup observation devices; the observation device information table includes: observing equipment codes, data types, observation station information, whether the equipment is virtual master equipment or not, data sources of all observation data values, virtual master equipment codes and communication state information;
finding an observation device information table of the target observation device in an observation device information linked list at the current moment according to observation device codes in each observation element sent by the target observation device;
determining whether the target observation equipment is double-backup observation equipment or not according to an observation equipment information table of the target observation equipment;
when the target observation device is a double-backup observation device, finding a target virtual main device and an observation device information table of the target virtual main device in the observation device information chain table according to a virtual main device code in the observation device information table of the target observation device; the target virtual master device is a virtual master device corresponding to the target observation station;
judging whether each observation element sent by the target observation equipment at the current moment is data required by the target virtual main equipment or not according to the data type in the observation equipment information table of the target virtual main equipment and the data source of each observation value;
and if so, storing the observation data values in the observation elements sent by the target observation equipment at the current moment into a database of the target virtual main equipment.
2. The method for screening data of a dual-backup observation data center according to claim 1, wherein determining an observation device information linked list at a current time according to a set fault policy specifically comprises:
judging whether the actual observation equipment of each observation station in the current monitoring area has communication fault or data fault according to a set fault strategy; the communication fault is a fault of a communication link state; the data fault is a fault of an observed data value;
for an observation station with double backup observation devices, if the double backup observation devices have communication faults, updating a first data source in an observation device information linked list at the previous moment to another actual observation device which is backed up with the double backup observation devices mutually, and determining the updated observation device information linked list as the observation device information linked list at the current moment; the first data source is a data source of all observed data values in an observation device information table of the virtual main device corresponding to the double backup observation devices;
for an observation station with double backup observation devices, if a certain observation data value of the double backup observation devices has a fault, updating a second data source in an observation device information linked list at the previous moment into another actual observation device which is backed up with the double backup observation devices, and determining the updated observation device information linked list as the observation device information linked list at the current moment; the second data source is a data source of the observation data value with the fault in the observation equipment information table of the virtual main equipment corresponding to the double backup observation equipment;
and for the observation station with the double backup observation devices, if the double backup observation devices have no communication fault or data fault, determining the observation device information linked list at the previous moment as the observation device information linked list at the current moment.
3. The method for screening data of a dual-backup observation data center according to claim 2, wherein whether the actual observation equipment of each observation station in the current monitoring area has a communication fault or a data fault is judged according to a set fault policy, specifically comprising:
detecting the communication link state or the observation data value of the actual observation equipment of each observation station in the current monitoring area;
if the communication link state of the actual observation equipment is that the data receiving time is longer than the set alarm time, determining that the actual observation equipment has communication faults;
and if a certain observed data value of the actual observation equipment exceeds the set quality range, determining that the observed data value of the actual observation equipment has a fault.
4. The method for screening data of a dual-backup observation data center according to claim 1, wherein determining whether the target observation device is a dual-backup observation device according to an observation device information table of the target observation device specifically includes:
and when the ' virtual master device is not false and the ' virtual master device code ' in the observation device information table of the target observation device is not empty, determining that the target observation device is a double-backup observation device.
5. The method for screening data of a dual-backup observation data center according to claim 1, wherein acquiring observation elements sent by a target observation device specifically comprises:
acquiring a data packet sent by target observation equipment; the data packet includes: a data packet header flag, an observation device code, a data type, an observation time, an observation data value, a data validation code and a data end flag;
performing data sub-packaging and data validation on the data packet to obtain a validated data packet;
and analyzing the data of the verified data packet to obtain the observation elements.
6. The method for screening data in a dual-backup observation data center according to claim 1, wherein a data source in the observation device information table of the actual observation device is empty, and a data source in the observation device information table of the virtual master device is an actual observation device in the observation station corresponding to the virtual master device;
the "whether the observation device information table of the actual observation device is the virtual master device" is false, and the "whether the observation device information table of the virtual master device is the virtual master device" is true.
7. The method for screening data of a dual-backup observation data center according to claim 2, wherein after determining whether the actual observation device of each observation station in the monitoring area at the current moment has a communication failure or a data failure according to a set failure policy, the method further comprises:
and if the communication fault occurs in the actual observation equipment or at least one observation data value of the actual observation equipment fails, sending an alarm signal.
8. A dual backup observation data center data screening system, comprising:
the data acquisition module is used for acquiring a plurality of observation elements sent by the target observation equipment at the current moment; the target observation equipment is actual observation equipment arranged at a target observation station; the observation elements comprise: observing device codes, data types, observation times and observation data values;
the observation device information linked list updating module is used for determining the observation device information linked list at the current moment according to the set fault strategy; the observation device information linked list comprises observation device information tables of actual observation devices of all observation sites in the monitored area and an observation device information table of the virtual master device; if the observation station is provided with two actual observation devices which are backups of each other, the observation station corresponds to a virtual main device, and the two actual observation devices which are backups of each other are double-backup observation devices; the observation device information table includes: observing equipment codes, data types, observation station information, whether the equipment is virtual master equipment or not, data sources of all observation data values, virtual master equipment codes and communication state information;
the observation device information table determining module is used for finding the observation device information table of the target observation device in the observation device information linked list at the current moment according to the observation device codes in the observation elements sent by the target observation device;
the double-backup observation device judging module is used for determining whether the target observation device is a double-backup observation device according to the observation device information table of the target observation device;
a virtual master device information table determining module, configured to, when the target observation device is a dual-backup observation device, find the observation device information tables of the target virtual master device and the target virtual master device in the observation device information chain table according to a virtual master device code in the observation device information table of the target observation device; the target virtual master device is a virtual master device corresponding to the target observation station;
the data screening module is used for judging whether each observation element sent by the target observation equipment at the current moment is the data required by the target virtual main equipment or not according to the data type in the observation equipment information table of the target virtual main equipment and the data source of each observation value;
and the data storage module is used for storing the observation data values in the observation elements sent by the target observation equipment at the current moment into a database of the target virtual master equipment if the observation elements sent by the target observation equipment are the data required by the target virtual master equipment.
9. An electronic device, comprising a memory for storing a computer program and a processor for executing the computer program to cause the electronic device to perform the dual backup observation data center data screening method of any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that it stores a computer program which, when executed by a processor, implements the dual backup observation data center data screening method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310138648.4A CN115941421B (en) | 2023-02-21 | 2023-02-21 | Data screening method, system, equipment and medium for double-backup observation data center |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310138648.4A CN115941421B (en) | 2023-02-21 | 2023-02-21 | Data screening method, system, equipment and medium for double-backup observation data center |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115941421A true CN115941421A (en) | 2023-04-07 |
| CN115941421B CN115941421B (en) | 2023-05-12 |
Family
ID=85820295
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310138648.4A Active CN115941421B (en) | 2023-02-21 | 2023-02-21 | Data screening method, system, equipment and medium for double-backup observation data center |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115941421B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107920111A (en) * | 2017-10-31 | 2018-04-17 | 厦门市谷玉信息技术有限公司 | A kind of integral intelligent collecting method and platform based on surface weather observation |
| CN112269690A (en) * | 2020-11-17 | 2021-01-26 | 珠海大横琴科技发展有限公司 | Data backup method and device |
| CN114020541A (en) * | 2022-01-05 | 2022-02-08 | 深圳市科力锐科技有限公司 | Backup data display method, device, equipment and storage medium |
| CN114116322A (en) * | 2022-01-27 | 2022-03-01 | 深圳市科力锐科技有限公司 | Data recovery method, device, equipment and storage medium |
| CN114978987A (en) * | 2022-05-17 | 2022-08-30 | 北京交通大学 | Server redundancy backup method |
-
2023
- 2023-02-21 CN CN202310138648.4A patent/CN115941421B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107920111A (en) * | 2017-10-31 | 2018-04-17 | 厦门市谷玉信息技术有限公司 | A kind of integral intelligent collecting method and platform based on surface weather observation |
| CN112269690A (en) * | 2020-11-17 | 2021-01-26 | 珠海大横琴科技发展有限公司 | Data backup method and device |
| CN114020541A (en) * | 2022-01-05 | 2022-02-08 | 深圳市科力锐科技有限公司 | Backup data display method, device, equipment and storage medium |
| CN114116322A (en) * | 2022-01-27 | 2022-03-01 | 深圳市科力锐科技有限公司 | Data recovery method, device, equipment and storage medium |
| CN114978987A (en) * | 2022-05-17 | 2022-08-30 | 北京交通大学 | Server redundancy backup method |
Non-Patent Citations (1)
| Title |
|---|
| 吴永芳，陈刚， 张学灵: "海洋数据备份平台的设计和实现", 《信息技术》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115941421B (en) | 2023-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107220775B (en) | Active power distribution network multi-view cooperative vulnerability assessment method considering information system effect | |
| CN108458885A (en) | Ship Remote Fault Diagnosis and Decision-making support system | |
| CN110146129A (en) | A kind of real-time contamination monitoring system of ship based on Big Dipper short message and method | |
| BRPI0403362B1 (en) | METHOD OF PROVIDING A GRAPHIC DISPLAY OF AN ELECTRICAL DISTRIBUTION NETWORK | |
| CN110769068A (en) | Method, device, server and storage medium for generating alarm message | |
| CN109088775A (en) | abnormality monitoring method, device and server | |
| Annunziato et al. | ANAK KRAKATAU VOLCANO EMERGENCY TSUNAMI EARLY WARNING SYSTEM. | |
| CN115508918A (en) | Ground precipitation cooperative quality control method and system based on radar combined reflectivity | |
| CN115512518A (en) | Early warning information processing method and device for multiple disasters based on time-space correlation | |
| CN115941421A (en) | Data screening method, system, equipment and medium for dual-backup observation data center | |
| Venkatesan et al. | Assessment of the reliability of the Indian tsunami buoy system | |
| CN110030497A (en) | A kind of cathodic protection on-line monitoring early warning system | |
| CN112750281B (en) | Geological disaster professional monitoring and early warning method and device | |
| CN109064051A (en) | Transmission of electricity tower bar on-line monitoring method and device | |
| Srinivasa Kumar et al. | Assessment of the reliability of the Indian Tsunami early warning system | |
| CN112750280A (en) | Combined type geological disaster professional monitoring and early warning method and device | |
| CN110825761A (en) | Ship-shore distributed electronic chart system-oriented chart data arrangement and updating method | |
| JP4495634B2 (en) | Earthquake information management system | |
| US7898940B2 (en) | System and method to mitigate physical cable damage | |
| CN113684868B (en) | City utility tunnel early warning system | |
| CN207249448U (en) | A kind of monitoring analysis control system of radar | |
| CN106338312A (en) | Water body pollutant and hydrology monitoring early-warning/alarming method and system | |
| CN114866569A (en) | Marine natural disaster reporting and disclosing system based on block chain technology | |
| CN207895653U (en) | A kind of moisture condensation warning device | |
| CN116501728B (en) | Method and system for generating real-time business data file of automatic hydrological observation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |