CN117708113A - Precipitation data construction method - Google Patents
Precipitation data construction method Download PDFInfo
- Publication number
- CN117708113A CN117708113A CN202410166502.5A CN202410166502A CN117708113A CN 117708113 A CN117708113 A CN 117708113A CN 202410166502 A CN202410166502 A CN 202410166502A CN 117708113 A CN117708113 A CN 117708113A
- Authority
- CN
- China
- Prior art keywords
- precipitation
- data
- precipitation data
- basic
- screening
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001556 precipitation Methods 0.000 title claims abstract description 804
- 238000010276 construction Methods 0.000 title claims abstract description 29
- 238000012544 monitoring process Methods 0.000 claims abstract description 232
- 238000012216 screening Methods 0.000 claims abstract description 124
- 238000005259 measurement Methods 0.000 claims description 13
- 230000001186 cumulative effect Effects 0.000 claims description 12
- 238000000034 method Methods 0.000 abstract description 17
- 238000012545 processing Methods 0.000 abstract description 14
- 238000001514 detection method Methods 0.000 abstract description 13
- 238000007689 inspection Methods 0.000 abstract description 6
- 238000003860 storage Methods 0.000 description 18
- 238000004458 analytical method Methods 0.000 description 3
- 230000004927 fusion Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000001303 quality assessment method Methods 0.000 description 2
- 238000003908 quality control method Methods 0.000 description 2
- 230000001502 supplementing effect Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000005429 filling process Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000010792 warming Methods 0.000 description 1
- 238000005303 weighing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Quality & Reliability (AREA)
- Testing Or Calibration Of Command Recording Devices (AREA)
Abstract
The disclosure provides a precipitation data construction method, and relates to the field of data processing. The precipitation data construction method comprises the following steps: according to the screening conditions determined by the basic precipitation data of each monitoring site in the global precipitation monitoring area, initially screening invalid precipitation data in the basic precipitation data, updating the screening conditions and screening the invalid precipitation data in the screened basic precipitation data for multiple times when the deviation between the screened basic precipitation data and the reference precipitation data of the local precipitation monitoring area is large, and finally filling the missing detection data in the screened basic precipitation data through the remote sensing precipitation data to obtain target precipitation data. The system and the method can improve the integrity and accuracy of the precipitation data, utilize the deviation between the precipitation data of the global and local monitoring precipitation areas to carry out quality inspection, are low in detection difficulty, and can further improve the quality of the precipitation data based on the quality inspection result for multiple times by screening invalid precipitation data.
Description
Technical Field
The disclosure relates to the technical field of data processing, in particular to a precipitation data construction method.
Background
Precipitation is a main source of available water resources in most regions of the world, is a key supplement for almost all hydrologic processes, is a main influencing factor for determining vegetation growth and agricultural activities, and is closely related to people's production and life and social economic development. Meanwhile, strong precipitation is one of the main factors causing natural disasters such as flood, collapse, landslide, debris flow and the like, is a key forecasting and early warning object in disaster prevention and reduction work, and in recent years, extreme precipitation caused by global warming is remarkably increased. Therefore, accurate analysis of precipitation data to cope with extreme weather is of great importance, and timing, fixed-point long-term observation through ground weather observation stations is a main way to obtain accurate precipitation data.
In the related art, a large amount of missing and false data exist in the rainfall data determined based on the ground weather observation station, the integrity and the accuracy of the rainfall data are poor, and a large amount of rainfall data exist in a region with a large coverage area, so that the quality detection difficulty of the rainfall data corresponding to the whole region is high, and the quality of the rainfall data is affected to a certain extent.
It should be noted that the information disclosed in the above background section is only for enhancing understanding of the background of the present disclosure and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
The embodiment of the disclosure aims to provide a precipitation data construction method, so as to solve the problems of lower integrity and accuracy of precipitation data and lower quality of the precipitation data caused by higher quality inspection difficulty at least to a certain extent.
According to an aspect of an embodiment of the present disclosure, there is provided a precipitation data construction method, including:
acquiring historical precipitation data corresponding to a global precipitation monitoring area, wherein the historical precipitation data comprises basic precipitation data and remote sensing precipitation data corresponding to the global precipitation monitoring area and reference precipitation data corresponding to a local precipitation monitoring area;
determining screening conditions according to the precipitation data of each monitoring site in the basic precipitation data, and screening invalid precipitation data in the basic precipitation data based on the screening conditions to obtain basic precipitation data after preliminary screening;
determining deviation data between precipitation data corresponding to a local precipitation monitoring area and reference precipitation data in the initially screened basic precipitation data;
if the deviation data is larger than or equal to a preset deviation threshold value, updating screening conditions, and carrying out secondary screening on invalid precipitation data in the basic precipitation data according to the updated screening conditions until the deviation data is smaller than the deviation threshold value, so as to obtain basic precipitation data after screening is completed;
Filling the short-period precipitation data in the basic precipitation data after screening is completed through the remote sensing precipitation data, and obtaining target precipitation data.
The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects:
according to the precipitation data construction method in the example embodiment of the disclosure, invalid precipitation data in basic precipitation data can be initially screened according to screening conditions determined by basic precipitation data of each monitoring site in a global precipitation monitoring area, when deviation between the screened basic precipitation data and reference precipitation data of a local precipitation monitoring area is large, the screening conditions are updated, the invalid precipitation data in the screened basic precipitation data are screened for multiple times, and finally missing measurement data in the screened basic precipitation data are filled through remote sensing precipitation data, so that target precipitation data are obtained. On one hand, the accuracy of the basic precipitation data can be improved by eliminating invalid precipitation data in the basic precipitation data and carrying out quality monitoring on the basic precipitation data after preliminary screening by referring to the precipitation data, and the completeness of the basic precipitation data can be improved by supplementing the precipitation data in the absence period in the basic precipitation data after screening by remote sensing precipitation data, so that the quality of target precipitation data obtained by final processing is improved; on the other hand, the quality detection is carried out on the basic precipitation data after preliminary screening through the reference precipitation data with more accuracy in the local precipitation monitoring area, so that the data volume required by quality monitoring can be effectively reduced, the quality detection difficulty is reduced, the screening conditions are updated when the deviation is large, the basic precipitation data is screened for multiple times through the updated screening conditions, the accuracy of the precipitation data can be further ensured, and the quality of target precipitation data is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. It will be apparent to those of ordinary skill in the art that the drawings in the following description are merely examples of the disclosure and that other drawings may be derived from them without undue effort.
Fig. 1 schematically illustrates a flow chart of a precipitation data construction method in an embodiment of the disclosure.
Fig. 2 schematically illustrates a flowchart of screening invalid precipitation data according to precipitation data of a reference monitoring site corresponding to a current monitoring site in an embodiment of the disclosure.
Fig. 3 schematically illustrates a flow chart of multiple screening of primary screened base precipitation data based on updated screening conditions in accordance with an embodiment of the disclosure.
FIG. 4 schematically illustrates a flow chart for populating missing data that is erroneously assigned zero in an embodiment of the present disclosure.
Fig. 5 schematically illustrates a structural schematic diagram of a computer system of an electronic device according to some embodiments of the present disclosure.
Fig. 6 schematically illustrates a schematic diagram of a computer-readable storage medium according to some embodiments of the present disclosure.
In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Reference numerals in the drawings are as follows:
500. an electronic device; 510. a processing unit; 520. a storage unit; 521. a random access memory unit (RAM); 522. a cache storage unit; 523. a read only memory unit (ROM); 524. program/utility; 525. a program module;
530. a bus; 540. a display unit; 550. an input/output (I/O) interface; 560. a network adapter; 570. an external device;
600. program product.
Detailed Description
The terminology used in the description presented herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the description. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in this specification to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, the first information may also be referred to as second information, and similarly, the second information may also be referred to as first information, without departing from the scope of the present description. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
In the related art, there are the following technical problems:
at present, the timing and fixed-point long-term observation of a ground weather observation station is still a main way for obtaining accurate precipitation data, however, a plurality of uncertain factors influence the quality of the observation data in the precipitation observation process, for example, the influence of sundries such as stones and gravel possibly exists in a rainfall barrel and a tipping bucket type rain gauge, the precipitation data of a global precipitation monitoring area is only subjected to rapid quality control, a plurality of suspicious data, uncontrollable data and missing measurement data are reserved, a great number of missing measurement and false precipitation problems exist in the precipitation data, and the quality detection difficulty is high due to the fact that the global precipitation monitoring area has a corresponding great number of precipitation data, so that the quality of the precipitation data is influenced to a certain extent.
Based on one or more problems in the related art, an embodiment of the present disclosure proposes a precipitation data construction method, which may be executed by a terminal device or may be executed by a server, and a description will be given below of the precipitation data construction method by taking the execution of the server as an example.
Fig. 1 schematically illustrates a flow chart of a precipitation data construction method in an embodiment of the disclosure. Referring to fig. 1, the precipitation data construction method may include the steps of:
step S110, historical precipitation data corresponding to a global precipitation monitoring area are obtained, wherein the historical precipitation data comprises basic precipitation data and remote sensing precipitation data corresponding to the global precipitation monitoring area and reference precipitation data corresponding to the local precipitation monitoring area;
step S120, determining screening conditions according to the precipitation data of each monitoring site in the basic precipitation data, and screening invalid precipitation data in the basic precipitation data based on the screening conditions to obtain basic precipitation data after preliminary screening;
step S130, determining deviation data between precipitation data corresponding to a local precipitation monitoring area and reference precipitation data in the primarily screened basic precipitation data;
step S140, if the deviation data is greater than or equal to a preset deviation threshold, updating screening conditions, and carrying out secondary screening on invalid precipitation data in the basic precipitation data according to the updated screening conditions until the deviation data is smaller than the deviation threshold, so as to obtain the basic precipitation data after screening is completed;
And step S150, filling the missing period precipitation data in the screened basic precipitation data by remote sensing precipitation data to obtain target precipitation data corresponding to the global precipitation monitoring area.
According to the precipitation data construction method disclosed by the invention, on one hand, the accuracy of the basic precipitation data can be improved by removing invalid precipitation data in the basic precipitation data and carrying out quality monitoring on the basic precipitation data after preliminary screening by referring to the precipitation data, and the integrity of the basic precipitation data can be improved by supplementing the precipitation data of the lack-of-detection period in the basic precipitation data after screening by remote sensing precipitation data, so that the quality of target precipitation data obtained by final processing is improved; on the other hand, the quality detection is carried out on the basic precipitation data after preliminary screening through the reference precipitation data with more accuracy in the local precipitation monitoring area, so that the data volume required by quality monitoring can be effectively reduced, the quality detection difficulty is reduced, the screening conditions are updated when the deviation is large, the basic precipitation data is screened for multiple times through the updated screening conditions, the accuracy of the precipitation data can be further ensured, and the quality of target precipitation data is improved.
Next, a precipitation data construction method in the present exemplary embodiment will be described in detail.
In step S110, historical precipitation data corresponding to the global precipitation monitoring area is obtained, where the historical precipitation data includes base precipitation data and remote sensing precipitation data corresponding to the global precipitation monitoring area, and reference precipitation data corresponding to the local precipitation monitoring area.
In an example embodiment of the present disclosure, the global precipitation monitoring area may be an area covering most land and part of the sea island, or may cover an area corresponding to a certain region, and the local precipitation monitoring area may be an area in which the corresponding precipitation data in the global precipitation monitoring area can be subjected to artificial secondary quality inspection or other quality inspection means to improve the data quality, where the selection of the global precipitation monitoring area and the local precipitation monitoring area is not particularly limited.
The basic precipitation data refers to precipitation data which can cover a global precipitation monitoring area but has suspicious data, uncontrollable data and missing measurement data, and is used as basic data of the constructed precipitation data. The basic precipitation data may be determined by precipitation data corresponding to all the monitoring stations recorded in the global ground international exchange station, and the basic precipitation data may include precipitation data with various time resolutions, such as precipitation data with 1,3,6, 12, and 24 hours resolution, and the time resolutions of precipitation data corresponding to the same or different monitoring stations may be the same or different.
The remote sensing precipitation data are grid precipitation data which can cover a global precipitation monitoring area and have high observation precision, and are used for filling missing measurement data in basic precipitation data and judging the accuracy of precipitation conditions represented by the basic precipitation data. The remote sensing precipitation data can be determined by integrating satellite precipitation data corresponding to the global precipitation monitoring area with multi-satellite inversion precipitation data, the spatial resolution of the remote sensing precipitation data can be 0.1 degrees, and the time resolution can be greater than or equal to the time resolution of the basic precipitation data, such as 1 hour time resolution, so that the remote sensing precipitation data can be ensured to fill precipitation data corresponding to the time-lacking period of each time scale of the basic precipitation data, of course, the remote sensing precipitation data can be interpolated into corresponding time scales according to specific conditions, and the determination mode of the remote sensing precipitation data and the size of the corresponding spatial and time resolutions are not particularly limited.
Optionally, when the precipitation data corresponding to the monitoring station point contains the missing period, the precipitation data corresponding to the remote sensing data grid point closest to the missing period can be utilized to fill the precipitation data of the missing period, so that the accuracy of the filled precipitation data is ensured while the data integrity is ensured.
Optionally, different time sequences exist between the precipitation data acquired through the global ground international exchange station and the precipitation data acquired through the satellite precipitation data fusion multi-satellite inversion precipitation data, so that the precipitation data corresponding to the same time sequence of the satellite precipitation data fusion multi-satellite inversion precipitation data in the global ground international exchange station can be extracted as basic precipitation data, the precipitation data acquired through the satellite precipitation data fusion multi-satellite inversion precipitation data is taken as remote sensing precipitation data, and therefore whether the precipitation data on a certain day in the basic precipitation data are accurate or not can be judged by utilizing the remote sensing precipitation data of the same time sequence, and the precipitation data corresponding to the time-lacking period in the basic precipitation data can be filled.
The reference precipitation data is precipitation data which corresponds to the local precipitation monitoring area and is subjected to manual secondary check and is used for verifying whether false precipitation exists in the filled basic precipitation data. The reference precipitation data can be determined through a ground climate data daily value data set, and the ground climate data daily value data set is based on the precipitation corresponding to daily or every half day weighing of the rainfall cylinder, so that the determination of the reference precipitation data can be not influenced by the strength of signals, and the accuracy of the reference precipitation data is ensured; the reference precipitation data is subjected to quality control and is subjected to manual secondary check, the accuracy of the data is high, and the accuracy of the reference precipitation data is further guaranteed, so that the accuracy of a detection result in quality inspection of the basic precipitation data after primary screening can be guaranteed, and the determination mode of the reference precipitation data is not particularly limited.
Optionally, because there are multiple time resolution's precipitation data in the basic precipitation data, the time resolution may be different to the precipitation data that different monitoring stations, different time uploads, and same monitoring station may have multiple time scale's precipitation data simultaneously on the same day, and the precipitation data of each time scale may overlap each other, leads to precipitation data of the same day may lack to survey a certain period of time, also perhaps all lack to survey, so can be through integrating precipitation data of each time scale, then based on the day accumulated precipitation volume in all time series that integration obtained do further analysis, thereby ensure precipitation data construction's time uniformity.
In step S120, screening conditions are determined according to precipitation data of each monitoring site in the basic precipitation data, and ineffective precipitation data in the basic precipitation data is screened based on the screening conditions, so as to obtain basic precipitation data after preliminary screening.
In an example embodiment of the present disclosure, the invalid precipitation data refers to precipitation data affecting accuracy of the basic precipitation data, where the invalid precipitation data may be false precipitation data in the basic precipitation data, or may be precipitation data of all time sequences corresponding to the monitoring station when the time of missing the precipitation data corresponding to the monitoring station is longer, or may be missing measurement data that is wrongly assigned to be zero, and the type of the invalid precipitation data is not particularly limited in this embodiment.
The screening conditions may be determined according to precipitation data of each monitoring station in the basic precipitation data, for example, the screening conditions may be determined by daily accumulated precipitation of precipitation data corresponding to each monitoring station in all time sequences, or the screening conditions may be determined by annual accumulated precipitation of precipitation data corresponding to each monitoring station determined based on daily accumulated precipitation in a certain year, or the screening conditions may be determined by a ratio of a time-out period determined by daily accumulated precipitation in all time sequences of precipitation data corresponding to each monitoring station in all time sequences.
The invalid precipitation data in the basic precipitation data can be screened based on screening conditions, so that the invalid precipitation data in the basic precipitation data and the precipitation data of all time sequences corresponding to the monitoring stations with more missing data can be removed, and the accuracy of the basic precipitation data is improved.
For example, when the precipitation data corresponding to a certain day at the monitoring station is greater than a preset precipitation threshold, it indicates that strong precipitation occurs on the same day, and the strong precipitation has a certain spatial continuity, so that the daily accumulated precipitation corresponding to the same and similar days at the nearby monitoring station can be used to determine whether the precipitation data corresponding to the current monitoring station is virtually high; if no corresponding monitoring station exists near the current monitoring station, the largest daily accumulated precipitation or annual accumulated precipitation of the historical years corresponding to the same monitoring station can be compared, so that whether the current monitoring station is in a virtual height of the current precipitation data or not can be determined, if invalid precipitation data is determined, the current precipitation data can be directly removed from the basic precipitation data, and therefore accuracy of the basic precipitation data is improved.
Alternatively, the daily accumulated precipitation of each monitoring station in all time sequences can be counted, so that the accumulated date of each year in all time sequences is determined according to the daily accumulated precipitation corresponding to each monitoring station, when the accumulated date of each year in the absence is larger than a certain value compared with the current year, the current monitoring station is indicated to have excessive absence data in the data of the corresponding year, and if the current monitoring station has the excessive absence data in all years, the precipitation data of all time sequences corresponding to the current monitoring station are removed, so that the integrity of the basic precipitation data is guaranteed, and the accuracy of the basic precipitation data is further improved.
In step S130, deviation data between precipitation data corresponding to the local precipitation monitoring area and reference precipitation data in the primarily screened basic precipitation data is determined.
In an example embodiment of the present disclosure, the deviation data refers to a deviation between precipitation data corresponding to a local precipitation monitoring area in the base precipitation data and reference precipitation data, and is used for performing quality assessment on the base precipitation data after preliminary screening, so that when a result of the quality assessment does not meet a quality requirement on the precipitation data, invalid precipitation data in the base precipitation data may be screened again. The deviation data may be an absolute or relative deviation between an annual accumulated precipitation amount of precipitation data corresponding to each monitoring station in the local precipitation monitoring area and an annual accumulated precipitation amount corresponding to the reference precipitation data, or may be a deviation between a spatial distribution rule of precipitation data corresponding to each monitoring station in the local precipitation monitoring area and a spatial distribution rule corresponding to the reference precipitation data, and the type of the deviation data is not particularly limited in this embodiment.
Optionally, by determining deviation data between the precipitation data corresponding to the local precipitation monitoring area in the primarily screened basic precipitation data and the reference precipitation data, the quality of the primarily screened basic precipitation data can be evaluated, and when the deviation data is greater than a certain value, it is indicated that false precipitation data still exist in the primarily screened basic precipitation data, so that screening conditions can be adjusted to screen the basic precipitation data again, and the accuracy of the basic precipitation data is improved.
In step S140, if the deviation data is greater than or equal to the preset deviation threshold, updating the screening condition, and performing secondary screening on the invalid precipitation data in the basic precipitation data according to the updated screening condition until the deviation data is less than the deviation threshold, so as to obtain the basic precipitation data after screening is completed.
In an example embodiment of the present disclosure, the deviation threshold refers to a criterion for determining whether to update the screening conditions for multiple screening of invalid precipitation data in the base precipitation data, thereby improving accuracy of the base precipitation data. The setting of the deviation threshold value can be determined according to deviation data, if deviation data between the precipitation data corresponding to each monitoring station point in the local precipitation monitoring area and the reference precipitation data is larger, the larger deviation threshold value can be set, so that more precipitation data can be reserved while invalid precipitation data are removed, and similarly, when the deviation data are smaller, the smaller deviation threshold value can be set, so that invalid precipitation data in basic precipitation data can be accurately removed, and of course, the appropriate deviation threshold value can be set according to specific conditions.
Optionally, when the deviation data determined based on the local precipitation monitoring area is greater than or equal to a preset deviation threshold, the updated screening condition can screen invalid precipitation data in the basic precipitation data corresponding to the global precipitation monitoring area, so that accuracy of the precipitation data corresponding to the global precipitation monitoring area can be improved, and missing detection conditions of precipitation data corresponding to monitoring stations reserved after screening can be judged day by day, so that missing detection data is supplemented, integrity of the basic precipitation data is further improved, and quality of the precipitation data corresponding to the global precipitation monitoring area is improved.
In step S150, the missing period precipitation data in the screened basic precipitation data is filled with the remote sensing precipitation data, so as to obtain target precipitation data corresponding to the global precipitation monitoring area.
In an example embodiment of the present disclosure, missing period precipitation data in the basic precipitation data after screening is completed may be filled by remote sensing precipitation data, for example, missing periods of precipitation data corresponding to each monitoring station point in all time sequences in the basic precipitation data after screening may be judged, and then the missing periods of precipitation data in the same period may be filled by remote sensing precipitation data; the accumulated number of the missing measurement data of each monitoring site in the basic precipitation data after the screening is completed can be counted to judge the precipitation data which is wrongly assigned to be zero, and then the corresponding remote sensing precipitation data is utilized for filling, of course, the basic precipitation data can be filled with the remote sensing precipitation data of a proper period according to specific conditions, and the period of the remote sensing precipitation data for filling the missing period precipitation data is not particularly limited.
The target precipitation data can be precipitation data which can cover a global precipitation monitoring area and is high in quality, and can be used as a data basis for developing research works such as hydrologic processes, particularly extreme precipitation development processes, so that the accuracy of research results is guaranteed, and the influence caused by extreme precipitation can be timely prevented and dealt with.
Optionally, when filling the missing period precipitation data in the basic precipitation data after screening is completed through the remote sensing precipitation data, the remote sensing precipitation data filled in the basic precipitation data can be marked, so that the filling data can be identified through marking information, the filling data has traceability, the filled precipitation data and the basic precipitation data can be distinguished through marking information, unnecessary influence of the filling data on a result can be avoided when the precipitation data is subjected to specific analysis, in addition, the marking information can also be used as one of indexes for evaluating the quality of the filled data, and the error in the filling process can be judged through monitoring the condition of the marking information of the filled data, so that correction and improvement can be timely carried out, and the accuracy of the basic precipitation data after filling is further improved.
In an example embodiment of the present disclosure, the base precipitation data includes phase precipitation data at a plurality of time resolutions, and the determination of the screening conditions in step S120 may be accomplished by:
the daily accumulated precipitation amount of each monitoring station can be obtained by combining the phase precipitation data under different time resolutions; the stage precipitation data refer to precipitation data corresponding to different time resolutions, and the stage precipitation data are used for determining accumulated precipitation data corresponding to each monitoring station point in a fixed time period. The time scale corresponding to the stage precipitation data is related to the time resolution of the basic precipitation data, for example, for the basic precipitation data with the time resolution of 3 hours, the corresponding stage precipitation data is the first 3 hours, the first 6 hours, the first 9 hours, the first 12 hours, the first 15 hours, the first 18 hours, the first 21 hours, the first 24 hours, and the accumulated precipitation data corresponding to the first 24 hours, and the time scale of the stage precipitation data is not particularly limited in this embodiment.
Optionally, the daily accumulated precipitation of each monitoring station is obtained by combining the stage precipitation data under different time resolutions, so that the integrity of the precipitation data corresponding to each monitoring station can be ensured, the false strong precipitation in the basic precipitation data and the precipitation data with overlong time in the basic precipitation data can be accurately screened based on the determination of the daily accumulated precipitation with higher integrity, and the screened invalid precipitation data can be accurately removed, so that the accuracy of the screened basic precipitation data is ensured.
The invalid precipitation data in the basic precipitation data can be screened according to the daily accumulated precipitation of the reference monitoring site corresponding to each monitoring site, for example, when the daily accumulated precipitation of the monitoring site on the i th day of N years exceeds a certain threshold value and the reference monitoring site exists within a certain range from the current monitoring site, the daily accumulated precipitation of the reference monitoring site on the i-1 th day, the i th day and the i+1 th day can be compared, and a certain precipitation difference is set, so that the invalid precipitation data in the precipitation data corresponding to each monitoring site is screened.
Alternatively, invalid precipitation data in the basic precipitation data may be screened according to the daily accumulated precipitation of each monitoring station corresponding to different time periods, for example, when the daily accumulated precipitation of the monitoring station on the i-th day of N years exceeds a certain threshold, the maximum daily accumulated precipitation of the current monitoring station corresponding to different years, such as N-1 years, or the annual accumulated precipitation of the N-1 years determined based on the daily accumulated precipitation may be compared, and a certain data threshold is set, so that invalid precipitation data in the precipitation data corresponding to each monitoring station is screened.
Alternatively, the invalid precipitation data in the basic precipitation data may be screened according to the number of invalid precipitation years determined by the daily cumulative precipitation amounts of each monitoring station, for example, the daily cumulative precipitation amounts of each monitoring station on all dates corresponding to all time sequences may be counted, when it is determined that the missing day accumulation of the i monitoring station on N years is greater than a certain value based on the daily cumulative precipitation amounts, the i monitoring station is the invalid precipitation year on N years, and when the number of the i monitoring station is regarded as the invalid precipitation year in all time sequences is greater than a certain value, the precipitation data corresponding to the i monitoring station on all time sequences is regarded as the invalid precipitation data.
In an example embodiment of the present disclosure, the determination of the daily cumulative precipitation amount corresponding to each monitoring site may be achieved by:
the target time resolution can be determined according to the data amount corresponding to each time resolution; and detecting the missing time periods of the precipitation data corresponding to the target time resolution, and combining the precipitation data corresponding to the other time resolutions based on the precipitation data corresponding to the target time resolution when the number of the missing time periods is larger than or equal to the preset missing time period number threshold value so as to obtain the daily accumulated precipitation corresponding to each monitoring station.
The target time resolution is a time scale corresponding to precipitation data with the largest data amount in the basic precipitation data and is used for determining the basic data for integrating the precipitation data of each stage, so that the precipitation data of the stages corresponding to each time resolution are integrated rapidly, and daily accumulated precipitation amount is obtained. The determination of the target time resolution is related to the time resolution of the precipitation data corresponding to each monitoring site, for example, if the time resolution of the precipitation data corresponding to a plurality of monitoring sites in the basic precipitation data is 3 hours, 3 may be taken as the target time resolution, or of course, the target time resolution of an appropriate time scale may be selected according to specific situations, and the size of the target time resolution is not particularly limited in this embodiment.
By taking the target time resolution as an example, merging precipitation data corresponding to other residual time resolutions to obtain daily accumulated precipitation data corresponding to all monitoring stations, and performing detailed explanation on the precipitation data corresponding to the target time resolution by taking the target time resolution as an example, when the basic precipitation data are 1 hour, 6 hours, 12 hours and 24 hours, and the precipitation data corresponding to the 3 hours resolution corresponding to each monitoring station are the most, the precipitation data corresponding to the 1 hour resolution are the least, firstly counting whether the precipitation data of the 3 hours resolution corresponding to each monitoring station on the i day in all time sequences are in a missing time period, namely whether the precipitation data of the phase of the 8 th time periods on the i day are complete, if the missing time is greater than the number threshold of the missing time periods, for example, 3, judging whether the phase data of the 6 hours resolution are complete, if the missing time periods are the missing time periods and the phase precipitation data corresponding to the 3 hours resolution are not included, sequentially judging whether the phase data corresponding to the 12 hours and the 24 hours resolution are the largest, if the missing time periods corresponding to the phase precipitation data are not included, and if the missing time periods corresponding to the phase data are not included, performing complete processing, and further carrying out complete processing on the precipitation data according to the data corresponding to all the missing time periods, and if the phase precipitation data corresponding to the missing time periods are the complete time periods, and the complete data are all added.
In an example embodiment of the present disclosure, the preliminary screening of invalid precipitation data in step S120 may be achieved by:
step S210, when detecting that the daily accumulated precipitation of any current monitoring station on the current date is greater than or equal to the preset daily accumulated precipitation, calculating the linear distance between the current monitoring station and other monitoring stations, and selecting a plurality of reference monitoring stations according to each linear distance and the preset selection distance;
step S220, acquiring accumulated precipitation of a reference monitoring site on a current date and reference days of each day before and after the current date;
step S230, if the difference between the reference daily accumulated precipitation and the daily accumulated precipitation of the current monitoring station on the current date is greater than or equal to the preset precipitation difference, determining the daily accumulated precipitation of the current monitoring station on the current date as invalid precipitation data.
The reference monitoring station is a monitoring station with a shorter linear distance from the corresponding monitoring station, and is used for judging whether invalid precipitation data exist in precipitation data corresponding to each monitoring station in all time sequences, so that the invalid precipitation data are removed, and the accuracy of basic precipitation data is improved. The screening distance can be set to determine a plurality of reference monitoring stations corresponding to each monitoring station, for example, when the screening distance is 200km, a plurality of reference monitoring stations, such as 4 reference monitoring stations, can be selected from all monitoring stations with the current monitoring station distance less than 200km, and of course, a suitable screening distance can be set and a suitable number of reference monitoring stations can be selected according to specific conditions.
By way of example, describing in detail with the preset daily cumulative precipitation amount being 50mm, when the daily cumulative precipitation amount corresponding to the ith monitoring station on the ith day is greater than 50mm, it indicates that strong precipitation occurs on the ith day or precipitation data on the ith day is invalid precipitation data, and the corresponding reference daily cumulative precipitation amounts corresponding to the multiple reference monitoring stations on the ith-1 day, the ith day and the (i+1) th day can be obtained, so that whether the daily cumulative precipitation amount corresponding to the ith monitoring station on the ith day is invalid precipitation data can be judged by utilizing the spatial continuity of strong water.
Optionally, when the daily accumulated precipitation amount corresponding to the ith monitoring station on the ith day is greater than 50mm, and the difference value between the daily accumulated precipitation amount corresponding to each corresponding reference monitoring station on the ith-1 th day and the reference daily accumulated precipitation amount corresponding to the ith+1 th day is greater than or equal to the preset precipitation amount difference value, the precipitation data corresponding to the ith monitoring station on the ith day is indicated to be invalid precipitation data, so that invalid precipitation data in the precipitation data corresponding to each monitoring station on all dates in all time sequences can be sequentially screened; optionally, the preset precipitation difference may be determined according to the daily accumulated precipitation corresponding to each monitoring station, for example, nine tenths of the daily accumulated precipitation corresponding to each monitoring station, and the magnitude of the precipitation difference for determining invalid precipitation data is not particularly limited in this embodiment.
In an example embodiment of the present disclosure, the preliminary screening of invalid precipitation data in step S120 may be achieved by:
if the daily accumulated precipitation of the current monitoring station on the current date is larger than the preset daily accumulated precipitation, acquiring the historical annual accumulated precipitation corresponding to the current monitoring station and the historical reference daily accumulated precipitation of which the precipitation meets the preset precipitation screening conditions in the historical daily accumulated precipitation; and if the daily accumulated precipitation amount of the current date is larger than the historical annual accumulated precipitation amount or the daily accumulated precipitation amount of the current date is larger than the preset multiple of the historical reference daily accumulated precipitation amount, determining the daily accumulated precipitation amount of the current monitoring station at the current date as invalid precipitation data.
Optionally, when the daily accumulated precipitation corresponding to the i th day of N years of the monitoring station is greater than the preset daily accumulated precipitation, the historical reference daily accumulated precipitation may be the daily accumulated precipitation corresponding to the date with the largest precipitation in N-1 years, and the historical year accumulated precipitation may be the sum of the daily accumulated precipitation of all the dates corresponding to N-1 years.
For example, taking a preset screening distance of 200km, a preset daily accumulated precipitation of 50mm, and a preset multiple of 2 as an example, when the daily accumulated precipitation corresponding to the ith monitoring station in the N-year is greater than 50mm and no other monitoring station exists within 200km from the ith monitoring station, the historical daily accumulated precipitation corresponding to the ith monitoring station in the N-1 year and the historical reference daily accumulated precipitation in the N-1 year are obtained, if the daily accumulated precipitation corresponding to the ith monitoring station in the N-year is greater than the historical daily accumulated precipitation corresponding to the ith monitoring station in the N-1 year and is greater than 2 times of the largest daily accumulated precipitation in the N-1 year, the invalid precipitation data corresponding to the ith monitoring station in the N-year can be determined as invalid precipitation data, and the invalid precipitation data in the precipitation data corresponding to each monitoring station in all dates in all time sequences are sequentially screened.
In an example embodiment of the present disclosure, the preliminary screening of invalid precipitation data in step S120 may be achieved by:
the method can determine the corresponding lack-measurement time length of each monitoring station according to the daily accumulated precipitation amount of each monitoring station, and calculate the annual precipitation standard deviation between the daily accumulated precipitation amounts of each monitoring station each year; screening ineffective precipitation years according to the lack of measurement duration and annual precipitation standards; and when the number of invalid precipitation years in any monitoring station is greater than or equal to a preset number threshold, determining all precipitation data corresponding to the monitoring station as invalid precipitation data.
The invalid precipitation year can be a year with a longer period of time lack in precipitation data corresponding to the monitoring stations, and the invalid precipitation year can be screened by the period of time lack and a year precipitation standard, for example, when the counted period of time lack of each monitoring station corresponding to N years is more than half of the total number of days of N years, or the year precipitation standard deviation between the accumulated precipitation amounts of each day corresponding to each monitoring station N years is equal to zero, that is, the extreme condition that the precipitation data corresponding to N years are all 0 or 1 exists, then N years is the invalid precipitation year of the current monitoring station.
The number threshold is a standard for judging whether to reject the precipitation data corresponding to the monitoring station in all time sequences, the setting of the number threshold is related to the total number of years corresponding to all time sequences of the basic precipitation data, the number threshold can be set to be half of the total number of years, and when the ineffective precipitation year corresponding to the monitoring station in all time sequences is greater than half of the total number of years, the precipitation data of all time sequences corresponding to the current monitoring station is rejected, and the determination of the number threshold is not particularly limited in this embodiment.
Optionally, when the number of years of all time sequences in the basic precipitation data is 14 years, if the number of invalid precipitation years corresponding to the ith detection station is greater than or equal to 7, considering all precipitation data corresponding to the ith monitoring station as invalid precipitation data.
In an example embodiment of the present disclosure, the multiple filtering of invalid precipitation data in the preliminary filtered base precipitation data in step S140 may be achieved by:
step S310, when the daily accumulated precipitation corresponding to the basic precipitation data of the monitoring station is larger than a preset strong precipitation judgment threshold value and the difference value between the daily accumulated precipitation of other years corresponding to the monitoring station meets a preset false data judgment condition, determining that the precipitation data corresponding to the monitoring station is invalid precipitation data;
for example, when the daily cumulative precipitation amount of the ith monitoring station on the ith day of N years is greater than a preset determination threshold value of strong precipitation, for example, 100mm, and the difference between the daily cumulative precipitation amount of the ith monitoring station on the other than the nth day in all time series satisfies a preset false data determination condition, for example, greater than 3 times of the daily cumulative precipitation amount of the ith monitoring station on the other than the nth day in all time series, the precipitation data corresponding to the ith monitoring station on the ith day of N years is taken as invalid precipitation data, and the setting of the determination threshold value of strong precipitation and the setting of the false data determination condition are not particularly limited in this embodiment.
Step S320, when the daily accumulated precipitation corresponding to the basic precipitation data of the monitoring station is larger than a preset precipitation threshold value, and the difference value between the daily accumulated precipitation corresponding to the monitoring station and the daily accumulated precipitation of all time periods except the current day meets a preset data judgment condition to be approved, manually rechecking the basic precipitation corresponding to the current day;
For example, when the daily accumulated precipitation of the ith monitoring station on the ith day of N years is greater than a preset precipitation threshold, for example, greater than 50mm, and the difference between the maximum daily accumulated precipitation corresponding to the remaining dates except the ith day in N years meets the preset data to be approved judging condition, for example, greater than 3 times of the maximum daily accumulated precipitation corresponding to the remaining dates, invalid precipitation data may exist in precipitation data corresponding to the ith day of N years by the ith monitoring station, and therefore, manual review is needed to determine the screening accuracy of the invalid precipitation data.
And step S330, when the updated screening conditions determine that invalid precipitation data exist in the precipitation data corresponding to the monitoring stations for at least two years continuously, screening the invalid precipitation data in the precipitation data corresponding to the monitoring stations for multiple times according to the updated screening conditions until the deviation data is smaller than the deviation threshold value, so as to obtain the basic precipitation data after screening.
For example, when the ith monitoring station has invalid precipitation data in all time sequences for at least two consecutive years, for example, precipitation data corresponding to 2-3 consecutive years still has false data in the filled basic precipitation data, so that the operation of screening the invalid precipitation data can be repeated by using updated screening conditions, thereby obtaining the basic precipitation data with higher accuracy.
In an example embodiment of the present disclosure, the filling of the missing period precipitation data in step S150 may be achieved by:
each monitoring station can be judged day by day whether a period of lack of measurement exists or not; if any monitoring station has a missing period, determining remote sensing data grid points with the distance between the remote sensing data grid points and the current monitoring station meeting a preset distance condition, and acquiring precipitation data corresponding to the remote sensing data grid points; and filling the precipitation data corresponding to the missing period of the current monitoring station by using the precipitation data belonging to the same period as the missing period in the precipitation data, so as to obtain target precipitation data.
The remote sensing data grid points refer to grid points which meet the preset distance condition with the monitoring station points with the missing time periods, namely, the grid points with the nearest distance, the precipitation data corresponding to the remote sensing data grid points can be precipitation data of a certain time period or precipitation data of a certain day, and the type of the precipitation data corresponding to the remote sensing data grid points is not particularly limited in the embodiment.
For example, when the i-th monitoring station exists in the basic precipitation data after screening and the precipitation data corresponding to the i-th monitoring station has a missing period, the precipitation data of the missing period is filled with precipitation data of the same period or the same day corresponding to a remote sensing data grid point nearest to the i-th monitoring station, and the filled data can be marked, so that target precipitation data with marked information can be obtained for further data analysis.
In an example embodiment of the present disclosure, the filling of the missing period precipitation data in step S150 may be achieved by:
step S410, counting the annual precipitation days in the basic precipitation data after the screening is completed and the annual reference precipitation days in the corresponding remote sensing precipitation data;
step S420, when the difference value between the annual precipitation days and the annual reference precipitation days meets the preset missing data judging condition, counting the date on which the basic precipitation data after screening is zero, and determining whether the remote sensing precipitation data corresponding to each date is greater than zero;
and step S430, if the remote sensing precipitation data is greater than zero, filling the precipitation data corresponding to the date on which the basic precipitation data is zero with the corresponding remote sensing precipitation data to obtain target precipitation data.
The annual precipitation date can be the accumulated days of which the corresponding daily accumulated precipitation amount in the basic precipitation data is not zero, and the annual reference precipitation date can be the accumulated days of which the corresponding daily accumulated precipitation amount in the remote sensing precipitation data is not zero, so that whether the precipitation data which is wrongly assigned to be zero exists in the basic precipitation data is determined through the difference value between the annual precipitation date and the annual reference precipitation date.
For example, when the difference between the annual precipitation days and the annual reference precipitation days satisfies the preset missing data determination condition, if the annual precipitation days of N years is less than 0.3 times the annual reference precipitation days, it indicates that there is missing data in the basic precipitation data for a long time, and the corresponding missing data is assigned to zero by mistake, so that the date that the daily accumulated precipitation corresponding to the basic precipitation data after the screening is completed can be counted, the precipitation condition of the same day is determined by using the remote sensing precipitation data of the same day, if the basic precipitation data of the i day is zero, and the corresponding remote sensing precipitation data is not zero, it indicates that precipitation occurs on the i day, and the missing data of the corresponding basic precipitation data is assigned to zero by mistake, and then the missing data in the basic precipitation data can be filled again by using the remote sensing precipitation data of the i day, thereby further guaranteeing the accuracy and the integrity of the basic precipitation data after the screening, and obtaining the target data that can cover the global precipitation area.
In an example embodiment of the present disclosure, marking of screened precipitation data may be achieved by:
And when filling the missing period precipitation data in the basic precipitation data after screening is completed through the remote sensing precipitation data, marking the filled precipitation data through the tag so as to determine the filling data in the target precipitation data through the tag.
The filling data can be traceable through the label marking the filled precipitation data in a simple mode, and the target precipitation data is classified through the label information, so that unnecessary influence of the filling data on the specific research result can be avoided, and the credibility and the usability of the target precipitation data with higher construction accuracy can be improved.
In addition, in the exemplary embodiment of the disclosure, an electronic device capable of implementing the precipitation data construction method is also provided.
Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as an apparatus, method, or program product. Accordingly, various aspects of the disclosure may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.
An electronic device 500 according to such an embodiment of the present disclosure is described below with reference to fig. 5. The electronic device 500 shown in fig. 5 is merely an example and should not be construed as limiting the functionality and scope of use of the disclosed embodiments.
As shown in fig. 5, the electronic device 500 is embodied in the form of a general purpose computing device. The components of electronic device 500 may include, but are not limited to: the at least one processing unit 510, the at least one memory unit 520, a bus 530 connecting the different system components (including the memory unit 520 and the processing unit 510), and a display unit 540.
Wherein the storage unit stores program code that is executable by the processing unit 510 such that the processing unit 510 performs steps according to various exemplary embodiments of the present disclosure described in the above section of the "exemplary method" of the present disclosure. For example, the processing unit 510 may perform step S110 shown in fig. 1, to obtain historical precipitation data corresponding to the global precipitation monitoring area, where the historical precipitation data includes base precipitation data and remote sensing precipitation data corresponding to the global precipitation monitoring area, and reference precipitation data corresponding to the local precipitation monitoring area; step S120, determining screening conditions according to the precipitation data of each monitoring site in the basic precipitation data, and screening invalid precipitation data in the basic precipitation data based on the screening conditions to obtain basic precipitation data after preliminary screening; step S130, determining deviation data between precipitation data corresponding to a local precipitation monitoring area and reference precipitation data in the primarily screened basic precipitation data; step S140, if the deviation data is greater than or equal to a preset deviation threshold, updating screening conditions, and carrying out secondary screening on invalid precipitation data in the basic precipitation data according to the updated screening conditions until the deviation data is smaller than the deviation threshold, so as to obtain the basic precipitation data after screening is completed; and step S150, filling the missing period precipitation data in the screened basic precipitation data by remote sensing precipitation data to obtain target precipitation data corresponding to the global precipitation monitoring area.
The storage unit 520 may include readable media in the form of volatile storage units, such as Random Access Memory (RAM) 521 and/or cache memory 522, and may further include Read Only Memory (ROM) 523.
The storage unit 520 may also include a program/utility 524 having a set (at least one) of program modules 525, such program modules 525 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
Bus 530 may be one or more of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
The electronic device 500 may also communicate with one or more external devices 570 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 500, and/or with any device (e.g., router, modem, etc.) that enables the electronic device 500 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 550. Also, electronic device 500 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet, through network adapter 560. As shown, network adapter 560 communicates with other modules of electronic device 500 over bus 530. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with electronic device 500, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, a terminal device, or a network device, etc.) to perform the method according to the embodiments of the present disclosure.
In an exemplary embodiment of the present disclosure, a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present disclosure is also provided. In some possible embodiments, the various aspects of the present disclosure may also be implemented in the form of a program product comprising program code for causing a terminal device to carry out the steps according to the various exemplary embodiments of the disclosure as described in the "exemplary methods" section of the disclosure, when the program product is run on the terminal device.
Referring to fig. 6, a program product 600 for implementing a precipitation data construction method according to an embodiment of the present disclosure is described, which may employ a portable compact disc read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).
Furthermore, the above-described figures are only schematic illustrations of processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It will be readily appreciated that the processes shown in the above figures do not indicate or limit the temporal order of these processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, for example, among a plurality of modules.
From the above description of embodiments, those skilled in the art will readily appreciate that the example embodiments described herein may be implemented in software, or in combination with the necessary hardware. Thus, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (may be a CD-ROM, a U-disk, a mobile hard disk, etc.) or on a network, and includes several instructions to cause a computing device (may be a personal computer, a server, a touch terminal, or a network device, etc.) to perform the method according to the embodiments of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A precipitation data construction method, comprising:
acquiring historical precipitation data corresponding to a global precipitation monitoring area, wherein the historical precipitation data comprises basic precipitation data and remote sensing precipitation data corresponding to the global precipitation monitoring area and reference precipitation data corresponding to a local precipitation monitoring area;
determining screening conditions according to the precipitation data of each monitoring site in the basic precipitation data, and screening invalid precipitation data in the basic precipitation data based on the screening conditions to obtain basic precipitation data after preliminary screening;
determining deviation data between precipitation data corresponding to the local precipitation monitoring area and the reference precipitation data in the basic precipitation data after preliminary screening;
if the deviation data is larger than or equal to a preset deviation threshold value, updating the screening conditions, and carrying out secondary screening on invalid precipitation data in the basic precipitation data according to the updated screening conditions until the deviation data is smaller than the deviation threshold value, so as to obtain the basic precipitation data after screening is completed;
And filling the missing period precipitation data in the basic precipitation data after the screening is completed by the remote sensing precipitation data to obtain target precipitation data corresponding to the global precipitation monitoring area.
2. The precipitation data construction method according to claim 1, wherein the base precipitation data includes phase precipitation data at a plurality of time resolutions, and wherein determining the screening condition based on the precipitation data of each monitoring site in the base precipitation data comprises:
combining the stage precipitation data under different time resolutions to obtain daily accumulated precipitation of each monitoring station;
determining screening conditions according to the daily accumulated precipitation;
wherein the screening conditions include:
screening invalid precipitation data in the basic precipitation data according to the daily accumulated precipitation amount of the reference monitoring stations corresponding to the monitoring stations;
screening invalid precipitation data in the basic precipitation data according to daily accumulated precipitation amounts corresponding to different time periods of each monitoring station;
and screening invalid precipitation data in the basic precipitation data according to the number of invalid precipitation years determined by the daily accumulated precipitation amount of each monitoring station.
3. The precipitation data construction method according to claim 2, wherein said combining the phase precipitation data at different time resolutions to obtain a daily cumulative precipitation amount for each of the monitoring sites comprises:
determining a target time resolution according to the data quantity corresponding to each time resolution;
and detecting the time lack period of the precipitation data corresponding to the target time resolution, and combining the precipitation data corresponding to other time resolutions based on the precipitation data corresponding to the target time resolution when the number of the time lack period is determined to be larger than or equal to a preset time lack period number threshold value so as to obtain the daily accumulated precipitation corresponding to each monitoring station.
4. The precipitation data construction method according to claim 2, wherein said screening of invalid precipitation data from the base precipitation data based on the screening conditions to obtain preliminary screened base precipitation data comprises:
when detecting that the daily accumulated precipitation of any current monitoring station on the current date is greater than or equal to the preset daily accumulated precipitation, calculating the linear distance between the current monitoring station and other monitoring stations, and selecting a plurality of reference monitoring stations according to each linear distance and the preset selection distance;
Acquiring the accumulated precipitation of the reference monitoring site on the current date and the reference date of each day before and after the current date;
and if the difference between the reference daily accumulated precipitation and the daily accumulated precipitation of the current monitoring station on the current date is larger than or equal to a preset precipitation difference, determining the daily accumulated precipitation of the current monitoring station on the current date as invalid precipitation data.
5. The precipitation data construction method according to claim 4, wherein said screening of invalid precipitation data from said base precipitation data based on said screening conditions to obtain preliminary screened base precipitation data, further comprises:
if the daily accumulated precipitation of the current monitoring station on the current date is larger than the preset daily accumulated precipitation, acquiring the historical annual accumulated precipitation corresponding to the current monitoring station and the historical reference daily accumulated precipitation of which the precipitation meets the preset precipitation screening conditions in the historical daily accumulated precipitation;
and if the daily accumulated precipitation of the current date is larger than the historical annual accumulated precipitation or the daily accumulated precipitation of the current date is larger than the preset multiple of the historical reference daily accumulated precipitation, determining the daily accumulated precipitation of the current monitoring station at the current date as invalid precipitation data.
6. The precipitation data construction method according to claim 2, wherein said screening of invalid precipitation data from the base precipitation data based on the screening conditions to obtain preliminary screened base precipitation data comprises:
determining the corresponding lack-measurement time length of each monitoring station according to the daily accumulated precipitation amount of each monitoring station,
calculating the annual precipitation standard deviation between the daily accumulated precipitation amounts of the monitoring stations each year;
screening invalid precipitation years according to the missing measurement duration and the annual precipitation standard deviation;
and when the number of the invalid precipitation years in any monitoring station is larger than or equal to a preset number threshold, determining all precipitation data corresponding to the monitoring station as invalid precipitation data.
7. The precipitation data construction method according to claim 1, wherein the performing secondary screening on invalid precipitation data in the base precipitation data according to the updated screening conditions comprises:
when the daily accumulated precipitation corresponding to the basic precipitation data of the monitoring station is larger than a preset strong precipitation judgment threshold value, and the difference value between the daily accumulated precipitation of other years corresponding to the monitoring station meets a preset false data judgment condition, determining that the precipitation data corresponding to the monitoring station is invalid precipitation data;
When the daily accumulated precipitation corresponding to the basic precipitation data of the monitoring station is larger than a preset precipitation threshold value, and the difference value between the daily accumulated precipitation corresponding to the monitoring station and the daily accumulated precipitation of all time periods except the current day meets a preset data to be approved judging condition, manually rechecking the basic precipitation corresponding to the current day;
and when the updated screening conditions determine that invalid precipitation data exist in the precipitation data corresponding to the monitoring stations for at least two years continuously, carrying out multiple screening on the invalid precipitation data in the precipitation data corresponding to the monitoring stations according to the updated screening conditions until the deviation data are smaller than the deviation threshold value so as to obtain the basic precipitation data after screening is completed.
8. The precipitation data construction method according to claim 1, wherein said filling of the missing period precipitation data in the screened basic precipitation data by the remote sensing precipitation data comprises:
judging whether a period of missing measurement exists or not day by day for each monitoring station;
if any monitoring station has a missing period, determining remote sensing data grid points with the distance between the remote sensing data grid points and the current monitoring station meeting a preset distance condition, and acquiring precipitation data corresponding to the remote sensing data grid points;
And filling the precipitation data corresponding to the current monitoring station missing period by using the precipitation data belonging to the same period as the missing period in the precipitation data, so as to obtain the target precipitation data.
9. The precipitation data construction method according to claim 8, wherein said filling of the missing period precipitation data in the screened basic precipitation data by the remote sensing precipitation data comprises:
counting the annual precipitation days in the basic precipitation data after the screening is completed and the corresponding annual reference precipitation days in the remote sensing precipitation data;
when the difference value between the annual precipitation days and the annual reference precipitation days meets a preset missing data judging condition, counting the date on which the basic precipitation data after screening is completed is zero, and determining whether remote sensing precipitation data corresponding to each date is larger than zero;
and if the remote sensing precipitation data is larger than zero, filling the precipitation data corresponding to the date on which the basic precipitation data is zero by utilizing the corresponding remote sensing precipitation data, so as to obtain the target precipitation data.
10. The precipitation data construction method according to claim 1, wherein the filling of the missing period precipitation data in the screened basic precipitation data by the remote sensing precipitation data further comprises:
And when filling the missing period precipitation data in the basic precipitation data after the screening is completed through the remote sensing precipitation data, marking the filled precipitation data through a tag so as to determine the filling data in the target precipitation data through the tag.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410166502.5A CN117708113B (en) | 2024-02-06 | 2024-02-06 | Precipitation data construction method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410166502.5A CN117708113B (en) | 2024-02-06 | 2024-02-06 | Precipitation data construction method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN117708113A true CN117708113A (en) | 2024-03-15 |
CN117708113B CN117708113B (en) | 2024-05-17 |
Family
ID=90162875
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410166502.5A Active CN117708113B (en) | 2024-02-06 | 2024-02-06 | Precipitation data construction method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN117708113B (en) |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20170134830A (en) * | 2016-05-26 | 2017-12-07 | 경상대학교산학협력단 | Bias correction method of extreme precipitation data in global climate model using mixture distributions |
US20190018918A1 (en) * | 2017-07-11 | 2019-01-17 | The Trustees Of Princeton University | System and method for performing accurate hydrologic determination using disparate weather data sources |
CN110118982A (en) * | 2019-04-12 | 2019-08-13 | 大连理工大学 | A kind of satellite precipitation data bearing calibration based on space optimization interpolation |
CN113205155A (en) * | 2021-05-27 | 2021-08-03 | 中国水利水电科学研究院 | Multi-source precipitation data fusion method based on partition self-adaptive weight |
CN113516406A (en) * | 2021-07-30 | 2021-10-19 | 中国气象局气象探测中心 | High-speed rail line rainfall measurement point arrangement method based on real-time observation and analysis |
CN114114198A (en) * | 2022-01-27 | 2022-03-01 | 江西省气象信息中心(江西省气象培训中心、江西省农村经济信息中心) | Precipitation data quality control method and device, storage medium and equipment |
CN114118640A (en) * | 2022-01-29 | 2022-03-01 | 中国长江三峡集团有限公司 | Long-term precipitation prediction model construction method, long-term precipitation prediction method and device |
CN116070792A (en) * | 2023-03-28 | 2023-05-05 | 中国科学院地理科学与资源研究所 | Fusion method, device, storage medium and equipment of multi-source precipitation data |
CN116822185A (en) * | 2023-06-20 | 2023-09-29 | 河南科技大学 | Daily precipitation data space simulation method and system based on HASM |
CN116910041A (en) * | 2023-06-21 | 2023-10-20 | 中国水利水电科学研究院 | Daily correction method for remote sensing precipitation product based on scale analysis |
CN117290675A (en) * | 2023-11-27 | 2023-12-26 | 中国电建集团西北勘测设计研究院有限公司 | Precipitation data processing method and device, storage medium and electronic equipment |
-
2024
- 2024-02-06 CN CN202410166502.5A patent/CN117708113B/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20170134830A (en) * | 2016-05-26 | 2017-12-07 | 경상대학교산학협력단 | Bias correction method of extreme precipitation data in global climate model using mixture distributions |
US20190018918A1 (en) * | 2017-07-11 | 2019-01-17 | The Trustees Of Princeton University | System and method for performing accurate hydrologic determination using disparate weather data sources |
CN110118982A (en) * | 2019-04-12 | 2019-08-13 | 大连理工大学 | A kind of satellite precipitation data bearing calibration based on space optimization interpolation |
CN113205155A (en) * | 2021-05-27 | 2021-08-03 | 中国水利水电科学研究院 | Multi-source precipitation data fusion method based on partition self-adaptive weight |
CN113516406A (en) * | 2021-07-30 | 2021-10-19 | 中国气象局气象探测中心 | High-speed rail line rainfall measurement point arrangement method based on real-time observation and analysis |
CN114114198A (en) * | 2022-01-27 | 2022-03-01 | 江西省气象信息中心(江西省气象培训中心、江西省农村经济信息中心) | Precipitation data quality control method and device, storage medium and equipment |
CN114118640A (en) * | 2022-01-29 | 2022-03-01 | 中国长江三峡集团有限公司 | Long-term precipitation prediction model construction method, long-term precipitation prediction method and device |
CN116070792A (en) * | 2023-03-28 | 2023-05-05 | 中国科学院地理科学与资源研究所 | Fusion method, device, storage medium and equipment of multi-source precipitation data |
CN116822185A (en) * | 2023-06-20 | 2023-09-29 | 河南科技大学 | Daily precipitation data space simulation method and system based on HASM |
CN116910041A (en) * | 2023-06-21 | 2023-10-20 | 中国水利水电科学研究院 | Daily correction method for remote sensing precipitation product based on scale analysis |
CN117290675A (en) * | 2023-11-27 | 2023-12-26 | 中国电建集团西北勘测设计研究院有限公司 | Precipitation data processing method and device, storage medium and electronic equipment |
Non-Patent Citations (4)
Title |
---|
WANDERS, N.: "Correction of real-time satellite precipitation with multi-sensor satellite observations of land surface variables", 《REMOTE SENSING OF ENVIRONMENT》, vol. 160, 15 April 2015 (2015-04-15) * |
于杨;朱晨;赵琦;徐文慧;杨溯;江慧;李庆祥;沈秋宇;: "全球地面气温和降水定时值数据整合与初步质量控制", 气象与环境学报, no. 06, 15 December 2016 (2016-12-15) * |
王根;盛绍学;黄勇;吴蓉;刘惠兰;: "基于不适定反问题求解的降水图像降尺度研究", 地球科学进展, no. 10, 10 October 2017 (2017-10-10) * |
董甲平: "遥感数据驱动的降水量高精度评价方法", 《中国优秀硕士学位论文全文数据库(基础科学辑)》, no. 1, 15 January 2024 (2024-01-15) * |
Also Published As
Publication number | Publication date |
---|---|
CN117708113B (en) | 2024-05-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110306605B (en) | Early warning system for automatic monitoring of foundation pit engineering | |
CN112200358B (en) | Landslide level prediction method, landslide level prediction device, landslide level prediction equipment and storage medium | |
CN113051519B (en) | Ground settlement early warning monitoring system based on geophysics | |
CN109933637B (en) | Flood risk dynamic display and analysis system | |
CN112308292A (en) | Method for drawing fire risk grade distribution map | |
CN116050624B (en) | Comprehensive monitoring method and system for highway construction | |
JP2020134300A (en) | Prediction method, prediction program and information processing apparatus | |
CN116822185B (en) | Daily precipitation data space simulation method and system based on HASM | |
CN117290675B (en) | Precipitation data processing method and device, storage medium and electronic equipment | |
JP2022172962A (en) | Landslide disaster prediction method and landslide disaster prediction device | |
CN116703004B (en) | Water system river basin intelligent patrol method and device based on pre-training model | |
CN114413834A (en) | High-precision settlement monitoring method based on Beidou/GPS positioning system | |
CN115577011A (en) | Power transmission line monitoring method and related equipment | |
CN117708113B (en) | Precipitation data construction method | |
CN112016744B (en) | Forest fire prediction method and device based on soil moisture and storage medium | |
CN116151482B (en) | Method, device, equipment and medium for predicting mining earthwork of open-pit mining area | |
CN116151437A (en) | Shallow collapse disaster early warning model establishment method, device, equipment and medium | |
CN113807724A (en) | Site selection method for spoil disposal site based on comprehensive risk evaluation | |
CN116546171B (en) | Monitoring equipment data acquisition method | |
CN117828384B (en) | Geological disaster risk point monitoring and emergency response system and method | |
Bitew et al. | Curating 62 years of Walnut Gulch Experimental Watershed dataset: Improving QAQC methods of rainfall and runoff measurements. | |
Chakrapani Lekha | Developing a regional scale landslide early warning system in a data-sparse region using remote sensing, geostatistics, and Google Earth Engine | |
Lekha | Developing a Regional Scale Landslide Early Warning System in a Data-Sparse Region Using Remote Sensing, Geostatistics, and Google Earth Engine | |
CN117669868A (en) | Genetic intelligent moon exploration site selection method and device considering exploration value index | |
Singh | Detecting and assessing the impacts of outlier events and data availability on design rainfall and flood estimation in South Africa. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |