CN111103635A - Meteorological data processing method, system, electronic equipment and storage medium - Google Patents
Meteorological data processing method, system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111103635A CN111103635A CN201911225012.3A CN201911225012A CN111103635A CN 111103635 A CN111103635 A CN 111103635A CN 201911225012 A CN201911225012 A CN 201911225012A CN 111103635 A CN111103635 A CN 111103635A
- Authority
- CN
- China
- Prior art keywords
- data
- meteorological
- format
- source data
- variable
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01W—METEOROLOGY
- G01W1/00—Meteorology
- G01W1/10—Devices for predicting weather conditions
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01W—METEOROLOGY
- G01W1/00—Meteorology
- G01W1/02—Instruments for indicating weather conditions by measuring two or more variables, e.g. humidity, pressure, temperature, cloud cover or wind speed
Landscapes
- Environmental & Geological Engineering (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Atmospheric Sciences (AREA)
- Biodiversity & Conservation Biology (AREA)
- Ecology (AREA)
- Environmental Sciences (AREA)
- Stored Programmes (AREA)
Abstract
The application provides a meteorological data processing method, a system, an electronic device and a storage medium, wherein the meteorological data processing method comprises the following steps: acquiring meteorological source data; judging the data format of the meteorological source data; analyzing the meteorological source data according to the data format of the meteorological source data and a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data, and extracting the required meteorological variable data from the meteorological source data; and converting the extracted meteorological variable data into output data in a preset format and outputting the output data in the preset format. The invention is applied to a WRF mode preprocessing module, meets the requirement of simultaneously compatible two data inputs of a GRIB data format and a NetCDF data format, can output an intermediate format which can be recognized by the preprocessing module, avoids the difficulty of writing in the GRIB format, and greatly expands the application scenes of WRF mode service and scientific research.
Description
Technical Field
The application relates to the technical field of meteorological research, in particular to the technical field of meteorological data analysis and processing, and specifically relates to a meteorological data processing method, a meteorological data processing system, electronic equipment and a storage medium.
Background
The WRF (Weather Research Forecast model) model is a numerical model commonly used in the Weather field, and it can be used for both business and Research. Since its release in 2000, WRF has evolved gradually to become one of the most prevalent weather patterns in the world. As a regional scale model, using WRF requires that weather data of larger spatial scale (typically global model weather data) be input into the model, resulting in higher resolution weather elements. The WRF mode includes a pre-processing module, a main module and a post-processing module. The preprocessing module wps (wrfpreprocessing system) includes three submodules, namely, geogid, ungrid, and metgrid, and their functions are: geogrid defines model projection, region range and nesting relation, and interpolates earth surface parameters; extracting the required meteorological variables from the GRIB format meteorological data by ungrib, and writing the meteorological variables into an intermedia format (a common binary format); metgrid interpolates meteorological variables in the intermediate format to the geogid-defined region.
GRIB is a binary format proposed and passed by the world weather organization (WMO) in the form of compressed data representations, typically with compression rates above 50%, that can be used to efficiently store and transmit physical fields of weather and oceans and metadata describing them, including both versions of GRIB1 and GRIB 2. However, the coding of the GRIB format is complex, a large number of templates are used, and GRIB data templates issued by different meteorological agencies are different, which brings great difficulty to users. Although some tools have been available for reading GRIB data, writing GRIB data remains a significant challenge for the average user.
The NetCDF data format was developed by the University of america atmospheric Research association (University Corporation for atomic Research, UCAR) Unidata project scientist for the characteristics of scientific data, and is a data description and encoding standard oriented to array type and suitable for network sharing. NetCDF is widely applied to the fields of atmospheric science, hydrology, oceanography, environmental simulation and the like, and data products of a plurality of meteorological modes at home and abroad are in a NetCDF format. The user can read and write NetCDF formatted data by means of various tools and software.
At present, the WRF mode only supports meteorological data in GRIB format as input, as mentioned above, writing in GRIB format data is very difficult for general users, and the use scene of the WRF mode is greatly limited, so that a user-friendly program interface compatible with GRIB and NetCDF formats is developed, meteorological data in different formats can smoothly enter a WRF pretreatment module, and numerical simulation or forecast is carried out, and the WRF mode has very obvious practical value for business and scientific research.
Content of application
In view of the above-mentioned shortcomings of the prior art, the present application aims to provide a meteorological data processing method, system, electronic device and storage medium, which are used for solving the technical problem that the WRF mode is not compatible with multiple format data input in the prior art.
To achieve the above and other related objects, a first aspect of the present application provides a meteorological data processing method, including: acquiring meteorological source data; judging the data format of the meteorological source data; analyzing the meteorological source data according to the data format of the meteorological source data and a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data, and extracting the required meteorological variable data from the meteorological source data; and converting the extracted meteorological variable data into output data in a preset format and outputting the output data in the preset format.
In some embodiments of the first aspect of the present application, the analyzing the weather source data, and the extracting the required weather variable data from the weather source data includes: calling a data analysis processing program corresponding to the data format according to the data format of the meteorological source data; and the data analysis processing program analyzes the meteorological source data and extracts the required meteorological variable data from the meteorological source data according to a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data.
In some embodiments of the first aspect of the present application, the meteorological data processing method further comprises: and configuring a data analysis processing program according to the library function of the ecCodes software library or the library function of the NetCDF software library.
In some embodiments of the first aspect of the present application, the determining the data format of the weather source data is performed by: and judging the data format of the meteorological source data according to the file extension of the meteorological source data or judging the data format of the meteorological source data according to the keyword parameters of the meteorological source data.
In some embodiments of the first aspect of the present application, the meteorological data processing method further comprises: configuring the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data; and generating a configuration file according to the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data.
In some embodiments of the first aspect of the present application, the data format of the weather source data comprises: NetCDF data format and GRIB data format; the preset format is an intermedate format.
To achieve the above and other related objects, a second aspect of the present application provides a weather data processing system, comprising: the source data acquisition module is used for acquiring meteorological source data; the data format judging module is used for judging the data format of the meteorological source data; the analysis extraction module is used for analyzing the meteorological source data according to the data format of the meteorological source data and a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data, and extracting the required meteorological variable data from the meteorological source data; and the output module is used for converting the extracted meteorological variable data into output data in a preset format and outputting the output data in the preset format.
In some embodiments of the second aspect of the present application, the meteorological data processing system further comprises: and the configuration module is used for configuring the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data and generating a configuration file according to the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data.
To achieve the above and other related objects, a third aspect of the present application provides an electronic terminal comprising: a processor and a memory; the memory is used for storing a computer program; the processor is used for executing the computer program stored by the memory so as to enable the electronic terminal to execute the meteorological data processing method.
To achieve the above and other related objects, a fourth aspect of the present application is a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a weather data processing method as described above.
As described above, the meteorological data processing method, system, electronic device, and storage medium according to the present application have the following advantageous effects:
the invention is applied to a WRF mode preprocessing module, meets the requirement of simultaneously compatible two data inputs of a GRIB data format and a NetCDF data format, directly decodes the data of the two formats through corresponding analysis programs respectively, extracts required variable data, and can output an intermedate format which can be recognized by the preprocessing module, thereby avoiding the difficulty of writing in the GRIB format and greatly expanding the application scenes of WRF mode service and scientific research.
Drawings
Fig. 1 is a schematic overall flow chart of a meteorological data processing method according to an embodiment of the present application.
FIG. 2 is a flowchart illustrating an exemplary implementation of the meteorological data processing method according to an embodiment of the present application.
FIG. 3 is a flowchart illustrating a configuration file of a weather data processing method according to an embodiment of the present application.
FIG. 4 is a schematic block diagram of a meteorological data processing system in an embodiment of the present application.
FIG. 5 is a schematic block diagram of a preferred embodiment of a weather data processing system according to the present application.
Fig. 6 is a schematic structural diagram of an electronic terminal according to an embodiment of the present application.
Description of the element reference numerals
100 meteorological data processing system
110 source data acquisition module
120 data format judging module
130 analysis and extraction module
140 output module
150 configuration module
1101 processor
1102 memory
S100 to S400
S110 to S120
Detailed Description
The following description of the embodiments of the present application is provided by way of specific examples, and other advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure herein. The present application is capable of other and different embodiments and its several details are capable of modifications and/or changes in various respects, all without departing from the spirit of the present application. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," and/or "comprising," when used in this specification, specify the presence of stated features, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, operations, elements, components, items, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "either: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions or operations are inherently mutually exclusive in some way.
The embodiment provides a meteorological data processing method, a meteorological data processing system, electronic equipment and a storage medium, and is used for solving the technical problem that a WRF mode is incompatible with data input in multiple formats in the prior art.
The meteorological data processing related to this embodiment is applicable to meteorological data preprocessing interface of WRF mode, and this interface is compatible with the meteorological data of GRIB and NetCDF data format, compiles the reading procedure of commonality respectively to different data format, and through judging the format of input meteorological data, the reading procedure of corresponding format is called to the use, extracts the meteorological variable that WRF mode needs and writes into the intermedium format, supplies direct use of sub-module metgrid of WRF preprocessing module WPS, supports Fortran, C and Python language.
The principles and embodiments of a weather data processing method, system, electronic device and storage medium according to the present embodiment will be described in detail below, so that those skilled in the art can understand a weather data processing method, system, electronic device and storage medium according to the present embodiment without any creative work.
Fig. 1 is a flow chart showing a meteorological data processing method according to an embodiment of the invention.
It should be noted that the meteorological data processing method can be applied to various types of hardware devices. The hardware device is, for example, a controller, specifically, an arm (advanced RISC machines) controller, an fpga (field programmable Gate array) controller, a soc (system on chip) controller, a dsp (digital signal processing) controller, or an mcu (micro controller unit) controller, etc. The hardware devices may also be, for example, a computer that includes components such as memory, a memory controller, one or more processing units (CPUs), a peripheral interface, RF circuitry, audio circuitry, speakers, a microphone, an input/output (I/O) subsystem, a display screen, other output or control devices, and external ports; the computer includes, but is not limited to, Personal computers such as desktop computers, notebook computers, tablet computers, smart phones, smart televisions, Personal Digital Assistants (PDAs), and the like. In other embodiments, the hardware device may also be a server, where the server may be arranged on one or more entity servers according to various factors such as functions and loads, or may be formed by a distributed or centralized server cluster, and this embodiment is not limited in this embodiment.
As shown in fig. 1, in the present embodiment, the meteorological data processing method includes steps S100 to S400.
Step S100, acquiring meteorological source data;
step S200, judging the data format of the meteorological source data;
step S300, analyzing the meteorological source data according to the data format of the meteorological source data and a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data, and extracting the required meteorological variable data from the meteorological source data;
step S400, converting the extracted meteorological variable data into output data in a preset format and outputting the output data in the preset format.
The following describes steps S100 to S400 of the meteorological data processing method in this embodiment in detail.
The meteorological data processing method of the embodiment can form a user-friendly program interface compatible with GRIB and NetCDF formats, so that meteorological data in different formats can smoothly enter the WRF preprocessing module, numerical simulation or forecasting is carried out, and the method has very obvious practical value for business and scientific research.
And step S100, acquiring meteorological source data.
In this embodiment, as shown in fig. 2, the Weather source data, i.e., the Global model Weather data, is input to the WRF model, such as Global Forecast System (GFS) model Forecast data product provided by National center for environmental Forecast (NCEP), which is a Weather data input source of the WRF model commonly used in service Forecast, in the format of GRIB, or ERA-Interim data set provided by European center for Medium-Range Weather Forecasts (ECMWF), which is commonly used in Weather research, which can also be used for input to the WRF model, and which provides both formats of GRIB and NetCDF.
Therefore, in this embodiment, the data format of the weather source data input to the WRF mode includes: NetCDF data format and GRIB data format.
And S200, judging the data format of the meteorological source data.
Specifically, in the embodiments, the manner of determining the data format of the weather source data is as follows: and judging the data format of the meteorological source data according to the file extension of the meteorological source data or judging the data format of the meteorological source data according to the keyword parameters of the meteorological source data.
Specifically, by default, the file extension of the weather source data is determined to be in the NetCDF format if nc is the default, and is determined to be in the GRIB format if grb, GRIB, grb2, GRIB2 and the like, or the format of the data may be specified according to the keyword parameter of the weather source data, for example, format "NetCDF" or format "GRIB".
Step S300, analyzing the meteorological source data according to the data format of the meteorological source data and a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data, and extracting the required meteorological variable data from the meteorological source data.
In this embodiment, the corresponding relationship between the meteorological variable data to be extracted and the variable data in the meteorological source data needs to be configured in advance.
In this embodiment, as shown in fig. 3, the meteorological data processing method further includes:
step S110, configuring the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data;
and step S120, generating a configuration file according to the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data.
Specifically, the corresponding relation of variables in the data file of the meteorological source data and the meteorological variable data to be extracted is configured, and a configuration file configure. The weather variable data required to be input for operating the WRF mode include, but are not limited to, air temperature, surface air pressure, humidity, wind vector and the like, the variables are named fixedly, and the weather source data (global mode weather data) also contains the variables, but the names are usually not consistent, so that the one-to-one correspondence relationship between the two is required to be specified so as to extract the variables from the global mode weather data subsequently.
For example, the WRF mode requires input air temperature, surface air pressure, and humidity named TT, PSFC, and RH in sequence, and the corresponding variable names of these meteorological variables in the GFS data are TMP _ P0_ L1_ GLL0, PRES _ P0_ L1_ GLL0, and RH _ P0_ L100_ GLL0, respectively.
Json is the following form:
{
“TT”:“TMP_P0_L1_GLL0”
“PSFC”:“PRES_P0_L1_GLL0”
“RH”:“RH_P0_L100_GLL0”
......
}。
in this embodiment, as shown in fig. 2, the analyzing the weather source data and extracting the weather variable data from the weather source data includes:
calling a data analysis processing program corresponding to the data format according to the data format of the meteorological source data; and the data analysis processing program analyzes the meteorological source data and extracts the required meteorological variable data from the meteorological source data according to a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data.
In this embodiment, the data format of the weather source data includes: NetCDF data format and GRIB data format; and respectively writing corresponding interface programs aiming at the two data formats, and extracting variable parameters required by the WRF mode.
In this embodiment, the meteorological data processing method further includes: and configuring a data analysis processing program according to the library function of the ecCodes software library or the library function of the NetCDF software library.
Specifically, for a meteorological source data analysis processing program in a NetCDF data format, the data analysis processing program analyzes the meteorological source data, and extracts required meteorological variable data from the meteorological source data according to a configuration file containing a correspondence between meteorological variable data to be extracted and variable data in the meteorological source data, as follows:
and customizing a universal decoding program interface according to a NetCDF software library provided by Unidata. The NetCDF software library provides library functions of Fortran, C and Python languages, and can directly operate on NetCDF files.
Taking Fortran language as an example, the library function nf90_ open () opens a certain NetCDF file, nf90_ get _ var () reads a certain variable in the file, and nf90_ close () closes the NetCDF file. The functions are further packaged, customized decoding program interfaces get _ NetCDF _ variables (NetCDF _ filename, config _ filename, variables) are written, and reading of a plurality of variables is achieved, wherein NetCDF _ filename is a NetCDF file name, config _ filename is a configuration file name, and variables are arrays formed by the plurality of variables to be returned. When the interface is called, the config _ filename is specified to a preset configuration file configuration.
Specifically, for a meteorological source data configuration data analysis processing program in the GRIB data format, the data analysis processing program analyzes the meteorological source data, and extracts required meteorological variable data from the meteorological source data according to a configuration file containing a correspondence between meteorological variable data to be extracted and variable data in the meteorological source data, as follows:
the decoding program interface in GRIB format is customized according to the ecCodes software library provided by ECMWF. The ecCodes software library also supports the Fortran, C and Python languages for reading GRIB files. Still taking the Fortran language as an example, the ecodes software library provides the function codes _ open _ file () to open the GRIB file, codes _ get () to read a certain variable, and codes _ close _ file () to close the GRIB file. The functions are packaged into customized decoding program interfaces get _ grid _ variables (grid _ file, config _ file, variables), wherein the grid _ file is a GRIB file name, when the interfaces are called, the grid _ file is specified as a pre-configured configuration file configuration.
Step S400, converting the extracted meteorological variable data into output data in a preset format and outputting the output data in the preset format.
Specifically, in the present embodiment, the preset format is, but not limited to, an intermediate format.
The interleave format is a binary format stored sequentially, in short, the binary format storing variables in a certain order, and the WRF official manual gives a Fortran program code fragment for outputting data in the interleave format. Function put _ intermediate _ variables (variables) of Fortran, C and Python languages which also output the intermediate format data are written according to the code segment, wherein the intermediate _ file is the file name of the intermediate format to be output, and the variables are variables required by the WRF mode obtained in step S300. The file in the intermediate format can be directly used by a submodule metgrid of a WRF pretreatment module WPS, so that data products in various meteorological modes can be input into the WRF without using an ungrib module, and business and scientific research activities can be carried out.
As can be seen from the above, the present embodiment is compatible with the widely used data formats of GRIB and NetCDF in the meteorological field, supports direct decoding of the data in the two formats, and writes the data in the intermedate format that can be recognized by the preprocessing module, thereby avoiding the difficulty of writing in the GRIB format, and greatly extending the application scenarios of WRF mode services and scientific research.
As shown in fig. 4, the present embodiment further provides a meteorological data processing system 100, where the meteorological data processing system 100 includes: a source data obtaining module 110, a data format determining module 120, an analyzing and extracting module 130 and an output module 140.
In this embodiment, the source data obtaining module 110 is configured to obtain meteorological source data; the data format judging module 120 is configured to judge a data format of the weather source data; the analyzing and extracting module 130 is configured to analyze the weather source data according to the data format of the weather source data and a configuration file containing a corresponding relationship between the weather variable data to be extracted and the variable data in the weather source data, and extract the required weather variable data from the weather source data; the output module 140 is configured to convert the extracted meteorological variable data into output data in a preset format and output the output data in the preset format.
In this embodiment, as shown in fig. 5, the weather data processing system 100 further includes: the configuration module 150 is configured to configure a corresponding relationship between the meteorological variable data to be extracted and the variable data in the meteorological source data, and generate a configuration file according to the corresponding relationship between the meteorological variable data to be extracted and the variable data in the meteorological source data.
The technical features of the weather data processing system 100 of this embodiment are basically the same as those of the weather data processing method in the foregoing embodiments, and the technical contents that can be used in the embodiments are not repeated.
It should be noted that the division of the modules of the above apparatus is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the configuration module 150 may be a separate processing element, or may be integrated into a chip of an electronic terminal, or may be stored in a memory of the terminal in the form of program codes, and a processing element of the terminal calls and executes the functions of the tracking calculation module. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.
For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. For another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
As shown in fig. 6, a schematic structural diagram of an electronic terminal in an embodiment of the present application is shown, where the electronic terminal includes a processor 1101 and a memory 1102; the memory 1102 is connected to the processor 1101 through a system bus to complete communication between the processor 1102 and the memory 1101, the memory 1102 is used for storing computer programs, and the processor 1101 is used for operating the computer programs, so that the electronic terminal executes the meteorological data processing method. The meteorological data processing method has already been described in detail above, and is not described herein again.
It should be noted that the above-mentioned system bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The system bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus. The communication interface is used for realizing communication between the database access system and other devices (such as a client, a read-write library and a read-only library). The Memory may include a Random Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory.
The Processor 1101 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the device can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
Furthermore, the present embodiment also provides a computer-readable storage medium on which a computer program is stored, which, when executed by a processor, implements the weather data processing method. The meteorological data processing method has already been described in detail above, and is not described herein again.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the above method embodiments may be performed by hardware associated with a computer program. The aforementioned computer program may be stored in a computer readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
In summary, the invention is applied to the WRF mode preprocessing module, meets the requirement of simultaneously compatible two data inputs of the GRIB data format and the NetCDF data format, directly decodes the data of the two formats through corresponding analysis programs respectively, extracts the required variable data, and can output the intermediate format recognizable by the preprocessing module, thereby avoiding the difficulty of writing in the GRIB format and greatly expanding the application scenes of WRF mode services and scientific researches. Therefore, the application effectively overcomes various defects in the prior art and has high industrial utilization value.
The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical concepts disclosed in the present application shall be covered by the claims of the present application.
Claims (10)
1. A meteorological data processing method is characterized in that: the meteorological data processing method comprises the following steps:
acquiring meteorological source data;
judging the data format of the meteorological source data;
analyzing the meteorological source data according to the data format of the meteorological source data and a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data, and extracting the required meteorological variable data from the meteorological source data;
and converting the extracted meteorological variable data into output data in a preset format and outputting the output data in the preset format.
2. The meteorological data processing method according to claim 1, wherein: the analyzing the meteorological source data, and the extracting the required meteorological variable data from the meteorological source data comprises:
calling a data analysis processing program corresponding to the data format according to the data format of the meteorological source data;
and the data analysis processing program analyzes the meteorological source data and extracts the required meteorological variable data from the meteorological source data according to a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data.
3. The meteorological data processing method according to claim 2, wherein: the meteorological data processing method further comprises the following steps:
and configuring a data analysis processing program according to the library function of the ecCodes software library or the library function of the NetCDF software library.
4. The meteorological data processing method according to claim 1, wherein: the mode for judging the data format of the meteorological source data is as follows: and judging the data format of the meteorological source data according to the file extension of the meteorological source data or judging the data format of the meteorological source data according to the keyword parameters of the meteorological source data.
5. The meteorological data processing method according to claim 1, wherein: the meteorological data processing method further comprises the following steps:
configuring the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data;
and generating a configuration file according to the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data.
6. The meteorological data processing method according to claim 1, wherein: the data format of the meteorological source data comprises: NetCDF data format and GRIB data format; the preset format is an intermedate format.
7. A meteorological data processing system, comprising: the meteorological data processing system includes:
the source data acquisition module is used for acquiring meteorological source data;
the data format judging module is used for judging the data format of the meteorological source data;
the analysis extraction module is used for analyzing the meteorological source data according to the data format of the meteorological source data and a configuration file containing the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data, and extracting the required meteorological variable data from the meteorological source data;
and the output module is used for converting the extracted meteorological variable data into output data in a preset format and outputting the output data in the preset format.
8. The meteorological data processing system of claim 7, wherein: the meteorological data processing system further comprises:
and the configuration module is used for configuring the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data and generating a configuration file according to the corresponding relation between the meteorological variable data to be extracted and the variable data in the meteorological source data.
9. An electronic terminal, characterized by: the method comprises the following steps: a processor and a memory;
the memory is used for storing a computer program;
the processor is configured to execute the computer program stored in the memory to cause the electronic terminal to execute the weather data processing method according to any one of claims 1 to 7.
10. A computer-readable storage medium having stored thereon a computer program, characterized in that: the computer program, when executed by a processor, implements the meteorological data processing method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911225012.3A CN111103635A (en) | 2019-12-04 | 2019-12-04 | Meteorological data processing method, system, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911225012.3A CN111103635A (en) | 2019-12-04 | 2019-12-04 | Meteorological data processing method, system, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111103635A true CN111103635A (en) | 2020-05-05 |
Family
ID=70421531
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911225012.3A Pending CN111103635A (en) | 2019-12-04 | 2019-12-04 | Meteorological data processing method, system, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111103635A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111629001A (en) * | 2020-05-27 | 2020-09-04 | 上海眼控科技股份有限公司 | Meteorological message generation method and device, computer equipment and storage medium |
| CN111679345A (en) * | 2020-05-18 | 2020-09-18 | 上海眼控科技股份有限公司 | Method and equipment for extracting aeronautical meteorological element values |
| CN112000728A (en) * | 2020-10-29 | 2020-11-27 | 上海爱可生信息技术股份有限公司 | Business data processing method, readable storage medium and computer equipment |
| CN114325877A (en) * | 2020-09-30 | 2022-04-12 | 北京金风慧能技术有限公司 | Method and device for evaluating weather forecast data |
| CN114911853A (en) * | 2022-04-20 | 2022-08-16 | 中山大学 | Python-based hydrological meteorological data area scale extraction and visualization method |
| CN116010525A (en) * | 2023-02-02 | 2023-04-25 | 国家气象信息中心(中国气象局气象数据中心) | Meteorological mode data decoding processing method |
| CN114325877B (en) * | 2020-09-30 | 2024-05-17 | 北京金风慧能技术有限公司 | Assessment method and device for weather forecast data |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103297845A (en) * | 2013-04-26 | 2013-09-11 | 东莞宇龙通信科技有限公司 | Method and son-machine for realizing media playing |
| CN107122497A (en) * | 2017-05-25 | 2017-09-01 | 北京微影时代科技有限公司 | Data processing method, device, electronic equipment and computer-readable recording medium |
| CN107798059A (en) * | 2017-09-08 | 2018-03-13 | 中国电力科学研究院 | A kind of NCO meteorological datas structured storage method and apparatus |
| CN109711145A (en) * | 2018-11-09 | 2019-05-03 | 深圳壹账通智能科技有限公司 | Data verification method and device, storage medium, computer equipment |
| CN110110448A (en) * | 2019-05-10 | 2019-08-09 | 珠海深圳清华大学研究院创新中心 | A kind of weather simulation method based on WRF, system and readable storage medium storing program for executing |
| CN110162510A (en) * | 2019-04-26 | 2019-08-23 | 平安普惠企业管理有限公司 | Transcription comparison method, device, computer equipment and storage medium |
| CN110363169A (en) * | 2019-07-19 | 2019-10-22 | 南方电网科学研究院有限责任公司 | Identification device, equipment and the system of a kind of power grid key equipment and component |
| CN110532319A (en) * | 2019-07-22 | 2019-12-03 | 广东华风海洋信息系统服务有限公司 | A kind of distribution meteorological data timing processing system |
-
2019
- 2019-12-04 CN CN201911225012.3A patent/CN111103635A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103297845A (en) * | 2013-04-26 | 2013-09-11 | 东莞宇龙通信科技有限公司 | Method and son-machine for realizing media playing |
| CN107122497A (en) * | 2017-05-25 | 2017-09-01 | 北京微影时代科技有限公司 | Data processing method, device, electronic equipment and computer-readable recording medium |
| CN107798059A (en) * | 2017-09-08 | 2018-03-13 | 中国电力科学研究院 | A kind of NCO meteorological datas structured storage method and apparatus |
| CN109711145A (en) * | 2018-11-09 | 2019-05-03 | 深圳壹账通智能科技有限公司 | Data verification method and device, storage medium, computer equipment |
| CN110162510A (en) * | 2019-04-26 | 2019-08-23 | 平安普惠企业管理有限公司 | Transcription comparison method, device, computer equipment and storage medium |
| CN110110448A (en) * | 2019-05-10 | 2019-08-09 | 珠海深圳清华大学研究院创新中心 | A kind of weather simulation method based on WRF, system and readable storage medium storing program for executing |
| CN110363169A (en) * | 2019-07-19 | 2019-10-22 | 南方电网科学研究院有限责任公司 | Identification device, equipment and the system of a kind of power grid key equipment and component |
| CN110532319A (en) * | 2019-07-22 | 2019-12-03 | 广东华风海洋信息系统服务有限公司 | A kind of distribution meteorological data timing processing system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111679345A (en) * | 2020-05-18 | 2020-09-18 | 上海眼控科技股份有限公司 | Method and equipment for extracting aeronautical meteorological element values |
| CN111629001A (en) * | 2020-05-27 | 2020-09-04 | 上海眼控科技股份有限公司 | Meteorological message generation method and device, computer equipment and storage medium |
| CN114325877A (en) * | 2020-09-30 | 2022-04-12 | 北京金风慧能技术有限公司 | Method and device for evaluating weather forecast data |
| CN114325877B (en) * | 2020-09-30 | 2024-05-17 | 北京金风慧能技术有限公司 | Assessment method and device for weather forecast data |
| CN112000728A (en) * | 2020-10-29 | 2020-11-27 | 上海爱可生信息技术股份有限公司 | Business data processing method, readable storage medium and computer equipment |
| CN114911853A (en) * | 2022-04-20 | 2022-08-16 | 中山大学 | Python-based hydrological meteorological data area scale extraction and visualization method |
| CN116010525A (en) * | 2023-02-02 | 2023-04-25 | 国家气象信息中心(中国气象局气象数据中心) | Meteorological mode data decoding processing method |
| CN116010525B (en) * | 2023-02-02 | 2023-10-13 | 国家气象信息中心(中国气象局气象数据中心) | Meteorological mode data decoding processing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111103635A (en) | Meteorological data processing method, system, electronic equipment and storage medium | |
| CN110019397B (en) | Method and device for data processing | |
| CN108920543B (en) | Query and interaction method and device, computer device and storage medium | |
| CN109062906B (en) | Translation method and device for program language resources | |
| CN105824974A (en) | Method and system for analyzing and processing data | |
| WO2024036662A1 (en) | Parallel graph rule mining method and apparatus based on data sampling | |
| CN114153896A (en) | Serialization and deserialization method, apparatus, device and medium thereof | |
| CN113468344B (en) | Entity relationship extraction method and device, electronic equipment and computer readable medium | |
| CN116244387A (en) | Entity relationship construction method, device, electronic equipment and storage medium | |
| CN114282895A (en) | Data processing method and device, electronic equipment and storage medium | |
| US11630663B2 (en) | Compressing multi-attribute vector into a single eigenvalue for ranking subject matter experts | |
| CN112560413B (en) | Report form expansion method, device and equipment based on configuration mode | |
| CN111191090B (en) | Method, device, equipment and storage medium for determining service data presentation graph type | |
| CN111984657B (en) | Data collection method, device, storage medium and computer equipment | |
| CN115222444A (en) | Method, apparatus, device, medium and product for outputting model information | |
| CN111143156B (en) | Big data platform garbage task acquisition system, method and computer system | |
| CN114218261A (en) | Data query method and device, storage medium and electronic equipment | |
| CN116011406A (en) | Data extraction method and device, processor and electronic equipment | |
| CN116074412B (en) | Data high-speed reading and writing method, system, equipment and readable storage medium | |
| CN113902833A (en) | Method and device for converting canvas into pdf and terminal equipment | |
| CN111027223A (en) | Method and system for generating ensemble forecasting result, electronic device and storage medium | |
| CN115757348A (en) | Micro-service architecture based data model transverse and longitudinal extension method and system | |
| CN116775599A (en) | Data migration method, device, electronic equipment and storage medium | |
| US20200244604A1 (en) | Application program interface documentations | |
| CN117951010A (en) | Function test method, function test device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200505 |
|
| RJ01 | Rejection of invention patent application after publication |