CN112765295B - Regional meteorological data splicing system - Google Patents
Regional meteorological data splicing system Download PDFInfo
- Publication number
- CN112765295B CN112765295B CN202110040186.3A CN202110040186A CN112765295B CN 112765295 B CN112765295 B CN 112765295B CN 202110040186 A CN202110040186 A CN 202110040186A CN 112765295 B CN112765295 B CN 112765295B
- Authority
- CN
- China
- Prior art keywords
- grid
- sub
- grid point
- mapping relation
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01W—METEOROLOGY
- G01W1/00—Meteorology
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Environmental & Geological Engineering (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Remote Sensing (AREA)
- Life Sciences & Earth Sciences (AREA)
- Atmospheric Sciences (AREA)
- Biodiversity & Conservation Biology (AREA)
- Ecology (AREA)
- Environmental Sciences (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A regional meteorological data splicing system relates to the technical field of computer design and solves the problems that in the existing meteorological data merging process, the merging consumption time is long, the execution efficiency is low and the like. The grid point mapping relation establishing module automatically generates a target grid according to original input data, establishes a mapping relation from input sub-area grid points to target grid points, and stores the mapping relation as a file; the grid point data mapping module applies an array for each sub-area, reads data in the sub-area into the memory, establishes a pointer array with the same shape as the target grid, wherein each element in the pointer array corresponds to a grid point at a corresponding position in the target grid, establishes a mapping relation between grids according to the grid point mapping relation, and assigns each array element to an address of the sub-area grid point data with the mapping relation.
Description
Technical Field
The invention relates to the technical field of computer design, in particular to a regional meteorological data splicing system.
Background
In the last decade, the improvement of computer computing and storage capacity provides the possibility of high-resolution numerical simulation and data assimilation of an earth system, but at present, common supercomputers still have great difficulty in simulating hundreds of meters of resolution in a large area. To solve this problem, the space region is usually divided into many sub-regions in the simulation stage, and the molecular region stores the simulation result. However, the subsequent analysis and visualization of the simulation result often requires merging the data of multiple sub-regions into a whole. The difficulty in merging the data of multiple sub-regions is that when the amount of merged data is large, the process takes too long to meet the requirements of practical applications. The research and development of regional meteorological data splicing aim at solving the problem that a large amount of data are merged and time is consumed too much.
In the past, when multi-region high-resolution meteorological data are combined, a nearest neighbor method is usually adopted to map the numerical value of each grid point of each subregion to a target grid which can contain all subregions, so that the purpose of data splicing is achieved. The process is generally carried out in two steps, firstly, the mapping relation of each grid point in two sets of grids is found out through the longitude and latitude coordinates of each grid point in the sub-area grid and the target grid, and the mapping relation is output as a file; then, the mapping of the grid point data from the sub-area grid to the target grid is performed through the mapping relation. Experience shows that when the data size is large, the time consumed by the second step is far longer than that consumed by the first step, so that the problem of large time consumption in data combination is solved, and the key point is to improve the execution efficiency of the second step.
The C language has a strong control capability on the pointer, and has the inherent advantages of the compiled language in execution efficiency, so that the C language is selected as a development language for splicing regional weather data.
Disclosure of Invention
The invention provides a regional meteorological data splicing system, aiming at solving the problems of low execution efficiency and the like caused by long merging time in the existing meteorological data merging process.
The regional meteorological data splicing system comprises two main functional modules and two auxiliary functional modules; the two main function modules are respectively a grid point mapping relation establishing module and a grid point data mapping module; the two auxiliary function modules are respectively a command line parameter analysis module and a software information output module;
the grid point mapping relation establishing module automatically generates a target grid according to original input data, establishes a mapping relation from input sub-area grid points to target grid points and stores the mapping relation as a file;
the grid point data mapping module applies for an array for each sub-area, reads data in the sub-area into a memory, establishes a pointer array with the shape consistent with that of a target grid, wherein each element in the pointer array corresponds to a grid point at a corresponding position in the target grid, establishes an inter-grid mapping relation according to the grid point mapping relation, and assigns each array element to an address of the sub-area grid point data with the mapping relation;
the command line parameter analysis module analyzes the command line parameters according to the design specification of Linux;
the software information output module provides necessary software information for users according to the design specification of Linux.
The invention has the beneficial effects that: the splicing system can simplify the original complicated area data splicing process and greatly improve the efficiency of the work.
Drawings
FIG. 1 is a schematic block diagram of a regional weather data splicing system according to the present invention;
FIG. 2 is a diagram illustrating a mapping relationship between sub-region grid points and target grid points according to the present invention.
Detailed Description
The present embodiment will be described with reference to fig. 1 and 2, and the regional weather data splicing system splices weather data of a plurality of spatial regions into a whole, and enables data splicing to be performed more efficiently by pointer operation in C language. The system comprises two main function modules and two auxiliary function modules, wherein the two main function modules comprise a grid point mapping relation establishing module and a grid point data mapping module, and the two auxiliary function modules comprise a command line parameter analyzing module and a software information output module.
The grid point mapping relation establishing module is used for establishing a relation between each grid point in the target grid and a sub-area grid point which is closest to the grid point in space distance if a plurality of sub-area grid points can be found in a certain range. The detailed flow of the module work is as follows:
d. and determining the boundary of the target grid according to the latitude and longitude ranges covered by all the sub-area grid points.
e. And calculating the longitude and latitude of each point of the target grid according to the grid distance of the given target grid.
f. And calculating the grid element in the target grid according to the latitude and longitude of each grid point of each sub-area, and recording the position of the grid in the sub-area and the position of the grid in the target grid.
g. And c, traversing each grid point of the target grid, finding out which grid points in the sub-areas fall near the target grid point according to the record in the step c, respectively calculating the space distance between the grid points of the sub-areas and the target grid point, and recording the grid point of the sub-area closest to the target grid point, namely establishing the mapping relation between the grid point and the target grid point.
The grid point data mapping module applies for an array for each sub-area first, and reads data in the sub-area into the memory. Then, a pointer array with the shape consistent with that of the target grid is established, each element in the array corresponds to a grid point at a corresponding position in the target grid, and according to the established mapping relation between grids, the address of sub-area grid point data with the mapping relation is given to each array element, and the method is combined with the graph 1.
In this embodiment, not every sub-area grid will be mapped to a certain target grid, because part of the sub-area grids will be eliminated due to the insufficient distance to the surrounding target grids. Conversely, for each target grid, there is not necessarily a sub-area grid mapped to it, because some target grids may be too far away from any sub-area grid, in which case the target grid may be assigned a missing value. After the pointer array is completed, the data mapping can be completed only by outputting the data pointed by each element of the array to the hard disk.
The command line parameter analysis module is developed by adopting the command line software specification of Linux, and the details of command line options are as follows. In order to analyze the command line options and parameters, data integration (data integration) adopts a getopt _ long function to analyze the command line options and parameters, and a special module performs corresponding processing on each option parameter. When a user executes a dataint command, the command line parameter parsing module first parses the command line options and parameters, and then determines which function module to execute and which parameters to assign to the function module. It is not in parallel with the rest of the modules, just because the command line parameter parser module determines whether other modules should be executed.
The software information output module: dataint provides display functionality for user help, software licenses, versions, etc. information that a user may invoke to display through a corresponding command line option.
Second embodiment, the present embodiment is described with reference to fig. 2, and the present embodiment is an example of the regional meteorological data splicing system according to the first embodiment: the present embodiment is developed by adopting the Linux command line tool standard in the dataint system, so the using method is similar to other Linux commands. FIG. 2 shows the relationship between the operation of modules in a dataint system.
Firstly, a user calls a grid point mapping relationship establishing module to establish a mapping relationship from each sub-area grid point in original data to a target grid point according to the original data, and the mapping relationship is output on a disk in a NetCDF format file form.
In the process, the command line parameter analysis module calls the lattice mapping relationship establishment module to generate a lattice mapping relationship file mp.nc according to input files of in01.nc, in02.nc, in03.nc and the like.
Then, the user calls the grid point data mapping module, and reads the grid point mapping relation file and the original data which are output just now together, so that the final output data can be obtained. In the process, the command line parameter analyzing module calls the lattice point data mapping module, reads input data in01.nc, in02.nc and in03.nc and other input files by using the just generated lattice point relation mapping file mp.nc, and finally splices the input data into a new data file out.nc.
The software information output module is mainly used for displaying the display functions of the information of the system, such as user help, software license, version and the like, to the user.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that various changes and modifications can be made by those skilled in the art without departing from the spirit of the invention, and these changes and modifications are all within the scope of the invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (1)
1. Regional meteorological data concatenation system, characterized by: the system comprises two main function modules and two auxiliary function modules; the two main function modules are respectively a grid point mapping relation establishing module and a grid point data mapping module; the two auxiliary function modules are respectively a command line parameter analysis module and a software information output module;
the grid point mapping relation establishing module automatically generates a target grid according to original input data, establishes a mapping relation from input sub-area grid points to target grid points and stores the mapping relation as a file;
the grid point data mapping module applies for an array for each sub-area, reads data in the sub-area into an internal memory, establishes a pointer array with the same shape as a target grid, wherein each element in the pointer array corresponds to a grid point at a corresponding position in the target grid, establishes an inter-grid mapping relation according to the grid point mapping relation, and assigns each array element to an address of sub-area grid point data with a mapping relation;
the command line parameter analysis module analyzes the command line parameters according to the design specification of Linux;
the software information output module provides necessary software information for a user according to the design specification of Linux;
the specific process of the lattice point mapping relationship establishing module is as follows:
a. determining the boundary of the target grid according to the latitude and longitude ranges covered by all the sub-area grid points;
b. calculating the longitude and latitude of each point of a given target grid according to the grid distance of the target grid;
c. calculating the grid position of each grid point in the target grid according to the longitude and latitude of each grid point of each sub-area, and recording the position of the grid in the sub-area and the position of the grid in the target grid;
d. traversing each grid point of the target grid, calculating the space distance from the sub-region grid point to the target grid point according to the position information recorded in the step c, and marking the sub-region grid point closest to the target grid point, namely: and establishing a mapping relation from the grid point to a target grid point.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110040186.3A CN112765295B (en) | 2021-01-13 | 2021-01-13 | Regional meteorological data splicing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110040186.3A CN112765295B (en) | 2021-01-13 | 2021-01-13 | Regional meteorological data splicing system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112765295A CN112765295A (en) | 2021-05-07 |
| CN112765295B true CN112765295B (en) | 2022-12-20 |
Family
ID=75699950
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110040186.3A Active CN112765295B (en) | 2021-01-13 | 2021-01-13 | Regional meteorological data splicing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112765295B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106528773A (en) * | 2016-11-07 | 2017-03-22 | 山东首讯信息技术有限公司 | Spark platform supported spatial data management-based diagram calculation system and method |
| CN112148774A (en) * | 2020-09-29 | 2020-12-29 | 华能新能源股份有限公司 | High-resolution spatial multi-region meteorological data processing system and method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB0911981D0 (en) * | 2009-07-09 | 2009-08-19 | Movix Uk Ltd | Data processing system using geographical locations |
-
2021
- 2021-01-13 CN CN202110040186.3A patent/CN112765295B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106528773A (en) * | 2016-11-07 | 2017-03-22 | 山东首讯信息技术有限公司 | Spark platform supported spatial data management-based diagram calculation system and method |
| CN112148774A (en) * | 2020-09-29 | 2020-12-29 | 华能新能源股份有限公司 | High-resolution spatial multi-region meteorological data processing system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112765295A (en) | 2021-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102541521B (en) | Automatic operating instruction generating device based on structured query language and method | |
| CN110209652B (en) | Data table migration method, device, computer equipment and storage medium | |
| CN107239392B (en) | Test method, test device, test terminal and storage medium | |
| CN104133772A (en) | Automatic test data generation method | |
| CN105528418A (en) | Design document generation method and apparatus | |
| CN110968495A (en) | Container cloud platform performance evaluation method and device | |
| CN105354138A (en) | Method for determining specific control attribute of mobile phone page | |
| CN102591787B (en) | The data processing method of JAVA card and device | |
| CN110955410A (en) | Automatic code generation method, device, equipment and medium | |
| CN111309734A (en) | Method and system for automatically generating table data | |
| CN108170602B (en) | Test case generation method and device, terminal and computer readable medium | |
| CN113688288A (en) | Data association analysis method and device, computer equipment and storage medium | |
| CN105447035A (en) | Data scanning method and apparatus | |
| CN115828873A (en) | Method and device for setting expression in electronic form | |
| CN104375211A (en) | Weather forecast contour map updating method and system | |
| CN112765295B (en) | Regional meteorological data splicing system | |
| CN111414422B (en) | Data distribution method, device, equipment and storage medium | |
| CN102722621A (en) | Method for visualizing computed result of finite element method | |
| CN112632303A (en) | Distributed storage method, analysis method and device for image data | |
| CN105446752A (en) | Triggering method and device of control in application program and mobile terminal | |
| CN109697234B (en) | Multi-attribute information query method, device, server and medium for entity | |
| CN117236111A (en) | Fastener parametric modeling method and device, terminal equipment and storage medium | |
| CN108647026B (en) | Visual interface integration method and system based on dynamic grid | |
| CN107704685B (en) | Mesh division method and device | |
| CN116208465A (en) | Intelligent monitoring and early warning method and system for electric power information communication condition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |