CN115454959B - Meteorological data verification method and system during aviation flight planning - Google Patents
Meteorological data verification method and system during aviation flight planning Download PDFInfo
- Publication number
- CN115454959B CN115454959B CN202211401594.8A CN202211401594A CN115454959B CN 115454959 B CN115454959 B CN 115454959B CN 202211401594 A CN202211401594 A CN 202211401594A CN 115454959 B CN115454959 B CN 115454959B
- Authority
- CN
- China
- Prior art keywords
- data
- server
- meteorological
- information
- weather
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
- G06F16/148—File search processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a meteorological data verification method and a system when an aviation flight plan is formulated, wherein the method comprises meteorological data storage and meteorological information verification, and the meteorological data storage step comprises the following steps: the method comprises the steps that a first server acquires meteorological data files, data blocks of the same meteorological data file are distributed to a plurality of second servers, and data node information where the data blocks are located is stored; the second server receives and stores the data block. The weather information verification step comprises the following steps: the first server confirms the time of a flying passing area according to the flying track data and generates a first weather information comparison instruction; the second server receives the first weather information comparison instruction, compares whether the weather information of the data block related to the time of the flying passing area exceeds a preset weather data threshold range or not, and feeds back a comparison result to the first server; and the first server displays the comparison result to the user. When the method is applied, the weather condition of the flight passing area time can be verified, and a user can be assisted to make a flight plan.
Description
Technical Field
The invention relates to an aviation flight safety control technology, in particular to a meteorological data verification method and a system during aviation flight planning.
Background
"flight safety" is a persistent problem in the aviation world. In recent years, record analysis on aviation safety shows that the accident rate lasting for years is not obviously improved all the time, and the accident occurrence frequency is increased along with the continuous development of civil aviation industry. In order to improve aviation safety, the ADS-B and radar monitoring data, meteorological data, intelligence data and the like are collected, and flight fault prediction analysis is performed based on the collected data, so that high attention is paid to people.
The meteorological data, one of the important information affecting aviation safety, is an indispensable link for analyzing and processing the meteorological data to predict flight faults. At present, flight fault prediction based on meteorological data is mainly used for predicting faults of running airplanes based on real-time collected meteorological data, and when flight safety risks are predicted, the risks are avoided by changing a course and the like. The existing mode of avoiding the flight safety risk of the airplane during driving based on meteorological data is adopted, the obstacle avoidance frequency is high, faults are inevitably generated due to untimely implementation of obstacle avoidance measures or nonstandard obstacle avoidance modes in the obstacle avoidance process, and therefore the probability of flight faults is increased due to the high obstacle avoidance frequency. In order to reduce the probability of failure, the training of crew members and the perfection of obstacle avoidance technology are emphasized, and the effect is very small.
Disclosure of Invention
The invention aims to solve the problem that the fault occurrence probability is high due to the fact that the existing mode of avoiding the flight safety risk of an airplane in driving based on meteorological data is adopted, and provides a meteorological data verification method in aviation flight plan formulation. The invention also discloses a system for realizing the meteorological data verification method in the process of making the aviation flight plan.
The purpose of the invention is mainly realized by the following technical scheme:
the meteorological data verification method during the formulation of the aviation flight plan is realized based on a Hadoop distributed framework, the Hadoop distributed framework comprises a Hadoop cluster formed by a plurality of servers, each server is provided with an HDFS (Hadoop distributed file system), a MapReduce and an Hbase, the HDFS comprises NameNode management nodes and DataNode data nodes, any one of the servers serves as a first server to operate the NameNode management nodes, and the other servers serve as second servers to operate the DataNode data nodes; the method comprises a meteorological data storage step and a meteorological information verification step, wherein the meteorological data storage step comprises the following steps:
s11, acquiring and processing meteorological data files by a NameNode management node of a first server, distributing data blocks of the same meteorological data file to data node data nodes of a plurality of second servers, and storing data node information of each data block in each file through Hbase of the first server; the data node information stored by the first server and each data block stored by the second server comprise area information and time information corresponding to the data block, the area information is preset information comprising altitude and position range, meteorological data of a meteorological data file is meteorological information in a certain time period of a certain area in the future, the same meteorological data file comprises a plurality of data blocks, and each data block is simultaneously distributed to the DataNode data nodes of three or more second servers;
s12, a DataNode data node of a second server receives and processes data blocks distributed by a NameNode management node of a first server and stores the data blocks, and then the data blocks are stored to Hbase in a form of a table;
the weather information verification step includes:
s21, a first server acquires and processes a flight track data file, confirms flight passing area time according to flight track data, searches data block node information including data block associated with the flight passing area time according to the flight passing area time, generates a first weather information comparison instruction and sends the first weather information comparison instruction to a second server which stores data blocks associated with the flight passing area time;
s22, the second server receives and processes the first weather information comparison instruction, compares whether the weather information of the data block associated with the time of the flying passing area exceeds a preset weather data threshold range through MapReduce of the first server, and feeds back the comparison result to the first server;
and S23, the first server receives the comparison result fed back by the second server and displays the comparison result to the user.
Further, the meteorological data storing step further includes: the method comprises the steps that a second server generates a meteorological information calling instruction for calling a certain data block according to data node information where each data block is located in each stored file and sends the meteorological information calling instruction to the second server where the data block is stored, the second server receives the meteorological information calling instruction and sends the data block stored in the second server to a first server, the first server receives the data block and conducts data consistency verification on data of the same data block stored in different second servers through MapReduce of the first server, if the data blocks are verified to be consistent, processing is not conducted, and if the data blocks are verified to be inconsistent, the verification result is fed back to a user.
Further, the meteorological data storing step further includes: the first server receives and processes data block correction information which is input by a user and contains data node information, the processed data block correction information is sent to a second server corresponding to the data node, and the second server receives the data block correction information and corrects corresponding data block parameters.
Further, the first weather information comparison instruction generated by the first server comprises second weather information comparison instructions consistent with the number of the searched data blocks related to the time of the flying passing area, and each second weather information comparison instruction corresponds to the data blocks related to the time of the flying passing area one to one; and when the first server sends each piece of second meteorological information comparison instruction to the second server, the first server sends each piece of second meteorological information comparison instruction to any one second server stored with a data block corresponding to the second meteorological information comparison instruction.
Further, when the first server sends the second weather information comparison instruction to the second servers, the first server confirms the number of data blocks, associated with the time of the flight passing area, stored in each second server according to the searched data block node information containing the time of the flight passing area, and then distributes the number of the second weather information comparison instructions, corresponding to the data blocks associated with the time of the flight passing area, received by each second server according to the confirmed number; and the first server sends each piece of second meteorological information comparison instruction to the second server, and sends the second meteorological information comparison instruction to the second server confirmed by the first server.
Further, the step of allocating, by the first server, the number of the second weather information comparison instructions received by each second server includes the following steps:
step S211, the first server sorts the second servers storing the data blocks related to the time of the flying passing area according to the number of the data blocks related to the time of the flying passing area, which are stored in each second server and confirmed by the first server, and sorts the second servers storing the data blocks related to the time of the flying passing area according to the preset second server numbers from small to large during sorting;
step S212, judging whether the second servers in the first order receive second meteorological information comparison instructions with the same number as the flying passing-through area time related data blocks stored by the second servers, if so, judging whether the received number exceeds the average value of the total number of the second meteorological information comparison instructions divided by the number of the second servers in the flying passing-through area time related data blocks, if not, receiving the second meteorological information comparison instructions with the same number as the flying passing-through area time related data blocks stored by the second servers in the first order, and if not, receiving the second meteorological information comparison instructions corresponding to the second servers in the second order and then storing the same data blocks;
step S213, after eliminating the second weather information comparison instruction received by the first ranked second server, repeating step S211 and step S212 to distribute the second weather information comparison instruction to the newly ranked first server;
and S214, after the distributed second meteorological information comparison instructions are eliminated, repeating the steps S211 to S213 until all the second meteorological information comparison instructions are distributed.
Further, the weather information of each data block includes a plurality of parameters, the second server presets a weather data threshold range corresponding to each parameter, and in the step S22, when comparing whether the weather information of the data block associated with the time of the flight passing area exceeds the preset weather data threshold range, the plurality of parameters included in the weather information of the data block are compared one by one, and the comparison result of each parameter is fed back to the first server.
Furthermore, each server is also provided with a data warehouse tool Hive for realizing the functions of inquiring and retrieving data in the HDFS based on Hadoop and a Yarn for being responsible for resource scheduling management, wherein the Yarn schedules the first server and the second server to process in sequence according to the generation sequence of the control information.
The system for realizing the meteorological data verification method during the formulation of the aviation flight plan is realized based on a Hadoop distributed framework, the Hadoop distributed framework comprises a Hadoop cluster formed by a plurality of servers, each server is provided with an HDFS (Hadoop distributed file system), a MapReduce and an Hbase, the HDFS comprises a NameNode management node and a DataNode data node, any one of the servers serves as a first server to operate the NameNode management node, and the other servers serve as second servers to operate the DataNode data node; the system also comprises a switch used for realizing the interaction of the information between the servers; wherein:
the first server is used for acquiring and processing meteorological data files through the NameNode management node, distributing data blocks of the same meteorological data file to the DataNode data nodes of a plurality of second servers, and storing data node information of each data block in each file through Hbase of the first server; the data node information stored by the first server and each data block stored by the second server comprise area information and time information corresponding to the data block, the area information is preset information comprising altitude and position range, meteorological data of a meteorological data file is meteorological information in a certain time period of a certain area in the future, the same meteorological data file comprises a plurality of data blocks, and each data block is simultaneously distributed to the DataNode data nodes of three or more second servers; the system is also used for acquiring and processing a flight track data file, confirming flight passing area time according to flight track data, searching data block node information including data block associated with flight passing area time according to flight passing area time, generating a first weather information comparison instruction, sending the first weather information comparison instruction to a second server storing a data block associated with flight passing area time, receiving a comparison result fed back by the second server and displaying the comparison result to a user;
the second server is used for receiving the data blocks distributed by the NameNode management node of the first server through the DataNode data node, processing and storing the data blocks, and then storing the data blocks to Hbase in a form of a table; the system comprises a first weather information comparison instruction, a first server and a second server, wherein the first weather information comparison instruction is used for receiving and processing the first weather information comparison instruction, comparing whether the weather information of the data block related to the time of the flying passing area exceeds a preset weather data threshold range through MapReduce of the first weather information comparison instruction, and feeding back a comparison result to the first server.
In conclusion, compared with the prior art, the invention has the following beneficial effects: (1) According to the invention, whether meteorological information exceeds a preset meteorological data threshold range or not is judged and fed back to a user by acquiring the meteorological data file and the flight path data file of the flight plan, so that the user can conveniently make an auxiliary flight plan according to a feedback result, the user can determine whether to change the flight path or not according to the feedback result of the invention, and under the condition of confirming that the flight path is changed, the obstacle avoidance frequency can be reduced, and further the probability of flight faults is reduced.
(2) At present, the detection of meteorological data is more and more refined, the massive expansion of data quantity follows, the transmission frequency of data and the data application and analysis scale are rapidly increased, and the meteorological data are managed by adopting a data management framework combining a traditional relational database and a file system, so that the meteorological data are more and more helpless in the face of huge quantity. The invention adopts a plane-dividing storage mode to store meteorological data, and the meteorological data is not stored in a fixed node, but is stored in a plurality of independent devices in a dispersing way, so that the devices share the storage load together, and the system can also run efficiently when facing mass data.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:
FIG. 1 is a system architecture diagram of one embodiment of the present invention;
FIG. 2 is a diagram of a server system architecture in accordance with an embodiment of the present invention;
FIG. 3 is a flow chart of the meteorological data storage steps in an embodiment of the present invention;
FIG. 4 is a flowchart of the meteorological data storage steps in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to examples and accompanying drawings, and the exemplary embodiments and descriptions thereof are only used for explaining the present invention and are not meant to limit the present invention.
Example 1:
as shown in fig. 1 and 2, the meteorological data verification system for the formulation of the aviation flight plan is implemented based on a Hadoop distributed framework, wherein the Hadoop distributed framework comprises a Hadoop cluster formed by a plurality of servers, each server is provided with an HDFS, a MapReduce and an Hbase, the HDFS comprises a NameNode management node and a DataNode data node, any one of the servers operates the NameNode management node as a first server, and the other servers operate the DataNode data node as second servers. Each server of this embodiment is further provided with a data warehouse tool Hive for implementing a function of querying and retrieving data in the HDFS based on Hadoop, and a Yarn for being responsible for resource scheduling management, where when this embodiment is applied, the Yarn schedules the first server and the second server to sequentially process according to the generation sequence of the control information, the Hive is a data warehouse tool based on Hadoop and can implement a function of querying and retrieving data in the HDFS, the Hive data warehouse tool can map a structured data file stored in the HDFS into a database table and provide an SQL-like query language, and query is performed using the SQL-like statement of Hive, which can quickly improve the development capability and omit the process of writing MapReduce. The embodiment further comprises a switch, which is used for realizing the interaction of the information between the servers. The server of the embodiment is implemented based on the existing computer, and comprises a CPU, a memory, a hard disk, a network card and a display system.
Hadoop is developed by Apache, is a mainstream open-source distributed computing framework at present, and mainly solves the problems of mass data storage, mass data computation and the like. The method is applied to meteorological data verification when an aviation flight plan is made for the first time, each server comprises a distributed file system (HDFS), a distributed offline operation framework (MapReduce), a distributed nematic open source database (Hbase), a data warehouse tool (Hive) and a resource scheduling management (Yarn), the storage and calculation capacity of meteorological data is improved by building a Hadoop distributed calculation platform, and a platform is provided for meteorological data analysis.
The embodiment includes a weather data storage step and a weather information verification step when applied, wherein the flow of the weather data storage step is shown in fig. 3, and includes: s11, acquiring and processing a meteorological data file by a NameNode management node of a first server, distributing data blocks of the same meteorological data file to data node data nodes of a plurality of second servers, and storing data node information of each data block in each file through Hbase of the first server; the data node information stored by the first server and each data block stored by the second server comprise area information and time information corresponding to the data block, the area information is preset information comprising altitude and position range, meteorological data of a meteorological data file is meteorological information in a certain time period of a certain area in the future, the same meteorological data file comprises a plurality of data blocks, and each data block is simultaneously distributed to the DataNode data nodes of three or more second servers; step S12, the DataNode data node of the second server receives the data block distributed by the NameNode management node of the first server, processes and stores the data block, and then stores the data block to Hbase in a form of a table. The data node information stored by the first server and each data block stored by the second server in this embodiment all include area information and time information corresponding to the data block, that is, an area and time corresponding to each data block are stored, the area information is preset information including altitude and position range, the area information in this embodiment is partitioned according to different altitude ranges and different positions, and a specific partitioning mode can be set according to user requirements. The meteorological data that this embodiment obtained is the data to the meteorological condition prediction in the future, according to current meteorological monitoring technique, can monitor the data of a plurality of time quantum every day in the next several days, consequently to specific meteorological data source and how to carry out meteorological data monitoring, this embodiment is no longer repeated, and this embodiment when specifically implementing, the meteorological information that obtains specifically arrives the year, month and day to meticulous to use every hour as the time quantum, in order to promote this embodiment and use the reference value who supplies the user when using.
As shown in fig. 4, the weather information verification step of the present embodiment includes: s21, a first server acquires and processes a flight track data file, confirms flight passing area time according to flight track data, searches data block node information including data block associated with the flight passing area time according to the flight passing area time, generates a first weather information comparison instruction and sends the first weather information comparison instruction to a second server which stores data blocks associated with the flight passing area time; s22, the second server receives and processes the first weather information comparison instruction, compares whether the weather information of the data block associated with the time of the flying passing area exceeds a preset weather data threshold range through MapReduce of the first server, and feeds back the comparison result to the first server; and S23, the first server receives the comparison result fed back by the second server and displays the comparison result to the user. The flight path includes longitude, latitude, line angle, track angle, average sea level barometric altitude, passing area, time corresponding to the passing area, and the like, and the time of the flight passing area in this embodiment is a certain area that the flight passes and time corresponding to the passing area. The embodiment confirms the time of the flight passing area according to the flight path data, and specifically extracts the flight passing area and time in the flight path data. The meteorological data threshold range in this embodiment includes a lower limit value and an upper limit value, and the meteorological data threshold range is a value preset by a user through the first server or the second server according to an actual demand.
Because the meteorological data includes wind speed, wind angle, magnetic difference, temperature, and the like, in the specific implementation of this embodiment, the meteorological information of each data block includes a plurality of parameters, the second server presets a meteorological data threshold range corresponding to each parameter, and in step S22, when comparing whether the meteorological information of the data block associated with the time of the flight passing area exceeds the preset meteorological data threshold range, the meteorological information of the data block includes a plurality of parameters that are compared one by one, and the comparison result of each parameter is fed back to the first server.
According to the embodiment, the meteorological data file is stored in advance, when a user formulates a flight plan, the flight track data file is imported into the system of the embodiment, the time of the flight passing area is extracted, the flight passing area time is compared with the meteorological data corresponding to the prestored area and time, the comparison result of whether the flight passing area time exceeds the preset time is fed back to the user, and the user can be assisted in formulating the flight plan. When the method is applied, the multiple second servers which store the same data blocks related to the time of the flight passing area simultaneously perform meteorological data comparison, and all the comparison results are fed back to the user reference, so that the meteorological data comparison results can be verified mutually.
Example 2:
this embodiment is further defined on the basis of embodiment 1 as follows: the meteorological data storage step of this embodiment further includes: the method comprises the steps that a second server generates a meteorological information calling instruction for calling a certain data block according to data node information where each data block is located in each stored file and sends the meteorological information calling instruction to the second server where the data block is stored, the second server receives the meteorological information calling instruction and sends the data block stored in the second server to a first server, the first server receives the data block and conducts data consistency verification on data of the same data block stored in different second servers through MapReduce of the first server, if the data blocks are verified to be consistent, processing is not conducted, and if the data blocks are verified to be inconsistent, the verification result is fed back to a user. Therefore, when the embodiment is applied, the consistency of the data in the same data block stored by the multiple DataNode data nodes can be checked, when the data are inconsistent, the data can be corrected by a user, and the evaluation performance of the embodiment can be prevented from being influenced by the weather data stored by the second server in error during comparison.
Example 3:
this embodiment is further defined on the basis of embodiment 1 or embodiment 2 as follows: the meteorological data storing step of this embodiment further includes: the first server receives and processes data block correction information which is input by a user and contains data node information, the processed data block correction information is sent to a second server corresponding to the data node, and the second server receives the data block correction information and corrects corresponding data block parameters. Therefore, when the embodiment is implemented specifically, for a data error stored in a certain second server, the data block correction information is input through the first server and the corresponding second server is controlled to complete data correction, so that the operation is convenient and fast, and the implementation is convenient.
Example 4:
this embodiment is further defined by any one of embodiments 1 to 3 as follows: the first weather information comparison instruction generated by the first server in this embodiment includes second weather information comparison instructions consistent with the number of the searched data blocks associated with the time of the flight passing area, and each second weather information comparison instruction corresponds to the data blocks associated with the time of the flight passing area one to one; and when the first server sends each piece of second meteorological information comparison instruction to the second server, the first server sends each piece of second meteorological information comparison instruction to any one second server stored with a data block corresponding to the second meteorological information comparison instruction.
Therefore, when the method is applied, only one second server participates in the comparison of the meteorological data of each block of data, and compared with the mode that a plurality of second servers participate simultaneously in the comparison in embodiment 1, the system operation efficiency can be improved.
Example 5:
this embodiment is further defined on the basis of embodiment 4 as follows: when the first server sends the second weather information comparison instruction to the second servers, the first server confirms the number of data blocks, which are stored by each second server and are associated with the time of the flying passing area, according to the searched data block node information containing the time of the flying passing area, and then distributes the number of the second weather information comparison instructions, which are received by each second server and correspond to the time of the flying passing area, according to the confirmed number; and the first server sends each piece of second meteorological information comparison instruction to the second server, and then sends the second meteorological information comparison instruction to the second server confirmed by the first server.
Because the number of the data blocks stored by the different second servers and associated with the time of the flight passing area may be the same, and the difference may also be large, in this embodiment, the first server allocates the second weather information comparison instruction received by each second server, so as to ensure that the second servers operate in order when performing weather data comparison.
Example 6:
this embodiment is further defined on the basis of embodiment 5 as follows: the first server of this embodiment allocates the number of the second weather information comparison instructions received by each second server, including the following steps: step S211, the first server sorts the second servers storing the data blocks related to the time of the flying passing area according to the number of the data blocks related to the time of the flying passing area, which are stored in each second server and confirmed by the first server, and sorts the second servers storing the data blocks related to the time of the flying passing area according to the preset second server numbers from small to large during sorting; step S212, judging whether the second servers in the first order receive second meteorological information comparison instructions with the same number as the flying passing-through area time related data blocks stored by the second servers, if so, judging whether the received number exceeds the average value of the total number of the second meteorological information comparison instructions divided by the number of the second servers in the flying passing-through area time related data blocks, if not, receiving the second meteorological information comparison instructions with the same number as the flying passing-through area time related data blocks stored by the second servers in the first order, and if not, receiving the second meteorological information comparison instructions corresponding to the second servers in the second order and then storing the same data blocks; step S213, after eliminating the second weather information comparison instruction received by the second server in the first order, repeating the step S211 and the step S212 to distribute the second weather information comparison instruction to the second server in the first order in the new order; and S214, after the distributed second meteorological information comparison instruction is eliminated, the steps S211 to S213 are repeated until all the second meteorological information comparison instructions are distributed.
In the embodiment, the second servers are sorted from small to large according to the number of the comparison instructions of the unallocated second meteorological information stored corresponding to the time correlation data block of the flying passing area, and then the comparison instructions of the second meteorological information are distributed to the second servers which are sorted to the first order, so that the distribution of the comparison instructions of the second meteorological information can be completed quickly, and the instruction distribution efficiency can be improved. When the embodiment is applied, although partial second servers do not participate in the comparison of the meteorological information, the second meteorological information comparison instruction can realize efficient distribution, and under the condition of efficient distribution of the instruction, the meteorological information comparison can be implemented rapidly, so that the operating efficiency of the system can be improved.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (8)
1. The method for verifying weather data when the aviation flight plan is made is characterized by being realized based on a Hadoop distributed framework, wherein the Hadoop distributed framework comprises a Hadoop cluster formed by a plurality of servers, each server is provided with an HDFS (high-level data file), a MapReduce and an Hbase, the HDFS comprises a NameNode management node and a DataNode data node, any one of the servers serves as a first server to operate the NameNode management node, and the other servers serve as second servers to operate the DataNode data node; the method comprises a meteorological data storage step and a meteorological information verification step, wherein the meteorological data storage step comprises the following steps:
s11, acquiring and processing meteorological data files by a NameNode management node of a first server, distributing data blocks of the same meteorological data file to data node data nodes of a plurality of second servers, and storing data node information of each data block in each file through Hbase of the first server; the data node information stored by the first server and each data block stored by the second server respectively comprise area information and time information corresponding to the data block, the area information is preset information comprising altitude and position range, meteorological data of a meteorological data file is meteorological information in a certain time period of a certain area in the future, the same meteorological data file comprises a plurality of data blocks, and each data block is simultaneously distributed to DataNode data nodes of three or more second servers;
s12, a DataNode data node of a second server receives and processes data blocks distributed by a NameNode management node of a first server and stores the data blocks, and then the data blocks are stored to Hbase in a form of a table;
the weather information verification step includes:
s21, a first server acquires and processes a flight path data file, confirms flight passing area time according to flight path data, searches data block node information including the flight passing area time correlation according to the flight passing area time, generates a first weather information comparison instruction and sends the first weather information comparison instruction to a second server storing data blocks related to the flight passing area time;
s22, the second server receives and processes the first weather information comparison instruction, compares whether the weather information of the data block associated with the time of the flying passing area exceeds a preset weather data threshold range through MapReduce of the first server, and feeds back the comparison result to the first server;
s23, the first server receives a comparison result fed back by the second server and displays the comparison result to a user;
the first weather information comparison instruction generated by the first server comprises second weather information comparison instructions consistent with the number of the searched data blocks related to the time of the flying passing area, and each second weather information comparison instruction corresponds to the data blocks related to the time of the flying passing area one to one; and when the first server sends each piece of second meteorological information comparison instruction to the second server, the first server sends each piece of second meteorological information comparison instruction to any one second server stored with a data block corresponding to the second meteorological information comparison instruction.
2. The method for weather data verification in the planning of an aircraft flight according to claim 1, wherein the weather data storing step further comprises: the method comprises the steps that a second server generates a meteorological information calling instruction for calling a certain data block according to data node information where each data block is located in each stored file and sends the meteorological information calling instruction to the second server where the data block is stored, the second server receives the meteorological information calling instruction and sends the data block stored in the second server to a first server, the first server receives the data block and conducts data consistency verification on data of the same data block stored in different second servers through MapReduce of the first server, if the data blocks are verified to be consistent, processing is not conducted, and if the data blocks are verified to be inconsistent, the verification result is fed back to a user.
3. The aerial flight planning time meteorological data verification method of claim 1, wherein the meteorological data storing step further comprises: the first server receives and processes data block correction information which is input by a user and contains data node information, the processed data block correction information is sent to a second server corresponding to the data node, and the second server receives the data block correction information and corrects corresponding data block parameters.
4. The method for verifying weather data during formulation of an aviation flight plan as claimed in claim 1, wherein when the first server sends the second weather information comparison instruction to the second servers, the first server confirms the number of data blocks, which are stored by each second server and are associated with the time of flight passing areas, according to the searched data block node information containing the time of flight passing areas, and then distributes the number of the second weather information comparison instructions, which are received by each second server and correspond to the data blocks associated with the time of flight passing areas, according to the confirmed number; and the first server sends each piece of second meteorological information comparison instruction to the second server, and then sends the second meteorological information comparison instruction to the second server confirmed by the first server.
5. The method for verifying weather data during planning of an aviation flight according to claim 4, wherein the step of the first server allocating the number of the second weather information comparison instructions received by each of the second servers includes the steps of:
step S211, the first server sorts the second servers storing the data blocks related to the time of the flying passing area according to the number of the data blocks related to the time of the flying passing area, which are stored in each second server and confirmed by the first server, and sorts the second servers storing the data blocks related to the time of the flying passing area according to the preset second server numbers from small to large during sorting;
step S212, judging whether the second servers in the first order receive second meteorological information comparison instructions with the same number as the flying passing-through area time related data blocks stored by the second servers, if so, judging whether the received number exceeds the average value of the total number of the second meteorological information comparison instructions divided by the number of the second servers in the flying passing-through area time related data blocks, if not, receiving the second meteorological information comparison instructions with the same number as the flying passing-through area time related data blocks stored by the second servers in the first order, and if not, receiving the second meteorological information comparison instructions corresponding to the second servers in the second order and then storing the same data blocks;
step S213, after eliminating the second weather information comparison instruction received by the first ranked second server, repeating step S211 and step S212 to distribute the second weather information comparison instruction to the newly ranked first server;
and S214, after the distributed second meteorological information comparison instructions are eliminated, repeating the steps S211 to S213 until all the second meteorological information comparison instructions are distributed.
6. The method for verifying weather data during formulation of an aviation flight plan as claimed in claim 1, wherein the weather information of each data block includes a plurality of parameters, the second server presets a weather data threshold range corresponding to each parameter, and in the step S22, the plurality of parameters included in the weather information of the data block are compared one by one when the weather information of the data block associated with the time of the flight passing area exceeds the preset weather data threshold range, and the comparison result of each parameter is fed back to the first server.
7. The method for verifying weather data during formulation of an aviation flight plan according to claim 1, wherein each server is further provided with a data warehouse tool Hive for realizing the function of querying and retrieving data in an HDFS based on Hadoop and a yann for being responsible for resource scheduling management, wherein the first server and the second server are scheduled to process sequentially according to the generation sequence of the control information by the yann.
8. The system for realizing the weather data verification method during aviation flight planning according to any one of claims 1 to 7 is realized based on a Hadoop distributed framework, wherein the Hadoop distributed framework comprises a Hadoop cluster formed by a plurality of servers, each server is provided with an HDFS (Hadoop distributed file system), a MapReduce and an Hbase, the HDFS comprises NameNode management nodes and DataNode data nodes, any one of the servers is used as a first server to operate the NameNode management nodes, and the other servers are used as second servers to operate the DataNode data nodes; the system also comprises a switch for realizing the information interaction between the servers; wherein:
the first server is used for acquiring and processing meteorological data files through the NameNode management node, distributing data blocks of the same meteorological data file to the DataNode data nodes of a plurality of second servers, and storing data node information of each data block in each file through Hbase of the first server; the data node information stored by the first server and each data block stored by the second server comprise area information and time information corresponding to the data block, the area information is preset information comprising altitude and position range, meteorological data of a meteorological data file is meteorological information in a certain time period of a certain area in the future, the same meteorological data file comprises a plurality of data blocks, and each data block is simultaneously distributed to the DataNode data nodes of three or more second servers; the system is also used for acquiring and processing a flight track data file, confirming flight passing area time according to flight track data, searching data block node information including data block associated with flight passing area time according to flight passing area time, generating a first weather information comparison instruction, sending the first weather information comparison instruction to a second server storing a data block associated with flight passing area time, receiving a comparison result fed back by the second server and displaying the comparison result to a user;
the second server is used for receiving the data blocks distributed by the NameNode management node of the first server through the DataNode data node, processing and storing the data blocks, and then storing the data blocks to Hbase in a form of a table; the system comprises a first weather information comparison instruction, a first server and a second server, wherein the first weather information comparison instruction is used for receiving and processing the first weather information comparison instruction, comparing whether the weather information of the data block related to the time of the flying passing area exceeds a preset weather data threshold range through MapReduce of the first weather information comparison instruction, and feeding back the comparison result to the first server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211401594.8A CN115454959B (en) | 2022-11-08 | 2022-11-08 | Meteorological data verification method and system during aviation flight planning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211401594.8A CN115454959B (en) | 2022-11-08 | 2022-11-08 | Meteorological data verification method and system during aviation flight planning |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115454959A CN115454959A (en) | 2022-12-09 |
| CN115454959B true CN115454959B (en) | 2023-01-24 |
Family
ID=84295787
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211401594.8A Active CN115454959B (en) | 2022-11-08 | 2022-11-08 | Meteorological data verification method and system during aviation flight planning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115454959B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106297417A (en) * | 2016-09-27 | 2017-01-04 | 南京航空航天大学 | A kind of unmanned plane during flying service and supervisory systems and method |
| CN107563019A (en) * | 2017-08-17 | 2018-01-09 | 河北工程大学 | One kind is directed to Complex Underlying Surface city hydrological distribution model digitizing solution |
| CN109241161A (en) * | 2018-08-09 | 2019-01-18 | 深圳市雅码科技有限公司 | A kind of meteorological data management method |
| CN109583467A (en) * | 2018-10-11 | 2019-04-05 | 中国电力科学研究院有限公司 | A kind of electric power meteorological data fusion method and system |
| CN113313292A (en) * | 2021-05-07 | 2021-08-27 | 国网河南省电力公司电力科学研究院 | Electric power meteorological information platform |
| CN113515514A (en) * | 2021-07-02 | 2021-10-19 | 国网辽宁省电力有限公司大连供电公司 | Multi-level edge computing system architecture based on cloud edge cooperation and implementation method thereof |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11169993B2 (en) * | 2014-06-06 | 2021-11-09 | The Mathworks, Inc. | Datastore mechanism for managing out-of-memory data |
| CN104332072B (en) * | 2014-10-22 | 2016-09-21 | 北京航空航天大学 | General Aviation Flight project management system |
| CN104376053B (en) * | 2014-11-04 | 2017-12-22 | 南京信息工程大学 | A kind of storage and retrieval method based on magnanimity meteorological data |
| CN107800808A (en) * | 2017-11-15 | 2018-03-13 | 广东奥飞数据科技股份有限公司 | A kind of data-storage system based on Hadoop framework |
| CN108614478A (en) * | 2018-04-16 | 2018-10-02 | 深圳市赑玄阁科技有限公司 | A kind of long-range meteorological data monitoring system and method |
| CN109917767B (en) * | 2019-04-01 | 2020-10-09 | 中国电子科技集团公司信息科学研究院 | Distributed unmanned aerial vehicle cluster autonomous management system and control method |
| US11488488B2 (en) * | 2020-01-03 | 2022-11-01 | Prince Sultan University | Blockchain-based solution for internet of drones security and privacy |
| US11363029B2 (en) * | 2020-01-08 | 2022-06-14 | Bank Of America Corporation | Big data distributed processing and secure data transferring with hyper fencing |
| EP3902230A1 (en) * | 2020-04-20 | 2021-10-27 | Honeywell International Inc. | Distributed connected aircraft cockpit flight management system as a network node with api service capabilities |
| CN111562541B (en) * | 2020-05-31 | 2022-05-24 | 宁夏隆基宁光仪表股份有限公司 | Software platform for realizing electric energy meter detection data management by applying CART algorithm |
| CN112506459A (en) * | 2020-12-14 | 2021-03-16 | 成都赫尔墨斯科技股份有限公司 | Data synchronization method and system for avionics system comprehensive display control unit |
| CN113763700B (en) * | 2021-04-26 | 2022-09-20 | 腾讯云计算（北京）有限责任公司 | Information processing method, information processing device, computer equipment and storage medium |
| CN114219151B (en) * | 2021-12-15 | 2023-05-26 | 中国民用航空飞行学院 | Self-adaptive universal aviation emergency rescue weather protection system |
| CN114760088B (en) * | 2022-02-21 | 2023-03-10 | 北京交通大学 | Flight plan data management method, system, electronic device and storage medium |
| CN114968668A (en) * | 2022-06-17 | 2022-08-30 | 重庆紫光华山智安科技有限公司 | Data processing method and device, data access terminal and storage medium |
-
2022
- 2022-11-08 CN CN202211401594.8A patent/CN115454959B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106297417A (en) * | 2016-09-27 | 2017-01-04 | 南京航空航天大学 | A kind of unmanned plane during flying service and supervisory systems and method |
| CN107563019A (en) * | 2017-08-17 | 2018-01-09 | 河北工程大学 | One kind is directed to Complex Underlying Surface city hydrological distribution model digitizing solution |
| CN109241161A (en) * | 2018-08-09 | 2019-01-18 | 深圳市雅码科技有限公司 | A kind of meteorological data management method |
| CN109583467A (en) * | 2018-10-11 | 2019-04-05 | 中国电力科学研究院有限公司 | A kind of electric power meteorological data fusion method and system |
| CN113313292A (en) * | 2021-05-07 | 2021-08-27 | 国网河南省电力公司电力科学研究院 | Electric power meteorological information platform |
| CN113515514A (en) * | 2021-07-02 | 2021-10-19 | 国网辽宁省电力有限公司大连供电公司 | Multi-level edge computing system architecture based on cloud edge cooperation and implementation method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115454959A (en) | 2022-12-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Belcastro et al. | Using scalable data mining for predicting flight delays | |
| CN111144631B (en) | Real-time probability prediction method for flight delay based on Bayesian network algorithm | |
| CN104885104B (en) | Satellite dispatches system | |
| US20210133370A1 (en) | Optimizing Aircraft Flows at Airports Using Data Driven Predicted Capabilities | |
| WO2018214388A1 (en) | Multi-platform big data system and method for aviation electronics | |
| US6278965B1 (en) | Real-time surface traffic adviser | |
| CN109448445A (en) | Flight based on shot and long term Memory Neural Networks is delayed grading forewarning system method | |
| WO1999008251A1 (en) | Real-time surface traffic adviser | |
| CN113449915B (en) | Flight delay prediction method based on knowledge graph | |
| CN105956723A (en) | Logistics information management method based on data mining | |
| Lytvyn et al. | Aviation aircraft planning system project development | |
| Chou et al. | A machine learning application for predicting and alerting missed approaches for airport management | |
| CN115454959B (en) | Meteorological data verification method and system during aviation flight planning | |
| CN112581260A (en) | Method, device and system for monitoring regional financial risk | |
| Sekine et al. | Multi-objective takeoff time optimization using cellular automaton-based simulator | |
| CN117094424A (en) | Real-time aircraft flight delay prediction | |
| Li et al. | Critical Flight Trajectory Identification via Machine Learning for Large-scale Trajectory Management | |
| Vishnyakova et al. | A solution to the problem of assessing aviation safety by simulation modeling | |
| García-Miranda et al. | AIRPORTS Metrics: A Big Data application for computing flights' performance indexes based on flown trajectories | |
| CN113139258A (en) | Road data processing method, device, equipment and storage medium | |
| CN113204534A (en) | SCADA measurement data acquisition and storage method and system based on stream calculation | |
| CN114492902A (en) | Flight recovery method and device, computer equipment and storage medium | |
| Zixuan et al. | Prediction Model of Flight Plan Departure Procedure Based on Extra-Tree | |
| Yu et al. | Efficient Spatio-Temporal-Data-Oriented Range Query Processing for Air Traffic Flow Statistics | |
| Corrado | A Data-Driven Methodology to Analyze Air Traffic Management System Operations within the Terminal Airspace |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |