CN113688100A - Meteorological data processing method, device, terminal and storage medium - Google Patents

Meteorological data processing method, device, terminal and storage medium Download PDF

Info

Publication number
CN113688100A
CN113688100A CN202111046860.5A CN202111046860A CN113688100A CN 113688100 A CN113688100 A CN 113688100A CN 202111046860 A CN202111046860 A CN 202111046860A CN 113688100 A CN113688100 A CN 113688100A
Authority
CN
China
Prior art keywords
nifi
flowfile
file
node
ctl
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111046860.5A
Other languages
Chinese (zh)
Other versions
CN113688100B (en
Inventor
刘学奇
闫庚翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Puredeli Technology Co ltd
Original Assignee
Beijing Puredeli Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Puredeli Technology Co ltd filed Critical Beijing Puredeli Technology Co ltd
Priority to CN202111046860.5A priority Critical patent/CN113688100B/en
Publication of CN113688100A publication Critical patent/CN113688100A/en
Application granted granted Critical
Publication of CN113688100B publication Critical patent/CN113688100B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/13File access structures, e.g. distributed indices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24568Data stream processing; Continuous queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • G06F16/287Visualization; Browsing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses a meteorological data processing method, a meteorological data processing device, a terminal and a storage medium, wherein the method comprises the following steps: acquiring a weather source file through a first nifi node, generating a ctl file based on the weather source file, and storing the ctl file in a flowfile; reading the ctl file from the flowfile through the second nifi node, and setting parameters for the read ctl file; distributing the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi nodes; and receiving flowfile through a plurality of fourth nifi nodes, and generating the picture based on the received flowfile. Parallel processing is carried out on meteorological data through a plurality of nifi nodes, linkage is realized through flowfile data flow between each nifi node, and the expansion is facilitated, so that the processing speed is accelerated, and congestion is avoided.

Description

Meteorological data processing method, device, terminal and storage medium
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method, an apparatus, a terminal, and a storage medium for processing meteorological data.
Background
In the meteorological field, a meteorological data file needs to be analyzed to generate a meteorological factor picture, and the current meteorological data analysis is realized by compiling Java programs, but the process of analyzing the meteorological data in the mode is too complex, codes need to be packaged in a single module, the programs are too bloated, and meanwhile, the analysis programs are deployed on a node and are difficult to horizontally expand, so that the programs are blocked.
Thus, there is a need for a solution to the problems of the prior art.
Disclosure of Invention
In view of the above, the invention provides a meteorological data processing method, a meteorological data processing device, a terminal and a storage medium, which are used for solving the problems in the prior art, wherein the meteorological data are processed in parallel through a plurality of nifi nodes, and each nifi node is linked through a flowfile data stream, so that the expansion is convenient, the processing speed is increased, and the congestion is avoided.
Specifically, the present invention proposes the following specific examples:
the embodiment of the invention provides a meteorological data processing method, which comprises the following steps:
acquiring a weather source file through a first nifi node, generating a ctl file based on the weather source file, and storing the ctl file in a flowfile;
reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file;
distributing the ctl file provided with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi nodes;
and receiving flowfile through the fourth nifi nodes, and generating a picture based on the received flowfile.
In a specific embodiment, the processing procedures of the first nifi node, the second nifi node, the third nifi node and each fourth nifi node are all displayed in a mode of an image interface.
In a specific embodiment, one or more of the first nifi node, the second nifi node, and the third nifi node comprises a plurality of sub nifi nodes.
In a specific embodiment, the generating a ctl file based on the weather source file includes:
acquiring meteorological information based on a source file name in the meteorological source file; the meteorological information comprises an air quality name, a reporting time and a boundary range;
and generating a ctl file based on the weather information.
In a particular embodiment, the parameters include any combination of one or more of the following: the system comprises general weather parameters, a boundary range of weather factors, a color range corresponding to the name of the weather factor, a numerical range corresponding to the color range and a picture generation path.
In a specific embodiment, the generating a picture based on the received flowfile includes:
generating an initial picture based on the received ctl file in the flowfile and the parameters;
and carrying out transparentization treatment on the background color of the initial picture, and simultaneously reserving the color in the boundary range in the initial picture to obtain a final picture.
And carrying out parallel processing on the ctl file in the flowfile through the fourth nifi nodes, so that the processing efficiency is improved, and the occurrence of congestion is effectively avoided.
In a particular embodiment, the weather source file is obtained from an ftp server; the method further comprises the following steps:
and uploading the generated picture to an ftp server.
The embodiment of the invention also provides a meteorological data processing device, which comprises:
the acquisition module is used for acquiring a weather source file through a first nifi node, generating a ctl file based on the weather source file, and storing the ctl file in a flowfile;
the setting module is used for reading the ctl file from the flowfile through a second nifi node and setting parameters for the read ctl file;
the distribution module is used for distributing the ctl file provided with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi nodes;
and the generating module is used for receiving the flowfile through the fourth nifi nodes and generating the picture based on the received flowfile.
The embodiment of the invention also provides a terminal, which comprises a memory and a processor, wherein the memory stores a computer program, and the processor runs the computer program to enable the processor to execute the meteorological data processing method.
The embodiment of the invention also provides a storage medium, wherein a computer program is stored on the storage medium, and when being executed by a processor, the computer program realizes the meteorological data processing method.
Therefore, the embodiment of the invention provides a meteorological data processing method, a meteorological data processing device, a terminal and a storage medium, wherein the method comprises the following steps: acquiring a weather source file through a first nifi node, generating a ctl file based on the weather source file, and storing the ctl file in a flowfile; reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file; distributing the ctl file provided with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi nodes; and receiving flowfile through the fourth nifi nodes, and generating a picture based on the received flowfile. Parallel processing is carried out on meteorological data through a plurality of nifi nodes, linkage is realized through flowfile data flow between each nifi node, and the expansion is facilitated, so that the processing speed is accelerated, and congestion is avoided.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings required to be used in the embodiments will be briefly described below, and it should be understood that the following drawings only illustrate some embodiments of the present invention, and therefore should not be considered as limiting the scope of the present invention. Like components are numbered similarly in the various figures.
FIG. 1 is a flow chart of a method for processing meteorological data according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating a method for processing meteorological data according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a picture obtained by a method for processing meteorological data according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a meteorological data processing device according to an embodiment of the present invention;
fig. 5 is another schematic structural diagram of a meteorological data processing apparatus according to an embodiment of the present invention.
Illustration of the drawings:
201-an acquisition module; 202-setting a module; 203-a distribution module; 204-a generation module; 205-upload module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
Hereinafter, the terms "including", "having", and their derivatives, which may be used in various embodiments of the present invention, are only intended to indicate specific features, numbers, steps, operations, elements, components, or combinations of the foregoing, and should not be construed as first excluding the existence of, or adding to, one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing.
Furthermore, the terms "first," "second," "third," and the like are used solely to distinguish one from another and are not to be construed as indicating or implying relative importance.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which various embodiments of the present invention belong. The terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning that is consistent with their contextual meaning in the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in various embodiments of the present invention.
Example 1
The embodiment 1 of the invention discloses a meteorological data processing method, as shown in fig. 1 and fig. 2, comprising the following steps:
s101, acquiring a weather source file through a first nifi node, generating a ctl file based on the weather source file, and storing the ctl file in a flowfile;
specifically, the weather source File is acquired from an ftp (File Transfer Protocol) server; specifically, each nifi (a real-time data stream processing system) node is a processor, and the ctl file is a file containing control information. flowfile is then a stream file.
With this, as shown in fig. 2, the "generating a ctl file based on the weather source file" in step S101 includes:
acquiring meteorological information based on a source file name in the meteorological source file; the meteorological information comprises an air quality name, a reporting time and a boundary range;
and generating a ctl file based on the weather information.
Step S102, reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file;
specifically, the parameters include any combination of one or more of the following: the system comprises general weather parameters, a boundary range of weather factors, a color range corresponding to the name of the weather factor, a numerical range corresponding to the color range and a picture generation path.
Step S103, distributing the ctl file provided with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi nodes;
specifically, after the parameters are set, the parameters are distributed to a plurality of fourth nifi nodes, so that the processing efficiency is improved.
And step S104, receiving the flowfile through the fourth nifi nodes, and generating the picture based on the received flowfile.
The specific step S104 of "generating a picture based on the received flowfile" includes:
generating an initial picture based on the received ctl file in the flowfile and the parameters;
and carrying out transparentization treatment on the background color of the initial picture, and simultaneously reserving the color in the boundary range in the initial picture to obtain a final picture.
After the picture is generated, the method further comprises: and uploading the generated picture to an ftp server.
In addition, the processing procedures of the first nifi node, the second nifi node, the third nifi node and each fourth nifi node are all displayed in an image interface (for example, the processing procedures can be displayed in a web interface manner), so that the result after the analysis of the analysis process and each process can be visually seen, and the dynamic setting of additional parameter configuration is easy to realize, the code does not need to be changed, the redeployment is not needed, the process is simple, the nifi node can be effective only by restarting the image interface, such as the web interface, and the display in the image interface manner is convenient to start and stop. That is, each processing process can be deployed on multiple servers, so that horizontal extension is further improved, and analysis efficiency is further improved.
Each parsing process is replaced by a nifi node, the process is clear, each processor stores data after parsing in a flowfile object, and then the flowfile object flows to the next processor. And a plurality of nifi nodes are deployed, so that the analysis efficiency is improved.
Specifically, taking fig. 2 as an example, in a specific application scenario, the method includes the following steps:
1. and pulling the weather source file.
2. And acquiring information such as an air quality name, a start time, a boundary range and the like according to the source file name to generate a ctl file.
3. The ctl information is stored in the flowfile object and flows to the next processor.
4. Setting general parameters when OpenGrADS (weather drawing enhancement software) reads ctl contents.
5. And setting a meteorological factor boundary range.
6. And setting a color range according to the name of the meteorological factor.
7. A numerical range corresponding to the color range is set.
8. And setting a picture generation path.
9. The http (hypertext transfer protocol, English) protocol is used to transfer the flowfile stream to the other processing nodes.
10. The processing node receives a flowfile byte stream.
11. And generating the picture according to the parameter information carried in the flowfile object.
12. The background color of the picture is made transparent, and the color in the boundary range is reserved, so that the obtained picture is as shown in fig. 3, wherein the background is transparent, but the color in the boundary range is reserved.
13. And uploading the picture to an ftp server for proxy access of nginx (English is a high-performance HTTP and reverse proxy web server).
Example 2
In view of this, an apparatus for processing meteorological data according to embodiment 2 of the present invention, as shown in fig. 4, includes:
the obtaining module 201 is configured to obtain a weather source file through a first nifi node, generate a ctl file based on the weather source file, and store the ctl file in a flowfile;
a setting module 202, configured to read the ctl file from the flowfile through a second nifi node, and set a parameter for the read ctl file;
the distribution module 203 is configured to distribute the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi nodes;
a generating module 204, configured to receive the flowfile through the fourth nifi nodes, and generate the picture based on the received flowfile.
In a specific embodiment, the processing procedures of the first nifi node, the second nifi node, the third nifi node and each fourth nifi node are all displayed in a mode of an image interface.
In a specific embodiment, one or more of the first nifi node, the second nifi node, and the third nifi node comprises a plurality of sub nifi nodes.
In a specific embodiment, the obtaining module 201 "generates a ctl file based on the weather source file", including:
acquiring meteorological information based on a source file name in the meteorological source file; the meteorological information comprises an air quality name, a reporting time and a boundary range;
and generating a ctl file based on the weather information.
In a particular embodiment, the parameters include any combination of one or more of the following: the system comprises general weather parameters, a boundary range of weather factors, a color range corresponding to the name of the weather factor, a numerical range corresponding to the color range and a picture generation path.
In a specific embodiment, the generating module 204 "generates a picture based on the received flowfile", including:
generating an initial picture based on the received ctl file in the flowfile and the parameters;
and carrying out transparentization treatment on the background color of the initial picture, and simultaneously reserving the color in the boundary range in the initial picture to obtain a final picture.
In a particular embodiment, the weather source file is obtained from an ftp server;
as shown in fig. 5, the apparatus further comprises:
and the uploading module 205 is used for uploading the generated picture to an ftp server.
Example 3
The embodiment 3 of the present invention further discloses a terminal, which includes a memory and a processor, wherein the memory stores a computer program, and the processor runs the computer program to enable the processor to execute the meteorological data processing method in the embodiment 1.
Example 4
The embodiment 4 of the present invention further discloses a storage medium, wherein a computer program is stored on the storage medium, and when being executed by a processor, the computer program implements the meteorological data processing method of the embodiment 1.
Therefore, the embodiment of the invention provides a meteorological data processing method, a meteorological data processing device, a terminal and a storage medium, wherein the method comprises the following steps: acquiring a weather source file through a first nifi node, generating a ctl file based on the weather source file, and storing the ctl file in a flowfile; reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file; distributing the ctl file provided with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi nodes; and receiving flowfile through the fourth nifi nodes, and generating a picture based on the received flowfile. Parallel processing is carried out on meteorological data through a plurality of nifi nodes, linkage is realized through flowfile data flow between each nifi node, and the expansion is facilitated, so that the processing speed is accelerated, and congestion is avoided.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative and, for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, each functional module or unit in each embodiment of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part of the technical solution that contributes to the prior art in essence can be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a smart phone, a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention.

Claims (10)

1. A method for processing meteorological data is characterized by comprising the following steps:
acquiring a weather source file through a first nifi node, generating a ctl file based on the weather source file, and storing the ctl file in a flowfile;
reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file;
distributing the ctl file provided with the parameters to a plurality of fourth nifi nodes in a flowfile manner through a third nifi node;
and receiving flowfile through the fourth nifi nodes, and generating a picture based on the received flowfile.
2. The method of claim 1, wherein the processing of the first nifi node, the second nifi node, the third nifi node, and each of the fourth nifi nodes are displayed as graphical interfaces.
3. The method of claim 1, wherein one or more of the first nifi node, the second nifi node, and the third nifi node comprises a plurality of sub nifi nodes.
4. The method of claim 1, wherein generating the ctl file based on the weather source file comprises:
acquiring meteorological information based on a source file name in the meteorological source file; the meteorological information comprises an air quality name, a reporting time and a boundary range;
and generating a ctl file based on the weather information.
5. The method of claim 1, wherein the parameters comprise any combination of one or more of: the system comprises general weather parameters, a boundary range of weather factors, a color range corresponding to the name of the weather factor, a numerical range corresponding to the color range and a picture generation path.
6. The method of claim 1 or 5, wherein generating the picture based on the received flowfile comprises:
generating an initial picture based on the received ctl file in the flowfile and the parameters;
and carrying out transparentization treatment on the background color of the initial picture, and simultaneously reserving the color in the boundary range in the initial picture to obtain a final picture.
7. The method of claim 1, wherein the weather source file is obtained from an ftp server; the method further comprises the following steps:
and uploading the generated picture to an ftp server.
8. A weather data processing apparatus, comprising:
the acquisition module is used for acquiring a weather source file through a first nifi node, generating a ctl file based on the weather source file, and storing the ctl file in a flowfile;
the setting module is used for reading the ctl file from the flowfile through a second nifi node and setting parameters for the read ctl file;
the distribution module is used for distributing the ctl file provided with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi nodes;
and the generating module is used for receiving the flowfile through the fourth nifi nodes and generating the picture based on the received flowfile.
9. A terminal, characterized in that it comprises a memory, which stores a computer program, and a processor, which runs the computer program to make the processor execute the method for processing meteorological data according to any one of claims 1 to 7.
10. A storage medium, characterized in that the storage medium has stored thereon a computer program which, when being executed by a processor, implements a method for processing meteorological data according to any one of claims 1 to 7.
CN202111046860.5A 2021-09-06 2021-09-06 Meteorological data processing method, device, terminal and storage medium Active CN113688100B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111046860.5A CN113688100B (en) 2021-09-06 2021-09-06 Meteorological data processing method, device, terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111046860.5A CN113688100B (en) 2021-09-06 2021-09-06 Meteorological data processing method, device, terminal and storage medium

Publications (2)

Publication Number Publication Date
CN113688100A true CN113688100A (en) 2021-11-23
CN113688100B CN113688100B (en) 2023-07-18

Family

ID=78585758

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111046860.5A Active CN113688100B (en) 2021-09-06 2021-09-06 Meteorological data processing method, device, terminal and storage medium

Country Status (1)

Country Link
CN (1) CN113688100B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113936432A (en) * 2021-12-17 2022-01-14 中国气象局公共气象服务中心(国家预警信息发布中心) Weather early warning image-text generation method and device and electronic equipment

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150134780A1 (en) * 2013-11-13 2015-05-14 Datadirect Networks, Inc. Centralized parallel burst engine for high performance computing
CN106202378A (en) * 2016-07-08 2016-12-07 中国地质大学(武汉) The immediate processing method of a kind of streaming meteorological data and system
US20160366224A1 (en) * 2015-06-15 2016-12-15 International Business Machines Corporation Dynamic node group allocation
CN107577486A (en) * 2017-09-29 2018-01-12 广州数鹏通科技有限公司 Weather information drawing processing method, device, computer equipment and storage medium
WO2018214388A1 (en) * 2017-05-23 2018-11-29 深圳大学 Multi-platform big data system and method for aviation electronics
CN109542593A (en) * 2018-11-27 2019-03-29 浪潮天元通信信息系统有限公司 A kind of flow chart of data processing design method based on NIFI
CN112948653A (en) * 2021-04-23 2021-06-11 广东省气象探测数据中心 Meteorological data monitoring system based on business process
WO2021114812A1 (en) * 2019-12-12 2021-06-17 中兴通讯股份有限公司 Data acquisition method and apparatus, computer device, and computer-readable medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150134780A1 (en) * 2013-11-13 2015-05-14 Datadirect Networks, Inc. Centralized parallel burst engine for high performance computing
US20160366224A1 (en) * 2015-06-15 2016-12-15 International Business Machines Corporation Dynamic node group allocation
CN106202378A (en) * 2016-07-08 2016-12-07 中国地质大学(武汉) The immediate processing method of a kind of streaming meteorological data and system
WO2018214388A1 (en) * 2017-05-23 2018-11-29 深圳大学 Multi-platform big data system and method for aviation electronics
CN107577486A (en) * 2017-09-29 2018-01-12 广州数鹏通科技有限公司 Weather information drawing processing method, device, computer equipment and storage medium
CN109542593A (en) * 2018-11-27 2019-03-29 浪潮天元通信信息系统有限公司 A kind of flow chart of data processing design method based on NIFI
WO2021114812A1 (en) * 2019-12-12 2021-06-17 中兴通讯股份有限公司 Data acquisition method and apparatus, computer device, and computer-readable medium
CN112948653A (en) * 2021-04-23 2021-06-11 广东省气象探测数据中心 Meteorological data monitoring system based on business process

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
孙周军;李高洁;黄伟;郑艳萍;: "基于流技术的自动气象站数据处理优化方法", 气象水文海洋仪器, no. 04, pages 32 - 36 *
邢为栋: "NiFi数据流实例三", CSDN, pages 1 - 10 *
金圣宇;: "气象资料数据化全流程监控方案研究", 电子世界, no. 10, pages 63 - 64 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113936432A (en) * 2021-12-17 2022-01-14 中国气象局公共气象服务中心(国家预警信息发布中心) Weather early warning image-text generation method and device and electronic equipment

Also Published As

Publication number Publication date
CN113688100B (en) 2023-07-18

Similar Documents

Publication Publication Date Title
CN107729475B (en) Webpage element acquisition method, device, terminal and computer-readable storage medium
CN111917740B (en) Abnormal flow alarm log detection method, device, equipment and medium
CN106897347B (en) Webpage display method, operation event recording method and device
CN108228293B (en) Interface skin switching method and device
WO2018001078A1 (en) Url matching method and device, and storage medium
CN111726456B (en) Data processing method and related device
US10917376B2 (en) Origin-based consolidation of related content within social network posts
US20150262238A1 (en) Techniques for Topic Extraction Using Targeted Message Characteristics
CN113050939A (en) Page generation method and device
CN113688100A (en) Meteorological data processing method, device, terminal and storage medium
CN109698814B (en) Botnet discovery method and botnet discovery device
CN110708360A (en) Information processing method and system and electronic equipment
CN111147354B (en) Message processing method, device, equipment and storage medium
CN110968314A (en) Page generation method and device
CN106878151B (en) Method, equipment and system for transmitting information
CN108055594B (en) Edge slicing implementation method and device, computer equipment and storage medium
CN112988026B (en) Scroll bar display method and device and electronic equipment
CN107948234B (en) Data processing method and device
CN114501117B (en) Multi-platform message synchronous merging method, system, electronic equipment and storage medium
CN109587198B (en) Image-text information pushing method and device
US10171879B2 (en) Contextual alerting for broadcast content
CN111125998A (en) Text processing method and device
CN111552510B (en) File construction method and device, electronic equipment and computer readable storage medium
CN109657184B (en) Rich text processing method, rich text processing device, server and computer readable medium
US20210136011A1 (en) System and method for dynamic chat message customization

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant