CN113688100B - Meteorological data processing method, device, terminal and storage medium - Google Patents
Meteorological data processing method, device, terminal and storage medium Download PDFInfo
- Publication number
- CN113688100B CN113688100B CN202111046860.5A CN202111046860A CN113688100B CN 113688100 B CN113688100 B CN 113688100B CN 202111046860 A CN202111046860 A CN 202111046860A CN 113688100 B CN113688100 B CN 113688100B
- Authority
- CN
- China
- Prior art keywords
- nifi
- flowfile
- file
- ctl
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24568—Data stream processing; Continuous queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
- G06F16/287—Visualization; Browsing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a method, a device, a terminal and a storage medium for processing meteorological data, wherein the method comprises the following steps: acquiring a meteorological source file through a first nifi node, generating a ctl file based on the meteorological source file, and storing the ctl file in a flowfile; reading a ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file; distributing the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi node; and receiving the flowfile through a plurality of fourth nifi nodes, and generating a picture based on the received flowfile. The meteorological data are processed in parallel through the plurality of nifi nodes, linkage is realized among the nifi nodes through the flowfile data flow, expansion is facilitated, the processing speed is accelerated, and congestion is avoided.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method, an apparatus, a terminal, and a storage medium for processing meteorological data.
Background
In the meteorological field, a meteorological data file needs to be analyzed to generate a meteorological factor picture, and at present, the analysis of the meteorological data is realized by writing Java programs, but the process of analyzing the meteorological data by adopting the method is too complex, codes need to be packaged in a single module, the programs are too bulky, and meanwhile, the analysis programs are deployed on a node and are difficult to horizontally expand, so that the programs are blocked.
Thus, there is a need for a solution to the problems of the prior art.
Disclosure of Invention
In view of the above, the invention provides a method, a device, a terminal and a storage medium for processing meteorological data, which are used for solving the problems in the prior art, the meteorological data are processed in parallel by a plurality of nifi nodes, and each nifi node is linked through a flowfile data stream, so that the expansion is convenient, the processing speed is increased, and the congestion is avoided.
Specifically, the present invention proposes the following specific embodiments:
the embodiment of the invention provides a meteorological data processing method, which comprises the following steps:
acquiring a meteorological source file through a first nifi node, generating a ctl file based on the meteorological source file, and storing the ctl file in a flowfile;
reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file;
distributing the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi node;
and receiving the flowfile through the plurality of fourth nifi nodes, and generating a picture based on the received flowfile.
In a specific embodiment, the processing procedures of the first nifi node, the second nifi node, the third nifi node and the fourth nifi nodes are all displayed in a manner of an image interface.
In a specific embodiment, one or more of the first, second, and third nifi nodes comprise a plurality of child nifi nodes.
In a specific embodiment, the generating a ctl file based on the meteorological source file includes:
acquiring weather information based on a source file name in the weather source file; the weather information comprises an air quality name, a time of reporting and a boundary range;
and generating a ctl file based on the meteorological information.
In a specific embodiment, the parameters include any combination of one or more of the following: the weather general parameters, the boundary range of the weather factors, the color range corresponding to the names of the weather factors, the numerical range corresponding to the color range and the picture generation path.
In a specific embodiment, the generating a picture based on the received flowfile includes:
generating an initial picture based on the ctl file in the received flowfile and the parameters;
and carrying out transparency processing on the background color of the initial picture, and simultaneously retaining the color in the boundary range of the initial picture to obtain a final picture.
And the plurality of fourth nifi nodes are used for processing the ctl files in the flowfile in parallel, so that the processing efficiency is improved, and the occurrence of congestion is effectively avoided.
In a specific embodiment, the meteorological source file is obtained from an ftp server; the method further comprises the steps of:
and uploading the generated picture to an ftp server.
The embodiment of the invention also provides a meteorological data processing device, which comprises:
the acquisition module is used for acquiring a meteorological source file through a first nifi node, generating a ctl file based on the meteorological source file, and storing the ctl file in a flowfile;
the setting module is used for reading the ctl file from the flowfile through the second nifi node and setting parameters for the read ctl file;
the distribution module is used for distributing the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through a third nifi node;
and the generating module is used for receiving the flowfiles through the plurality of fourth nifi nodes and generating pictures based on the received flowfiles.
The embodiment of the invention also provides a terminal which comprises a memory and a processor, wherein the memory stores a computer program, and the processor runs the computer program to enable the processor to execute the meteorological data processing method.
The embodiment of the invention also provides a storage medium, wherein the storage medium is stored with a computer program, and the computer program realizes the method for processing the meteorological data when being executed by a processor.
Accordingly, the embodiment of the invention provides a meteorological data processing method, a device, a terminal and a storage medium, wherein the method comprises the following steps: acquiring a meteorological source file through a first nifi node, generating a ctl file based on the meteorological source file, and storing the ctl file in a flowfile; reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file; distributing the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi node; and receiving the flowfile through the plurality of fourth nifi nodes, and generating a picture based on the received flowfile. The meteorological data are processed in parallel through the plurality of nifi nodes, linkage is realized among the nifi nodes through the flowfile data flow, expansion is facilitated, the processing speed is accelerated, and congestion is avoided.
Drawings
In order to more clearly illustrate the technical solutions of the present invention, the drawings that are required for the embodiments will be briefly described, it being understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope of the present invention. Like elements are numbered alike in the various figures.
FIG. 1 is a schematic flow chart of a method for processing meteorological data according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of a method for processing meteorological data according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a picture obtained by a method for processing meteorological data according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a weather data processing apparatus according to an embodiment of the present invention;
fig. 5 is a schematic diagram of another structure of a meteorological data processing apparatus according to an embodiment of the present invention.
Legend description:
201-an acquisition module; 202-setting up a module; 203-a distribution module; 204-a generation module; 205-upload module.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments.
The components of the embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be made by a person skilled in the art without making any inventive effort, are intended to be within the scope of the present invention.
The terms "comprises," "comprising," "including," or any other variation thereof, are intended to cover a specific feature, number, step, operation, element, component, or combination of the foregoing, which may be used in various embodiments of the present invention, and are not intended to first exclude the presence of or increase the likelihood of one or more other features, numbers, steps, operations, elements, components, or combinations of the foregoing.
Furthermore, the terms "first," "second," "third," and the like are used merely to distinguish between descriptions and should not be construed as indicating or implying relative importance.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which various embodiments of the invention belong. The terms (such as those defined in commonly used dictionaries) will be interpreted as having a meaning that is the same as the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein in connection with the various embodiments of the invention.
Example 1
The embodiment 1 of the invention discloses a meteorological data processing method, which is shown in fig. 1 and 2 and comprises the following steps:
step S101, acquiring a meteorological source file through a first nifi node, generating a ctl file based on the meteorological source file, and storing the ctl file in a flowfile;
specifically, the meteorological source file is obtained from an ftp (File Transfer Protocol ) server; each ni fi (a real-time data stream processing system) node is a processor, and the ctl file is a file containing control information. flowfile is then a stream file.
Thus, as shown in fig. 2, the "generating a ctl file based on the meteorological source file" in step S101 includes:
acquiring weather information based on a source file name in the weather source file; the weather information comprises an air quality name, a time of reporting and a boundary range;
and generating a ctl file based on the meteorological information.
Step S102, reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file;
specifically, the parameters include any combination of one or more of the following: the weather general parameters, the boundary range of the weather factors, the color range corresponding to the names of the weather factors, the numerical range corresponding to the color range and the picture generation path.
Step S103, distributing the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through a third nifi node;
specifically, after the parameters are set, the parameters are distributed to a plurality of fourth nifi nodes, so that the processing efficiency is accelerated.
And step S104, receiving the flowfile through the plurality of fourth nifi nodes, and generating a picture based on the received flowfile.
The "generating a picture based on the received flowfile" in the specific step S104 includes:
generating an initial picture based on the ctl file in the received flowfile and the parameters;
and carrying out transparency processing on the background color of the initial picture, and simultaneously retaining the color in the boundary range of the initial picture to obtain a final picture.
After the picture is generated, the method further comprises: and uploading the generated picture to an ftp server.
In addition, the processing procedures of the first nifi node, the second nifi node, the third nifi node and the fourth nifi nodes are all displayed in a manner of an image interface (for example, the processing procedures can be displayed in a web interface manner), so that the analysis flow and the result after analysis of each flow can be visually seen, the dynamic setting of additional parameter configuration is easy to realize, code modification is not needed, redeployment is not needed, the procedure is simple, the nifi nodes can be effectively restarted only by the image interface, for example, the web interface, and the display in the manner of the image interface is also convenient to start and stop. That is, each processing process can be deployed on a plurality of servers, so that the horizontal expansion is further improved, and the analysis efficiency is further improved.
Each parsing flow is replaced by a nifi node, the flow is clear, and each processor stores the parsed data in a flowfile object and then flows the flowfile object to the next processor. And a plurality of nifi nodes are deployed, so that the analysis efficiency is improved.
Specifically, taking fig. 2 as an example, in a specific application scenario, the scheme includes the following steps:
1. and pulling the meteorological source file.
2. And acquiring information such as an air quality name, a time of report, a boundary range and the like according to the source file name, and generating a ctl file.
3. The ctl information is stored in the flowfile object and flows to the next processor.
4. Setting general parameters when OpenGrADS (a weather drawing enhancement software) reads the ctl content.
5. And setting a meteorological factor boundary range.
6. The color range is set according to the weather factor name.
7. A numerical range corresponding to the color range is set.
8. And setting a picture generation path.
9. The flowfile stream is transferred to other processing nodes using the http (hypertext transfer protocol) protocol.
10. The processing node receives a flowfile byte stream.
11. And generating a picture according to the parameter information carried in the flowfile object.
12. The background color of the picture is made transparent, the color within the boundary is preserved, and the resulting picture is shown in fig. 3, where the background is transparent, but the color within the boundary is preserved.
13. The pictures are uploaded to an ftp server for proxy access by nginx (english full name engine x, a high-performance HTTP and reverse proxy web server).
Example 2
In view of this, an apparatus for processing meteorological data according to embodiment 2 of the present invention, as shown in fig. 4, includes:
an obtaining module 201, configured to obtain a meteorological source file through a first nifi node, generate a ctl file based on the meteorological source file, and store the ctl file in a flowfile;
a setting module 202, configured to read the ctl file from the flowfile through a second nifi node, and set parameters for the read ctl file;
a distributing module 203, configured to distribute, by using a third nifi node, the ctl file with the parameters set to a plurality of fourth nifi nodes in a flowfile manner;
and the generating module 204 is configured to receive the flowfiles through the plurality of fourth nifi nodes, and generate a picture based on the received flowfiles.
In a specific embodiment, the processing procedures of the first nifi node, the second nifi node, the third nifi node and the fourth nifi nodes are all displayed in a manner of an image interface.
In a specific embodiment, one or more of the first, second, and third nifi nodes comprise a plurality of child nifi nodes.
In a specific embodiment, the obtaining module 201 "generates a ctl file based on the meteorological source file", including:
acquiring weather information based on a source file name in the weather source file; the weather information comprises an air quality name, a time of reporting and a boundary range;
and generating a ctl file based on the meteorological information.
In a specific embodiment, the parameters include any combination of one or more of the following: the weather general parameters, the boundary range of the weather factors, the color range corresponding to the names of the weather factors, the numerical range corresponding to the color range and the picture generation path.
In a specific embodiment, the generating module 204 "generates a picture based on the received flowfile", including:
generating an initial picture based on the ctl file in the received flowfile and the parameters;
and carrying out transparency processing on the background color of the initial picture, and simultaneously retaining the color in the boundary range of the initial picture to obtain a final picture.
In a specific embodiment, the meteorological source file is obtained from an ftp server;
as shown in fig. 5, the apparatus further includes:
and the uploading module 205 is configured to upload the generated picture to the ftp server.
Example 3
The embodiment 3 of the invention also discloses a terminal, which comprises a memory and a processor, wherein the memory stores a computer program, and the processor runs the computer program to enable the processor to execute the meteorological data processing method in the embodiment 1.
Example 4
Embodiment 4 of the present invention further discloses a storage medium, where a computer program is stored, and when the computer program is executed by a processor, the method for processing meteorological data in embodiment 1 is implemented.
Accordingly, the embodiment of the invention provides a meteorological data processing method, a device, a terminal and a storage medium, wherein the method comprises the following steps: acquiring a meteorological source file through a first nifi node, generating a ctl file based on the meteorological source file, and storing the ctl file in a flowfile; reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file; distributing the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi node; and receiving the flowfile through the plurality of fourth nifi nodes, and generating a picture based on the received flowfile. The meteorological data are processed in parallel through the plurality of nifi nodes, linkage is realized among the nifi nodes through the flowfile data flow, expansion is facilitated, the processing speed is accelerated, and congestion is avoided.
In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners as well. The apparatus embodiments described above are merely illustrative, for example, of the flow diagrams and block diagrams in the figures, which illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules or units in various embodiments of the invention may be integrated together to form a single part, or the modules may exist alone, or two or more modules may be integrated to form a single part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a smart phone, a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, randomAccess Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention.
Claims (8)
1. A method for processing meteorological data, comprising:
acquiring a meteorological source file through a first nifi node, generating a ctl file based on the meteorological source file, and storing the ctl file in a flowfile;
reading the ctl file from the flowfile through a second nifi node, and setting parameters for the read ctl file;
the parameters include any combination of one or more of the following: the method comprises the steps of generating a path by using weather general parameters, a boundary range of weather factors, a color range corresponding to the names of the weather factors, a numerical value range corresponding to the color range and a picture;
distributing the ctl file provided with the parameters to a plurality of fourth nifi nodes in a flowfile manner through the third nifi node;
receiving a flowfile through the plurality of fourth nifi nodes, and generating a picture based on the received flowfile;
generating an initial picture based on the ctl file in the received flowfile and the parameters;
and carrying out transparency processing on the background color of the initial picture, and simultaneously retaining the color in the boundary range of the initial picture to obtain a final picture.
2. The method of claim 1, wherein the processing of the first nifi node, the second nifi node, the third nifi node, and each of the fourth nifi nodes are all presented as an image interface.
3. The method of claim 1, wherein one or more of the first, second, and third nifi nodes comprises a plurality of child nifi nodes.
4. The method of claim 1, wherein the generating a ctl file based on the meteorological source file comprises:
acquiring weather information based on a source file name in the weather source file; the weather information comprises an air quality name, a time of reporting and a boundary range;
and generating a ctl file based on the meteorological information.
5. The method of claim 1, wherein the meteorological source file is obtained from an ftp server; the method further comprises the steps of:
and uploading the generated picture to an ftp server.
6. A weather data processing apparatus, comprising:
the acquisition module is used for acquiring a meteorological source file through a first nifi node, generating a ctl file based on the meteorological source file, and storing the ctl file in a flowfile;
the setting module is used for reading the ctl file from the flowfile through the second nifi node and setting parameters for the read ctl file; the parameters include any combination of one or more of the following: the method comprises the steps of generating a path by using weather general parameters, a boundary range of weather factors, a color range corresponding to the names of the weather factors, a numerical value range corresponding to the color range and a picture;
the distribution module is used for distributing the ctl file with the parameters to a plurality of fourth nifi nodes in a flowfile manner through a third nifi node;
the generating module is used for receiving the flowfiles through the plurality of fourth nifi nodes and generating pictures based on the received flowfiles;
and the processing module is used for generating an initial picture based on the ctl file in the received flowfile and the parameters, and performing transparency processing on the background color of the initial picture, and simultaneously reserving the color in the boundary range of the initial picture to obtain a final picture.
7. A terminal comprising a memory and a processor, the memory storing a computer program, the processor running the computer program to cause the processor to perform the method of processing meteorological data according to any one of claims 1 to 5.
8. A storage medium having stored thereon a computer program which, when executed by a processor, implements a method of processing meteorological data according to any one of claims 1 to 5.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111046860.5A CN113688100B (en) | 2021-09-06 | 2021-09-06 | Meteorological data processing method, device, terminal and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111046860.5A CN113688100B (en) | 2021-09-06 | 2021-09-06 | Meteorological data processing method, device, terminal and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113688100A CN113688100A (en) | 2021-11-23 |
CN113688100B true CN113688100B (en) | 2023-07-18 |
Family
ID=78585758
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111046860.5A Active CN113688100B (en) | 2021-09-06 | 2021-09-06 | Meteorological data processing method, device, terminal and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113688100B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113936432B (en) * | 2021-12-17 | 2022-03-29 | 中国气象局公共气象服务中心(国家预警信息发布中心) | Weather early warning image-text generation method and device and electronic equipment |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106202378A (en) * | 2016-07-08 | 2016-12-07 | 中国地质大学(武汉) | The immediate processing method of a kind of streaming meteorological data and system |
CN107577486A (en) * | 2017-09-29 | 2018-01-12 | 广州数鹏通科技有限公司 | Weather information drawing processing method, device, computer equipment and storage medium |
WO2018214388A1 (en) * | 2017-05-23 | 2018-11-29 | 深圳大学 | Multi-platform big data system and method for aviation electronics |
CN109542593A (en) * | 2018-11-27 | 2019-03-29 | 浪潮天元通信信息系统有限公司 | A kind of flow chart of data processing design method based on NIFI |
CN112948653A (en) * | 2021-04-23 | 2021-06-11 | 广东省气象探测数据中心 | Meteorological data monitoring system based on business process |
WO2021114812A1 (en) * | 2019-12-12 | 2021-06-17 | 中兴通讯股份有限公司 | Data acquisition method and apparatus, computer device, and computer-readable medium |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9558192B2 (en) * | 2013-11-13 | 2017-01-31 | Datadirect Networks, Inc. | Centralized parallel burst engine for high performance computing |
US9762672B2 (en) * | 2015-06-15 | 2017-09-12 | International Business Machines Corporation | Dynamic node group allocation |
-
2021
- 2021-09-06 CN CN202111046860.5A patent/CN113688100B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106202378A (en) * | 2016-07-08 | 2016-12-07 | 中国地质大学(武汉) | The immediate processing method of a kind of streaming meteorological data and system |
WO2018214388A1 (en) * | 2017-05-23 | 2018-11-29 | 深圳大学 | Multi-platform big data system and method for aviation electronics |
CN107577486A (en) * | 2017-09-29 | 2018-01-12 | 广州数鹏通科技有限公司 | Weather information drawing processing method, device, computer equipment and storage medium |
CN109542593A (en) * | 2018-11-27 | 2019-03-29 | 浪潮天元通信信息系统有限公司 | A kind of flow chart of data processing design method based on NIFI |
WO2021114812A1 (en) * | 2019-12-12 | 2021-06-17 | 中兴通讯股份有限公司 | Data acquisition method and apparatus, computer device, and computer-readable medium |
CN112948653A (en) * | 2021-04-23 | 2021-06-11 | 广东省气象探测数据中心 | Meteorological data monitoring system based on business process |
Non-Patent Citations (3)
Title |
---|
NiFi数据流实例三;邢为栋;CSDN;第1-10页 * |
基于流技术的自动气象站数据处理优化方法;孙周军;李高洁;黄伟;郑艳萍;;气象水文海洋仪器(04);第32-36页 * |
气象资料数据化全流程监控方案研究;金圣宇;;电子世界(10);第63-64页 * |
Also Published As
Publication number | Publication date |
---|---|
CN113688100A (en) | 2021-11-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107729475B (en) | Webpage element acquisition method, device, terminal and computer-readable storage medium | |
CN109857908B (en) | Method and apparatus for matching videos | |
KR20190014098A (en) | System and method for identifying matching content | |
CN113688100B (en) | Meteorological data processing method, device, terminal and storage medium | |
US11303949B2 (en) | Method of switching resolution, computing device, and computer-readable storage medium | |
CN111510777B (en) | Method and device for measuring network speed, computer equipment and readable storage medium | |
US11017237B1 (en) | Systems and methods for automated video classification | |
CN111770360B (en) | Method and system for marking whole flow of video manuscript collection, editing and auditing | |
CN111147354B (en) | Message processing method, device, equipment and storage medium | |
US10956746B1 (en) | Systems and methods for automated video classification | |
CN110737795A (en) | Photo album cover determining method, device, equipment and storage medium | |
CN108055594B (en) | Edge slicing implementation method and device, computer equipment and storage medium | |
CN107948234B (en) | Data processing method and device | |
CN111626922B (en) | Picture generation method and device, electronic equipment and computer readable storage medium | |
CN105871802A (en) | Method, device and system for monitoring transmission of streaming media file | |
US9794213B1 (en) | Social interaction data preservation for augmented photos | |
CN106649724B (en) | Information display method and device and user terminal | |
CN106934041B (en) | image file management method and device | |
CN113438503B (en) | Video file restoring method, device, computer equipment and storage medium | |
CN111428128B (en) | Method for generating pluggable recommendation system, service recommendation method, device and equipment | |
CN111479140B (en) | Data acquisition method, data acquisition device, computer device and storage medium | |
CN109462496B (en) | Data processing method and device for video network terminal | |
CN111225263B (en) | Video playing control method and device, electronic equipment and storage medium | |
US11138440B1 (en) | Systems and methods for automated video classification | |
CN104346338A (en) | Multimedia information display method and device for terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |