CN110738453A - weather integrated service system based on cloud computing - Google Patents
weather integrated service system based on cloud computing Download PDFInfo
- Publication number
- CN110738453A CN110738453A CN201810803314.3A CN201810803314A CN110738453A CN 110738453 A CN110738453 A CN 110738453A CN 201810803314 A CN201810803314 A CN 201810803314A CN 110738453 A CN110738453 A CN 110738453A
- Authority
- CN
- China
- Prior art keywords
- data
- layer
- service
- platform
- weather
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007405 data analysis Methods 0.000 claims abstract description 4
- 238000007418 data mining Methods 0.000 claims abstract description 4
- 238000007781 pre-processing Methods 0.000 claims abstract description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 3
- 238000013500 data storage Methods 0.000 claims 1
- 238000007619 statistical method Methods 0.000 abstract description 3
- 230000010354 integration Effects 0.000 abstract 1
- 238000004364 calculation method Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01W—METEOROLOGY
- G01W1/00—Meteorology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Environmental & Geological Engineering (AREA)
- Theoretical Computer Science (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Marketing (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Health & Medical Sciences (AREA)
- Ecology (AREA)
- Health & Medical Sciences (AREA)
- Educational Administration (AREA)
- Life Sciences & Earth Sciences (AREA)
- Atmospheric Sciences (AREA)
- Biodiversity & Conservation Biology (AREA)
- Primary Health Care (AREA)
- Environmental Sciences (AREA)
- Data Mining & Analysis (AREA)
- Development Economics (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides weather integrated service systems based on cloud computing, which are characterized in that the system is designed into an application layer, a service layer, a data layer and a base layer from top to bottom, wherein the base layer is responsible for data acquisition and preprocessing and design and deployment of hardware platforms such as server clusters, networks and storage devices, the data layer adopts a mixed architecture of HDFS, HBASE and a relational database and comprises a big data base platform and a relational database, the service layer develops a big data platform service interface based on the big data base platform, the interface mainly provides series data services for upper layer application, the application layer mainly supports business applications such as data query, data analysis and data mining and the like realized by the big data platform, the data acquisition and warehousing interval of the system from the acquisition to the sharing query is not more than 10 seconds, the element value statistical analysis reaches a second-level response, the weather automatic station message acquisition and processing time is not less than 2 thousand files/second, and under the normal operation condition of system equipment, the data integration and warehousing time is not less than 2 records/second.
Description
Technical Field
The invention relates to weather integrated service systems, in particular to weather integrated service systems based on cloud computing.
Background
At present, more than 2000 country-level ground meteorological stations and more than 5 ten thousand area-level automatic stations are built in China, messages are transmitted times every 5 minutes, and the observation data are in the minute level, the development of detection technology enables meteorological data to have the characteristics of multiple types, large data volume, various and complex formats and the like, the meteorological data comprise 14 large types such as ground, high altitude, ocean, agricultural gas, radar, satellites and the like, hundreds of subclasses, the meteorological data comprise structured data such as txt, buff, xml formats and the like, and also comprise a plurality of unstructured data such as bIn, gr 1/2, hrIt Ib, netcdf, image formats and the like, the data attribute information, element information, station network information, space geographic information and the like form rich metadata.
Disclosure of Invention
The invention aims to provide cloud computing-based meteorological comprehensive service systems which are simplified and improve the working efficiency aiming at the defects of the prior art.
The technical scheme includes that the meteorological integrated service system based on cloud computing is designed into an application layer, a service layer, a data layer and a base layer from top to bottom, the base layer is responsible for data acquisition preprocessing and design and deployment of hardware platforms such as server clusters, networks and storage devices, the data layer adopts a mixed architecture of HDFS, HBASE and relational databases and comprises a big data base platform and a relational database, the service layer develops a big data platform service interface based on the big data base platform, the interface mainly provides series data services for upper layer application, and the application layer mainly supports business applications such as data query, data analysis and data mining and the like realized by the big data platform.
The technical solution of the present invention is further defined by step , wherein the service layer interface mainly includes two categories of query and computation, the query interface supports the service information query and retrieval service, and the computation interface supports the summary analysis service.
, the application layer mainly includes various business systems of all levels of weather business departments , related industry departments (such as water conservancy, territorial resources, and the like) which need to access weather data, data services developed for the social public in the future, and the like.
The weather integrated service system based on cloud computing has the advantages that the interval between the acquisition and storage of data and the sharing query is not more than 10 seconds, the statistical analysis of element values achieves second-level response, the time for acquiring and processing the messages of the weather automatic station is more than or equal to 2 thousand files/second, and the time for integrating and storing the data is more than or equal to 2 ten thousand records/second under the condition that system equipment normally operates.
Detailed Description
The technical solution of the present invention is described in detail below, but the scope of the present invention is not limited to the embodiments.
The embodiment 1 comprises meteorological integrated service systems based on cloud computing, which are designed into an application layer, a service layer, a data layer and a base layer from top to bottom, wherein the base layer is responsible for data acquisition and preprocessing and the design and deployment of hardware platforms such as server clusters, networks and storage devices, the clusters and the storage can be linearly expanded along with the increase of data volume so as to meet the needs of service growth, the data layer adopts a mixed structure of HDFS, HBASE and relational database and comprises a big data base platform and a relational database, the big data base platform deployed on the base facility is the core of the whole structure and mainly comprises two parts which are respectively a distributed file system and a distributed database and are integrated with a big data computing and retrieval engine suitable for meteorological data service requirements, the service layer develops a big data platform service interface based on the big data base platform, the interface mainly provides series data services for upper-layer applications, and the application layer mainly supports the business applications such as data query, data analysis and data mining and the like realized by the big data platform.
The service layer interface mainly comprises two categories of inquiry and calculation, the inquiry interface supports service information inquiry and retrieval service, and the calculation interface supports summary analysis service.
The application layer mainly comprises various service systems of all levels of weather service departments , relevant industry departments (such as water conservancy, territorial resources and the like) needing to access weather data, data services developed for the social public in the future and the like.
According to the weather integrated service system based on cloud computing, the interval between acquisition and storage of data and sharing query does not exceed 10 seconds, the element value statistical analysis achieves second-level response, the time for acquiring and processing weather automatic station messages is more than or equal to 2 thousand files/second, and the time for integrating and storing the data is more than or equal to 2 ten thousand records/second under the condition that system equipment normally operates.
As noted above, while the present invention has been shown and described with reference to certain preferred embodiments, it is not to be construed as limited thereto. Various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (3)
- The cloud computing-based meteorological integrated service system is characterized by comprising an application layer, a service layer, a data layer and a base layer from top to bottom, wherein the base layer is responsible for data acquisition and preprocessing and design and deployment of hardware platforms such as server clusters, networks and storage devices, the data layer adopts a mixed architecture of HDFS (high-level data storage system), HBASE (high-level database and relational database) and comprises a big data base platform and a relational database, the service layer develops a big data platform service interface based on the big data base platform, the interface mainly provides series data services for upper-layer application, and the application layer mainly supports business applications such as data query, data analysis and data mining realized by the big data platform.
- 2. The weather integrated service system based on cloud computing as claimed in claim 1, wherein the service layer interface mainly includes query and computing, the query interface supports service information query and retrieval services, and the computing interface supports summary analysis services.
- 3. The weather integrated service system based on cloud computing as claimed in claim 1, wherein the application layer is mainly various service systems of all levels of weather service department , related industry departments (such as water conservancy, homeland, etc.) that need to access weather data, and data services developed for the social public in the future.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810803314.3A CN110738453A (en) | 2018-07-20 | 2018-07-20 | weather integrated service system based on cloud computing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810803314.3A CN110738453A (en) | 2018-07-20 | 2018-07-20 | weather integrated service system based on cloud computing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110738453A true CN110738453A (en) | 2020-01-31 |
Family
ID=69235613
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810803314.3A Pending CN110738453A (en) | 2018-07-20 | 2018-07-20 | weather integrated service system based on cloud computing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110738453A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111552010A (en) * | 2020-04-28 | 2020-08-18 | 杨军 | Satellite remote sensing quick response and visualization service platform for global meteorological disasters |
| CN113254417A (en) * | 2021-06-29 | 2021-08-13 | 南京满星数据科技有限公司 | Meteorological grid data service method and system based on big data technology |
-
2018
- 2018-07-20 CN CN201810803314.3A patent/CN110738453A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111552010A (en) * | 2020-04-28 | 2020-08-18 | 杨军 | Satellite remote sensing quick response and visualization service platform for global meteorological disasters |
| CN113254417A (en) * | 2021-06-29 | 2021-08-13 | 南京满星数据科技有限公司 | Meteorological grid data service method and system based on big data technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108446293B (en) | Method for constructing city portrait based on city multi-source heterogeneous data | |
| US10346446B2 (en) | System and method for aggregating multi-source data and identifying geographic areas for data acquisition | |
| CN103020281B (en) | A kind of data storage and retrieval method based on spatial data numerical index | |
| CN102521386B (en) | Method for grouping space metadata based on cluster storage | |
| CN102906751B (en) | A kind of method of data storage, data query and device | |
| CN111459908A (en) | Multi-source heterogeneous ecological environment big data processing method and system based on data lake | |
| CN103136249A (en) | System and method of multiplex mode isomerous data integration | |
| CN104462244A (en) | Smart city heterogeneous data sharing method based on meta model | |
| CN103491187A (en) | Big data unified analyzing and processing method based on cloud computing | |
| CN102902743A (en) | Retrieval and reconstruction method for emergency plans | |
| CN111552813A (en) | Power knowledge graph construction method based on power grid full-service data | |
| CN104346438A (en) | Data management service system based on large data | |
| KR101982756B1 (en) | System and Method for processing complex stream data using distributed in-memory | |
| Roberts et al. | Impact of simulated twenty-first-century changes in extratropical cyclones on coastal flooding at the Battery, New York City | |
| CN113487251A (en) | Natural disaster early warning and emergency response method and system based on one-key type remote sensing | |
| CN110738453A (en) | weather integrated service system based on cloud computing | |
| Hulbert et al. | An experimental study of big spatial data systems | |
| CN106056515A (en) | Community grid event cluster feature extraction method | |
| Dobos et al. | A multi-terabyte relational database for geo-tagged social network data | |
| CN107330017A (en) | A kind of electric power mass data storage and query and statistical analysis method and its system based on subject example | |
| CN116126942A (en) | Multi-dimensional space meteorological grid data distributed storage query method and system | |
| CN109299207B (en) | Chinese earthquake motion parameter zone-drawing service system based on new media | |
| CN109189873A (en) | A kind of Meteorological Services big data monitoring analysis system platform | |
| CN112540987A (en) | Big data management system of distribution and utilization electricity based on data mart | |
| CN105955998B (en) | Radio monitoring data query method based on buffer technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200131 |
|
| WD01 | Invention patent application deemed withdrawn after publication |