CN110188370B - A Rapid Modeling Approach for Automated Reusable Geospatial Information Processing - Google Patents
A Rapid Modeling Approach for Automated Reusable Geospatial Information Processing Download PDFInfo
- Publication number
- CN110188370B CN110188370B CN201910279328.4A CN201910279328A CN110188370B CN 110188370 B CN110188370 B CN 110188370B CN 201910279328 A CN201910279328 A CN 201910279328A CN 110188370 B CN110188370 B CN 110188370B
- Authority
- CN
- China
- Prior art keywords
- model
- sequence
- engine
- operators
- operator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 11
- 238000000034 method Methods 0.000 claims abstract description 32
- 238000012545 processing Methods 0.000 claims abstract description 19
- 238000011161 development Methods 0.000 claims abstract description 8
- 230000008569 process Effects 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000012360 testing method Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 claims description 2
- 125000004122 cyclic group Chemical group 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 5
- 230000010354 integration Effects 0.000 abstract description 2
- 230000008901 benefit Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 4
- 238000004220 aggregation Methods 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012732 spatial analysis Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Geometry (AREA)
- Remote Sensing (AREA)
- Computer Hardware Design (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Stored Programmes (AREA)
Abstract
本发明公开了一种自动化可复用地理空间信息处理快速建模方法，通过主要技术方案，针对地理空间信息处理，可以广泛的将现有的各种已有处理能力汇聚到一起，形成不同平台环境下的功能最大并集，除了完整集成ArcGIS已有的GP功能，将其他方基于GP模型开发的Python算子功能、将各个专题应用根据需求自定制开发的算子功能、将历史积累的大量可执行程序功能统统纳入模型中来。通过次要技术方案，将模型的可复用效果发挥到最大，通过简单的二次开发调用，可以将主要技术方案形成的模型，快速接入各类应用环境中，极大提升了模型的应用效果和应用范围，降低了模型的快速复用难度。
The invention discloses an automatic and reusable geospatial information processing rapid modeling method. Through the main technical scheme, for geospatial information processing, various existing processing capabilities can be widely gathered together to form different platforms The largest combination of functions in the environment, in addition to the complete integration of the existing GP functions of ArcGIS, the Python operator functions developed by other parties based on the GP model, the custom developed operator functions for each topic application, and a large number of historically accumulated functions. Executable program functions are all incorporated into the model. Through the secondary technical solutions, the reusable effect of the model can be maximized. Through simple secondary development calls, the models formed by the main technical solutions can be quickly integrated into various application environments, which greatly improves the application of the model. The effect and scope of application reduce the difficulty of rapid reuse of the model.
Description
Technical Field
The invention relates to a quick modeling technical method aiming at geospatial information processing, in particular to an automatic reusable geospatial information processing quick modeling method.
Background
The quick modeling technical method aiming at the processing of the geospatial information has two types which are the closest to the prior art of the invention: a ModelBuilder modeling method in commercial geographic information software represented by ArcGIS; and the other is an open source geospatial information ETL tool modeling method represented by GeoKettle.
The technical defect of ArcGIS model builder is caused by the limitation of GP processing tools, the implementation of the bottom layer technology depends on Windows COM technology, and strict specification limitation is implemented on model operator interfaces, so that a complete technical system can be ensured for a closed platform, but the access support degree of a third-party model operator is not enough.
The technical defect of the GeoKettle is that a modeling method is developed from a Kettle which is a pure ETL modeling processing tool, a built model is required to be executed through a command line mode or a GUI mode, and due to the architectural design, a core module is not subjected to micro-aggregation, so that the core module is separated from a provided running environment, and the model cannot be embedded into other applications.
Disclosure of Invention
The invention aims to solve the problems and provide an automatic reusable geospatial information processing rapid modeling method.
The invention realizes the purpose through the following technical scheme:
the invention comprises the following steps:
the method comprises the following steps: firstly, converging original execution operators, wherein the model comprises four major operator accessible models: the GP tool takes the processing tools accumulated by the original platforms such as ArcGIS and the like as operators to be all brought in; second, Python processing tool which accords with GP standard that other third party develops; thirdly, a functional operator is self-customized and developed based on the system of the method; fourthly, processing operators formed by various historical accumulated executable programs through parameter stripping and transformation;
step two: and compiling a model sequence through a modeler, wherein the model sequence is a set capable of sequentially executing processing operators according to certain logic, and an XML file is used as a sequence carrier. The modeling device browses and selects all available operators in the operator library in a visual mode, automatically prompts to select parameter transmission, interactively edits to form a model sequence, the model sequence comprises execution logics such as sequence, nesting and circulation, and the modeling process is similar to simple interactive program building development;
step three: in the modeling process, the correctness of model parameters can be automatically checked through a model editor at any time, a model sequence is compiled, and the structure of the model sequence is adjusted in real time according to requirements;
step IV: after the model sequence is built, filling test parameters through a model tester, and performing automatic model test, wherein if the model fails to operate or does not accord with a preset target, the model editor is returned to modify the model;
step five: the model sequence meeting the requirements can be tested to derive a localized file, and the model sequence can be loaded to run repeatedly later and can also be embedded into other system multiplexing models together with the model execution engine.
The invention is oriented to the geospatial information processing modeling achievement, and under a multi-environment, the invention is automatic, rapid and reusable in model, and adopts the following technical scheme:
the established model in the first process is quickly and simply reused in other environments, other application scenes are embedded through secondary development of the model engine, and the execution model is called through the model engine in other scenes, so that other application systems obtain the multiplexing capability of the model:
step 1: filling a model operator, a model sequence and input parameters (including exchange selection or intervention parameters) into a model engine;
step 2: the model engine depends on the model framework to define a minimum contract interface, realizes corresponding operators of different types, classifies and calls specific engine entities, and realizes a GP engine, a Python engine, a self-customizing engine and an executive program engine;
and step 3: the model engine calls a model interpreter to forward analyze the model sequence, check form parameters and actual parameters and materialize operator objects;
and 4, step 4: the model operator orderly calls model operators according to the interpretation result of the interpreter and the model sequence logic to carry out actual model operation and carry out parameter transmission among different operators;
and 5: in the running process of the model sequence, the model engine reports the monitoring log to a subscription terminal (including error information and normal execution process progress) in real time through an observer mode, and if the model is executed successfully, a result and model parameters are output.
The invention has the beneficial effects that:
the invention relates to an automatic reusable geographical space information processing rapid modeling method, which has the following advantages compared with the prior art:
the function is improved. By the main technical scheme, aiming at the processing of geographic space information, various existing processing capacities can be widely converged together to form a maximum function union under different platform environments, except for completely integrating the existing GP function of ArcGIS, Python operator functions developed by other parties based on a GP model, operator functions developed by each topic application according to the requirement in a self-customized manner and a large number of historically accumulated executable program functions are integrally incorporated into the model.
② the effect is improved. Through the secondary technical scheme, the reusable effect of the model is exerted to the maximum, the model formed by the primary technical scheme can be quickly accessed into various application environments through simple secondary development and calling, the application effect and the application range of the model are greatly improved, and the quick reuse difficulty of the model is reduced.
And social benefits. The technical method has stronger social benefit, can effectively combine academic modeling and industrial application, enables the geographic space information professionals to concentrate on model optimization, enables the industrial engineering technicians to concentrate on the model for quick reuse, can effectively bridge the existing academic and industrial gaps, and has better social application benefit.
Fourthly, economic benefit. The related software formed by the technical method has been partially applied to various production and engineering projects: in the geographic information node service integration, by the technical method, service chain aggregation is realized at a WEB end, and geological disaster rapid spatial analysis is performed; in the construction of database building software of a digital city database and in the construction of database building software of a national and local three-tone database, the application system can be quickly built by the technical method, and the development period of geographic information software is greatly shortened. In conclusion, by the technical method, economic cost can be saved and better economic benefit can be obtained due to reusable rapid modeling.
Drawings
FIG. 1 is a modeling flow diagram of the present invention;
FIG. 2 is a call flow diagram of the present invention.
Detailed Description
The invention will be further described with reference to the accompanying drawings in which:
as shown in fig. 1:
compared with the technical method, the ArcGIS model builder technology can only use the own GP processing tool which meets the interface requirement of the ArcGIS model builder technology for modeling, and can not quickly take a third party processing tool and an executable program as processing operators to be fused into a processing model;
compared with the method, the established model can only operate in the host environment to perform data ETL, and cannot strip the core model and quickly integrate the core model into other application scenes to perform secondary development and calling.
The foregoing shows and describes the general principles and features of the present invention, together with the advantages thereof. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are described in the specification and illustrated only to illustrate the principle of the present invention, but that various changes and modifications may be made therein without departing from the spirit and scope of the present invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (2)
1. An automatic reusable geospatial information processing rapid modeling method is characterized in that: the method comprises the following steps:
the method comprises the following steps: firstly, converging original execution operators, wherein the model comprises four major operator accessible models: the GP tool takes the processing tools accumulated by the original ArcGIS platform as operators to be all brought in; second, Python processing tool which accords with GP standard that other third party develops; thirdly, a functional operator is self-customized and developed based on the system of the method; fourthly, processing operators formed by various historical accumulated executable programs through parameter stripping and transformation;
step two: compiling a model sequence through a modeler, wherein the model sequence is a set capable of sequentially executing processing operators according to certain logic, and an XML file is used as a sequence carrier; the modeling device browses and selects all available operators in an operator library in a visual mode, automatically prompts to select parameter transmission, interactively edits to form a model sequence, the model sequence comprises sequence, nesting and cyclic execution logic, and the modeling process is similar to simple interactive program building development;
step three: in the modeling process, the correctness of model parameters can be automatically checked through a model editor at any time, a model sequence is compiled, and the structure of the model sequence is adjusted in real time according to requirements;
step IV: after the model sequence is built, filling test parameters through a model tester, and performing automatic model test, wherein if the model fails to operate or does not accord with a preset target, the model editor is returned to modify the model;
step five: the model sequence meeting the requirements can be tested to derive a localized file, and the model sequence can be loaded to run repeatedly later and can also be embedded into other system multiplexing models together with the model execution engine.
2. The automated reusable geospatial information processing rapid modeling method of claim 1 in which: facing to the modeling achievement of the geographic space information processing, under a multi-environment, the automatic, fast and multiplexing model adopts the following technical scheme:
the established model in the step I is quickly and simply reused in other environments, other application scenes are embedded through secondary development of the model engine, and the execution model is called through the model engine in other scenes, so that other application systems obtain the multiplexing capability of the model:
step 1: filling the model operator, the model sequence and the input parameters into a model engine; wherein the input parameters include exchange selection or intervention parameters;
step 2: the model engine depends on the model framework to define a minimum contract interface, realizes corresponding operators of different types, classifies and calls specific engine entities, and realizes a GP engine, a Python engine, a self-customizing engine and an executive program engine;
and step 3: the model engine calls a model interpreter to forward analyze the model sequence, check form parameters and actual parameters and materialize operator objects;
and 4, step 4: the model operator orderly calls model operators according to the interpretation result of the interpreter and the model sequence logic to carry out actual model operation and carry out parameter transmission among different operators;
and 5: in the running process of the model sequence, the model engine reports the monitoring log to a subscription terminal in real time through an observer mode, and if the model is successfully executed, a result and model parameters are output; the monitoring log comprises error information and normal execution flow progress.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910279328.4A CN110188370B (en) | 2019-04-09 | 2019-04-09 | A Rapid Modeling Approach for Automated Reusable Geospatial Information Processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910279328.4A CN110188370B (en) | 2019-04-09 | 2019-04-09 | A Rapid Modeling Approach for Automated Reusable Geospatial Information Processing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110188370A CN110188370A (en) | 2019-08-30 |
| CN110188370B true CN110188370B (en) | 2021-11-05 |
Family
ID=67713797
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910279328.4A Expired - Fee Related CN110188370B (en) | 2019-04-09 | 2019-04-09 | A Rapid Modeling Approach for Automated Reusable Geospatial Information Processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110188370B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112949061B (en) * | 2021-03-01 | 2023-11-10 | 北京清华同衡规划设计研究院有限公司 | Village and town development model construction method and system based on reusable operator |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104391922A (en) * | 2014-11-20 | 2015-03-04 | 武汉图歌信息技术有限责任公司 | Geographic space information self adaption multiple terminal visualization method |
| CN104503737A (en) * | 2014-11-20 | 2015-04-08 | 北京索为高科系统技术有限公司 | Unified modeling platform |
| CN104504171A (en) * | 2014-11-20 | 2015-04-08 | 北京索为高科系统技术有限公司 | Modeling method based on unified modeling environment |
| CN104572062A (en) * | 2014-04-15 | 2015-04-29 | 武汉中地数码科技有限公司 | Construction method for geospatial information workflow service function flow templates |
| KR20180035035A (en) * | 2016-09-28 | 2018-04-05 | 한국전자통신연구원 | Method and apparatus for optimizing query in data engine |
| CN109299526A (en) * | 2018-09-07 | 2019-02-01 | 武汉众智鸿图科技有限公司 | A kind of hydraulic model generation method and system based on water-supply management database |
-
2019
- 2019-04-09 CN CN201910279328.4A patent/CN110188370B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104572062A (en) * | 2014-04-15 | 2015-04-29 | 武汉中地数码科技有限公司 | Construction method for geospatial information workflow service function flow templates |
| CN104391922A (en) * | 2014-11-20 | 2015-03-04 | 武汉图歌信息技术有限责任公司 | Geographic space information self adaption multiple terminal visualization method |
| CN104503737A (en) * | 2014-11-20 | 2015-04-08 | 北京索为高科系统技术有限公司 | Unified modeling platform |
| CN104504171A (en) * | 2014-11-20 | 2015-04-08 | 北京索为高科系统技术有限公司 | Modeling method based on unified modeling environment |
| KR20180035035A (en) * | 2016-09-28 | 2018-04-05 | 한국전자통신연구원 | Method and apparatus for optimizing query in data engine |
| CN109299526A (en) * | 2018-09-07 | 2019-02-01 | 武汉众智鸿图科技有限公司 | A kind of hydraulic model generation method and system based on water-supply management database |
Non-Patent Citations (3)
| Title |
|---|
| A Similarity Evaluation Modal for Remote Sensing Data Distribution;Xiaoxia Yang等;《IEEE》;20181105;第2933-2936页 * |
| 基于ArcGIS ModelBuilder的复杂地质体自动建模方法;宋仁波等;《工程地质学报》;20170608;第25卷(第2期);第393-401页 * |
| 组件与服务耦合的地学模型集成方法与实现;张明达等;《武汉大学学报（信息科学版）》;20180731;第43卷(第7期);第1106-1112页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110188370A (en) | 2019-08-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107273286B (en) | Scene automatic test platform and method for task application | |
| CN108121216B (en) | Automated workshop virtual debugging method based on digital factory | |
| CN111209623A (en) | Building method of BIM family library of hydraulic and hydroelectric engineering | |
| CN107506303A (en) | Method, apparatus and system for automatic test | |
| CN111694741A (en) | Test case design method based on path depth coverage | |
| WO2022199179A1 (en) | Remaining life prediction model modeling system and method for equipment, and prediction system | |
| CN106294965A (en) | A kind of hull assembly Sequence Planning system and planing method thereof | |
| Bocciarelli et al. | BPMN-based business process modeling and simulation | |
| CN112465981A (en) | Method for automatically modeling by utilizing BIM data based on UE4 | |
| CN116171453A (en) | Method and apparatus for generating and utilizing knowledge patterns for manufacturing simulation models | |
| CN113868120A (en) | Industrial software debugging method and device, computer equipment and storage medium | |
| KR102268053B1 (en) | Intelligent safety fault diagnostic system of robotic process automation | |
| CN110188370B (en) | A Rapid Modeling Approach for Automated Reusable Geospatial Information Processing | |
| KR102418796B1 (en) | FMEA failure mode recommend system | |
| CN110059002A (en) | Generation method, test equipment, storage medium and the device of test data | |
| CN112578755A (en) | Programmable intelligent controller and application system based on programmable intelligent controller | |
| CN107291992B (en) | Comprehensive environment test simulation system and method suitable for electronic equipment in desert area | |
| CN114818361A (en) | Digital twin model construction method based on application scene | |
| CN110928761B (en) | Demand chain and system and method for application thereof | |
| CN103853554A (en) | Software reconstruction position determination method and software reconstruction position identification device | |
| CN116822631A (en) | Graph-based interpretable cognitive reasoning penetration robot system | |
| CN113485940B (en) | Combined test case generation method based on parameter abstract modeling | |
| US8234597B2 (en) | Tool and method to graphically correlate process and test data with specific chips on a wafer | |
| CN115712420A (en) | Architecture design and architecture conversion method based on complex real-time embedded system | |
| CN118034661B (en) | Large language model intelligent task application system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20211105 |