CN110188370B - Automatic reusable rapid modeling method for processing geographic space information - Google Patents
Automatic reusable rapid modeling method for processing geographic space information Download PDFInfo
- Publication number
- CN110188370B CN110188370B CN201910279328.4A CN201910279328A CN110188370B CN 110188370 B CN110188370 B CN 110188370B CN 201910279328 A CN201910279328 A CN 201910279328A CN 110188370 B CN110188370 B CN 110188370B
- Authority
- CN
- China
- Prior art keywords
- model
- sequence
- engine
- operators
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 238000012545 processing Methods 0.000 title claims abstract description 22
- 238000011161 development Methods 0.000 claims abstract description 8
- 230000010365 information processing Effects 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000012360 testing method Methods 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 claims description 2
- 125000004122 cyclic group Chemical group 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 5
- 230000008901 benefit Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 4
- 238000004220 aggregation Methods 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012732 spatial analysis Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Geometry (AREA)
- Remote Sensing (AREA)
- Computer Hardware Design (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses an automatic reusable rapid modeling method for processing geospatial information, which can be used for gathering various existing processing capacities together widely aiming at the processing of the geospatial information through a main technical scheme to form a maximum function union set under different platform environments. Through the secondary technical scheme, the reusable effect of the model is exerted to the maximum, the model formed by the primary technical scheme can be quickly accessed into various application environments through simple secondary development and calling, the application effect and the application range of the model are greatly improved, and the quick reuse difficulty of the model is reduced.
Description
Technical Field
The invention relates to a quick modeling technical method aiming at geospatial information processing, in particular to an automatic reusable geospatial information processing quick modeling method.
Background
The quick modeling technical method aiming at the processing of the geospatial information has two types which are the closest to the prior art of the invention: a ModelBuilder modeling method in commercial geographic information software represented by ArcGIS; and the other is an open source geospatial information ETL tool modeling method represented by GeoKettle.
The technical defect of ArcGIS model builder is caused by the limitation of GP processing tools, the implementation of the bottom layer technology depends on Windows COM technology, and strict specification limitation is implemented on model operator interfaces, so that a complete technical system can be ensured for a closed platform, but the access support degree of a third-party model operator is not enough.
The technical defect of the GeoKettle is that a modeling method is developed from a Kettle which is a pure ETL modeling processing tool, a built model is required to be executed through a command line mode or a GUI mode, and due to the architectural design, a core module is not subjected to micro-aggregation, so that the core module is separated from a provided running environment, and the model cannot be embedded into other applications.
Disclosure of Invention
The invention aims to solve the problems and provide an automatic reusable geospatial information processing rapid modeling method.
The invention realizes the purpose through the following technical scheme:
the invention comprises the following steps:
the method comprises the following steps: firstly, converging original execution operators, wherein the model comprises four major operator accessible models: the GP tool takes the processing tools accumulated by the original platforms such as ArcGIS and the like as operators to be all brought in; second, Python processing tool which accords with GP standard that other third party develops; thirdly, a functional operator is self-customized and developed based on the system of the method; fourthly, processing operators formed by various historical accumulated executable programs through parameter stripping and transformation;
step two: and compiling a model sequence through a modeler, wherein the model sequence is a set capable of sequentially executing processing operators according to certain logic, and an XML file is used as a sequence carrier. The modeling device browses and selects all available operators in the operator library in a visual mode, automatically prompts to select parameter transmission, interactively edits to form a model sequence, the model sequence comprises execution logics such as sequence, nesting and circulation, and the modeling process is similar to simple interactive program building development;
step three: in the modeling process, the correctness of model parameters can be automatically checked through a model editor at any time, a model sequence is compiled, and the structure of the model sequence is adjusted in real time according to requirements;
step IV: after the model sequence is built, filling test parameters through a model tester, and performing automatic model test, wherein if the model fails to operate or does not accord with a preset target, the model editor is returned to modify the model;
step five: the model sequence meeting the requirements can be tested to derive a localized file, and the model sequence can be loaded to run repeatedly later and can also be embedded into other system multiplexing models together with the model execution engine.
The invention is oriented to the geospatial information processing modeling achievement, and under a multi-environment, the invention is automatic, rapid and reusable in model, and adopts the following technical scheme:
the established model in the first process is quickly and simply reused in other environments, other application scenes are embedded through secondary development of the model engine, and the execution model is called through the model engine in other scenes, so that other application systems obtain the multiplexing capability of the model:
step 1: filling a model operator, a model sequence and input parameters (including exchange selection or intervention parameters) into a model engine;
step 2: the model engine depends on the model framework to define a minimum contract interface, realizes corresponding operators of different types, classifies and calls specific engine entities, and realizes a GP engine, a Python engine, a self-customizing engine and an executive program engine;
and step 3: the model engine calls a model interpreter to forward analyze the model sequence, check form parameters and actual parameters and materialize operator objects;
and 4, step 4: the model operator orderly calls model operators according to the interpretation result of the interpreter and the model sequence logic to carry out actual model operation and carry out parameter transmission among different operators;
and 5: in the running process of the model sequence, the model engine reports the monitoring log to a subscription terminal (including error information and normal execution process progress) in real time through an observer mode, and if the model is executed successfully, a result and model parameters are output.
The invention has the beneficial effects that:
the invention relates to an automatic reusable geographical space information processing rapid modeling method, which has the following advantages compared with the prior art:
the function is improved. By the main technical scheme, aiming at the processing of geographic space information, various existing processing capacities can be widely converged together to form a maximum function union under different platform environments, except for completely integrating the existing GP function of ArcGIS, Python operator functions developed by other parties based on a GP model, operator functions developed by each topic application according to the requirement in a self-customized manner and a large number of historically accumulated executable program functions are integrally incorporated into the model.
② the effect is improved. Through the secondary technical scheme, the reusable effect of the model is exerted to the maximum, the model formed by the primary technical scheme can be quickly accessed into various application environments through simple secondary development and calling, the application effect and the application range of the model are greatly improved, and the quick reuse difficulty of the model is reduced.
And social benefits. The technical method has stronger social benefit, can effectively combine academic modeling and industrial application, enables the geographic space information professionals to concentrate on model optimization, enables the industrial engineering technicians to concentrate on the model for quick reuse, can effectively bridge the existing academic and industrial gaps, and has better social application benefit.
Fourthly, economic benefit. The related software formed by the technical method has been partially applied to various production and engineering projects: in the geographic information node service integration, by the technical method, service chain aggregation is realized at a WEB end, and geological disaster rapid spatial analysis is performed; in the construction of database building software of a digital city database and in the construction of database building software of a national and local three-tone database, the application system can be quickly built by the technical method, and the development period of geographic information software is greatly shortened. In conclusion, by the technical method, economic cost can be saved and better economic benefit can be obtained due to reusable rapid modeling.
Drawings
FIG. 1 is a modeling flow diagram of the present invention;
FIG. 2 is a call flow diagram of the present invention.
Detailed Description
The invention will be further described with reference to the accompanying drawings in which:
as shown in fig. 1:
compared with the technical method, the ArcGIS model builder technology can only use the own GP processing tool which meets the interface requirement of the ArcGIS model builder technology for modeling, and can not quickly take a third party processing tool and an executable program as processing operators to be fused into a processing model;
compared with the method, the established model can only operate in the host environment to perform data ETL, and cannot strip the core model and quickly integrate the core model into other application scenes to perform secondary development and calling.
The foregoing shows and describes the general principles and features of the present invention, together with the advantages thereof. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are described in the specification and illustrated only to illustrate the principle of the present invention, but that various changes and modifications may be made therein without departing from the spirit and scope of the present invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (2)
1. An automatic reusable geospatial information processing rapid modeling method is characterized in that: the method comprises the following steps:
the method comprises the following steps: firstly, converging original execution operators, wherein the model comprises four major operator accessible models: the GP tool takes the processing tools accumulated by the original ArcGIS platform as operators to be all brought in; second, Python processing tool which accords with GP standard that other third party develops; thirdly, a functional operator is self-customized and developed based on the system of the method; fourthly, processing operators formed by various historical accumulated executable programs through parameter stripping and transformation;
step two: compiling a model sequence through a modeler, wherein the model sequence is a set capable of sequentially executing processing operators according to certain logic, and an XML file is used as a sequence carrier; the modeling device browses and selects all available operators in an operator library in a visual mode, automatically prompts to select parameter transmission, interactively edits to form a model sequence, the model sequence comprises sequence, nesting and cyclic execution logic, and the modeling process is similar to simple interactive program building development;
step three: in the modeling process, the correctness of model parameters can be automatically checked through a model editor at any time, a model sequence is compiled, and the structure of the model sequence is adjusted in real time according to requirements;
step IV: after the model sequence is built, filling test parameters through a model tester, and performing automatic model test, wherein if the model fails to operate or does not accord with a preset target, the model editor is returned to modify the model;
step five: the model sequence meeting the requirements can be tested to derive a localized file, and the model sequence can be loaded to run repeatedly later and can also be embedded into other system multiplexing models together with the model execution engine.
2. The automated reusable geospatial information processing rapid modeling method of claim 1 in which: facing to the modeling achievement of the geographic space information processing, under a multi-environment, the automatic, fast and multiplexing model adopts the following technical scheme:
the established model in the step I is quickly and simply reused in other environments, other application scenes are embedded through secondary development of the model engine, and the execution model is called through the model engine in other scenes, so that other application systems obtain the multiplexing capability of the model:
step 1: filling the model operator, the model sequence and the input parameters into a model engine; wherein the input parameters include exchange selection or intervention parameters;
step 2: the model engine depends on the model framework to define a minimum contract interface, realizes corresponding operators of different types, classifies and calls specific engine entities, and realizes a GP engine, a Python engine, a self-customizing engine and an executive program engine;
and step 3: the model engine calls a model interpreter to forward analyze the model sequence, check form parameters and actual parameters and materialize operator objects;
and 4, step 4: the model operator orderly calls model operators according to the interpretation result of the interpreter and the model sequence logic to carry out actual model operation and carry out parameter transmission among different operators;
and 5: in the running process of the model sequence, the model engine reports the monitoring log to a subscription terminal in real time through an observer mode, and if the model is successfully executed, a result and model parameters are output; the monitoring log comprises error information and normal execution flow progress.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910279328.4A CN110188370B (en) | 2019-04-09 | 2019-04-09 | Automatic reusable rapid modeling method for processing geographic space information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910279328.4A CN110188370B (en) | 2019-04-09 | 2019-04-09 | Automatic reusable rapid modeling method for processing geographic space information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110188370A CN110188370A (en) | 2019-08-30 |
| CN110188370B true CN110188370B (en) | 2021-11-05 |
Family
ID=67713797
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910279328.4A Expired - Fee Related CN110188370B (en) | 2019-04-09 | 2019-04-09 | Automatic reusable rapid modeling method for processing geographic space information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110188370B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112949061B (en) * | 2021-03-01 | 2023-11-10 | 北京清华同衡规划设计研究院有限公司 | Village and town development model construction method and system based on reusable operator |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104391922A (en) * | 2014-11-20 | 2015-03-04 | 武汉图歌信息技术有限责任公司 | Geographic space information self adaption multiple terminal visualization method |
| CN104504171A (en) * | 2014-11-20 | 2015-04-08 | 北京索为高科系统技术有限公司 | Modeling method based on unified modeling environment |
| CN104503737A (en) * | 2014-11-20 | 2015-04-08 | 北京索为高科系统技术有限公司 | Unified modeling platform |
| CN104572062A (en) * | 2014-04-15 | 2015-04-29 | 武汉中地数码科技有限公司 | Construction method for geospatial information workflow service function flow templates |
| KR20180035035A (en) * | 2016-09-28 | 2018-04-05 | 한국전자통신연구원 | Method and apparatus for optimizing query in data engine |
| CN109299526A (en) * | 2018-09-07 | 2019-02-01 | 武汉众智鸿图科技有限公司 | A kind of hydraulic model generation method and system based on water-supply management database |
-
2019
- 2019-04-09 CN CN201910279328.4A patent/CN110188370B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104572062A (en) * | 2014-04-15 | 2015-04-29 | 武汉中地数码科技有限公司 | Construction method for geospatial information workflow service function flow templates |
| CN104391922A (en) * | 2014-11-20 | 2015-03-04 | 武汉图歌信息技术有限责任公司 | Geographic space information self adaption multiple terminal visualization method |
| CN104504171A (en) * | 2014-11-20 | 2015-04-08 | 北京索为高科系统技术有限公司 | Modeling method based on unified modeling environment |
| CN104503737A (en) * | 2014-11-20 | 2015-04-08 | 北京索为高科系统技术有限公司 | Unified modeling platform |
| KR20180035035A (en) * | 2016-09-28 | 2018-04-05 | 한국전자통신연구원 | Method and apparatus for optimizing query in data engine |
| CN109299526A (en) * | 2018-09-07 | 2019-02-01 | 武汉众智鸿图科技有限公司 | A kind of hydraulic model generation method and system based on water-supply management database |
Non-Patent Citations (3)
| Title |
|---|
| A Similarity Evaluation Modal for Remote Sensing Data Distribution;Xiaoxia Yang等;《IEEE》;20181105;第2933-2936页 * |
| 基于ArcGIS ModelBuilder的复杂地质体自动建模方法;宋仁波等;《工程地质学报》;20170608;第25卷(第2期);第393-401页 * |
| 组件与服务耦合的地学模型集成方法与实现;张明达等;《武汉大学学报（信息科学版）》;20180731;第43卷(第7期);第1106-1112页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110188370A (en) | 2019-08-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107273286B (en) | Scene automatic test platform and method for task application | |
| CN106777101B (en) | Data processing engine | |
| CN111209623A (en) | Building method of BIM family library of hydraulic and hydroelectric engineering | |
| CN107506303A (en) | Method, apparatus and system for automatic test | |
| CN111694741A (en) | Test case design method based on path depth coverage | |
| CN108121216A (en) | A kind of automated workshop Virtual Debugging method based on digital factory | |
| KR102268053B1 (en) | Intelligent safety fault diagnostic system of robotic process automation | |
| CN116171453A (en) | Method and apparatus for generating and utilizing knowledge patterns for manufacturing simulation models | |
| CN110096445A (en) | A kind of model is in ring test method and device | |
| CN113868120A (en) | Industrial software debugging method and device, computer equipment and storage medium | |
| CN111858356A (en) | UI automatic testing method based on image recognition technology | |
| CN102707712B (en) | Electronic equipment fault diagnosis method and system | |
| CN112651057A (en) | Automatic building system and method for railway concrete filled steel tube tied arch bridge BIM model | |
| CN110188370B (en) | Automatic reusable rapid modeling method for processing geographic space information | |
| CN110069414A (en) | Regression testing method and system | |
| CN110059002A (en) | Generation method, test equipment, storage medium and the device of test data | |
| CN112578755A (en) | Programmable intelligent controller and application system based on programmable intelligent controller | |
| Hoang et al. | A capability model for the adaptation of manufacturing systems | |
| CN107291992B (en) | Comprehensive environment test simulation system and method suitable for electronic equipment in desert area | |
| CN115840616A (en) | Method and device for creating kinematic pair object and storage medium | |
| CN111680370A (en) | Design method and design device of hydraulic valve | |
| CN118041918A (en) | Distributed informationized data transmission method for digital visual platform | |
| Braun et al. | A methodology for the detection of functional relations of mechatronic components and assemblies in brownfield systems | |
| CN110928761B (en) | Demand chain and system and method for application thereof | |
| KR20220073151A (en) | FMEA failure mode recommend system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20211105 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |