CN101945126A - Forest resource heterogeneous data distributed management system - Google Patents

Forest resource heterogeneous data distributed management system Download PDF

Info

Publication number
CN101945126A
CN101945126A CN2010102759761A CN201010275976A CN101945126A CN 101945126 A CN101945126 A CN 101945126A CN 2010102759761 A CN2010102759761 A CN 2010102759761A CN 201010275976 A CN201010275976 A CN 201010275976A CN 101945126 A CN101945126 A CN 101945126A
Authority
CN
China
Prior art keywords
data
service
metadata
module
management
Prior art date
Application number
CN2010102759761A
Other languages
Chinese (zh)
Inventor
张旭
于新文
李轩
杨彦臣
Original Assignee
中国林业科学研究院资源信息研究所
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国林业科学研究院资源信息研究所 filed Critical 中国林业科学研究院资源信息研究所
Priority to CN2010102759761A priority Critical patent/CN101945126A/en
Publication of CN101945126A publication Critical patent/CN101945126A/en

Links

Abstract

The invention provides a forest resource heterogeneous data distributed management system. The system comprises a data management module, a service management module, a data service release module, a metadata service module, a metadata registration module and a catalogue and index module, wherein the data management module maintains distributed data stored locally by a data provider and collected by a network; the service management module provides service data; the data service release module acquires and matches the distribution data and the service data so as to generate data service release information, and releases the dynamic deployment of the data service release information to a server; the metadata service module generates data service metadata according to the data service release information; the metadata registration module eliminates the isomerism of the data service metadata through the conversion of a private format, and generates standard metadata of the system; and the catalogue and index module provides catalogues and indexes for the standard metadata of the system. The forest resource heterogeneous data distributed management system realizes the distributed management of the forest resource heterogeneous data of a forestry center.

Description

森林资源异构数据分布式管理系统 Forest resources distributed heterogeneous data management system

技术领域 FIELD

[0001] 本发明涉及一种数据管理系统,尤其涉及一种森林资源异构数据分布式管理系统。 [0001] The present invention relates to a data management system, particularly to a forest resource management system of distributed heterogeneous data.

背景技术 Background technique

[0002] 随着计算机、数据库、网络等技术迅猛发展以及在林业中的广泛应用,林业行业从国家到地方,从生产管理部门到研究机构构建了很多应用系统。 [0002] As computers, databases, networks and other technology are developing rapidly and widely used in forestry, from national to local forestry industry, build a lot of applications, from production to management and research institutions. 森林资源数据管理系统是“数字林业平台技术研究与应用”中数字林业公共技术平台的一部分,下级部门向上级数字林业平台提交标准化的数据,为国家重大林业决策分析提供依据。 Forest resource data management system is part of the "digital forestry technology research and application platform" digital Forestry common technology platform, standardized data subordinate departments to submit to the superior digital forestry platform for major national forestry decision-making based on the analysis. 这些系统大多是地方自行开发的,采用的数据库管理系统不相同,数据库的结构也不一致,造成各应用系统之间不能互通互联,无法实现共享,形成了一个个信息孤岛,导致信息共享和集成困难,信息传递不及时、不一致、信息利用率低下。 Most of these systems are self-developed places, the use of database management systems are not the same, the structure of the database is inconsistent, can not communicate with the interconnection between the various application systems can not be shared, formed a month islands of information, resulting in information sharing and integration difficulties transmission of information is not timely, inconsistent, low utilization information. 因此,如何消除分布于不同部门不同地点的数据的异构性,并对其进行有效的管理和整合已成为森林资源管理数据系统的必然选择。 Therefore, how to eliminate heterogeneous distributed in different locations in different sectors of data and its effective management and integration has become an inevitable choice for forest resource management data systems.

发明内容 SUMMARY

[0003] 本发明的主要目的在于提供一种能够消解分布于不同部门不同地点的森林资源数据的异构性,提供多种基于统一标准的数据服务,实现林场级的森林资源异构数据的分布式管理系统。 [0003] The main object of the invention is to provide a digestion forest resource data distributed in different locations in different sectors of heterogeneity, offers a variety of standards-based data services, and the distribution of forest resources Forest Farm-level heterogeneous data management systems.

[0004] 为了达到上述目的,本发明提供了一种森林资源异构数据分布式管理系统,包括数据服务管理单元和元数据管理单元; [0004] To achieve the above object, the present invention provides a distributed heterogeneous data forest resource management system includes a data management unit, and a metadata service management unit;

[0005] 所述数据服务管理单元包括数据管理模块、服务管理模块、数据服务发布模块和元数据服务模块; [0005] The service data management unit comprises a data management module, the service management module, the data module and metadata services publish service module;

[0006] 所述元数据管理单元包括元数据注册模块和目录与索引模块; [0006] The metadata management unit comprises a registration module and a metadata catalog indexing module;

[0007] 所述数据管理模块,与所述数据服务发布模块连接,用于维护数据提供者本地存储与网络收集的分布式数据; [0007] The data management module, service module connected with the data published, for maintaining data locally by providing distributed data storage and network collection;

[0008] 所述服务管理模块,与所述数据服务发布模块连接,用于多种服务器与服务模块集中管理,提供符合OGC规范定义标准的数据服务; [0008] The service management module, the data service connection release module, for more centralized management server and the service module providing data services from OGC specification defines a standard;

[0009] 所述数据服务发布模块,与所述元数据服务模块连接,用于获取并配对所述分布式数据和所述数据服务,以生成私有数据服务发布信息,并将该数据服务发布信息动态部署发布至服务器; [0009] The release data service module, the service module connected to the metadata, and for acquiring said paired data and said distributed data services, private data to generate a service issuing information, and publish information of the data service dynamic deployment publish to a server;

[0010] 所述元数据服务模块,与所述元数据注册模块连接,根据该数据服务发布信息生成数据服务元数据; [0010] The metadata service module, the registration module and the metadata connection release information generation data service data based on the service metadata;

[0011] 所述元数据注册模块,与所述目录与索引模块连接,通过对私有格式进行转换处理并生成系统标准元数据,以消除该数据服务元数据的异构性; [0011] The metadata registration module connected to the indexing module catalog, by converting the format of the proprietary processing system and generating standardized metadata, to eliminate the heterogeneous data service metadata;

[0012] 所述目录与索引模块,用于为该系统标准元数据提供目录与索引。 [0012] The catalog indexing module configured to provide for the system catalog standard metadata index.

[0013] 实施时,该分布式数据根据数据类型和数据源分别定义,并且每种数据类型包含多项数据源定义; [0013] When the embodiment, the distributed data are defined according to the type of data and data sources, each data type and comprises a number of data source definition;

[0014] 所述数据类型包括数据格式与存储格式。 The [0014] data type includes a data format storage format.

[0015] 实施时,该数据服务包括地图服务、要素服务和基于网络文件传输协议的文件服务。 [0015] When the embodiments, the map service includes a data service, service features, and file transfer protocol based network file service.

[0016] 实施时,所述数据服务元数据通过分类构建策略与所述数据服务发布信息一一对应。 [0016] When the embodiments, the data service metadata construction strategy Ads correspondence with the data service through the classification.

[0017] 实施时,所述数据服务元数据包括等级由高至低排列的服务节点、数据服务与实体数据;所述实体数据包括描述信息,该描述信息指明可以使用的数据服务以及数据服务对应运行的服务节点。 [0017] When the embodiments, the data service metadata includes service nodes in descending order of rank, and the data service entity data; said data entity includes descriptive information, the service description information indicates the data may be used and the data corresponding to the service run the service node.

[0018] 与现有技术相比,本发明可以实现林场级的森林资源异构数据的分布式管理。 [0018] Compared with the prior art, the present invention may be implemented management of forest resources distributed heterogeneous data Woodland level. 附图说明 BRIEF DESCRIPTION

[0019] 图1是本发明所述的系统的功能模块图; [0019] FIG. 1 is a functional block diagram of a system according to the present invention;

[0020] 图2是在本发明中,为保证实体数据按照统一的方式管理而采用的数据处理方式的流程图; [0020] FIG. 2 in the present invention, a flowchart for data processing to ensure the management entity data in a unified manner employed;

[0021] 图3是本发明的数据服务管理单元的功能框图; [0021] FIG. 3 is a functional block diagram of a data service management unit of the present invention;

[0022] 图4是本发明的元数据管理单元功能框图; [0022] FIG. 4 is a functional block diagram of a metadata management unit according to the present invention;

[0023] 图5是在本发明所述的系统中进行数据源维护的示意图; [0023] FIG. 5 is a diagram of a data source is maintained in the system of the present invention;

[0024] 图6是在本发明所述的系统中进行数据服务发布活动的示意图; [0024] FIG. 6 is a diagram illustrating a data service release activity in the system according to the present invention;

[0025] 图7是在本发明所述的系统中进行元数据注册活动的示意图; [0025] FIG. 7 is a schematic diagram of metadata registration activities in the system according to the present invention;

[0026] 图8是本发明所述的系统中的分布式数据节点通过统一访问接口构建资源数据管理平台的功能框图; [0026] FIG. 8 is a functional block diagram of a distributed data management platform resource data node system according to the present invention by a unified access interface construction;

[0027] 图9是元数据注册过程中通过分布式数据管理定义不同等级元数据信息(节点、 服务、数据),根据私有格式元数据的资源映射文件确定转换规则提取私有格式元数据信息至分布式系统统一建立的元数据体系结构的示意图; [0027] FIG. 9 is a metadata registration procedures defined in different levels metadata information (node, services, data) through the distributed data management, resource mapping file format according to the private metadata determining a proprietary format conversion rule extracting metadata information to the distribution metadata schematic system architecture of the unified formula is established;

[0028] 图10是本发明所述的森林资源异构数据分布式管理系统利用Web服务的跨域兼容性与数据传递的标准格式特性解决格式差异与存储异构问题的示意图。 [0028] FIG. 10 is a schematic view of a standard format characteristics of forest resources distributed heterogeneous data management system according to the present invention utilizes Web Service compatibility with cross-domain data transfer formats vary with the solution of the problem of heterogeneous storage.

具体实施方式 Detailed ways

[0029] 首先对本发明涉及到的定义介绍如下: [0029] First, the definition of the present invention relates to the following description:

[0030] Web服务:是基于XML和HTTP/HTTPS的一种服务,其通信协议主要基于S0AP,服务的描述通过WSDL,通过UDDI来发现和获得服务的元数据。 [0030] Web Service: a service is based on XML and HTTP / HTTPS, which is mainly based on the communication protocol S0AP, through the WSDL description of the service, to find and access metadata and services through UDDI.

[0031] OGC (Open GIS Consortium,开放地理信息系统协会),Open GIS规范致力于为地理信息系统间的数据和服务互操作提供统一标准。 [0031] OGC (Open GIS Consortium, Open GIS Consortium), Open GIS specification committed to providing uniform standards for data and services among GIS interoperability. 开放地理信息联盟,是一个非盈利的志愿的国际标准化组织,引领着空间地理信息标准及定位基本服务的发展。 Open Geospatial Consortium, is a volunteer non-profit International Organization for Standardization, leading the development of geospatial information standards and positioning basic services. 目前在空间数据互操作领域,基于公共接口访问模式的互操作方法是一种基本的操作方法。 Currently spatial data interoperability art, based on common interface interoperability access mode is a basic method of operation. 通过国际标准化组织(IS0/TC211)或技术联盟(如0GC)制定空间数据互操作的接口规范,GIS软件商开发遵循这一接口规范的空间数据的读写函数,可以实现异构空间数据库的互操作。 Developed by the International Organization for Standardization (IS0 / TC211) or technical alliances (such as 0GC) interface specification interoperability of spatial data, GIS software vendors to follow the development of this interface specification data read and write function space, it can achieve interoperability of heterogeneous spatial database operating. 基于http (Web)XML的空间数据互操作是一个很热门的研究方向,主要涉及Web Service的相关技术。 Based on http (Web) XML spatial data interoperability is a very hot research, mainly related technologies Web Service. OGC和IS0/TC211共同推出了基于Web服务(XML)的空间数据互操作实现规范Web Map Service, Web Feature Service, Web Coverage Service 以及用于空间数据传输与转换的地理信息标记语言GML。 OGC and IS0 / TC211 jointly launched a spatial data based on Web services (XML) to achieve interoperability specifications Web Map Service, Web Feature Service, Web Coverage Service as well as space for data transmission and conversion of Geographic Information Markup Language GML.

[0032] 分布式,指数据和程序可以不位于一个服务器上,而是分散到多个服务器,以网络上分散分布的地理信息数据及受其影响的数据库操作为研究对象的一种理论计算模型。 [0032] distributed, it refers to data and programs may not be located on a server, but is dispersed to a plurality of servers, database operations to geographical information on the distribution network and affected by dispersion calculation model as a theoretical study of . 分布式有利于任务在整个计算机系统上进行分配与优化,克服了传统集中式系统会导致中心主机资源紧张与响应瓶颈的缺陷,解决了网络GIS中存在的数据异构、数据共享、运算复杂等问题。 Distributed in favor of task allocation and optimization of the entire computer system, to overcome the traditional centralized system will lead to tension and defect bottlenecks response center host resources to solve the existing GIS network of heterogeneous data, data sharing, computational complexity, etc. problem.

[0033] 林场,一般分为国有林场和私营林场。 [0033] forest, is generally divided into private and state-owned forest Forest Farm. 国有林场指国家培育和保护森林资源的林业生产性的事业单位,国有林场的林地、林木等全部生产资料和产品都是国家财产。 Refers to the production of state-owned forestry institutions of national forestry cultivation and protection of forest resources, state-owned forest woodland, forest, and all means of production and products are state property. 我国的国有林场是新中国成立初期国家为加快森林资源培育,保护和改善生态,在重点生态脆弱地区和大面积集中连片的国有荒山荒地上,采取国家投资的方式建立起来的专门从事营造林和森林管护的林业事业单位。 Our state-owned forest is the founding of New China national forest resources in order to accelerate the cultivation, protection and improvement of the ecological, state-owned barren hills and wasteland focus on ecologically fragile areas and large areas of contiguous focus, take the form of state investment established specializing in afforestation protecting forests and forestry institutions. 私营林场是私人所有的一种林场,是非公有制形式存在的企业,是以盈利为目的从事生产经营活动,完成自我经济效益最大化的同时,接受林业部门领导肩负一定生态任务。 Private Forest Farm is a privately owned tree farm, there is a form of non-public enterprises, engaged in production activities in terms of profits for the purpose of self-completion while maximizing economic benefits, and accept the leadership of the forestry sector to shoulder some ecological tasks.

[0034] 本发明所述的森林资源异构数据分布式管理系统,是基于开放地理信息联盟的OGC技术标准构建的数据共享平台,利用Web服务的跨域兼容性与数据传递的标准格式特性解决格式差异与存储异构问题如图10所示,也是数据遵守OGC规范提供的丽S地图服务、WFS要素服务与原始文件下载服务,构建的统一管理、分布式共享数据的平台,更是实现统一编程接口API开发与运行应用系统之间统一格式的数据交换系统。 [0034] forest resources distributed heterogeneous data management system according to the invention is based on the Open Geospatial Consortium OGC technical standards for data sharing platform built using Web services compatibility with the standard format for cross-domain characteristics of the data transfer solution differences with the problem of heterogeneous storage format shown in Figure 10, the data also comply with S Korea map service provided by OGC specifications, WFS service with elements of the original file download service, to build a unified management of distributed data sharing platform, is to achieve unity unified format data exchange system between programming interface (API) to develop and run applications.

[0035] 如图1所示,本发明所述的森林资源异构数据分布式管理系统包括数据服务管理单元、元数据管理单元和系统存储单元,其中, [0035] 1, forest resources distributed heterogeneous data management system according to the present invention includes a data management service unit, a metadata storage unit and a system management unit, wherein,

[0036] 所述数据服务管理单元包括数据管理模块、服务管理模块、数据服务发布模块和元数据服务模块; [0036] The service data management unit comprises a data management module, the service management module, the data module and metadata services publish service module;

[0037] 所述数据管理模块和所述服务管理模块分别与所述数据服务发布模块连接; [0037] The service data management module and the management module is respectively connected with the service issuing module data;

[0038] 所述数据服务发布模块与所述元数据服务模块连接; [0038] The release data service module and the service module connected to the metadata;

[0039] 所述元数据管理单元包括元数据注册模块和目录与索引模块。 [0039] The metadata management unit comprises a registration module and the metadata index catalog module.

[0040] 所述元数据服务模块与所述元数据注册模块连接; [0040] The metadata of the metadata service module connected to the registration module;

[0041] 所述元数据注册模块分别与所述目录与索引模块和所述系统存储单元连接。 [0041] The metadata registration module connected with the catalog module and the indexing system storage unit.

[0042] 数据管理模块维护数据提供者本地存储与网络收集的分布式数据,涵盖多种数据格式和存储格式的森林资源数据的定义信息与数据获取途径的描述信息,集中组织与检索。 Description Information [0042] Data Management module maintains a local provider of distributed data storage and network collected data definition information covers a variety of data formats and storage format of forest resource data acquisition path, centralized organization and retrieval.

[0043] 提供者的森林资源数据按照数据类型与数据源分别定义的方式,同时建立二者间一对多关系描述,即每种数据类型包含多项数据源定义,而数据类型支持多种定义(包含数据格式与存储格式的多种组合)。 [0043] forest resource data provider data type manner with the data sources are defined, while establishing many relationship between the two described, i.e. each data type contains a number of data source definition, and support a variety of data types defined (comprising various combinations of the data format stored in format). 这样的组织方式能够处理任何数据格式与存储格式的数据源定义,并且检索数据源信息过程中支持依照数据类型分组查询使管理组件具有更快、更准确的发现能力。 This organization can handle any data source and the format definition data storage format, the data source information and retrieve data in accordance with the type of support during the query packet assembly has managed to make faster and more accurate discovery capabilities.

[0044] 服务管理模块面向多种服务器与服务模块(由Web服务或者引用第三方开发功能类库等等)集中管理,遵循森林资源数据服务规范的相关内容对访问者提供OGC规范定义标准的地图服务(WMS)、要素服务(WFS)和基于网络文件传输协议的文件服务(FTP),提供自定义服务空间数据格式转换。 [0044] service for a variety of server management module and service module (referenced by the Web service or third-party developers function libraries, etc.) centralized management, forest resource data related content to follow the service specification for visitors with OGC specification defines a standard map services (the WMS), feature service (WFS) and file services (FTP) based file transfer protocol network, to provide customized services spatial data format conversion. 所述服务管理模块支持具有二次开发接口的服务器,基于网络提供的Web服务或功能类库的集成。 The service management server module supports a secondary development interface, integrated Web service or function libraries based network provides.

[0045] 服务管理模块采用插件开发模式设计保持功能的独立性、扩展性,能够很好的利用各种商业软件或社区维护的开源软件等众多产品保持组件的灵活性。 [0045] Service Management module uses plug-in developer mode is designed to maintain the independence of features, scalability to very good use of a variety of commercial software or open source software community to maintain and many other products remain flexible components. 对访问者提供各种行业标准与各种技术标准实现的功能服务,这些标准与规范可以保证访问者的开发接口与数据访问接口的一致性。 It offers visitors a variety of industry standards and technical standards to achieve a variety of functions and services of these standards and specifications to ensure consistency of data access interface development interface with visitors. 服务管理模块与插件之间按照统一接口设计、开发与使用,实现松耦合的系统架构能够有效的避免组件对某一种产品的依赖性使用,保持底层服务器技术更新对组件的最小影响,并且增加新的插件相当于对组件进行功能升级,对外可以提供更多服务体现组件的扩展性。 Service Management module and plug in accordance with a uniform interface to design, develop and use to achieve loosely coupled system architecture can effectively avoid dependence on component uses a particular product, the underlying server technology to keep updated with minimal impact on components, and increase the new plug-in equivalent feature upgrades to components, external service may provide more scalability reflected components.

[0046] 数据服务发布模块负责服务管理模块与数据管理模块的组合操作,分别获取两模块提供的服务能力与资源数据,遵循森林资源数据服务封装规范相关内容定义规则由组件自动配对服务与数据的合法组合生成数据服务发布信息,利用动态部署功能发布至服务器上提供数据服务。 [0046] a combination of operational data service release module is responsible for the service management module and data management modules, respectively, to obtain service capabilities and resources data of two modules provided, follow the forest resource data service package specifications related content defined rules by the component automatically matching services and data legal combination of generating data services Ads, posted by the dynamic deployment capabilities to provide data services on the server.

[0047] 数据服务发布模块提供实时监控数据获取服务,包含数据服务当前状态、服务节点环境与负载信息。 [0047] Data Services released data acquisition module provides real-time monitoring services, including data services, the current state of the service node environment and load information. 提供控制各项服务的启动和停止操作实现远程服务管理功能。 Control of services provided to start and stop operations for remote service management capabilities.

[0048] 元数据服务模块按照森林资源数据提供者完成的数据服务发布和部署处理结果, 遵循森林资源数据服务封装规范相关内容自动生成数据服务元数据,依据数据服务类型分别提供元数据信息,对外提供数据服务的元数据类型查询和获取的访问接口。 [0048] metadata service module according to forest resources data service publisher completion and deployment of the results, follow the forest resource data service package specifications related content is automatically generated data service metadata, depending on the data type of service provides metadata information respectively, external providing data services and access to the type of query metadata access interface.

[0049] 元数据的分类构建策略能够保证数据服务与元数据的一一对应关系,服务节点针对数据服务的增加、减少变化仅仅体现所属的元数据更新、删除操作,相对于完整的单独元数据提供方式有效减少数据更新频率与数量更好的提高组件响应速度。 Classification [0049] metadata to build strategies to ensure increased one relationship, the service node data services and metadata for data services, reducing the change is only reflected in the metadata belongs update and delete operations, complete a separate metadata relative It provides a way to effectively reduce the number of data update frequency components to better improve the response speed.

[0050] 元数据注册模块接受依据多种规范生成数据服务私有的元数据,通过私有格式转换处理消除异构性,私有格式元数据针对于不同数据节点、不同服务器提供相同服务类型的数据服务的元数据存在不同的格式。 [0050] The registration module receiving metadata based on a variety of private data service specification generating metadata, to eliminate the heterogeneous format conversion processing by a private, proprietary formats for metadata nodes on different data, different servers providing the same service type of data and services There are different formats of metadata. 元数据注册过程中通过分布式数据管理定义不同等级元数据信息(节点、服务、数据),根据私有格式元数据的资源映射文件确定转换规则提取私有格式元数据信息至分布式系统统一建立的元数据体系结构。 Distributed Data Management defined by different levels of metadata information (node, services, data), resource mapping file based on proprietary metadata format conversion rule is determined to extract a proprietary format metadata information Yuan distributed system to establish a unified metadata registration process data architecture. 资源映射文件主要解决数据节点生成的私有元数据信息与分布式数据管理定义的元数据之间如何建立一一对应关系、如何转换数据类型、如何计算数据数值的规则,如图9所示。 The resource mapping file is mainly to solve how to establish one correspondence between the private metadata and metadata distributed data management information data generated by the node defined, how to convert the data type, the rules how to calculate the data value, as shown in FIG.

[0051] 遵循森林资源分布式数据管理体系结构规范相关内容形成系统标准元数据信息, 并将该系统标准元数据信息持久化到所述系统存储单元。 [0051] Distributed Data follow forest resource management architecture specifications related content to form a standard metadata information system, and the system was standardized metadata information is persisted to the system storage unit.

[0052] 所述元数据注册模块解决私有格式的元数据转换至系统标准元数据操作问题,采取资源数据映射策略遵循规范定义标准元数据开发接口利用软件工厂类设计模式开发组件,为每种资源映射文件创建出私有格式转换处理对象交给标准元数据接口调用完成数据转换任务。 Metadata [0052] The metadata registration module proprietary format conversion solution to the problem of operating system standard metadata, take the resource data mapping policy specification defines standard metadata follows the development interface by software design model development component factory class for each resource map file format conversion process to create private objects to the standard metadata interface calls for data conversion tasks.

[0053] 元数据注册过程中没有元数据格式的限制,保证了组件的开放性更加有利于数据节点的注册与数据服务的管理,获得更多数据资源提供系统用户使用。 [0053] metadata registration process without restriction metadata format, to ensure the openness of the components is more conducive to registration and data management services node data, more data resources provide system users.

[0054] 所述目录与索引模块用于为所述元数据注册模块的系统标准元数据提供目录与索引。 System standard metadata [0054] The catalog module is used to index the metadata provided catalog module registered index. [0055] 数据提供者已经发布数量巨大的数据服务,并且系统收集整理完成数据服务的元数据,并将该元数据按照标准格式持久化至所述系统存储单元。 [0055] The data provided by the large number of already published data service, and the system is completed collected data service metadata and the metadata according to the standard format of the persistent storage unit to the system. 数据内容涉及服务节点、数据服务与实体数据三大类型,按照等级由高至低排列服务节点>数据服务>实体数据;最小单位为实体数据,该实体数据拥有系统全局唯一标识(英文缩写GID),每份实体数据存储不同数量的、不同详细程度的描述信息,这些信息指明哪些数据服务可以使用、数据服务运行在哪些服务节点; Data concerning the service node, the data service entity data with three types,> Data Service> level in descending order in accordance with the entity data serving node; minimum unit of data entity, the entity data systems has globally unique identifier (abbreviation GID) a different number of each data storage entity, described in various levels of detail of information, information indicating which data service may be used, which runs data service serving node;

[0056] 最小单位实体数据指数据共享者管理的一个数据集,运行环境中数据集可以是文件系统的文件或文件组,也可以是数据库存储的若干张表,根据数据类型不同表现为不同的存储形式。 [0056] The minimum unit of entity data refer to a dataset sharer management, operating environment, the data set may be a file system file or group of files, and may be a database stored in a plurality of tables according to different data types present different storage form. 另外空间数据的属性信息同样存在字段数量、名称和类型的不同,表现在实体元数据信息中属性数量、描述信息等不相同。 Further the attribute information of the spatial data field is also a different number, name and type, the performance of the entity in the number of attributes in the metadata information, description information, which are not the same. 这样一种结构化的形式采用上下级关系的目录体系展现。 Such a form of structured directory system using superior-subordinate relationship show.

[0057] 对于数量级的元数据查阅提供索引检索方式,使用者可以针对顶层任意设置属性类型,获得一份支持排序的全部数值检索表,并且支持多层次不同级别数值的检索表,最后通过路径分析指向实体数据获得全局唯一标识符。 [0057] For the number of stages provides data access metadata index search mode, the user can arbitrarily set an attribute type for the top layer, obtain a copy of all numbers sorted search table, and retrieves the table to support different levels of multi-level values, and finally through path analysis entity data points to obtain a globally unique identifier.

[0058] 元数据检索通过使用者提交查询关键字与查询范围,由组件按照输入参数的相关程度返回查询结果列表,直接指向全局唯一标识符。 [0058] The metadata search query submitted by a user keyword query scope, return the query result according to the degree of correlation components from the input parameters, directly to the globally unique identifier.

[0059] 元数据的更新采用森林资源数据提供者完成数据发布与服务部署任务再主动通知数据共享管理系统的机制,组件对外提供数据更新通知服务接口。 Update [0059] metadata using forest resource data provider for data services with the deployment of the task and then publish proactive notification mechanism for data sharing management system components provide external data update notification service interface.

[0060] 在本发明中,保证林场生产与业务中涉及的森林资源实体数据按照统一的方式管理,数据的处理过程保持循环流动再开发的方式,如图2所示,流程关键点为:数据发现_计算分析_创建新数据_发布服务_数据再发现的工作序列。 [0060] In the present invention, to ensure that forest resources Woodland entity data involved in the production of business management unified manner, the processing of the data retention mode circulating redevelopment, shown in Figure 2, the key point of the process: Data analysis calculated found _ _ _ create new data published working sequence data service _ rediscovery.

[0061] 本发明的系统整体架构分为两个部分:数据提供服务端拥有森林资源实体数据的所有权,基于互联网架设服务器具有对外提供数据服务能力的软、硬件设备;本发明的系统内部将角色定义为提供空间数据服务与地图服务的提供者,最后是数据共享系统维护分布式数据建立的全局管理模块,它的功能可以被所有的提供者内部访问与使用,还对外提供数据浏览检索的功能系统将这部分定义为数据共享管理与查询的管理者。 [0061] the overall system architecture of the present invention is divided into two parts: software and hardware devices to provide data services end ownership of forest resources owned entity data, with the ability to provide external data services based on the Internet to set up a server; the internal system of the present invention will be role defined to provide spatial data services and map services provider, and finally the data sharing system to maintain the established global distributed data management module, which functions can be accessed with the use of all internal provider, but also offer data browse and search functions this part of the system is defined as a shared data management and query manager.

[0062] 如图3所示,本发明的数据服务管理单元的功能框图; [0062] As shown, the functional block diagram of a data service management unit 3 of the present invention;

[0063] 如图4所示,本发明的元数据管理单元功能框图。 [0063] 4, the functional block diagram of a metadata management unit of the present invention.

[0064] 本发明提供空间实体服务、服务元数据、数据元数据及全部的方法与属性描述信息的获取和查询功能,能够做到分布式异构数据源统一接口访问,利用中间格式XML编写标准实现数据传输的自描述与跨平台的使用。 [0064] The present invention provides a spatial entity service, service metadata, metadata and all methods and properties described in the acquired function information and queries can be distributed to achieve a unified interface to access disparate data sources, the preparation of the standard intermediate format using XML self-describing data transmission using the cross-platform.

[0065] 服务管理的设计模仿运行环境构建插件实现功能的松耦合方式提供通用标准的要素服务、地图服务、文件服务与转换格式的功能,功能服务器采用自主研发与开源社区软件或者商业软件相结合完成,定义统一服务接口保证服务提供者是动态链接至系统使用户获得访问过程简单、稳定的能力,同时解决系统功能扩展的快速、简便的问题。 Provide a common standard [0065] service management designed to mimic the operating environment to build plug-in functions to achieve loose coupling elements as service, map service functions, file format conversion services, server functionality using self-developed or commercial software and open source software community combining complete, unified service interface definitions to ensure that the service provider is a dynamic-link system allows the user to gain access process is simple, stable capacity, while addressing the function expansion of the system quick and easy problem.

[0066] 数据管理涉及数据类型与存储格式的两部分内容,管理策略是结构简单、容易扩展、方便使用,为达到此目标所有的数据采用键值对方式按照属性与属性值分类组织。 Two parts [0066] Data management of data relates to the type of storage format, management strategy is simple in structure, easy to expand, easy to use, to achieve this goal for all of the data using the key attribute property values ​​according to the way the tissue classification. 多种数据格式对应多个数据存储的多对多关系,提取某一种数据格式与数据存储的属性集合完成数据源的定义。 A plurality of data formats corresponding to the plurality of data storage many relationship, extracting a data format of a stored data set of properties complete the definition of the data source. 如此键值对的存储策略保证了结构简单,动态的组合存储方式体现容易扩展,用户使用中仅关注在数据源的增加与减少操作部分做到方便使用的目的。 Key-value pairs stored policy thus ensures a simple structure, reflect a dynamic combination of easy storage expansion, user convenience purposes only do interest for use in the operating portion increases and decreases in the data source.

[0067] 数据共享管理与查找的管理者数据服务节点管理包括数据节点的网络注册信息与提供者描述信息。 [0067] data sharing and management of data managers are looking for service management including network node registration information provider data node description. 通过节点元数据提供者获取数据,数据节点编码成XML格式推送最新或更新后数据至管理者按照注册信息解析并持久化数据。 Node metadata provider by acquiring data, node data encoded into XML format or push the latest updated data managers to resolve in accordance with the registration information and persistent data.

[0068] 服务访问管理的内容由数据提供者决定,提供者的服务元数据需要定义服务类型的相关描述信息与服务访问的方法描述、参数描述、参数值界定、返回格式描述与错误信息描述,管理者按照服务类型分组存储。 [0068] The content service access management is provided by a data decision, service metadata needs of those methods described information and service access definitions services of the type described, the parameters described, a parameter value defining returns format description and the error description, managers in accordance with the type of service packets are stored.

[0069] 实体数据管理是最小单位的描述数据集,拥有完整的空间信息和属性信息。 [0069] management entity is the smallest unit of data description data sets, with complete spatial information and attribute information. 数据提供者需要实现要素服务并提取服务元数据描述空间实体信息,作为特殊的服务元数据提交管理者解析处理。 Data service providers need to implement elements of the service and extract metadata information describing spatial entity, as a special service metadata submission management resolution process.

[0070] 元数据管理重点解决数据提供者的数据节点与数据服务和实体数据对象间一对多关系的维护。 [0070] metadata management focused on solving maintenance-many relationships between data providers and data services node data entities and data objects. 使用者能够查询数据节点包含那些服务,获得服务访问方法详细描述。 Users can query the data node contains those services, access to services access methods described in detail. 根据检索条件搜索到数据实体及相关信息,报告服务是否发布状态。 According to the search conditions to search the data entities and relevant information, whether published report service status.

[0071] 如图5所示,在本发明所述的系统中进行数据源维护的示意图,在进行数据维护时,首先采用了权限集中管理,进行身份验证,如果验证通过,则创建数据类型或修改服务类型并获得指定的数据类型信息,从而增加新的数据源,操作成功后推出登录。 [0071] As shown, a system 5 according to the present invention in a schematic view of a data source to maintain, during maintenance data, using the first centralized management authority, identity verification, if the verification is passed, or create a data type modify the type of service and access to the specified data type information, thus adding new data sources, launched a successful operation after login.

[0072] 如图6所示,在本发明所述的系统中进行数据服务发布活动的示意图,首先采用了权限集中管理,进行身份验证,如果验证通过,则创建数据源,当数据源存在时,进行数据服务发布,发布成功后生成元数据,退出登录或通知数据服务门户更新元数据。 [0072] As shown in FIG 6, a schematic diagram of a data service release activity in the system of the present invention, first using a centralized management authority, identity verification, if the verification, the data source is created when there is a data source for data service release, after the release of the successful generation of metadata, or notification Log data service portal update metadata.

[0073] 如图7所示,在本发明所述的系统中进行元数据注册活动的示意图,首先采用了权限集中管理,进行身份验证,验证通过后,如果已经完成服务部署,则数据服务提供者通知更新元数据,数据管理者收到数据节点通知后,请求元数据,则所述数据服务提供者生成元数据,所述数据共享管理者下载元数据文件并检查元数据能否被识别,否则创建资源映射文件配置元数据提取规则,然后按照数据管理者分类提取转换元数据并持久化。 [0073] As shown, a schematic view metadata registration activity in a system according to the present invention 7, the first use of centralized management authority, identity verification, after the verification, if the service deployment has been completed, the data services provided after the notification by updating the metadata, the data management node receives the data notification request metadata, then the data service provider generate metadata, data sharing manager to download the metadata file and examines the metadata can be identified, otherwise, create a resource mapping file configuration metadata extraction rules, and then follow the data management classification and metadata extraction conversion persistence.

[0074] 如图8所示分布式数据节点通过统一访问接口构建资源数据管理平台,对外提供资源数据共享服务接口。 [0074] As shown in Figure 8 data nodes distributed data management platform to build resources through a unified access interface, provide external resource data sharing service interface. 基于管理平台与服务访问接口支持桌面应用、网络应用、软件开发及系统集成等多种应用模式。 Based management platform and service provider supports desktop applications, web applications, software development and systems integration and other application mode.

[0075] 以上说明对发明而言只是说明性的,而非限制性的,本领域普通技术人员理解,在不脱离所附权利要求所限定的精神和范围的情况下,可做出许多修改、变化或等效,但都将落入本发明的保护范围内。 [0075] For the above-described invention is merely illustrative, and not restrictive, those of ordinary skill in the art understand that in the appended claims without departing from the spirit and scope as defined in, many modifications may be made, variations or equivalent, but will fall within the scope of the present invention.

Claims (5)

  1. 一种森林资源异构数据分布式管理系统,其特征在于,包括数据服务管理单元和元数据管理单元,其中,所述数据服务管理单元包括数据管理模块、服务管理模块、数据服务发布模块和元数据服务模块;所述元数据管理单元包括元数据注册模块和目录与索引模块;所述数据管理模块,与所述数据服务发布模块连接,用于维护数据提供者本地存储与网络收集的分布式数据;所述服务管理模块,与所述数据服务发布模块连接,用于集中管理多种服务器与服务模块,提供符合OGC规范定义标准的数据服务;所述数据服务发布模块,与所述元数据服务模块连接,用于获取并配对所述分布式数据和所述数据服务,以生成数据服务发布信息,并将该数据服务发布信息动态部署发布至服务器;所述元数据服务模块,与所述元数据注册模块连接,根据该数据服务发布 One kind of distributed heterogeneous data forest resource management system, wherein the management unit includes a data service and metadata management unit, wherein, the service data management unit comprises a data management module, the service management module, and a data service issuing module element a data service module; the metadata management unit comprises a registration module and the metadata index catalog module; said data management module, the data service connection releasing module configured to maintain data distributed network provider local storage collected transactions; the service management module, connected with the data service issuing module for centralized management of multiple servers and services module, providing data services from OGC specification defines a standard; publish the data service module, the data element connect service module, and configured to acquire data and the pairing of the distributed service data, to generate a data service issuing information, and publish the data to publish service information dynamic deployment server; the metadata service module, and the metadata Registry module is connected, according to the data released service 息生成数据服务元数据;所述元数据注册模块,与所述目录与索引模块连接,通过私有格式转换处理消除该数据服务元数据的异构性,并生成系统标准元数据;所述目录与索引模块,用于为该系统标准元数据提供目录与索引。 Generating a data service metadata information; the metadata registration module, connected with the catalog indexing module, the format conversion processing by a private eliminate the heterogeneous data service metadata, and generates standardized metadata system; the catalog indexing means for providing an index for a standard catalog metadata system.
  2. 2.根据权利要求1所述的森林资源异构数据分布式管理系统,其特征在于,该分布式数据根据数据类型和数据源分别定义,并且每种数据类型包含多项数据源定义;所述数据类型包括数据格式与存储格式。 The forest resources distributed heterogeneous data management system according to claim 1, wherein the distributed data are defined according to the type of data and data sources, each data type and comprises a number of data source definition; the data type includes a data format storage format.
  3. 3.根据权利要求1或2所述的森林资源异构数据分布式管理系统,其特征在于,该系统所提供的数据服务包括地图服务、要素服务和基于网络文件传输协议的文件服务。 3. forest resources or the heterogeneous data 12 distributed management system according to claim, wherein the data service provided by the system includes a service map file services, service features, and the file transfer protocol-based network.
  4. 4.根据权利要求3所述的森林资源异构数据分布式管理系统,其特征在于, 所述数据服务元数据通过分类构建策略与所述数据服务发布信息一一对应。 Forest resources according to claim 3, said heterogeneous distributed data management system, characterized in that the data service metadata policy by taxonomy-building service issuing information with the correspondence data.
  5. 5.根据权利要求4所述的森林资源异构数据分布式管理系统,其特征在于,所述数据服务元数据包括等级由高至低排列的服务节点、数据服务与实体数据;所述实体数据包括描述信息,该描述信息指明可以使用的数据服务以及数据服务对应运行于的服务节点。 The entity data; forest resources according to claim 4, wherein the heterogeneous distributed data management system, characterized in that the data service metadata includes service nodes in descending order of rank, service data with the entity data It includes description information, the description information may be specified using the data services and data services running on nodes of a corresponding service.
CN2010102759761A 2010-09-09 2010-09-09 Forest resource heterogeneous data distributed management system CN101945126A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010102759761A CN101945126A (en) 2010-09-09 2010-09-09 Forest resource heterogeneous data distributed management system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010102759761A CN101945126A (en) 2010-09-09 2010-09-09 Forest resource heterogeneous data distributed management system

Publications (1)

Publication Number Publication Date
CN101945126A true CN101945126A (en) 2011-01-12

Family

ID=43436893

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010102759761A CN101945126A (en) 2010-09-09 2010-09-09 Forest resource heterogeneous data distributed management system

Country Status (1)

Country Link
CN (1) CN101945126A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103365966A (en) * 2013-06-21 2013-10-23 北京邮电大学 Method and device for storing node information in Internet of things
CN103678603A (en) * 2013-12-13 2014-03-26 江苏物联网研究发展中心 Multi-source heterogeneous data efficient converging and storing frame system
CN103970899A (en) * 2014-05-27 2014-08-06 重庆大学 Service-oriented metadata relevance extraction management method and management system
CN104184785A (en) * 2013-09-12 2014-12-03 中国林业科学研究院资源信息研究所 Forest Internet of Things system based on cloud platform
CN105159904A (en) * 2014-05-11 2015-12-16 浙江大学 Digital resource associated management method and system
CN105701181A (en) * 2016-01-06 2016-06-22 中电科华云信息技术有限公司 Dynamic heterogeneous metadata acquisition method and system
CN106453618A (en) * 2016-11-15 2017-02-22 西安中科空间信息技术有限公司 Remote sensing image processing service cloud platform system based on G-Cloud cloud computing
CN106777370A (en) * 2017-01-24 2017-05-31 桂林电子科技大学 A kind of oceanographic data collection and metadata management method
CN108133000A (en) * 2017-12-21 2018-06-08 百度在线网络技术(北京)有限公司 A kind of metadata storing method, device and server

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101201842A (en) * 2007-10-30 2008-06-18 北京航空航天大学 Digital museum gridding and construction method thereof
CN101329682A (en) * 2008-07-22 2008-12-24 华北电力大学 Method for integrating distribution type isomerization information resource
CN101625690A (en) * 2009-07-07 2010-01-13 中国科学院地理科学与资源研究所 Method and device for sharing access of distributed and heterogeneous earth science data resource

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101201842A (en) * 2007-10-30 2008-06-18 北京航空航天大学 Digital museum gridding and construction method thereof
CN101329682A (en) * 2008-07-22 2008-12-24 华北电力大学 Method for integrating distribution type isomerization information resource
CN101625690A (en) * 2009-07-07 2010-01-13 中国科学院地理科学与资源研究所 Method and device for sharing access of distributed and heterogeneous earth science data resource

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
《林业科学》 20060605 颜平辉等 数字林业数据管理平台研究 第42卷, *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103365966A (en) * 2013-06-21 2013-10-23 北京邮电大学 Method and device for storing node information in Internet of things
CN103365966B (en) * 2013-06-21 2017-02-08 北京邮电大学 Method and device for storing node information in Internet of things
CN104184785B (en) * 2013-09-12 2017-10-24 中国林业科学研究院资源信息研究所 Forestry Internet of things system based on cloud platform
CN104184785A (en) * 2013-09-12 2014-12-03 中国林业科学研究院资源信息研究所 Forest Internet of Things system based on cloud platform
CN103678603A (en) * 2013-12-13 2014-03-26 江苏物联网研究发展中心 Multi-source heterogeneous data efficient converging and storing frame system
CN103678603B (en) * 2013-12-13 2017-01-25 江苏物联网研究发展中心 Multi-source heterogeneous data efficient converging and storing frame system
CN105159904B (en) * 2014-05-11 2019-01-18 浙江大学 A kind of method and system of digital resource associate management
CN105159904A (en) * 2014-05-11 2015-12-16 浙江大学 Digital resource associated management method and system
CN103970899A (en) * 2014-05-27 2014-08-06 重庆大学 Service-oriented metadata relevance extraction management method and management system
CN105701181A (en) * 2016-01-06 2016-06-22 中电科华云信息技术有限公司 Dynamic heterogeneous metadata acquisition method and system
CN106453618A (en) * 2016-11-15 2017-02-22 西安中科空间信息技术有限公司 Remote sensing image processing service cloud platform system based on G-Cloud cloud computing
CN106777370A (en) * 2017-01-24 2017-05-31 桂林电子科技大学 A kind of oceanographic data collection and metadata management method
CN108133000A (en) * 2017-12-21 2018-06-08 百度在线网络技术(北京)有限公司 A kind of metadata storing method, device and server

Similar Documents

Publication Publication Date Title
Scannapieco et al. The DaQuinCIS architecture: a platform for exchanging and improving data quality in cooperative information systems
US7558791B2 (en) System and method for ontology-based translation between directory schemas
US7171415B2 (en) Distributed information discovery through searching selected registered information providers
CN101395602B (en) Method and apparatus for a distributed file storage and indexing service
US6895586B1 (en) Enterprise management system and method which includes a common enterprise-wide namespace and prototype-based hierarchical inheritance
US20090240737A1 (en) Process and appliance for data processing and computer programme product
US7730034B1 (en) Providing entity-related data storage on heterogeneous data repositories
US6934702B2 (en) Method and system of routing messages in a distributed search network
US20030101194A1 (en) System and method for loading hierarchical data into relational database systems
US20120005273A1 (en) System, method, computer program products, standards, soa infrastructure, search algorithm and a business method tehreof for ai enabled information communication and computation (icc) framework (newalter) operated by netalter operating system (nos) in terms of netalter service browser (nsb) to device alternative to internet and enterprise & social communication framework engrossing universally distributed grid supercomputing and peer to peer framework
US6950821B2 (en) System and method for resolving distributed network search queries to information providers
US7099871B2 (en) System and method for distributed real-time search
EP2005709B1 (en) Service registry and relevant system and method
US6961723B2 (en) System and method for determining relevancy of query responses in a distributed network search mechanism
US7013303B2 (en) System and method for multiple data sources to plug into a standardized interface for distributed deep search
JP5090450B2 (en) Method, program, and computer-readable medium for updating replicated data stored in a plurality of nodes organized in a hierarchy and linked via a network
Li et al. A storage solution for massive iot data based on nosql
Karasavvas et al. Introduction to OGSA-DAI services
US7475058B2 (en) Method and system for providing a distributed querying and filtering system
CN1841379B (en) Mapping of a file system model to a database object
US7487191B2 (en) Method and system for model-based replication of data
US8296303B2 (en) Intelligent event query publish and subscribe system
JP5043937B2 (en) Method and computer program for federated resource discovery in distributed systems
JP2010519624A (en) REST for entities
US20110225107A1 (en) Semantics update and adaptive interfaces in connection with information as a service

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C12 Rejection of a patent application after its publication