CN102014154A - Grid service-based remote sensing image extraction and sharing system and method - Google Patents
Grid service-based remote sensing image extraction and sharing system and method Download PDFInfo
- Publication number
- CN102014154A CN102014154A CN2010105331407A CN201010533140A CN102014154A CN 102014154 A CN102014154 A CN 102014154A CN 2010105331407 A CN2010105331407 A CN 2010105331407A CN 201010533140 A CN201010533140 A CN 201010533140A CN 102014154 A CN102014154 A CN 102014154A
- Authority
- CN
- China
- Prior art keywords
- metadata
- remote sensing
- sensing images
- service module
- extraction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a grid service-based remote sensing image extraction and sharing system and a grid service-based remote sensing image extraction and sharing method. The system comprises a client system, a platform application server, a department application server, a metadata server, a remote sensing image data server, a metadata proxy service module, a grid service management module, a metadata extraction service module, a metadata management service module, a metadata archiving service module and a metadata query service module. The method comprises the following steps of: extracting metadata of a remote sensing image according to the type of the remote sensing image; specifying a remote sensing image catalog for batch processing by a user, batch-processing archived remote sensing image data, and extracting and storing image metadata; and transmitting a metadata query request to the metadata proxy service module by the client system, summarizing and returning an image metadata set which meets each metadata query condition. Through the system and the method, various types of remote sensing image data of the department can be managed, searched and shared.
Description
Technical field
The present invention relates to the remote sensing images management domain, in particular, relate to a kind of extendible remote sensing images and extract and shared system, and system is to the extraction and the shared method of remote sensing images.
Background technology
Nowadays remote sensing technology has obtained develop rapidly, and remotely-sensed data is becoming the significant data source of great scientific researches such as urban planning, geoscience research, digital earth and engineering construction.But along with the continuous increase of remotely-sensed data amount and the expansion of application, how scientificlly and effectively to manage, store, upgrade and reuse existing remotely-sensed data resource, become the focus of current spatial information Research of Metadata.Metadata (Metadata) is promptly about the data of data, be used for specially describing the content, scope, quality etc. of remotely-sensed data a series of with the closely-related information of remotely-sensed data itself.By metadata to multi-source Remote Sensing Data data unify, standard, science, effectively manage imperative.
At present, the website that remotely-sensed data inquiry much is provided or downloads is arranged on the Internet, as NASA (NASA) website, European NASA (ESA) website, Canada Center for Remote Sensing website, Chinese remote sensing satellite ground station etc.The user can browse or inquire about fast view of remote sensing images and the metadata on these websites.Yet the user but lacks effective retrieval method to the remote sensing images resource of our unit's inside magnanimity.For example in Oceanographic Inst. No.1 of State Bureau of Oceanography, Lei Ji optical imagery, microwave imagery and high-definition picture reach more than the 5TB during the last ten years.These image resources all are to leave on the disk array with the file or folder form, search extremely inconvenient.Moreover, the image resource between different departments, the different research institute is opaque mutually, and everyone does not know whether the other side has own needed remote sensing image data, thereby has hindered remote sensing science research and application and development.
Metadata generally is stored in the header file of remote sensing images, and the metadata that also has need be handled remote sensing images and obtain.For storage and uniform and these metadata of management, can adopt following two kinds of methods: manual typing with extract by computer program or calculate.Because the remote sensing images metadata is of a great variety, quantity is huge, and manual typing is normally unpractical; Obtain remote sensing images and the header file that then requires for different satellites and transducer by computer program, write different handling procedures respectively.This will require metadata extraction program to have sufficient autgmentability, because the user always wishes to add new image kind at any time.For such demand, existing software systems are all only supported for the known image type of process as ERDAS IMAGINE, ENVI etc., and the extended method of handling for unknown images are not provided.If can allow the user embed meta-data extraction or the handling procedure of oneself writing, then have great importance for the flexibility and the extensibility that improve the remote sensing image data shared system by a kind of simple mode.
The remote sensing images resource that the remote sensing image data processor generally will download or buy uploads on the server of this department carries out unified management.Existing metadata extraction program generally is that the remote sensing images on this machine of user are handled, and the result that will extract is shown to the user and stores in the database then.
Metadata extraction process seems simply, and is but very loaded down with trivial details in fact.The user need choose each width of cloth image successively, carries out image filing and meta-data extraction operation then, and this process generally needs a few minutes.General user department has often accumulated the hundreds of width of cloth even several thousand width of cloth view data, if each width of cloth image all will repeat such process, then the process of entire image filing is extremely dull.The user wishes to provide a kind of method of image filing batch processing, promptly only need choose the root at target image resource collection place, system searches for automatically and files all remote sensing image datas, thereby greatly improves the treatment effeciency of remote sensing images filing and metadata sharing system.
Summary of the invention
Task of the present invention is to provide a kind of remote sensing images based on mesh services to extract and shared system, and this system is to the extraction and the sharing approach of remote sensing images.This system and method can allow the remotely-sensed data keeper that this department's all kinds remote sensing image data is managed, searches for and shares, and also can visit the remote sensing image data of other departments; Be with good expansibility, when new image type adds fashionablely, as long as the metadata corresponding extraction procedure is provided, just can be deployed in the system by dynamic state part, existing application service can not be affected.
Its technical solution is:
A kind of remote sensing images meta-data extraction and shared system based on mesh services comprise:
FTP client FTP is used for locating all by the platform application server and comprises and need the department of image resource application server, again by department's application server access and/or management remote sensing images and metadata; Wherein, remotely-sensed data keeper's FTP client FTP also comprises the browser plug-in of supporting the remote sensing images filing, this browser plug-in is realized image file transfers based on File Transfer Protocol, and include but not limited to that support folder is uploaded, breakpoint transmission, progress show and batch processing;
The platform application server, be used for remotely-sensed data keeper's processing request is forwarded to corresponding department's application server, user's remotely-sensed data query requests is sent to all department's application servers, and return to the user after will gathering from the Query Result of each department's application server;
Department's application server is used for the accesses meta-data server, carries out extraction, filing, inquiry and the management of metadata;
Meta data server, the metadata and fast view that are used to store all filing remote sensing images of this department;
The remote sensing image data server is used to store all filing remote sensing images resources of this department.
Above-mentioned platform application server comprises:
The metadata broker service module is used for the type according to user's request, realizes asking one to one or the one-to-many forwarding; If the metadata query request is then carried out one-to-many and is transmitted, if metadata is handled or the management request, then carry out one to one and transmit, processing of request result returns to the user;
The mesh services administration module, be used to realize all services of department registration, browse, manage and inquire about; The search and the positioning function of mesh services are provided for the metadata broker service;
Above-mentioned department application server comprises:
The meta-data extraction service module is used for the type according to remote sensing images, calls the metadata corresponding extraction procedure, realizes the extraction of remote sensing images metadata;
The metadata management service module is used to realize including but not limited to browsing, upgrade and deleting of image metadata;
Metadata filing service module is used to realize the storage of metadata and fast view;
The metadata query service module is used for the query requests according to user's submission, visits one or more metadata tables, returns the image metadata set of satisfying querying condition.
Above-mentioned meta-data extraction service module also comprises a plurality of metadata extraction program, and existence form is JAR bag, DLL storehouse and/or EXE file, dynamically is written into when operation, finishes meta-data extraction or computing function.
Above-mentioned based on mesh services the remote sensing images meta-data extraction and shared system to the extraction and the shared method of remote sensing images, may further comprise the steps:
A is according to the type of remote sensing images, and dynamic call metadata corresponding extraction procedure extracts the metadata of remote sensing images;
B user specifies the remote sensing images catalogue of batch processing, searches for all remote sensing images header files that comprise under this catalogue automatically by FTP client FTP, and batch processing filing remote sensing image data extracts and the memory image metadata then;
C sends the metadata query request by FTP client FTP to the metadata broker service module, the metadata broker service module at first obtains all available metadata query service lists, adopt the metadata query service module of all departments of multithreading concurrent invocation then, gather then and return the image metadata set of satisfying each metadata query condition.
Also comprise step among the above-mentioned steps a:
The configuration file of a1 reading system obtains certain image type metadata corresponding extraction procedure;
A2 calls this metadata extraction program of dynamic load by reflection, dynamically transmits parameter to this extraction procedure, realizes calling of functional based method, obtains the metadata set of returning.
In above-mentioned steps a2, if the metadata extraction program that is loaded is the JAR bag, because the defective that the garbage reclamation mechanism of Java exists, the JAR that is loaded bag can not be unloaded.When metadata extraction program is called after tens times, it is unusual that java.lang.OutOfMemoryError:PermGen space will appear in system.This problem is found so far from 2003 and is not resolved.Therefore in order to solve the memory source tcam-exhaustion, adopt following steps to call the metadata handling procedure:
Be to comprise step among the above-mentioned steps a2:
A21 utilizes the distinctive Resource Properties mechanism of mesh services, sets up a resource pool that is similar to database connection pool; This resource pool comprises all pointers that loaded the JAR bag, and writes down the image type information of each JAR bag pointer correspondence;
A22 judges at first for each pending remote sensing images whether the image of the type occurred; If obtain certainly, directly obtain corresponding JAR bag pointer, realize that the reflection of data processor is called; If negated, load corresponding JAR bag according to configuration file, and its pointer and image type are joined in the resource pool, realize that then the reflection of data processor is called.
Also comprise among the above-mentioned steps b:
B1 analyzes the header file name and the path of remote sensing images, use regular expression describe can the unique identification header file the feature string; For example, for header file p117r45_5t19900722.met, its feature can be described as p d{1,3}r d{1,3}_5t d{8}.met$.
All files under the b2 search subscriber assigned catalogue are if this header file name and routing information and feature string coupling then are designated a new header file, again by recalling the root of determining the remote sensing images file;
B3 utilizes browser plug-in to upload the remote sensing images file and file clips to user's given server catalogue;
B3 calls this meta-data extraction service module and extracts the metadata that comprises in the header file;
B4 calls the metadata of this metadata filing service module storage extraction and the metadata that the user provides.
Also comprise among the above-mentioned steps c:
It is a character string that c1 at first encapsulates various query arguments by FTP client FTP, then service name, function name and the parameter sets of calling is sent to the metadata broker service module;
C2 at first calls the mesh services administration module by the metadata broker service module, inquires about all registrations and current available metadata query service module;
C3 disassembles parameter sets by the metadata broker service module, determines the data type of each parameter according to service registry information, calls all metadata query service modules by reflection technology and multithreading then;
C4 waits for by the metadata broker service module and merges the execution result of each thread different result sets then, and return to FTP client FTP.
The present invention has following useful technique effect:
1, the present invention sets up binding relationship by the meta-data extraction service is separated with various metadata extraction program by configuration file, has solved the scaling problem of system.By design with realize resource pool based on the mesh services Resource Properties, not only eliminate the overflow problem of memory headroom, and repeated to load the JAR bag when having avoided batch processing, improved the operational efficiency of system.
2, the present invention provides the remote sensing images batch processing mode for the user, the user only needs the root of specific image file set, system will find and file all remote sensing images file and metadata automatically, thereby alleviate user's work load, and improve the efficient of image and metadata filing.
3, the present invention uses Enterprise SOA (SOA), and the image resource of any department can add or withdraw from Platform Server at any time.Remote sensing images and metadata still are stored in the server of each department oneself, have guaranteed all departments' data independence and fail safe.The user does not need to know the particular location of image resource, only need send the metadata query request to Platform Server, can obtain the remote sensing images metadata information that all departments share.
Description of drawings
The invention will be further described below in conjunction with accompanying drawing and embodiment:
Fig. 1 is the system principle schematic block diagram of one embodiment of the present invention.
Fig. 2 is the system principle schematic block diagram of another embodiment of the invention.
Fig. 3 calls metadata service method flow chart for Fig. 2 execution mode.
Fig. 4 is the meta-data extraction service business flow chart of Fig. 2 execution mode.
Fig. 5 is the remote sensing images and the metadata filing batch processing flow chart of Fig. 2 execution mode.
Embodiment
Execution mode 1
Referring to Fig. 1, a kind of remote sensing images meta-data extraction and shared system, FTP client FTP 101 based on mesh services
1To 101
NConnect by internet 102 and platform application server 103.FTP client FTP 101
1To 101
NCommunicate with platform application server 103, handle or visit remote sensing images metadata.FTP client FTP 101 behind the installation plug-in unit
1Can also carry out the archive operation of remote sensing images file.FTP client FTP generates the instruction that the remote sensing images metadata is handled, inquired about.Platform application server 103 is by internet 104 and one or more departments application server 105
1To 105
NConnect.When carrying out extraction from FTP client FTP, filing, query statement, platform application server 103 will be resolved the parameter information that these instructions are comprised, and visit extraction, filing or inquiry that one or more departments application server is finished the remote sensing images metadata then.Department's application server 105
iWith remote sensing image data server 106
iWith meta data server 107
iConnect, i is any one integer of ordinal number 1 to N.When the user carries out the remote sensing images filing, department's application server 105
iStore the fast view of remote sensing images into remote sensing image data server 106
iIn, metadata store is arrived meta data server 107
iIn.When the user carries out the remote sensing images inquiry, department's application server 105
iInquiry is also returned meta data server 107
iIn metadata and remote sensing image data server 106
iIn fast view information.Remote sensing image data server 106
1To 106
NBe used for storing and providing the fast view of remote sensing images file and various sizes, meta data server 107
1To 107
NBe used for storing and providing the metadata of remote sensing images.
The said system component parts comprises known parts, and these parts need not to describe in detail at this.For example FTP client FTP can be such as personal computer (PC), notebook computer etc. can access the Internet computing equipment.The general running browser program of FTP client FTP, for example, the Internet Explorer of Microsoft (Microsoft)
TMBrowser, Mozilla Firefox
TMBrowsers etc. (need to install the FTP client FTP 101 of image uploading ActiveX plug-in unit
1Can only move IE kernel browser, as the browser of roaming, Window on the World, search dog browser, the TT of Tengxun, 360 safe browsers etc.), thereby allow FTP client FTP 101
1The user archive remote sensing images to remote sensing image data server 106
jWith meta data server 107
j, j is any one integer of ordinal number 1 to N, inquires about and browses from meta data server 107
1To 107
NWith remote sensing image data server 106
1To 106
NMetadata of Huo Deing and view respectively soon.Each FTP client FTP generally also comprises one or more user interface facilities, for example keyboard, mouse, touch-screen etc., be used for each FTP client FTP on the graphic user interface (GUI) that provides of browser carry out alternately.Platform application server 103 and department's application server can be can access the Internet and computing equipment with certain calculating and storage capacity such as server, personal computer (PC) etc.Meta data server can adopt common large data base management system, for example Microsoft SQL Server
TM, Sybase SQL Server
TM, Oracle
TM, DB2
TMDeng.The remote sensing image data server can adopt common ftp server client software, for example Serv-U
TM, Xlight
TMDeng.The present invention is suitable for using with the internet, and the internet refers to specific Global Internet.Yet, should be appreciated that other network can be used for replacing perhaps using with the internet internet, for example local area network (LAN) LAN etc.
It will be appreciated by those skilled in the art that, be used to realize that the computer code of various aspects of the present invention can be codes such as C++, VB, Java, Javascript, C#, can on FTP client FTP 101, platform application server 103, department's application server 105, be performed or compile perhaps that the back carries out and other suitable programming language.
Execution mode 2
Referring to Fig. 2, a kind of remote sensing images meta-data extraction and shared system based on mesh services comprise FTP client FTP 201
1To 201
N, internet 202 and 204, platform application server 203, department's application server 205
1To 205
M, remote sensing image data server 206
1To 206
M, meta data server 207
1To 207
M
Wherein platform application server 203 comprises metadata broker service module 208 and mesh services administration module 209.Platform application server 203 is in charge of the metadata service module of all registrations, calls various metadata service modules and realizes remote sensing images metadata processing and shared.Department's application server 205
iComprise meta-data extraction service module 2010
i, metadata management service module 2011
i, metadata filing service module 2012
i, metadata query service module 2013
iDeng.Department's application server 205 is deployed in the network of each department inside, and the remote sensing images file and the metadata of management this department externally provide the service of remote sensing images metadata.
Metadata broker service module 208 is used to receive the metadata service invocation request that comes from each FTP client FTP, and the corresponding metadata service is searched and called to the type of analysis service then.Because different requests relates to different services and method, the number of parameters and the parameter type of use are completely different, and therefore having designed a kind of universal method can accept dissimilar service calls.Each FTP client FTP only need provide Service name, method name, department's name and the parameter list character string that will call, just can realize calling of corresponding with service and method.If department name is not empty, then call the corresponding element data service module of all department's application servers; Otherwise, call the metadata service module of corresponding department application server.
For example, for the metadata management service module, it has a method: metadata is browsed, and comprises two parameters, satellite, transducer.A data keeper wants to inquire about the remote sensing images metadata of the LANDSAT-5 of optics department satellite, TM transducer, and it is as follows then can to call the metadata broker service module:
Metadata broker service agent=new metadata broker service ();
Agent.invokeService (" metadata management service ", " metadata is browsed ", " optics department ", " LANDSAT-5, TM ");
For another example, for the metadata query service module, it has a method: according to the longitude and latitude inquiry, comprise six parameters, time started, concluding time, circle, west longitude, circle, east longitude, south bound latitude, circle, north latitude.Suppose the user to inquire about all departments on January 1st, 2009 between 31 days December in 2009, the longitude scope between 73.4 to 135.2, the remote sensing images metadata of latitude scope between 3.52 to 53.33, it is as follows then can to call the metadata broker service module:
Metadata broker service agent=new metadata broker service ();
Agent.invokeService (" metadata query service ", " according to the longitude and latitude inquiry ", " ", " 2009-1-1,2009-12-31,73.4,135.2,3.52,53.33 ");
From top two examples as can be seen, by using the metadata broker service module, the user does not need to know the reference address of metadata service module, does not need to be concerned about whether metadata service module reference address changes yet, and what metadata service modules even do not need to know has.As long as specified services name, method name and department's name, each parameter value of the method that will be called again changes into character string respectively, uses comma then, " couple together just passable.The metadata broker service module at first calls mesh services administration module 209 after receiving an invokeService method call, determine WSDL (the Web Service Description Language) address set of service according to Service name.If department's name is not empty, then only return the WSDL address of specific office service; The WSDL document of analysis service is then determined the title and the data type of each parameter of method according to the method name; Decompose the parameter list character string at last, as separator, each parameter value that obtains converts a parameter object to according to its corresponding data types, all parameter objects is combined into an object array again with comma.Utilize the Java reflection technology, realize calling, and obtain the service return results for the reflection of specifying the metadata service module.If there is a plurality of service WSDL address to need visit, then use multithreading to call, merge a plurality of service thread return results at last.
One of ordinary skill in the art will appreciate that the analytic method of service WSDL document in the above-mentioned processing, service reflection call method adopts multithreading to realize the operations such as concurrent invocation of service.
Mesh services administration module 209 be used to realize mesh services registration, modification, deletion, function such as locate, browse.Mesh services is the assembly of Web service and resource, and the most important difference of it and Web service is exactly that mesh services can have Resource Properties.Therefore mesh services has state, and Web service is stateless.Because the present invention will utilize the Resource Properties of mesh services in the meta-data extraction service module, so use the specific implementation form of mesh services module here as the metadata service module.
The present invention uses a database table to come the log-on message of save mesh service, specifically comprises: Service name, address of service, department's name, service describing, service state, publisher, issuing time.Department's name is used for indicating service arrangement on the application server of that department.After certain department manager's login system, system limits metadata service module that he can only call this department according to his department's name and carries out metadata and handle.
Mesh services administration module 209 comprises registration, modification and delet method, is used to realize the mesh services issue, safeguards and cancel function.Announced mesh services can be called by each FTP client FTP and metadata broker service module 208, realizes remote sensing images metadata processing and shared.Metadata broker service module 208 is found the service WSDL address set that all need by the localization method of mesh services administration module 209.Platform management person checks all announced mesh services by the browsing method of mesh services administration module 209.
In conjunction with Fig. 3, describe the flow process of this method in metadata service module invoked procedure below in detail:
Step 307 is described document according to the WSDL that serves, and obtains the number of parameters and the parameter type information of the method that is called.Use comma that parameter list is divided into a character string array, again according to parameter object array of parameter type structure.
Step 308 is described document according to the WSDL that serves, and obtains the number of parameters and the parameter type information of the method that is called.Use comma that parameter list is divided into a character string array, again according to parameter object array of parameter type structure.
Step 309 starts a plurality of threads, each metadata query service module of concurrent invocation.
Meta-data extraction service module 2010
iExtract the remote sensing images metadata of i department.The remote sensing images header file data format of different satellites, different sensors is widely different, and data model is also different.The header file that has adopts the mode storing metadata (as ENVISAT satellite ASAR transducer) of a key-value pair of every row, the semi-structured file storage metadata of the employing that has (as LANDSAT-5 satellite TM transducer), the employing XML file storage metadata (as the various transducers of SPOT-5 satellite) that has.Therefore, do not have a kind of method in common can extract the metadata of all kinds header file, must write independent metadata extraction program at dissimilar header files.In order to improve the versatility of meta-data extraction service, the meta-data extraction code that consideration will be relevant with the specific image type is peeled off out from the meta-data extraction service, as an independently external program existence.For example, we can be encapsulated as the metadata extraction program of each image a JAR (Java Archive).The meta-data extraction service module is at when operation JAR different according to the type dynamic load of image.This mode has solved the scaling problem of meta-data extraction service, when a kind of new image type occurring, as long as for it creates a JAR, in the image metadata configuration file, this image type and JAR name, class name, method name are associated then, just can realize the automatic extraction of this image type metadata.The meta-data extraction service module no longer needs to remodify, compile, pack and dispose, and department's application server does not need to restart yet, and has reduced the influence to the application system of having disposed to greatest extent.
In order then to use the reflection calling technology of Java at the different JAR of when operation dynamic load.Yet when certain JAR time number called in reflection above 69 times, the Tomcat application server was quoted one unusually: java.lang.OutOfMemoryError:PermGen space.This is to come to be used for the PermGen space of storage class information unusually.This space is different with the heap space that is used for storing example, and GC when main program moves (garbage reclamation mechanism) can not empty the PermGen space.Therefore, if the meta-data extraction service module has loaded too many class, then produce the PermGen free air anomaly probably.
Except the Tomcat application server reported an error, each reflection was called and all will be consumed about 1MB internal memory, and this will cause free memory to reduce sharply.In addition, because outside JAR needs to reload at every turn, reflection is called and is called with non-reflection that specific rate is slower mutually.Possessor's suggestion avoids Tomcat unusual by the size that increases the PermGen space to the greatest extent, but this is a method rather than a permanent way that alleviates problem.The most basic solution is to avoid the waste of memory headroom.After calling outside JAR at every turn and finishing, the class of those dynamic load has just become the rubbish in the internal memory because do not have pointed they.If can keep the pointer of these classes, when load next time, just do not need to have reloaded JAR so.This method has not only been avoided the waste of PermGen space, and has shortened the time that reflection is called.Utilize the mesh services technology to realize the metadata service, can use grid property to preserve state of resources, promptly preserve all by the set of pointers of dynamic loading classes.
Based on the thought of database connection pool, designed the class that all loadings are preserved in a dynamic loading type pond.When FTP client FTP sent metadata and files a request, the meta-data extraction service module was at first checked the class pond.If target class is loaded already, the meta-data extraction service module will be obtained the class pointer and carry out the meta-data extraction operation immediately so.If target class also is not loaded, the mesh services module will at first load it and class pointer and class description will be put into the class pond in order to reusing in the future so.Therefore, the size in class pond is metastable, because the quantity of class is limited.Even being called, same class infinitely repeatedly also can not increase the size in class pond.Provide the key code that realize in the class pond below:
@GridAttribute?public?Vector<String>jars，classes；
@GridAttribute?public?Vector<Object>classPtrs；
boolean?invoked＝false；
// check whether target class exists in the class pond.If then call immediately
Iterator<String>JarIter＝jars.iterator()；
Iterator<String>ClassIter＝classes.iterator()；
Iterator<Object>ClassPtrIter＝classPtrs.iterator()；
while(JarIter.hasNext()){
Jar＝JarIter.next()；Class＝ClassIter.next()；
ClassPtr＝ClassPtrIter.next()；
if(Jar.equals(targetJar)&&Class.
equals(targetClass)){
Method[]Methods＝ClassPtr.getMethods()；
for(int?i＝0；i<Methods.length；i++){
if(Methods[i].getName().equals(extractMethod)){
Method＝Methods[i]；break；
}
}
retObject＝Method.invoke(ClassPtr，argsObject)；
invoked＝true；break；
}
}
If (! Invoked) if // target class do not exist
// load outer category and call, then class pointer and category information are put in the class pond
jars.add(extractJar)；classes.add(extractClass)；
classPtrs.add(classPtr)；
}
In order to verify the validity of this method, 4 outside JAR have been called 25 times separately, call for 100 times altogether.Experimental result shows that the Tomcat application server is not quoted any unusual, and the execution meta-data extraction time dropped to 0.24 second from 0.53 second, because saved the time that JAR loads.Under the situation that does not adopt the class pond, behind the dynamic load JAR 68 times, Tomcat EMS memory occupation amount has reached 84,512KB; Adopt the class pool technology only to need 6,520KB, and after this call at every turn and can not take new memory headroom again.
The initial idea of SUN company is a fixing PermGen space size when JVM (Java Virtual Machine) starts, but they do not expect that reflection technology can be used so widely, and there is a special garbage reclamation mechanism in this space.Therefore when a class dynamically is loaded into the PermGen space, the GC processing of being at a complete loss as to what to do.In 2003, this bug just was found and reports to Sun Microsystems, but was not resolved up to now.The present invention does not attempt to eliminate this bug, but considers to reuse those methods of loading classes.Design and Implement a dynamic loading type pond based on the thought of database connection pool, and used grid property to preserve the pointer of loading classes.When carrying out service call, just can these classes have been reused by the visit grid property next time.
In conjunction with Fig. 4, describe the flow process of this method call external metadata extraction procedure below in detail:
Step 401 defines a resource array, and each resource in the array comprises three attributes: Jar name, class name, class pointer.
Step 402 receives FTP client FTP calling for the meta-data extraction service module.
Step 403 according to the satellite name and the transducer name of input, is determined Jar bag, class name (containing the path) and the method name that will call.All parameters are encapsulated in the Object array.
Step 404 judges whether to exist certain resource, and its Jar name, class name call identical with this.
Step 405 if be "Yes", is then obtained the class pointer in this resource, and the method name preparation method pointer according to calling calls by the reflection technology implementation method.
Step 406 if be "No", is then obtained the complete trails of Jar bag, uses kind loading method to obtain the class pointer, and the method name preparation method pointer according to calling calls by the reflection technology implementation method.
Step 407 is created a new resource, and its Jar name equals this Jar name of calling, and class name equals this class name that calls, and the class pointer equals the class pointer that step 407 obtains.
Step 408 is returned the result that reflection is called, if implementation has unusually, then returns abnormal information.
Under the normal condition, remotely-sensed data keeper need spend time a few minutes and finish width of cloth remote sensing images filings.For the department that has the hundreds of width of cloth even several thousand width of cloth images, the efficient and the automaticity that improve the image filing press for.The user wishes that system can search for all the remote sensing images resources under the assigned catalogue automatically, and adopt that batch fashion realizes that image file is uploaded, functions such as meta-data extraction and filing.Comprised image resource in order to discern those files, those files are normal folder, and the present invention utilizes regular expression to define pattern corresponding to header file filename and path for the remote sensing images of each type.For example, the header file of a LANDSAT-5 satellite TM transducer is p117r44_5t19900722.met, corresponding pattern be p d{1,3}r d{1,3}_5t d{8}.met$, if the filename of certain file meets this pattern, the file that can conclude its place is the remote sensing images of LANDSAT-5 satellite TM transducer.Whether the header file that has only depends on filename not conclude is header file, and for example, the panchromatic transducer of SPOT-5 high-resolution satellite and the header file name of multispectral sensor all are METADATA.DIM, therefore must add their path characteristic information again.The mode-definition of panchromatic transducer be w+/2.5m/SCENE01/METADATA.DIM$, the mode-definition of multispectral sensor be w+/10m/SCENE01/METADATA.DIM$.By definition header file pattern, remote sensing images that can the unique identification each type.
The present invention has also defined an attribute: the header file degree of depth exactly from header file, arrives the step number of remote sensing images root in the directory tree.For example, the LANDSAT-5 satellite TM sensor head file degree of depth is 1, illustrates that header file is just under the image root; The panchromatic sensor head file of the SPOT-5 satellite degree of depth is 3, illustrates from header file, clicks " returning higher level's catalogue " 3 times, could determine the image root.This attribute effect is to determine corresponding remote sensing images file according to the header file of finding, thereby realizes uploading and operations such as the extraction of header file metadata, filing of remote sensing images file.
In conjunction with Fig. 5, describe the flow process that this method realizes the filing batch processing below in detail:
Step 505 utilizes browser plug-in to upload All Files and sub-folder in the remote sensing images file, and shows the progress of uploading.
After step 506, remote sensing images are uploaded and finished, call the meta-data extraction service module and from header file, extract image metadata, call metadata filing service module memory image metadata.
Step 507 judges whether the remote sensing images header file that exists other to file.If, execution in step 504, otherwise execution in step 508
Each graphic user interface of above-mentioned execution mode can be as follows:
1, satellite and the transducer under the remote sensing images of at first selecting to file, in each FTP client FTP, select the image head file then, select the fast view of image again, next select remote sensing images to upload to the position of remote sensing image data server, click " uploading " button at last.System will show that current image file of uploading and progress and remote sensing images totally upload progress.After remote sensing images were uploaded and finished, the meta-data extraction result appearred.Wherein, light green zone bit data are extracted from the image head file and are obtained by calling the meta-data extraction service module, and faint yellow zone bit data are obtained by alternate manner (artificial input etc.).
2, satellite and the transducer under the remote sensing images set of at first selecting to file selected the path of image collection in FTP client FTP then, and system will search for the remote sensing images header file of all specified satellite and sensor type under this catalogue automatically.Select the remote sensing images set to upload to the position of remote sensing image data server, in the Grid control, choose the remote sensing images that all will be uploaded, click " uploading " button, " remote sensing images are uploaded " dialog box occurs and show the current remote sensing images of uploading and upload progress.The remote sensing images filing is the prerequisite of remote sensing images meta-data extraction, because the remote sensing images resource that only uploads on the remote sensing image data server can be by the meta-data extraction service access.
3, at first select to file the affiliated satellite and the transducer of remote sensing images set of metadata, select the position of image collection at the remote sensing image data server then, system will search for the remote sensing images header file of all specified satellite and sensor type under this catalogue automatically.The remote sensing images file that has may not have corresponding fast view down, can click " modification " button, " uploading a fast view " dialog box occurs, and the user can select the fast view file corresponding to remote sensing images.In the Grid control, choose the remote sensing images that all will file metadata, click " beginning filing " button, the information such as progress of " remotely-sensed data filing batch processing " dialog box display element data filing occur.
4, the satellite designation (but multiselect) that the user can given query, data acquisition time scope, spatial dimension (four border longitude and latitude scope or framing mode), the space compute mode, Data Source, satellite orbit number querying condition such as grade, and be the satellite appointment ad hoc inquiry condition of certain selection." Query Result tabulation " page appears in the click OK button, and the user can browse the metadata and the fast view of each width of cloth remote sensing images.These metadata and fast view may be from the meta data servers of a plurality of departments, but the source of metadata is sightless for the user.Click fast view or " checking " hyperlink, " browse graph picture and metadata " page occurs, wherein comprised the detailed metadata information of large-sized fast view and remote sensing images.
" module " in the aforesaid way also can be described as " unit ".
The part of not addressing in the aforesaid way is taked or is used for reference prior art and can realize.
Need to prove, any equivalent way that those skilled in the art have done under the instruction of this specification, or obviously variant all should be in protection scope of the present invention.
Claims (6)
1. remote sensing images meta-data extraction and shared system based on a mesh services is characterized in that comprising:
FTP client FTP is used for locating all by the platform application server and comprises and need the department of image resource application server, again by department's application server access and/or management remote sensing images and metadata; Wherein, remotely-sensed data keeper's FTP client FTP also comprises the browser plug-in of supporting the remote sensing images filing, this browser plug-in is realized image file transfers based on File Transfer Protocol, and include but not limited to that support folder is uploaded, breakpoint transmission, progress show and batch processing;
The platform application server, be used for remotely-sensed data keeper's processing request is forwarded to corresponding department's application server, user's remotely-sensed data query requests is sent to all department's application servers, and return to the user after will gathering from the Query Result of each department's application server;
Department's application server is used for the accesses meta-data server, carries out extraction, filing, inquiry and the management of metadata;
Meta data server, the metadata and fast view that are used to store all filing remote sensing images of this department;
The remote sensing image data server is used to store all filing remote sensing images resources of this department.
2. remote sensing images meta-data extraction and shared system based on mesh services according to claim 1 is characterized in that:
Described platform application server comprises:
The metadata broker service module is used for the type according to user's request, realizes asking one to one or the one-to-many forwarding; If the metadata query request is then carried out one-to-many and is transmitted, if metadata is handled or the management request, then carry out one to one and transmit, processing of request result returns to the user;
The mesh services administration module, be used to realize all services of department registration, browse, manage and inquire about; The search and the positioning function of mesh services are provided for the metadata broker service module;
Described department application server comprises:
The meta-data extraction service module is used for the type according to remote sensing images, calls the metadata corresponding extraction procedure, realizes the extraction of remote sensing images metadata;
The metadata management service module is used to realize including but not limited to browsing, upgrade and deleting of image metadata;
Metadata filing service module is used to realize the storage of metadata and fast view;
The metadata query service module is used for the query requests according to user's submission, visits one or more metadata tables, returns the image metadata set of satisfying querying condition.
3. remote sensing images meta-data extraction and shared system based on mesh services according to claim 2, it is characterized in that: described meta-data extraction service module also comprises a plurality of metadata extraction program, existence form is JAR bag, DLL storehouse and/or EXE file, when operation, dynamically be written into, finished meta-data extraction or computing function.
A claim 1 described based on mesh services the remote sensing images meta-data extraction and shared system to the extraction and the shared method of remote sensing images, it is characterized in that may further comprise the steps:
A is according to the type of remote sensing images, and dynamic call metadata corresponding extraction procedure extracts the metadata of remote sensing images;
B user specifies the remote sensing images catalogue of batch processing, searches for all remote sensing images header files that comprise under this catalogue automatically by FTP client FTP, and batch processing filing remote sensing image data extracts and the memory image metadata then;
C sends the metadata query request by FTP client FTP to the metadata broker service module, the metadata broker service module at first obtains all available metadata query service lists, adopt the metadata query service module of all departments of multithreading concurrent invocation then, gather then and return the image metadata set of satisfying each metadata query condition.
5. according to claim 4 based on mesh services the remote sensing images meta-data extraction and shared system to the extraction and the shared method of remote sensing images, it is characterized in that:
Also comprise step among the described step a:
The configuration file of a1 reading system obtains certain image type metadata corresponding extraction procedure;
A2 calls this metadata extraction program of dynamic load by reflection, dynamically transmits parameter to this extraction procedure, realizes calling of functional based method, obtains the metadata set of returning;
Also comprise among the described step b:
B1 analyzes the header file name and the path of remote sensing images, use regular expression describe can the unique identification header file the feature string;
All files under the b2 search subscriber assigned catalogue are if this header file name and routing information and feature string coupling then are designated a new header file, again by recalling the root of determining the remote sensing images file;
B3 utilizes browser plug-in to upload the remote sensing images file and file clips to user's given server catalogue;
B3 calls the meta-data extraction service module and extracts the metadata that comprises in the header file;
B4 calls the metadata of metadata filing service module storage extraction and the metadata that the user provides;
Also comprise among the described step c:
It is a character string that c1 at first encapsulates various query arguments by FTP client FTP, then service name, function name and the parameter sets of calling is sent to the metadata broker service module;
C2 at first calls the mesh services administration module by the metadata broker service module, inquires about all registrations and current available metadata query service module;
C3 disassembles parameter sets by the metadata broker service module, determines the data type of each parameter according to service registry information, calls all metadata query service modules by reflection technology and multithreading then;
C4 waits for by the metadata broker service module and merges the execution result of each thread different result sets then, and return to FTP client FTP.
6. according to claim 5 based on mesh services the remote sensing images meta-data extraction and shared system to the extraction and the shared method of remote sensing images, it is characterized in that:
Comprise step among the described step a2:
A21 utilizes the distinctive Resource Properties mechanism of mesh services, sets up a resource pool that is similar to database connection pool; This resource pool comprises all pointers that loaded the JAR bag, and writes down the image type information of each JAR bag pointer correspondence;
A22 judges at first for each pending remote sensing images whether the image of the type occurred; If obtain certainly, directly obtain corresponding JAR bag pointer, realize that the reflection of data processor is called; If negated, load corresponding JAR bag according to configuration file, and its pointer and image type are joined in the resource pool, realize that then the reflection of data processor is called.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010533140 CN102014154B (en) | 2010-11-05 | 2010-11-05 | Grid service-based remote sensing image extraction and sharing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010533140 CN102014154B (en) | 2010-11-05 | 2010-11-05 | Grid service-based remote sensing image extraction and sharing system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102014154A true CN102014154A (en) | 2011-04-13 |
| CN102014154B CN102014154B (en) | 2013-10-09 |
Family
ID=43844162
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010533140 Expired - Fee Related CN102014154B (en) | 2010-11-05 | 2010-11-05 | Grid service-based remote sensing image extraction and sharing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102014154B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102436492A (en) * | 2011-11-09 | 2012-05-02 | 浙江大学 | Web publishing method of quantified remote sensing data |
| CN102521687A (en) * | 2011-12-01 | 2012-06-27 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN103428202A (en) * | 2013-07-24 | 2013-12-04 | 浙江大学 | Automatic monitored storage method of remote sensing data product based on file transfer protocol (FTP) and extensible markup language (XML) |
| CN103559327A (en) * | 2013-11-22 | 2014-02-05 | 中国电子科技集团公司第五十四研究所 | One-stop type processing method of remote sensing data requirement |
| CN103581310A (en) * | 2013-10-24 | 2014-02-12 | 深圳市远行科技有限公司 | Automatic generating method for web service agent |
| CN104424530A (en) * | 2013-09-07 | 2015-03-18 | 镇江金软计算机科技有限责任公司 | Method for realizing layering management of multilevel departments through permission setting |
| CN106294742A (en) * | 2016-08-10 | 2017-01-04 | 中国科学技术大学 | A kind of space launching site security reliability database construction method and analyzing and assessment system |
| CN107196984A (en) * | 2016-03-15 | 2017-09-22 | 华为技术有限公司 | A kind of sharing method of metadata, metadata sources equipment and network intermediary device |
| CN107632818A (en) * | 2016-05-12 | 2018-01-26 | 韩锋 | The Arcgis tool boxes of remote sensing images information batch extracting |
| CN108563728A (en) * | 2018-04-04 | 2018-09-21 | 沈阳东软医疗系统有限公司 | A kind of method and apparatus that medical image file is uploaded by browser |
| CN111079515A (en) * | 2019-10-29 | 2020-04-28 | 深圳先进技术研究院 | Area monitoring method, device, terminal and storage medium based on remote sensing big data |
| CN112559534A (en) * | 2020-12-24 | 2021-03-26 | 山东省国土测绘院 | Remote sensing image data filing management system and method |
| CN113515651A (en) * | 2021-06-21 | 2021-10-19 | 中盾创新档案管理(北京)有限公司 | Archive storage method based on grid database |
| CN116954910A (en) * | 2023-07-27 | 2023-10-27 | 北京和德宇航技术有限公司 | Remote sensing data processing method, device, system and medium |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101667192A (en) * | 2009-09-17 | 2010-03-10 | 航天恒星科技有限公司 | Integration method of multi-satellite heterogeneous remote sensing data based on SOA architecture |
-
2010
- 2010-11-05 CN CN 201010533140 patent/CN102014154B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101667192A (en) * | 2009-09-17 | 2010-03-10 | 航天恒星科技有限公司 | Integration method of multi-satellite heterogeneous remote sensing data based on SOA architecture |
Non-Patent Citations (3)
| Title |
|---|
| BINGGE CUI ETL.: "Integration and Sharing of Remote Sensing Images Based on Grid Service", 《2008 SEVENTH INTERNATIONAL CONFERENCE GRID AND COOPERATIVE COMPUTING》 * |
| 王强: "基于网格服务的遥感数据集成与共享平台", 《电脑知识与技术》 * |
| 程妍妍等: "基于网格服务的遥感图像元数据自动获取", 《电脑知识与技术》 * |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102436492A (en) * | 2011-11-09 | 2012-05-02 | 浙江大学 | Web publishing method of quantified remote sensing data |
| CN102521687A (en) * | 2011-12-01 | 2012-06-27 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN102521687B (en) * | 2011-12-01 | 2014-12-24 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN103428202A (en) * | 2013-07-24 | 2013-12-04 | 浙江大学 | Automatic monitored storage method of remote sensing data product based on file transfer protocol (FTP) and extensible markup language (XML) |
| CN103428202B (en) * | 2013-07-24 | 2016-06-01 | 浙江大学 | Remotely-sensed data product based on FTP and XML monitors storage method automatically |
| CN104424530A (en) * | 2013-09-07 | 2015-03-18 | 镇江金软计算机科技有限责任公司 | Method for realizing layering management of multilevel departments through permission setting |
| CN103581310A (en) * | 2013-10-24 | 2014-02-12 | 深圳市远行科技有限公司 | Automatic generating method for web service agent |
| CN103559327A (en) * | 2013-11-22 | 2014-02-05 | 中国电子科技集团公司第五十四研究所 | One-stop type processing method of remote sensing data requirement |
| CN103559327B (en) * | 2013-11-22 | 2016-06-08 | 中国电子科技集团公司第五十四研究所 | A kind of one-stop processing method of remotely-sensed data demand |
| CN107196984A (en) * | 2016-03-15 | 2017-09-22 | 华为技术有限公司 | A kind of sharing method of metadata, metadata sources equipment and network intermediary device |
| CN107196984B (en) * | 2016-03-15 | 2020-06-26 | 华为技术有限公司 | Metadata sharing method, metadata source equipment and network intermediate equipment |
| CN107632818A (en) * | 2016-05-12 | 2018-01-26 | 韩锋 | The Arcgis tool boxes of remote sensing images information batch extracting |
| CN106294742A (en) * | 2016-08-10 | 2017-01-04 | 中国科学技术大学 | A kind of space launching site security reliability database construction method and analyzing and assessment system |
| CN106294742B (en) * | 2016-08-10 | 2019-05-14 | 中国科学技术大学 | A kind of space launching site security reliability database construction method and analysis and assessment system |
| CN108563728A (en) * | 2018-04-04 | 2018-09-21 | 沈阳东软医疗系统有限公司 | A kind of method and apparatus that medical image file is uploaded by browser |
| CN108563728B (en) * | 2018-04-04 | 2021-01-19 | 东软医疗系统股份有限公司 | Method and device for uploading medical image file through browser |
| CN111079515A (en) * | 2019-10-29 | 2020-04-28 | 深圳先进技术研究院 | Area monitoring method, device, terminal and storage medium based on remote sensing big data |
| CN111079515B (en) * | 2019-10-29 | 2023-10-27 | 深圳先进技术研究院 | Remote sensing big data-based area monitoring method, device, terminal and storage medium |
| CN112559534A (en) * | 2020-12-24 | 2021-03-26 | 山东省国土测绘院 | Remote sensing image data filing management system and method |
| CN112559534B (en) * | 2020-12-24 | 2021-11-26 | 山东省国土测绘院 | Remote sensing image data filing management system and method |
| CN113515651A (en) * | 2021-06-21 | 2021-10-19 | 中盾创新档案管理(北京)有限公司 | Archive storage method based on grid database |
| CN116954910A (en) * | 2023-07-27 | 2023-10-27 | 北京和德宇航技术有限公司 | Remote sensing data processing method, device, system and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102014154B (en) | 2013-10-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102014154B (en) | Grid service-based remote sensing image extraction and sharing system and method | |
| US8056091B2 (en) | Systems and methods for using application services | |
| US9747117B2 (en) | System and methods for loading an application and its modules in a client device | |
| CN103744853A (en) | Method and device for providing web cache information in search engine | |
| US9274783B2 (en) | Dynamic delivery and integration of static content into cloud | |
| US20230143896A1 (en) | Cross-Platform Module for Loading Across a Plurality of Device Types | |
| CN104077387A (en) | Webpage content display method and browser device | |
| US20150156075A1 (en) | Mobile Information Management System And Methods Of Use And Doing Business | |
| US20140297711A1 (en) | Method and framework for content viewer integrations | |
| US20130060805A1 (en) | Methods and systems for detecting website orphan content | |
| Skluzacek et al. | A serverless framework for distributed bulk metadata extraction | |
| CN112947992B (en) | Code version management method and device | |
| JPH1031615A (en) | Distributed hyper media system | |
| JP5657498B2 (en) | File search system | |
| US20090063416A1 (en) | Methods and systems for tagging a variety of applications | |
| Kausar et al. | Web crawler based on mobile agent and java aglets | |
| Shao et al. | Federated catalogue for discovering earth observation data | |
| KR101632389B1 (en) | IoT analyzing system using IoT virtual file structure | |
| Stephan et al. | Semantic catalog of things, services, and data to support a wind data management facility | |
| Chen et al. | Use of service middleware based on ECHO with CSW for discovery and registry of MODIS data | |
| US20170302592A1 (en) | System and Methods for Sharing Resources Among Application Modules | |
| Hawick et al. | On-line data archives | |
| Thavasimani | RapidXfer-data transfer framework for square kilometre array | |
| Yang et al. | The China GEO data center: bringing order to open earth-observation data | |
| Wang | Distributed geographic information systems on the Web |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Cui Binge Inventor after: Tian Xiujuan Inventor after: Chen Xin Inventor before: Cui Binge Inventor before: Song Pingjian Inventor before: Liu Rongjie Inventor before: Chen Xin |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: CUI BINGE SONG PINGJIAN LIU RONGJIE CHEN XIN TO: CUI BINGE TIAN XIUJUAN CHEN XIN |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20131009 Termination date: 20191105 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |