CN103077074B - A kind of three-dimensional space data Method of Scheduling Parallel and system - Google Patents
A kind of three-dimensional space data Method of Scheduling Parallel and system Download PDFInfo
- Publication number
- CN103077074B CN103077074B CN201210576332.5A CN201210576332A CN103077074B CN 103077074 B CN103077074 B CN 103077074B CN 201210576332 A CN201210576332 A CN 201210576332A CN 103077074 B CN103077074 B CN 103077074B
- Authority
- CN
- China
- Prior art keywords
- dimensional space
- space data
- data
- task
- thread
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to geospatial information system technical field, it is provided that a kind of three-dimensional space data Method of Scheduling Parallel based on data content, described method includes: receive the three-dimensional space data dispatch request of multiple client；By scheduler task parallel decomposition method based on data content, three-dimensional space data scheduler task being decomposed, generating can the three-dimensional space data scheduling sublayer task of executed in parallel；Perform thread for described three-dimensional space data scheduling sublayer task distribution available task and data base connects, perform the parallel query in three-dimensional space data storehouse；After the data recombination obtain described three-dimensional space data scheduling sublayer job enquiry, return to client.The present invention is by by the decomposition of three-dimensional space data scheduler task and executed in parallel, improve the efficiency dispatching dissimilar three-dimensional space data from three-dimensional space data storehouse, improve the ability of three-dimension GIS real-time visual.
Description
Technical field
The invention belongs to geospatial information system technical field, particularly relate to a kind of three-dimensional space data Method of Scheduling Parallel and system.
Background technology
Can the smooth visualization demand that always three-dimension GIS is most basic of extensive three-dimensional space data, data needed for fast dispatch become the key ensureing three-dimensional real-time visual fluency from extensive three-dimensional space data storehouse.When data volume in three-dimensional space data storehouse is less than Installed System Memory or display device caching, system start-up is generally used data to be just fully loaded to the strategy of internal memory and video memory, to support the most efficient three-dimensional visualization.But, along with the scale in three-dimensional space data storehouse is continuously increased, Installed System Memory cannot load the most far away total data, and this is necessary for needing dynamic dispatching technology, needs dynamic load data by three-dimensional visualization.In order to improve the efficiency of three-dimensional space data visualization and data dispatch, use multithreading can make full use of the advantage of multinuclear, realize the real parallel of digital independent, but how to make multithreading execution efficiency more efficient, it is necessary to consider the classifying rationally problem of parallel task.
Existing three-dimension GIS software has been achieved for the achievement of comparative maturity for the dynamic dispatching of continuous print massive terrains surface data, such as the digital earth softwares such as GoogleEarth, WorldWind massive terrain data to the whole world, can realize the effect of visualization of quick, smooth multi-resolution display in a network environment, many clients real-time Transmission three-dimensional geography terrain data collection given in a streaming manner by the TerraGate web data server software such as Skyline.But, the at present dynamic dispatching for the magnanimity three-dimensional space data of above and below ground various discrete complicated entity, geobody, underground pipe networks etc. is also far from the maturation of terrain data, as Skyline has the strict restriction of comparison to the texture size of three-dimensional space data, geometry dough sheet number etc..Especially to city three-dimensional model data, due to characteristics such as data structure complexity, spatial distribution scrambling and detail characteristics, thus the terrain data that is far from the scheduling of city three-dimensional model data is ripe, quickly.
The data dispatch in three-dimensional space data storehouse is all premised on the request of front end user, high performance throughput data from data base, actively meets front end rapid data request.This process, for the purpose of the dispatching requirement of response front end user, therefore must be converted into dispatching requirement at intermediate module and dispatch the Parallel Scheduling task of data from data base.Parallel Scheduling for three-dimensional space data must carry out the Parallel Scheduling task division of data for the data content dependency of three-dimension GIS visualization and three-dimensional space data, but does not the most all have the scheme of maturation at present.
Summary of the invention
The present invention provides a kind of three-dimensional space data Method of Scheduling Parallel and system, aim to solve the problem that the dispatching efficiency of current three-dimensional space data is low, cause cannot from extensive three-dimensional space data storehouse data needed for fast dispatch, thus the problem being difficult to ensure three-dimensional real-time visual fluency.
To this end, the technical scheme is that
A kind of three-dimensional space data Method of Scheduling Parallel based on data content, comprises the following steps:
Receive the three-dimensional space data dispatch request of multiple client；
By scheduler task parallel decomposition method based on data content, three-dimensional space data scheduler task being decomposed, generating can the three-dimensional space data scheduling sublayer task of executed in parallel；
Perform thread for described three-dimensional space data scheduling sublayer task distribution available task and data base connects, perform the parallel query in three-dimensional space data storehouse；
After the data recombination obtain described three-dimensional space data scheduling sublayer job enquiry, return to client.
Present invention also offers a kind of three-dimensional space data parallel dispatch system, including client and server, server includes:
Scheduler task decomposing module, for the parsing of data scheduling request, the parallel decomposition of data scheduling duties, generating can the data scheduling duties of executed in parallel；
Data dispatch module, for generating three-dimensional space data scheduler task based on data content；
Thread pool management module, manages the establishment of thread for Thread Pool Technology, destroys and manage operation, the allocation strategy of task, and the synchronous synergetic mechanism between thread；
Database connection pool module, for Database Connection-Pool Technology managed database establishment, destroy with manage operation be respectively connected with described data dispatch module and data base, for distributing available thread for described three-dimensional space data scheduler task, performing many scheduler tasks parallel query in three-dimensional space data storehouse, the data base being pre-created and preserving multiple user connects queue；
Scheduler task performs module, is connected with database connection pool management module with described thread pool management module, the Parallel Scheduling task in the three-dimensional space data storehouse for performing；
Three-dimensional space data storehouse, is connected with described thread pool management module schedules task execution module, is used for storing large-scale three-dimensional space data.Compared with prior art, embodiments of the invention have the advantage that
Present invention data content based on three-dimensional space data correlation analysis, the regulation and operation scheduler task parallel decomposition of three-dimensional space data is called in task division parallel, and the executed in parallel of many scheduler tasks, thus improve the dispatching efficiency extracting dissimilar three-dimensional space data from data base, improve the ability of three-dimension GIS real-time visual.
Accompanying drawing explanation
Fig. 1 is the method flow diagram of the three-dimensional space data Method of Scheduling Parallel that the embodiment of the present invention provides；
Fig. 2 is the method flow diagram generating three-dimensional space data scheduler task based on data content that the embodiment of the present invention provides；
Fig. 3 be the embodiment of the present invention provide for three-dimensional space data scheduler task distribute available thread, perform three-dimensional space data storehouse many scheduler tasks parallel query method flow diagram；
Fig. 4 is the method flow diagram taking out idle thread from idle thread queue that the embodiment of the present invention provides；
Fig. 5 is the structure chart of the three-dimensional space data parallel dispatch system that the embodiment of the present invention provides.
Detailed description of the invention
In order to make the purpose of the present invention, technical scheme and advantage clearer, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that described herein is only a part of embodiment of the present invention rather than whole embodiments.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art are obtained on the premise of not making creative work, broadly fall into the scope of protection of the invention.
Fig. 1 is the method flow diagram of the three-dimensional space data Method of Scheduling Parallel that the embodiment of the present invention provides, and for convenience of description, illustrate only the part relevant to the embodiment of the present invention.
As it is shown in figure 1, the method comprises the following steps:
Step 101, receives the three-dimensional space data dispatch request of multiple client.
Step 102, by scheduler task parallel decomposition method based on data content, decomposes three-dimensional space data scheduler task, and generating can the three-dimensional space data scheduling sublayer task of executed in parallel.
Step 103, performs thread for described three-dimensional space data scheduling sublayer task distribution available task and data base connects, perform the parallel query in three-dimensional space data storehouse.
Step 104, after the data recombination obtain described three-dimensional space data scheduling sublayer job enquiry, returns to client.
Fig. 2 is the method flow diagram generating three-dimensional space data scheduler task based on data content that the embodiment of the present invention provides, and for convenience of description, illustrate only the part relevant to the embodiment of the present invention.
As in figure 2 it is shown, the method performs step 101, after receiving the data inquiry request of client, further comprising the steps of:
Step 201, it is judged that the data inquiry request type of reception, if three dimensions inquiry request, performs step 202, if non-three dimensions inquiry request, then performs step 203.
Step 202: obtaining described three dimensions inquiry request needs the third dimension element class set of inquiry, data type according to third dimension element class judges, set up single scheduler task for each third dimension element class, and be converted into can the third dimension element data scheduling duties of executed in parallel.
Concrete, described three dimensions inquiry request, can be one or more in building inquiry, vegetation inquiry, pipeline inquiry, geology inquiry.
Concrete, described in the data scheduling duties that is converted into, can be one or more in building scheduler task, vegetation scheduler task, pipeline scheduler task, geology scheduler task.
Step 203: judge the type of this inquiry request, separates the inquiry of the various data types such as material, texture, Share Model and attribute, and is converted into corresponding data scheduling duties.
Concrete, described non-three dimensions inquiry request, can be one or more in texture inquiry, material inquiry, Share Model inquiry, attribute query.
Concrete, described in the three-dimensional space data scheduling sublayer task that is converted into, can be one or more in texture scheduler task, material scheduler task, Share Model scheduler task, attribute scheduler task.
Fig. 3 be the embodiment of the present invention provide for three-dimensional space data scheduler task distribution available task perform thread, perform many scheduler tasks parallel query method flow diagram in three-dimensional space data storehouse, for convenience of description, illustrate only the part relevant to the embodiment of the present invention.
As it is shown on figure 3, the method comprises the following steps:
Step 301, puts into the three-dimensional space data scheduling sublayer task of generation in three-dimensional space data task dispatching queue.
Step 302, takes out first scheduler task in three-dimensional space data task dispatching queue successively.
Preferably, according to the principle of first in first out, from described three-dimensional space data task dispatching queue, take out first scheduler task successively.
Step 303, performs to take out thread queue an idle thread from idle task.
Method that is concrete, that take out idle thread from idle thread queue, as shown in Figure 4, will describe in detail in next embodiment.
Step 304, the scheduler task will taken out in three-dimensional space data task dispatching queue, it is bundled in from described idle thread queue in the described idle thread taken out.
Step 305, is set to busy thread by described idle thread, joins in busy thread queue.
Step 306, from described busy thread queue, takes out the busy thread of described binding scheduler task successively, performs described three-dimensional space data scheduling sublayer task.
Concrete, the busy thread of described binding scheduler task, from the connection pool management device of database connection pool management module, obtain idle data base and connect, carry out the inquiry in three-dimensional space data storehouse.
Step 307, after described three-dimensional space data scheduling sublayer tasks carrying, is set to described busy thread idle thread, and joins in described idle thread queue.
Preferably, it is stored in the three-dimensional space data in same disk/RAID, same thread processes.
The data performed acquired in described three-dimensional space data scheduler task are returned by step 308.
Concrete, each thread is performed the data acquired in described scheduler task and is incorporated in a set, total data is returned.
Fig. 4 is the method flow diagram taking out idle thread from idle thread queue that the embodiment of the present invention provides, and for convenience of description, illustrate only the part relevant to the embodiment of the present invention.
As shown in Figure 4, the method comprises the following steps:
Step 401, it is judged that whether there is idle thread in idle thread queue, if existing, then performs step 402, if not existing, then performs step 403.
Step 402, takes out an idle thread from described idle thread queue.
Step 403, it is judged that whether active threads reaches maximum thread arranges number, if reaching, then performs step 404, if not up to, then performs step 405.
Step 404, when waiting until available free thread in idle thread queue, takes out an idle thread from described idle thread queue.
Step 405, creates new thread and puts in described idle thread queue.
Based on identical design, the embodiment of the present invention also provides for a kind of three-dimensional space data parallel dispatch system, as it is shown in figure 5, this system includes:
Client 51, for sending data inquiry request to server, and receives the Query Result of return.
Scheduler task decomposing module 52, for the parsing of data scheduling request, the parallel decomposition of data scheduling duties；Scheduler task performs module 56, and generating can the data scheduling duties of executed in parallel.
Concrete, scheduler task decomposing module 52 uses scheduler task algorithm of parallel resolution, generates three-dimensional space data scheduler task based on data content.
Thread pool management module 53, manages the establishment of thread for Thread Pool Technology, destroys and manage operation, the allocation strategy of task, and the synchronous synergetic mechanism between thread.
Concrete, thread pool management module 53, including thread pool manager, described thread pool manager is connected with data dispatch module, database connection pool management module and data base respectively.
Concrete, described thread pool manager, for performing to obtain module 56 three-dimensional space data scheduler task from described scheduler task, distributes available thread.
Concrete, described thread pool manager is additionally operable to be connected with the idle data base obtained from described database connection pool management module, and after data base obtains database stores information, carries out the inquiry in three-dimensional space data storehouse.
Three-dimensional space data storehouse 54, is used for storing large-scale three-dimensional space data.
Database connection pool module 55, for Database Connection-Pool Technology managed database establishment, destroy and manage operation.
Concrete, database connection pool module 55, also include database connection pool manager, database connection pool manager is for providing idle data base to connect to thread pool manager.
Embodiment of the present invention data content based on three-dimensional space data correlation analysis, divide by the regulation and operation scheduler task parallel decomposition of three-dimensional space data being called in parallel task, and the executed in parallel of many scheduler tasks, thus improve the dispatching efficiency extracting dissimilar three-dimensional space data from data base, improve the ability of three-dimension GIS real-time visual.
It will be appreciated by those skilled in the art that the module in the device in embodiment can describe according to embodiment to carry out being distributed in the device of embodiment, it is also possible to carry out respective change and be disposed other than in one or more devices of the present embodiment.The module of above-described embodiment can merge into a module, it is also possible to is further split into multiple submodule.
Through the above description of the embodiments, those skilled in the art is it can be understood that can add the mode of required general hardware platform by software to the present invention and realize, naturally it is also possible to by hardware, but a lot of in the case of the former is more preferably embodiment.Based on such understanding, the part that prior art is contributed by technical scheme the most in other words can embody with the form of software product, this computer software product is stored in a storage medium, including some instructions with so that a station terminal equipment (can be mobile phone, personal computer, server, or the network equipment etc.) perform the method described in each embodiment of the present invention.
The above is only the preferred embodiment of the present invention; it should be pointed out that, for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should regard protection scope of the present invention.
Claims (5)
1. a three-dimensional space data Method of Scheduling Parallel based on data content, it is characterised in that comprise the following steps:
A: receive the three-dimensional space data dispatch request of multiple client；
B: by scheduler task parallel decomposition method based on data content, three-dimensional space data scheduler task is decomposed, generate can the three-dimensional space data scheduling sublayer task of executed in parallel, comprise the following steps:
B1: judge the data inquiry request type received, if three dimensions inquiry request, performs step B2, if non-three dimensions inquiry request, then performs step B3；
B2: obtaining described three dimensions inquiry request needs the third dimension element class set of inquiry, data type according to third dimension element class judges, set up single scheduler task for each third dimension element class, and be converted into can the third dimension element data scheduling duties of executed in parallel as described three-dimensional space data scheduling sublayer task；
B3: judge the type of described non-three dimensions inquiry request, separates the inquiry of various data type, and is converted into three-dimensional space data scheduling sublayer task；Described various data type includes material, texture, Share Model and attribute；
C: perform thread for described three-dimensional space data scheduling sublayer task distribution available task and data base connects, perform the parallel query in three-dimensional space data storehouse；
D: after the data recombination obtain described three-dimensional space data scheduling sublayer job enquiry, return to client.
2. three-dimensional space data Method of Scheduling Parallel as claimed in claim 1, it is characterized in that, described perform thread and data base for described three-dimensional space data scheduling sublayer task distribution available task and connect, perform the parallel query in three-dimensional space data storehouse, comprise the following steps:
C1: the three-dimensional space data scheduling sublayer task of described generation is put in three-dimensional space data task dispatching queue；
C2: according to the principle of first in first out, take out first scheduler task in described three-dimensional space data task dispatching queue successively；
C3: perform to take out thread queue an idle thread from idle task；
C4: the described scheduler task will taken out in described three-dimensional space data task dispatching queue, is bundled in from described idle thread queue in the described idle thread taken out, and described idle thread is set to busy thread, join in busy thread queue；
C5: from described busy thread queue, takes out the busy thread of described binding scheduler task successively, performs described three-dimensional space data scheduling sublayer task；
C6: after described three-dimensional space data scheduling sublayer tasks carrying, is set to described busy thread idle thread, and joins in described idle thread queue；
C7: the data performed acquired in described three-dimensional space data scheduling sublayer task are returned.
3. three-dimensional space data Method of Scheduling Parallel as claimed in claim 2, it is characterised in that described step C5, comprises the following steps:
The busy thread of described binding scheduler task, obtains idle data base and connects, carry out the inquiry in three-dimensional space data storehouse.
4. three-dimensional space data Method of Scheduling Parallel as claimed in claim 2, it is characterised in that described step C7, comprises the following steps:
After data acquired in each thread described scheduler task of execution are incorporated in a data acquisition system, total data is returned.
5. a three-dimensional space data parallel dispatch system, including client and server, it is characterised in that described server includes:
Scheduler task decomposing module, for the parsing of data scheduling request, the parallel decomposition of data scheduling duties, generating can the data scheduling duties of executed in parallel；
Thread pool management module, manages the establishment of thread for Thread Pool Technology, destroys and manage operation, the allocation strategy of task, and the synchronous synergetic mechanism between thread；
Database connection pool module, for Database Connection-Pool Technology, it is achieved data base connect establishment, destroy and manage operation, the data base being pre-created and preserving multiple user connects queue；
Scheduler task performs module, for performing the Parallel Scheduling task in three-dimensional space data storehouse；
Three-dimensional space data storehouse, performs module with described scheduler task and is connected, be used for storing large-scale three-dimensional space data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210576332.5A CN103077074B (en) | 2012-12-26 | 2012-12-26 | A kind of three-dimensional space data Method of Scheduling Parallel and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210576332.5A CN103077074B (en) | 2012-12-26 | 2012-12-26 | A kind of three-dimensional space data Method of Scheduling Parallel and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103077074A CN103077074A (en) | 2013-05-01 |
| CN103077074B true CN103077074B (en) | 2016-08-03 |
Family
ID=48153611
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210576332.5A Active CN103077074B (en) | 2012-12-26 | 2012-12-26 | A kind of three-dimensional space data Method of Scheduling Parallel and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103077074B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105337923B (en) * | 2014-05-26 | 2019-07-12 | 腾讯科技（北京）有限公司 | Data distributing method and system and data sending device and data sink |
| CN105760477A (en) * | 2016-02-15 | 2016-07-13 | 中国建设银行股份有限公司 | Data query method and system for multiple data sources and associated equipment therefore |
| CN107577766B (en) * | 2017-09-04 | 2020-09-15 | 苏州英诺迈医学创新服务有限公司 | Webpage 3D target loading method and device |
| CN107741922A (en) * | 2017-10-18 | 2018-02-27 | 山东浪潮通软信息科技有限公司 | A kind of operational formula treating method and apparatus |
| CN110569252B (en) * | 2018-05-16 | 2023-04-07 | 杭州海康威视数字技术股份有限公司 | Data processing system and method |
| CN111444445B (en) * | 2020-03-25 | 2024-07-12 | 深圳平安医疗健康科技服务有限公司 | Data transmission method, system, computer equipment and readable storage medium |
| CN111831721B (en) * | 2020-09-15 | 2020-12-18 | 北京东方通科技股份有限公司 | Processing method, system and equipment for spatial data visualization |
| CN112817771A (en) * | 2021-04-15 | 2021-05-18 | 成都四方伟业软件股份有限公司 | Shared multithreading service management method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1588358A (en) * | 2004-08-26 | 2005-03-02 | 陈红 | Treating method and system for MDX multidimensional data search statement |
| CN101916280A (en) * | 2010-08-17 | 2010-12-15 | 上海云数信息科技有限公司 | Parallel computing system and method for carrying out load balance according to query contents |
| CN101930472A (en) * | 2010-09-09 | 2010-12-29 | 南京中兴特种软件有限责任公司 | Parallel query method for distributed database |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8392920B2 (en) * | 2010-01-27 | 2013-03-05 | Microsoft Corporation | Parallel query engine with dynamic number of workers |
-
2012
- 2012-12-26 CN CN201210576332.5A patent/CN103077074B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1588358A (en) * | 2004-08-26 | 2005-03-02 | 陈红 | Treating method and system for MDX multidimensional data search statement |
| CN101916280A (en) * | 2010-08-17 | 2010-12-15 | 上海云数信息科技有限公司 | Parallel computing system and method for carrying out load balance according to query contents |
| CN101930472A (en) * | 2010-09-09 | 2010-12-29 | 南京中兴特种软件有限责任公司 | Parallel query method for distributed database |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103077074A (en) | 2013-05-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103077074B (en) | A kind of three-dimensional space data Method of Scheduling Parallel and system | |
| CN108234612B (en) | Multi-terminal mode high-resolution resource dynamic allocation and on-demand service release system | |
| GB2503801A (en) | Power grid visualisation based on a three dimensional geographic information system (GIS) | |
| CN110110006A (en) | Data managing method and Related product | |
| CN108733850A (en) | A kind of power grid big data analysis excavation application system | |
| US20110217963A1 (en) | Methods and systems for distributed processing on consumer devices | |
| CN106708917A (en) | Data processing method and device and OLAP system | |
| CN102404615A (en) | Video processing system based on cloud computing | |
| CN101303775A (en) | Method and system for presenting network topological structure based on GIS | |
| CN103984761A (en) | Massive isomerous data storage method and system | |
| CN109656685A (en) | Container resource regulating method and system, server and computer readable storage medium | |
| CN107563955A (en) | A kind of parallel map dicing method and system based on GPU | |
| CN111967789A (en) | Debugging system is transferred in distribution automation terminal warehouse debugging | |
| CN105786447A (en) | Method and apparatus for processing data by server and server | |
| CN102724290A (en) | Method, device and system for getting target customer group | |
| CN104168174A (en) | Method and apparatus for information transmission | |
| Elgazzar et al. | Overview of using private cloud model with GIS | |
| CN106055578A (en) | Geography national condition monitoring system based on GIS network service and rich internet application | |
| Boukerche et al. | Optimized dynamic grid-based DDM protocol for large-scale distributed simulation systems | |
| CN202475491U (en) | Talent assessment system for enterprise | |
| CN109241215A (en) | Object searching method, device, equipment and computer readable storage medium | |
| Wu et al. | Optimizing network performance of computing pipelines in distributed environments | |
| CN108363756A (en) | A kind of intelligent transportation big data processing system | |
| CN109150938A (en) | Satellite application public service platform based on cloud service | |
| CN108921930A (en) | A kind of cultural relics in the collection of cultural institution rendering method and its system based on object-oriented |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |