CN105160474A - Data processing method for realizing heterogeneous database based on intelligent task scheduling platform - Google Patents
Data processing method for realizing heterogeneous database based on intelligent task scheduling platform Download PDFInfo
- Publication number
- CN105160474A CN105160474A CN201510558525.1A CN201510558525A CN105160474A CN 105160474 A CN105160474 A CN 105160474A CN 201510558525 A CN201510558525 A CN 201510558525A CN 105160474 A CN105160474 A CN 105160474A
- Authority
- CN
- China
- Prior art keywords
- data
- intelligent task
- heterogeneous database
- processing method
- task scheduling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 13
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 238000012856 packing Methods 0.000 claims abstract description 12
- 238000000034 method Methods 0.000 claims abstract description 10
- 230000001360 synchronised effect Effects 0.000 claims abstract description 9
- 238000012545 processing Methods 0.000 claims abstract description 8
- 238000004806 packaging method and process Methods 0.000 claims description 8
- 230000001808 coupling effect Effects 0.000 abstract 1
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data processing method for realizing heterogeneous databases based on an intelligent task scheduling platform, which solves the problems of data flow and intelligent task scheduling of business handling in heterogeneous databases of different data centers. The method is carried out by the following steps: 1) packing and unpacking the data of the heterogeneous database; 2) synchronously transmitting the structured data and the unstructured data in the heterogeneous database; 3) the core data exchange processing module automatically distributes data; 4) and scheduling the background intelligent task. The invention realizes the real-time exchange of business handling, comprises structured and unstructured data synchronous transmission, and isolates the business handling from the data exchange transmission through a background intelligent task scheduling mechanism, thereby achieving the coupling effect.
Description
Technical field
The present invention relates to task scheduling platform field, be specifically related to a kind of data processing method realizing heterogeneous database based on intelligent task dispatching platform.
Background technology
In education sector, the electronics student status of students in middle and primary schools is deposited and manages in units of economizing, and does not have the mechanism setting up business handling of transfeing to another school transprovincially between each provincial data center.The student transprovincially transferd to another school at present, needs to face to come and go and produces province and proceed to that province carrys out fill message, material of witnessing, and the personnel of student status management simultaneously also face the problems such as application material verification difficulty of transfeing to another school.
Current existing data center parametric controller can not realize the real-time exchange of business handling, and structuring and non-structured data synchronization transmissions.Need at present to solve the business handling problem of students in middle and primary schools' electronics student status in different provincial data center.Originally time of handling of transfeing to another school is long, and the real-time of business handling and correctness can not ensure.
Summary of the invention
Technical assignment of the present invention is for the deficiencies in the prior art, provides a kind of data processing method realizing heterogeneous database based on intelligent task dispatching platform.This method solves the stream compression of business handling in the heterogeneous database of different pieces of information center and intelligent task scheduling problem.
The technical solution adopted for the present invention to solve the technical problems is:
Realize a data processing method for heterogeneous database based on intelligent task dispatching platform, the method is undertaken by following steps:
1), the data packing of heterogeneous database unpacks;
2) structural data, in heterogeneous database and the synchronous transmission of dividing unstructured data;
3), core data exchange processing module automatic distributing data;
4), background intelligent task scheduling.
The data packing of heterogeneous database unpacks, and business handling process data is synchronously packed together with annexes such as testimonial materials, is carried out unpacking and putting in storage respectively and file by packaging file the take over party of data.
Structural data in heterogeneous database and the synchronous transmission of point unstructured data, ensure that packaging file accurately and timely can be transferred to destination, and ensure the synchronous transmission of data and attachment files.
Further, described core data exchange processing module resolves packaging file request, according to asking file distributing to destination.
Further, described intelligent task dispatching platform finishing service handles the driving of stream compression, completes packing, unpacks, transmits, the intelligent scheduling of the background process such as work flow.
Of the present inventionly a kind ofly realize the data processing method of heterogeneous database compared with prior art based on intelligent task dispatching platform, the beneficial effect produced is, 1, can network for the business of transfeing to another school transprovincially of students in middle and primary schools and handle, substantially increase efficiency of transfeing to another school transprovincially.2, for the personnel of handling that transprovincially transfer to another school of links provide Data support accurately.The business between the heterogeneous database of different pieces of information center that 3, can solve other industry handles problem in real time.
Accompanying drawing explanation
Accompanying drawing 1 is the business handling technical schematic diagram realizing heterogeneous database based on intelligent task dispatching platform.
Embodiment
Below in conjunction with accompanying drawing 1, a kind of data processing method realizing heterogeneous database based on intelligent task dispatching platform of the present invention is described in detail below.
Realize a data processing method for heterogeneous database based on intelligent task dispatching platform, the method is undertaken by following steps:
1), the data packing of heterogeneous database unpacks;
2) structural data, in heterogeneous database and the synchronous transmission of dividing unstructured data;
3), core data exchange processing module automatic distributing data;
4), background intelligent task scheduling.
The data packing of heterogeneous database unpacks, and business handling process data is synchronously packed together with annexes such as testimonial materials, is carried out unpacking and putting in storage respectively and file by packaging file the take over party of data.
Structural data in heterogeneous database and the synchronous transmission of point unstructured data, ensure that packaging file accurately and timely can be transferred to destination, and ensure the synchronous transmission of data and attachment files.
Core data exchange processing module automatic distributing data, central core data exchange processing module resolves packaging file request, and by file distributing to destination.
Background intelligent task scheduling, intelligent task dispatching platform finishing service handles the driving of stream compression, completes packing, unpacks, transmits, the intelligent scheduling of the background process such as work flow.By background intelligent task scheduling modules, drive and realize business in the heart and real-time exchange in different pieces of information, comprise structuring and non-structured data, intelligent task dispatching platform realizes the effect that business handling and data transmit loose coupling.
The inventive method researches and develops special task scheduling modules, and task is initiated automatically in backstage.Business datum across data center circulates, and drives business handling by task scheduling.The packet of circulation containing structural data and unstructured data, and ensures synchronous packing, transmission.Exchange the form after the data transmitted are through serializing.
A kind of data processing method realizing heterogeneous database based on intelligent task dispatching platform of the present invention, by intelligent task dispatching platform mechanism, the automatic packing such as application information and testimonial material of transfeing to another school, central core system is exchanged to by data transmission, packing data is automatically distributed to and produces province by the intelligent task dispatching platform of central core system, packaging file is unpacked warehouse-in by the backstage scheduler task producing province, standby service handled rear automatically electronics student status is sent proceed to province, the interlock transprovincially realizing business of transfeing to another school transprovincially is handled, exchanges data backstage completes automatically, substantially reduce and originally transferd to another school the time of handling, and ensure real-time and the correctness of business handling.
Claims (3)
1. realize a data processing method for heterogeneous database based on intelligent task dispatching platform, it is characterized in that, the method is undertaken by following steps:
1), the data packing of heterogeneous database unpacks;
2) structural data, in heterogeneous database and the synchronous transmission of dividing unstructured data;
3), core data exchange processing module automatic distributing data;
4), background intelligent task scheduling.
2. a kind of data processing method realizing heterogeneous database based on intelligent task dispatching platform according to claim 1, is characterized in that, described core data exchange processing module resolves packaging file request, according to asking file distributing to destination.
3. a kind of data processing method realizing heterogeneous database based on intelligent task dispatching platform according to claim 1, is characterized in that, described background intelligent task scheduling completes packing, unpacks, transmits, work flow.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510558525.1A CN105160474A (en) | 2015-09-06 | 2015-09-06 | Data processing method for realizing heterogeneous database based on intelligent task scheduling platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510558525.1A CN105160474A (en) | 2015-09-06 | 2015-09-06 | Data processing method for realizing heterogeneous database based on intelligent task scheduling platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105160474A true CN105160474A (en) | 2015-12-16 |
Family
ID=54801325
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510558525.1A Pending CN105160474A (en) | 2015-09-06 | 2015-09-06 | Data processing method for realizing heterogeneous database based on intelligent task scheduling platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105160474A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112422510A (en) * | 2020-10-22 | 2021-02-26 | 山东浪潮通软信息科技有限公司 | Data transmission method and system based on DMZ zone |
| CN113342826A (en) * | 2021-07-01 | 2021-09-03 | 广东电网有限责任公司 | Method, storage medium and system for uniformly managing data operations of different data acquisition engines |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101714157A (en) * | 2009-09-29 | 2010-05-26 | 金蝶软件（中国）有限公司 | Method, device and heterogeneous database system for generating heterogeneous database report |
| CN103942234A (en) * | 2013-01-21 | 2014-07-23 | 中国电信股份有限公司 | Method for operating multiple heterogeneous databases, middleware device and system |
| CN104200416A (en) * | 2014-09-15 | 2014-12-10 | 浪潮软件股份有限公司 | Method for implementation of distributed database business processing |
-
2015
- 2015-09-06 CN CN201510558525.1A patent/CN105160474A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101714157A (en) * | 2009-09-29 | 2010-05-26 | 金蝶软件（中国）有限公司 | Method, device and heterogeneous database system for generating heterogeneous database report |
| CN103942234A (en) * | 2013-01-21 | 2014-07-23 | 中国电信股份有限公司 | Method for operating multiple heterogeneous databases, middleware device and system |
| CN104200416A (en) * | 2014-09-15 | 2014-12-10 | 浪潮软件股份有限公司 | Method for implementation of distributed database business processing |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112422510A (en) * | 2020-10-22 | 2021-02-26 | 山东浪潮通软信息科技有限公司 | Data transmission method and system based on DMZ zone |
| CN112422510B (en) * | 2020-10-22 | 2023-01-20 | 山东浪潮通软信息科技有限公司 | Data transmission method and system based on DMZ zone |
| CN113342826A (en) * | 2021-07-01 | 2021-09-03 | 广东电网有限责任公司 | Method, storage medium and system for uniformly managing data operations of different data acquisition engines |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2002056552A3 (en) | System and method for remote traffic management in a communication network | |
| CN107171922A (en) | Heterogeneous system bridge service method based on middleware Technology | |
| CN105160474A (en) | Data processing method for realizing heterogeneous database based on intelligent task scheduling platform | |
| CN108810103A (en) | Industry platform of internet of things based on cloud | |
| CN110278644A (en) | A kind of more architectural lighting monitoring methods and system based on edge calculations | |
| CN107888314B (en) | A kind of across a network method for synchronizing time towards industrial Internet of Things | |
| CN202084036U (en) | Intelligent medicine basket management system | |
| CN109285403A (en) | A kind of system that family-school interaction quality-oriented education is carried out based on internet | |
| CN104994181B (en) | A kind of method that dynamic MAC address table is shown in distributed OLT system | |
| CN109446685A (en) | A kind of data communication protocol based on power station emulation training | |
| CN104239537B (en) | A kind of big data preprocessed text data genaration handling process implementation method | |
| CN105636317A (en) | Intelligent street lamp management system and information processing method | |
| CN104200416A (en) | Method for implementation of distributed database business processing | |
| CN104318816A (en) | Multi-machine joint-screen computer teaching system | |
| CN104427472B (en) | The methods, devices and systems that end message reports in a kind of group system | |
| CN104427475B (en) | The methods, devices and systems that end message reports in a kind of group system | |
| CN105303467B (en) | Keep the method and its system of Electric Power Marketing System and power distribution system data consistency | |
| CN107070955A (en) | The transmission method and device of a kind of electric power system data | |
| CN109801042A (en) | A kind of transformation of scientific and technical result information service method and system | |
| CN102122320A (en) | Management system of intelligent medicine frame | |
| CN102740217A (en) | GSM-R (Global System for Mobile Communications for Railway) emergency system and method | |
| CN107844954A (en) | A kind of artificial intelligence system method of automatic factory | |
| CN107809619A (en) | A kind of method and gateway exchange system that outgoing access is realized by multimedia gateway | |
| CN103414875B (en) | It is a kind of to be uniformly controlled the method that video conferencing system conference scenario shows | |
| CN103491030B (en) | A kind of data processing method and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151216 |
|
| RJ01 | Rejection of invention patent application after publication |