CN106341457A - Device for asynchronously exporting data from cloud platform - Google Patents
Device for asynchronously exporting data from cloud platform Download PDFInfo
- Publication number
- CN106341457A CN106341457A CN201610715580.1A CN201610715580A CN106341457A CN 106341457 A CN106341457 A CN 106341457A CN 201610715580 A CN201610715580 A CN 201610715580A CN 106341457 A CN106341457 A CN 106341457A
- Authority
- CN
- China
- Prior art keywords
- cloud platform
- unit
- export
- data
- request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/184—Distributed file systems implemented as replicated file system
Abstract
The invention discloses a device for asynchronously exporting data from a cloud platform. The device comprises a cloud interface, an export request unit which sends an export request to a cloud platform through a cloud interface, an export receiving unit which queries the export state of the cloud platform through the cloud interface and gets exported files page by page after the cloud platform feeds back an export permit signal, and a command input unit which inputs an export command to the export request unit. The advantage is that the interaction between a user and the cloud platform is asynchronous, and after the user sends an export request, the cloud platform must ensure that exported data is correct before the exported data is received. Moreover, the exported data is exported page by page, the phenomenon that a large file is formed for export of big data is avoided, and the influence of an export error on previously exported data is avoided.
Description
Technical field
The present invention relates to a kind of high in the clouds data let-off gear(stand), the asynchronous device deriving data of more particularly, to a kind of cloud platform.
Background technology
Cloud derives the principle that cloud storage used for reference by platform, disposes Export server in a network, and the network equipment is carried out
Integrate and dynamically distributes, realizing data center's levels such as United Dispatching, unified derivation, intelligent management, high efficiency recovery derives system
System requires.Compared with traditional cloud guiding system, the cloud based on asynchronous data cloud is derived platform and be provide not only data derivation clothes
Business, network storage space, additionally provide resource dynamic expansion ability based on virtualization storage technology and cloud storage management platform,
Resource pool share framework and derivation data asynchronous transmission mechanism, improve speed and the effectiveness of derivation.The core of this platform
The asynchronous data cloud being made up of logical data cloud and physical data cloud.Logical data cloud is by a series of different regions that are distributed in
Logical memory device (as VTL) forms the mass data storage it is provided that quick, stable；Physical data cloud by
Multiple physical storage devices (as magnetic tape controller) composition is it is provided that Large Copacity, memory space steady in a long-term.Logical data cloud and
Physical data cloud is controlled by cloud Export server, according to the distribution of exporting policy, provides parallel data storage service.
When deriving data, it is all to be derived using synchronous, i.e. cloud platform real-time change, while carry out data lead
Go out.Such working method can lead to a certain measuring point irreversible mistake to occur, seriously when being concurrently writing and read
Meeting lead to the database corruption of cloud platform, this is very huge to the economic loss of enterprise.
Content of the invention
In order to solve above-mentioned technical problem, present invention aim at providing a kind of cloud platform the asynchronous device deriving data.
A kind of asynchronous device deriving data of cloud platform of the present invention is it is characterised in that include:
High in the clouds interface, for connecting cloud platform；
Derive request unit, sending to cloud platform by high in the clouds interface derives request；
Derive receiving unit, state is derived by high in the clouds interface polls cloud platform；After cloud platform is fed back and is derived enabling signal, point
Page obtains export；
Instruction input unit, input derives instruction to derivation request unit.
Described device also includes paging and sums up unit, and the paging file of acquisition is summed up as a total number according to sequence number
According to library file.
Described device also includes timing unit, and the request unit of timing controlled derivation at preset time intervals sends derivation please
Ask；Timing controlled derives receiving unit inquiry cloud platform and derives state at preset time intervals.
Described device also includes reminding unit, finishes rear line in acquisition paging file and sends alert notification.
A kind of asynchronous device deriving data of cloud platform of the present invention, has an advantage in that, user is mutual with cloud platform
Dynamic be asynchronous carry out, after user sends derivation request, need to guarantee that data correctly just can receive derivation number by cloud platform
According to.And the data deriving is all paging derives, it is to avoid it is larger to derive the file being formed when big data, also avoids one
The data deriving mistake and deriving before impact.
Brief description
Fig. 1 is the structural representation of device of the present invention.
Specific embodiment
According to Fig. 1, a kind of device of cloud platform of the present invention asynchronous derivation data includes high in the clouds interface, uses
In connection cloud platform；Derive request unit, sending to cloud platform by high in the clouds interface derives request；Derive receiving unit, pass through
High in the clouds interface polls cloud platform derives state；After cloud platform is fed back and derived enabling signal, paging obtains export；Instruction is defeated
Enter unit, input derives instruction to derivation request unit.
Operation principle is that user first passes through instruction input unit to the data letter deriving request unit input needs derivation
Breath, object, time period and attribute that such as data is covered etc..Derive request unit to send deriving request by high in the clouds interface
To cloud platform, device of the present invention is in asynchronous waiting state simultaneously.Cloud platform is in for requested derivation data
When in the state of stable and safety, provide derivation enabling signal.During device waits, derive receiving unit and be spaced one end
Time just passes through the derivation enabling signal of high in the clouds interface polls cloud platform, and after derivation enabling signal is detected, paging will need
The data deriving is obtained from cloud platform successively by high in the clouds interface, to complete the asynchronous process deriving data.
Described paging is derived and just can also be carried out single derivation in some paging files acquisition derivation enabling signal, then weighs
The paging file not completing to derive is ask in check, till all paging files all complete to derive.Part paging file is in cloud
Derivation just can be completed, it is to avoid once deriving multiple paging files takes considerable time, enhances work when platform is idle
Make efficiency.
Described device also includes paging and sums up unit, and the paging file of acquisition is summed up as a total number according to sequence number
According to library file.Because all of derivation data is all divided into multiple paging files, therefore in order to follow-up data storehouse can realize one
Secondary property imports to required target host computer, first can sum up each paging file successively according to paging sequence number.Make subsequently to import
Convenient and quick, so that file integrality is increased further.
Described device also includes timing unit, and the request unit of timing controlled derivation at preset time intervals sends derivation please
Ask；Timing controlled derives receiving unit inquiry cloud platform and derives state at preset time intervals.Can be right in instruction input unit
Time quantum carries out time interval setting, makes device of the present invention cloud platform can be sent timing with derivation instruction, enters one
Step reduces manual operation can make accuracy improve.At the interval setting, cloud platform is sent with inquiry or derive request, can avoid short
Time repeatedly conducts interviews to cloud platform causes port to attack.
Described device also includes reminding unit, finishes rear line in acquisition paging file and sends alert notification.Due to
Device of the present invention adopts asynchronous derivation, therefore may be spaced the long period after user sends derivation request and just obtain
Derive license, be also required to the derivation spending the longer derivation time just to complete whole data after obtaining derivation license.Therefore use
Family needs the waiting time grown very much in whole process, in order to wait this process to expend the extensive work time.Therefore arrange
Reminding unit, after completing all derivation tasks, reminds user to carry out other operations, user can be within the time that script waits
Make other work to select.
For a person skilled in the art, can technical scheme as described above and design, make other each
Plant corresponding change and deformation, and all these change and deformation all should belong to the protection model of the claims in the present invention
Within enclosing.
Claims (4)
1. a kind of asynchronous device deriving data of cloud platform is it is characterised in that include:
High in the clouds interface, for connecting cloud platform；
Derive request unit, sending to cloud platform by high in the clouds interface derives request；
Derive receiving unit, state is derived by high in the clouds interface polls cloud platform；After cloud platform is fed back and is derived enabling signal, point
Page obtains export；
Instruction input unit, input derives instruction to derivation request unit.
2. device according to claim 1 it is characterised in that include paging sum up unit, by obtain paging file according to
Sum up as a total database file according to sequence number.
3. device according to claim 1 is it is characterised in that include timing unit, timing controlled at preset time intervals
Derive request unit and send derivation request；Timing controlled derives receiving unit inquiry cloud platform and derives shape at preset time intervals
State.
4. device according to claim 1 it is characterised in that include reminding unit, obtain paging file finish after to
User sends alert notification.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610715580.1A CN106341457A (en) | 2016-08-25 | 2016-08-25 | Device for asynchronously exporting data from cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610715580.1A CN106341457A (en) | 2016-08-25 | 2016-08-25 | Device for asynchronously exporting data from cloud platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106341457A true CN106341457A (en) | 2017-01-18 |
Family
ID=57825661
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610715580.1A Pending CN106341457A (en) | 2016-08-25 | 2016-08-25 | Device for asynchronously exporting data from cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106341457A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102456005A (en) * | 2010-10-19 | 2012-05-16 | 深圳市金蝶友商电子商务服务有限公司 | High-data-volume file processing method and system |
| CN103257964A (en) * | 2012-02-16 | 2013-08-21 | 环达电脑(上海)有限公司 | Asynchronous exporting method of mass data |
| CN103412961A (en) * | 2013-09-04 | 2013-11-27 | 广东全通教育股份有限公司 | Processing method and system for real-time exporting report form of mass data |
| CN103810238A (en) * | 2013-11-20 | 2014-05-21 | 国家电网公司 | Large-data-volume Excel file exporting method based on asynchronous processing |
-
2016
- 2016-08-25 CN CN201610715580.1A patent/CN106341457A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102456005A (en) * | 2010-10-19 | 2012-05-16 | 深圳市金蝶友商电子商务服务有限公司 | High-data-volume file processing method and system |
| CN103257964A (en) * | 2012-02-16 | 2013-08-21 | 环达电脑(上海)有限公司 | Asynchronous exporting method of mass data |
| CN103412961A (en) * | 2013-09-04 | 2013-11-27 | 广东全通教育股份有限公司 | Processing method and system for real-time exporting report form of mass data |
| CN103810238A (en) * | 2013-11-20 | 2014-05-21 | 国家电网公司 | Large-data-volume Excel file exporting method based on asynchronous processing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10748220B2 (en) | Account processing method and apparatus | |
| CN103577551A (en) | Method and device for submitting data to database in batch | |
| CN108469988A (en) | A kind of method for scheduling task based on isomery Hadoop clusters | |
| CN104156296A (en) | System and method for intelligently monitoring large-scale data center cluster computing nodes | |
| US9910872B2 (en) | Grid based data mobility | |
| CN112860695B (en) | Monitoring data query method, device, equipment, storage medium and program product | |
| CN106649239A (en) | Method and device for generating report in cloud monitoring system based on visualization | |
| CN104317899A (en) | Big-data analyzing and processing system and access method | |
| CN105302730A (en) | Calculation model detection method, testing server and service platform | |
| CN105184452B (en) | A kind of MapReduce job dependence control methods calculated suitable for power information big data | |
| CN104735142B (en) | A kind of processing in real time of big data and storage system and its processing method | |
| CN115599769A (en) | Data migration method and device, electronic equipment and storage medium | |
| CN105785962A (en) | Workshop material delivery control and manage platform based on UWB | |
| CN101968752A (en) | Model of cloud computing resource pool and performance analysis method | |
| CN101645073A (en) | Method for guiding prior database file into embedded type database | |
| CN110069565B (en) | Distributed database data batch processing method and device | |
| CN103577469A (en) | Database connection multiplexing method and device | |
| CN105574027A (en) | On-line transaction processing/on-line analytical processing (OLTP/OLAP) hybrid application based multi-dimensional performance data storage method, device and system | |
| CN106341457A (en) | Device for asynchronously exporting data from cloud platform | |
| CN102314631B (en) | The event processing apparatus of manufacturing execution system | |
| CN115904817A (en) | Distributed database parallel playback method and device, electronic equipment and storage medium | |
| CN115169578A (en) | AI model production method and system based on meta-space data markers | |
| CN104317906A (en) | Processing method for large-scale storage of reported data of GPS (global positioning system) monitoring radios | |
| CN114792125A (en) | Data processing method and device based on distributed training, electronic equipment and medium | |
| CN114547206A (en) | Data synchronization method and data synchronization system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170118 |
|
| RJ01 | Rejection of invention patent application after publication |