CN108763403A - A kind of data unloading method and device - Google Patents
A kind of data unloading method and device Download PDFInfo
- Publication number
- CN108763403A CN108763403A CN201810497359.2A CN201810497359A CN108763403A CN 108763403 A CN108763403 A CN 108763403A CN 201810497359 A CN201810497359 A CN 201810497359A CN 108763403 A CN108763403 A CN 108763403A
- Authority
- CN
- China
- Prior art keywords
- fragment
- data
- unloaded
- fragment data
- uninstall file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44594—Unloading
Abstract
The embodiment of the present application discloses a kind of data unloading method, and this method includes：Fragment is carried out to data to be unloaded, obtains each fragment data corresponding with the data to be unloaded；According to the primitive form of the data to be unloaded, each fragment data that fragment obtains is ranked up, and corresponding arrangement serial number is marked for each fragment data；In turn, unloading processing is carried out to above-mentioned fragment data using processing thread, obtains fragment uninstall file corresponding with each fragment data, and the arrangement serial number of each fragment uninstall file is corresponding with the arrangement serial number of fragment data；After obtaining fragment uninstall file corresponding with each data to be unloaded, according to the arrangement serial number of each fragment uninstall file, merge each fragment uninstall file to obtain uninstall file.The data unloading method can ensure the uninstall file that load shedding to be unloaded is general format, and thus in subsequent load uninstall file without being limited by particular load tool, load can be achieved using any loading tool.
Description
Technical field
This application involves technical field of data processing, more particularly to a kind of data unloading method and device.
Background technology
A large amount of data are commonly stored in banking data base, but since the amount of storage of banking data base is limited, and data
The data update speed stored in library, it usually needs continually unload the data stored in database.But it is specific at some
In the case of, for example, user's mislanding carry it is certain there is still a need for data, or the data being unloaded are required again, at this time also
It needs to reload these data unloaded.
In addition, in application scenes, it is also necessary to data are transmitted by way of unloading data, specifically, sending
Side needs to unload data to be passed to be uninstall file, and in turn, recipient can receive institute by reloading the uninstall file
The data of transmission.
In the prior art, load shedding is carried out usually using the unloading mechanism that oracle database carries, however, using this
Kind discharging method unloads data, and in the subsequent load uninstall file, there are prodigious limitations, that is, load this and unload published article
The loading tool that oracle database must be used to provide when part is loaded, if the load work provided without oracle database
Tool, then cannot achieve and reloaded to uninstall file, obtain the corresponding initial data of uninstall file.
Invention content
It in order to solve the above-mentioned technical problem, can will be to be unloaded this application provides a kind of data unloading method and device
Load shedding is the uninstall file of general format, thus eliminates the limitation suffered in the subsequent load uninstall file.
The embodiment of the present application discloses following technical solution：
In a first aspect, the embodiment of the present application provides a kind of data unloading method, the method includes：
Fragment is carried out to data to be unloaded, obtains each fragment data corresponding with the data to be unloaded；
According to the primitive form of the data to be unloaded, each fragment data is ranked up, and is described each
Fragment data marks corresponding arrangement serial number；
The fragment data is handled using processing thread, the corresponding fragment of the fragment data is obtained and unloads published article
The arrangement serial number of part, the fragment uninstall file is corresponding with the arrangement serial number of the fragment data；
After the corresponding fragment uninstall file of each fragment data to be obtained, according to the arrangement of the fragment uninstall file
Serial number merges the fragment uninstall file and obtains uninstall file.
Optionally, described that the fragment data is handled using the processing thread, obtain the fragment data pair
The fragment uninstall file answered, including：
Judge whether the quantity of the fragment data is more than preset quantity；
If the quantity of the fragment data is more than the preset quantity, according to the quantity of the processing thread of configuration and
The quantity of the fragment data is each fragment data matching treatment thread；
Utilize fragment data described in the matched processing thread process of institute；
If the quantity of the fragment data is less than the preset quantity, using the individual processing thread to the fragment
Data are handled.
Optionally, fragment is carried out to data to be unloaded described, obtains each fragment corresponding with the data to be unloaded
Before data, the method further includes：
The parameter of Unloading path and unloading manner is configured, the Unloading path is for characterizing depositing for the fragment uninstall file
Storage space is set, and the unloading manner is used to characterize the processing mode of the processing thread.
Optionally, fragment is carried out to data to be unloaded described, obtains each fragment corresponding with the data to be unloaded
Before data, the method further includes：
The data to be unloaded are obtained from database.
Optionally, described to obtain the data to be unloaded from the database, including：
User name input by user and login password are verified；
If being verified, according to the data name input by user, obtains corresponding described wait unloading from the database
Carry data.
Second aspect, the embodiment of the present application provide a kind of load shedding device, and described device includes：
Fragment module obtains each fragment corresponding with the data to be unloaded for carrying out fragment to data to be unloaded
Data；
Sorting module is ranked up each fragment data for the primitive form according to the data to be unloaded,
And mark corresponding arrangement serial number for each fragment data；
Unload module is obtained the fragment data and corresponded to for being handled the fragment data using processing thread
Fragment uninstall file, the arrangement serial number of the fragment uninstall file is corresponding with the arrangement serial number of the fragment data；
Merging module, after the corresponding fragment uninstall file of each fragment data to be obtained, according to the fragment
The arrangement serial number of uninstall file merges the fragment uninstall file and obtains uninstall file.
Optionally, the Unload module is specifically used for：
Judge whether the quantity of the fragment data is more than preset quantity；
If the quantity of the fragment data is more than the preset quantity, according to the quantity of the processing thread of configuration and
The quantity of the fragment data is each fragment data matching treatment thread；
Utilize fragment data described in the matched processing thread process of institute；
If the quantity of the fragment data is less than the preset quantity, using the individual processing thread to the fragment
Data are handled.
Optionally, described device further includes：
Configuration module, the parameter for configuring Unloading path and unloading manner, the Unloading path is for characterizing described point
The storage location of piece uninstall file, the unloading manner are used to characterize the processing mode of the processing thread.
Optionally, described device further includes：
Acquisition module, for obtaining the data to be unloaded from database.
Optionally, the acquisition module is specifically used for：
User name input by user and login password are verified；
If being verified, according to the data name input by user, obtains corresponding described wait unloading from the database
Carry data.
The data unloading method provided by the embodiments of the present application it can be seen from above-mentioned technical proposal, to data to be unloaded into
Row fragment, and according to the primitive form of the data to be unloaded, arrangement sequence is accordingly marked to each fragment data that fragment obtains
Number, it correspondingly, can also be according to each fragment data after obtaining fragment uninstall file using processing thread process fragment data
Serial number is arranged, corresponding arrangement serial number is marked for each fragment uninstall file.In turn, all corresponding point of fragment datas are being obtained
After piece uninstall file, each fragment uninstall file can be merged according to the arrangement serial number of each fragment uninstall file, to obtain
Complete uninstall file.Since the uninstall file is obtained by each fragment uninstall file by putting in order to merge, this is unloaded
Published article part and the primitive form of data to be unloaded are completely corresponding, in turn, in the subsequent load uninstall file, without being added by specific
The limitation of load tool can load the uninstall file of the general format using any loading tool.
Description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application without having to pay creative labor, may be used also for those of ordinary skill in the art
With obtain other attached drawings according to these attached drawings.
Fig. 1 is a kind of flow diagram of data unloading method provided by the embodiments of the present application；
Fig. 2 is the flow diagram of another data unloading method provided by the embodiments of the present application；
Fig. 3 is a kind of structural schematic diagram of load shedding device provided by the embodiments of the present application.
Specific implementation mode
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application
Attached drawing, technical solutions in the embodiments of the present application are clearly and completely described, it is clear that described embodiment is only this
Apply for a part of the embodiment, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art exist
The every other embodiment obtained under the premise of creative work is not made, shall fall in the protection scope of this application.
Term " first ", " second ", " third " in the description and claims of this application and above-mentioned attached drawing, "
The (if present)s such as four " are for distinguishing similar object, without being used to describe specific sequence or precedence.It should manage
The data that solution uses in this way can be interchanged in the appropriate case, so that embodiments herein described herein for example can be to remove
Sequence other than those of illustrating or describe herein is implemented.In addition, term " comprising " and " having " and theirs is any
Deformation, it is intended that cover it is non-exclusive include, for example, containing the process of series of steps or unit, method, system, production
Product or equipment those of are not necessarily limited to clearly to list step or unit, but may include not listing clearly or for this
The intrinsic other steps of processes, method, product or equipment or unit a bit.
This application provides a kind of data unloading method, it can ensure the unloading for general format by load shedding to be unloaded
Thus file uses any loading tool in the subsequent load uninstall file without being limited by particular load tool
Load the uninstall file of the general format.
The core technology thinking of data unloading method provided by the present application is introduced below：
Data unloading method provided by the present application first carries out data to be unloaded when being unloaded to data to be unloaded
Fragment obtains each fragment data corresponding with the data to be unloaded；According to the primitive form of the data to be unloaded, fragment is obtained
To each fragment data be ranked up, and mark corresponding arrangement serial number for each fragment data；In turn, processing thread is utilized
Unloading processing is carried out to above-mentioned fragment data, obtains fragment uninstall file corresponding with each fragment data, and is each fragment
Uninstall file mark arrangement serial number, ensures that the arrangement serial number of each fragment uninstall file is opposite with the arrangement serial number of fragment data
It answers；All fragment data processing corresponding with data to be unloaded are terminated, fragment corresponding with each data to be unloaded is obtained and unloads
It publishes papers after part, according to the arrangement serial number of each fragment uninstall file, merges each fragment uninstall file to obtain uninstall file.
Above-mentioned data unloading method carries out fragment to data to be unloaded, and according to the primitive form of the data to be unloaded, right
Each fragment data that fragment obtains accordingly marks arrangement serial number, correspondingly, utilizes processing thread unloading processing fragment data
It, can also be according to the arrangement serial number of each fragment data, for each fragment uninstall file mark pair after obtaining fragment uninstall file
The arrangement serial number answered.In turn, after obtaining the corresponding fragment uninstall file of all fragment datas, published article can be unloaded according to each fragment
The arrangement serial number of part merges each fragment uninstall file, to obtain complete uninstall file.Due to the uninstall file be by
Each fragment uninstall file is by putting in order what merging obtained, and therefore, the uninstall file and the primitive form of data to be unloaded are complete
It is corresponding, it is in turn, equal using any loading tool without being limited by particular load tool in the subsequent load uninstall file
The uninstall file of the general format can be loaded.
Data unloading method provided by the present application is introduced by way of examples below：
Referring to Fig. 1, Fig. 1 is the flow diagram of data unloading method provided by the embodiments of the present application.The load shedding side
Method includes the following steps：
Step 101：Fragment is carried out to data to be unloaded, obtains each fragment data corresponding with the data to be unloaded.
After getting data to be unloaded, fragment is carried out to acquired data to be unloaded, is obtained and the data pair to be unloaded
The each fragment data answered.When specific implementation, the data to be unloaded, each two point can be split in such a way that decollator is set
The data cut between symbol are fragment data.
It should be noted that before carrying out fragment to data to be unloaded, need to obtain the number to be unloaded from database
According to.
When specifically obtaining data to be unloaded, user is needed to input user name and login password, with log database system.It obtains
After obtaining user name input by user and login password, user name input by user and login password are verified, a side
Face verifies whether that there are the user names, and whether with login password corresponding, if there are the user names if on the other hand verifying the user name
And the user name and login password correspond to, then it represents that are verified, user can log in the Database Systems；If conversely, not depositing
Not corresponding with login password in the user name or user name, then user can not log database system.
After being verified, user can log in the Database Systems, and by inputting the data name of data to be unloaded, obtaining should
Data to be unloaded.
In addition, carrying out fragment to data to be unloaded, before obtaining the corresponding each fragment data of the data to be unloaded, also
The parameter that Unloading path and unloading manner can be configured determines that unloading each fragment data obtains by configuring the parameter of Unloading path
The storage location of each fragment uninstall file arrived；By configuring the parameter of unloading manner, determine that the when of unloading each fragment data is adopted
Specific discharging method.
It should be noted that above-mentioned data to be unloaded can be the data of form, or the number of textual form
According to not doing any restriction to the data mode of the data to be unloaded herein.
Step 102：According to the primitive form of the data to be unloaded, each fragment data is ranked up, and be
Each fragment data marks corresponding arrangement serial number.
Fragment is carried out to data to be unloaded to need according to this after obtaining each fragment data corresponding with data to be unloaded
The primitive form of data to be unloaded is ranked up each fragment data, and marks corresponding arrangement sequence for each fragment data
Number.It thereby guarantees that and arranges each fragment data according to the corresponding arrangement serial number of each fragment data, data to be unloaded can be obtained.
Step 103：The fragment data is handled using processing thread, obtains the corresponding fragment of the fragment data
The arrangement serial number of uninstall file, the fragment uninstall file is corresponding with the arrangement serial number of the fragment data.
Each fragment data is obtained, and is to utilize processing thread after each fragment data marks out corresponding arrangement serial number
Unloading processing is carried out to the fragment data obtained, obtains fragment uninstall file corresponding with each fragment data.Due to each
Fragment data has corresponding arrangement serial number, therefore, can be each for unloading processing according to the arrangement serial number of each fragment data
The fragment uninstall file mark arrangement serial number that fragment data obtains, arrangement serial number and each fragment data of the fragment uninstall file
Arrangement serial number it is corresponding.
In order to improve the processing speed of unloading data, the unloading operation can be preconfigured to and configure multiple processing threads.
Before carrying out unloading operation to fragment data, judge whether the quantity of fragment data is more than the preset quantity, if fragment data
Quantity is more than the preset quantity, then illustrates that the fragment data for needing to unload is more, need to utilize the multiple processing threads configured
Fragment data is handled, to improve unloading efficiency.It, can be according to the processing Thread Count configured, to needing when specific implementation
The fragment data to be unloaded carries out modulus grouping, divides all fragment datas equally to each processing thread, to ensure as each processing
The quantity of the fragment data of thread distribution is almost the same, and limited processing thread is made full use of to unload all fragment datas
Processing.
Conversely, if the quantity of fragment data is less than the preset quantity, illustrates that the fragment data for needing to unload is less, be not necessarily to
Unloading processing is carried out to fragment data using multiple processing threads, these fragment datas are unloaded i.e. using individual processing thread
Can, avoid waste process resource.
It should be noted that above-mentioned preset quantity can be set according to actual conditions, can be incited somebody to action according to process experience
Preset quantity is set as 100,000, it is of course also possible to which it is other values that preset quantity, which is arranged, according to actual conditions, herein not to present count
Amount does any specific restriction.
It should be noted that while carrying out processing acquisition fragment uninstall file to fragment data using processing thread, place
Lineation journey can also export unloaded state, which corresponds to this unloading processing procedure, can be with according to the unloaded state
Determine this time whether unloading processing procedure is normal.It, can if determining that this time unloading processing procedure is abnormal according to the unloaded state
It, can be by checking that processing daily record abnormal unloads this after user receives alarm notification to make corresponding alarm notification
It carries processing procedure to be analyzed, the abnormal reason of analysis this time unloading processing, and then corresponding place is made according to the abnormal cause
Reason measure.
Step 104：After the corresponding fragment uninstall file of each fragment data to be obtained, published article is unloaded according to the fragment
The arrangement serial number of part merges the fragment uninstall file and obtains uninstall file.
Unloading is carried out using processing thread to fragment data to handle to obtain uninstall file, pending thread is to all fragment numbers
According to having handled, after obtaining fragment uninstall file corresponding with each fragment data, according to the arrangement of each fragment uninstall file
Serial number merges each fragment uninstall file, obtains uninstall file corresponding with data to be unloaded, which is general lattice
The file of formula.
Data unloading method provided by the embodiments of the present application carries out fragment to data to be unloaded, and according to the number to be unloaded
According to primitive form, to fragment obtain each fragment data accordingly mark arrangement serial number, correspondingly, using handle thread unload
Can also be each fragment according to the arrangement serial number of each fragment data after load processing fragment data obtains fragment uninstall file
Uninstall file marks corresponding arrangement serial number.It in turn, can be by after obtaining the corresponding fragment uninstall file of all fragment datas
Each fragment uninstall file is merged according to the arrangement serial number of each fragment uninstall file, to obtain complete uninstall file.Due to
The uninstall file obtains, therefore, the uninstall file and data to be unloaded by each fragment uninstall file by putting in order to merge
Primitive form it is completely corresponding, in turn, in the subsequent load uninstall file, without being limited by particular load tool, use
Any loading tool can load the uninstall file of the general format.
For the ease of further understanding scheme provided by the present application, with reference to practical application scene to above-mentioned load shedding
Method carries out the introduction of globality.
Referring to Fig. 2, Fig. 2 provides the process chart of another data unloading method for the embodiment of the present application.
Parameter configuration master control receives user name input by user and login password, to the user name and login password into
Row verification, if being verified, allows user's log database, user to be obtained from database by input data name to be unloaded
Data.In addition, the parameter configuration master control can also configure the parameter of Unloading path, unloading manner, to unload number to be unloaded
According to when, obtain the parameter of Unloading path and unloading manner, unloaded according to the parameter of the Unloading path and unloading manner
Processing.
After parameter configuration master control gets data to be unloaded, starts asynchronous schedule master control, treated using asynchronous schedule master control
It unloads data and carries out fragment, obtain each fragment data corresponding with data to be unloaded, and according to the original of the data to be unloaded
Beginning form is ranked up each fragment data and marks the arrangement serial number of each fragment data.
In turn, judge whether the quantity for the fragment data that fragment data to be unloaded obtain is more than preset quantity 100,000, if small
In preset quantity, then starts individually processing thread and unloading processing is carried out to fragment data, obtain corresponding with each fragment data
Fragment uninstall file, and mark corresponding with fragment data arrangement serial number for each fragment uninstall file；If more than present count
Amount, then start the processing thread of configuration, carry out unloading processing to each fragment data using preconfigured processing thread, obtain
Fragment uninstall file corresponding with each fragment data, and mark arrangement corresponding with fragment data for each fragment uninstall file
Serial number.
Asynchronous schedule master control judges whether all each fragment unloading data complete by unloading, if each fragment data has all unloaded
At then according to the arrangement serial number of each fragment uninstall file, merging the corresponding fragment uninstall file of each fragment data and unloaded
Published article part；It is asynchronous to wait at the unloading to each fragment data if not completing the unloading to each fragment data to handle
Reason, until all unloadings completed to all fragment datas are handled, after obtaining the corresponding fragment uninstall file of each fragment data,
According to the arrangement serial number of each fragment uninstall file, merge each fragment uninstall file.
It is the knot of load shedding device 300 referring to Fig. 3, Fig. 3 in addition, present invention also provides a kind of load shedding device
Structure schematic diagram, the load shedding device 300 include：
Fragment module 301 obtains each point corresponding with the data to be unloaded for carrying out fragment to data to be unloaded
Sheet data；
Sorting module 302 arranges each fragment data for the primitive form according to the data to be unloaded
Sequence, and mark corresponding arrangement serial number for each fragment data；
Unload module 303 obtains the fragment data pair for being handled the fragment data using processing thread
The arrangement serial number of the fragment uninstall file answered, the fragment uninstall file is corresponding with the arrangement serial number of the fragment data；
Merging module 304, after the corresponding fragment uninstall file of each fragment data to be obtained, according to described point
The arrangement serial number of piece uninstall file merges the fragment uninstall file and obtains uninstall file.
Optionally, the Unload module 303 is specifically used for：
Judge whether the quantity of the fragment data is more than preset quantity；
If the quantity of the fragment data is more than the preset quantity, according to the quantity of the processing thread of configuration and
The quantity of the fragment data is each fragment data matching treatment thread；
Utilize fragment data described in the matched processing thread process of institute；
If the quantity of the fragment data is less than the preset quantity, using the individual processing thread to the fragment
Data are handled.
Optionally, described device further includes：
Configuration module, the parameter for configuring Unloading path and unloading manner, the Unloading path is for characterizing described point
The storage location of piece uninstall file, the unloading manner are used to characterize the processing mode of the processing thread.
Optionally, described device further includes：
Acquisition module, for obtaining the data to be unloaded from database.
Optionally, the acquisition module is specifically used for：
User name input by user and login password are verified；
If being verified, according to the data name input by user, obtains corresponding described wait unloading from the database
Carry data.
Load shedding device provided by the embodiments of the present application carries out fragment to data to be unloaded, and according to the number to be unloaded
According to primitive form, to fragment obtain each fragment data accordingly mark arrangement serial number, correspondingly, using handle thread unload
Can also be each fragment according to the arrangement serial number of each fragment data after load processing fragment data obtains fragment uninstall file
Uninstall file marks corresponding arrangement serial number.It in turn, can be by after obtaining the corresponding fragment uninstall file of all fragment datas
Each fragment uninstall file is merged according to the arrangement serial number of each fragment uninstall file, to obtain complete uninstall file.Due to
The uninstall file obtains, therefore, the uninstall file and data to be unloaded by each fragment uninstall file by putting in order to merge
Primitive form it is completely corresponding, in turn, in the subsequent load uninstall file, without being limited by particular load tool, use
Any loading tool can load the uninstall file of the general format.
It should be noted that each embodiment in this specification is described in a progressive manner, each embodiment it
Between just to refer each other for identical similar part, each embodiment focuses on the differences from other embodiments.
For equipment and system embodiment, since it is substantially similar to the method embodiment, so describe fairly simple,
The relevent part can refer to the partial explaination of embodiments of method.Equipment and system embodiment described above is only schematic
, wherein may or may not be physically separated as the unit that separating component illustrates, shown as unit
Component may or may not be physical unit, you can be located at a place, or may be distributed over multiple networks
On unit.Some or all of module therein can be selected according to the actual needs to achieve the purpose of the solution of this embodiment.
Those of ordinary skill in the art are without creative efforts, you can to understand and implement.
The above, only a kind of specific implementation mode of the application, but the protection domain of the application is not limited thereto,
Any one skilled in the art is in the technical scope that the application discloses, the change or replacement that can be readily occurred in,
It should all cover within the protection domain of the application.Therefore, the protection domain of the application should be with scope of the claims
Subject to.
Claims (10)
1. a kind of data unloading method, which is characterized in that the method includes：
Fragment is carried out to data to be unloaded, obtains each fragment data corresponding with the data to be unloaded；
According to the primitive form of the data to be unloaded, each fragment data is ranked up, and is each fragment
Data mark corresponding arrangement serial number；
The fragment data is handled using processing thread, obtains the corresponding fragment uninstall file of the fragment data, institute
The arrangement serial number for stating fragment uninstall file is corresponding with the arrangement serial number of the fragment data；
After the corresponding fragment uninstall file of each fragment data to be obtained, according to the arrangement sequence of the fragment uninstall file
Number, merge the fragment uninstall file and obtains uninstall file.
2. according to the method described in claim 1, it is characterized in that, it is described using the processing thread to the fragment data into
Row processing, obtains the corresponding fragment uninstall file of the fragment data, including：
Judge whether the quantity of the fragment data is more than preset quantity；
If the quantity of the fragment data is more than the preset quantity, according to the quantity of the processing thread of configuration and described
The quantity of fragment data is each fragment data matching treatment thread；
Utilize fragment data described in the matched processing thread process of institute；
If the quantity of the fragment data is less than the preset quantity, using the individual processing thread to the fragment data
It is handled.
3. according to the method described in claim 1, it is characterized in that, carrying out fragment, acquisition and institute to data to be unloaded described
Before stating the corresponding each fragment data of data to be unloaded, the method further includes：
The parameter of Unloading path and unloading manner is configured, the Unloading path is used to characterize the storage position of the fragment uninstall file
It sets, the unloading manner is used to characterize the processing mode of the processing thread.
4. according to the method described in claim 1, it is characterized in that, carrying out fragment, acquisition and institute to data to be unloaded described
Before stating the corresponding each fragment data of data to be unloaded, the method further includes：
The data to be unloaded are obtained from database.
5. according to the method described in claim 4, it is characterized in that, described obtain the number to be unloaded from the database
According to, including：
User name input by user and login password are verified；
If being verified, according to the data name input by user, the corresponding number to be unloaded is obtained from the database
According to.
6. a kind of load shedding device, which is characterized in that described device includes：
Fragment module obtains each fragment data corresponding with the data to be unloaded for carrying out fragment to data to be unloaded；
Sorting module is ranked up each fragment data, and be for the primitive form according to the data to be unloaded
Each fragment data marks corresponding arrangement serial number；
Unload module obtains corresponding point of the fragment data for being handled the fragment data using processing thread
The arrangement serial number of piece uninstall file, the fragment uninstall file is corresponding with the arrangement serial number of the fragment data；
Merging module unloads after the corresponding fragment uninstall file of each fragment data to be obtained according to the fragment
The arrangement serial number of file merges the fragment uninstall file and obtains uninstall file.
7. device according to claim 6, which is characterized in that the Unload module is specifically used for：
Judge whether the quantity of the fragment data is more than preset quantity；
If the quantity of the fragment data is more than the preset quantity, according to the quantity of the processing thread of configuration and described
The quantity of fragment data is each fragment data matching treatment thread；
Utilize fragment data described in the matched processing thread process of institute；
If the quantity of the fragment data is less than the preset quantity, using the individual processing thread to the fragment data
It is handled.
8. device according to claim 6, which is characterized in that described device further includes：
Configuration module, the parameter for configuring Unloading path and unloading manner, the Unloading path are unloaded for characterizing the fragment
The storage location of published article part, the unloading manner are used to characterize the processing mode of the processing thread.
9. device according to claim 6, which is characterized in that described device further includes：
Acquisition module, for obtaining the data to be unloaded from database.
10. device according to claim 9, which is characterized in that the acquisition module is specifically used for：
User name input by user and login password are verified；
If being verified, according to the data name input by user, the corresponding number to be unloaded is obtained from the database
According to.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810497359.2A CN108763403A (en) | 2018-05-22 | 2018-05-22 | A kind of data unloading method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810497359.2A CN108763403A (en) | 2018-05-22 | 2018-05-22 | A kind of data unloading method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108763403A true CN108763403A (en) | 2018-11-06 |
Family
ID=64004776
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810497359.2A Pending CN108763403A (en) | 2018-05-22 | 2018-05-22 | A kind of data unloading method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108763403A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114168078A (en) * | 2021-12-09 | 2022-03-11 | 中国建设银行股份有限公司 | Data unloading method, device, system, equipment and medium |
| CN115086453A (en) * | 2022-07-06 | 2022-09-20 | 中国人民银行清算总中心 | Data exchange method, device and system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101556589A (en) * | 2008-04-09 | 2009-10-14 | 北京闻言科技有限公司 | Method for Oracle regularly deleting stale data in database |
| CN104731888A (en) * | 2015-03-12 | 2015-06-24 | 北京奇虎科技有限公司 | Data migration method, device and system |
| CN105183854A (en) * | 2015-09-08 | 2015-12-23 | 浪潮(北京)电子信息产业有限公司 | Scheduling method applicable to data unloading of database |
| US20160078113A1 (en) * | 2014-07-15 | 2016-03-17 | International Business Machines Corporation | Validating code of an extract, transform and load (etl) tool |
| CN105653731A (en) * | 2016-02-02 | 2016-06-08 | 厦门市美亚柏科信息股份有限公司 | Method for restoring deleted data of journaling file system |
| CN106126272A (en) * | 2016-06-15 | 2016-11-16 | 北京小米移动软件有限公司 | File system discharging method and device |
| CN106657213A (en) * | 2016-09-14 | 2017-05-10 | 深圳峰创智诚科技有限公司 | File transmission method and device |
| CN107391508A (en) * | 2016-05-16 | 2017-11-24 | 顺丰科技有限公司 | Data load method and system |
-
2018
- 2018-05-22 CN CN201810497359.2A patent/CN108763403A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101556589A (en) * | 2008-04-09 | 2009-10-14 | 北京闻言科技有限公司 | Method for Oracle regularly deleting stale data in database |
| US20160078113A1 (en) * | 2014-07-15 | 2016-03-17 | International Business Machines Corporation | Validating code of an extract, transform and load (etl) tool |
| CN104731888A (en) * | 2015-03-12 | 2015-06-24 | 北京奇虎科技有限公司 | Data migration method, device and system |
| CN105183854A (en) * | 2015-09-08 | 2015-12-23 | 浪潮(北京)电子信息产业有限公司 | Scheduling method applicable to data unloading of database |
| CN105653731A (en) * | 2016-02-02 | 2016-06-08 | 厦门市美亚柏科信息股份有限公司 | Method for restoring deleted data of journaling file system |
| CN107391508A (en) * | 2016-05-16 | 2017-11-24 | 顺丰科技有限公司 | Data load method and system |
| CN106126272A (en) * | 2016-06-15 | 2016-11-16 | 北京小米移动软件有限公司 | File system discharging method and device |
| CN106657213A (en) * | 2016-09-14 | 2017-05-10 | 深圳峰创智诚科技有限公司 | File transmission method and device |
Non-Patent Citations (1)
| Title |
|---|
| 胡剑星: "城市商业银行Informix数据库备份与恢复方案", 《中国金融电脑》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114168078A (en) * | 2021-12-09 | 2022-03-11 | 中国建设银行股份有限公司 | Data unloading method, device, system, equipment and medium |
| CN115086453A (en) * | 2022-07-06 | 2022-09-20 | 中国人民银行清算总中心 | Data exchange method, device and system |
| CN115086453B (en) * | 2022-07-06 | 2024-03-26 | 中国人民银行清算总中心 | Data exchange method, device and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108600029B (en) | Configuration file updating method and device, terminal equipment and storage medium | |
| CN109814910A (en) | Automate gray scale dissemination method, device, computer system and storage medium | |
| CN107832126A (en) | The method of adjustment and its terminal of a kind of thread | |
| CN108287751A (en) | Task executing method and device, distributed system | |
| CN108234134A (en) | Block synchronous method and system | |
| CN108763403A (en) | A kind of data unloading method and device | |
| CN109408262A (en) | A kind of business data processing method and relevant device | |
| CN113051019A (en) | Flow task execution control method, device and equipment | |
| CN106233210A (en) | Dynamic and configurable production line and/or distribution line control system and for its method | |
| CN106383764A (en) | Data acquisition method and device | |
| CN108763089A (en) | A kind of test method, apparatus and system | |
| CN104462420B (en) | The execution method and apparatus of the query task of database | |
| EP2933726A1 (en) | Apparatus, system and method for application log data processing | |
| CN107404540A (en) | The synchronous method and device of data | |
| CN106844055A (en) | A kind of execution method and apparatus of task | |
| CN107491374A (en) | A kind of determination methods and computing device of equipment downtime state | |
| CN107704331A (en) | Electrical equipment fault analyzes and processes householder method and device | |
| CN108376110A (en) | A kind of automatic testing method, system and terminal device | |
| CN108156597A (en) | A kind of bluetooth equipment and its test method | |
| CN111142929A (en) | Firmware configuration method, device, equipment and medium in equipment production process | |
| CN106776728A (en) | Code check method, system and development platform based on log file analysis | |
| CN110069277A (en) | Using loading method, using online equipment, storage medium and device | |
| CN110940874A (en) | Calibration method, server and medium for nuclear power station transformer protection device | |
| CN110297754A (en) | A kind of test information feedback method and system | |
| CN113540526B (en) | Fuel cell fault diagnosis method and system based on historical data analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181106 |
|
| RJ01 | Rejection of invention patent application after publication |