CN107193710A - One kind realizes self-defining data assemblage method and device based on storing process - Google Patents
One kind realizes self-defining data assemblage method and device based on storing process Download PDFInfo
- Publication number
- CN107193710A CN107193710A CN201710384367.1A CN201710384367A CN107193710A CN 107193710 A CN107193710 A CN 107193710A CN 201710384367 A CN201710384367 A CN 201710384367A CN 107193710 A CN107193710 A CN 107193710A
- Authority
- CN
- China
- Prior art keywords
- data
- converged
- storing process
- scheduler program
- process scheduler
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Self-defining data assemblage method and device are realized based on storing process the invention provides one kind, this method includes：At least two storing process scheduler programs are set, wherein, the at least two storing process scheduler program corresponds to different cycle and grade respectively, and the corresponding grade of the storing process scheduler program storing process scheduler program corresponding grade short higher than the cycle of cycle length；It is performed both by for storing process scheduler program each described：When it is determined that current time reaches presently described storing process scheduler program corresponding Period Start Time, each data to be converged is converged using presently described storing process scheduler program, wherein, data to be converged described in each include：The data of the storing process scheduler program convergence of a grade lower than presently described storing process scheduler program.Therefore, the scheme that the present invention is provided can improve the efficiency of convergence.
Description
Technical field
The present invention relates to field of computer technology, more particularly to one kind realizes self-defining data convergence side based on storing process
Method and device.
Background technology
More prevalent with Network Information, the data of each enterprise are also into volatile increase.Each enterprise in order to
The management of specification its data, it will usually be managed collectively convergence together.
At present, convergence is generally manually completed by data management staff.Such as, after a work end of day, by data
The data that the working day is related to and produces are gathered together by administrative staff manually.When the data volume that the working day produces is huge
When, data management staff's substantial amounts of time will be expended during convergence.
It can be seen that, existing mode, convergence needs data management staff to manually complete, therefore, the efficiency of convergence
It is relatively low.
The content of the invention
Self-defining data assemblage method and device are realized based on storing process the invention provides one kind, data can be improved
Sink-efficiency.
In a first aspect, realizing self-defining data assemblage method, this method bag based on storing process the invention provides one kind
Include：
At least two storing process scheduler programs are set, wherein, at least two storing process scheduler program is right respectively
Answer different cycle and grade, and described short higher than the cycle of the corresponding grade of the storing process scheduler program of cycle length is deposited
Store up the corresponding grade of process scheduling program；
It is performed both by for storing process scheduler program each described：It is determined that current time reaches presently described stored
During the corresponding Period Start Time of journey scheduler program, each number to be converged is converged using presently described storing process scheduler program
According to, wherein, data to be converged described in each include：The storage of a grade lower than presently described storing process scheduler program
The data of process scheduling program convergence.
Preferably,
Before each data to be converged is converged using presently described storing process scheduler program, further comprise：
Whether judge presently described storing process scheduler program is the storing process scheduler program positioned at the lowest class,
If it is, converging quantity set in advance from outside database using presently described storing process scheduler program
Individual target data.
Preferably,
Further comprise：For the corresponding cycle of storing process schedulers each described set the first amount threshold and
Time threshold；
It is described to converge each data to be converged using presently described storing process scheduler program, including：
It is performed both by for data to be converged described in each：When presently described when convergence data do not converge completion, convergence
The duration of presently described data to be converged reaches the time threshold, then gives up presently described data to be converged, and ought
The corresponding title of preceding data converge, which writes, to be treated in amended record file；When presently described when convergence completion is converged, converge
The duration for gathering presently described data to be converged is not up to the time threshold, then continues to converge next number to be converged
According to；
It is determined that the data to be converged and the total number of the data to be converged of convergence given up, when it is determined that described total
When number reaches first amount threshold, then each data knot to be converged is converged using presently described storing process scheduler program
Beam.
Preferably,
It is described the corresponding title write-in of presently described data to be converged is treated in amended record file after, further comprise：
It is determined that the quantity for treating title in amended record file；
When it is determined that the data reach the second amount threshold set in advance, alarm.
Preferably,
Described when it is determined that the total number reaches the amount threshold, then journey is dispatched using presently described storing process
Sequence is converged after each end of data to be converged, and is further comprised：
The corresponding title of the data to be converged according to treating in amended record file, it is determined that the data to be converged given up；
Obtain the data to be converged given up；
Data to be converged described in acquisition are forced to converge to each institute of presently described storing process scheduler program convergence
State in data to be converged.
Preferably,
At least two storing process scheduler program, including：Minute storing process scheduler program, hour storing process are adjusted
Degree program, day storing process scheduler program, all storing process scheduler programs, moon storing process scheduler program, season storing process
At least two or a variety of in scheduler program and year storing process scheduler program.
Second aspect, realizes self-defining data converging device, the device bag the invention provides one kind based on storing process
Include：
Setting unit, for setting at least two storing process scheduler programs, wherein, at least two storing process is adjusted
Degree program corresponds to different cycle and grade respectively, and cycle length the corresponding grade of the storing process scheduler program higher than week
The phase short corresponding grade of the storing process scheduler program；
Unit is converged, for being performed both by for storing process scheduler program each described：It is determined that current time reaches
During the corresponding Period Start Time of presently described storing process scheduler program, the convergence of presently described storing process scheduler program is utilized
Each data to be converged, wherein, data to be converged described in each include：Than presently described low one of storing process scheduler program etc.
The data of the storing process scheduler program convergence of level.
Preferably,
Further comprise：Judging unit；
The judging unit, for judging whether presently described storing process scheduler program is positioned at described in the lowest class
Storing process scheduler program, if it is, being converged in advance from outside database using presently described storing process scheduler program
The quantity target data of setting.
Preferably,
Further comprise：Threshold setting unit；
The threshold setting unit, for setting first to count for the corresponding cycle of storing process schedulers each described
Measure threshold value and time threshold；
The convergence unit, is further used for being performed both by for data to be converged described in each：Wait to converge when presently described
When poly- data do not converge completion, the duration for converging presently described data to be converged reaches the time threshold, then gives up and work as
Preceding data converge, and the corresponding title of presently described data to be converged is write treated in amended record file；When presently described
When converging convergence and completing, the duration for converging presently described data to be converged is not up to the time threshold, then after
The continuous next data to be converged of convergence；It is determined that data converge given up and convergence described in data to be converged it is total
Number, when it is determined that the total number reaches first amount threshold, is then converged using presently described storing process scheduler program
Gather each end of data to be converged.
Preferably,
Further comprise：Alarm unit；
The alarm unit, for determining the quantity for treating title in amended record file；When it is determined that the data reach it is pre-
During the second amount threshold first set, alarm.
Preferably,
Further comprise：Amended record unit；
The amended record unit, for the corresponding title of data to be converged according to treating in amended record file, it is determined that giving up
The data to be converged；Obtain the data to be converged given up；Data to be converged described in acquisition are forced to converge to and worked as
In data to be converged described in each of the preceding storing process scheduler program convergence.
Self-defining data assemblage method and device are realized based on storing process the embodiments of the invention provide one kind, set extremely
Few two kinds of storing process scheduler programs, and various storing process scheduler programs correspond to different cycle and grade respectively, wherein week
The corresponding grade of storing process scheduler program of the phase length storing process scheduler program corresponding grade short higher than the cycle.Then it is every
A kind of storing process scheduler program is adjusted when it is determined that current time reaches its corresponding Period Start Time using the storing process
Degree program converges each data of the storing process scheduler program convergence of a grade lower than it.Pass through above-mentioned, this programme
There is provided at least two storing process scheduler programs, and when the time reaches that each storing process scheduler program corresponding cycle starts
During the time, each number that each storing process scheduler program converges the storing process scheduler program converged than a low grade
According to not manually progress convergence operation.Therefore, the scheme that the present invention is provided can improve the efficiency of convergence.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are the present invention
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
These accompanying drawings obtain other accompanying drawings.
Fig. 1 is a kind of stream that self-defining data assemblage method is realized based on storing process that one embodiment of the invention is provided
Cheng Tu；
Fig. 2 is that a kind of of another embodiment of the present invention offer realizes self-defining data assemblage method based on storing process
Flow chart；
Fig. 3 be one embodiment of the invention provide equipment where self-defining data converging device is realized based on storing process
A kind of hardware structure diagram；
Fig. 4 is a kind of knot that self-defining data converging device is realized based on storing process that one embodiment of the invention is provided
Structure schematic diagram；
Fig. 5 is that a kind of of one embodiment of the invention offer realizes self-defined number including judging unit based on storing process
According to the structural representation of converging device；
Fig. 6 is that a kind of realized including threshold setting unit based on storing process that one embodiment of the invention is provided is made by oneself
The structural representation of adopted convergence device；
Fig. 7 is that a kind of of one embodiment of the invention offer realizes self-defined number including alarm unit based on storing process
According to the structural representation of converging device；
Fig. 8 is that a kind of of one embodiment of the invention offer realizes self-defined number including amended record unit based on storing process
According to the structural representation of converging device.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
A part of embodiment of the present invention, rather than whole embodiments, based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained on the premise of creative work is not made, belongs to the scope of protection of the invention.
As shown in figure 1, self-defining data assemblage method is realized based on storing process the embodiments of the invention provide one kind, should
Method may comprise steps of：
Step 101：At least two storing process scheduler programs are set, wherein, at least two storing process dispatches journey
Sequence corresponds to different cycle and grade respectively, and the corresponding grade of the storing process scheduler program of cycle length is short higher than the cycle
The corresponding grade of the storing process scheduler program；
Step 102：Successively at least two storing process scheduler program, a kind of storing process scheduling is selected
Program is used as presently described storing process scheduler program；
Step 103：It is determined that current time reaches the corresponding Period Start Time of presently described storing process scheduler program
When, each data to be converged is converged using presently described storing process scheduler program, wherein, packet to be converged described in each
Include：The data of the storing process scheduler program convergence of a grade lower than presently described storing process scheduler program.
Step 104：Whether judge presently described storing process scheduler program is last described storing process scheduling journey
Sequence, if it is, terminating current process；Otherwise, step 102 is performed.
According to embodiment illustrated in fig. 1, at least two storing process scheduler programs, and various storing process scheduler programs are set
Different cycle and grade are corresponded to respectively, and wherein the corresponding grade of storing process scheduler program of cycle length is short higher than the cycle deposits
Store up the corresponding grade of process scheduling program.Then each storing process scheduler program is it is determined that current time reaches that its is corresponding
During Period Start Time, the storing process scheduler program for converging a grade lower than it using the storing process scheduler program is converged
Each data.By above-mentioned, this programme is provided with least two storing process scheduler programs, and when the time reach each
During the corresponding Period Start Time of storing process scheduler program, each storing process scheduler program will be converged than a low grade
Each data of storing process scheduler program convergence, convergence operation is not carried out manually.Therefore, the reality that the present invention is provided
The efficiency of convergence can be improved by applying example.
In an embodiment of the invention, at least two storing involved by step 101 in flow chart shown in above-mentioned Fig. 1
Journey scheduler program can include：Minute storing process scheduler program, hour storing process scheduler program, day storing process scheduling journey
Sequence, all storing process scheduler programs, moon storing process scheduler program, season storing process scheduler program and year storing process are adjusted
At least two or a variety of in degree program.
In the present embodiment, the species and quantity of storing process scheduler program can be determined according to business need.Wherein
Minute storing process scheduler program, hour storing process scheduler program, day storing process scheduler program, all storing process scheduling journeys
Sequence, moon storing process scheduler program, season storing process scheduler program and year storing process scheduler program are storing process
Scheduler program preferred kind, can also select other species according to business need.
In the present embodiment, each storing process scheduler program corresponding cycle and grade can be according to business needs
It is determined that.But it should be noted that various storing process scheduler programs need to correspond to different cycles and grade respectively.Such as there is provided
Minute storing process scheduler program, hour storing process scheduler program, day storing process scheduler program.It is provided with minute storage
The process scheduling program corresponding cycle is 10 minutes, sets the hour storing process scheduler program corresponding cycle to be 1 hour, setting
Its storing process scheduler program corresponding cycle is 24 hours.It is high according to the corresponding grade of the storing process scheduler program of cycle length
In the requirement of the cycle short corresponding grade of storing process scheduler program, it is minimum that minute storing process scheduler program is arranged on grade
The first estate, hour storing process scheduler program is arranged on the second placed in the middle grade of grade, and day storing process scheduler program is set
Put in the grade highest tertiary gradient.
According to above-described embodiment, storing process scheduler program can select minute storing process to dispatch journey according to business need
Sequence, hour storing process scheduler program, day storing process scheduler program, all storing process scheduler programs, moon storing process scheduling
At least two or a variety of in program, season storing process scheduler program and year storing process scheduler program.Due to storing
Journey scheduler program can flexibly be selected according to business need, therefore business is with strong applicability.
In an embodiment of the invention, in flow chart shown in Fig. 1 involved by step 103 the presently described storage of utilization
Process scheduling program is converged before each data to be converged, and may further include：
Whether judge presently described storing process scheduler program is the storing process scheduler program positioned at the lowest class,
If it is, converging quantity set in advance from outside database using presently described storing process scheduler program
Individual target data.
In the present embodiment, due to being elementary storing process scheduler program when currently stored process scheduling program
When, currently stored process scheduling program is the storing process scheduler program in the absence of a low grade.Therefore can not be to low one
Each data to be converged of the storing process scheduler program convergence of grade are converged.
In the present embodiment, such as, currently stored process scheduling program is minute storing process scheduler program, determines that it is
Positioned at the storing process scheduler program of the lowest class, then it is determined that current time reaches that minute storing process scheduler program is corresponding
During Period Start Time, quantity target data set in advance is converged from outside database.And for example, currently stored process
Scheduler program is hour storing process scheduler program, determines its storing process scheduler program for being not located at the lowest class, then exists
When determining that current time reaches the corresponding Period Start Time of minute storing process scheduler program, the scheduling of hour storing process is utilized
Each data of the minute storing process scheduler program convergence of a program grade lower than it.
According to above-described embodiment, need to sentence before each data to be converged is converged using currently stored process scheduling program
Whether currently stored process scheduling program of breaking is storing process scheduler program positioned at the lowest class, and entered according to the result of judgement
The different convergence operation of row.
In an embodiment of the invention, it is described to realize that self-defining data assemblage method be further based on storing process
Including step：For the corresponding cycle of storing process schedulers each described, the first amount threshold and time threshold are set；
The presently described storing process scheduler program convergence of utilization then in flow chart shown in above-mentioned Fig. 1 involved by step 103
Each data to be converged, can include：
It is performed both by for data to be converged described in each：When presently described when convergence data do not converge completion, convergence
The duration of presently described data to be converged reaches the time threshold, then gives up presently described data to be converged, and ought
The corresponding title of preceding data converge, which writes, to be treated in amended record file；When presently described when convergence completion is converged, converge
The duration for gathering presently described data to be converged is not up to the time threshold, then continues to converge next number to be converged
According to；
It is determined that the data to be converged and the total number of the data to be converged of convergence given up, when it is determined that described total
When number reaches first amount threshold, then each data knot to be converged is converged using presently described storing process scheduler program
Beam.
In the present embodiment, the first amount threshold and time threshold can be determined according to business need, such as, minute
The storing process schedulers corresponding cycle is 10 minutes, sets that the first amount threshold is 68 and time threshold is 5 minutes.
In the present embodiment, each is converged when data are converged in minute storing process scheduler program, such as waiting to converge
Poly- data 1 are performed：When convergence data 1 do not converge completion, 5 minutes duration for converging data 1 to be converged reach the time
Threshold value 5 minutes, then give up data 1 to be converged, and the corresponding write-in of title 001 of data 1 to be converged is treated in amended record file.For
Data 2 to be converged are performed：When the convergence completion of data 2 is converged, 3 minutes duration of data 2 to be converged are converged not up to
Time threshold 5 minutes, then continue to converge next data to be converged.Then when it is determined that the data to be converged given up and treating for converging
When the total number of convergence data reaches the first amount threshold 68, each number to be converged is converged using minute storing process scheduler program
According to end.
According to above-described embodiment, each is converged when data are converged in currently stored process scheduling program, it is thus necessary to determine that when
Before convergence duration of data to be converged whether reach default time threshold, if reaching time threshold, illustrate convergence
It is current to there is problem when data are converged, currently wait to converge, it is necessary to give up to not influence the convergence of next data to be converged
Data.And treat the corresponding title write-in of currently data to be converged in amended record file.By above-mentioned, it will be deposited during for convergence
In the rejection of data to be converged of problem, therefore reduce the possibility for convergence interruption occur.
In an embodiment of the invention, the corresponding title write-in of presently described data to be converged treated into amended record text described
After in part, it may further include：
It is determined that the quantity for treating title in amended record file；
When it is determined that the data reach the second amount threshold set in advance, alarm.
In the present embodiment, it is necessary to enter one after the corresponding title write-in of currently data to be converged is treated in amended record file
Step determines to treat that amended record file has been written into the quantity of title.Judge whether the quantity determined reaches the second quantity threshold set in advance
Value, when it is determined that data reach the second amount threshold, illustrates the overabundance of data not converged, it is understood that there may be currently stored process scheduling
The possibility of program operation exception, it is therefore desirable to alarm, with informing business personnel, so that business personnel excludes exception in time, so that
Ensure that storing process scheduler program can normally be run.When it is determined that data are not up to the second amount threshold, then explanation was stored
Journey scheduler program is normally run.
In the present embodiment, the second amount threshold can be determined according to business need, such as 10.
According to above-described embodiment, it is necessary to enter after the corresponding title write-in of currently data to be converged is treated in amended record file
One step determines to treat the quantity of title in amended record file, when it is determined that the data of title reach amount threshold set in advance, alarm.
So that business personnel excludes abnormal conditions in time according to alarm, to ensure that storing process scheduler program can normally be run.
In an embodiment of the invention, then utilized when it is determined that the total number reaches the amount threshold described
Presently described storing process scheduler program is converged after each end of data to be converged, and is further comprised：
The corresponding title of the data to be converged according to treating in amended record file, it is determined that the data to be converged given up；
Obtain the data to be converged given up；
Data to be converged described in acquisition are forced to converge to each institute of presently described storing process scheduler program convergence
State in data to be converged.
In the present embodiment, the integrality of the data to be converged converged for storing process scheduler program, using currently
Storing process scheduler program is converged after each end of data to be converged, it is necessary to according to the data pair to be converged treated in amended record file
The title answered, it is determined that each data to be converged given up.Then each data to be converged given up are got, then by each of acquisition
Individual data to be converged force to converge in each data to be converged of currently stored process scheduling program convergence.
In the present embodiment, such as storing process scheduler program converges minute of a level lower than it and stored when small
After each data to be converged of journey scheduler program convergence, according to the corresponding title A01 of the data to be converged treated in amended record file,
It is determined that the data to be converged given up are data A to be converged, then data A to be converged is obtained.Then data A to be converged is forced into convergence
In each data to be converged converged to hour storing process scheduler program, so as to ensure a hour storing process scheduler program convergence
The integrality of each data.
According to above-described embodiment, after each end of data to be converged is converged using currently stored process scheduling program,
According to the corresponding title of data to be converged treated in amended record file, it is determined that the data to be converged given up.What then acquisition was given up treats
Data are converged, and data the to be converged pressure of acquisition is converged into each number to be converged that currently stored process scheduling program is converged
In.Due to having carried out forcing convergence to the data to be converged given up, therefore the integrality of convergence data can be heightened.
Below with set minute storing process scheduler program, hour storing process scheduler program, day storing process scheduling journey
Exemplified by sequence.Expansion explanation realizes self-defining data assemblage method based on storing process, as shown in Fig. 2 should be real based on storing process
Existing self-defining data assemblage method, may include steps of：
Step 201：At least two storing process scheduler programs are set, wherein, at least two storing process scheduler programs point
Cycle that Dui Ying be not different and grade, and the corresponding grade of storing process scheduler program of cycle length is higher than cycle short storage
The corresponding grade of journey scheduler program.
In this step, there is provided three kinds of storing process scheduler programs, respectively minute storing process scheduler program, hour
Storing process scheduler program, day storing process scheduler program.Being provided with a minute storing process scheduler program corresponding cycle is
10 minutes, set hour storing process scheduler program corresponding cycle for 1 hour, set day storing process scheduler program corresponding
Cycle is 24 hours.Journey is dispatched according to the storing process that the corresponding grade of storing process scheduler program of cycle length is short higher than the cycle
The requirement of the corresponding grade of sequence, minute storing process scheduler program is arranged on elementary the first estate, hour storing process
Scheduler program is arranged on grade the second grade placed in the middle, and day storing process scheduler program is arranged on the grade highest tertiary gradient.
In this step, setting can be attached with outside database with passage path conf/dispatch.xml, and
Label in the paths<proc></proc>Storage needs the storing process scheduler program title performed.Wherein needed in storage
During the storing process scheduler program title of execution, set in hour storing process scheduler program<parent>Label, according to this
It is individual<parent>Label, in the corresponding Period Start Time of arrival hour storing process scheduler program, execution hour stored
The pro_insert_hourlog of journey scheduler program, and record the cycle in table tbhourlog.In addition, setting minute to store
Process scheduling program (MinuteDispatch), hour storing process scheduler program (HourDispatch), day storing process is adjusted
Degree program (DayDispatch), path is respectively：
/home/inspur/dbOperater/Dispatch/MinuteDispatch
/home/inspur/dbOperater/Dispatch/HourDispatch
/home/inspur/dbOperater/Dispatch/DayDispatch
Step 202：For each storing process schedulers corresponding cycle, the first amount threshold and time threshold are set
Value.
In this step, it is 68 and time threshold to set corresponding first data threshold of minute storing process scheduler program
For 5 minutes.Corresponding first data threshold of setting hour storing process scheduler program is 816 and time threshold is 5 minutes.If
Put that corresponding first data threshold of day storing process scheduler program is 19584 and time threshold is 5 minutes.
In this step, illustrated with minute storing process scheduler program：Can be by the path that is set in step 201
In conf/aabis_PM.xml<delayMinute>3</delayMinute>Label be set time threshold because when
Between threshold value be 5 minutes and the TB_COUNT constant in the Package/aabis_min_dispatch in database
int:=68 and BSC_COUNT constant int:=1 is provided with relation, the numbers of the data to be converged of 68 convergences, and 1 is
Bsc number.Wherein, delayMinute numerical value can not be set more than 5 minutes, because after five points, next five the number of minutes is
Have.Such as 09:What 00 time called is 08:The convergence of 68 data to be converged in 55 cycles.It can in addition contain set<
hourCycleCount>5000</hourCycleCount>Label, with accomplish current time postpone 5000 hours wait converge
Data are in the scope of scheduling.
Step 203：Successively at least two storing process scheduler programs, a kind of storing process scheduler program conduct is selected
Currently stored process scheduling program.
Step 204：Whether judge currently stored process scheduling program is storing process scheduler program positioned at the lowest class,
If it is, performing step 205；Otherwise, step 206 is performed.
In this step, when currently stored process scheduling program is minute storing process scheduler program, then judge that it is
Positioned at the storing process scheduler program of the lowest class, step 205 is performed.
In this step, when currently stored process scheduling program is small, storing process scheduler program or day storing process are adjusted
During degree program, then judge that currently stored process scheduling program is not located at the storing process scheduler program of the lowest class, perform step
Rapid 206.
Step 205：When it is determined that current time reaches currently stored process scheduling program corresponding Period Start Time, profit
Quantity set in advance data to be converged are converged from outside database with presently described storing process scheduler program, and are held
Row step 207.
Step 206：When it is determined that current time reaches currently stored process scheduling program corresponding Period Start Time, profit
Each data to be converged is converged with currently stored process scheduling program, wherein, each data to be converged includes：Than currently stored mistake
The data of the storing process scheduler program convergence of the low grade of journey scheduler program, and perform step 207.
Step 207：Successively in each data to be converged, one data to be converged of selection are used as current data to be converged.
Step 208：Judge whether the convergence state of current data to be converged is normal, if it is, performing step 210, otherwise
Perform step 209.
Step 209：When current when convergence data do not converge completion, the duration of the current data to be converged of convergence reaches
Time threshold, then give up current data to be converged, and the corresponding title write-in of currently data to be converged is treated in amended record file, and
Perform step 213.
In this step, illustrated by taking minute storing process scheduler program as an example.In minute storing process scheduler program
Each is converged when data are converged, is performed such as data 1 to be converged：When convergence data 1 do not converge completion, convergence is treated
5 minutes duration of convergence data 1 reach time threshold 5 minutes, then give up data 1 to be converged, and will 1 pair of data be converged
The write-in of title 001 answered is treated in amended record file, and performs step 213.
Step 210：When presently described when convergence completion is converged, the duration of the current data to be converged of convergence is not
Time threshold is reached, then continues to converge next data to be converged.
In this step, illustrated by taking minute storing process scheduler program as an example.Performed for data 2 to be converged：When
When converging the convergence of data 2 and completing, converge 3 minutes duration not up to time threshold 5 minutes of data 2 converge, then after
The continuous next data to be converged of convergence.
Step 211：Judge whether current data to be converged are last data to be converged, if it is, performing step
212, otherwise perform step 207.
Step 212：It is determined that the total number of the data to be converged given up and the data to be converged of convergence, when it is determined that described total
When number reaches the first amount threshold, then each end of data to be converged is converged using currently stored process scheduling program, and perform
Step 215.
Step 213：It is determined that treating the quantity of title in amended record file.
In this step, it is determined that the quantity for treating title in amended record file is 5.
Step 214：When it is determined that data reach the second amount threshold set in advance, alarm.
In this step, determine that the quantity 5 determined in step 213 is less than the second amount threshold 10, therefore explanation is worked as
Preceding storing process scheduler program normal operation, without alert process.
Step 215：According to the corresponding title of data to be converged treated in amended record file, it is determined that the data to be converged given up.
In this step, according to the corresponding title A01 of the data to be converged treated in amended record file, it is determined that waiting of giving up is converged
Data are data A to be converged.
Step 216：Obtain the data to be converged given up.
In this step, data A to be converged is obtained.
Step 217：Each that the data to be converged of acquisition are forced to converge to currently stored process scheduling program convergence is treated
Converge in data.
In step, the data A to be converged obtained in step 216 data is forced to converge to currently stored process scheduling journey
In each data to be converged of sequence convergence, to ensure the data completion property of currently stored process scheduling program convergence.
Step 218：Whether judge currently stored process scheduling program is last storing process scheduler program, if
It is to terminate current process；Otherwise, step 203 is performed.
As shown in Figure 3, Figure 4, self-defining data convergence dress is realized based on storing process the embodiments of the invention provide one kind
Put.Device embodiment can be realized by software, can also be realized by way of hardware or software and hardware combining.From hardware layer
For face, as shown in figure 3, realizing that self-defining data converging device place is set based on storing process to be provided in an embodiment of the present invention
A kind of standby hardware structure diagram, in addition to the processor shown in Fig. 3, internal memory, network interface and nonvolatile memory,
Equipment in embodiment where device can also generally include other hardware, such as be responsible for the forwarding chip of processing message.With
Exemplified by software is realized, as shown in figure 4, as the device on a logical meaning, being will be non-volatile by the CPU of equipment where it
Property memory in corresponding computer program instructions read in internal memory what operation was formed.The present embodiment provide based on storing
Cheng Shixian self-defining data converging devices, including：
Setting unit 401, for setting at least two storing process scheduler programs, wherein, described at least two stored
Journey scheduler program corresponds to different cycle and grade respectively, and the corresponding grade of the storing process scheduler program of cycle length is high
In the corresponding grade of the storing process scheduler program that the cycle is short；
Unit 402 is converged, for being performed both by for storing process scheduler program each described：It is determined that current time reaches
During Period Start Time corresponding to presently described storing process scheduler program, converged using presently described storing process scheduler program
Gather each data to be converged, wherein, data to be converged described in each include：It is lower than presently described storing process scheduler program one
The data of the storing process scheduler program convergence of grade.
According to embodiment as shown in Figure 4, it should realize that self-defining data converging device included setting single based on storing process
Member and convergence unit.Using setting unit, storing process scheduler program is set, wherein, each storing process scheduler program is right respectively
Answer different cycle and grade, and the corresponding grade of the storing process scheduler program storing process short higher than the cycle of cycle length is adjusted
The corresponding grade of degree program.Then using converging unit it is determined that current time reaches that currently stored process scheduling program is corresponding
During Period Start Time, a grade lower than currently stored process scheduling program is converged using currently stored process scheduling program
The data of storing process scheduler program convergence.By said process, this programme is provided with the scheduling of at least two storing process
Program, and when the time reaching the corresponding Period Start Time of each storing process scheduler program, each storing process scheduling journey
Each data that sequence converges the storing process scheduler program converged than a low grade, convergence behaviour is not carried out manually
Make.Therefore, the embodiment that the present invention is provided can improve the efficiency of convergence.
In an embodiment of the invention, as shown in figure 5, realizing that self-defining data converging device may be used also based on storing process
To further comprise：Judging unit 501；
The judging unit 501, for judging whether presently described storing process scheduler program is positioned at the lowest class
The storing process scheduler program, if it is, being converged using presently described storing process scheduler program from outside database
Quantity target data set in advance.
In an embodiment of the invention, as shown in fig. 6, realizing that self-defining data converging device may be used also based on storing process
To further comprise：Threshold setting unit 601；
The threshold setting unit 601, for setting for the corresponding cycle of storing process schedulers each described
One amount threshold and time threshold；
The convergence unit 402, is further used for being performed both by for data to be converged described in each：Treated when presently described
When convergence data do not converge completion, the duration for converging presently described data to be converged reaches the time threshold, then gives up
Presently described data to be converged, and the corresponding title write-in of presently described data to be converged is treated in amended record file；When current institute
State when convergence completion is converged, the duration for converging presently described data to be converged is not up to the time threshold, then
Continue to converge next data to be converged；It is determined that the data to be converged given up and the data to be converged of convergence
Total number, when it is determined that the total number reaches first amount threshold, then utilizes presently described storing process scheduler program
Converge each end of data to be converged.
In an embodiment of the invention, as shown in fig. 7, realizing that self-defining data converging device may be used also based on storing process
To further comprise：Alarm unit 701；
The alarm unit 701, for determining the quantity for treating title in amended record file；When it is determined that the data reach
During the second amount threshold set in advance, alarm.
In an embodiment of the invention, as shown in figure 8, realizing that self-defining data converging device may be used also based on storing process
To further comprise：Amended record unit 801；
The amended record unit 801, for the corresponding title of data to be converged according to treating in amended record file, it is determined that house
The data to be converged abandoned；Obtain the data to be converged given up；Data to be converged described in acquisition are forced to converge to
In data to be converged described in each of presently described storing process scheduler program convergence.
A kind of computer-readable recording medium is provided in one embodiment of the invention, the computer-readable recording medium includes：Execute instruction, when storage control
Described in the computing device of device processed during execute instruction, the storage control performs real based on storing process described in any of the above-described
Existing self-defining data assemblage method.
A kind of storage control is provided in one embodiment of the invention, the storage control includes：Processor, memory
And bus；The memory is used to store execute instruction；The processor is connected with the memory by the bus；Work as institute
When stating storage control operation, the execute instruction of memory storage described in the computing device, so that the storage control
Device processed performs and realizes self-defining data assemblage method based on storing process described in any of the above-described.
The contents such as the information exchange between each unit, implementation procedure in said apparatus, due to implementing with the inventive method
Example is based on same design, and particular content can be found in the narration in the inventive method embodiment, and here is omitted.
In summary, each embodiment of the invention can at least realize following beneficial effect：
1st, in embodiments of the present invention, at least two storing process scheduler programs, and various storing process scheduling journey are set
Sequence corresponds to different cycle and grade respectively, and the wherein corresponding grade of storing process scheduler program of cycle length is short higher than the cycle
The corresponding grade of storing process scheduler program.Then each storing process scheduler program is it is determined that current time reaches its correspondence
Period Start Time when, the storing process scheduler program for utilizing the storing process scheduler program to converge a grade lower than it converges
Each poly- data.By above-mentioned, this programme is provided with least two storing process scheduler programs, and when the time reaches respectively
During the corresponding Period Start Time of individual storing process scheduler program, each storing process scheduler program will be converged than a low grade
Storing process scheduler program convergence each data, not manually carry out convergence operation.Therefore, the present invention is provided
Embodiment can improve the efficiency of convergence.
2nd, in embodiments of the present invention, storing process scheduler program can select minute storing process to adjust according to business need
Degree program, hour storing process scheduler program, day storing process scheduler program, all storing process scheduler programs, moon storing process
At least two or a variety of in scheduler program, season storing process scheduler program and year storing process scheduler program.Due to depositing
Storage process scheduling program can flexibly be selected according to business need, therefore business is with strong applicability.
3rd, in embodiments of the present invention, needed before each data to be converged is converged using currently stored process scheduling program
Whether judge currently stored process scheduling program is storing process scheduler program positioned at the lowest class, and according to the knot of judgement
Fruit carries out different convergence operations.
4th, in embodiments of the present invention, each is converged when data are converged, it is necessary to really in currently stored process scheduling program
Whether the convergence duration of data to be converged reaches default time threshold before settled, if reaching time threshold, illustrates
Convergence is current to have problem when data are converged, in order to not influence the convergence of next data to be converged currently to be treated, it is necessary to give up
Converge data.And treat the corresponding title write-in of currently data to be converged in amended record file.By above-mentioned, during for convergence
There will be the rejection of data to be converged of problem, therefore reduce the possibility for convergence interruption occur.
5th, in embodiments of the present invention, after the corresponding title write-in of currently data to be converged is treated in amended record file, need
The quantity for treating title in amended record file is further determined that, when it is determined that the data of title reach amount threshold set in advance,
Alarm.So that business personnel excludes abnormal conditions in time according to alarm, to ensure that storing process scheduler program can normally be run.
6th, in embodiments of the present invention, using currently stored process scheduling program converge each end of data to be converged it
Afterwards, according to the corresponding title of data to be converged treated in amended record file, it is determined that the data to be converged given up.Then obtain what is given up
Data to be converged, and the data to be converged of acquisition are forced to converge to currently stored process scheduling program convergence each wait to converge
In data.Due to having carried out forcing convergence to the data to be converged given up, therefore the integrality of convergence data can be heightened.
7th, in embodiments of the present invention, should based on storing process realize self-defining data converging device include setting unit with
Converge unit.Using setting unit, storing process scheduler program is set, wherein, each storing process scheduler program is corresponded to not respectively
Same cycle and grade, and the corresponding grade of storing process scheduler program of cycle length is higher than cycle short storing process scheduling journey
The corresponding grade of sequence.Then using converging unit it is determined that current time reaches the currently stored process scheduling program corresponding cycle
During the time started, the storage of a grade lower than currently stored process scheduling program is converged using currently stored process scheduling program
The data of process scheduling program convergence.By said process, this programme is provided with least two storing process scheduler programs,
And when the time reaching the corresponding Period Start Time of each storing process scheduler program, each storing process scheduler program will converge
Each data that the poly- storing process scheduler program than a low grade is converged, convergence operation is not carried out manually.Cause
This, the embodiment that the present invention is provided can improve the efficiency of convergence.
It should be noted that herein, such as first and second etc relational terms are used merely to an entity
Or operation makes a distinction with another entity or operation, and not necessarily require or imply exist between these entities or operation
Any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant be intended to it is non-
It is exclusive to include, so that process, method, article or equipment including a series of key elements not only include those key elements,
But also other key elements including being not expressly set out, or also include solid by this process, method, article or equipment
Some key elements.In the absence of more restrictions, the key element limited by sentence " including one ", is not arranged
Except also there is other identical factor in the process including the key element, method, article or equipment.
One of ordinary skill in the art will appreciate that：Realizing all or part of step of above method embodiment can pass through
Programmed instruction related hardware is completed, and foregoing program can be stored in the storage medium of embodied on computer readable, the program
Upon execution, the step of including above method embodiment is performed；And foregoing storage medium includes：ROM, RAM, magnetic disc or light
Disk etc. is various can be with the medium of store program codes.
It is last it should be noted that：Presently preferred embodiments of the present invention is the foregoing is only, the skill of the present invention is merely to illustrate
Art scheme, is not intended to limit the scope of the present invention.Any modification for being made within the spirit and principles of the invention,
Equivalent substitution, improvement etc., are all contained in protection scope of the present invention.
Claims (10)
1. one kind realizes self-defining data assemblage method based on storing process, it is characterised in that including：
At least two storing process scheduler programs are set, wherein, at least two storing process scheduler program is corresponded to not respectively
With cycle and grade, and the corresponding grade of the storing process scheduler program of cycle length stored higher than cycle short described
The corresponding grade of journey scheduler program；
It is performed both by for storing process scheduler program each described：It is determined that current time reaches that presently described storing process is adjusted
During the corresponding Period Start Time of degree program, each data to be converged is converged using presently described storing process scheduler program, its
In, data to be converged described in each include：The storing process of a grade lower than presently described storing process scheduler program
The data of scheduler program convergence.
2. according to the method described in claim 1, it is characterised in that
Before each data to be converged is converged using presently described storing process scheduler program, further comprise：
Whether judge presently described storing process scheduler program is the storing process scheduler program positioned at the lowest class,
If it is, converging quantity mesh set in advance from outside database using presently described storing process scheduler program
Mark data.
3. according to the method described in claim 1, it is characterised in that
Further comprise：For the corresponding cycle of storing process schedulers each described, the first amount threshold and time are set
Threshold value；
It is described to converge each data to be converged using presently described storing process scheduler program, including：
It is performed both by for data to be converged described in each：When presently described when convergence data do not converge completion, convergence is current
The duration of the data to be converged reaches the time threshold, then gives up presently described data to be converged, and by current institute
The corresponding title write-in of data to be converged is stated to treat in amended record file；When presently described when convergence completion is converged, convergence is worked as
The duration of the preceding data to be converged is not up to the time threshold, then continues to converge next data to be converged；
It is determined that the data to be converged and the total number of the data to be converged of convergence given up, when it is determined that the total number reaches
During to first amount threshold, then each end of data to be converged is converged using presently described storing process scheduler program.
4. method according to claim 3, it is characterised in that
It is described the corresponding title write-in of presently described data to be converged is treated in amended record file after, further comprise：
It is determined that the quantity for treating title in amended record file；
When it is determined that the data reach the second amount threshold set in advance, alarm.
5. method according to claim 3, it is characterised in that
Described when it is determined that the total number reaches the amount threshold, then converged using presently described storing process scheduler program
Gather after each end of data to be converged, further comprise：
The corresponding title of the data to be converged according to treating in amended record file, it is determined that the data to be converged given up；
Obtain the data to be converged given up；
Data to be converged described in acquisition are forced to converge to and treated described in each of presently described storing process scheduler program convergence
Converge in data.
6. according to any described method of claim 1 to 5, it is characterised in that
At least two storing process scheduler program, including：Minute storing process scheduler program, hour storing process scheduling journey
Sequence, day storing process scheduler program, all storing process scheduler programs, moon storing process scheduler program, season storing process scheduling
At least two or a variety of in program and year storing process scheduler program.
7. one kind realizes self-defining data converging device based on storing process, it is characterised in that including：
Setting unit, for setting at least two storing process scheduler programs, wherein, at least two storing process dispatches journey
Sequence corresponds to different cycle and grade respectively, and the corresponding grade of the storing process scheduler program of cycle length is short higher than the cycle
The corresponding grade of the storing process scheduler program；
Unit is converged, for being performed both by for storing process scheduler program each described：It is determined that current time reaches currently
During the corresponding Period Start Time of the storing process scheduler program, each is converged using presently described storing process scheduler program
Data to be converged, wherein, data to be converged described in each include：A grade lower than presently described storing process scheduler program
The data of the storing process scheduler program convergence.
8. device according to claim 7, it is characterised in that
Further comprise：Judging unit；
The judging unit, for judging whether presently described storing process scheduler program is the storage positioned at the lowest class
Process scheduling program, is preset if it is, being converged using presently described storing process scheduler program from outside database
Quantity target data.
9. device according to claim 7, it is characterised in that
Further comprise：Threshold setting unit；
The threshold setting unit, for setting the first quantity threshold for the corresponding cycle of storing process schedulers each described
Value and time threshold；
The convergence unit, is further used for being performed both by for data to be converged described in each：When presently described number to be converged
During according to not converging completion, the duration for converging presently described data to be converged reaches the time threshold, then gives up current institute
State data to be converged, and the corresponding title write-in of presently described data to be converged is treated in amended record file；Wait to converge when presently described
When poly- convergence is completed, the duration for converging presently described data to be converged is not up to the time threshold, then continues to converge
Poly- next data to be converged；It is determined that the data to be converged given up and total of the data to be converged of convergence
Number, when it is determined that the total number reaches first amount threshold, is then converged using presently described storing process scheduler program
Each end of data to be converged.
10. device according to claim 9, it is characterised in that
Further comprise：Alarm unit；
The alarm unit, for determining the quantity for treating title in amended record file；When it is determined that the data reach sets in advance
During fixed second amount threshold, alarm；
And/or,
Further comprise：Amended record unit；
The amended record unit, for the corresponding title of data to be converged according to treating in amended record file, it is determined that the institute given up
State data to be converged；Obtain the data to be converged given up；Data to be converged described in acquisition are forced to converge to current institute
State in data to be converged described in each of storing process scheduler program convergence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710384367.1A CN107193710A (en) | 2017-05-26 | 2017-05-26 | One kind realizes self-defining data assemblage method and device based on storing process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710384367.1A CN107193710A (en) | 2017-05-26 | 2017-05-26 | One kind realizes self-defining data assemblage method and device based on storing process |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107193710A true CN107193710A (en) | 2017-09-22 |
Family
ID=59875591
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710384367.1A Pending CN107193710A (en) | 2017-05-26 | 2017-05-26 | One kind realizes self-defining data assemblage method and device based on storing process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107193710A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005266380A (en) * | 2004-03-19 | 2005-09-29 | Ricoh Co Ltd | State judging apparatus, image forming apparatus, external information processor, image quality detecting apparatus and state judging method |
| CN1897566A (en) * | 2005-07-14 | 2007-01-17 | 中兴通讯股份有限公司 | System and method for realizing convergent point service quality guarantee based on class grading |
| CN103294790A (en) * | 2013-05-22 | 2013-09-11 | 西北工业大学 | Spatiotemporal semantic meaning indexing and retrieving method aiming at GPS (global positioning system) trajectory data |
| CN105573889A (en) * | 2015-12-15 | 2016-05-11 | 上海仪电(集团)有限公司 | Virtual machine monitoring data access method and apparatus |
-
2017
- 2017-05-26 CN CN201710384367.1A patent/CN107193710A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005266380A (en) * | 2004-03-19 | 2005-09-29 | Ricoh Co Ltd | State judging apparatus, image forming apparatus, external information processor, image quality detecting apparatus and state judging method |
| CN1897566A (en) * | 2005-07-14 | 2007-01-17 | 中兴通讯股份有限公司 | System and method for realizing convergent point service quality guarantee based on class grading |
| CN103294790A (en) * | 2013-05-22 | 2013-09-11 | 西北工业大学 | Spatiotemporal semantic meaning indexing and retrieving method aiming at GPS (global positioning system) trajectory data |
| CN105573889A (en) * | 2015-12-15 | 2016-05-11 | 上海仪电(集团)有限公司 | Virtual machine monitoring data access method and apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11301136B2 (en) | Capacity forecasting based on capacity policies and transactions | |
| CN103370691B (en) | Managing buffer overflow conditions | |
| CN108459939A (en) | A kind of log collecting method, device, terminal device and storage medium | |
| CN104021043B (en) | The interruption re-access method and system of batch application program | |
| CN109510824A (en) | A kind of method of calibration and device of interface packets | |
| CN107273195A (en) | A kind of batch processing method of big data, device and computer system | |
| CN107092543A (en) | Method and apparatus for data scrub management in a memory system | |
| CN110175165A (en) | Transaction account checking method, device, computer equipment and storage medium | |
| CN108960527A (en) | The method for early warning and relevant apparatus of labor turnover | |
| CN110224943A (en) | Traffic service current-limiting method, electronic equipment and computer storage medium based on URL | |
| CN111785315B (en) | Method, system, storage medium and terminal for reducing erasing interference and erasing time | |
| CN110515917A (en) | A kind of method, apparatus and medium of control reconfiguration speed | |
| CN107193649A (en) | A kind of method for scheduling task and device based on NUMA system | |
| CN103838762B (en) | Uninterrupted data processing unit and method based on tables of data rotation | |
| CN105138329B (en) | A kind of method for changing in-orbit task | |
| CN110490742A (en) | A kind of transaction in block chain executes method and device | |
| CN107506293A (en) | A kind of software performance data acquisition method and device | |
| CN107193710A (en) | One kind realizes self-defining data assemblage method and device based on storing process | |
| CN109634714A (en) | A kind of method and device of intelligent scheduling | |
| CN107086960A (en) | A kind of message transmitting method and device | |
| CN104750547B (en) | The input and output I/O request processing method and processing device of virtual machine | |
| CN109086380A (en) | The method and system of compression storage are carried out to historical data | |
| CN110348245A (en) | Data completeness protection method, system, device and storage medium based on NVM | |
| CN109783215A (en) | Abnormal task processing method and relevant apparatus | |
| Schaffel et al. | Mentee-mentor dynamics under an egalitarian training policy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190711 Address after: 214029 No. 999 Gaolang East Road, Binhu District, Wuxi City, Jiangsu Province (Software Development Building) 707 Applicant after: Chaozhou Zhuoshu Big Data Industry Development Co., Ltd. Address before: 250100 S06 tower, 1036, Chao Lu Road, hi tech Zone, Ji'nan, Shandong. Applicant before: Shandong wave cloud services Mdt InfoTech Ltd |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170922 |
|
| RJ01 | Rejection of invention patent application after publication |