CN107704566A - Ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system - Google Patents
Ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system Download PDFInfo
- Publication number
- CN107704566A CN107704566A CN201710910646.7A CN201710910646A CN107704566A CN 107704566 A CN107704566 A CN 107704566A CN 201710910646 A CN201710910646 A CN 201710910646A CN 107704566 A CN107704566 A CN 107704566A
- Authority
- CN
- China
- Prior art keywords
- subfile
- scheduling
- main frame
- merging
- split
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1858—Parallel file systems, i.e. file systems supporting multiple processors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present invention provides a kind of ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system, some subfiles are split as by predetermined fractionation rule to each CDR file obtained by collection as split system, and it is sent to re-scheduling system, and re-scheduling is carried out to the subfile comprising same phone number by re-scheduling system, and after the mark of the message registration to repeating, it is distributed to multiple merging main frames of combination system, subfile is merged by merging main frame, generation is marked with the CDR file of duplicate marking.Merging process merges host parallel processing by more of combination system, and quickly, uniformly hashed according to predetermined hash rule, treatment effeciency can be improved, and the merging task of each merging main frame is more balanced, while integration across database, across main frame carry out file addressing are not needed in merging process, file addressing is more efficient, quick.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of ticket centralized procurement preprocess method, system and re-scheduling, fractionation
And combination system.
Background technology
Telecom operators need accurate recording user to use business in data services service process is provided a user
Information, these information embody generally in the form of ticket, as rates ground.And because each bill record collection point is in some abnormal feelings
There may be repetition ticket under condition, therefore re-scheduling is an important step of charge system, and charge system gathers ticket from network element
Afterwards, in order to ensure the uniqueness of user bill, it is necessary to carry out re-scheduling processing, exclude the ticket repeated.
Currently, ticket re-scheduling generally by ticket centralized procurement pretreatment system complete, when handling CDR file, for efficiency,
The design of storage etc. can be split the CDR file of collection, re-scheduling processing carried out, in order to keep front and rear end system
The uniformity of file, the Piece file mergence after splitting re-scheduling can be returned original.
Existing ticket centralized procurement pretreatment system, fractionation, re-scheduling and merging process are completed by a main frame, can not be simultaneously
Row processing, less efficient and growing with telecommunication service, the treating capacity of ticket is increasing, the calculating to main frame
The requirement more and more higher of ability.
The content of the invention
The present invention provides a kind of ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system, to realize ticket
Parallel processing, improve treatment effeciency.
It is an aspect of the invention to provide a kind of ticket centralized procurement preprocess method, including：
The re-scheduling system receives the subfile that split system is sent, and the subfile is split system to collection gained
Each CDR file splits gained by predetermined fractionation rule, wherein the subfile carries, to belong to CDR file originally with it corresponding
First mark, and it is sent to re-scheduling system；
The re-scheduling system carries out re-scheduling to the subfile comprising same phone number, and to identical in each subfile
Message registration, only retain one of them, remaining marks duplicate marking；
The subfile after re-scheduling is distributed to the multiple of combination system by the re-scheduling system by predetermined hash rule
Merge main frame, so that the merging main frame merges according to the described first mark to the subfile, generation is marked with repetition
The CDR file of mark.
Another aspect of the present invention is to provide a kind of ticket centralized procurement preprocess method, including：
Split system receives the CDR file of collection gained；
The split system splits into some sons to each CDR file of collection gained by predetermined fractionation rule
File, and belong to CDR file corresponding first originally with it in subfile carrying and identify；
The subfile is sent to re-scheduling system by the split system.
Another aspect of the present invention is to provide a kind of ticket centralized procurement preprocess method, including：
Multiple merging main frames in combination system receive the subfile of re-scheduling system distribution, wherein the subfile carry with
It belongs to the first mark corresponding to CDR file originally；
The merging main frame merges according to the described first mark is synchronous to the subfile, and generation is marked with repetition mark
The CDR file of knowledge.
Another aspect of the present invention is to provide a kind of re-scheduling system, including at least one re-scheduling main frame, the re-scheduling master
Machine includes：
First receiving module, for receiving the subfile of split system transmission, the subfile is split system to collection
Each CDR file of gained splits gained by predetermined fractionation rule, wherein the subfile carries belongs to CDR file originally with it
Corresponding first mark, and it is sent to re-scheduling system；
First processing module, for carrying out re-scheduling to the subfile comprising same phone number, and to each subfile
Middle identical message registration, only retains one of them, remaining marks duplicate marking；
First distribution module, the subfile after re-scheduling is distributed by predetermined hash rule for the re-scheduling system
To multiple merging main frames of combination system, so that the merging main frame closes according to the described first mark to the subfile
And generate the CDR file for being marked with duplicate marking.
Another aspect of the present invention is to provide a kind of split system, including：
Second receiving module, the CDR file of collection gained is received for split system；
Second processing module, if for being split into each CDR file of collection gained by predetermined fractionation rule
Dry subfile, and belong to CDR file corresponding first originally with it in subfile carrying and identify；
Second distribution module, for the subfile to be sent into re-scheduling system.
Another aspect of the present invention is to provide a kind of combination system, including at least two merge main frame, described to merge master
Machine includes：
3rd receiving module, for receiving the subfile of re-scheduling system distribution, belonged to originally wherein the subfile carries with it
First mark corresponding to CDR file；
3rd processing module, for being merged according to the described first mark is synchronous to the subfile, generation is marked with
The CDR file of duplicate marking.
Another aspect of the present invention is to provide a kind of ticket centralized procurement pretreatment system, including re-scheduling system as described above
System, described split system and described combination system.
Ticket centralized procurement preprocess method provided by the invention, system and re-scheduling, fractionation and combination system, pass through split system
Some subfiles are split as by predetermined fractionation rule to each CDR file of collection gained, and are sent to re-scheduling system, and
Re-scheduling is carried out to the subfile comprising same phone number by re-scheduling system, and after the mark of the message registration to repeating, is distributed to
Multiple merging main frames of combination system, are merged by merging main frame to subfile, and generation is marked with the ticket text of duplicate marking
Part.Merging process merges host parallel processing by more of combination system, and quick, uniform according to predetermined hash rule
Hash, treatment effeciency can be improved, and the merging task of each merging main frame is more balanced, while need not be across data in merging process
Storehouse, across main frame carry out file addressing, file addressing are more efficient, quick.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, without having to pay creative labor, may be used also
To obtain other accompanying drawings according to these accompanying drawings.
Fig. 1 is the ticket centralized procurement preprocess method flow chart that the embodiment of the present invention one provides；
Fig. 2 is the ticket centralized procurement preprocess method flow chart that the embodiment of the present invention two provides；
Fig. 3 is the ticket centralized procurement preprocess method flow chart that the embodiment of the present invention three provides；
Fig. 4 is the structure chart for the re-scheduling main frame that the embodiment of the present invention four provides；
Fig. 5 is the structure chart for the split system that the embodiment of the present invention five provides；
Fig. 6 is the structure chart for the merging main frame that the embodiment of the present invention six provides；
Fig. 7 is the structure chart for the ticket centralized procurement pretreatment system that the embodiment of the present invention six provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made
Embodiment, belong to the scope of protection of the invention.
Embodiment one
Fig. 1 is the ticket centralized procurement preprocess method flow chart that the embodiment of the present invention one provides.As shown in figure 1, the present embodiment
A kind of ticket centralized procurement preprocess method is provided, its executive agent is re-scheduling system, and this method comprises the following steps that：
S101, the re-scheduling system receive the subfile that split system is sent, and the subfile is split system to collection
Each CDR file of gained splits gained by predetermined fractionation rule, wherein the subfile carries belongs to CDR file originally with it
Corresponding first mark, and it is sent to re-scheduling system.
In the present embodiment, each CDR file of collection gained is torn open by predetermined fractionation rule by split system first
Point, wherein CDR file is gathered at the network element of different recording call lists, and its gatherer process can be completed by split system, or
Completed by other main frames, do not limited herein.Because each CDR file splits rule according to identical in the present embodiment
Split, such as can carry out being split as 10 subfiles according to calling party telephone number tail number in message registration, i.e., for ticket A
The message registration that all-calls side's telephone number tail number is 0 is stored in subfile A0, by all-calls side's telephone number tail
Number it is stored in for 1 message registration in subfile A1, it is by that analogy, same for ticket B so as to obtain ten subfiles of A0 to A9
Sample is obtained ten subfiles ... of B0 to B9 and is illustrated in the present embodiment with such a fractionation rule.Certainly rule is split
It is not limited in above-mentioned fractionation rule, is illustrated in detail again in subsequent embodiment.
Carried in above-mentioned gained subfile and belong to corresponding to CDR file the first mark originally, such as subfile A0, its
Carried in filename and belong to the first mark " A " corresponding to CDR file originally, naturally it is also possible to which other modes, which carry, belongs to ticket text originally
The first mark, is not limited herein corresponding to part.Carried in subfile and belong to corresponding to CDR file first originally and identify its mesh
Subfile is merged into original words monofile when being easy for subsequently merging.
Re-scheduling system in the present embodiment can only have a re-scheduling main frame, but in order to improve re-scheduling efficiency, also can be by more
The processing of platform re-scheduling host parallel, accordingly, split system then need subfile being distributed to the plurality of re-scheduling main frame, during distribution,
Subfile with same phone number is distributed to same re-scheduling main frame, specifically, tail number is 1 subfile in above-mentioned example
Include the message registration of same phone number in A1, B1 ..., therefore be distributed to same re-scheduling main frame, re-scheduling could be realized.
S102, the re-scheduling system carry out re-scheduling to the subfile comprising same phone number, and to each subfile
Middle identical message registration, only retains one of them, remaining marks duplicate marking.
In the present embodiment, re-scheduling system carries out re-scheduling, specific re-scheduling mistake for the subfile of same phone number
Journey can use any rearrangement of the prior art, not limit herein.Pass through re-scheduling, it is possible to achieve across the identical of subfile
Message registration lookup, wherein identical message registration refers to that the air time is identical and both call sides number is identical, or meets
Other comparison conditions.After identical message registration is found, retain wherein one and do not mark duplicate marking, remaining is marked
Duplicate marking, and duplicate marking is not marked particularly for for which message registration, it can randomly choose or be sent out according to subfile
The time order and function for being sent to re-scheduling system is selected, and is not limited herein.
The subfile after re-scheduling is distributed to combination system by S103, the re-scheduling system by predetermined hash rule
Multiple merging main frames, so that the merging main frame merges according to the described first mark to the subfile, generation is marked with
The CDR file of duplicate marking.
In the present embodiment, the subfile after re-scheduling is distributed to the multiple of combination system by re-scheduling system after the completion of re-scheduling
Merge main frame, by each merging host parallel processing, subfile is merged into original CDR file according to the first mark, but now
, then will not be right in follow-up charging flow for message registration repeatedly marked duplicate marking in the CDR file of gained
The message registration repetition charging of this repetition, only to the message registration charging of unmarked duplicate marking.The hash of the present embodiment
Rule can be designed according to the number of units for merging main frame, and subfile is uniformly distributed to each merging main frame by hashing rule,
So that the merging task for respectively merging main frame is more balanced.
For example, it is assumed that monofile has A, B, C, D tetra- if original in above-mentioned example, and merging main frame has two, then may be used
By subfile A0 '-A9 ' and the B0 '-B9 ' after re-scheduling be distributed to First merge main frame, by subfile C0 '-C9 ' and D0 '-
D9 ' is distributed to second merging main frame, by First merge main frame subfile A0 '-A9 ' are merged into A ', by subfile B0 '-
B9 ' merges into B ', and equally, second merging main frame obtains C ' and D after merging subfile '.
The ticket centralized procurement preprocess method that the present embodiment provides, as split system to each CDR file obtained by collection
Some subfiles are split as by predetermined fractionation rule, and are sent to re-scheduling system, and by re-scheduling system to including same phone
The subfile of number carries out re-scheduling, and after the mark of the message registration to repeating, is distributed to multiple merging main frames of combination system, by
Merge main frame to merge subfile, generation is marked with the CDR file of duplicate marking.The method of the present embodiment, merging process
Merge host parallel processing by more of combination system, and according to regular quick, the uniform hash of predetermined hash, can improve
Treatment effeciency, and the merging task of each merging main frame is more balanced, while integration across database is not needed in merging process, is entered across main frame
Row file addressing, file addressing are more efficient, quick.
On the basis of above-described embodiment, the re-scheduling system described in S103 is divided the subfile by predetermined hash rule
Multiple merging main frames of combination system are issued, are specifically as follows：
First mark of the subfile is calculated cryptographic Hash by the re-scheduling system, and merges master according to described to cryptographic Hash
The number of units modulo operation of machine, the merging main frame according to corresponding to being distributed to the modulo operation result.
In order to which subfile to be uniformly distributed to each merging main frame in the present embodiment, therefore counted according to the first mark of subfile
Calculate cryptographic Hash, and to cryptographic Hash by the number of units modulo operation for merging main frame, subfile is distributed to according to modulus result corresponding to
Merge main frame, wherein the first mark identical subfile will necessarily distribute to same merging main frame.For example, first is identified as A's
Subfile, assume that cryptographic Hash is 5 after cryptographic Hash is taken to A, and merging main frame has 4, then to cryptographic Hash 5 with 4 modulus, modulus result
For 1, therefore the first subfile for being identified as A is distributed to First and merges main frame.This implementation hash rule distribution more rapidly,
Uniformly, so as to ensure that more merge host parallel processing, and it is more balanced to merge task.
On the basis of above-described embodiment, combination system may also include multiple databases, each database and one
The merging main frame connection.Wherein database can be mongodb databases, and it is in file quick search, file integrality school
Test, be more outstanding in terms of exception management, can also use other databases certainly.
Further, the subfile after re-scheduling is distributed to by the re-scheduling system described in S103 by predetermined hash rule
Multiple merging main frames of combination system, are specifically included：
The subfile after re-scheduling is distributed to the database by the re-scheduling system by predetermined hash rule, so that
The merging main frame obtains the subfile from the corresponding database.
In the present embodiment, because each merging main frame exclusively enjoys a database, and subfile to be combined is in the number
Subfile is obtained directly from its corresponding database according to main frame in storehouse, is merged, it is not necessary to integration across database, across main frame progress
File addressing, file addressing are highly efficient, quick.
Embodiment two
Fig. 2 is the ticket centralized procurement preprocess method flow chart that the embodiment of the present invention two provides.As shown in Fig. 2 the present embodiment
A kind of ticket centralized procurement preprocess method is provided, its executive agent is split system, and this method comprises the following steps that：
S201, split system receive the CDR file of collection gained.
In the present embodiment, CDR file is gathered at the network element of different recording call lists, and its gatherer process can be by tearing open
Subsystem is completed, or is completed by other main frames, is not limited herein.That is, split system can be single main frame,
It can be integrated in other functional modules such as acquisition system on a main frame.
If S202, the split system are split into each CDR file of collection gained by predetermined fractionation rule
Dry subfile, and belong to CDR file corresponding first originally with it in subfile carrying and identify.
Split in the present embodiment because each CDR file splits rule according to identical, be easy to the multinode to re-scheduling
Parallel re-scheduling.And it belongs to originally and subfile is merged into original words Dan Wen when the first mark then is easy to subsequently merge corresponding to CDR file
Part, wherein how specific subfile carries the first mark, such as it can be carried or in subfile in the filename of subfile
Attribute in carry etc., do not limit herein.
Preferably, the predetermined fractionation rule in this implementation is specifically as follows：
The split system is for the message registration in any CDR file, according to two after telephone number with predetermined
Numerical value modulo operation, the message registration corresponding to modulo operation result identical telephone number is stored in a subfile
In.
Such as predetermined value is 64, the modulo operation of two after being carried out with calling party telephone number, such as tail number are 00 He
Message registration corresponding to the telephone number that tail number is 64 preserves in one file, and the phone number that tail number is 01 and tail number is 65
Message registration corresponding to code is stored in another file, the like, a CDR file is split as 64 subfiles.Pass through
The fractionation rule of ticket fractionations is carried out by two modulus after telephone number, can solve that prior art ticket amount is huge, separate unit machine
The problem of device process performance is limited, i.e., using distributed treatment pattern, process performance is improved, treatment effeciency is higher, protects simultaneously
Demonstrate,proving same number can be handled by same process.
Certainly predetermined fractionation rule can also be as given example is electric according to MPTY in message registration in embodiment one
Words number tail number is split, and is either split according to the number section of phone number or latter four etc. according to telephone number
Deng with arbitrary fractionation rule.
The subfile is sent to re-scheduling system by S203, the split system.
Can be distributed in the present embodiment according to the number of units of re-scheduling main frame in re-scheduling system, if such as re-scheduling system only have
One re-scheduling main frame, then all subfiles are sent to the rearrangement main frame；With certain point if having more rearrangement main frames
Subfile is more uniformly distributed to each rearrangement main frame by hair rule, wherein when distributing, has the subfile of same phone number
Same re-scheduling main frame is distributed to, rearrangement could be realized.
More specifically, the subfile of all CDR files can be distributed discharge by the split system according to modulo operation result
Multiple re-scheduling main frames of weight system.Such as modulus is carried out according to 64 above-mentioned, can be by modulus if re-scheduling main frame has 8
As a result same re-scheduling main frame is distributed to for subfile corresponding to 0-7, so as to realize quick, uniform distribution, is easy to each row
The parallel re-scheduling of weight main frame.
The ticket centralized procurement preprocess method that the present embodiment provides, as split system to each CDR file obtained by collection
Some subfiles are split as by predetermined fractionation rule, and are sent to re-scheduling system, and by re-scheduling system to including same phone
The subfile of number carries out re-scheduling.The method of the present embodiment, the quick fractionation of CDR file can be achieved, and quickly, uniformly
Re-scheduling system is sent to, is advantageous to improve the efficiency of ticket centralized procurement pretreatment.
Embodiment three
Fig. 3 is the ticket centralized procurement preprocess method flow chart that the embodiment of the present invention three provides.As shown in figure 3, the present embodiment
A kind of ticket centralized procurement preprocess method is provided, its executive agent is combination system, and this method comprises the following steps that：
Multiple merging main frames in S301, combination system receive the subfile of re-scheduling system distribution, wherein the subfile
Carrying belongs to CDR file corresponding first originally with it and identified.
In the present embodiment, the subfile after re-scheduling is distributed to the multiple of combination system by re-scheduling system after the completion of re-scheduling
Merge main frame, by each merging host parallel processing, subfile is merged into original CDR file according to the first mark, but now
, then will not be right in follow-up charging flow for message registration repeatedly marked duplicate marking in the CDR file of gained
The message registration repetition charging of this repetition, only to the message registration charging of unmarked duplicate marking.
Further, combination system also includes multiple databases, and each database connects with a main frame that merges
Connect.Wherein database can be mongodb databases, and it is in terms of file quick search, file integrality verification, exception management
It is more outstanding, other databases can be also used certainly.
Multiple merging main frames in combination system in the present embodiment described in S301 receive the subfile of re-scheduling system distribution,
Specifically it may include：
S3011, the database receive the subfile of the re-scheduling system distribution；
S3012, the merging main frame obtain the subfile from the corresponding database.
In the present embodiment, because each merging main frame exclusively enjoys a database, and subfile to be combined is in the number
Subfile is obtained directly from its corresponding database according to main frame in storehouse, is merged, it is not necessary to integration across database, across main frame progress
File addressing, file addressing are highly efficient, quick.
S302, the merging main frame are merged according to the described first mark is synchronous to the subfile, and generation is marked with
The CDR file of duplicate marking.
In the present embodiment, merge main frame to be addressed according to the first mark, identical subfile is identified by all first
Merge, so as to generate the CDR file for being marked with duplicate marking.Although it can be come certainly in subsequent charging with subfile
Charging is carried out, but because subfile quantity is more, to save the read-write expense of charge system, it is best place that subfile, which is merged,
Reason mode.
The ticket centralized procurement preprocess method that the present embodiment provides, as split system to each CDR file obtained by collection
Some subfiles are split as by predetermined fractionation rule, and are sent to re-scheduling system, and by re-scheduling system to including same phone
The subfile of number carries out re-scheduling, and after the mark of the message registration to repeating, is distributed to multiple merging main frames of combination system, by
Merge main frame to merge subfile, generation is marked with the CDR file of duplicate marking.The method of the present embodiment, merging process
Merge host parallel processing by more of combination system, and according to regular quick, the uniform hash of predetermined hash, can improve
Treatment effeciency, and the merging task of each merging main frame is more balanced, while integration across database is not needed in merging process, is entered across main frame
Row file addressing, file addressing are more efficient, quick.
Example IV
Fig. 4 is the structure chart for the re-scheduling main frame that the embodiment of the present invention four provides.The re-scheduling system that the present embodiment provides can be with
The handling process that ticket centralized procurement preprocess method embodiment one provides is performed, as shown in figure 4, the re-scheduling system of the present embodiment, bag
At least one re-scheduling main frame 10 is included, the re-scheduling main frame 10 includes：
First receiving module 11, for receiving the subfile of split system transmission, the subfile is split system to adopting
Each CDR file of collection gained splits gained by predetermined fractionation rule, wherein the subfile carries belongs to ticket text originally with it
First mark corresponding to part, and it is sent to re-scheduling system；
First processing module 12, for carrying out re-scheduling to the subfile comprising same phone number, and to each Ziwen
Identical message registration in part, only retains one of them, and remaining marks duplicate marking；
First distribution module 13, the subfile after re-scheduling is divided by predetermined hash rule for the re-scheduling system
Multiple merging main frames of combination system are issued, so that the merging main frame closes according to the described first mark to the subfile
And generate the CDR file for being marked with duplicate marking.
Further, first distribution module 13 is specifically used for the first mark of the subfile calculating cryptographic Hash,
And the number of units modulo operation to cryptographic Hash according to the merging main frame, the conjunction according to corresponding to being distributed to the modulo operation result
And main frame.
It should be noted that it is preferably parallel re-scheduling processing in the present embodiment, it is advantageous to be re-scheduling system, including at least
Two re-scheduling main frames 10.
Re-scheduling system provided in an embodiment of the present invention can be specifically used for performing the embodiment of the method that above-mentioned Fig. 1 is provided,
Here is omitted for concrete function.
The re-scheduling system that the present embodiment provides, the subfile sent by receiving split system, and to including same phone
The subfile of number carries out re-scheduling, and after the mark of the message registration to repeating, is distributed to multiple merging main frames of combination system, by
Merge main frame to merge subfile, generation is marked with the CDR file of duplicate marking, and merging process is by the more of combination system
Platform merging host parallel processing, and quickly, uniformly hashed according to predetermined hash rule, treatment effeciency can be improved, and respectively
It is more balanced to merge the merging task of main frame, while integration across database, across main frame carry out file addressing are not needed in merging process, text
Part addressing is more efficient, quick.
Embodiment five
Fig. 5 is the structure chart for the split system that the embodiment of the present invention five provides.The split system that the present embodiment provides can be with
The handling process that ticket centralized procurement preprocess method embodiment two provides is performed, as shown in figure 5, the split system of the present embodiment, bag
Include：
Second receiving module 21, the CDR file of collection gained is received for split system；
Second processing module 22, for being split into each CDR file of collection gained by predetermined fractionation rule
Some subfiles, and belong to CDR file corresponding first originally with it in subfile carrying and identify；
Second distribution module 23, for the subfile to be sent into re-scheduling system.
Further, the Second processing module 22 is specifically used for, for the message registration in any CDR file,
, will be described logical corresponding to modulo operation result identical telephone number according to two after telephone number with predetermined value modulo operation
Words record is stored in a subfile.
Further, second distribution module 23 is specifically used for, and the subfile of all CDR files is transported according to modulus
Calculate multiple re-scheduling main frames that result is distributed to re-scheduling system.
Split system provided in an embodiment of the present invention can be specifically used for performing the embodiment of the method that above-mentioned Fig. 2 is provided,
Here is omitted for concrete function.
The split system that this implementation provides, as being split to each CDR file obtained by collection by predetermined fractionation rule
For some subfiles, and re-scheduling system is sent to, and re-scheduling is carried out to the subfile comprising same phone number by re-scheduling system,
The quick fractionation of CDR file can be achieved, and quickly, be uniformly sent to re-scheduling system, be advantageous to raising ticket centralized procurement and locate in advance
The efficiency of reason.
Embodiment six
Fig. 6 is the structure chart for the merging main frame that the embodiment of the present invention six provides.The combination system that the present embodiment provides can be with
The handling process that ticket centralized procurement preprocess method embodiment three provides is performed, as shown in fig. 6, the combination system of the present embodiment, bag
At least two merging main frames 30 are included, the merging main frame 30 includes：
3rd receiving module 31, for receiving the subfile of re-scheduling system distribution, wherein the subfile carries and its original
Belong to the first mark corresponding to CDR file；
3rd processing module 32, for being merged according to the described first mark is synchronous to the subfile, generation mark
There is the CDR file of duplicate marking.
Further, the combination system also includes multiple databases, and each database described merges master with one
Machine connects.The database receives the subfile of the re-scheduling system distribution.
3rd receiving module 31 is specifically used for, and the subfile is obtained from the corresponding database.
Combination system provided in an embodiment of the present invention can be specifically used for performing the embodiment of the method that above-mentioned Fig. 3 is provided,
Here is omitted for concrete function.
The combination system that this implementation provides, predetermined fractionation is pressed to each CDR file obtained by collection as split system
Rule is split as some subfiles, and is sent to re-scheduling system, and by re-scheduling system to the subfile comprising same phone number
Re-scheduling is carried out, and after the mark of the message registration to repeating, multiple merging main frames of combination system are distributed to, by merging main frame antithetical phrase
File merges, and generation is marked with the CDR file of duplicate marking.Merging process by combination system more merging main frames simultaneously
Row processing, and according to regular quick, the uniform hash of predetermined hash, treatment effeciency, and the conjunction of each merging main frame can be improved
Integration across database, across main frame carry out file addressing are not needed and task is more balanced, while in merging process, file addressing is higher
Imitate, be quick.
Embodiment seven
Fig. 7 is the structure chart for the ticket centralized procurement pretreatment system that the embodiment of the present invention six provides.As shown in fig. 7, this implementation
The ticket centralized procurement pretreatment system that example provides, including the re-scheduling system 1 as described in example IV, the fractionation as described in embodiment five
System 2 and the combination system 3 as described in embodiment six.
The ticket centralized procurement pretreatment system concrete function of this implementation is as described in above-mentioned embodiment, and here is omitted.
The ticket centralized procurement pretreatment system that the present embodiment provides, as split system to each CDR file obtained by collection
Some subfiles are split as by predetermined fractionation rule, and are sent to re-scheduling system, and by re-scheduling system to including same phone
The subfile of number carries out re-scheduling, and after the mark of the message registration to repeating, is distributed to multiple merging main frames of combination system, by
Merge main frame to merge subfile, generation is marked with the CDR file of duplicate marking.The system of the present embodiment, merging process
Merge host parallel processing by more of combination system, and according to regular quick, the uniform hash of predetermined hash, can improve
Treatment effeciency, and the merging task of each merging main frame is more balanced, while integration across database is not needed in merging process, is entered across main frame
Row file addressing, file addressing are more efficient, quick.The system of the present embodiment it is single can to solve deployment to ticket concurrent processing
One the problem of, the reason such as the treatment effeciency of file, file storage, file unloading, abnormal conditions after splitting is taken into full account.
In several embodiments provided by the present invention, it should be understood that disclosed apparatus and method, it can be passed through
Its mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, only
Only a kind of division of logic function, there can be other dividing mode when actually realizing, such as multiple units or component can be tied
Another system is closed or is desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or discussed
Mutual coupling or direct-coupling or communication connection can be the INDIRECT COUPLINGs or logical by some interfaces, device or unit
Letter connection, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit realized in the form of SFU software functional unit, can be stored in one and computer-readable deposit
In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are causing a computer
It is each that equipment (can be personal computer, server, or network equipment etc.) or processor (processor) perform the present invention
The part steps of embodiment methods described.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (Read-
Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disc or CD etc. it is various
Can be with the medium of store program codes.
Those skilled in the art can be understood that, for convenience and simplicity of description, only with above-mentioned each functional module
Division progress for example, in practical application, can be complete by different functional modules by above-mentioned function distribution as needed
Into the internal structure of device being divided into different functional modules, to complete all or part of function described above.On
The specific work process of the device of description is stated, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
Finally it should be noted that：Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations；To the greatest extent
The present invention is described in detail with reference to foregoing embodiments for pipe, it will be understood by those within the art that：Its according to
The technical scheme described in foregoing embodiments can so be modified, either which part or all technical characteristic are entered
Row equivalent substitution；And these modifications or replacement, the essence of appropriate technical solution is departed from various embodiments of the present invention technology
The scope of scheme.
Claims (12)
- A kind of 1. ticket centralized procurement preprocess method, it is characterised in that including：Re-scheduling system receives the subfile that split system is sent, and the subfile is each ticket of the split system to collection gained File presses predetermined fractionation rule and splits gained, is marked wherein subfile carrying belongs to CDR file corresponding first originally with it Know, and be sent to re-scheduling system；The re-scheduling system carries out re-scheduling to the subfile comprising same phone number, and identical in each subfile is led to Words record, only retains one of them, remaining marks duplicate marking；The subfile after re-scheduling is distributed to multiple merging of combination system by predetermined hash rule by the re-scheduling system Main frame, so that the merging main frame merges according to the described first mark to the subfile, generation is marked with duplicate marking CDR file.
- 2. according to the method for claim 1, it is characterised in that the re-scheduling system presses predetermined hash rule by the son Multiple merging main frames of the file distributing to combination system, are specifically included：First mark of the subfile is calculated cryptographic Hash by the re-scheduling system, and to cryptographic Hash according to the merging main frame Number of units modulo operation, the merging main frame according to corresponding to being distributed to the modulo operation result.
- 3. method according to claim 1 or 2, it is characterised in that the combination system also includes multiple databases, each The database is connected with a main frame that merges；The subfile after re-scheduling is distributed to multiple merging of combination system by predetermined hash rule by the re-scheduling system Main frame, specifically include：The subfile after re-scheduling is distributed to the database by the re-scheduling system by predetermined hash rule, so that described Merge main frame and obtain the subfile from the corresponding database.
- A kind of 4. ticket centralized procurement preprocess method, it is characterised in that including：Split system receives the CDR file of collection gained；The split system splits into some subfiles to each CDR file of collection gained by predetermined fractionation rule, And belong to CDR file corresponding first originally with it in subfile carrying and identify；The subfile is sent to re-scheduling system by the split system.
- 5. according to the method for claim 4, it is characterised in that each CDR file of the split system to collection gained Some subfiles are split as by predetermined fractionation rule, are specifically included：The split system is for the message registration in any CDR file, according to two after telephone number with predetermined value Modulo operation, the message registration corresponding to modulo operation result identical telephone number is stored in a subfile.
- 6. according to the method for claim 5, it is characterised in that the subfile is sent to re-scheduling system by the split system System, is specifically included：The subfile of all CDR files is distributed to multiple rows of re-scheduling system by the split system according to modulo operation result Weight main frame.
- A kind of 7. ticket centralized procurement preprocess method, it is characterised in that including：Multiple merging main frames in combination system receive the subfile of re-scheduling system distribution, wherein the subfile carries and its original Belong to the first mark corresponding to CDR file；The merging main frame merges according to the described first mark is synchronous to the subfile, and generation is marked with duplicate marking CDR file.
- 8. according to the method for claim 7, it is characterised in that the combination system also includes multiple databases, Mei Yisuo Database is stated to be connected with a main frame that merges；Multiple merging main frames in the combination system receive the subfile of re-scheduling system distribution, specifically include：The database receives the subfile of the re-scheduling system distribution；The merging main frame obtains the subfile from the corresponding database.
- 9. a kind of re-scheduling system, it is characterised in that including at least one re-scheduling main frame, the re-scheduling main frame includes：First receiving module, for receiving the subfile of split system transmission, the subfile is split system to collection gained Each CDR file split gained by predetermined fractionation rule, wherein the subfile carries, to belong to CDR file originally with it corresponding The first mark, and be sent to re-scheduling system；First processing module, for carrying out re-scheduling to the subfile comprising same phone number, and to phase in each subfile Same message registration, only retains one of them, remaining marks duplicate marking；First distribution module, the subfile after re-scheduling is distributed to conjunction by predetermined hash rule for the re-scheduling system And multiple merging main frames of system, so that the merging main frame merges according to the described first mark to the subfile, it is raw Into the CDR file for being marked with duplicate marking.
- A kind of 10. split system, it is characterised in that including：Second receiving module, the CDR file of collection gained is received for split system；Second processing module, for splitting into some sons by predetermined fractionation rule to each CDR file of collection gained File, and belong to CDR file corresponding first originally with it in subfile carrying and identify；Second distribution module, for the subfile to be sent into re-scheduling system.
- 11. a kind of combination system, it is characterised in that merge main frame including at least two, the merging main frame includes：3rd receiving module, for receiving the subfile of re-scheduling system distribution, wherein the subfile carries belongs to ticket originally with it First mark corresponding to file；3rd processing module, for being merged according to the described first mark is synchronous to the subfile, generation is marked with repetition The CDR file of mark.
- 12. a kind of ticket centralized procurement pretreatment system, it is characterised in that wanted including re-scheduling system as claimed in claim 9, right Ask the split system described in 10 and combination system as claimed in claim 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710910646.7A CN107704566A (en) | 2017-09-29 | 2017-09-29 | Ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710910646.7A CN107704566A (en) | 2017-09-29 | 2017-09-29 | Ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107704566A true CN107704566A (en) | 2018-02-16 |
Family
ID=61174691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710910646.7A Pending CN107704566A (en) | 2017-09-29 | 2017-09-29 | Ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107704566A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108650429A (en) * | 2018-04-08 | 2018-10-12 | 国网辽宁省电力有限公司信息通信分公司 | A kind of calling list rearrangement method and re-scheduling system |
| CN109714494A (en) * | 2019-01-03 | 2019-05-03 | 中国联合网络通信集团有限公司 | List generating method and system, ticket generate server |
| CN111274209A (en) * | 2020-01-08 | 2020-06-12 | 中国联合网络通信集团有限公司 | Call bill file processing method and device |
| CN115150763A (en) * | 2021-03-30 | 2022-10-04 | 中国移动通信集团江苏有限公司 | Call bill charging method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1525689A (en) * | 2003-02-24 | 2004-09-01 | 中兴通讯股份有限公司 | A call bill weight picking method |
| CN101510203A (en) * | 2009-02-25 | 2009-08-19 | 南京联创科技股份有限公司 | Big data quantity high performance processing implementing method based on parallel process of split mechanism |
| CN101572762A (en) * | 2009-02-25 | 2009-11-04 | 南京联创科技股份有限公司 | Method for realizing combination of mass tickets by statistic based storage management and quick indexing |
-
2017
- 2017-09-29 CN CN201710910646.7A patent/CN107704566A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1525689A (en) * | 2003-02-24 | 2004-09-01 | 中兴通讯股份有限公司 | A call bill weight picking method |
| CN101510203A (en) * | 2009-02-25 | 2009-08-19 | 南京联创科技股份有限公司 | Big data quantity high performance processing implementing method based on parallel process of split mechanism |
| CN101572762A (en) * | 2009-02-25 | 2009-11-04 | 南京联创科技股份有限公司 | Method for realizing combination of mass tickets by statistic based storage management and quick indexing |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108650429A (en) * | 2018-04-08 | 2018-10-12 | 国网辽宁省电力有限公司信息通信分公司 | A kind of calling list rearrangement method and re-scheduling system |
| CN109714494A (en) * | 2019-01-03 | 2019-05-03 | 中国联合网络通信集团有限公司 | List generating method and system, ticket generate server |
| CN111274209A (en) * | 2020-01-08 | 2020-06-12 | 中国联合网络通信集团有限公司 | Call bill file processing method and device |
| CN111274209B (en) * | 2020-01-08 | 2023-05-30 | 中国联合网络通信集团有限公司 | Method and device for processing ticket file |
| CN115150763A (en) * | 2021-03-30 | 2022-10-04 | 中国移动通信集团江苏有限公司 | Call bill charging method and device |
| CN115150763B (en) * | 2021-03-30 | 2024-05-07 | 中国移动通信集团江苏有限公司 | Bill charging method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107704566A (en) | Ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system | |
| CN102724219B (en) | A network data computer processing method and a system thereof | |
| CN103346912B (en) | Method, device and system for conducting warning correlation analysis | |
| CN109919315A (en) | A kind of forward inference method, apparatus, equipment and the storage medium of neural network | |
| CN107147501A (en) | Timestamp processing method and processing device | |
| CN106407207A (en) | Real-time added data updating method and apparatus | |
| CN106354795A (en) | Distributed data exchanging system | |
| CN101938362B (en) | Charging regrant method, device and system | |
| CN109347893A (en) | A kind of file memory method and device of block chain network | |
| CN107483381A (en) | The monitoring method and device of interlock account | |
| CN107315586A (en) | Using the methods, devices and systems of packing | |
| CN103366022A (en) | Information processing system and processing method for use therewith | |
| CN103823807A (en) | Data de-duplication method, device and system | |
| CN109388636A (en) | Business datum is inserted into database method, apparatus, computer equipment and storage medium | |
| CN103036721A (en) | Traffic statistical method under cloud computing environment | |
| SE514994C2 (en) | Method and apparatus for extracting data from a group of data | |
| CN105868218A (en) | Data processing method and electronic device | |
| CN106156361A (en) | Law enforcement supervision method and device | |
| CN104951370B (en) | A kind of EMS memory management process and device | |
| CN105243078A (en) | File resource distribution method, system and apparatus | |
| CN106331011A (en) | Method and device for sharing license resource between multiple virtual network functions | |
| CN106658444A (en) | Short message channel provider selection method and terminal | |
| CN103905375B (en) | Data encryption request distribution method and device in concentrating type data encryption system | |
| CN103929378B (en) | The communication link distribution of cross-domain data transmission and cross-domain data transmission method and system | |
| CN106354828A (en) | Data fragmentation method and device for distributed database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180216 |