CN108923967A - A kind of duplicate removal discharge record method, apparatus, server and storage medium - Google Patents
A kind of duplicate removal discharge record method, apparatus, server and storage medium Download PDFInfo
- Publication number
- CN108923967A CN108923967A CN201810686101.7A CN201810686101A CN108923967A CN 108923967 A CN108923967 A CN 108923967A CN 201810686101 A CN201810686101 A CN 201810686101A CN 108923967 A CN108923967 A CN 108923967A
- Authority
- CN
- China
- Prior art keywords
- flow
- duplicate removal
- window
- time
- business hours
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
Abstract
The embodiment of the invention discloses a kind of duplicate removal discharge record method, apparatus, server and storage medium, the method includes：In the case where receiving message, obtain the fields points information of message, and according to fields points information determine the corresponding flow of outgoing packet whether be and the matched duplicate removal flow of preset flow configuration information, if, it then parses fields points information and determines the business generation time and instruction information of duplicate removal flow, and multiple business hours windows for recording duplicate removal flow are determined according to preset flow configuration information and business generation time, and then according to instruction information, duplicate removal flow is recorded respectively under multiple business hours windows.The present invention records duplicate removal flow using time window form, is conducive to more accurately record duplicate removal flow.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of duplicate removal discharge record method, apparatus, server and deposit
Storage media.
Background technique
With the development of internet technology with it is universal, the corresponding number of users of each platform is also increasing substantially, and corresponds to and uses
The growth of geometry number is also presented in the data traffic at family, this forms huge challenge for data statistics and analysis work.In numerous systems
Count in data on flows, going this index of tuple is a basis and common statistical indicator, and go the determination of tuple dependent on pair
The statistics of duplicate removal flow.Therefore, better duplicate removal logic how is established to record duplicate removal flow, become one it is urgently to be resolved
The problem of.
Summary of the invention
The embodiment of the invention provides a kind of duplicate removal discharge record method, apparatus, server and storage mediums, using the time
Window shape formula records duplicate removal flow, is conducive to more accurately record duplicate removal flow.
In a first aspect, the embodiment of the invention provides a kind of duplicate removal discharge record method, this method includes：
In the case where receiving message, the fields points information of the message is obtained, and true according to the fields points information
Make the corresponding flow of the message whether be and the matched duplicate removal flow of preset flow configuration information；
If the corresponding flow of the message be with the matched duplicate removal flow of the preset flow configuration information, described in parsing
Fields points information simultaneously determines that the business generation time of the duplicate removal flow and instruction information, the instruction information are used to indicate to institute
It states duplicate removal flow and executes flow add operation or flow reducing；
It is determined according to the preset flow configuration information and the business generation time for recording the duplicate removal flow
Multiple business hours windows, each business hours window respectively corresponds to different time grains in the multiple business hours window
Degree；
According to the instruction information, the duplicate removal flow is recorded respectively under the multiple business hours window.
In one embodiment, the preset flow configuration information includes the time precision of record, described according to described pre-
If flow configuration information and the business generation time determine multiple business hours windows for recording the duplicate removal flow
Specific embodiment be：
The time precision of the record is obtained from the preset flow configuration information, and according to the time of record essence
Degree determines that minimum time granularity window and time small time granularity window, the time granularity of the minimum time granularity window are less than
The time granularity of described small time granularity window；
The corresponding minimum time granularity window of the business generation time is determined as minimal service time window, it will
The corresponding described small time granularity window of the business generation time is determined as time small business hours window；
It is determined based on the minimal service time window and described small business hours window for recording the duplicate removal
Multiple business hours windows of flow.
In one embodiment, the instruction information, which is used to indicate, executes flow add operation to the duplicate removal flow, described
According to the instruction information, the specific embodiment of the duplicate removal flow is recorded respectively under the multiple business hours window
For：
The instruction information is parsed, is used to indicate in the instruction information and behaviour is added to the duplicate removal flow execution flow
In the case where work, judge whether the duplicate removal flow is repetitive stream amount；
If the duplicate removal flow is not the repetition flow, gone respectively to described under the multiple business hours window
The number that density current amount occurs, which executes, increases operation；
If the duplicate removal flow is the repetition flow, to each business hours window in the multiple business hours window
The number that the duplicate removal flow under mouthful occurs remains unchanged.
In one embodiment, the instruction information, which is used to indicate, executes flow reducing to the duplicate removal flow, described
According to the instruction information, the specific embodiment of the duplicate removal flow is recorded respectively under the multiple business hours window
For：The instruction information is parsed, determines whether the instruction information is used to indicate and the duplicate removal flow execution flow is subtracted
Operation；If the instruction information is to be used to indicate to execute the flow reducing to the duplicate removal flow, in the multiple industry
It is engaged in respectively executing the number that the duplicate removal flow occurs under time window and reduces operation.
In one embodiment, the preset flow configuration information further includes failure duration threshold value, described the multiple
After recording the duplicate removal flow under business hours window respectively, timing can also be opened for the multiple business hours window
Function；It, will be under the multiple time window in the case where current institute's timing length is more than or equal to the failure duration threshold value
The record data of the duplicate removal flow are deleted.
In one embodiment, the multiple business hours window includes that the minimal service time window and described time are small
Business hours window, it is described to judge whether the duplicate removal flow is that the specific embodiment of repetitive stream amount is：Determine the duplicate removal
The current number that flow is recorded under the minimal service time window；It is more than or equal to number threshold in the current number
In the case where value, then judge the duplicate removal flow for repetitive stream amount.
In one embodiment, the preset flow configuration information further includes flow Rule Information, the flow rule letter
It include statistics duration in breath, it is described to determine whether the corresponding flow of the message is to flow with default according to the fields points information
It, can be with after measuring the matched duplicate removal flow of configuration information：Obtain the institute in present system time and the flow Rule Information
State statistics duration；The statistical time for the duplicate removal flow is determined according to the present system time and the statistics duration
Section；Obtain the record data of all business hours windows in the statistical time section；If true according to the record data
The fixed duplicate removal flow meets the corresponding flow rule of the flow Rule Information, then exports warning message.
Second aspect, the embodiment of the invention provides a kind of duplicate removal discharge record device, the duplicate removal discharge record device packets
Include the module of the method for executing above-mentioned first aspect.
The third aspect, the embodiment of the invention provides a kind of server, which includes processor, network interface and deposits
Reservoir, the processor, network interface and memory are connected with each other, wherein control of the network interface by the processor
For messaging, the memory is used to store the computer program for supporting server to execute the above method, the computer
Program includes program instruction, and the processor is configured for calling described program instruction, the method for executing above-mentioned first aspect.
Fourth aspect, the embodiment of the invention provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, and the computer program includes program instruction, and described program instructs when being executed by a processor
The method for making the processor execute above-mentioned first aspect.
In the embodiment of the present invention, server obtains the fields points information of institute's message, and root in the case where receiving message
According to fields points information determine the corresponding flow of outgoing packet whether be with the matched duplicate removal flow of preset flow configuration information, if so,
It then parses fields points information and determines the business generation time and instruction information of duplicate removal flow, and according to preset flow configuration information
Multiple business hours windows for recording duplicate removal flow are determined with business generation time, and then according to the instruction information,
Duplicate removal flow is recorded respectively under multiple business hours windows.Duplicate removal flow is recorded using time window form, it is more accurate to be conducive to
Duplicate removal flow is recorded.
Detailed description of the invention
Technical solution in order to illustrate the embodiments of the present invention more clearly, below will be to needed in embodiment description
Attached drawing is briefly described, it should be apparent that, drawings in the following description are some embodiments of the invention, general for this field
For logical technical staff, without creative efforts, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of flow diagram of duplicate removal discharge record method provided in an embodiment of the present invention；
Fig. 2 is a kind of schematic diagram of flow configuration operation interface provided in an embodiment of the present invention；
Fig. 3 is the flow diagram of another duplicate removal discharge record method provided in an embodiment of the present invention；
Fig. 4 is a kind of schematic diagram of flow rule configuration operation interface provided in an embodiment of the present invention；
Fig. 5 is a kind of schematic block diagram of duplicate removal discharge record device provided in an embodiment of the present invention；
Fig. 6 is a kind of schematic block diagram of server provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
It is a kind of flow diagram of duplicate removal discharge record method provided in an embodiment of the present invention referring to Fig. 1, Fig. 1, such as schemes
Shown, which may include：
101, server obtains the fields points information of message in the case where receiving message, and according to fields points information
Determine the corresponding flow of outgoing packet whether be and the matched duplicate removal flow of preset flow configuration information.
In one embodiment, user can configure the page by flow and configure in advance to flow, the purpose of configuration
It is to determine and which kind of flow to carry out discharge record to, the present invention is mainly configured to density current amount, records to duplicate removal flow.
Wherein, duplicate removal flow is that concern difference removes the flows of weight values, this, which goes weight values, to be a unique identification, as device number, ID number,
Account etc..For example, flow is with device number different user transaction count, wherein the unique identification of the user can be
User account, then the user account is then weight values, this flow pays close attention to different users (going weight values), then to remove density current
Amount.
Further, duplicate removal flow configuration particular content (i.e. preset flow configuration information) may include to record when
Between precision (such as minute), (it is different to can be described as same device number to flow description information for namely the description to flow, such as a flow
Customer transaction number of success), statistical dimension (such as IP address), (static fields can for example correspond to different user to static fields
Account), time type and add operation or reducing corresponding identifier are executed when discharge record, identified as add operation is corresponding
Symbol is " 001 ", and it is " 002 " that reducing, which corresponds to identifier,.After the completion of user is to the configuration of duplicate removal flow, server can need
When obtain above-mentioned flow configuration information namely user pass through flow configure page configuration particular content.
Wherein, the flow configuration page can be as shown in Fig. 2, " use figure it is seen that being configured with device number difference
This duplicate removal flow (i.e. flow description information) of family transaction count " and statistical dimension are such as IP address, and static fields are account
Unique identification (such as device number), and the time precision of record is minute, when discharge record, add operation corresponds to identifier and is
" 001 ", it is " 002 " that reducing, which corresponds to identifier,.
It in one embodiment, can be by the fields points information and step of message in the case that server receives message
Flow configuration information in 101 is compared, and then determines whether the corresponding flow of the message is and presets according to comparison result
The matched duplicate removal flow of flow configuration information.Wherein, which may include multiple fields points, each fields points in multiple fields points
And the corresponding value of each fields points is then the fields points information of message mentioned above.
Illustratively, it is assumed that flow configures the page as shown in Fig. 2, the duplicate removal flow of configuration is to hand over device number different user
Easy number of success, the message that system receives are as follows：
Wherein, " event timestamp ", " event id ", " user name ", " ip " and " device " etc. is
The fields points for including in message, the corresponding value of each fields points characterize the business generation time " 2018-05- of the message respectively
0316：11：34 ", the corresponding transaction success status code " 001 " of the message, user name, the address ip " 1.1.1.1 " and device number
Deng.Just corresponding flow configures the time type in the page to the fields points " event timestamp "；The value of fields points " device "
Statistical dimension in the corresponding flow configuration page；Static fields in the corresponding flow configuration page of fields points " user name ", namely
Characterize different accounts (such as user U1, U2 or U3)；The value of " event id " corresponds to the identifier in the flow configuration page,
The corresponding identifier of add operation " 001 " in " event id=001 " corresponding flow configuration page, " event id=002 " is corresponding
Flow configures the corresponding identifier of add operation " 002 " in the page.
In this case, after server receives message, the corresponding each fields points of message can be obtained by analytic message
" event timestamp ", " device " and " user name " etc. and the corresponding value of each fields points, what be will acquire is each
Fields points and corresponding value are compared with time type, statistical dimension and the static fields in flow configuration information, can
To determine that each fields points with flow configuration information are matched, and then it can determine that the corresponding flow of the message is and the stream
Measure the matched duplicate removal flow of configuration information.
If 102, server determine the corresponding flow of outgoing packet be with the matched duplicate removal flow of preset flow configuration information,
Parsing fields points information simultaneously determines that the business generation time of duplicate removal flow and instruction information, the instruction information are used to indicate to going
Density current amount executes flow add operation or flow reducing.
In one embodiment, server determine the corresponding flow of the message be duplicate removal flow after, on the one hand can root
Determine that the business of the duplicate removal flow produces according to the corresponding value of event time fields points (such as " event timestamp ") in message
The raw time, such as " event timestamp " corresponding value is 2018-05-03 16：11：34, then business generation time is then
It can be determined as 11 minutes and 34 seconds 16 points of on May 3rd, 2018.It on the other hand, can be by identification transaction code fields points (such as
" device ") corresponding value (as " 001 " or " 002 "), determine that executing flow add operation to this duplicate removal flow still executes
Flow reducing, namely determine the instruction information for the duplicate removal flow.For example, server recognizes fields points " device "
When corresponding value is " 001 ", then the instruction information for being used to indicate and executing flow add operation to the duplicate removal flow, identification can be generated
To fields points " device " it is corresponding value be " 002 " when, then can be generated be used to indicate to the duplicate removal flow execute flow subtract behaviour
The instruction information of work.
103, server is determined according to preset flow configuration information and business generation time for recording the duplicate removal flow
Multiple business hours windows, each business hours window respectively corresponds to different time grains in multiple business hours window
Degree.
In one embodiment, preset flow configuration information includes the time precision of record, and server can be from default stream
Obtain the time precision of record in amount configuration information, and according to the time precision of the record determine minimum time granularity window and
Secondary small time granularity window, and then the corresponding minimum time granularity window of business generation time is determined as minimal service time window
Mouthful, corresponding small time granularity window of business generation time is determined as time small business hours window, and be based on minimal service
Time window and time small business hours window determine multiple business hours windows for recording duplicate removal flow.Wherein, this is most
The time granularity of small time granularity window is less than the time granularity of time small time granularity window.
Wherein, above-mentioned time small time granularity window may include one or more, the minimum time granularity window when
Between granularity time granularity corresponding with the time precision of above-mentioned record be consistent, namely record time precision be minute, that
The time granularity of minimum particle size window may be minute.
Illustratively, the time precision recorded in flow configuration information is minute, the business generation time of the duplicate removal flow
For on May 3rd, 2018 16 points 23 seconds 11 minutes.In this case, when server can determine minimum according to the time precision
Between granularity window be minute class windows, secondary small time granularity window can be determined as hour class windows and day class windows.
Further, server can be in conjunction with the business generation time of duplicate removal flow, by 2018-05-03T16：11：00 is determined as business
The corresponding minute class windows of generation time (16 points of on May 3rd, 1 11 minutes and 23 seconds), that is, be determined as the minimal service time
Window；By 2018-05-03T16：00：00 and 2018-05-03T00：00：00 is identified as the 16: 11 of on May 3rd, 2018
Divide 23 seconds corresponding hour class windows and day class windows, that is, is determined as time small business hours window.It further, then can be with
Based on the minimal service time window determined and time small business hours window, by time window 2018-05-03T16：11：
00,2018-05-03T16：00：00 and 2018-05-03T00：00：00 when being determined as multiple business for recording duplicate removal flow
Between window.As can be seen that each business hours window has divided priority level according to time granularity, wherein minute rank is minimum
Rank, hour rank are taken second place, and day rank is third.
104, server records the duplicate removal flow according to the instruction information respectively under multiple business hours windows.
Wherein, which, which is used to indicate, executes flow add operation or flow reducing to duplicate removal flow.At one
It, can be first when server, which recognizes the instruction information, to be used to indicate to the execution flow add operation of duplicate removal flow in embodiment
Determine whether the duplicate removal flow is repetitive stream amount, if it is flow is repeated, then this duplicate removal flow is not recorded；If no
It is to repeat flow, then the number that the duplicate removal flow occurs is executed under each business hours window determined and increase operation.
Alternatively, then may be used when server recognizes the instruction information and is used to indicate to the execution flow reducing of duplicate removal flow
Operation is reduced to execute under each business hours window determined to the number that the duplicate removal flow occurs.
In the embodiment of the present invention, server obtains the fields points information of institute's message, and root in the case where receiving message
According to fields points information determine the corresponding flow of outgoing packet whether be with the matched duplicate removal flow of preset flow configuration information, if so,
Then parse business generation time and instruction information that fields points information determines duplicate removal flow, and according to preset flow configuration information and
Business generation time determines multiple business hours windows for recording duplicate removal flow, and then according to the instruction information, more
Duplicate removal flow is recorded respectively under a business hours window.The embodiment of the present invention records duplicate removal flow using time window form, favorably
In more accurately being recorded to duplicate removal flow.
It is the flow diagram of another duplicate removal discharge record method provided in an embodiment of the present invention referring to Fig. 3, Fig. 3, such as
Shown in figure, which may include：
301, server obtains the fields points information of message in the case where receiving message, and according to fields points information
Determine the corresponding flow of outgoing packet whether be and the matched duplicate removal flow of preset flow configuration information.
If 302, server determine the corresponding flow of outgoing packet be with the matched duplicate removal flow of preset flow configuration information,
Parsing fields points information and the business generation time and instruction information for determining duplicate removal flow.
303, server is determined according to preset flow configuration information and business generation time for recording the duplicate removal flow
Multiple business hours windows.
Wherein, the specific implementation of step 301- step 303 may refer to step 101- step in above-described embodiment
103 associated description, details are not described herein by the present invention.
304, server records the duplicate removal flow according to the instruction information respectively under multiple business hours windows.
In one embodiment, server can parse the instruction information, determine to indicate that information is used to indicate to this
In the case that duplicate removal flow executes flow add operation, judge whether the duplicate removal flow is repetitive stream amount, if the duplicate removal flow is not
Flow is repeated, then the number that duplicate removal flow occurs is executed respectively under multiple business hours windows and increases operation, if the duplicate removal
Flow is repetitive stream amount, then time occurred to the duplicate removal flow under each business hours window in multiple business hours windows
Number remains unchanged.
Wherein, server judges whether duplicate removal flow is that the specific implementation of repetitive stream amount can be：Server determines
The current number that duplicate removal flow is recorded under minimal service time window is more than or equal to frequency threshold value in current number
In the case of, then judge the duplicate removal flow for repetitive stream amount.
Illustratively, it is assumed that a duplicate removal flow is described below：With device number different user transaction number of success.Every
Default when transaction successfully, so numerical value can be added 1 on handing over incident time point by default.For example, this friendship received
Easy message is A, and a transaction message B is also had received before this transaction message.Wherein, transaction message A is characterized 2018 5
16 points of 54 seconds 11 minutes user U1 of the moon 3 are traded by equipment D, when transaction request is initiated, when receiving message A
When this transaction of system default successfully (majority of case is also all successful).Transaction message B characterizes on May 3rd, 2018
16 points have within 23 seconds 11 minutes a user U1 by equipment D (may be mobile phone, computer, plate etc.) traded, trading
When request is initiated, when this transaction of system default successfully (majority of case is also all successful) when receiving message B,
The record for corresponding to duplicate removal flow to this message B under each business hours window is as follows：
Equipment D-2018-05-03T16：11：00 → [(U1,1)], for characterizing equipment D in 2018-05-03T16：11：
There is the record of one [(U1,1)] on 00 time point (time window of minute rank)；
Equipment D-2018-05-03T16：00：00 → [(U1,1), for characterizing equipment D in 2018-05-03T16：00：00
Time point (time window of hour rank) on have the record of one [(U1,1)]；
Equipment D-2018-05-03T00：00：00 → [(U1,1)], for characterizing equipment D in 2018-05-03T00：00：
There is the record of one [(U1,1)] on 00 time point (time window of day rank).
In this case, when receiving transaction message A, analytic message A determines that outgoing packet A is corresponding and goes weight values for U1,
Namely user is U1；Corresponding business generation time be on May 3rd, 2018 16 points 23 seconds 11 minutes, the business generation time pair
The minimum time window namely minimal service time window answered are 2018-05-03T16：11：00, the minimal service time window
Under about U1 duplicate removal flow record [(U1,1)], pass through analysis minimal service time window 2018-05-03T16：11：00
Under value, the duplicate removal flow about U1 can be determined in 2018-05-03T16：11：It was had already appeared under 00 this window, i.e. U1
Number is more than or equal to 1 (i.e. frequency threshold value), then may determine that the duplicate removal flow is repetitive stream amount, then keep May 3 in 2018
Number 16 points of 23 seconds 11 minutes all business hours window U1 duplicate removal flow number it is constant, namely now each business hours window
Record be still：
Equipment D-2018-05-03T16：11：00 → [(U1,1)]
Equipment D-2018-05-03T16：00：00 → [(U1,1)]
Equipment D-2018-05-03T00：00：00 → [(U1,1)]
Further, the time elapses backward, 11 minutes and 55 seconds 16 points of on May 3rd, 2018, has received a transaction message C, hands over
Easy message C characterizes 16 points of 54 seconds 11 minutes user U2 on May 3rd, 2018 and is traded by equipment D.Analytic message C, really
Make message C it is corresponding to go weight values be U2,16 points of the corresponding business generation time of message C on May 3rd, 2,018 11 minutes and 55 seconds,
The corresponding minimal service time window of the business generation time is (2018-05-03T16：11：00) and when the minimal service
Between the data that record under window be [(U1,1)], pass through analysis 2018-05-03T16：11：Record under 00 this time window
Data can determine the corresponding duplicate removal flow in U1 of weight values U2 in 2018-05-03T16：11：Do not go out under 00 this window
It now crosses, then may determine that the duplicate removal flow not is to repeat flow, then in 16 points of 55 seconds 11 minutes corresponding institutes on May 3rd, 2018
The flow for having business hours window to execute the duplicate removal flow about U2 increases operation, and the result executed after increasing operation is as follows：
Equipment D-2018-05-03T16：11：00 → [(U1,1), (U2,1)]
Equipment D-2018-05-03T16：00：00 → [(U1,1), (U2,1)]
Equipment D-2018-05-03T00：00：00 → [(U1,1), (U2,1)]
In one embodiment, server can also parse instruction information, determine whether instruction information is used to indicate to described
Duplicate removal flow executes the flow reducing, if the instruction information, which is used to indicate, executes flow reducing to duplicate removal flow,
The number that the duplicate removal flow occurs is executed respectively under multiple business hours windows and reduces operation.
Illustratively, example receives transaction message A, B and C in front, and in each business hours window to A, B and C
On the basis of corresponding duplicate removal flow is recorded, the time elapses backward, 16 points of on May 3rd, 2,018 14 minutes and 43 seconds, receives
To a transaction message F, transaction message F characterize 16 points of 23 seconds 11 minutes user U1 on May 3rd, 2018 by equipment D into
Capable Fail Transaction.Analytic message F, determine outgoing packet F it is corresponding go weight values be U1, corresponding business generation time 2018 5
16 points of the moon 3 11 minutes and 23 seconds, and indicate that information is used to flow away weight to this and execute flow reducing.In this case, it obtains
Take current all business hours windows and corresponding value as follows：
Equipment D-2018-05-03T16：11：00 → [(U1,1), (U2,1)]
Equipment D-2018-05-03T16：00：00 → [(U1,1), (U2,1)]
Equipment D-2018-05-03T00：00：00 → [(U1,1), (U2,1)]
It is executed so under all business hours windows as follows about the result after the flow reducing of the duplicate removal flow of U1：
Equipment D-2018-05-03T16：11：00 → [(U1,0), (U2,1)]
Equipment D-2018-05-03T16：00：00 → [(U1,0), (U2,1)]
Equipment D-2018-05-03T00：00：00 → [(U1,0), (U2,1)]
In one embodiment, above-mentioned preset flow configuration information further includes failure duration threshold value, and server is in multiple industry
Business time window under record duplicate removal flow respectively after, can also for multiple business hours windows open clocking capability, and
In the case where the long duration threshold value more than or equal to failure of current institute's timing, by the note of duplicate removal flow described under multiple time windows
Data are recorded to delete.
For example, failure duration threshold value be 1 hour, server recorded respectively under multiple business hours windows duplicate removal flow it
Afterwards, the record data under multiple business hours windows are：
Equipment D-2018-05-03T16：11：00 → [(U1,1)]
Equipment D-2018-05-03T16：00：00 → [(U1,1)]
Equipment D-2018-05-03T00：00：00 → [(U1,1)]
It in this case, can be with needle after server records duplicate removal flow under above-mentioned multiple business hours windows respectively
Clocking capability is opened to multiple business hours windows, records current initial time.Such as current initial time is 2018-
05-03T16：11：00, then in current time by 2018-05-03T16：11：00 becomes 2018-05-03T17：11：When 00,
It can then determine that current institute's timing is long to be equal to 1 hour, then delete the record data under three above business hours window.It adopts
In such a way, it is possible to reduce to the EMS memory occupation of memory space.
305, server obtains the statistics duration in present system time and preset flow Rule Information.
306, server determines the statistical time section for the duplicate removal flow according to present system time and statistics duration.
In one embodiment, user can then be configured by flow rule page convection current gauge, configuration it is specific
Content (i.e. preset flow Rule Information) may include：Duration, flow rule are counted (as device number different user is traded successfully
4) number is greater than, the configuration page can be as shown in Figure 4.Figure 4, it is seen that the flow rule of configuration is with device number difference
Customer transaction number of success is greater than 4, and when statistics is 1 hour a length of, and the flow of execution this flow rule of configuration is " same to device number
This duplicate removal flow of different user transaction number of success ".
Further, when server determines that the corresponding flow of outgoing packet is with preset flow with confidence according to fields points information
It after ceasing matched duplicate removal flow, can also detect whether to open duplicate removal traffic statistic function, if had turned on, acquisition is worked as
Preceding system time, and the statistical time section for the duplicate removal flow is determined according to present system time and statistics duration.One
In a embodiment, which can be divided into hour rank and minute rank, for different time ranks, server according to
The statistical time section for the duplicate removal flow that present system time and statistics duration are determined is different.Specifically, it is uniting
It when a length of hour rank of timing, indicates since present system time corresponding time point within one hour, takes this time point place
Hour window, such as present system time corresponding time point be 2018-05-03T16：11：00, then this this it is small
When refer to 2018-05-03T16：00：00 arrives 2018-05-03T16：11：00 this 11 minutes, this 11 minutes were the system determined
Count the period.Alternatively, indicated since present system time corresponding time point within m minutes in statistics when a length of minute rank,
M (m is the number greater than 0) minute is retrodicted, such as m is 60, present system time corresponding time point is 2018-05-03T16：11：
00, then from 2018-05-03T16：11：00 starts to retrodict 60 minutes time range 2018-05-03T15：11：00 arrives
2018-05-03T16：11：00 this 60 minutes, then the statistical time section to determine.
307, server obtains the record data of all business hours windows in statistical time section.
If 308, server determines that the duplicate removal flow meets the corresponding flow of flow Rule Information according to the record data
Rule then exports warning message.
Illustratively, preconfigured flow rule is that number of success is traded with device number different user greater than 10 times, is held
A length of 2018-05-03T16 when the statistics that row step 206 is determined：00：00 arrives 2018-05-03T16：11：00 this 11 minutes,
The record data (the duplicate removal flow recorded) of all business hours windows are as follows in this 11 minutes：
1) equipment D-2018-05-04T10：08：00 → [] [] indicates not being free, without flow
2) equipment D-2018-05-04T10：07：00→[]
3) equipment D-2018-05-04T10：06：00→[]
4) equipment D-2018-05-04T10：05：00→[]
5) equipment D-2018-05-04T10：04：00→[]
6) equipment D-2018-05-04T10：03：00→[]
7) equipment D-2018-05-04T10：03：00→[]
8) equipment D-2018-05-04T10：02：00 → [(U101,1)]
9) equipment D-2018-05-04T10：01：00 → [(U1,1), (U2,1) ... (U10,1)] has 10 users to be remembered
Record is got off
10) equipment D-2018-05-04T10：00：00 → [(U1,1), (U2,1) ... (U11,1)] has 11 user's quilts
It records
11) equipment D-2018-05-04T9：59：00 → [(U1,1), (U2,1) ... (U100,1)] has 100 user's quilts
It records.
Wherein, U1-U101 represents different users, namely goes weight values.Server gets all business hours windows
After above-mentioned record data, the data under all of above business hours window can all be taken out, then one share 101 it is different
User, namely be greater than 10 with device number different user transaction number of success for 101,101, then it may determine that this duplicate removal flow is full
Sufficient flow rule, then can export warning message, be conducive to risk control.
In one embodiment, server can will be counted when counting to the duplicate removal flow in statistical time section
Period resolves to the time window set being made of the time window of multiple and different time granularities.For example, statistical time section is 2014
On January 2, on November 1, to 2016 can be broken down into 2014 according to the initial time of this time and deadline
November, in December, 2014,2015, on January 1st, 2016, on January 2nd, 2016, this 5 periods.
Illustratively, it is assumed that the time precision of record is minute, the statistics duration configured in the flow rule configuration page
It is 60*24*2 minutes, server determines that the corresponding flow of outgoing packet is and the matched duplicate removal flow of preset flow configuration information
Time is 2018-05-03T16：11：34 because flow rule configuration when using time precision be minute, 34 seconds when
Between returned time point where 11 points, 2018-05-03T16：11：34 corresponding time points should be 2018-05-
01T16：11：00, server can determine that the statistical time section of the duplicate removal flow is 2018-05- according to statistics duration
03T16：11：34 retrodict 60*24*2 minutes this time range.It is calculated in the duplicate removal flow treated in statistical time section
When, the time window of all minutes ranks in the period to be counted can all be taken out, from 2018-05-01T16：11：00
Start, takes
2018-05-01T16：12：00
2018-05-01T16：13：00
2018-05-01T16：14：00
…
2018-05-01T16：58：00
2018-05-01T16：59：00
2018-05-01T17：00：00
2018-05-01T17：01：00
2018-05-01T17：02：00
…
2018-05-01T18：00：00
2018-05-01T18：01：00
2018-05-01T18：02：00
…
2018-05-01T19：00：00
2018-05-01T19：01：00
2018-05-01T19：02：00
…
2018-05-01T19：00：00
2018-05-01T19：01：00
2018-05-01T19：02：00
…
2018-05-01T23：58：00
2018-05-01T23：59：00
2018-05-02T00：00：00
2018-05-02T00：01：00
…
2018-05-02T23：58：00
2018-05-02T23：59：00
2018-05-03T00：00：00
2018-05-03T00：01：00
…
2018-05-03T01：00：00
…
2018-05-03T02：00：00
…
2018-05-03T15：59：00
2018-05-03T16：00：00
2018-05-03T16：01：00
…
2018-05-03T16：11：00
Come to 60*24*2=2880 minute rank time window.In response to this, each minute grade can be identified
Whether other time window is all in the time dimension of other higher levels, if corresponding hour, day dimension all can carried out
Merging.Such as in minute list above, 2018-05-02T00：00：00 to 2018-05-02T23：59：All points in 00
In clock list all time windows corresponding to this day of 2018-05-02,2018-05-01T17：00：00 to 2018-05-
01T17：59：00 all in corresponding hour time window.Statistical time section after merging includes 23 hour windows, respectively
As follows：
2018-05-01T17
2018-05-01T18
2018-05-01T19
2018-05-01T20
2018-05-01T21
2018-05-01T22
2018-05-01T23
2018-05-03T00
2018-05-03T01
2018-05-03T02
…
2018-05-03T15
It further include this day corresponding day time window 1 of 2018-05-02 after merging, and the minutes that can not merge
Window：2018-05-01T16：12：00 to 2018-05-01T16：59：00,2018-05-03T16：00：00 to 2018-05-
03T16：11：00, get off only to need to take altogether day time window 1+hour time window, 23+minutes window 60 in this way
A=84 time windows, about it is reduced to original 1/40.When the corresponding time span of flow rule is bigger, effect of optimization is got over
Obviously.The quantity of institute's extraction time window can be reduced, the statistical efficiency of duplicate removal flow is improved.
In the embodiment of the present invention, server can obtain the fields points information of institute's message in the case where receiving message,
And according to fields points information determine the corresponding flow of outgoing packet whether be with the matched duplicate removal flow of preset flow configuration information, if
It is the business generation time and instruction information for then parsing fields points information and determining duplicate removal flow, and is configured according to preset flow
Information and business generation time determine multiple business hours windows for recording duplicate removal flow, and then are believed according to the instruction
Breath, records duplicate removal flow under multiple business hours windows respectively.Further, server can also obtain present system time
With the statistics duration in preset flow Rule Information, determined according to present system time and statistics duration for the duplicate removal flow
Statistical time section, and the record data of all business hours windows in statistical time section are obtained, if server is according to the note
Record data determine that the duplicate removal flow meets the corresponding flow rule of flow Rule Information, then export warning message.It on the one hand can be with
Duplicate removal flow is recorded using time window form, is conducive to more accurately record duplicate removal flow, it on the other hand can be
In the case that duplicate removal flow meets flow rule, warning message is exported, the control to risk is conducive to.
The embodiment of the invention also provides a kind of duplicate removal discharge record device, the device is for executing earlier figures 1 or Fig. 3
The module of the method.It specifically, is a kind of showing for duplicate removal discharge record device provided in an embodiment of the present invention referring to Fig. 5
Meaning block diagram.The duplicate removal discharge record device of the present embodiment includes：Obtain module 50, determining module 51 and logging modle 52.
Module 50 is obtained, in the case where receiving message, obtaining the fields points information of the message；
Determining module 51, the fields points information for being got according to acquisition module 50 determine that the message is corresponding
Flow whether be and the matched duplicate removal flow of preset flow configuration information；
Determining module 51 is also used to if it is determined that the corresponding flow of the message is matched with preset flow configuration information
Duplicate removal flow then parses the fields points information and determines the business generation time and instruction information of the duplicate removal flow, described
Instruction information, which is used to indicate, executes flow add operation or flow reducing to the duplicate removal flow；
Determining module 51 is also used to determine to be used for according to the preset flow configuration information and the business generation time
Multiple business hours windows of the duplicate removal flow are recorded, each business hours window is respectively in the multiple business hours window
Corresponding different time granularity；
Logging modle 52, described in being recorded respectively under the multiple business hours window according to the instruction information
Duplicate removal flow.
In one embodiment, the preset flow configuration information include record time precision, the determining module 51,
Specifically for obtaining the time precision of the record from the preset flow configuration information, and according to the time of record essence
Degree determines that minimum time granularity window and time small time granularity window, the time granularity of the minimum time granularity window are less than
The time granularity of described small time granularity window；The corresponding minimum time granularity window of the business generation time is true
It is set to minimal service time window, the corresponding described small time granularity window of the business generation time is determined as time small industry
Business time window；It is determined based on the minimal service time window and described small business hours window for recording described go
Multiple business hours windows of density current amount.
In one embodiment, the instruction information, which is used to indicate, executes flow add operation to the duplicate removal flow, described
According to the instruction information, logging modle 52 is specifically used for parsing the instruction information, is used to indicate pair in the instruction information
In the case that the duplicate removal flow executes the flow add operation, judge whether the duplicate removal flow is repetitive stream amount；If described
Duplicate removal flow is not time for repeating flow, then occurring respectively to the duplicate removal flow under the multiple business hours window
Number, which executes, increases operation；If the duplicate removal flow is the repetition flow, to each industry in the multiple business hours window
The number that the duplicate removal flow under business time window occurs remains unchanged.
In one embodiment, the instruction information, which is used to indicate, executes flow reducing to the duplicate removal flow, described
According to the instruction information, logging modle 52 is specifically also used to parse the instruction information, determines whether the instruction information is used
The flow reducing is executed to the duplicate removal flow in instruction；If the instruction information is used to indicate to the duplicate removal flow
The flow reducing is executed, then the number that the duplicate removal flow occurs is executed respectively under the multiple business hours window
Reduce operation.
In one embodiment, the preset flow configuration information further includes failure duration threshold value, and described device further includes：
Timing module 53 and removing module 54, wherein：
Timing module 53, for opening clocking capability for the multiple business hours window；
Removing module 54, for being more than or equal to the failure duration threshold value in the current institute's timing of timing module 53 length
In the case of, the record data of duplicate removal flow described under the multiple time window are deleted.
In one embodiment, the multiple business hours window includes that the minimal service time window and described time are small
Business hours window, the logging modle 52 are specifically also used to determine the duplicate removal flow in the minimal service time window
Lower recorded current number；In the case where the current number is more than or equal to frequency threshold value, then the duplicate removal is judged
Flow is repetitive stream amount.
In one embodiment, the preset flow configuration information further includes flow Rule Information, the flow rule letter
It include statistics duration in breath, described device further includes output module 55, wherein：
Module 50 is obtained, is also used to obtain the statistics duration in present system time and the flow Rule Information；
Determining module 51 is also used to be determined according to the present system time and the statistics duration for the duplicate removal
The statistical time section of flow；
Module 50 is obtained, is also used to obtain the record data of all business hours windows in the statistical time section；
Output module 55, if for determining that the duplicate removal flow meets the flow rule and believes according to the record data
Corresponding flow rule is ceased, then exports warning message.
It should be noted that the function of each functional module of duplicate removal discharge record device can described in the embodiment of the present invention
According in embodiment of the method described in Fig. 1 perhaps Fig. 3 method implement its specific implementation process be referred to Fig. 1 or
The associated description of the embodiment of the method for Fig. 3, details are not described herein again.
Fig. 6 is referred to, Fig. 6 is a kind of schematic block diagram of server provided in an embodiment of the present invention.As shown in fig. 6, should
Server includes processor 601, memory 602 and network interface 603.Above-mentioned processor 601, memory 602 and network interface
603 can be connected by bus or other modes, in Fig. 6 shown in the embodiment of the present invention for being connected by bus.Wherein, net
Network interface 603 is used for messaging by the control of the processor, and memory 602 is for storing computer program, the calculating
Machine program includes program instruction, and processor 601 is used to execute the program instruction of the storage of memory 602.Wherein, 601 quilt of processor
It is configured to call described program instruction execution：In the case where receiving message, the fields points information of the message is obtained, and
According to the fields points information determine the corresponding flow of the message whether be and the matched duplicate removal of preset flow configuration information
Flow；If the corresponding flow of the message be with the matched duplicate removal flow of the preset flow configuration information, parse the word
Section point information simultaneously determines that the business generation time of the duplicate removal flow and instruction information, the instruction information are used to indicate to described
Duplicate removal flow executes flow add operation or flow reducing；When being generated according to the preset flow configuration information and the business
Between determine multiple business hours windows for recording the duplicate removal flow, each business in the multiple business hours window
Time window respectively corresponds to different time granularities；According to the instruction information, under the multiple business hours window respectively
Record the duplicate removal flow
It should be appreciated that in embodiments of the present invention, alleged processor 601 can be central processing unit (Central
Processing Unit, CPU), which can also be other general processors, digital signal processor (Digital
Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit,
ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic
Device, discrete gate or transistor logic, discrete hardware components etc..General processor can be microprocessor or this at
Reason device is also possible to any conventional processor etc..
The memory 602 may include read-only memory and random access memory, and to processor 601 provide instruction and
Data.The a part of of memory 602 can also include nonvolatile RAM.For example, memory 602 can also be deposited
Store up the information of device type.
In the specific implementation, processor 601 described in the embodiment of the present invention, memory 602 and network interface 603 can be held
Implementation described in embodiment of the method described in row Fig. 1 or Fig. 3 provided in an embodiment of the present invention, also can be performed the present invention
The implementation of duplicate removal discharge record device described in embodiment, details are not described herein.
A kind of computer readable storage medium, the computer-readable storage medium are provided in another embodiment of the invention
Matter is stored with computer program, and the computer program includes program instruction, realization when described program instruction is executed by processor：
In the case where receiving message, the fields points information of the message is obtained, and determined according to the fields points information described
The corresponding flow of message whether be and the matched duplicate removal flow of preset flow configuration information；If the corresponding flow of the message be with
The matched duplicate removal flow of preset flow configuration information then parses the fields points information and determines the industry of the duplicate removal flow
Generation time of being engaged in and instruction information, the instruction information, which is used to indicate, executes flow add operation or flow to the duplicate removal flow
Reducing；It is determined according to the preset flow configuration information and the business generation time for recording the duplicate removal flow
Multiple business hours windows, each business hours window respectively corresponds to different time grains in the multiple business hours window
Degree；According to the instruction information, the duplicate removal flow is recorded respectively under the multiple business hours window.The computer can
Reading storage medium can be the internal storage unit of server described in aforementioned any embodiment, such as the hard disk or interior of server
It deposits.The computer readable storage medium is also possible to match on the External memory equipment of the server, such as the server
Standby plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD)
Card, flash card (Flash Card) etc..Further, the computer readable storage medium can also both include the server
Internal storage unit also include External memory equipment.The computer readable storage medium is for storing the computer program
And other programs and data needed for the server.The computer readable storage medium can be also used for temporarily storing
The data that has exported or will export.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage medium
In, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
Above disclosed is only section Example of the invention, cannot limit the right of the present invention with this certainly
Range, those skilled in the art can understand all or part of the processes for realizing the above embodiment, and according to right of the present invention
Equivalent variations made by it is required that, still belongs to the scope covered by the invention.
Claims (10)
1. a kind of duplicate removal discharge record method, which is characterized in that including：
In the case where receiving message, the fields points information of the message is obtained, and determine according to the fields points information
The corresponding flow of the message whether be and the matched duplicate removal flow of preset flow configuration information；
If the corresponding flow of the message be with the matched duplicate removal flow of the preset flow configuration information, parse the field
Point information and the business generation time and instruction information for determining the duplicate removal flow, the instruction information is used to indicate goes to described
Density current amount executes flow add operation or flow reducing；
It is determined according to the preset flow configuration information and the business generation time for recording the more of the duplicate removal flow
A business hours window, each business hours window respectively corresponds to different time granularities in the multiple business hours window；
According to the instruction information, the duplicate removal flow is recorded respectively under the multiple business hours window.
2. the method according to claim 1, wherein the preset flow configuration information includes the time essence of record
Degree, it is described to be determined according to the preset flow configuration information and the business generation time for recording the duplicate removal flow
Multiple business hours windows, including：
The time precision of the record is obtained from the preset flow configuration information, and true according to the time precision of the record
Minimum time granularity window and time small time granularity window are made, the time granularity of the minimum time granularity window is less than described
The time granularity of secondary small time granularity window；
The corresponding minimum time granularity window of the business generation time is determined as minimal service time window, it will be described
The corresponding described small time granularity window of business generation time is determined as time small business hours window；
It is determined based on the minimal service time window and described small business hours window for recording the duplicate removal flow
Multiple business hours windows.
3. according to the method described in claim 2, it is characterized in that, the instruction information is used to indicate and holds to the duplicate removal flow
Row flow add operation, it is described according to the instruction information, under the multiple business hours window respectively record described in remove density current
Amount, including：
The instruction information is parsed, is used to indicate in the instruction information and the flow add operation is executed to the duplicate removal flow
In the case of, judge whether the duplicate removal flow is repetitive stream amount；
If the duplicate removal flow is not the repetition flow, density current is removed to described respectively under the multiple business hours window
The number that amount occurs, which executes, increases operation；
If the duplicate removal flow is the repetition flow, under each business hours window in the multiple business hours window
The duplicate removal flow occur number remain unchanged.
4. according to the method described in claim 2, it is characterized in that, the instruction information is used to indicate and holds to the duplicate removal flow
Row flow reducing, it is described according to the instruction information, under the multiple business hours window respectively record described in remove density current
Amount, including：
The instruction information is parsed, determines whether the instruction information is used to indicate and the duplicate removal flow execution flow is subtracted
Operation；
If the instruction information is to be used to indicate to execute the flow reducing to the duplicate removal flow, in the multiple business
The number that the duplicate removal flow occurs is executed respectively under time window and reduces operation.
5. the method according to claim 1, wherein the preset flow configuration information further includes failure duration threshold
Value, it is described record the duplicate removal flow respectively under the multiple business hours window after, the method also includes：
Clocking capability is opened for the multiple business hours window；
In the case where current institute's timing length is more than or equal to the failure duration threshold value, by institute under the multiple time window
The record data for stating duplicate removal flow are deleted.
6. according to the method described in claim 3, it is characterized in that, the multiple business hours window includes the minimal service
Time window and described small business hours window, it is described to judge whether the duplicate removal flow is repetitive stream amount, including：
Determine the current number that the duplicate removal flow is recorded under the minimal service time window；
In the case where the current number is more than or equal to frequency threshold value, then judge the duplicate removal flow for repetitive stream amount.
7. method according to claim 1-6, which is characterized in that the preset flow configuration information further includes stream
Rule Information is measured, includes statistics duration in the flow Rule Information, it is described that the report is determined according to the fields points information
The corresponding flow of text whether be with after the matched duplicate removal flow of preset flow configuration information, the method also includes：
Obtain the statistics duration in present system time and the flow Rule Information；
The statistical time section for the duplicate removal flow is determined according to the present system time and the statistics duration；
Obtain the record data of all business hours windows in the statistical time section；
If determining that the duplicate removal flow meets the corresponding flow rule of the flow Rule Information according to the record data,
Export warning message.
8. a kind of duplicate removal discharge record device, which is characterized in that including：
Module is obtained, in the case where receiving message, obtaining the fields points information of the message；
Determining module, for determining whether the corresponding flow of the message is to match with preset flow according to the fields points information
Confidence ceases matched duplicate removal flow；
Determining module is also used to determine that the corresponding flow of the message is and preset flow configuration information is matched removes density current
Amount then parses the fields points information and determines the business generation time and instruction information of the duplicate removal flow, the instruction letter
Breath, which is used to indicate, executes flow add operation or flow reducing to the duplicate removal flow；
Determining module is also used to be determined according to the preset flow configuration information and the business generation time for recording
Multiple business hours windows of duplicate removal flow are stated, each business hours window respectively corresponds to not in the multiple business hours window
Same time granularity；
Logging modle removes density current described in record respectively under the multiple business hours window for according to the instruction information
Amount.
9. a kind of server, which is characterized in that including processor and storage device, the processor and the storage device are mutual
Connection, wherein the storage device is for storing computer program, and the computer program includes program instruction, the processing
Device is configured for calling described program instruction, executes the method according to claim 1 to 7.
10. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer journey
Sequence, the computer program include program instruction, and described program instruction executes the processor such as
The described in any item methods of claim 1-7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810686101.7A CN108923967B (en) | 2018-06-27 | 2018-06-27 | Duplication-removing flow recording method, duplication-removing flow recording device, server and storage medium |
| PCT/CN2018/108470 WO2020000742A1 (en) | 2018-06-27 | 2018-09-28 | Deduplication traffic recording method, device, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810686101.7A CN108923967B (en) | 2018-06-27 | 2018-06-27 | Duplication-removing flow recording method, duplication-removing flow recording device, server and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108923967A true CN108923967A (en) | 2018-11-30 |
| CN108923967B CN108923967B (en) | 2021-07-02 |
Family
ID=64423173
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810686101.7A Active CN108923967B (en) | 2018-06-27 | 2018-06-27 | Duplication-removing flow recording method, duplication-removing flow recording device, server and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108923967B (en) |
| WO (1) | WO2020000742A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113810337A (en) * | 2020-06-12 | 2021-12-17 | 中国电信股份有限公司 | Method, device and storage medium for network message duplicate removal |
| CN114996261A (en) * | 2022-08-05 | 2022-09-02 | 深圳市深蓝信息科技开发有限公司 | AIS data-based duplication eliminating method and device, terminal equipment and storage medium |
| CN115086195A (en) * | 2022-06-09 | 2022-09-20 | 北京锐安科技有限公司 | Method, device, equipment and medium for determining message duplicate removal time of shunting equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102833146A (en) * | 2011-06-17 | 2012-12-19 | 华为技术有限公司 | Method and equipment for network duplicate removal |
| CN105989072A (en) * | 2015-02-10 | 2016-10-05 | 阿里巴巴集团控股有限公司 | Duplicate removal counting method and device |
| CN106294351A (en) * | 2015-05-13 | 2017-01-04 | 阿里巴巴集团控股有限公司 | Log event treating method and apparatus |
| CN106452868A (en) * | 2016-10-12 | 2017-02-22 | 中国电子科技集团公司第三十研究所 | Network traffic statistics implement method supporting multi-dimensional aggregation classification |
| CN106878102A (en) * | 2016-12-23 | 2017-06-20 | 中国科学院信息工程研究所 | A kind of Pedestrian flow detection method and system based on the identification of network traffics multi-field |
| CN107689901A (en) * | 2017-11-13 | 2018-02-13 | 锐捷网络股份有限公司 | A kind of method and device of monitoring business message flow |
| US20180081946A1 (en) * | 2016-09-16 | 2018-03-22 | Oracle International Corporation | Duplicate reduction or elimination with hash join operations |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106294706A (en) * | 2016-08-08 | 2017-01-04 | 苏州云杉世纪网络科技有限公司 | Cloud platform customer service statistical analysis system based on DFI and method |
-
2018
- 2018-06-27 CN CN201810686101.7A patent/CN108923967B/en active Active
- 2018-09-28 WO PCT/CN2018/108470 patent/WO2020000742A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102833146A (en) * | 2011-06-17 | 2012-12-19 | 华为技术有限公司 | Method and equipment for network duplicate removal |
| CN105989072A (en) * | 2015-02-10 | 2016-10-05 | 阿里巴巴集团控股有限公司 | Duplicate removal counting method and device |
| CN106294351A (en) * | 2015-05-13 | 2017-01-04 | 阿里巴巴集团控股有限公司 | Log event treating method and apparatus |
| US20180081946A1 (en) * | 2016-09-16 | 2018-03-22 | Oracle International Corporation | Duplicate reduction or elimination with hash join operations |
| CN106452868A (en) * | 2016-10-12 | 2017-02-22 | 中国电子科技集团公司第三十研究所 | Network traffic statistics implement method supporting multi-dimensional aggregation classification |
| CN106878102A (en) * | 2016-12-23 | 2017-06-20 | 中国科学院信息工程研究所 | A kind of Pedestrian flow detection method and system based on the identification of network traffics multi-field |
| CN107689901A (en) * | 2017-11-13 | 2018-02-13 | 锐捷网络股份有限公司 | A kind of method and device of monitoring business message flow |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113810337A (en) * | 2020-06-12 | 2021-12-17 | 中国电信股份有限公司 | Method, device and storage medium for network message duplicate removal |
| CN113810337B (en) * | 2020-06-12 | 2023-08-08 | 天翼云科技有限公司 | Method, device and storage medium for network message deduplication |
| CN115086195A (en) * | 2022-06-09 | 2022-09-20 | 北京锐安科技有限公司 | Method, device, equipment and medium for determining message duplicate removal time of shunting equipment |
| CN115086195B (en) * | 2022-06-09 | 2024-02-02 | 北京锐安科技有限公司 | Method, device, equipment and medium for determining message de-duplication time of shunt equipment |
| CN114996261A (en) * | 2022-08-05 | 2022-09-02 | 深圳市深蓝信息科技开发有限公司 | AIS data-based duplication eliminating method and device, terminal equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108923967B (en) | 2021-07-02 |
| WO2020000742A1 (en) | 2020-01-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107992398B (en) | Monitoring method and monitoring system of service system | |
| EP2011013B1 (en) | Merging multi-line log entries | |
| CN1755644B (en) | Method, system, and apparatus for providing customer product support for a software program based upon states of program execution instability | |
| CN108923972A (en) | A kind of duplicate removal flow prompt method, device, server and storage medium | |
| CN108923967A (en) | A kind of duplicate removal discharge record method, apparatus, server and storage medium | |
| CN112311617A (en) | Configured data monitoring and alarming method and system | |
| CN108572907A (en) | A kind of alarm method, device, electronic equipment and computer readable storage medium | |
| CN111371672B (en) | Message pushing method and device | |
| CN111522711B (en) | Data monitoring processing system, method, execution end, monitoring end and electronic equipment | |
| CN105429792B (en) | User behavior flow acquisition methods and device, user behavior analysis method and system | |
| CN113992340B (en) | User abnormal behavior identification method, device, equipment and storage medium | |
| CN110458681A (en) | A kind of method, apparatus, server and the storage medium of data reconciliation decision | |
| CN109284331B (en) | Certificate making information acquisition method based on service data resources, terminal equipment and medium | |
| CN102195791A (en) | Alarm analysis method, device and system | |
| CN108073703A (en) | A kind of comment information acquisition methods, device, equipment and storage medium | |
| CN103957230B (en) | A kind of client user's number determines method, server, client and system | |
| CN108024222B (en) | Traffic ticket generating method and device | |
| CN109145109A (en) | User group's message propagation anomaly analysis method and device based on social networks | |
| CN108830658B (en) | Data processing method and device for information push, electronic equipment and storage medium | |
| CN109150819B (en) | A kind of attack recognition method and its identifying system | |
| CN115545241A (en) | Charging pile state identification method and device, electronic equipment and storage medium | |
| CN115509797A (en) | Method, device, equipment and medium for determining fault category | |
| CN113655958A (en) | Application data storage method | |
| CN114390015A (en) | Data pushing system, method and equipment based on object model and storage medium | |
| CN106034044B (en) | The method and apparatus of alert analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |