CN115086195B - Method, device, equipment and medium for determining message de-duplication time of shunt equipment - Google Patents
Method, device, equipment and medium for determining message de-duplication time of shunt equipment Download PDFInfo
- Publication number
- CN115086195B CN115086195B CN202210649405.2A CN202210649405A CN115086195B CN 115086195 B CN115086195 B CN 115086195B CN 202210649405 A CN202210649405 A CN 202210649405A CN 115086195 B CN115086195 B CN 115086195B
- Authority
- CN
- China
- Prior art keywords
- message
- equipment
- packet processing
- messages
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000012360 testing method Methods 0.000 claims abstract description 30
- 230000006870 function Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 7
- 230000003247 decreasing effect Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 8
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
Abstract
The embodiment of the invention discloses a method, a device, equipment and a medium for determining message de-duplication time of shunt equipment. Wherein the method comprises the following steps: acquiring the number N of transmitted packets of the packet processing equipment in the current predicted de-duplication time; triggering packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment, and acquiring the number of first messages distributed to the packet processing equipment by the distribution equipment; triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment; and adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined. According to the embodiment of the invention, through the method, the message duplication removing time of the shunt equipment can be accurately determined, the cost for constructing the test environment is saved, and the requirement on the expertise of the testers is also reduced.
Description
Technical Field
The embodiment of the invention relates to a computer data processing technology, in particular to a method, a device, equipment and a medium for determining message de-duplication time of shunt equipment.
Background
In recent years, as broadband networks and value added services are increasingly used. Telecommunication operators, value added service providers, and even various public safety institutions, all require deployment of various distribution devices in private networks. The distribution equipment filters out the data needed by the user according to the port numbers, internet protocol addresses, feature codes and other conditions of different protocols. However, after the data is processed by various devices in the network, some identical messages are generated, and the data are not needed, so that the message deduplication function is provided, a large amount of junk data can be reduced, and the final data quality is improved.
The inventors found in the course of implementing the present invention that: in the prior art, the effective time of message deduplication is an important performance dimension of a message deduplication function, and under the condition that a large amount of data enters the shunting equipment, the approximate effective time of deduplication is tested to be very simple, but the accurate deduplication time is tested to be difficult.
Disclosure of Invention
The embodiment of the invention provides a method, a device, equipment and a medium for determining message de-duplication time of shunt equipment, so as to improve the accuracy of the message de-duplication time of the shunt equipment.
In a first aspect, an embodiment of the present invention provides a method for determining a packet deduplication time of a offload device, where the method is executed by a test device, and includes:
acquiring the number N of transmitted packets of the packet processing equipment in the current predicted de-duplication time;
the method comprises the steps that trigger packet processing equipment sends a plurality of groups of first message sets to the to-be-detected distribution equipment, and obtains the quantity of first messages distributed to the packet processing equipment by the distribution equipment, wherein the first message sets comprise N-1 first messages which are different from each other;
triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment, wherein the second message sets comprise N second messages which are different from each other;
the splitting device is preconfigured to start a duplicate removal function, and splits only a first message in the first message set or the second message set;
and adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined.
In a second aspect, an embodiment of the present invention further provides a device for determining a message deduplication time of a shunting device, which is executed by a test device, where the device for determining a message deduplication time of a shunting device includes:
the packet sending quantity obtaining module is used for obtaining the packet sending quantity N of the packet processing equipment in the current predicted deduplication time;
the first message quantity acquisition module is used for triggering the packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment and acquiring the quantity of the first messages distributed to the packet processing equipment by the distribution equipment, wherein the first message sets comprise N-1 first messages which are different from each other;
the second message quantity acquisition module is used for triggering the packet processing equipment to send a plurality of groups of second message sets to the shunting equipment and acquiring the second message quantity shunted by the shunting equipment to the packet processing equipment, wherein the second message sets comprise N second messages which are different from each other;
the splitting device is preconfigured to start a duplicate removal function, and splits only a first message in the first message set or the second message set;
and the target de-duplication time determining module is used for adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined.
In a third aspect, an embodiment of the present invention further provides a test device, including a memory, a processor, and a computer program stored on the memory and capable of running on the processor, where the processor implements a method for determining a message deduplication time of a offload device according to any embodiment of the present invention when the processor executes the computer program.
In a fourth aspect, an embodiment of the present invention further provides a computer readable storage medium, where a computer program is stored, where the computer program when executed by a processor implements a method for determining a message deduplication time of a offload device according to any embodiment of the present invention.
In a fifth aspect, an embodiment of the present invention further provides a packet deduplication time system of a offload device, including: test equipment, to-be-tested shunt equipment and packet processing equipment;
the test equipment is used for executing the message de-duplication time determining method for realizing the shunt equipment according to any embodiment of the invention;
the packet processing device is configured to send multiple groups of first message sets or multiple groups of second message sets to a to-be-tested shunting device at a packet sending rate corresponding to the packet processing device, receive a first message or a second message sent by the shunting device, and feed back the number of the first message and the number of the second message to the testing device;
the splitting device is configured to receive multiple sets of first message sets or multiple sets of second message sets sent by the packet processing device, and send the first message and the second message after splitting and de-duplication to the packet processing device.
According to the technical scheme provided by the embodiment of the invention, the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is obtained; triggering packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment, and acquiring the number of first messages distributed to the packet processing equipment by the distribution equipment; triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment; and adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined. According to the embodiment of the invention, through the method, the message duplication removing time of the shunt equipment can be accurately determined, the cost for constructing the test environment is saved, and the requirement on the expertise of the testers is also reduced.
Drawings
Fig. 1a is a flowchart of a method for determining message deduplication time of a offload device according to a first embodiment of the present invention;
fig. 1b is a schematic structural diagram of a source message address after configuration in the method according to the first embodiment of the present invention;
fig. 1c is a schematic structural diagram of a packet sending rate after configuration in a method according to a first embodiment of the present invention;
fig. 2 is a schematic structural diagram of a message de-duplication time determining apparatus of a splitting device according to a second embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a test apparatus according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a packet de-duplication time determining system of a shunting device according to a fifth embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
Fig. 1a is a flowchart of a method for determining a message deduplication time of a offloading device according to a first embodiment of the present invention. The embodiment can be suitable for determining the accurate message duplicate removal time of the to-be-detected shunt equipment. The method of the embodiment may be performed by a message deduplication time determining apparatus of the offloading device, where the apparatus may be implemented by software and/or hardware, and the apparatus may be generally configured in a server or a terminal device, and is performed by a testing device.
Correspondingly, the method specifically comprises the following steps:
s110, acquiring the number N of the packets sent by the packet processing device in the current predicted deduplication time.
The packet processing device may be capable of sending a message and receiving a message sent by the splitting device. The current predicted deduplication time may be a valid time for predicting deduplication of the to-be-detected offloading device according to a deduplication function of the to-be-detected offloading device. The number of packets N may be the number of packets that the packet processing device sends to the splitting device to be tested.
Optionally, the acquiring the number N of packets sent by the packet processing device in the current predicted deduplication time includes: acquiring the current predicted deduplication time according to the equipment information of the to-be-detected shunting equipment; and configuring a source message address and a packet sending rate of the packet processing equipment, and counting the number N of packets sent by the packet processing equipment in the current predicted de-duplication time.
The device information of the splitting device may be device information of a message deduplication capability of the splitting device. The source message address may be an address at which the packet processing device sends the first message to the distribution device. The packet sending rate may be a speed of the packet processing device sending packets to the distribution device.
Specifically, the same packet interface and rate must be used when the packet transmitter transmits the first set of messages and the second set of messages. And the messages in the first message set and the second message set are the same packet length, for example, are 512 bytes (the content of each message in the message set is different, but the size is the same). That is, if the predicted deduplication time is 1s, it is known how many packets are 512 bytes long, say N packets, to be sent by the packet sending machine at 10g interface at 10% rate; then the first message set is N-1 messages with 512 bytes and different contents, and the second message set is N messages with 512 bytes and different contents; the packet processing device also transmits the first set of messages and the second set of messages at a rate of 10% using the 10g interface.
Illustratively, as shown in fig. 1b, the source message address after configuration is completed. In fig. 1b, the source message address is 1.1.1.1.1, i.e. the address at which the packet processing device sends the first message to the bypass device is 1.1.1.1. As shown in fig. 1c, the packet sending rate after the configuration is completed. In fig. 1c, the packet processing device transmits packets to the distribution device at a 10% packet transmission rate.
And S120, triggering the packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment, and acquiring the number of the first messages distributed to the packet processing equipment by the distribution equipment.
The first message set comprises N-1 first messages which are different from each other.
The splitting device may be a device capable of splitting and deduplicating the received message set. The first set of messages may be a set of messages sent by the packet processing device to the distribution device during the current predicted deduplication time. The first message may be a message sent to the packet processing device after being split and de-duplicated by the splitting device. Specifically, the first message set includes N-1 first messages which are different from each other. The first number of messages may be the number of first messages sent by the offload device to the packet processing device.
Optionally, triggering the packet processing device to send a plurality of groups of first message sets to the to-be-detected splitting device, and obtaining the number of first messages split by the splitting device to the packet processing device, including: triggering the splitting equipment to perform preset message matching rule matching on the first messages in the received multiple groups of first message sets, and splitting to obtain a first single message; triggering the shunting equipment to perform de-duplication operation on the first single message, and obtaining the first message quantity shunted by the shunting equipment to the packet processing equipment.
The preset message matching rule may be a matching rule that the test device configures the shunting device to only receive a message of a certain message address. The first single message may be a single message obtained by shunting the first messages in the plurality of groups of first messages through the shunting device.
Illustratively, assume that the number of packets sent by the acquisition packet processing device during the current predicted deduplication time is 100, and the current predicted deduplication time is 1s. Firstly, a test device triggers a packet processing device to send a plurality of groups of first message sets to a to-be-tested shunt device, wherein the first message sets comprise 99 first messages, namely a plurality of groups of 99 first messages, 5 groups are assumed to be sent, namely 5 groups of 99 first messages are sent, the first messages are assumed to be 1.1.1.1, the second first messages are assumed to be 1.1.1.2, the 99 first messages are sequentially increased according to a step length of 0.0.1, namely the 99 th first message is 1.1.1.99, and the second first messages are assumed to be 1.1.1.1.1. The preset message matching rule is assumed that the splitting device only allows the message of 1.1.1.1 to pass through splitting, so that duplication is removed.
Further, the splitting device performs preset message matching rule matching on the received 5 groups of 99 first messages, and the first messages which can be split can be 5 first messages of 1.1.1.1.
Correspondingly, triggering the shunting equipment to perform the duplicate removal operation on the 5 first messages of 1.1.1.1, and obtaining 1 first messages of 1.1.1.1 after duplicate removal, namely, obtaining that the number of the first messages shunted to the packet processing equipment by the shunting equipment is 1 by the testing equipment.
The advantage of setting like this is that through carrying out the message matching rule that presets with the first message in multiunit first message set and matcing, obtain first single message, can reduce the work load of the duplicate removal of shunting equipment like this, also can compare better, saved time cost.
And S130, triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment.
The second message set comprises N second messages which are different from each other. The splitting device is preconfigured to turn on the deduplication function and split only a first message of the first set of messages or the second set of messages. The second number of messages may be the number of second messages sent by the offload device to the packet processing device.
The second message set may be a message set sent by the packet processing device to the splitting device in the current predicted deduplication time, where the second message set includes N second messages that are different from each other. The second message may be a message sent to the packet processing device after being split and de-duplicated by the splitting device.
Specifically, because the packet processing device predicts the number N of packets sent in the de-duplication time currently, the splitting device can perform de-duplication operation on the received N packets. The trigger packet processing device sends a plurality of groups of second message sets to the shunting device, namely a first group of second messages for sending N, and a second group of first messages for sending N+1. Because the splitting device can perform the deduplication operation on the received N second messages, the (n+1) th message cannot be subjected to the deduplication operation.
Optionally, the splitting device is preconfigured to turn on the deduplication function, and splits only a first message in the first message set or the second message set, including: triggering the splitting equipment to determine whether a first message in the first message set or the second message set meets a preset message matching rule, and if so, triggering the splitting equipment to split to obtain the first message; if not, triggering the shunt equipment to discard the message which does not meet the preset message matching rule.
In the previous example, the splitting device performs preset message matching rule matching on the received 5 groups of 99 first messages, and the first messages which do not pass through the splitting can be discarded by the splitting first messages which are 5 first messages of 1.1.1.1.1, specifically, 1.1.1.2, 1.1.3, … and 1.1.1.99 are not matched to obtain preset message matching, and discarding is performed.
Optionally, triggering the packet processing device to send a plurality of groups of second message sets to the splitting device, and obtaining the number of second messages split by the splitting device to the packet processing device, including: triggering the splitting equipment to perform preset message matching rule matching on second messages in a plurality of groups of received second message sets, and splitting to obtain a second single message; triggering the splitting equipment to perform de-duplication operation on the second single message, and obtaining the second message quantity split by the splitting equipment to the packet processing equipment.
The second single message may be a single message obtained by splitting the second messages in the plurality of groups of second message sets through a splitting device.
Illustratively, assuming N is 100, the current predicted deduplication time is 1s. Assuming that the first second message is 1.1.1.1, the second message is 1.1.1.2, the 100 second messages are sequentially increased according to the step length of 0.0.0.1, that is, the 100 th second message is 1.1.1.100, the second group of first second messages is 1.1.1.1, and so on. Assume that the packet processing device sends 5 second sets of messages to the forking device.
Further, the splitting device performs preset message matching rule matching on the received 5 groups of second messages, and the second messages which can be split can be 5 first messages of 1.1.1.1.
Correspondingly, triggering the splitting device to perform the duplicate removal operation on the 5 second messages of 1.1.1.1, and because the first 1.1.1.1 and the second 1.1.1 are not in the same effective time, the second messages of 1.1.1.1 can be reserved, namely, the number of the second messages which are split by the splitting device to the packet processing device is 5 and obtained after duplicate removal by the testing device.
The advantages of this arrangement are that: the first message set or the second message set, which needs to be subjected to the duplicate removal operation, of the shunt equipment can be reduced, so that the message duplicate removal time of the shunt equipment can be more easily and accurately determined, and the time cost is saved.
And S140, adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined.
Wherein the target deduplication time may be an accurate deduplication time to determine the offload device.
Optionally, adjusting the current predicted deduplication time according to the first message number and the second message number until determining a target deduplication time matched with the splitting device, including: if the number of the first messages is 1 and the number of the second messages is a plurality of, determining the current predicted deduplication time as the target deduplication time; if the number of the first messages and the number of the second messages are 1, the operation of obtaining the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is carried out in a return mode after the current predicted de-duplication time is increased according to a preset incremental mode; if the number of the first messages and the number of the second messages are multiple, the operation of obtaining the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is carried out in a return mode after the current predicted de-duplication time is reduced according to a preset decreasing mode.
In the previous example, since the current predicted deduplication time is 1s. Firstly, a testing device triggers a packet processing device to send 5 groups of 99 first messages to a to-be-tested splitting device to obtain 1 first messages of 1.1.1.1, namely the number of the first messages split by the splitting device to the packet processing device is 1. Further, the test device triggers the packet processing device to send 5 groups of 100 second messages to the splitting device to obtain 5 second messages of 1.1.1.1, i.e. the number of second messages split by the splitting device to the packet processing device is 5. Therefore, if the number of the first messages is 1 and the number of the second messages is 5, the current predicted deduplication time 1s can be determined as the target deduplication time.
If the number of the first messages and the number of the second messages are both 1, the current predicted deduplication time setting can be indicated to be too small. Illustratively, the splitting device may perform deduplication on the received 120 first messages or the received second messages within the valid time 1s within the current predicted deduplication time 1s. Namely, the first packet of the 2 nd group can be de-duplicated, so that the current predicted de-duplication time 1s is set to be too small, and the current predicted de-duplication time is increased according to a preset incremental mode, and the operation of acquiring the number N of packets sent by the packet processing equipment in the current predicted de-duplication time is returned to be executed under the assumption of 1.1 s.
If the number of the first messages and the number of the second messages are multiple, the current predicted deduplication time setting can be indicated to be too large. Illustratively, the splitting device may perform deduplication on the received 70 first messages or the received second messages within the valid time 1s within the current predicted deduplication time 1s. And de-duplicating the 71 st to 99 th first messages or the 71 st to 100 th second messages in the next effective time of 1s. Therefore, the number of the first messages can be determined to be multiple, and the number of the second messages is also determined to be multiple. Therefore, when the current predicted de-duplication time 1s is set too large, the current predicted de-duplication time is reduced to 0.9s according to a preset decrementing mode, and the operation of obtaining the number N of packets sent by the packet processing device in the current predicted de-duplication time is performed.
The advantages of this arrangement are that: according to the number relation between the first message number and the second message number, whether the current predicted deduplication time is set accurately is determined, and the current predicted deduplication time is further adjusted, so that the obtained target deduplication time is more accurate.
According to the technical scheme provided by the embodiment of the invention, the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is obtained; triggering packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment, and acquiring the number of first messages distributed to the packet processing equipment by the distribution equipment; triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment; and adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined. According to the embodiment of the invention, through the method, the message duplication removing time of the shunt equipment can be accurately determined, the cost for constructing the test environment is saved, and the requirement on the expertise of the testers is also reduced.
Example two
Fig. 2 is a block diagram of a message duplication removal time determining apparatus for a shunting device according to a second embodiment of the present invention, where the message duplication removal time determining apparatus for a shunting device according to the present embodiment may be implemented by software and/or hardware, and may be configured in a server or a terminal device to implement a message duplication removal time determining method for a shunting device according to an embodiment of the present invention. As shown in fig. 2, the apparatus may specifically include: the system comprises a packet sending number acquisition module 210, a first message number acquisition module 220, a second message number acquisition module 230 and a target deduplication time determination module 240.
The packet sending number obtaining module 210 is configured to obtain the number N of packets sent by the packet processing device in the current predicted deduplication time;
a first message number obtaining module 220, configured to trigger the packet processing device to send a plurality of groups of first message sets to the to-be-detected splitting device, and obtain the number of first messages split by the splitting device to the packet processing device, where the first message sets include N-1 first messages that are different from each other;
a second message number obtaining module 230, configured to trigger the packet processing device to send a plurality of groups of second message sets to the splitting device, and obtain the number of second messages split by the splitting device to the packet processing device, where the second message sets include N second messages different from each other;
the splitting device is preconfigured to start a duplicate removal function, and splits only a first message in the first message set or the second message set;
the target de-duplication time determining module 240 is configured to adjust the current predicted de-duplication time according to the first message number and the second message number until a target de-duplication time matched with the splitting device is determined.
According to the technical scheme provided by the embodiment of the invention, the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is obtained; triggering packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment, and acquiring the number of first messages distributed to the packet processing equipment by the distribution equipment; triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment; and adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined. According to the embodiment of the invention, through the method, the message duplication removing time of the shunt equipment can be accurately determined, the cost for constructing the test environment is saved, and the requirement on the expertise of the testers is also reduced.
Based on the above embodiments, the packet number obtaining module 210 may be specifically configured to: acquiring the current predicted deduplication time according to the equipment information of the to-be-detected shunting equipment; and configuring a source message address and a packet sending rate of the packet processing equipment, and counting the number N of packets sent by the packet processing equipment in the current predicted de-duplication time.
Based on the above embodiments, the target deduplication time determination module 240 may be specifically configured to: if the number of the first messages is 1 and the number of the second messages is a plurality of, determining the current predicted deduplication time as the target deduplication time; if the number of the first messages and the number of the second messages are 1, the operation of obtaining the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is carried out in a return mode after the current predicted de-duplication time is increased according to a preset incremental mode; if the number of the first messages and the number of the second messages are multiple, the operation of obtaining the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is carried out in a return mode after the current predicted de-duplication time is reduced according to a preset decreasing mode.
On the basis of the above embodiments, the method can be specifically used for: triggering the shunting equipment to determine whether the messages in the first message set or the second message set meet a preset first message matching rule, and if so, triggering the shunting equipment to shunt to obtain a first message; if not, triggering the shunt equipment to discard the message which does not meet the preset message matching rule.
Based on the foregoing embodiments, the first message number obtaining module 220 may be specifically configured to: triggering the splitting equipment to perform preset message matching rule matching on the first messages in the received multiple groups of first message sets, and splitting to obtain a first single message; triggering the shunting equipment to perform de-duplication operation on the first single message, and obtaining the first message quantity shunted by the shunting equipment to the packet processing equipment.
Based on the above embodiments, the second message number obtaining module 230 may be specifically configured to: triggering the splitting equipment to perform preset message matching rule matching on second messages in a plurality of groups of received second message sets, and splitting to obtain a second single message; triggering the splitting equipment to perform de-duplication operation on the second single message, and obtaining the second message quantity split by the splitting equipment to the packet processing equipment.
The message de-duplication time determining device of the shunting equipment can execute the message de-duplication time determining method of the shunting equipment provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the executing method.
Example III
Fig. 3 is a schematic structural diagram of a test apparatus according to a third embodiment of the present invention. As shown in fig. 3, the apparatus includes a processor 310, a memory 320, an input device 330, and an output device 340; the number of processors 310 in the device may be one or more, one processor 310 being taken as an example in fig. 3; the processor 310, memory 320, input 330 and output 340 in the device may be connected by a bus or other means, for example in fig. 3.
The memory 320 is used as a computer readable storage medium, and may be used to store a software program, a computer executable program, and modules, such as program instructions/modules (e.g., the packet count obtaining module 210, the first packet count obtaining module 220, the second packet count obtaining module 230, and the target deduplication time determining module 240) corresponding to the method for determining the deduplication time of a offload device in an embodiment of the present invention. The processor 310 executes various functional applications of the device and data processing by executing software programs, instructions and modules stored in the memory 320, that is, implements the above-mentioned method for determining message deduplication time of the offload device, and the method includes: acquiring the number N of transmitted packets of the packet processing equipment in the current predicted de-duplication time; triggering packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment, and acquiring the number of first messages distributed to the packet processing equipment by the distribution equipment; triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment; and adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined.
Memory 320 may include primarily a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application program required for functionality; the storage data area may store data created according to the use of the terminal, etc. In addition, memory 320 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 320 may further include memory located remotely from processor 310, which may be connected to the device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 330 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the apparatus. The output device 340 may include a display device such as a display screen.
Example IV
A fourth embodiment of the present invention also provides a method for determining a message deduplication time of a offload device, the method including: acquiring the number N of transmitted packets of the packet processing equipment in the current predicted de-duplication time; triggering packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment, and acquiring the number of first messages distributed to the packet processing equipment by the distribution equipment; triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment; and adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined.
Of course, the computer readable instructions provided by the embodiment of the present invention are not limited to the above-mentioned method operations, and may also perform the related operations in the method for determining the message deduplication time of the offload device provided by any embodiment of the present invention.
From the above description of embodiments, it will be clear to a person skilled in the art that the present invention may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, although in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, etc., and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present invention.
It should be noted that, in the embodiment of the foregoing packet deduplication time determining apparatus of the offload device, each unit and module included are only divided according to the functional logic, but are not limited to the above-mentioned division, so long as the corresponding function can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.
Example five
Fig. 4 is a schematic structural diagram of a system for determining a message duplication removal time of a shunting device according to a fifth embodiment of the present invention, where the system for determining a message duplication removal time of a shunting device includes a testing device 410, a shunting device 420 to be tested, and a packet processing device 430;
the test device 410 is configured to execute a message deduplication time method of the offload device;
the packet processing device 420 is configured to send multiple groups of first message sets or multiple groups of second message sets to a to-be-tested shunting device at a packet sending rate corresponding to the packet processing device, receive a first message or a second message sent by the shunting device, and feed back the number of the first message and the number of the second message to the testing device;
the splitting device 430 is configured to receive multiple sets of first message sets or multiple sets of second message sets sent by the packet processing device, and send the first message and the second message after splitting and de-duplication to the packet processing device.
According to the technical scheme provided by the embodiment of the invention, the message de-duplication time system of the shunting equipment comprises the testing equipment, the shunting equipment to be tested and the packet processing equipment, so that the determination of the message de-duplication time of the shunting equipment is performed, the message de-duplication time of the shunting equipment can be accurately determined, the cost for constructing a testing environment is saved, and the requirement on the expertise of a tester is also reduced.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (10)
1. The method for determining the message de-duplication time of the shunt equipment is characterized by being executed by test equipment and comprising the following steps of:
acquiring the number N of transmitted packets of the packet processing equipment in the current predicted de-duplication time;
the method comprises the steps that trigger packet processing equipment sends a plurality of groups of first message sets to the to-be-detected distribution equipment, and obtains the quantity of first messages distributed to the packet processing equipment by the distribution equipment, wherein the first message sets comprise N-1 first messages which are different from each other;
triggering the packet processing equipment to send a plurality of groups of second message sets to the distribution equipment, and acquiring the second message quantity distributed to the packet processing equipment by the distribution equipment, wherein the second message sets comprise N second messages which are different from each other;
the splitting device is preconfigured to start a duplicate removal function, and splits only a first message in the first message set or the second message set;
and adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined.
2. The method of claim 1, wherein obtaining the number of packets N sent by the packet processing device during the current predicted deduplication time comprises:
acquiring the current predicted deduplication time according to the equipment information of the to-be-detected shunting equipment;
and configuring a source message address and a packet sending rate of the packet processing equipment, and counting the number N of packets sent by the packet processing equipment in the current predicted de-duplication time.
3. The method of claim 1, wherein adjusting the current predicted deduplication time based on the first number of messages and the second number of messages until a target deduplication time matching the offload device is determined comprises:
if the number of the first messages is 1 and the number of the second messages is a plurality of, determining the current predicted deduplication time as the target deduplication time;
if the number of the first messages and the number of the second messages are 1, the operation of obtaining the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is carried out in a return mode after the current predicted de-duplication time is increased according to a preset incremental mode;
if the number of the first messages and the number of the second messages are multiple, the operation of obtaining the number N of the packets sent by the packet processing equipment in the current predicted de-duplication time is carried out in a return mode after the current predicted de-duplication time is reduced according to a preset decreasing mode.
4. The method of claim 1, wherein the splitting device is preconfigured to turn on a deduplication function and split only a first message of the first set of messages or the second set of messages, comprising:
triggering the splitting equipment to determine whether a first message in the first message set or the second message set meets a preset message matching rule, and if so, triggering the splitting equipment to split to obtain the first message;
if not, triggering the shunt equipment to discard the message which does not meet the preset message matching rule.
5. The method of claim 1, wherein triggering the packet processing device to send a plurality of sets of first message sets to the splitting device to be tested and obtaining the number of first messages split by the splitting device to the packet processing device comprises:
triggering the splitting equipment to perform preset message matching rule matching on the first messages in the received multiple groups of first message sets, and splitting to obtain a first single message;
triggering the shunting equipment to perform de-duplication operation on the first single message, and obtaining the first message quantity shunted by the shunting equipment to the packet processing equipment.
6. The method of claim 5, wherein triggering the packet processing device to send a plurality of sets of second message sets to the splitting device and obtaining the number of second messages split by the splitting device to the packet processing device comprises:
triggering the splitting equipment to perform preset message matching rule matching on second messages in a plurality of groups of received second message sets, and splitting to obtain a second single message;
triggering the splitting equipment to perform de-duplication operation on the second single message, and obtaining the second message quantity split by the splitting equipment to the packet processing equipment.
7. A message de-duplication time determining apparatus of a shunting device, which is executed by a test device, comprising:
the packet sending quantity obtaining module is used for obtaining the packet sending quantity N of the packet processing equipment in the current predicted deduplication time;
the first message quantity acquisition module is used for triggering the packet processing equipment to send a plurality of groups of first message sets to the to-be-detected distribution equipment and acquiring the quantity of the first messages distributed to the packet processing equipment by the distribution equipment, wherein the first message sets comprise N-1 first messages which are different from each other;
the second message quantity acquisition module is used for triggering the packet processing equipment to send a plurality of groups of second message sets to the shunting equipment and acquiring the second message quantity shunted by the shunting equipment to the packet processing equipment, wherein the second message sets comprise N second messages which are different from each other;
the splitting device is preconfigured to start a duplicate removal function, and splits only a first message in the first message set or the second message set;
and the target de-duplication time determining module is used for adjusting the current predicted de-duplication time according to the first message number and the second message number until the target de-duplication time matched with the shunt equipment is determined.
8. A test device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method for determining the message deduplication time of a offload device according to any of claims 1-6 when executing the computer program.
9. A computer readable storage medium having stored thereon a computer program, which when executed by a processor implements a method of determining a message deduplication time of a offload device according to any of claims 1-6.
10. A message deduplication time system of a offload device, comprising: test equipment, to-be-tested shunt equipment and packet processing equipment;
the test device for performing the method of any one of claims 1-6;
the packet processing device is configured to send multiple groups of first message sets or multiple groups of second message sets to a to-be-tested shunting device at a packet sending rate corresponding to the packet processing device, receive a first message or a second message sent by the shunting device, and feed back the number of the first message and the number of the second message to the testing device;
the splitting device is configured to receive multiple sets of first message sets or multiple sets of second message sets sent by the packet processing device, and send the first message and the second message after splitting and de-duplication to the packet processing device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210649405.2A CN115086195B (en) | 2022-06-09 | 2022-06-09 | Method, device, equipment and medium for determining message de-duplication time of shunt equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210649405.2A CN115086195B (en) | 2022-06-09 | 2022-06-09 | Method, device, equipment and medium for determining message de-duplication time of shunt equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115086195A CN115086195A (en) | 2022-09-20 |
| CN115086195B true CN115086195B (en) | 2024-02-02 |
Family
ID=83252345
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210649405.2A Active CN115086195B (en) | 2022-06-09 | 2022-06-09 | Method, device, equipment and medium for determining message de-duplication time of shunt equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115086195B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107832406A (en) * | 2017-11-03 | 2018-03-23 | 北京锐安科技有限公司 | Duplicate removal storage method, device, equipment and the storage medium of massive logs data |
| CN108923967A (en) * | 2018-06-27 | 2018-11-30 | 平安科技（深圳）有限公司 | A kind of duplicate removal discharge record method, apparatus, server and storage medium |
| CN108923972A (en) * | 2018-06-30 | 2018-11-30 | 平安科技（深圳）有限公司 | A kind of duplicate removal flow prompt method, device, server and storage medium |
| CN111131479A (en) * | 2019-12-27 | 2020-05-08 | 迈普通信技术股份有限公司 | Flow processing method and device and flow divider |
| CN114048201A (en) * | 2021-11-16 | 2022-02-15 | 北京锐安科技有限公司 | Distributed stream computing engine Flink-based key field real-time deduplication method |
| CN114157611A (en) * | 2021-12-15 | 2022-03-08 | 苏州盛科通信股份有限公司 | Message duplicate removal method, device and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8385192B2 (en) * | 2009-08-11 | 2013-02-26 | International Business Machines Corporation | Deduplicated data processing rate control |
| US10866939B2 (en) * | 2015-11-30 | 2020-12-15 | Micro Focus Llc | Alignment and deduplication of time-series datasets |
-
2022
- 2022-06-09 CN CN202210649405.2A patent/CN115086195B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107832406A (en) * | 2017-11-03 | 2018-03-23 | 北京锐安科技有限公司 | Duplicate removal storage method, device, equipment and the storage medium of massive logs data |
| CN108923967A (en) * | 2018-06-27 | 2018-11-30 | 平安科技（深圳）有限公司 | A kind of duplicate removal discharge record method, apparatus, server and storage medium |
| CN108923972A (en) * | 2018-06-30 | 2018-11-30 | 平安科技（深圳）有限公司 | A kind of duplicate removal flow prompt method, device, server and storage medium |
| CN111131479A (en) * | 2019-12-27 | 2020-05-08 | 迈普通信技术股份有限公司 | Flow processing method and device and flow divider |
| CN114048201A (en) * | 2021-11-16 | 2022-02-15 | 北京锐安科技有限公司 | Distributed stream computing engine Flink-based key field real-time deduplication method |
| CN114157611A (en) * | 2021-12-15 | 2022-03-08 | 苏州盛科通信股份有限公司 | Message duplicate removal method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115086195A (en) | 2022-09-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109302346B (en) | Method and device for transmitting data flow | |
| US10122746B1 (en) | Correlation and consolidation of analytic data for holistic view of malware attack | |
| EP2299633B1 (en) | Misdirected packet detection method | |
| CN109257326B (en) | Method and device for defending against data stream attack, storage medium and electronic equipment | |
| CN111431758B (en) | Cloud network equipment testing method and device, storage medium and computer equipment | |
| CN108900374B (en) | Data processing method and device applied to DPI equipment | |
| CN112039796B (en) | Data packet transmission method and device, storage medium and electronic equipment | |
| CN108418780A (en) | Filter method and device, system, the dns server of IP address | |
| CN108429739B (en) | Method, system and terminal equipment for identifying honeypots | |
| CN112929241B (en) | Network testing method and device | |
| CN110650042A (en) | Electric power communication network health degree evaluation method and terminal equipment | |
| CN110958245B (en) | Attack detection method, device, equipment and storage medium | |
| CN110417687B (en) | Message sending and receiving method and device | |
| JP2016167799A (en) | Network monitoring method and apparatus, and packet filtering method and apparatus | |
| CN114071544B (en) | Network testing method and device and electronic equipment | |
| CN115174676A (en) | Convergence and shunt method and related equipment thereof | |
| CN115086195B (en) | Method, device, equipment and medium for determining message de-duplication time of shunt equipment | |
| CN111131479B (en) | Flow processing method and device and flow divider | |
| US10764722B2 (en) | Subscriber sampling for network packet forwarding based upon unique subscriber identifiers | |
| EP3360285A1 (en) | System and method to reconcile cabling test results with cabling test configurations | |
| CN109347766A (en) | A kind of method and device of scheduling of resource | |
| CN111106977B (en) | Data stream detection method, device and storage medium | |
| CN114301812A (en) | Method, device, equipment and storage medium for monitoring message processing result | |
| CN108874530B (en) | Method and device for expanding and shrinking service board of message forwarding equipment | |
| CN111385372B (en) | Network service discovery method, client, server and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |