WO2022143016A1

WO2022143016A1 - Data distribution method, apparatus, and system, and medium

Info

Publication number: WO2022143016A1
Application number: PCT/CN2021/135709
Authority: WO
Inventors: 赵华昌
Original assignee: 中兴通讯股份有限公司
Priority date: 2020-12-29
Filing date: 2021-12-06
Publication date: 2022-07-07
Also published as: CN114697409A

Abstract

Disclosed in embodiments of the present disclosure are a data distribution method, apparatus, and system, and a medium. According to the data distribution method, steps executed at a sending terminal comprise: receiving a registration request sent by a receiving terminal, the registration request comprising a receiving terminal identification (ID) and a data type of CDR data required by the receiving terminal; and sending, on the basis of the registration request, to the receiving terminal CDR data having a consistent data type with the CDR data required by the receiving terminal.

Description

Data distribution method, device, system and medium

CROSS-REFERENCE TO RELATED APPLICATIONS

The present disclosure claims priority to Chinese patent application CN202011586983.3 filed on December 29, 2020, entitled "Data Distribution Method, Device, System and Medium", the entire contents of which are incorporated into the present disclosure by reference.

technical field

The embodiments of the present disclosure relate to the field of communication technologies, and in particular, to a data distribution method, apparatus, system, and medium.

Background technique

With the advancement and development of network communication technology, network communication has entered the era of big data. To avoid malicious communication threats to hosts, network devices, etc., as well as the theft of communication content. Traditional real-time detection and defense are no longer capable of identifying subtle anomalies in massive data. For this reason, real-time backup of original communication data has gradually become necessary, and time window-based retrospective analysis technology plus in-depth detection of data packets is a microscope for abnormal data discovery. The deep packet inspection DPI (Deep Packet Inspection) data processing system is a device that analyzes and controls the Internet protocol and raw communication data, and should be widely configured for various business and traffic analysis. The bottom layer of the DPI data processing system collects raw communication data and generates Call Detail Record (Call Detail Record) data, and associates various CDR data generated. For example, multiple CDR data with the same key value can be associated by key value. Relationships and backfilling. Backfilling is to enrich the respective fields of the CDR data after the association. The enrichment process here is called backfilling. The bottom layer distributes the enriched data to the application layer of the DPI data processing system, and then the application layer performs data analysis.

The current problem is that the application layer can have different processing nodes, and different processing nodes require different CDR data according to the processing tasks. It can be seen that different processing nodes in the application layer have diverse CDR data requirements. Therefore, how to meet the diverse requirements of different data processing nodes for CDR data, reduce the complexity of data distribution, and improve data distribution efficiency has become an urgent problem to be solved.

SUMMARY OF THE INVENTION

The purpose of one or more embodiments of this specification is to provide a data distribution method, device, system and medium, which can meet the diverse requirements of different data processing nodes for CDR data, reduce the complexity of data distribution, and improve data distribution efficiency.

To solve the above technical problems, one or more embodiments of the present specification are implemented as follows.

In a first aspect, a data distribution method is provided, and the steps performed at the sending end include: receiving a registration request sent by the receiving end, the registration request including the receiving end identification ID and the data type of the CDR data required by the receiving end; The registration request sends CDR data consistent with the data type of the CDR data required by the receiving end to the receiving end.

In a second aspect, a data distribution method is proposed. The steps performed at the receiving end include: sending a registration request to the sending end, where the registration request includes the receiving end identification ID and the data type of CDR data required by the receiving end; receiving the The sender sends, based on the registration request, CDR data consistent with the data type of the CDR data required by the receiver.

In a third aspect, a data distribution method is proposed. The steps performed at the data generating end include: generating CDR data; classifying the CDR data according to the data type of the CDR data required by the receiving end and classifying the CDR data mark; send the CDR data to the sending end.

In a fourth aspect, a data distribution device is proposed, which is set at the sending end and includes: a request receiving module configured to receive a registration request sent by the receiving end, where the registration request includes an ID of the receiving end and CDR data required by the receiving end A data sending module configured to send, to the receiving end, CDR data consistent with the data type of the CDR data required by the receiving end based on the registration request.

In a fifth aspect, a data distribution device is proposed, which is set at the receiving end, and includes: a request sending module configured to send a registration request to the sending end, where the registration request includes an ID of the receiving end and an ID of the CDR data required by the receiving end. data type; a data receiving module configured to receive CDR data sent by the sender based on the registration request and consistent with the data type of the CDR data required by the receiver.

In a sixth aspect, a data distribution device is proposed, which is arranged at a data generating end, comprising: a data generating module configured to generate CDR data; a classification module configured to classify the CDR data according to the data type of the CDR data required by the receiving end classifying and classifying and marking the CDR data; a data originating module configured to send the CDR data to the sending end.

In a seventh aspect, a DPI data processing system is proposed, including the data distribution apparatus as described above.

In an eighth aspect, a storage medium is provided for computer-readable storage, the storage medium stores one or more programs, and when the one or more programs can be executed by one or more processors, the above-mentioned implementation is achieved The steps of the data distribution method described herein.

Description of drawings

In order to more clearly illustrate one or more embodiments of the present specification or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of one or more embodiments or the prior art. It is obvious that , the drawings in the following description are only some embodiments described in this specification, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 is a schematic diagram of steps of a data distribution method provided by an embodiment of the present disclosure.

FIG. 2 is a schematic diagram of steps of another data distribution method provided by an embodiment of the present disclosure.

FIG. 3 is a schematic diagram of steps of still another data distribution method provided by an embodiment of the present disclosure.

FIG. 4 is a schematic diagram of steps of still another data distribution method provided by an embodiment of the present disclosure.

FIG. 5 is a schematic diagram of steps of still another data distribution method provided by an embodiment of the present disclosure.

FIG. 6 is a schematic diagram of steps of still another data distribution method provided by an embodiment of the present disclosure.

FIG. 7 is a schematic diagram of steps of another data distribution method provided by an embodiment of the present disclosure.

FIG. 8 is a schematic diagram of steps of still another data distribution method provided by an embodiment of the present disclosure.

FIG. 9 is a schematic diagram of steps of another data distribution method provided by an embodiment of the present disclosure.

FIG. 10 is a schematic diagram of steps of another data distribution method provided by an embodiment of the present disclosure.

FIG. 11 is a schematic diagram of steps of still another data distribution method provided by an embodiment of the present disclosure.

FIG. 12 is a schematic structural diagram of a data distribution apparatus provided by an embodiment of the present disclosure.

FIG. 13 is a schematic structural diagram of another data distribution apparatus provided by an embodiment of the present disclosure.

FIG. 14 is a schematic structural diagram of another data distribution apparatus provided by an embodiment of the present disclosure.

Detailed ways

In order to make those skilled in the art better understand the technical solutions in this specification, the technical solutions in one or more embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings in one or more embodiments of this specification. It is apparent that the described embodiment or embodiments are only some, but not all, embodiments of this specification. Based on one or more embodiments in this specification, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this document.

The data distribution method provided by the present disclosure is suitable for the situation that the deep packet SPI data processing system needs to send the CDR data to the data processing node in the SPI data processing system during the deep packet inspection, so that the data processing node can process the CDR data. Meet the diverse requirements of different data processing nodes for CDR data, reduce the complexity of data distribution, and improve data distribution efficiency. The data distribution method provided by this specification and its various steps will be described in detail below.

It should be noted that the sending end, the receiving end and the data generating end mentioned in the present disclosure are set in the DPI data processing system, and the DPI data processing system may include an architecture composed of multiple servers. The receiving end is set on the data processing node, and the sending end and the data generating end can be set on the data processing node or on other server nodes in the DPI data processing system. Some server nodes bear the functions of the bottom layer, and some server nodes bear the functions of the application layer. Here, the server nodes that bear the functions of the bottom layer may overlap with the server nodes that bear the functions of the application layer, which are not limited here. The transmitting end, the receiving end and the data generating end mentioned in the present disclosure realize the efficient distribution of CDR data in the DPI data processing system, and meet different requirements of different data processing nodes for CDR data.

Example 1

Referring to FIG. 1 , it is a schematic diagram of steps of a data distribution method provided by an embodiment of the present disclosure. It can be understood that the data distribution method is executed at the sending end, where the sending end may be at the bottom layer of the DPI data processing system, the purpose is to collect the raw communication data for processing and send it to the application layer for data analysis. The bottom layer can be completed by server nodes. The data distribution method performed at the sending end provided by the embodiment of the present disclosure includes the following steps.

Step 10: Receive a registration request sent by the receiver, where the registration request includes the ID of the receiver and the data type of the CDR data required by the receiver.

The receiving end may be on the application layer of the DPI data processing system, such as the data processing node described above, which is to send the request of the data processing node for CDR data to the sending end located at the bottom layer. For the convenience of understanding, the sender and the receiver are used here as the subject and object of data distribution.

After receiving the registration request from the receiver, the sender needs to respond according to the registration request. The registration request includes the ID of the receiver and the data type of the CDR data required by the receiver. It can be seen that the receiver here can correspond to the data processing node one by one, and send the data processing node's request for CDR data to the sender, so that the sender can Obtain the CDR data requirements of each data processing node. The requirement of each data processing node for CDR data can be the data type of the CDR data required by the receiving end corresponding to the data processing node, and the data quantity can be set at the sending end, and it is not necessary for the receiving end to send a registration request every time need to inform the sender. At the same time, in order to facilitate the sender to distinguish each receiver, the registration request includes the receiver ID. The receiver ID can be used to identify the receiver's code, serial number or user name, which is not limited here, as long as it is convenient for the sender to follow up accurately. It is sufficient to send the CDR data required by the receiving end to the receiving end.

Step 20: Send the CDR data consistent with the data type of the CDR data required by the receiving end to the receiving end based on the registration request.

After the sender receives the registration request from the receiver, according to the information mentioned in the registration request, it sends the CDR data corresponding to the amount of data and the data type of the CDR data required by the receiver to the receiver. The data processing node corresponding to the terminal performs the data analysis task.

It can be seen that the sender performs targeted data distribution according to the requirements of the receiver for CDR data in the registration request, which can meet the diversity requirements of different data processing nodes for the data type and data quantity of CDR data. The diversity requirement here is for Different data processing nodes have different requirements for CDR data. It can be seen that the complexity of data distribution is reduced and the efficiency of data distribution is improved.

Referring to FIG. 2 , in some embodiments, in the data distribution method provided by the embodiments of the present disclosure, step 20 “sends CDR data consistent with the data type of the CDR data required by the receiving end to the receiving end based on the registration request.” Specifically Include the following steps.

Step 200: Classify the receiving ends with the same receiving end ID and the same data type of the CDR data required by the receiving end into the same group.

When the sender executes the response based on the registration request, it will refer to the receiver ID provided by the registration request and the data type of the CDR data required by the receiver, and prepare the CDR data that matches the data type and data quantity of the CDR data described by the receiver. Then send it to the receiver with the receiver ID. In the embodiment of the present disclosure, the transmitting end first classifies the receiving ends with the same receiving end ID and the same data type of CDR data required by the receiving end into the same group, with different receiving end IDs and different data types of CDR data required by the receiving end The receivers are divided into different groups, the purpose is to process the CDR data according to the group when the receiver sends CDR data.

Step 210: Send the full amount of data corresponding to the data type of the CDR data required by the receiver to the receivers in the same group, so that the receiver can receive the CDR data from the full amount of data.

The receiving end in the same group will receive the full amount of data of the data type of the CDR data required by the corresponding receiving end sent by the transmitting end, that is, the data of the data type corresponding to the CDR data required by the receiving end will be sent to different groups according to the group. Full data, the full data here corresponds to the data type of the CDR data required by the receiving end, and the full data corresponding to the data type of the CDR data required by different receiving ends are different.

When the group receives the full amount of data corresponding to the data type of the CDR data required by the receiver, the receivers in the same group receive the CDR data corresponding to the amount of data from the full amount of data. It can be seen that the full amount of data is the sum of the amount of data that is greater than or equal to the data type of the CDR data required by all receivers in the same group. Therefore, before sending the CDR data to the group, the sender can check the sum of the data quantity that the receiver under the same group needs to meet the data type of the CDR data required by the receiver, and the data that currently matches the receiver. The data type of the required CDR data is compared with the full amount of data before sending.

In the data distribution method provided by the embodiment of the present disclosure, when there are multiple receiving ends in the same group, it may be that the amount of data required by different receiving ends conforms to the data type of CDR data required by the receiving ends may be different.

Referring to FIG. 3 , in some embodiments, in the data distribution method provided by the embodiment of the present disclosure, the registration request further includes the amount of data, there are multiple receivers in the same group, and the multiple receivers share the full amount of data. Under the conditions, step 210 "send the full amount of data of the data type corresponding to the CDR data required by the receiver to the receiver under the same group, so that the receiver can receive the CDR data corresponding to the amount of data from the full amount of data" The specific steps include the following steps.

Step 211: Send the CDR data in the full amount of data to multiple receivers in the same group in turn, until the CDR data received by the multiple receivers in the same group reaches the number of data.

In the data distribution method provided by the embodiment of the present disclosure, multiple receiving ends in the same group share the full amount of data, that is, the data required by the multiple receiving ends in the group conforms to the data type of the CDR data required by the receiving end. The sum of the numbers is equal to the full amount of data. In this case, when the group receives the full amount of data sent by the sender, multiple receivers in the group receive CDR data in turn, until the CDR data received by all receivers in the group reaches each The amount of data required by the receiver. Here, the number of data required by multiple receivers in the same group that meet the data type of the CDR data required by the receiver can be different. After one receiver receives the required amount of data, it can stop sending CDRs to the receiver. data.

Referring to FIG. 4 , in some embodiments, in the data distribution method provided by the embodiments of the present disclosure, there are multiple receiving ends in the same group, and under the condition that the multiple receiving ends share the full amount of data together, step 210 "to the The receiving end in the same group sends the full amount of data corresponding to the data type of the CDR data required by the receiving end, so that the receiving end can receive the CDR data corresponding to the amount of data from the full amount of data." Specifically includes the following steps.

Step 212: Evenly distribute the full amount of data to multiple receivers in the same group.

The multiple receivers in the same group perform load sharing on the full amount of data. In this case, the sender needs to analyze and calculate before sending the CDR data. The multiple receivers in which group need the same amount of data of the data type that matches the CDR data required by the receiver, and calculate the corresponding CDR data required by the receiver. What is the amount of full data of the data type.

For example, it is now necessary to distribute the full amount of data as 100 pieces of CDR data from the sender to receiver A, receiver B, and receiver C for data processing. Receiver A and receiver B each need 50 pieces to complete the first task , the receiver C needs 100 pieces to complete the second task. During initialization, the receiver ID of receiver A is 1, the receiver ID of receiver B is 1, and the receiver ID of receiver C is 2. The sender groups according to the ID of the receiver (here, for the convenience of description, the data type of the CDR data required by all receivers is the same), receiver A and receiver B are in the same group, receiver C is another Group, each group receives a full amount of data. Since receiver A and receiver B belong to the same group, while receiver C belongs to another group alone, the sender distributes 100 CDR data equally to the receiver. A and receiver B send 100 pieces of CDR data to receiver C.

Referring to FIG. 5 , in some embodiments, before step 10 “receives the registration request sent by the receiving end”, the data distribution method provided by the embodiment of the present disclosure further includes the following steps.

Step 30: After the data generating end generates CDR data, the CDR data is classified according to the data type of the CDR data required by the receiving end, and the CDR data sent by the data generating end is received under the condition that the CDR data is classified and marked.

The data generating end, which is different from the sending end and the receiving end, generates the original communication data into CDR data after collecting the original communication data, and classifies the CDR data according to the data type of the CDR data required by the receiving end, and analyzes the CDR data. Category markers. After the classification is completed, the CDR data with the classification mark is sent to the sender.

Referring to FIG. 6 , a specific implementation of the data distribution method provided by the embodiment of the present disclosure will be described in detail below.

Goal: ① Distribute 30 pieces of CDR data with data type 1 through the sender to distribute 15 pieces of receiver A, 15 pieces of receiver B, and 30 pieces of receiver C (the receivers required by receiver A, receiver B and receiver B) The data type of the required CDR data is 1); ② Distribute 10 CDR data of type 2 to the receiving end A5 and the receiving end D 5 through the sending end (the receiving end A and the receiving end D need the required receiving end The data type of the CDR data is 2).

The data distribution steps are as follows.

Step 1: The receiving end establishes a connection with the sending end, and the receiving end reports the receiving end ID, the data type and data quantity of the CDR data required by the receiving end to the sending end, and the reported information is called registration information. The content of the registration information is abstracted as follows :

字段field	描述describe
typetype	用于接收端告知发送端所需CDR数据的数据类型The data type used by the receiver to inform the sender of the required CDR data
idid	用于接收端之间的分组，id相同的子节点为一组For grouping between receivers, child nodes with the same id are a group
Data_Type_countData_Type_count	接收端所需CDR数据的数据类型的数据数量。The data quantity of the data type of the CDR data required by the receiver.

Content of registration information reported by receiver A:

type

1, 2 receiver ID: aa;

Content of registration information reported by receiver B: type 1 receiver ID: aa;

Content of registration information reported by receiver C: type 1 receiver ID: bb;

Content of registration information reported by receiver D: type 2 receiver ID: aa.

The amount of data is as mentioned in the previous objective and is omitted here.

Step 2: The sender receives the registration information of the receiver and registers as follows:

Receiver A:

Data types

1 and 2 of the CDR data required by the receiver are required; the receiver ID is aa;

Receiver B: Data type 1 of the CDR data required by the receiver is required; the receiver ID is aa;

Receiver C: data type 1 of the CDR data required by the receiver is required; the receiver ID is bb;

Receiver D: Data type 2 of the CDR data required by the receiver is required; the receiver ID is aa.

Summarizing all the receiving ends, the following results are obtained: for the CDR data whose data type is 1, the load sharing between the receiving end A and the receiving end B corresponds to the data type of the CDR data required by the receiving end is 1. For the full amount of data, the receiver C alone bears the full amount of data corresponding to the data type 1 of the CDR data required by the receiver; for the CDR data of the data type 2 of the CDR data required by the receiver, receiver A and receiver D load Share the full amount of data of the data type 2 corresponding to the CDR data required by the receiving end.

Step 3: The sender distributes 30 pieces of CDR data with the data type of CDR data required by the receiver as 1, and distributes them to 15 pieces of the receiver A, 15 pieces of the receiver B, and 30 pieces of the receiver C; The 10 pieces of CDR data whose data type is 2 are distributed to 5 pieces of CDR data at the receiving end and 5 pieces at the receiving end.

It can be seen from the above analysis that the data distribution method provided by the embodiments of the present disclosure is applicable to the scenario where the deep packet SPI data processing system needs to send CDR data to the CDR data processing node in the SPI data processing system during deep packet inspection, so that The CDR data processing node performs data processing, and the CDR data here is a detailed list of call records. The steps performed by the sending end of the data distribution method perform corresponding operations based on the registration request after receiving the registration request sent by the receiving end. The registration request includes the ID of the receiving end and the data type of the CDR data required by the receiving end, and the transmitting end sends the CDR data consistent with the data type of the CDR data required by the receiving end to the receiving end based on the registration request. The data distribution method can meet the diversity requirements of different data processing nodes for the data type and data quantity of the CDR data. The diversity requirement here is that different data processing nodes have different requirements for the CDR data. It can be seen that the complexity of data distribution is reduced and the efficiency of data distribution is improved.

Embodiment 2

Referring to FIG. 7 , a data distribution method provided by an embodiment of the present disclosure, executed at a receiving end, includes the following steps.

Step 10': send a registration request to the sender, where the registration request includes the receiver ID and the data type of the CDR data required by the receiver.

After receiving the registration request from the receiver, the sender needs to respond according to the registration request. The registration request includes the ID of the receiver and the data type of the CDR data required by the receiver. It can be seen that the receiver here can correspond to the data processing node one by one, and send the data processing node's request for CDR data to the sender, so that the sender can Obtain the CDR data requirements of each data processing node. The requirement of each data processing node for CDR data can be the data type of the CDR data required by the receiving end corresponding to the data processing node, and the data quantity can be set in advance at the sending end, or the receiving end can send a registration request every time It is carried in the registration request, and is not limited here. At the same time, in order to facilitate the sender to distinguish each receiver, the registration request includes the receiver ID. The receiver ID can be used to identify the receiver's code, serial number or user name, which is not limited here, as long as it is convenient for the sender to follow up accurately. It is sufficient to send the CDR data required by the receiving end to the receiving end.

Step 20': The receiving and transmitting end sends, based on the registration request, CDR data consistent with the data type of the CDR data required by the receiving end.

After the sender receives the registration request from the receiver, it sends the CDR data that is consistent with the data type of the CDR data required by the receiver to the receiver according to the information mentioned in the registration request. Processing nodes perform data analysis tasks.

Referring to FIG. 8 , in some embodiments, in the data distribution method provided by the embodiments of the present disclosure, at the transmitting end, the receiving end with the same receiving end ID and the data type of the CDR data required by the receiving end are grouped into the same group. Next, step 20' "the receiving and sending end sends CDR data consistent with the data type of the CDR data required by the receiving end based on the registration request" specifically includes the following steps.

Step 200': when the transmitting terminal sends the full data of the data type of the CDR data required by the corresponding receiving terminal to the receiving terminal under the same group, receive the CDR data from the full data.

When the sender executes the response based on the registration request, it will refer to the ID of the receiver provided by the registration request, the data type and data quantity of the CDR data required by the receiver, and select the CDR that matches the data type and data quantity of the CDR data described by the receiver. After the data is ready, it is sent to the receiver with the receiver ID. In the embodiment of the present disclosure, the transmitting end first classifies the receiving ends with the same receiving end ID and the same data type of CDR data required by the receiving end into the same group, with different receiving end IDs and different data types of CDR data required by the receiving end The receivers are divided into different groups, the purpose is to process the CDR data according to the group when the receiver sends CDR data.

Referring to FIG. 9 , in some embodiments, in the data distribution method provided by the embodiment of the present disclosure, the registration request includes the amount of data, there are multiple receivers in the same group, and the conditions for the multiple receivers to share the full amount of data together Next, step 200' "when the transmitting end sends the full amount of data of the data type of the CDR data required by the corresponding receiving end to the receiving end under the same group, receive the CDR data of the corresponding data quantity from the full amount of data", specifically comprising the following steps .

Step 201': multiple receivers under the same group take turns to receive the CDR data in the full amount of data sent by the sender, until the CDR data received by the multiple receivers under the same group reaches the number of data.

Referring to FIG. 10 , in some embodiments, in the data distribution method provided by the embodiments of the present disclosure, there are multiple receiving ends in the same group, and under the condition that the multiple receiving ends share the full amount of data, step 200'" When the sender sends the full amount of data corresponding to the data type of the CDR data required by the receiver to the receiver under the same group, it receives the CDR data corresponding to the amount of data from the full amount of data", which specifically includes the following steps.

Step 202': Obtain the CDR data after the full amount of data is evenly distributed.

It can be seen from the above analysis that the data distribution method provided by the embodiments of the present disclosure is applicable to the scenario where the deep packet SPI data processing system needs to send CDR data to the CDR data processing node in the SPI data processing system during deep packet inspection, so that The CDR data processing node performs data processing, and the CDR data here is a detailed list of call records. The steps performed by the sending end of the data distribution method perform corresponding operations based on the registration request after receiving the registration request sent by the receiving end. The registration request includes the ID of the receiving end and the data type of the CDR data required by the receiving end, and the sending end sends, based on the registration request, the CDR data corresponding to the amount of data that is consistent with the data type of the CDR data required by the receiving end to the receiving end. The data distribution method can meet the diversity requirements of different data processing nodes for the data type and data quantity of the CDR data. The diversity requirement here is that different data processing nodes have different requirements for the CDR data. It can be seen that the complexity of data distribution is reduced and the efficiency of data distribution is improved.

Embodiment 3

Referring to FIG. 11 , a data distribution method provided by an embodiment of the present disclosure includes the following steps at a data generating end.

Step 10": Generate CDR data.

The data generating end, which is different from the sending end and the receiving end, generates the original communication data into CDR data after collecting the original communication data.

Step 20": classify the CDR data according to the data type of the CDR data required by the receiving end and classify and mark the CDR data.

The data generating end classifies the CDR data according to the data type of the CDR data required by the receiving end, and classifies and marks the CDR data.

Step 30": Send the CDR data to the sender.

The data generating end sends the CDR data with the classification mark to the transmitting end.

Embodiment 4

Referring to FIG. 12 , which is a schematic structural diagram of a data distribution apparatus according to an embodiment of the present disclosure, the data distribution apparatus 1 is set at the sending end and includes the following modules.

The request receiving module 10 is configured to receive a registration request sent by the receiver, where the registration request includes the receiver ID and the data type of the CDR data required by the receiver.

After receiving the registration request from the receiver, the sender needs to respond according to the registration request. The registration request includes the ID of the receiver and the data type of the CDR data required by the receiver. It can be seen that the receiver here can correspond to the data processing node one by one, and send the data processing node's request for CDR data to the sender, so that the sender can Obtain the CDR data requirements of each data processing node. The requirement of each data processing node for CDR data may be the data type and data quantity of the CDR data required by the receiving end corresponding to the data processing node, and the data quantity here may be preset at the sending end. At the same time, in order to facilitate the sender to distinguish each receiver, the registration request includes the receiver ID. The receiver ID can be used to identify the receiver's code, serial number or user name, which is not limited here, as long as it is convenient for the sender to follow up accurately. It is sufficient to send the CDR data required by the receiving end to the receiving end.

The data sending module 20 is configured to send the CDR data consistent with the data type of the CDR data required by the receiving end to the receiving end based on the registration request.

In some embodiments, the data distribution apparatus provided by the embodiments of the present disclosure, the data sending module 20, is further configured to: group the receiving ends with the same receiving end ID and the data type of the CDR data required by the receiving end into the same group.

The full amount of data corresponding to the data type of the CDR data required by the receiver is sent to the receivers in the same group, so that the receiver can receive CDR data corresponding to the amount of data from the full amount of data.

Embodiment 5

Referring to FIG. 13 , it is a schematic structural diagram of a data distribution apparatus according to an embodiment of the present disclosure. The data distribution device 2 is set at the receiving end, and includes the following modules.

The request sending module 10' is configured to send a registration request to the sender, where the registration request includes the receiver ID and the data type of the CDR data required by the receiver.

After receiving the registration request from the receiver, the sender needs to respond according to the registration request. The registration request includes the ID of the receiver and the data type of the CDR data required by the receiver. It can be seen that the receiver here can correspond to the data processing node one by one, and send the data processing node's request for CDR data to the sender, so that the sender can Obtain the CDR data requirements of each data processing node. The requirement of each data processing node for the CDR data may be the data type and data quantity of the CDR data required by the receiving end corresponding to the data processing node. At the same time, in order to facilitate the sender to distinguish each receiver, the registration request includes the receiver ID. The receiver ID can be used to identify the receiver's code, serial number or user name, which is not limited here, as long as it is convenient for the sender to follow up accurately. It is sufficient to send the CDR data required by the receiving end to the receiving end.

The data receiving module 20' is configured to receive CDR data that is consistent with the data type of the CDR data required by the receiving end based on the registration request sent by the sending end.

In some embodiments, in the data distribution apparatus provided by the embodiments of the present disclosure, under the condition that the transmitting end groups the receiving ends with the same receiving end ID and the data type of the CDR data required by the receiving end into the same group, the data receiving module 20 ', and is further configured to receive CDR data from the full amount of data when the transmitter sends the full amount of data corresponding to the data type of the CDR data required by the receiver to the receiver under the same group.

Embodiment 6

Referring to FIG. 14 , it is a schematic structural diagram of a data distribution apparatus according to an embodiment of the present disclosure. The data distribution device 3, set at the data generating end, includes the following modules.

The data generation module 10" is configured to generate CDR data.

The classification module 20" is configured to classify the CDR data according to the data type of the CDR data required by the receiving end and to classify and mark the CDR data.

The data originating module 30" is configured to send the CDR data to the sending end.

Embodiment 7

In addition, an embodiment of the present specification provides a communication system, including the data distribution apparatus shown in FIG. 12 to FIG. 14 . As shown in FIG. 12 , the data distribution apparatus 1 is set at the sending end, and includes the following modules.

Embodiment 8

A storage medium provided by an embodiment of the present disclosure is configured as a computer-readable storage medium, and the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to realize the following: The steps of the data distribution method shown in FIG. 1 to FIG. 11 may specifically perform the following steps.

It can be seen from the above analysis that the data distribution method provided by the embodiments of the present disclosure is applicable to the scenario where the deep packet SPI data processing system needs to send CDR data to the CDR data processing node in the SPI data processing system during deep packet inspection, so that The CDR data processing node performs data processing, and the CDR data here is a detailed list of call records. The steps performed by the sending end of the data distribution method perform corresponding operations based on the registration request after receiving the registration request sent by the receiving end. The registration request includes the ID of the receiving end and the data type of the CDR data required by the receiving end, and the sending end sends, based on the registration request, the CDR data corresponding to the amount of data that is consistent with the data type of the CDR data required by the receiving end to the receiving end. The data distribution method can meet the diverse requirements of different data processing nodes for the data type and data quantity of CDR data, and the diversity requirement here is that different data processing nodes have different requirements for CDR data. It can be seen that the complexity of data distribution is reduced and the efficiency of data distribution is improved.

In a word, the above descriptions are only preferred embodiments of the present specification, and are not intended to limit the protection scope of the present specification. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this specification shall be included within the protection scope of this specification.

The systems, devices, modules or units described in one or more of the above embodiments may be specifically implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer can be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or A combination of any of these devices.

Computer-readable storage media includes both persistent and non-permanent, removable and non-removable media, and storage of information can be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media, such as modulated data signals and carrier waves.

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture, or device that includes the element.

Each embodiment in this specification is described in a progressive manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, as for the system embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for related parts, please refer to the partial descriptions of the method embodiments.

The foregoing describes specific embodiments of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve desirable results. Additionally, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

Claims

A data distribution method, executed at a sending end, the method comprising:

Receive a registration request sent by the receiving end, and the registration request includes the receiving end identification ID and the data type of the CDR data required by the receiving end;

Based on the registration request, the CDR data consistent with the data type of the CDR data required by the receiving end is sent to the receiving end.
The data distribution method according to claim 1, wherein, based on the registration request, sending the CDR data consistent with the data type of the CDR data required by the receiving end to the receiving end, comprising:

The receiving ends with the same receiving end ID and the same data type of the CDR data required by the receiving end are classified into the same group;

Sending full data corresponding to the data type of CDR data required by the receiving end to the receiving end in the same group, so that the receiving end can receive CDR data from the full data.
The data distribution method according to claim 2, wherein the registration request further includes the amount of data, there are multiple receivers in the same group, and the multiple receivers share the condition of the full amount of data Next, send the full amount of data corresponding to the data type of the CDR data required by the receiver to the receiver under the same group, so that the receiver can receive the CDR data from the full amount of data, including:

Sending the CDR data in the full amount of data to a plurality of the receivers under the same group in turn, until the CDR data received by the receivers under the same group reaches the data quantity.
The data distribution method according to claim 2 or 3, wherein under the condition that there are a plurality of the receiving ends in the same group, and the plurality of the receiving ends share the full amount of data together, the data is sent to the same group. The receiving end of the other category sends the full amount of data corresponding to the data type of the CDR data required by the receiving end, so that the receiving end can receive the CDR data from the full amount of data, including:

The full amount of data is evenly distributed to the multiple receivers in the same group.
The data distribution method according to claim 1, wherein, before receiving the registration request sent by the receiver, the method further comprises:

After the data generating end generates CDR data, the CDR data is classified according to the data type of the CDR data required by the receiving end, and the CDR data sent by the data generating end is received under the condition that the CDR data is classified and marked data.
A data distribution method, executed at a receiving end, the method comprising:

Send a registration request to the sender, where the registration request includes the receiver identification ID and the data type of the CDR data required by the receiver;

The receiving end sends, based on the registration request, CDR data that is consistent with the data type of the CDR data required by the receiving end.
The data distribution method according to claim 6, wherein, under the condition that the transmitting end classifies the receiving ends with the same receiving end ID and the same data type of the CDR data required by the receiving ends into the same group, Receive CDR data that is consistent with the data type of the CDR data required by the receiving end based on the registration request sent by the transmitting end, including:

When the transmitting end sends the full amount of data corresponding to the data type of the CDR data required by the receiving end to the receiving end in the same group, the CDR data is received from the full amount of data.
The data distribution method according to claim 7, wherein the registration request further includes the amount of data, there are multiple receivers in the same group, and the multiple receivers share the condition of the full amount of data Next, when the transmitting end sends the full amount of data corresponding to the data type of the CDR data required by the receiving end to the receiving end under the same group, receiving CDR data from the full amount of data, including:

The multiple receivers under the same group take turns to receive the CDR data in the full amount of data sent by the sender until the CDR data received by the multiple receivers under the same group to the stated amount of data.
The data distribution method according to claim 7 or 8, wherein under the condition that there are a plurality of the receiving ends in the same group, and the plurality of the receiving ends share the full amount of data, the sending end When sending the full amount of data corresponding to the data type of the CDR data required by the receiver to the receiving end in the same group, receiving the CDR data corresponding to the data quantity from the full amount of data, including:

Obtain the CDR data after evenly distributing the full amount of data.
A data distribution method, executed at a data generating end, the method comprising:

Generate CDR data;

The CDR data is classified according to the data type of the CDR data required by the receiving end and the CDR data is classified and marked;

sending the CDR data to the sending end.
A data distribution device, set at a sending end, the device comprising:

A request receiving module, configured to receive a registration request sent by the receiving end, the registration request including the receiving end identification ID and the data type of the CDR data required by the receiving end;

A data sending module configured to send, to the receiving end, CDR data consistent with the data type of the CDR data required by the receiving end based on the registration request.
The data distribution apparatus of claim 11, wherein the data sending module is further configured to:

The receiving ends with the same receiving end ID and the same data type of the CDR data required by the receiving end are classified into the same group;

Sending full data corresponding to the data type of CDR data required by the receiving end to the receiving end in the same group, so that the receiving end can receive CDR data from the full data.
A data distribution device, set at a receiving end, the device comprising:

A request sending module, configured to send a registration request to the sender, where the registration request includes the receiver identifier ID and the data type of the CDR data required by the receiver;

A data receiving module configured to receive CDR data sent by the sending end based on the registration request and consistent with the data type of the CDR data required by the receiving end.
The data distribution device according to claim 13, wherein, under the condition that the transmitting end classifies the receiving ends with the same receiving end ID and the same data type of the CDR data required by the receiving ends into the same group, The data receiving module is also configured as:

When the transmitting end sends the full amount of data corresponding to the data type of the CDR data required by the receiving end to the receiving end in the same group, the CDR data is received from the full amount of data.
A data distribution device, arranged at a data generating end, the device comprising:

a data generation module, configured to generate CDR data;

A classification module, configured to classify the CDR data according to the data type of the CDR data required by the receiving end and to classify and mark the CDR data;

A data originating module, configured to send the CDR data to the sending end.
A DPI data processing system, comprising the data distribution apparatus according to any one of claims 11 to 15.
A storage medium for computer-readable storage, the storage medium stores one or more programs, and when the one or more programs can be executed by one or more processors, the implementation as in claims 1 to 10 The steps of any one of the data distribution methods.