WO2020134392A1 - Data distribution method and apparatus, and storage medium - Google Patents

Data distribution method and apparatus, and storage medium Download PDF

Info

Publication number
WO2020134392A1
WO2020134392A1 PCT/CN2019/111799 CN2019111799W WO2020134392A1 WO 2020134392 A1 WO2020134392 A1 WO 2020134392A1 CN 2019111799 W CN2019111799 W CN 2019111799W WO 2020134392 A1 WO2020134392 A1 WO 2020134392A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
cache area
area
distribution key
distributed
Prior art date
Application number
PCT/CN2019/111799
Other languages
French (fr)
Chinese (zh)
Inventor
黄小龙
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2020134392A1 publication Critical patent/WO2020134392A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/08Testing, supervising or monitoring using real traffic
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W28/00Network traffic management; Network resource management
    • H04W28/02Traffic management, e.g. flow control or congestion control
    • H04W28/08Load balancing or load distribution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W28/00Network traffic management; Network resource management
    • H04W28/02Traffic management, e.g. flow control or congestion control
    • H04W28/10Flow control between communication endpoints
    • H04W28/14Flow control between communication endpoints using intermediate storage
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the present disclosure relates to the field of communication technologies, and in particular, to a data distribution method, device, and storage medium.
  • Wireless soft data collection refers to the user terminal defined by the LTE (Long Term Evolution) specification, and is the control specification protocol data that needs to be used when transmitting user data between devices such as base stations and base station controllers.
  • LTE Long Term Evolution
  • These protocols mainly involve the LTE air interface protocol RRC (Radio Resource Control), X2AP protocol (X2 Application Protocol, application protocol) and base station measurement report data (MR).
  • RRC Radio Resource Control
  • X2AP protocol X2 Application Protocol, application protocol
  • MR base station measurement report data
  • the data of the same base station needs to be distributed to the same device or module. That is to say, when distributing data to the front-end distribution module, not only must the data be distributed to each module as evenly as possible, but also to ensure that the data of the same protocol of the same base station needs to be distributed to a specific module, otherwise the business Association analysis may be wrong.
  • the base station ID can be obtained from the header of the signaling message, and each base station is unique.
  • Protocol type information can also be obtained from the signaling message header of a protocol TYPE (type) field.
  • an initial KEY value of a data distribution (hereinafter also referred to as distribution) can be formed. Use this KEY to distribute the data of the same protocol of the same base station into the overload algorithm to the same module.
  • the above KEY value can be divided into different modules by modulo or hash operation.
  • due to the uneven data of different base stations or the inconsistent performance of the back-end modules it may cause uneven distribution or even if the distribution is uniform, but some back-end modules have low performance, and the performance of each module cannot be maximized.
  • the present disclosure provides a data distribution method, device, and storage medium to solve the problem that data distribution cannot be performed according to the actual congestion situation of the back-end module in the related art.
  • a data distribution method including: receiving data sent by a traffic aggregation adapter SCA; determining a first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data; The first distribution KEY distributes the data to each primary cache area; according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data to be processed in each secondary cache area A second distribution KEY is determined according to the amount of data; according to the second distribution KEY, the data to be distributed in the primary cache area is distributed to each secondary cache area.
  • a data distribution apparatus including: a receiving module for receiving data sent by a traffic aggregation adapter SCA; a first determining module for a base station identification ID corresponding to the data and The protocol type information determines the first distribution key value KEY; the first distribution module is used to distribute the data to each level one cache area according to the first distribution key; the second determination module is used to determine the first level cache The second distribution KEY is determined by the base station ID corresponding to the data to be distributed in the area, the protocol type information, and the data volume of the data to be processed in each secondary cache area; the second distribution module is used to The data to be distributed in the first-level cache area is distributed to each of the second-level cache areas.
  • a device for determining data distribution including: a processor; a memory for storing processor-executable instructions; when the instructions are executed by the processor, the following operations are performed: receiving traffic The data sent by the aggregation adapter SCA; the first distribution key value KEY is determined according to the base station identification ID and the protocol type information corresponding to the data; the data is distributed to each level one cache area according to the first distribution KEY; according to the The second distribution KEY is determined by the base station ID corresponding to the data to be distributed in the first-level cache area, protocol type information, and the data volume of the data to be processed in each second-level cache area; the first-level cache is cached according to the second distribution KEY The data to be distributed in the area is distributed to each of the secondary cache areas.
  • a non-transitory computer-readable storage medium which, when instructions in the storage medium are executed by a processor, enables the processor to execute the description according to the first aspect of the present disclosure Data distribution method.
  • Figure 1 is a schematic diagram of a wireless soft system
  • Fig. 2 is a flowchart of a data distribution method according to an exemplary embodiment
  • Fig. 3 is a flowchart of a data distribution method according to an exemplary embodiment
  • Fig. 4 is a flow chart showing distributing data to be distributed in a first-level cache area to each second-level cache area according to a second distribution KEY according to an exemplary embodiment
  • Fig. 5 is a block diagram of a data distribution device according to an exemplary embodiment
  • Fig. 6 is a block diagram of a data distribution device according to an exemplary embodiment.
  • FIG. 1 is a schematic diagram of a wireless soft system.
  • the system involves an SCA (Traffic Convergence Adapter) and a data collection module , Data processing modules, data distribution modules, databases, files, and third parties.
  • the data collection module, the data processing module and the data distribution module constitute a soft mining protocol machine, and the data distribution method of the present disclosure can be executed by the soft mining protocol machine.
  • the data collection module can receive data from multiple SCA devices through SDTP (Serial Data Transport Protocol), aggregate the collected data, and distribute the data to each thread in the data processing module for processing and data processing. After the module processes the data, it distributes the data to the data distribution module according to the configuration.
  • the data distribution module then distributes the data to a write file, stores it in a database, or sends it to a third party.
  • SDTP Serial Data Transport Protocol
  • Fig. 2 is a flowchart of a data distribution method according to an exemplary embodiment. As shown in Fig. 2, the method includes the following steps:
  • Step 201 Receive data sent by SCA
  • a large amount of service signaling data of SCA equipment can be collected through the SDTP protocol multi-interface.
  • Step 202 Determine the first distribution key value KEY according to the base station ID corresponding to the data and the protocol type information;
  • the header of the signaling carrying the data can be analyzed to extract the protocol type of the data.
  • Data of different protocol types can extract different key value information.
  • base station ID in the RRC (Radio Resource Control) protocol MME_UE_S1AP_ID, S1APID in X2AP, base station ID in MR, CellID, etc.
  • the base station ID and the protocol type identifier corresponding to the data can be used as two input quantities of the hash function, so as to obtain the first distribution KEY corresponding to the data. After obtaining the first distribution KEY, according to the number of the second buffer area in the back end Modulo the first KEY to distribute data to different second buffers.
  • the first distribution KEY corresponding to the data of the RRC protocol can be calculated by the following formula:
  • RRC_KEY Hash(ENBID, MME_UE_S1AP_ID);
  • the first distribution KEY corresponding to the data of the X2AP protocol can be calculated by the following formula:
  • X2AP_KEY Hash(ENBID, CELLID);
  • the first distribution KEY corresponding to the data of the S1AP protocol can be calculated by the following formula:
  • UU_EXTERN_KEY Hash(ENBID, MME_UE_S1AP_ID, MME_GROUP_ID);
  • Step 203 Distribute the data to each primary cache area according to the first distribution KEY;
  • the first-level cache area is used for temporarily storing data and distributing data.
  • the ID of the first-level cache area can be obtained according to the following formula, so that the data to be distributed can be distributed to the corresponding to the ID First-level cache area:
  • the DISTRIBUTE_ID in the above formula indicates the ID of the first-level cache area
  • KEY is the first-level distribution KEY
  • MODULE_NUM indicates the modulus operation.
  • Step 204 Determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data amount of the data to be processed in each secondary cache area;
  • a distribution KEY can be calculated according to the base station ID and protocol type information corresponding to the data to be distributed in the primary cache area, and then the data to be processed in the secondary cache area corresponding to the primary cache area The value of the distribution KEY is adjusted to obtain the second distribution KEY.
  • the second-level cache area corresponding to the first-level cache area is at least two second-level cache areas for distributing data by the first-level cache area.
  • Step 205 Distribute the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY.
  • the first-level cache area and the second-level cache area may be the buffer area in the data acquisition module in the above soft mining protocol machine.
  • the second-level cache area may send the data to the corresponding in the data processing module Threads are processed, and each secondary cache area can correspond to different threads.
  • Protocol type information and the amount of data to be processed in the secondary cache area determines the second distribution KEY, according to the second distribution key to distribute the data to be distributed in the primary cache area to the secondary cache area, so as to achieve
  • the data backlog of the end processing module dynamically adjusts the amount of data distributed to each back-end processing module, so that load balancing can be better performed.
  • the determining the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, the protocol type information, and the data amount of the data to be processed in each secondary cache area may include:
  • the value of the adjustment factor is determined according to the data amount of the data to be processed in the first cache area and the second cache area; for example, an initial adjustment factor may be preset, and by adjusting the value of the initial adjustment factor, the current primary cache area will be determined
  • the data to be distributed is distributed to the first buffer area or the second buffer area corresponding to the buffer area, which can be adjusted in a positive direction, that is, increase the preset value on the basis of the original adjustment factor, or negatively adjusted, that is, in the original Based on the adjustment factor, the preset value is decreased to determine whether the data will be distributed to the first cache area or the second cache area.
  • Using the adjustment factor to adjust the second distribution KEY to be adjusted may be, for example, adding or subtracting the adjustment factor on the basis of the calculated second distribution KEY.
  • the second distribution KEY to be adjusted is calculated according to the base station ID and protocol type information corresponding to the data to be distributed in the first-level buffer area; wherein the calculation method of the second distribution KEY to be adjusted may be the same as the calculation method of the first distribution KEY described above, I won't repeat them here. Adjust the second distribution KEY to be adjusted using the adjustment factor to obtain the second distribution KEY.
  • the first cache area and the second cache area are a pair of second-level cache areas pre-configured corresponding to a first-level cache area.
  • the first-level cache area is a first-level cache module
  • the secondary buffer area takes the secondary buffer module as an example.
  • 31, 32, 33, 34, and 35 shown in FIG. 3 are primary buffer modules, and the pair of secondary buffer modules corresponding to 31 are: 311 and 312, a pair of secondary buffer modules corresponding to 32 are 321 and 322, a pair of secondary buffer modules corresponding to 33 are 331 and 332, and a pair of secondary buffer modules corresponding to 34 are 341 and 342, a pair of secondary buffer modules corresponding to 35 are 351 and 352, respectively.
  • the signaling header is analyzed, the information required to distribute the KEY is extracted, and the first-level distribution KEY is generated according to The number of the back-end first-level buffer modules performs modulus operation according to the above calculation formula for calculating the first-level buffer area, and distributes the data to different first-level buffer modules according to the calculation results.
  • the primary buffer module receives the data, it distributes the data to the secondary buffer module again according to the secondary distribution key.
  • the secondary buffer module passes the data to the corresponding thread in the data processing module for processing.
  • determining the value of the adjustment factor according to the data amount of the data to be processed in the first cache area and the second cache area may include: determining the first cache area and the second cache area respectively Whether the number of data packets to be processed is greater than a first threshold; the number of data packets to be processed in the first cache area is greater than the first threshold, and the number of data packets to be processed in the second cache area
  • the value of the adjustment factor is adjusted so that The amount of data distributed by the primary cache area to the second cache area is greater than the amount of data distributed to the first cache area.
  • the following is an example of the processing flow for determining the value of the adjustment factor according to the data amount of the data to be processed in the first cache area and the second cache area.
  • the first distribution key is selected to be distributed to the first cache Whether the number of unprocessed data packets in the zone reaches the set threshold M (an example of the first threshold).
  • the threshold M may be determined according to the size of the first-level cache area and the size of the data flow received by the first cache area, for example, the threshold may be positively related to the size of the first-level cache area, and the size of the threshold may be related to the received data The size of the traffic is negatively correlated.
  • the threshold value M the number of unprocessed data packets in the first cache area is not greater than the threshold value M, it means that the first cache area is relatively free, and the first cache area can process data normally, then when the data is subsequently distributed, you can choose to send the data packets To the cache. If the number of unprocessed data packets in the first cache area is greater than the threshold value M, indicating that there are more data packets in the cache, you can further determine whether the number of unprocessed data packets in the second cache area exceeds the threshold Value M.
  • the number of unprocessed data packets in the second cache area is not greater than the threshold M, indicating that the second cache area is relatively free, you can change the value of the adjustment factor so that the data is distributed to the second cache area, if the second cache The number of unprocessed data packets in the area is greater than the threshold value M, indicating that the number of data packets in the second buffer area is also large. Then, the difference between the number of unprocessed data packets in the two first buffers and the number of unprocessed data packets in the second buffer can be further calculated. If the difference between the two unprocessed data packets is greater than the threshold N (which is an example of the above second threshold). Then, the value of the adjustment factor is changed, so that the data to be distributed this time is distributed to the second-level cache area with a small amount to be processed.
  • the threshold N which is an example of the above second threshold
  • distributing the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY may include: according to the data corresponding to the data to be distributed in the primary cache area The base station ID, the protocol type field, and the adjustment factor generate the second distribution KEY; determine whether the value of the adjustment factor occurred last time when data was distributed for a pair of second-level cache areas corresponding to the first-level cache area Change, the pair of secondary cache areas include a first cache area and a second cache area; when the value of the adjustment factor changes, the data to be distributed in the primary cache area is distributed according to the second distribution KEY Distribute to the first cache area or the second cache area; when the value of the adjustment factor changes, distribute the data to be distributed in the primary cache area to the first cache area according to the second distribution KEY The first cache area and the second cache area; the value of the adjustment factor has not changed, and the adjustment needs to be adjusted according to the amount of data to be processed in the first cache area and the second cache area When the value of the value of the
  • the second distribution KEY can be directly used to distribute the data to be distributed .
  • the process of distributing the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY will be described below through an example in conjunction with FIG. 4.
  • a data packet is read from the primary buffer area S, the base station ID and the protocol type identifier are determined according to the packet header information, and the second distribution KEY is generated based on the base station ID, the protocol type identifier and the adjustment factor,
  • the secondary cache area A or the secondary cache area B corresponding to the primary cache area S is selected as the target cache area for sending data packets. Determine whether the value of the adjustment factor has been modified.
  • the adjustment factor has been modified, it means that when the data was previously distributed for the buffer area A or the buffer area B, the adjustment factor has been based on the amount of data to be processed in the buffer area A or the buffer area B. The value has been adjusted, so there is no need to adjust the adjustment factor. If the adjustment factor has not been modified, it is determined whether the adjustment factor value needs to be adjusted according to the amount of data to be processed in the buffer area A and the buffer area B. The determination of the value of the adjustment factor according to the data amount of the data to be processed in the first buffer area and the second buffer area is described in detail, so it will not be repeated here. In the data distribution process shown in FIG.
  • the value of the second distribution KEY is automatically adjusted according to the backlog of data in the back-end module to realize dynamic feedback adjustment and form a positive direction Feedback loop, which can ensure the balance of the distribution data, and also guarantee the need for business data distribution and rent-free business rules, and can fully utilize the performance of the back-end module.
  • the data distribution method of the embodiment of the present disclosure can distribute the data, which can improve the performance of the back-end processing module by about five times. And can improve the performance of receiving data to a certain extent.
  • Fig. 5 is a block diagram of a data distribution device according to an exemplary embodiment. As shown in Fig. 5, the device 50 includes the following components:
  • the receiving module 51 is used to receive the data sent by the traffic aggregation adapter SCA;
  • the first determining module 52 is configured to determine a first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data;
  • the first distribution module 53 is configured to distribute data to each level one cache area according to the first distribution KEY;
  • the second determination module 54 is configured to determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data amount of the data to be processed in each secondary cache area;
  • the second distribution module 55 is configured to distribute the data to be distributed in the first-level cache area to each second-level cache area according to the second distribution KEY.
  • the second determining module may include: a first determining unit, configured to determine the value of the adjustment factor according to the data amount of the data to be processed in the first buffer area and the second buffer area, wherein, The first cache area and the second cache area are a pair of pre-configured second-level cache areas corresponding to a first-level cache area; a calculation unit is used to determine the base station ID corresponding to the data to be distributed in the first-level cache area 3.
  • the protocol type information is calculated to obtain a second distribution KEY to be adjusted; a first adjustment unit is used to adjust the second distribution KEY to be adjusted using the adjustment factor to obtain the second distribution KEY.
  • the first determining unit is configured to separately determine whether the number of data packets to be processed in the first cache area and the second cache area is greater than a first threshold; The number of data packets to be processed in the first buffer is greater than the first threshold, the number of data packets to be processed in the second buffer is not greater than the first threshold, and the first buffer And when the difference between the data packets to be sent in the second buffer area is greater than the second threshold, the value of the adjustment factor is adjusted so that the first-level buffer area distributes the data to be distributed to the second buffer area .
  • the second distribution module includes: a second determination unit, configured to determine the location based on the base station ID, the protocol type field, and the adjustment factor corresponding to the data to be distributed in the first-level cache area The second distribution KEY; a judgment unit for judging whether the value of the adjustment factor has changed when the data was distributed for a pair of secondary cache areas corresponding to the primary cache area last time.
  • the area includes a first cache area and a second cache area; a first distribution unit is used to distribute the data to be distributed in the first-level cache area according to the second distribution KEY when the value of the adjustment factor changes To the first cache area or the second cache area; a third determination unit, which is used when the value of the adjustment factor has not changed, and according to the first cache area and the second cache area
  • a target adjustment factor is determined according to the amount of data to be processed in the first buffer area and the second buffer area;
  • a second adjustment unit is used to use the A target adjustment factor adjusts the second distribution KEY to obtain a target distribution KEY;
  • a second distribution unit is used to distribute the data to be distributed in the first-level cache area to the first cache area according to the target distribution KEY Or the second cache area.
  • Fig. 6 is a block diagram of a device 600 for determining data distribution according to an exemplary embodiment.
  • the device 600 may be provided as a server. 6
  • the device 600 includes a processor 622, the number of which may be one or more, and a memory 632, which is used to store a computer program executable by the processor 622.
  • the computer program stored in the memory 632 may include one or more modules each corresponding to a set of instructions.
  • the processor 622 may be configured to execute the computer program to perform the above-described method of determining data distribution.
  • the device 600 may further include a power component 626 and a communication component 650, which may be configured to perform power management of the device 600, and the communication component 650 may be configured to implement communication of the device 600, for example, wired or wireless communication .
  • the device 600 may also include an input/output (I/O) interface 658.
  • the device 600 can operate an operating system based on the memory 632, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, and so on.
  • a non-transitory computer-readable storage medium including program instructions for example, a memory 632 including program instructions
  • the program instructions may be executed by the processor 622 of the device 600 to complete the above Determine the method of data distribution.
  • the data distribution method of the embodiment of the present disclosure after obtaining the first distribution KEY according to the base station ID corresponding to the data to be distributed and the protocol type information and distributing the data to the first-level cache area, then according to the data corresponding to the data to be distributed in the first-level cache area.
  • the base station ID, protocol type information and the amount of data to be processed in the secondary cache area determine the second distribution KEY, and according to the second distribution KEY, the data to be distributed in the primary cache area is distributed to the secondary cache area, thereby realizing
  • the purpose of dynamically adjusting the amount of data distributed to each back-end processing module according to the data backlog of the back-end processing module can better load balance.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

Provided are a data distribution method and apparatus, and a storage medium, which are used for solving the problem in the related art of it not being possible to carry out data distribution according to the actual congestion condition of threads. The method comprises: receiving data sent by a signaling collection adapter (SCA); determining a first distribution key value (KEY) according to a base station ID and protocol type information corresponding to the data; distributing, according to the first distribution KEY, the data to various primary cache regions; determining a second distribution KEY according to the base station ID and protocol type information corresponding to the data, which is to be distributed, in the primary cache regions, and according to the data amount of data, which is to be processed, in secondary cache regions; and distributing, according to the second distribution KEY, the data, which is to be distributed, in the primary cache regions to the secondary cache regions.

Description

数据分发方法、装置及存储介质Data distribution method, device and storage medium
本公开要求享有2018年12月26日提交的名称为“数据分发方法、装置及存储介质”的中国专利申请CN201811606877.X的优先权,其全部内容通过引用并入本文中。This disclosure claims the priority of the Chinese patent application CN201811606877.X, entitled "Data Distribution Method, Device, and Storage Media", filed on December 26, 2018, the entire contents of which are incorporated herein by reference.
技术领域Technical field
本公开涉及通信技术领域,特别是涉及一种数据分发方法、装置及存储介质。The present disclosure relates to the field of communication technologies, and in particular, to a data distribution method, device, and storage medium.
背景技术Background technique
无线软采集数据是指LTE(Long Term Evolution,长期演进)规范定义的用户终端,是基站以及基站控制器等设备之间传输用户数据时需要使用的控制规范协议数据。这些协议主要涉及LTE空口协议RRC(Radio Resource Control,无线资源控制),X2AP协议(X2Application Protocol,应用协议)和基站测量报告数据(MR)。根据业务关联处理的规则,需要将同一个基站的数据分发到相同的设备或者模块。也即前端分发模块在对数据进行分发时,不仅需要使数据尽可能均衡的分发到每个模块,同时还要保证同一个基站的同一个协议的数据需要分到某个特定的模块,否则业务关联分析可能会出错。其中,可以从信令消息的头部获取到基站ID,每个基站唯一。协议类型信息也可以从信令消息头部获取到一个协议的TYPE(类型)字段。根据基站ID以及协议类型信息可组成一个数据分流(以下也称分发)的初始KEY值。使用这个KEY将同一个基站的相同协议的数据进过负载算法分发到同一个模块。通常可将上述KEY值通过取模或者进行哈希运算的方式把数据分到不同模块。但是由于不同基站的数据可能不均衡或者后端模块性能不一致等原因,可能会导致分流不均或者即使分流均匀但是某些后端模块性能较低,不能最大化使用各个模块的性能。Wireless soft data collection refers to the user terminal defined by the LTE (Long Term Evolution) specification, and is the control specification protocol data that needs to be used when transmitting user data between devices such as base stations and base station controllers. These protocols mainly involve the LTE air interface protocol RRC (Radio Resource Control), X2AP protocol (X2 Application Protocol, application protocol) and base station measurement report data (MR). According to the rules of service association processing, the data of the same base station needs to be distributed to the same device or module. That is to say, when distributing data to the front-end distribution module, not only must the data be distributed to each module as evenly as possible, but also to ensure that the data of the same protocol of the same base station needs to be distributed to a specific module, otherwise the business Association analysis may be wrong. Among them, the base station ID can be obtained from the header of the signaling message, and each base station is unique. Protocol type information can also be obtained from the signaling message header of a protocol TYPE (type) field. According to the base station ID and protocol type information, an initial KEY value of a data distribution (hereinafter also referred to as distribution) can be formed. Use this KEY to distribute the data of the same protocol of the same base station into the overload algorithm to the same module. Generally, the above KEY value can be divided into different modules by modulo or hash operation. However, due to the uneven data of different base stations or the inconsistent performance of the back-end modules, it may cause uneven distribution or even if the distribution is uniform, but some back-end modules have low performance, and the performance of each module cannot be maximized.
发明内容Summary of the invention
本公开提供一种数据分发方法、装置及存储介质,用以解决相关技术中无法根据后端模块的实际拥堵情况进行数据分发的问题。The present disclosure provides a data distribution method, device, and storage medium to solve the problem that data distribution cannot be performed according to the actual congestion situation of the back-end module in the related art.
根据本公开的第一个方面,提供了一种数据分发方法,包括:接收流量汇聚适配器 SCA发送的数据;根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;根据所述第一分发KEY将所述数据分发至各一级缓存区;根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。According to the first aspect of the present disclosure, a data distribution method is provided, including: receiving data sent by a traffic aggregation adapter SCA; determining a first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data; The first distribution KEY distributes the data to each primary cache area; according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data to be processed in each secondary cache area A second distribution KEY is determined according to the amount of data; according to the second distribution KEY, the data to be distributed in the primary cache area is distributed to each secondary cache area.
根据本公开的第二个方面,提供了一种数据分发装置,包括:接收模块,用于接收流量汇聚适配器SCA发送的数据;第一确定模块,用于根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;第一分发模块,用于根据所述第一分发KEY将所述数据分发至各一级缓存区;第二确定模块,用于根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;第二分发模块,用于根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。According to a second aspect of the present disclosure, there is provided a data distribution apparatus, including: a receiving module for receiving data sent by a traffic aggregation adapter SCA; a first determining module for a base station identification ID corresponding to the data and The protocol type information determines the first distribution key value KEY; the first distribution module is used to distribute the data to each level one cache area according to the first distribution key; the second determination module is used to determine the first level cache The second distribution KEY is determined by the base station ID corresponding to the data to be distributed in the area, the protocol type information, and the data volume of the data to be processed in each secondary cache area; the second distribution module is used to The data to be distributed in the first-level cache area is distributed to each of the second-level cache areas.
根据本公开的第三个方面,提供了一种确定数据分发装置,包括:处理器;用于存储处理器可执行指令的存储器;当所述指令被处理器执行时,执行如下操作:接收流量汇聚适配器SCA发送的数据;根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;根据所述第一分发KEY将所述数据分发至各一级缓存区;根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。According to a third aspect of the present disclosure, there is provided a device for determining data distribution, including: a processor; a memory for storing processor-executable instructions; when the instructions are executed by the processor, the following operations are performed: receiving traffic The data sent by the aggregation adapter SCA; the first distribution key value KEY is determined according to the base station identification ID and the protocol type information corresponding to the data; the data is distributed to each level one cache area according to the first distribution KEY; according to the The second distribution KEY is determined by the base station ID corresponding to the data to be distributed in the first-level cache area, protocol type information, and the data volume of the data to be processed in each second-level cache area; the first-level cache is cached according to the second distribution KEY The data to be distributed in the area is distributed to each of the secondary cache areas.
根据本公开的第四个方面,提供了一种非临时性计算机可读存储介质,当所述存储介质中的指令由处理器执行时,使得处理器能够执行根据本公开第一个方面所述的数据分发方法。According to a fourth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium which, when instructions in the storage medium are executed by a processor, enables the processor to execute the description according to the first aspect of the present disclosure Data distribution method.
附图说明BRIEF DESCRIPTION
图1是无线软系统的示意图;Figure 1 is a schematic diagram of a wireless soft system;
图2是根据一示例性实施例示出的一种数据分发方法的流程图;Fig. 2 is a flowchart of a data distribution method according to an exemplary embodiment;
图3是根据一示例性实施例示出的一种数据分发方法的流程图;Fig. 3 is a flowchart of a data distribution method according to an exemplary embodiment;
图4是根据一示例性实施例示出的根据第二分发KEY将一级缓存区中待分发的数据分发至各二级缓存区的流程图;Fig. 4 is a flow chart showing distributing data to be distributed in a first-level cache area to each second-level cache area according to a second distribution KEY according to an exemplary embodiment;
图5是根据一示例性实施例示出的一种数据分发装置的框图;Fig. 5 is a block diagram of a data distribution device according to an exemplary embodiment;
图6是根据一示例性实施例示出的一种数据分发装置的框图。Fig. 6 is a block diagram of a data distribution device according to an exemplary embodiment.
具体实施方式detailed description
下面将结合本公开实施例中的附图,对本公开的实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本公开一部分实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有作出创造性劳动的前提下所获得的所有其他实施例,都属于本公开保护的范围。The technical solutions in the embodiments of the present disclosure will be described clearly and completely in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, but not all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present disclosure.
在对本公开的数据分发方法进行说明之前,首先对该方法的实施环境进行简要介绍,图1是无线软系统的示意图,如图1所示,该系统涉及SCA(流量汇聚适配器)、数据采集模块、数据处理模块、数据分发模块、数据库、文件以及第三方。其中,数据采集模块、数据处理模块以及数据分发模块构成软采协议机,本公开的数据分发方法可由该软采协议机执行。数据采集模块可通过SDTP(Serial Data Transport Protocol,串行数据传输协议)接收多个SCA设备的数据,对采集到的数据进行汇聚后将数据分发到数据处理模块中的各个线程进行处理,数据处理模块对数据进行处理完成后再根据配置将数据分发至数据分发模块,数据分发模块再将数据分发至写文件,存入数据库或送给第三方。Before explaining the data distribution method of the present disclosure, the implementation environment of the method is first briefly introduced. FIG. 1 is a schematic diagram of a wireless soft system. As shown in FIG. 1, the system involves an SCA (Traffic Convergence Adapter) and a data collection module , Data processing modules, data distribution modules, databases, files, and third parties. Among them, the data collection module, the data processing module and the data distribution module constitute a soft mining protocol machine, and the data distribution method of the present disclosure can be executed by the soft mining protocol machine. The data collection module can receive data from multiple SCA devices through SDTP (Serial Data Transport Protocol), aggregate the collected data, and distribute the data to each thread in the data processing module for processing and data processing. After the module processes the data, it distributes the data to the data distribution module according to the configuration. The data distribution module then distributes the data to a write file, stores it in a database, or sends it to a third party.
图2是根据一示例性实施例示出的一种数据分发方法的流程图,如图2所示,该方法包括如下步骤:Fig. 2 is a flowchart of a data distribution method according to an exemplary embodiment. As shown in Fig. 2, the method includes the following steps:
步骤201:接收SCA发送的数据;Step 201: Receive data sent by SCA;
例如,可通过SDTP协议多接口采集SCA设备的大量的业务信令数据。For example, a large amount of service signaling data of SCA equipment can be collected through the SDTP protocol multi-interface.
步骤202:根据所述数据对应的基站ID以及协议类型信息确定第一分发关键值KEY;Step 202: Determine the first distribution key value KEY according to the base station ID corresponding to the data and the protocol type information;
例如,可对携带所述数据的信令的头部进行分析,提取出数据的协议类型。不同协议类型的数据可以提取不同关键值信息。例如,RRC(Radio Resource Control,无线资源控制)协议中的基站ID,MME_UE_S1AP_ID,X2AP中的S1APID,MR中的基站ID,CellID等等。可将数据对应的基站ID以及协议类型标识符作为哈希函数的两个输入量,从而得到该数据对应的第一分发KEY,在得到第一分发KEY后,根据后端第二缓存区的个数,对该第一KEY进行取模,从而将数据分发到不同的第二缓存区。For example, the header of the signaling carrying the data can be analyzed to extract the protocol type of the data. Data of different protocol types can extract different key value information. For example, base station ID in the RRC (Radio Resource Control) protocol, MME_UE_S1AP_ID, S1APID in X2AP, base station ID in MR, CellID, etc. The base station ID and the protocol type identifier corresponding to the data can be used as two input quantities of the hash function, so as to obtain the first distribution KEY corresponding to the data. After obtaining the first distribution KEY, according to the number of the second buffer area in the back end Modulo the first KEY to distribute data to different second buffers.
例如,RRC协议的数据对应的第一分发KEY可通过下式计算得到:For example, the first distribution KEY corresponding to the data of the RRC protocol can be calculated by the following formula:
RRC_KEY=Hash(ENBID,MME_UE_S1AP_ID);RRC_KEY=Hash(ENBID, MME_UE_S1AP_ID);
X2AP协议的数据对应的第一分发KEY可通过下式计算得到:The first distribution KEY corresponding to the data of the X2AP protocol can be calculated by the following formula:
X2AP_KEY=Hash(ENBID,CELLID);X2AP_KEY=Hash(ENBID, CELLID);
S1AP协议的数据对应的第一分发KEY可通过下式计算得到:The first distribution KEY corresponding to the data of the S1AP protocol can be calculated by the following formula:
UU_EXTERN_KEY=Hash(ENBID,MME_UE_S1AP_ID,MME_GROUP_ID);UU_EXTERN_KEY=Hash(ENBID, MME_UE_S1AP_ID, MME_GROUP_ID);
步骤203:根据所述第一分发KEY将数据分发至各一级缓存区;Step 203: Distribute the data to each primary cache area according to the first distribution KEY;
其中,一级缓存区用于暂存数据以及分发数据,在确定出第一分发KEY后,可根据下式得出一级缓存区的ID,从而可将待分发的数据分发至该ID对应的一级缓存区:Among them, the first-level cache area is used for temporarily storing data and distributing data. After the first distribution KEY is determined, the ID of the first-level cache area can be obtained according to the following formula, so that the data to be distributed can be distributed to the corresponding to the ID First-level cache area:
DISTRIBUTE_ID=KEY%MODULE_NUM;DISTRIBUTE_ID=KEY%MODULE_NUM;
上式中的DISTRIBUTE_ID表示一级缓存区的ID,KEY为一级分发KEY,MODULE_NUM表示取模运算。The DISTRIBUTE_ID in the above formula indicates the ID of the first-level cache area, KEY is the first-level distribution KEY, and MODULE_NUM indicates the modulus operation.
步骤204:根据一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;Step 204: Determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data amount of the data to be processed in each secondary cache area;
在步骤204中,可根据一级缓存区中的待分发数据对应的基站ID、协议类型信息先计算出一个分发KEY,然后再根据该一级缓存区对应的二级缓存区中待处理的数据量对该分发KEY的值进行调整,得到第二分发KEY。其中,与一级缓存区对应的二级缓存区为被该一级缓存区分发数据的至少两个二级缓存区。In step 204, a distribution KEY can be calculated according to the base station ID and protocol type information corresponding to the data to be distributed in the primary cache area, and then the data to be processed in the secondary cache area corresponding to the primary cache area The value of the distribution KEY is adjusted to obtain the second distribution KEY. Wherein, the second-level cache area corresponding to the first-level cache area is at least two second-level cache areas for distributing data by the first-level cache area.
步骤205:根据所述第二分发KEY将所述一级缓存区中待分发数据分发至各二级缓存区。Step 205: Distribute the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY.
其中,一级缓存区以及二级缓存区可以是上述软采协议机中的数据采集模块中的缓存区,二级缓存区在接收到分发数据后,可将数据发送至数据处理模块中对应的线程进行处理,各二级缓存区可对应不同的线程。Among them, the first-level cache area and the second-level cache area may be the buffer area in the data acquisition module in the above soft mining protocol machine. After receiving the distribution data, the second-level cache area may send the data to the corresponding in the data processing module Threads are processed, and each secondary cache area can correspond to different threads.
本公开的数据分发方法,在根据待分发数据对应的基站ID以及协议类型信息得到第一分发KEY将数据分发至一级缓存区之后,再根据一级缓存区中待分发的数据对应的基站ID、协议类型信息以及二级缓存区中待处理的数据量确定出第二分发KEY,根据该第二分发KEY将一级缓存区中待分发的数据分发至二级缓存区,从而实现了根据后端处理模块的数据积压情况动态调节分发至各后端处理模块的数据量的目的,能够更好的进行负载均衡。In the data distribution method of the present disclosure, after obtaining the first distribution KEY according to the base station ID corresponding to the data to be distributed and the protocol type information and distributing the data to the first-level cache area, then according to the base station ID corresponding to the data to be distributed in the first-level cache area , Protocol type information and the amount of data to be processed in the secondary cache area determines the second distribution KEY, according to the second distribution key to distribute the data to be distributed in the primary cache area to the secondary cache area, so as to achieve The data backlog of the end processing module dynamically adjusts the amount of data distributed to each back-end processing module, so that load balancing can be better performed.
在一种可实现方式中,所述根据一级缓存区中待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY,可包括:根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值;例如,可预先设置一个初始调节因子,通过调整该初始调节因子的值可决定当前一级缓存区将待分发数据分发给与该以及缓存区对应的第一缓存区或第二缓存区,可通过正向调节,即在原始调节因子 的基础上增大预设数值,或负向调节,即在原始调节因子的基础上减小预设数值来确定数据将被分发至第一缓存区还是第二缓存区。使用调节因子对待调节的第二分发KEY进行调节例如可以是在计算得到的第二分发KEY的基础上加上或减去调节因子。根据一级缓存区中待分发数据对应的基站ID、协议类型信息计算得到待调节的第二分发KEY;其中,待调节的第二分发KEY的计算方式可同上述第一分发KEY的计算方式,此处不再赘述。使用所述调节因子对所述待调节的第二分发KEY进行调节,得到所述第二分发KEY。In an implementable manner, the determining the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, the protocol type information, and the data amount of the data to be processed in each secondary cache area may include: The value of the adjustment factor is determined according to the data amount of the data to be processed in the first cache area and the second cache area; for example, an initial adjustment factor may be preset, and by adjusting the value of the initial adjustment factor, the current primary cache area will be determined The data to be distributed is distributed to the first buffer area or the second buffer area corresponding to the buffer area, which can be adjusted in a positive direction, that is, increase the preset value on the basis of the original adjustment factor, or negatively adjusted, that is, in the original Based on the adjustment factor, the preset value is decreased to determine whether the data will be distributed to the first cache area or the second cache area. Using the adjustment factor to adjust the second distribution KEY to be adjusted may be, for example, adding or subtracting the adjustment factor on the basis of the calculated second distribution KEY. The second distribution KEY to be adjusted is calculated according to the base station ID and protocol type information corresponding to the data to be distributed in the first-level buffer area; wherein the calculation method of the second distribution KEY to be adjusted may be the same as the calculation method of the first distribution KEY described above, I won't repeat them here. Adjust the second distribution KEY to be adjusted using the adjustment factor to obtain the second distribution KEY.
其中,所述第一缓存区以及所述第二缓存区为预先配置的与一个一级缓存区对应的一对二级缓存区,如图3中所示,一级缓存区以一级缓冲模块为例,二级缓存区以二级缓冲模块为例,其中,图3中所示的31、32、33、34以及35为一级缓冲模块,与31对应的一对二级缓冲模块分别为311以及312,与32对应的一对二级缓冲模块分别为321以及322,与33对应的一对二级缓冲模块分别为331以及332,与34对应的一对二级缓冲模块分别为341以及342,与35对应的一对二级缓冲模块分别为351以及352。在图3所示的数据分发流程中,在通过SDTP传送协议接口程序,汇聚接收到的所有SCA的数据后,分析信令头部,提取分发KEY所需要的信息,生成一级分发KEY,根据后端一级缓冲模块的数量,根据上述计算一级缓存区的算式进行取模运算,根据运算结果将数据分发到不同的一级缓冲模块。一级缓冲模块接收到数据后,根据二级分发KEY再次把数据分发到二级缓冲模。二级缓冲模块再把数据传递给数据处理模块中对应的线程进行处理。Wherein, the first cache area and the second cache area are a pair of second-level cache areas pre-configured corresponding to a first-level cache area. As shown in FIG. 3, the first-level cache area is a first-level cache module For example, the secondary buffer area takes the secondary buffer module as an example. Among them, 31, 32, 33, 34, and 35 shown in FIG. 3 are primary buffer modules, and the pair of secondary buffer modules corresponding to 31 are: 311 and 312, a pair of secondary buffer modules corresponding to 32 are 321 and 322, a pair of secondary buffer modules corresponding to 33 are 331 and 332, and a pair of secondary buffer modules corresponding to 34 are 341 and 342, a pair of secondary buffer modules corresponding to 35 are 351 and 352, respectively. In the data distribution process shown in Figure 3, after collecting all the data of the SCA received through the SDTP transmission protocol interface program, the signaling header is analyzed, the information required to distribute the KEY is extracted, and the first-level distribution KEY is generated according to The number of the back-end first-level buffer modules performs modulus operation according to the above calculation formula for calculating the first-level buffer area, and distributes the data to different first-level buffer modules according to the calculation results. After the primary buffer module receives the data, it distributes the data to the secondary buffer module again according to the secondary distribution key. The secondary buffer module passes the data to the corresponding thread in the data processing module for processing.
在一种可实现方式中,根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值可包括:分别确定所述第一缓存区以及所述第二缓存区中待处理的数据包的个数是否大于第一阈值;在所述第一缓存区中待处理的数据包的个数大于所述第一阈值,所述第二缓存区中待处理的数据包的个数不大于所述第一阈值,且所述第一缓存区以及所述第二缓存区中待发的送数据包之差大于第二阈值时,调整所述调节因子的值,以使由所述一级缓存区分发至所述第二缓存区的数据量大于分发至所述第一缓存区的数据量。以下通过一个例子对根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值的处理流程,在该例子中,判断根据第一分发KEY选择被分发到第一缓存区还未处理的数据包的数量是否达到设定的阀值M(为第一阈值的一个示例)。该阀值M可根据一级缓存区的大小以及第一缓存区接收数据的流量的大小进行确定,例如,该阈值可以与一级缓存区的大小呈正相关关系,该阈值的大小可以与接收数据的流量的大小呈负相关关系。如果第一缓存区中还未处理的数据包的数量不大于阈值M,说明该第一缓存区比较空闲,该第一缓存区可以正常处理数据,则后续分发数据时,可选择将数据包发送到该缓 存区。如果第一缓存区中还未处理的数据包的数量大于阀值M,说明该缓存中数据包个数较多,则可进一步判断第二缓存区中未处理的数据包的个数是否超过阀值M。如果第二缓存区中未处理的数据包的个数不大于阀值M,说明第二缓存区比较空闲,则可改变调节因子的值,使数据被分发至第二缓存区,如果第二缓存区中未处理的数据包的个数大于阀值M,说明第二缓存区中的数据包的个数也较多。则可进一步计算两个第一缓存区中未处理的数据包数量与第二缓存区中未处理的数据包数量之间的差值。若二者未处理数据包之差大于阀值N(为上述第二阈值的一个示例)。则改变调节因子的值,从而使得本次待分发的数据被分发至待处理数量较少的二级缓存区。In an implementable manner, determining the value of the adjustment factor according to the data amount of the data to be processed in the first cache area and the second cache area may include: determining the first cache area and the second cache area respectively Whether the number of data packets to be processed is greater than a first threshold; the number of data packets to be processed in the first cache area is greater than the first threshold, and the number of data packets to be processed in the second cache area When the number is not greater than the first threshold, and the difference between the data packets to be sent in the first buffer area and the second buffer area is greater than the second threshold value, the value of the adjustment factor is adjusted so that The amount of data distributed by the primary cache area to the second cache area is greater than the amount of data distributed to the first cache area. The following is an example of the processing flow for determining the value of the adjustment factor according to the data amount of the data to be processed in the first cache area and the second cache area. In this example, it is determined that the first distribution key is selected to be distributed to the first cache Whether the number of unprocessed data packets in the zone reaches the set threshold M (an example of the first threshold). The threshold M may be determined according to the size of the first-level cache area and the size of the data flow received by the first cache area, for example, the threshold may be positively related to the size of the first-level cache area, and the size of the threshold may be related to the received data The size of the traffic is negatively correlated. If the number of unprocessed data packets in the first cache area is not greater than the threshold value M, it means that the first cache area is relatively free, and the first cache area can process data normally, then when the data is subsequently distributed, you can choose to send the data packets To the cache. If the number of unprocessed data packets in the first cache area is greater than the threshold value M, indicating that there are more data packets in the cache, you can further determine whether the number of unprocessed data packets in the second cache area exceeds the threshold Value M. If the number of unprocessed data packets in the second cache area is not greater than the threshold M, indicating that the second cache area is relatively free, you can change the value of the adjustment factor so that the data is distributed to the second cache area, if the second cache The number of unprocessed data packets in the area is greater than the threshold value M, indicating that the number of data packets in the second buffer area is also large. Then, the difference between the number of unprocessed data packets in the two first buffers and the number of unprocessed data packets in the second buffer can be further calculated. If the difference between the two unprocessed data packets is greater than the threshold N (which is an example of the above second threshold). Then, the value of the adjustment factor is changed, so that the data to be distributed this time is distributed to the second-level cache area with a small amount to be processed.
在一种可实现方式中,根据所述第二分发KEY将所述一级缓存区中待分发的数据分发至各二级缓存区可包括:根据所述一级缓存区中待分发数据对应的基站ID、协议类型字段以及所述调节因子生成所述第二分发KEY;判断上一次为与所述一级缓存区对应的一对二级缓存区分发数据时,所述调节因子的值是否发生更改,该一对二级缓存区包括第一缓存区以及第二缓存区;在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区;在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区以及所述第二缓存区;在所述调节因子的值未发生更改,且根据所述第一缓存区以及所述第二缓存区中待处理的数据量确定需调整所述调节因子的值时,根据所述第一缓存区以及所述第二缓存区中待处理的数据量确定目标调节因子;使用所述目标调节因子对所述第二分发KEY进行调节,得到目标分发KEY;根据所述目标分发KEY将所述一级缓存区的待分发数据分发至所述第一缓存区或所述第二缓存区。在根据第一缓存区以及第二缓存区中待处理的数据量确定无需调整调节因子的值时,则无需对第二分发KEY进行调节,可直接使用所述第二分发KEY对待分发数据进行分发。In an implementable manner, distributing the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY may include: according to the data corresponding to the data to be distributed in the primary cache area The base station ID, the protocol type field, and the adjustment factor generate the second distribution KEY; determine whether the value of the adjustment factor occurred last time when data was distributed for a pair of second-level cache areas corresponding to the first-level cache area Change, the pair of secondary cache areas include a first cache area and a second cache area; when the value of the adjustment factor changes, the data to be distributed in the primary cache area is distributed according to the second distribution KEY Distribute to the first cache area or the second cache area; when the value of the adjustment factor changes, distribute the data to be distributed in the primary cache area to the first cache area according to the second distribution KEY The first cache area and the second cache area; the value of the adjustment factor has not changed, and the adjustment needs to be adjusted according to the amount of data to be processed in the first cache area and the second cache area When the value of the factor is determined, a target adjustment factor is determined according to the amount of data to be processed in the first cache area and the second cache area; the target adjustment factor is used to adjust the second distribution KEY to obtain the target distribution KEY Distribute the data to be distributed in the first-level cache area to the first cache area or the second cache area according to the target distribution KEY. When it is determined that the value of the adjustment factor does not need to be adjusted according to the amount of data to be processed in the first cache area and the second cache area, there is no need to adjust the second distribution KEY, and the second distribution KEY can be directly used to distribute the data to be distributed .
以下结合图4通过一个例子对根据第二分发KEY将一级缓存区中待分发的数据分发至各二级缓存区的处理过程进行描述。如图4所示,从一级缓存区S读取一个数据包,根据数据包头部信息确定基站ID以及协议类型标识符,根据基站ID、协议类型标识符以及调节因子,生成第二分发KEY,根据第二分发KEY,选择与一级缓存区S对应的二级缓存区A或二级缓存区B,作为发送数据包的目标缓存区。判断调节因子的值是否修改过,如果调节因子修改过,则说明在之前为缓存区A或缓存区B分发数据时,已经基于缓存区A或缓存区B中待处理的数据量对调节因子的值进行调节过,故无需再对该调节因子进行调节,如果调节因子没有修改过,则根据缓存区A以及缓存区B中待处理的数 据量判断是否需要调整调节因子的值,鉴于上文已经对根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值进行了详细的说明,故此处不再赘述。在图4所示的数据分发流程中,考虑到后端模块的处理能力不同,根据后端模块中数据的积压情况对第二分发KEY的值进行自动调整,实现了动态反馈调节,形成正向的反馈环,从而可保证分发数据的均衡性,同时也保证了业务数据的分发免租业务规则的需要,以及可充分利用后端模块的性能。The process of distributing the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY will be described below through an example in conjunction with FIG. 4. As shown in FIG. 4, a data packet is read from the primary buffer area S, the base station ID and the protocol type identifier are determined according to the packet header information, and the second distribution KEY is generated based on the base station ID, the protocol type identifier and the adjustment factor, According to the second distribution KEY, the secondary cache area A or the secondary cache area B corresponding to the primary cache area S is selected as the target cache area for sending data packets. Determine whether the value of the adjustment factor has been modified. If the adjustment factor has been modified, it means that when the data was previously distributed for the buffer area A or the buffer area B, the adjustment factor has been based on the amount of data to be processed in the buffer area A or the buffer area B. The value has been adjusted, so there is no need to adjust the adjustment factor. If the adjustment factor has not been modified, it is determined whether the adjustment factor value needs to be adjusted according to the amount of data to be processed in the buffer area A and the buffer area B. The determination of the value of the adjustment factor according to the data amount of the data to be processed in the first buffer area and the second buffer area is described in detail, so it will not be repeated here. In the data distribution process shown in FIG. 4, considering the different processing capabilities of the back-end module, the value of the second distribution KEY is automatically adjusted according to the backlog of data in the back-end module to realize dynamic feedback adjustment and form a positive direction Feedback loop, which can ensure the balance of the distribution data, and also guarantee the need for business data distribution and rent-free business rules, and can fully utilize the performance of the back-end module.
相关实验数据表明,在系统采用相同的后端模块的情况下,通过本公开实施例的数据分发方法对数据进行分发,可使后端的处理模块的性能提升大概五倍。且可在一定程度上提升接收数据的性能。Relevant experimental data shows that, when the system uses the same back-end module, the data distribution method of the embodiment of the present disclosure can distribute the data, which can improve the performance of the back-end processing module by about five times. And can improve the performance of receiving data to a certain extent.
图5是根据一示例性实施例示出的一种数据分发装置的框图,如图5所示,该装置50包括如下组成部分:Fig. 5 is a block diagram of a data distribution device according to an exemplary embodiment. As shown in Fig. 5, the device 50 includes the following components:
接收模块51,用于接收流量汇聚适配器SCA发送的数据;The receiving module 51 is used to receive the data sent by the traffic aggregation adapter SCA;
第一确定模块52,用于根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;The first determining module 52 is configured to determine a first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data;
第一分发模块53,用于根据所述第一分发KEY将数据分发至各一级缓存区;The first distribution module 53 is configured to distribute data to each level one cache area according to the first distribution KEY;
第二确定模块54,用于根据一级缓存区中待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;The second determination module 54 is configured to determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data amount of the data to be processed in each secondary cache area;
第二分发模块55,用于根据所述第二分发KEY将所述一级缓存区中待分发数据分发至各二级缓存区。The second distribution module 55 is configured to distribute the data to be distributed in the first-level cache area to each second-level cache area according to the second distribution KEY.
在一种可实现方式中,所述第二确定模块可包括:第一确定单元,用于根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值,其中,所述第一缓存区以及所述第二缓存区为预先配置的与一个一级缓存区对应的一对二级缓存区;计算单元,用于根据一级缓存区中待分发数据对应的基站ID、协议类型信息计算得到待调节的第二分发KEY;第一调节单元,用于使用所述调节因子对所述待调节的第二分发KEY进行调节,得到所述第二分发KEY。In a possible implementation manner, the second determining module may include: a first determining unit, configured to determine the value of the adjustment factor according to the data amount of the data to be processed in the first buffer area and the second buffer area, wherein, The first cache area and the second cache area are a pair of pre-configured second-level cache areas corresponding to a first-level cache area; a calculation unit is used to determine the base station ID corresponding to the data to be distributed in the first-level cache area 3. The protocol type information is calculated to obtain a second distribution KEY to be adjusted; a first adjustment unit is used to adjust the second distribution KEY to be adjusted using the adjustment factor to obtain the second distribution KEY.
在一种可实现方式中,所述第一确定单元用于:分别确定所述第一缓存区以及所述第二缓存区中待处理的数据包的个数是否大于第一阈值;在所述第一缓存区中待处理的数据包的个数大于所述第一阈值,所述第二缓存区中待处理的数据包的个数不大于所述第一阈值,且所述第一缓存区以及所述第二缓存区中待发的送数据包之差大于第二阈值时,调整所述调节因子的值,以使所述一级缓存区将待分发数据分发至所述第二缓存区。In a possible implementation manner, the first determining unit is configured to separately determine whether the number of data packets to be processed in the first cache area and the second cache area is greater than a first threshold; The number of data packets to be processed in the first buffer is greater than the first threshold, the number of data packets to be processed in the second buffer is not greater than the first threshold, and the first buffer And when the difference between the data packets to be sent in the second buffer area is greater than the second threshold, the value of the adjustment factor is adjusted so that the first-level buffer area distributes the data to be distributed to the second buffer area .
在一种可实现方式中,所述第二分发模块,包括:第二确定单元,用于根据所述一级缓存区中待分发数据对应的基站ID、协议类型字段以及所述调节因子确定所述第二分发KEY;判断单元,用于判断上一次为与所述一级缓存区对应的一对二级缓存区分发数据时,所述调节因子的值是否发生更改,该一对二级缓存区包括第一缓存区以及第二缓存区;第一分发单元,用于在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区;第三确定单元,用于在所述调节因子的值未发生更改,且根据所述第一缓存区以及所述第二缓存区中待处理的数据量确定需调整所述调节因子的值时,根据所述第一缓存区以及所述第二缓存区中待处理的数据量确定目标调节因子;第二调节单元,用于使用所述目标调节因子对所述第二分发KEY进行调节,得到目标分发KEY;第二分发单元,用于根据所述目标分发KEY将所述一级缓存区的待分发数据分发至所述第一缓存区或所述第二缓存区。In a possible implementation manner, the second distribution module includes: a second determination unit, configured to determine the location based on the base station ID, the protocol type field, and the adjustment factor corresponding to the data to be distributed in the first-level cache area The second distribution KEY; a judgment unit for judging whether the value of the adjustment factor has changed when the data was distributed for a pair of secondary cache areas corresponding to the primary cache area last time. The area includes a first cache area and a second cache area; a first distribution unit is used to distribute the data to be distributed in the first-level cache area according to the second distribution KEY when the value of the adjustment factor changes To the first cache area or the second cache area; a third determination unit, which is used when the value of the adjustment factor has not changed, and according to the first cache area and the second cache area When the amount of processed data determines that the value of the adjustment factor needs to be adjusted, a target adjustment factor is determined according to the amount of data to be processed in the first buffer area and the second buffer area; a second adjustment unit is used to use the A target adjustment factor adjusts the second distribution KEY to obtain a target distribution KEY; a second distribution unit is used to distribute the data to be distributed in the first-level cache area to the first cache area according to the target distribution KEY Or the second cache area.
图6是根据一示例性实施例示出的一种确定数据分发的装置600的框图。例如,装置600可以被提供为一服务器。参照图6,装置600包括处理器622,其数量可以为一个或多个,以及存储器632,用于存储可由处理器622执行的计算机程序。存储器632中存储的计算机程序可以包括一个或一个以上的每一个对应于一组指令的模块。此外,处理器622可以被配置为执行该计算机程序,以执行上述的确定数据分发的方法。Fig. 6 is a block diagram of a device 600 for determining data distribution according to an exemplary embodiment. For example, the device 600 may be provided as a server. 6, the device 600 includes a processor 622, the number of which may be one or more, and a memory 632, which is used to store a computer program executable by the processor 622. The computer program stored in the memory 632 may include one or more modules each corresponding to a set of instructions. In addition, the processor 622 may be configured to execute the computer program to perform the above-described method of determining data distribution.
另外,装置600还可以包括电源组件626和通信组件650,该电源组件626可以被配置为执行装置600的电源管理,该通信组件650可以被配置为实现装置600的通信,例如,有线或无线通信。此外,该装置600还可以包括输入/输出(I/O)接口658。装置600可以操作基于存储在存储器632的操作系统,例如Windows ServerTM,Mac OS XTM,UnixTM,LinuxTM等等。In addition, the device 600 may further include a power component 626 and a communication component 650, which may be configured to perform power management of the device 600, and the communication component 650 may be configured to implement communication of the device 600, for example, wired or wireless communication . In addition, the device 600 may also include an input/output (I/O) interface 658. The device 600 can operate an operating system based on the memory 632, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, and so on.
在另一示例性实施例中,还提供了一种包括程序指令的非临时性计算机可读存储介质,例如包括程序指令的存储器632,上述程序指令可由装置600的处理器622执行以完成上述的确定数据分发的方法。In another exemplary embodiment, a non-transitory computer-readable storage medium including program instructions, for example, a memory 632 including program instructions, the program instructions may be executed by the processor 622 of the device 600 to complete the above Determine the method of data distribution.
本公开实施例的数据分发方法,在根据待分发数据对应的基站ID以及协议类型信息得到第一分发KEY将数据分发至一级缓存区之后,再根据一级缓存区中待分发的数据对应的基站ID、协议类型信息以及二级缓存区中待处理的数据量确定出第二分发KEY,根据该第二分发KEY将一级缓存区中待分发的数据分发至二级缓存区,从而实现了根据后端处理模块的数据积压情况动态调节分发至各后端处理模块的数据量的目的,能够更好的进行负载均衡。In the data distribution method of the embodiment of the present disclosure, after obtaining the first distribution KEY according to the base station ID corresponding to the data to be distributed and the protocol type information and distributing the data to the first-level cache area, then according to the data corresponding to the data to be distributed in the first-level cache area The base station ID, protocol type information and the amount of data to be processed in the secondary cache area determine the second distribution KEY, and according to the second distribution KEY, the data to be distributed in the primary cache area is distributed to the secondary cache area, thereby realizing The purpose of dynamically adjusting the amount of data distributed to each back-end processing module according to the data backlog of the back-end processing module can better load balance.
尽管为示例目的,已经公开了本公开的优选实施例,本领域的技术人员将意识到各种改进、增加和取代也是可能的,因此,本公开的范围应当不限于上述实施例。Although the preferred embodiments of the present disclosure have been disclosed for illustrative purposes, those skilled in the art will realize that various improvements, additions, and substitutions are also possible, and therefore, the scope of the present disclosure should not be limited to the above-described embodiments.

Claims (10)

  1. 一种数据分发方法,其中,包括:A data distribution method, including:
    接收流量汇聚适配器SCA发送的数据;Receive the data sent by the traffic aggregation adapter SCA;
    根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;Determine the first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data;
    根据所述第一分发KEY将所述数据分发至各一级缓存区;Distribute the data to each primary cache area according to the first distribution KEY;
    根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;Determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data amount of the data to be processed in each secondary cache area;
    根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。Distribute the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY.
  2. 根据权利要求1所述的方法,其中,根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY,包括:The method according to claim 1, wherein the second distribution KEY is determined according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data amount of the data to be processed in each secondary cache area ,include:
    根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值,其中,所述第一缓存区以及所述第二缓存区为预先配置的与一个所述一级缓存区对应的一对二级缓存区;The value of the adjustment factor is determined according to the data amount of the data to be processed in the first cache area and the second cache area, wherein the first cache area and the second cache area are pre-configured and one of the first-level cache A pair of secondary cache areas corresponding to the area;
    根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息确定待调节的第二分发KEY;Determine the second distribution KEY to be adjusted according to the base station ID and protocol type information corresponding to the data to be distributed in the primary buffer area;
    使用所述调节因子对所述待调节的第二分发KEY的值进行调整,得到所述第二分发KEY。The adjustment factor is used to adjust the value of the second distribution KEY to be adjusted to obtain the second distribution KEY.
  3. 根据权利要求2所述的方法,其中,根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值,包括:The method according to claim 2, wherein determining the value of the adjustment factor according to the data amount of the data to be processed in the first buffer area and the second buffer area includes:
    分别确定所述第一缓存区以及所述第二缓存区中待处理的数据包的个数是否大于第一阈值;Separately determine whether the number of data packets to be processed in the first buffer area and the second buffer area is greater than a first threshold;
    在所述第一缓存区中待处理的数据包的个数大于所述第一阈值,所述第二缓存区中待处理的数据包的个数不大于所述第一阈值,且所述第一缓存区以及所述第二缓存区中待发的送数据包之差大于第二阈值时,调整所述调节因子的值,以使所述一级缓存区将待分发数据分发至所述第二缓存区。The number of data packets to be processed in the first cache area is greater than the first threshold, the number of data packets to be processed in the second cache area is not greater than the first threshold, and the first When the difference between a buffer area and the data packets to be sent in the second buffer area is greater than a second threshold, the value of the adjustment factor is adjusted so that the primary buffer area distributes the data to be distributed to the first Second cache area.
  4. 根据权利要求1至3任一项所述的方法,其中,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区,包括:The method according to any one of claims 1 to 3, wherein distributing the data to be distributed in the first-level cache area to each of the second-level cache areas according to the second distribution KEY includes:
    根据所述一级缓存区中的待分发数据对应的基站ID、协议类型字段以及所述调节因 子确定所述第二分发KEY;Determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the first-level buffer area, the protocol type field, and the adjustment factor;
    判断上一次为与所述一级缓存区对应的一对二级缓存区分发数据时,所述调节因子的值是否发生更改,该一对二级缓存区包括第一缓存区以及第二缓存区;Judging whether the value of the adjustment factor was changed when the data was last distributed to a pair of secondary cache areas corresponding to the primary cache area, the pair of secondary cache areas includes a first cache area and a second cache area ;
    在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区;When the value of the adjustment factor changes, distribute the data to be distributed in the primary cache area to the first cache area or the second cache area according to the second distribution KEY;
    在所述调节因子的值未发生更改,且根据所述第一缓存区以及所述第二缓存区中待处理的数据的数据量确定需调整所述调节因子的值时,根据所述第一缓存区以及所述第二缓存区中待处理的数据的数据量确定目标调节因子;When the value of the adjustment factor has not been changed, and the value of the adjustment factor needs to be adjusted according to the data amount of the data to be processed in the first buffer area and the second buffer area, according to the first The data amount of the buffer area and the data to be processed in the second buffer area determines the target adjustment factor;
    使用所述目标调节因子对所述第二分发KEY进行调节,得到目标分发KEY;Adjust the second distribution KEY using the target adjustment factor to obtain the target distribution KEY;
    根据所述目标分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区。Distribute the data to be distributed in the primary cache area to the first cache area or the second cache area according to the target distribution KEY.
  5. 一种数据分发装置,其中,包括:A data distribution device, including:
    接收模块,用于接收流量汇聚适配器SCA发送的数据;The receiving module is used to receive the data sent by the traffic aggregation adapter SCA;
    第一确定模块,用于根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;A first determining module, configured to determine a first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data;
    第一分发模块,用于根据所述第一分发KEY将所述数据分发至各一级缓存区;A first distribution module, configured to distribute the data to each primary cache area according to the first distribution KEY;
    第二确定模块,用于根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;A second determination module, configured to determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the first-level cache area, protocol type information, and the data amount of the data to be processed in each second-level cache area;
    第二分发模块,用于根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。The second distribution module is configured to distribute the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY.
  6. 根据权利要求5所述的装置,其中,所述第二确定模块,包括:The apparatus according to claim 5, wherein the second determining module includes:
    第一确定单元,用于根据第一缓存区以及第二缓存区中待处理的数据的数据量确定调节因子的值,其中,所述第一缓存区以及所述第二缓存区为预先配置的与一个所述一级缓存区对应的一对二级缓存区;The first determining unit is configured to determine the value of the adjustment factor according to the data amount of the data to be processed in the first cache area and the second cache area, wherein the first cache area and the second cache area are pre-configured A pair of secondary cache areas corresponding to one of the primary cache areas;
    计算单元,用于根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息确定得到待调节的第二分发KEY;The calculation unit is configured to determine the second distribution KEY to be adjusted according to the base station ID and the protocol type information corresponding to the data to be distributed in the first-level cache area;
    第一调节单元,用于使用所述调节因子对所述待调节的第二分发KEY的值进行调整,得到所述第二分发KEY。The first adjustment unit is used to adjust the value of the second distribution KEY to be adjusted using the adjustment factor to obtain the second distribution KEY.
  7. 根据权利要求6所述的装置,其中,所述第一确定单元用于:The apparatus according to claim 6, wherein the first determining unit is used to:
    分别确定所述第一缓存区以及所述第二缓存区中待处理的数据包的个数是否大于第 一阈值;Separately determine whether the number of data packets to be processed in the first buffer area and the second buffer area is greater than a first threshold;
    在所述第一缓存区中待处理的数据包的个数大于所述第一阈值,所述第二缓存区中待处理的数据包的个数不大于所述第一阈值,且所述第一缓存区以及所述第二缓存区中待发的送数据包之差大于第二阈值时,调整所述调节因子的值,以使所述一级缓存区将待分发数据分发至所述第二缓存区。The number of data packets to be processed in the first cache area is greater than the first threshold, the number of data packets to be processed in the second cache area is not greater than the first threshold, and the first When the difference between a buffer area and the data packet to be sent in the second buffer area is greater than a second threshold, the value of the adjustment factor is adjusted so that the primary buffer area distributes the data to be distributed to the first Second cache area.
  8. 根据权利要求5至7任一项所述的装置,其中,所述第二分发模块,包括:The apparatus according to any one of claims 5 to 7, wherein the second distribution module includes:
    第二确定单元,用于根据所述一级缓存区中的待分发数据对应的基站ID、协议类型字段以及所述调节因子确定所述第二分发KEY;A second determining unit, configured to determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary buffer area, the protocol type field, and the adjustment factor;
    判断单元,用于判断上一次为与所述一级缓存区对应的一对二级缓存区分发数据时,所述调节因子的值是否发生更改,该一对二级缓存区包括第一缓存区以及第二缓存区;The judging unit is used for judging whether the value of the adjustment factor has changed when the data was distributed for the pair of secondary cache areas corresponding to the primary cache area last time, the pair of secondary cache areas includes the first cache area And the second cache area;
    第一分发单元,用于在所述调节因子的值发生更改时,根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区;The first distribution unit is configured to distribute the data to be distributed in the first-level cache area to the first cache area or the second according to the second distribution KEY when the value of the adjustment factor changes Cache area
    第三确定单元,用于在所述调节因子的值未发生更改,且根据所述第一缓存区以及所述第二缓存区中待处理的数据的数据量确定需调整所述调节因子的值时,根据所述第一缓存区以及所述第二缓存区中待处理的数据的数据量确定目标调节因子;The third determining unit is configured to determine that the value of the adjustment factor needs to be adjusted according to the amount of data to be processed in the first buffer area and the second buffer area when the value of the adjustment factor has not changed When determining the target adjustment factor according to the data volume of the data to be processed in the first buffer area and the second buffer area;
    第二调节单元,用于使用所述目标调节因子对所述第二分发KEY进行调节,得到目标分发KEY;A second adjustment unit, configured to adjust the second distribution KEY using the target adjustment factor to obtain a target distribution KEY;
    第二分发单元,用于根据所述目标分发KEY将所述一级缓存区中的待分发数据分发至所述第一缓存区或所述第二缓存区。The second distribution unit is configured to distribute the data to be distributed in the first-level cache area to the first cache area or the second cache area according to the target distribution KEY.
  9. 一种数据分发装置,其中,包括:A data distribution device, including:
    处理器;processor;
    用于存储处理器可执行指令的存储器;Memory for storing processor executable instructions;
    当所述指令被处理器执行时,执行如下操作:When the instruction is executed by the processor, the following operations are performed:
    接收流量汇聚适配器SCA发送的数据;Receive the data sent by the traffic aggregation adapter SCA;
    根据所述数据对应的基站标识ID以及协议类型信息确定第一分发关键值KEY;Determine the first distribution key value KEY according to the base station identification ID and protocol type information corresponding to the data;
    根据所述第一分发KEY将所述数据分发至各一级缓存区;Distribute the data to each primary cache area according to the first distribution KEY;
    根据所述一级缓存区中的待分发数据对应的基站ID、协议类型信息以及各二级缓存区中待处理的数据的数据量确定第二分发KEY;Determine the second distribution KEY according to the base station ID corresponding to the data to be distributed in the primary cache area, protocol type information, and the data volume of the data to be processed in each secondary cache area;
    根据所述第二分发KEY将所述一级缓存区中的待分发数据分发至各所述二级缓存区。Distribute the data to be distributed in the primary cache area to each secondary cache area according to the second distribution KEY.
  10. 一种存储介质,当所述存储介质中的指令由处理器执行时,能够实现根据权利要 求1至4中任一项所述的方法的步骤。A storage medium capable of implementing the steps of the method according to any one of claims 1 to 4 when instructions in the storage medium are executed by a processor.
PCT/CN2019/111799 2018-12-26 2019-10-18 Data distribution method and apparatus, and storage medium WO2020134392A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811606877.XA CN111372277B (en) 2018-12-26 2018-12-26 Data distribution method, device and storage medium
CN201811606877.X 2018-12-26

Publications (1)

Publication Number Publication Date
WO2020134392A1 true WO2020134392A1 (en) 2020-07-02

Family

ID=71126834

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/111799 WO2020134392A1 (en) 2018-12-26 2019-10-18 Data distribution method and apparatus, and storage medium

Country Status (2)

Country Link
CN (1) CN111372277B (en)
WO (1) WO2020134392A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115134767B (en) * 2021-03-11 2024-02-09 上海大唐移动通信设备有限公司 Method, device and storage medium for improving performance of signaling soft acquisition equipment
CN114363198B (en) * 2022-01-14 2023-07-21 深圳市优网科技有限公司 Data acquisition method and device, storage medium and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101420462A (en) * 2008-12-11 2009-04-29 中国移动通信集团北京有限公司 Method and system for distributing data
CN105095109A (en) * 2014-05-21 2015-11-25 华为技术有限公司 Cache access method, cache access router and computer system
CN105681864A (en) * 2015-12-31 2016-06-15 惠州市伟乐科技股份有限公司 IP-based transmission flow jitter removing method and device
CN107193909A (en) * 2017-05-08 2017-09-22 杭州东方通信软件技术有限公司 Data processing method and system
CN107526816A (en) * 2017-08-28 2017-12-29 阿里巴巴集团控股有限公司 A kind of store method, device and the electronic equipment of streaming distributed recorder

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101277477B (en) * 2008-04-29 2012-04-04 华为技术有限公司 Method, apparatus and system for equalizing flux
CN101605123A (en) * 2008-06-11 2009-12-16 中兴通讯股份有限公司 A kind of SCSI distributed communication model
CN103347075B (en) * 2013-07-02 2016-06-08 北京金和软件股份有限公司 A kind of data multilevel method for caching and processing
CN103365691B (en) * 2013-07-12 2016-07-06 中国人民解放军总参谋部第六十三研究所 SCA component charger and loading method based on distributed storage
CN104427534B (en) * 2013-09-06 2018-06-12 中国移动通信集团公司 The soft detection method adopted of long term evolution and removable motion detection device
WO2015156758A1 (en) * 2014-04-07 2015-10-15 Hitachi, Ltd. Method and apparatus of cache promotion between server and storage system
CN104539475B (en) * 2014-12-09 2018-02-23 上海大唐移动通信设备有限公司 A kind of method and device of determination SCA gathered data correctness
CN105183394B (en) * 2015-09-21 2018-09-04 北京奇虎科技有限公司 A kind of data storage handling method and device
CN105512216A (en) * 2015-11-30 2016-04-20 青岛海尔智能家电科技有限公司 Data storage and reading method, device and system
CN106598882B (en) * 2016-12-09 2019-09-20 武汉斗鱼网络科技有限公司 A kind of safe internal storage data guard method and device
CN107622115B (en) * 2017-09-19 2019-11-26 武大吉奥信息技术有限公司 A kind of space querying result cache method towards WFS service
CN108256088A (en) * 2018-01-23 2018-07-06 清华大学 A kind of storage method and system of the time series data based on key value database

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101420462A (en) * 2008-12-11 2009-04-29 中国移动通信集团北京有限公司 Method and system for distributing data
CN105095109A (en) * 2014-05-21 2015-11-25 华为技术有限公司 Cache access method, cache access router and computer system
CN105681864A (en) * 2015-12-31 2016-06-15 惠州市伟乐科技股份有限公司 IP-based transmission flow jitter removing method and device
CN107193909A (en) * 2017-05-08 2017-09-22 杭州东方通信软件技术有限公司 Data processing method and system
CN107526816A (en) * 2017-08-28 2017-12-29 阿里巴巴集团控股有限公司 A kind of store method, device and the electronic equipment of streaming distributed recorder

Also Published As

Publication number Publication date
CN111372277B (en) 2023-07-14
CN111372277A (en) 2020-07-03

Similar Documents

Publication Publication Date Title
US10511535B2 (en) Data transmission control node, communications system, and data transmission management method
US10841815B2 (en) Link control node and method, and communications system
WO2017070970A1 (en) Route determining method and corresponding apparatus and system
EP3611962B1 (en) Quality of service control method and device
US20190349828A1 (en) Core network device, access network device, and data offloading method and system
US11172399B2 (en) Default quality of service (QoS) control method and device
US20200322835A1 (en) Data processing method and apparatus
US20230413103A1 (en) Quality of service implementations for separating user plane
EP3138319B1 (en) Insertion and use of application or radio information in network data packet headers
US20200359255A1 (en) Quality of service (qos) control method and related device
WO2020134392A1 (en) Data distribution method and apparatus, and storage medium
EP4152808A1 (en) Quality of service control method, device, and system
US11700189B2 (en) Method for performing task processing on common service entity, common service entity, apparatus and medium for task processing
CN112188553B (en) Data transmission method and device of 5G system
US10582410B2 (en) Predicting downlink throughput
CN109475007B (en) Data distribution method, user terminal, and computer-readable storage medium
WO2020088543A1 (en) Network access method and apparatus
JP2011045046A (en) Switching method and device
WO2018018641A1 (en) Data transmission method and apparatus for data service
JP6298013B2 (en) Policy control system and policy control method
WO2017166031A1 (en) Method and device for distinguishing access network and computer readable storage medium
US11496397B2 (en) Transparent quantitative congestion control
US20180249457A1 (en) Information exchange method and system, and device
CN117580110A (en) Data packet processing method, system, user plane function and application function network element
JP2014241552A (en) Compression instruction device, distribution system, compression instruction method, and compression instruction program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19904290

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16/11/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19904290

Country of ref document: EP

Kind code of ref document: A1