CN113535432B - Data distribution method and device, electronic equipment and storage medium - Google Patents
Data distribution method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113535432B CN113535432B CN202110818642.2A CN202110818642A CN113535432B CN 113535432 B CN113535432 B CN 113535432B CN 202110818642 A CN202110818642 A CN 202110818642A CN 113535432 B CN113535432 B CN 113535432B
- Authority
- CN
- China
- Prior art keywords
- target service
- target
- server
- service metadata
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000011664 signaling Effects 0.000 claims abstract description 109
- 238000013507 mapping Methods 0.000 claims abstract description 73
- 238000012545 processing Methods 0.000 claims abstract description 53
- 238000013467 fragmentation Methods 0.000 claims abstract description 15
- 238000006062 fragmentation reaction Methods 0.000 claims abstract description 15
- 230000000903 blocking effect Effects 0.000 claims description 9
- 230000007246 mechanism Effects 0.000 claims description 8
- 230000011218 segmentation Effects 0.000 claims description 8
- 230000001360 synchronised effect Effects 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000012550 audit Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a data distribution method, a data distribution device, electronic equipment and a storage medium, and relates to the technical field of data processing. The method can be applied to a signaling forwarding server, wherein a virtual server and a plurality of virtual clients are preconfigured in the signaling forwarding server, and the method comprises the following steps: receiving signaling data to be shunted through a virtual server, and performing fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata; determining each target virtual client corresponding to each target service metadata from a plurality of virtual clients according to a first preset mapping relation; according to the second preset mapping relation, each target service metadata is forwarded to each corresponding target service server through each target virtual client.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data splitting method, a data splitting device, an electronic device, and a storage medium.
Background
With the gradual popularization of big data applications, more and more applications of big data analysis, content security audit and service application visualization are popularized, and therefore, it is more and more important to correctly and on-demand transfer service data to a required analysis system.
In the prior art, the data broadcasting and data forwarding of the whole network are generally realized based on a Java traditional input/output interface.
It can be seen that the existing data distribution method is relatively simple, and the processing performance of distribution equipment is difficult to ensure.
Disclosure of Invention
The application aims to overcome the defects in the prior art and provide a data distribution method, a device, electronic equipment and a storage medium, which can ensure the processing performance of a signaling forwarding server.
In order to achieve the above purpose, the technical scheme adopted by the embodiment of the application is as follows:
in a first aspect, the present application provides a data offloading method, applied to a signaling forwarding server, where a virtual server and a plurality of virtual clients are preconfigured in the signaling forwarding server, the method includes:
receiving signaling data to be shunted through the virtual server, and performing fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata, wherein the target service metadata identify the service type;
Determining each target virtual client corresponding to each target service metadata from a plurality of virtual clients according to a first preset mapping relation, wherein the first preset mapping relation comprises: the service metadata belongs to the service type and the mapping relation between the virtual clients;
forwarding, by each target virtual client, each target service metadata to each corresponding target service server according to a second preset mapping relationship, where the second preset mapping relationship includes: mapping relationship between each virtual client and each service server.
In an optional implementation manner, forwarding, by each target virtual client, each target service metadata to each corresponding target service server includes:
determining the sending priority of each target service metadata according to the service type of each target service metadata;
and forwarding each target service metadata to each corresponding target service server through each target virtual client according to the sending priority of each target service metadata.
In an alternative embodiment, the method further comprises:
receiving a registration message sent by a service server to be registered, wherein the registration message comprises: an identification of a service server to be registered and an identification of a corresponding virtual client;
And updating the second preset mapping relation according to the registration message.
In an optional embodiment, the determining, according to a first preset mapping relationship, a target virtual client from a plurality of virtual clients includes:
according to the service type of each target service metadata, performing service dimension processing on each target service metadata based on an asynchronous message processing mechanism to obtain each processed target service metadata;
and determining each target virtual client corresponding to each processed target service metadata from a plurality of virtual clients according to the first preset mapping relation.
In an optional embodiment, the slicing processing is performed on the signaling data to be shunted to obtain a plurality of target service metadata after slicing, including:
decoding the signaling data to be shunted to obtain decoded signaling data to be shunted;
according to the decoded signaling data to be shunted, carrying out fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata;
forwarding, by each target virtual client, each target service metadata to each corresponding target service server according to a second preset mapping relationship, including:
Encoding the target service metadata through the target virtual clients to obtain encoded target service metadata;
and carrying out encryption processing on the coded target service metadata, and forwarding the encrypted target service metadata to corresponding target service servers through the target virtual clients.
In an alternative embodiment, the method further comprises:
recording the data packet size of each target service metadata through each target virtual client;
receiving feedback information sent by each target service server, wherein the feedback information comprises the size of a data packet of each received target service metadata;
generating a retransmission instruction according to the recorded data packet size of each target service metadata and the feedback message;
and retransmitting the target service metadata to the corresponding target service servers through the target virtual clients according to the retransmission instructions.
In an optional embodiment, the receiving, by the virtual server, signaling data to be shunted further includes:
and receiving signaling data to be shunted through the virtual server based on the synchronous non-blocking input-output model.
In a second aspect, the present invention provides a data splitting apparatus applied to a signaling forwarding server, where a virtual server and a plurality of virtual clients are preconfigured in the signaling forwarding server, the data splitting apparatus includes:
the system comprises a segmentation module, a segmentation module and a virtual server, wherein the segmentation module is used for receiving signaling data to be segmented through the virtual server, and performing segmentation processing on the signaling data to be segmented to obtain a plurality of segmented target service metadata, wherein the target service metadata identify the service type;
the determining module is configured to determine, from a plurality of virtual clients, each target virtual client corresponding to each target service metadata according to a first preset mapping relationship, where the first preset mapping relationship includes: the service metadata belongs to the service type and the mapping relation between the virtual clients;
the forwarding module is configured to forward, according to a second preset mapping relationship, each target service metadata to each corresponding target service server through each target virtual client, where the second preset mapping relationship includes: mapping relationship between each virtual client and each service server.
In an optional implementation manner, the forwarding module is specifically configured to determine, according to a service type of each target service metadata, a sending priority of each target service metadata;
And forwarding each target service metadata to each corresponding target service server through each target virtual client according to the sending priority of each target service metadata.
In an optional implementation manner, the forwarding module is further configured to receive a registration message sent by a service server to be registered, where the registration message includes: an identification of a service server to be registered and an identification of a corresponding virtual client;
and updating the second preset mapping relation according to the registration message.
In an optional implementation manner, the determining module is specifically configured to perform service dimension processing on each target service metadata based on an asynchronous message processing mechanism according to a service type to which each target service metadata belongs, so as to obtain each processed target service metadata;
and determining each target virtual client corresponding to each processed target service metadata from a plurality of virtual clients according to the first preset mapping relation.
In an optional implementation manner, the slicing module is specifically configured to decode the signaling data to be shunted to obtain decoded signaling data to be shunted;
according to the decoded signaling data to be shunted, carrying out fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata;
The forwarding module is specifically configured to perform encoding processing on each target service metadata through each target virtual client, and obtain each encoded target service metadata;
and carrying out encryption processing on the coded target service metadata, and forwarding the encrypted target service metadata to corresponding target service servers through the target virtual clients.
In an alternative embodiment, the data splitting device further comprises: the retransmission module is used for recording the data packet size of each target service metadata through each target virtual client;
receiving feedback information sent by each target service server, wherein the feedback information comprises the size of a data packet of each received target service metadata;
generating a retransmission instruction according to the recorded data packet size of each target service metadata and the feedback message;
and retransmitting the target service metadata to the corresponding target service servers through the target virtual clients according to the retransmission instructions.
In an alternative embodiment, the slicing module is further configured to receive, through the virtual server, signaling data to be shunted based on the synchronous non-blocking input-output model.
In a third aspect, the present application provides an electronic device comprising: a processor, a storage medium, and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor in communication with the storage medium via the bus when the electronic device is running, the processor executing the machine-readable instructions to perform the steps of the data splitting method as in any of the previous embodiments.
In a fourth aspect, the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of a data splitting method as in any of the previous embodiments.
The beneficial effects of the application are as follows:
the data distribution method, the device, the electronic equipment and the storage medium provided by the embodiment of the application are applied to a signaling forwarding server, wherein a virtual server and a plurality of virtual clients are preconfigured in the signaling forwarding server, and the method comprises the following steps: receiving signaling data to be shunted through a virtual server, and performing fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata, wherein the target service metadata identify the service type; according to a first preset mapping relation, determining each target virtual client corresponding to each target service metadata from a plurality of virtual clients, wherein the first preset mapping relation comprises: the service metadata belongs to the service type and the mapping relation between the virtual clients; forwarding, by each target virtual client, each target service metadata to each corresponding target service server according to a second preset mapping relationship, where the second preset mapping relationship includes: by applying the embodiment of the application, the distribution forwarding of the metadata of each target service can be realized, and the data blocking is avoided, so that the processing performance of the signaling forwarding server can be ensured.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a data splitting method according to an embodiment of the present application;
FIG. 2 is a flow chart of another data distribution method according to an embodiment of the present application;
FIG. 3 is a flow chart of another data distribution method according to an embodiment of the present application;
FIG. 4 is a flow chart of another data distribution method according to an embodiment of the present application;
FIG. 5 is a flow chart of another data distribution method according to an embodiment of the present application;
FIG. 6 is a flow chart of another data distribution method according to an embodiment of the present application;
fig. 7 is a schematic diagram of a functional module of a data splitting device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. The components of the embodiments of the present application generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the application, as presented in the figures, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.
Fig. 1 is a flow chart of a data offloading method according to an embodiment of the present application, where the data offloading method may be applied to a signaling forwarding server, where a virtual server and a plurality of virtual clients are preconfigured in the signaling forwarding server, and in some embodiments, the signaling forwarding server may be communicatively connected to a communication base station in a communication network. As shown in fig. 1, the method includes:
S101, receiving signaling data to be shunted through a virtual server, and carrying out fragmentation processing on the signaling data to be shunted to obtain a plurality of fragmented target service metadata, wherein the target service metadata identify the service type.
Wherein, the signaling data to be shunted of the mobile terminal can be acquired through a communication network, optionally, the mobile terminal can include but is not limited to: smart phones, tablet computers, intelligent wearable devices, etc., the acquired signaling data to be shunted may include: the location information, call information (e.g., call time, number information of a call partner), short message information, etc., are not limited herein. Taking a mobile phone as an example for illustration, mobile phone signaling data can be generated by capturing and recording the signaling track of the same user by a communication base station in a communication network when a mobile phone user has events such as talking, sending a short message or moving a position.
After the signaling data to be shunted is obtained, the signaling data to be shunted can be subjected to slicing, the slicing can be understood as slicing operation, that is, the signaling data to be shunted can be subjected to slicing operation, it can be understood that after the slicing operation, the signaling data to be shunted with larger data volume can be divided into a plurality of target service metadata with smaller data volume, and each target service metadata identifier has a service type, optionally, the service type to which the service metadata belongs can include: short message service, location service, call service, etc., are not limited herein. Of course, the present application is not limited to the size of the data packet of each target service metadata, and may be different according to the actual application scenario.
S102, determining each target virtual client corresponding to each target service metadata from a plurality of virtual clients according to a first preset mapping relation, wherein the first preset mapping relation comprises: the service metadata belongs to the service type and the mapping relation between the virtual clients.
The service metadata of different service types may correspond to different virtual clients, and the first preset mapping relationship may include: the service metadata belongs to the service type and the mapping relation between the virtual clients, so that after the fragmented multiple target service metadata are obtained, each target virtual client corresponding to each target service metadata can be determined according to the first preset mapping relation.
S103, forwarding each target service metadata to each corresponding target service server through each target virtual client according to a second preset mapping relation, wherein the second preset mapping relation comprises: mapping relationship between each virtual client and each service server.
After determining each target virtual client corresponding to each target service metadata based on the above description, each target service metadata can be forwarded to its corresponding target service server by the target virtual client, so as to realize the split forwarding of each target service metadata, avoid the problem of performance degradation of the signaling forwarding server caused by incapability of forwarding the target service metadata in time, improve the network back pressure capability of the signaling forwarding server, and ensure the stability of the signaling forwarding server.
In some embodiments, the signaling forwarding server may also be in communication connection with a proxy server in the communication network, where the proxy server is in communication connection with a communication base station in the communication network, so as to obtain the signaling data to be shunted through the proxy server.
In summary, an embodiment of the present application provides a data offloading method, applied to a signaling forwarding server, where a virtual server and a plurality of virtual clients are preconfigured in the signaling forwarding server, where the method includes: receiving signaling data to be shunted through a virtual server, and performing fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata, wherein the target service metadata identify the service type; according to a first preset mapping relation, determining each target virtual client corresponding to each target service metadata from a plurality of virtual clients, wherein the first preset mapping relation comprises: the service metadata belongs to the service type and the mapping relation between the virtual clients; forwarding, by each target virtual client, each target service metadata to each corresponding target service server according to a second preset mapping relationship, where the second preset mapping relationship includes: by applying the embodiment of the application, the distribution forwarding of the metadata of each target service can be realized, and the data blocking is avoided, so that the processing performance of the signaling forwarding server can be ensured, and the stability of the signaling forwarding server can be improved.
Fig. 2 is a flow chart of another data offloading method according to an embodiment of the present application, optionally, as shown in fig. 2, forwarding, by each target virtual client, each target service metadata to each corresponding target service server includes:
s201, determining the sending priority of each target service metadata according to the service type of each target service metadata.
S202, forwarding each target service metadata to each corresponding target service server through each target virtual client according to the sending priority of each target service metadata.
The sending priority of the target service metadata can represent the sending sequence of each corresponding target virtual client, and optionally, the higher the sending priority of the target service metadata is, the more forward the sending sequence of the corresponding target virtual client is, that is, the corresponding target virtual client can send the target service metadata to the corresponding target service server preferentially, so that the requirement of an application scene with higher timeliness requirement can be met, timeliness is ensured, and the adaptability of the data distribution method is improved.
Optionally, when the service type to which the service metadata belongs includes a sms service, a location service, and a call service, the sending priority of the target service metadata corresponding to the location service may be higher than the sending priority of the target service metadata corresponding to the call service, and the sending priority of the target service metadata corresponding to the call service may be higher than the sending priority of the target service metadata corresponding to the sms service, that is, when the service metadata is specifically sent, each target virtual client corresponding to the location service will forward the target service metadata of the location service type to the target service server corresponding to the location service preferentially; and each target virtual client corresponding to the call service is next to each target virtual client corresponding to the short message service, and the specific forwarding sequence is not limited to this according to the actual application scenario.
Fig. 3 is a flow chart of another data splitting method according to an embodiment of the present application. Optionally, as shown in fig. 3, the method further includes:
s301, receiving a registration message sent by a service server to be registered, wherein the registration message comprises: the identity of the service server to be registered and the identity of the corresponding virtual client.
S302, updating a second preset mapping relation according to the registration message.
According to an actual application scenario, for example, when a current service server corresponding to a certain virtual client fails and needs to configure a new service server, a second preset mapping relationship in a signaling forwarding server needs to be updated, so that each service server mapped by each virtual client can be updated, optionally, in this case, a server to be registered may send a registration message to the signaling forwarding server, where the registration message may include an identifier of the service server to be registered and an identifier of the corresponding virtual client, and after the signaling forwarding server receives the registration message, the second preset mapping relationship may be updated. Of course, the present application is not limited to a specific updating manner, and may be to add a service server to be registered in the second preset mapping relationship, or remove a history service server, or the like.
Optionally, the identification of the service server to be registered may include: the identifier of the virtual client may include, but is not limited to, a port number, an IP address, a server device serial number, etc., and may be different according to an actual application scenario.
Fig. 4 is a flow chart of another data distribution method according to an embodiment of the present application. Optionally, as shown in fig. 4, determining the target virtual client from the plurality of virtual clients according to the first preset mapping relationship includes:
s401, performing service dimension processing on each target service metadata based on an asynchronous message processing mechanism according to the service type to which each target service metadata belongs, and obtaining each processed target service metadata.
After obtaining the service type to which each target service data belongs, service dimension processing may be performed on each target service metadata based on an asynchronous message processing mechanism, such as a Handler mechanism, to obtain processed service metadata, optionally, each Handler module may correspond to a service type and be used for performing service dimension processing on the target service metadata corresponding to the service type, where the service dimension processing manner may include, but is not limited to, location statistics, call duration statistics, service metadata source statistics, user portrait statistics (such as residence, workplace, and behavior preference), and the specific setting manner is not limited thereto.
It can be understood that by performing service dimension processing on each target service metadata, the target service metadata can be subjected to primary service processing, invalid data is filtered, the data volume forwarded by the virtual client to the service server is reduced, data surge caused by network transient is avoided, and the applicability of the data distribution method is improved.
S402, determining each target virtual client corresponding to each processed target service metadata from a plurality of virtual clients according to a first preset mapping relation.
Referring to the foregoing description, after obtaining the processed target service metadata, each target virtual client corresponding to each processed target service metadata may be determined according to the service type to which each processed target service metadata belongs and the first preset mapping relationship.
Fig. 5 is a flow chart of another data splitting method according to an embodiment of the present application. Optionally, as shown in fig. 5, the slicing processing is performed on the signaling data to be shunted to obtain a plurality of target service metadata after slicing, including:
s501, decoding the signaling data to be shunted to obtain decoded signaling data to be shunted.
S502, according to the decoded signaling data to be shunted, carrying out fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata.
If the acquired signaling data to be shunted is generated by encoding according to the signaling standard specification, it is necessary to decode the signaling data to be shunted, so that the service type included in the signaling data to be shunted can be acquired according to the decoded signaling data to be shunted, alternatively, if the data size of a certain piece of signaling data to be shunted is larger, the piece of signaling data to be shunted can include a plurality of service types, further, the signaling data to be shunted can be fragmented according to the service type included in the signaling data to be shunted and a preset fragmentation threshold value, so as to obtain a plurality of target service metadata after fragmentation, each target service metadata can be marked with the corresponding service type, and the data size of each target service metadata can be smaller than the fragmentation data size threshold value indicated by the preset fragmentation threshold value.
Correspondingly, forwarding, according to the second preset mapping relationship, each target service metadata to each corresponding target service server through each target virtual client includes:
s503, coding the target service metadata through each target virtual client to obtain coded target service metadata.
S504, encrypting the coded target service metadata, and forwarding the target service metadata to the corresponding target service servers through the target virtual clients.
It will be appreciated that when forwarding each target service metadata to the target service server via the target virtual client after decoding, it is also necessary to perform an encoding operation on it so that it can be successfully forwarded, optionally the encoding format includes, but is not limited to: ASCII, UTF-8, UTF-16, etc., are not limited herein and may vary depending on the actual application scenario.
After encoding, it is also necessary to encrypt each encoded target service metadata in order to ensure security, and optionally, the encryption algorithm may include, but is not limited to: the hash algorithm, the symmetric encryption algorithm, the asymmetric encryption algorithm, and the like are not limited herein, and can be flexibly selected according to actual application scenarios. It will be appreciated that, if the encryption operation is performed, the target service server may perform the decoding operation by using a corresponding decoding algorithm and perform the decryption operation by using a corresponding decryption algorithm, which is not limited herein.
In some embodiments, the decryption and encoding operations may be implemented by a Pipeline model, which is not limited herein.
Fig. 6 is a flow chart of another data distribution method according to an embodiment of the present application. Optionally, as shown in fig. 6, the method further includes:
S601, recording the data packet size of each target service metadata through each target virtual client.
S602, receiving feedback information sent by each target service server, wherein the feedback information comprises the size of a data packet of each received target service metadata.
S603, generating a retransmission instruction according to the recorded data packet size of each target service metadata and the feedback message.
S604, retransmitting the target service metadata to the corresponding target service servers through the target virtual clients according to the retransmission instruction.
For each target virtual client, each target virtual client can record the data packet size of each target service metadata to be forwarded, each target service server can acquire the data packet size of each received target service metadata after receiving the target service metadata forwarded by each target virtual client, and send a feedback message including the data packet size of each received target service metadata to each target virtual client, so that each target virtual client can judge whether packet loss occurs according to the feedback message and the recorded data packet size, wherein if the data packet size of each recorded target service metadata is greater than the data packet size indicated by the feedback message, a retransmission instruction is generated, and further, each target virtual client can retransmit each target service metadata to the corresponding target service server through each target virtual client according to the retransmission instruction, so that the packet loss phenomenon is avoided, and the applicability of the data splitting method is improved.
Optionally, the receiving, by the virtual server, the signaling data to be shunted further includes:
and receiving signaling data to be shunted through the virtual server based on the synchronous non-blocking input-output model.
Alternatively, the synchronous non-blocking input/output model may be a NIO model, or may be another model having the same data processing function as the NIO model, which is not limited herein. The application is described herein by taking the NIO model as an example, and optionally, when receiving the signaling data to be shunted based on the NIO model, the application can realize non-blocking receiving based on a channel (channel) facing a buffer zone, thereby ensuring the processing performance of the signaling forwarding server. In some embodiments, the steps of the data splitting method described above may be specifically implemented based on the Netty framework, but are not limited thereto.
Optionally, the method further comprises: the signaling forwarding server is configured to generate a restarting instruction if the downtime is determined to occur; and restarting the signaling forwarding server according to the restarting instruction.
If the signaling forwarding server is determined to be in a down state, the signaling forwarding server can generate a restarting instruction through the configuration, and the signaling forwarding server can be controlled to restart according to the restarting instruction, so that high availability of the signaling forwarding server can be ensured under the condition of some unexpected faults, such as short-time power failure.
Fig. 7 is a schematic diagram of a functional module of a data splitting device according to an embodiment of the present application, and the basic principle and the technical effects of the device are the same as those of the corresponding method embodiment, and for brevity, reference may be made to corresponding contents in the method embodiment for the parts not mentioned in the present embodiment. The data splitting apparatus may be applied to a signaling forwarding server in which a virtual server and a plurality of virtual clients are preconfigured, as shown in fig. 7, the data splitting apparatus 100 includes:
the slicing module 110 is configured to receive signaling data to be sliced through the virtual server, and perform slicing processing on the signaling data to be sliced to obtain a plurality of target service metadata after slicing, where the target service metadata identifies a service type to which the target service metadata belongs;
the determining module 120 is configured to determine, from a plurality of virtual clients, each target virtual client corresponding to each target service metadata according to a first preset mapping relationship, where the first preset mapping relationship includes: the service metadata belongs to the service type and the mapping relation between the virtual clients;
the forwarding module 130 is configured to forward, according to a second preset mapping relationship, each target service metadata to each corresponding target service server through each target virtual client, where the second preset mapping relationship includes: mapping relationship between each virtual client and each service server.
In an optional implementation manner, the forwarding module 130 is specifically configured to determine, according to a service type of each of the target service metadata, a sending priority of each of the target service metadata; and forwarding each target service metadata to each corresponding target service server through each target virtual client according to the sending priority of each target service metadata.
In an optional embodiment, the forwarding module 130 is further configured to receive a registration message sent by a service server to be registered, where the registration message includes: an identification of a service server to be registered and an identification of a corresponding virtual client; and updating the second preset mapping relation according to the registration message.
In an optional implementation manner, the determining module 120 is specifically configured to perform service dimension processing on each piece of target service metadata based on an asynchronous message processing mechanism according to a service type to which each piece of target service metadata belongs, so as to obtain each piece of processed target service metadata; and determining each target virtual client corresponding to each processed target service metadata from a plurality of virtual clients according to the first preset mapping relation.
In an optional implementation manner, the slicing module 110 is specifically configured to decode the signaling data to be shunted to obtain decoded signaling data to be shunted; according to the decoded signaling data to be shunted, carrying out fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata; the forwarding module 130 is specifically configured to perform encoding processing on each target service metadata through each target virtual client, so as to obtain each encoded target service metadata; and carrying out encryption processing on the coded target service metadata, and forwarding the encrypted target service metadata to corresponding target service servers through the target virtual clients.
In an alternative embodiment, the data splitting device further comprises: the retransmission module is used for recording the data packet size of each target service metadata through each target virtual client; receiving feedback information sent by each target service server, wherein the feedback information comprises the size of a data packet of each received target service metadata; generating a retransmission instruction according to the recorded data packet size of each target service metadata and the feedback message; and retransmitting the target service metadata to the corresponding target service servers through the target virtual clients according to the retransmission instructions.
In an alternative embodiment, the splitting module 110 is further configured to receive, through the virtual server, signaling data to be split based on a synchronous non-blocking input-output model.
The foregoing apparatus is used for executing the method provided in the foregoing embodiment, and its implementation principle and technical effects are similar, and are not described herein again.
The above modules may be one or more integrated circuits configured to implement the above methods, for example: one or more application specific integrated circuits (Application Specific Integrated Circuit, abbreviated as ASICs), or one or more microprocessors, or one or more field programmable gate arrays (Field Programmable Gate Array, abbreviated as FPGAs), etc. For another example, when a module above is implemented in the form of a processing element scheduler code, the processing element may be a general-purpose processor, such as a central processing unit (Central Processing Unit, CPU) or other processor that may invoke the program code. For another example, the modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
Fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present application, where the electronic device may be integrated in a signaling forwarding server. As shown in fig. 8, the electronic device may include: processor 210, storage medium 220, and bus 230, storage medium 220 storing machine-readable instructions executable by processor 210, processor 210 executing machine-readable instructions to perform steps of the method embodiments described above when the electronic device is operating, processor 210 communicating with storage medium 220 via bus 230. The specific implementation manner and the technical effect are similar, and are not repeated here.
Optionally, the present application further provides a storage medium, on which a computer program is stored, which when being executed by a processor performs the steps of the above-described method embodiments. The specific implementation manner and the technical effect are similar, and are not repeated here.
In the several embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of elements is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.
The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (english: processor) to perform part of the steps of the methods of the embodiments of the application. And the aforementioned storage medium includes: u disk, mobile hard disk, read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.
The above is only a preferred embodiment of the present application, and is not intended to limit the present application, but various modifications and variations can be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application. It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures. The above is only a preferred embodiment of the present application, and is not intended to limit the present application, but various modifications and variations can be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (7)
1. A data offloading method, applied to a signaling forwarding server, where a virtual server and a plurality of virtual clients are preconfigured in the signaling forwarding server, the method comprising:
receiving signaling data to be shunted through the virtual server, and performing fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata, wherein the target service metadata identify the service type;
Determining each target virtual client corresponding to each target service metadata from a plurality of virtual clients according to a first preset mapping relation, wherein the first preset mapping relation comprises: the service metadata belongs to the service type and the mapping relation between the virtual clients;
forwarding, by each target virtual client, each target service metadata to each corresponding target service server according to a second preset mapping relationship, where the second preset mapping relationship includes: mapping relation between each virtual client and each service server;
forwarding, by each of the target virtual clients, each of the target service metadata to a corresponding one of the target service servers, including:
determining the sending priority of each target service metadata according to the service type of each target service metadata;
forwarding each target service metadata to each corresponding target service server through each target virtual client according to the sending priority of each target service metadata;
the determining, according to a first preset mapping relationship, a target virtual client from a plurality of virtual clients includes:
according to the service type of each target service metadata, performing service dimension processing on each target service metadata based on an asynchronous message processing mechanism to obtain each processed target service metadata;
Determining each target virtual client corresponding to each processed target service metadata from a plurality of virtual clients according to the first preset mapping relation;
the server to be registered sends a registration message to the signaling forwarding server, wherein the registration message comprises the identification of the server to be registered and the identification of the virtual client, and the signaling forwarding server updates the second mapping relation after receiving the registration message.
2. The method of claim 1, wherein the slicing the signaling data to be shunted to obtain a plurality of target service metadata after slicing, includes:
decoding the signaling data to be shunted to obtain decoded signaling data to be shunted;
according to the decoded signaling data to be shunted, carrying out fragmentation processing on the signaling data to be shunted to obtain fragmented multiple target service metadata;
forwarding, by each target virtual client, each target service metadata to each corresponding target service server according to a second preset mapping relationship, including:
encoding the target service metadata through the target virtual clients to obtain encoded target service metadata;
And carrying out encryption processing on the coded target service metadata, and forwarding the encrypted target service metadata to corresponding target service servers through the target virtual clients.
3. The method according to claim 1, wherein the method further comprises:
recording the data packet size of each target service metadata through each target virtual client;
receiving feedback information sent by each target service server, wherein the feedback information comprises the size of a data packet of each received target service metadata;
generating a retransmission instruction according to the recorded data packet size of each target service metadata and the feedback message;
and retransmitting the target service metadata to the corresponding target service servers through the target virtual clients according to the retransmission instructions.
4. A method according to any of claims 1-3, wherein said receiving signaling data to be shunted by said virtual server further comprises:
and receiving signaling data to be shunted through the virtual server based on the synchronous non-blocking input-output model.
5. A data splitting device, applied to a signaling forwarding server, wherein a virtual server and a plurality of virtual clients are preconfigured in the signaling forwarding server, the data splitting device comprising:
The system comprises a segmentation module, a segmentation module and a virtual server, wherein the segmentation module is used for receiving signaling data to be segmented through the virtual server, and performing segmentation processing on the signaling data to be segmented to obtain a plurality of segmented target service metadata, wherein the target service metadata identify the service type;
the determining module is configured to determine, from a plurality of virtual clients, each target virtual client corresponding to each target service metadata according to a first preset mapping relationship, where the first preset mapping relationship includes: the service metadata belongs to the service type and the mapping relation between the virtual clients;
the forwarding module is configured to forward, according to a second preset mapping relationship, each target service metadata to each corresponding target service server through each target virtual client, where the second preset mapping relationship includes: mapping relation between each virtual client and each service server; determining the sending priority of each target service metadata according to the service type of each target service metadata; forwarding each target service metadata to each corresponding target service server through each target virtual client according to the sending priority of each target service metadata; the server to be registered sends a registration message to the signaling forwarding server, wherein the registration message comprises an identifier of the server to be registered and an identifier of the virtual client, and the signaling forwarding server updates the second mapping relation after receiving the registration message;
The determining module is further configured to perform service dimension processing on each target service metadata based on an asynchronous message processing mechanism according to a service type to which each target service metadata belongs, so as to obtain each processed target service metadata; and determining each target virtual client corresponding to each processed target service metadata from a plurality of virtual clients according to the first preset mapping relation.
6. An electronic device, comprising: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating over the bus when the electronic device is running, the processor executing the machine-readable instructions to perform the steps of the data splitting method of any of claims 1-4.
7. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, performs the steps of the data splitting method according to any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110818642.2A CN113535432B (en) | 2021-07-20 | 2021-07-20 | Data distribution method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110818642.2A CN113535432B (en) | 2021-07-20 | 2021-07-20 | Data distribution method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113535432A CN113535432A (en) | 2021-10-22 |
| CN113535432B true CN113535432B (en) | 2023-12-15 |
Family
ID=78100417
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110818642.2A Active CN113535432B (en) | 2021-07-20 | 2021-07-20 | Data distribution method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113535432B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114338549B (en) * | 2021-12-30 | 2024-02-09 | 南京中孚信息技术有限公司 | Data stream identification processing method, device, server and storage medium |
| CN115712660B (en) * | 2022-01-29 | 2023-05-30 | 杭州宇信数字科技有限公司 | Data storage method, device, server and storage medium |
| CN115866057A (en) * | 2022-11-30 | 2023-03-28 | 中国联合网络通信集团有限公司 | Data processing method and device and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557427A (en) * | 2009-05-11 | 2009-10-14 | 阿里巴巴集团控股有限公司 | Method for providing diffluent information and realizing the diffluence of clients, system and server thereof |
| CN102255926A (en) * | 2010-05-17 | 2011-11-23 | 中国移动通信集团公司 | Task distribution method in map reduce (MR) system, system and apparatus thereof |
| CN105550051A (en) * | 2015-12-25 | 2016-05-04 | 北京奇虎科技有限公司 | Asynchronous processing method and device of business request |
| CN106899680A (en) * | 2017-03-09 | 2017-06-27 | 上海亿账通区块链科技有限公司 | The burst treating method and apparatus of multi-tiling chain |
| US9742549B1 (en) * | 2016-09-29 | 2017-08-22 | Analog Devices Global | Apparatus and methods for asynchronous clock mapping |
| CN110581893A (en) * | 2019-09-18 | 2019-12-17 | 西安未来国际信息股份有限公司 | data transmission method and device, routing equipment, server and storage medium |
| CN111464628A (en) * | 2020-03-31 | 2020-07-28 | 中国工商银行股份有限公司 | Multiplexing asynchronous processing system and method |
| CN111930515A (en) * | 2020-09-16 | 2020-11-13 | 北京达佳互联信息技术有限公司 | Data acquisition and distribution method, device, server and storage medium |
| CN112396315A (en) * | 2020-11-17 | 2021-02-23 | 平安普惠企业管理有限公司 | Method, device, equipment and storage medium for distributing business money strategy |
| CN112839067A (en) * | 2019-11-22 | 2021-05-25 | 腾讯科技（深圳）有限公司 | Data synchronization method and device |
| CN112905928A (en) * | 2021-05-07 | 2021-06-04 | 杭州米络星科技(集团)有限公司 | Webpage refreshing method and device, electronic equipment and storage medium |
-
2021
- 2021-07-20 CN CN202110818642.2A patent/CN113535432B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101557427A (en) * | 2009-05-11 | 2009-10-14 | 阿里巴巴集团控股有限公司 | Method for providing diffluent information and realizing the diffluence of clients, system and server thereof |
| CN102255926A (en) * | 2010-05-17 | 2011-11-23 | 中国移动通信集团公司 | Task distribution method in map reduce (MR) system, system and apparatus thereof |
| CN105550051A (en) * | 2015-12-25 | 2016-05-04 | 北京奇虎科技有限公司 | Asynchronous processing method and device of business request |
| US9742549B1 (en) * | 2016-09-29 | 2017-08-22 | Analog Devices Global | Apparatus and methods for asynchronous clock mapping |
| CN106899680A (en) * | 2017-03-09 | 2017-06-27 | 上海亿账通区块链科技有限公司 | The burst treating method and apparatus of multi-tiling chain |
| CN110581893A (en) * | 2019-09-18 | 2019-12-17 | 西安未来国际信息股份有限公司 | data transmission method and device, routing equipment, server and storage medium |
| CN112839067A (en) * | 2019-11-22 | 2021-05-25 | 腾讯科技（深圳）有限公司 | Data synchronization method and device |
| CN111464628A (en) * | 2020-03-31 | 2020-07-28 | 中国工商银行股份有限公司 | Multiplexing asynchronous processing system and method |
| CN111930515A (en) * | 2020-09-16 | 2020-11-13 | 北京达佳互联信息技术有限公司 | Data acquisition and distribution method, device, server and storage medium |
| CN112396315A (en) * | 2020-11-17 | 2021-02-23 | 平安普惠企业管理有限公司 | Method, device, equipment and storage medium for distributing business money strategy |
| CN112905928A (en) * | 2021-05-07 | 2021-06-04 | 杭州米络星科技(集团)有限公司 | Webpage refreshing method and device, electronic equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| Rendering differencial performance through intelligent network edge in cloud data centers;Dian Shen等;《Cocurrency and Computation:Practice and Experience》;1-14 * |
| 一种面向富客户端应用的运行时自适应中间件;赵祺等;《软件学报》;第24卷(第07期);1419-1435+17-18 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113535432A (en) | 2021-10-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113535432B (en) | Data distribution method and device, electronic equipment and storage medium | |
| US11228590B2 (en) | Data processing method and apparatus based on mobile application entrance and system | |
| CN109639642B (en) | MQTT-based security authentication method, device and storage medium | |
| US9781255B1 (en) | Authentication of phone call origination | |
| CN104349288B (en) | Message transmission method and device | |
| EP2710776B1 (en) | Anonymous signalling | |
| CN112738791B (en) | User information correlation backfill method, device, equipment and medium based on 5G core network | |
| CN104158816A (en) | Authentication method and device as well as server | |
| CN111246311A (en) | Data transmission method and device, storage medium and electronic equipment | |
| CN113032357A (en) | File storage method and device and server | |
| WO2019149006A1 (en) | Method and device for obtaining and providing access information of wireless access point, and medium | |
| CN109379764B (en) | Message sending method and device | |
| US9332405B2 (en) | Short message backup method, mobile terminal, and server | |
| CN113014580A (en) | File transmission method and device, electronic equipment and storage medium | |
| CN114257562B (en) | Instant messaging method, device, electronic equipment and computer readable storage medium | |
| CN106850770B (en) | Efficient transmission method based on cloud computing service | |
| US10785025B1 (en) | Synchronization of key management services with cloud services | |
| CN107294704B (en) | Password generation method, password execution method and terminal | |
| WO2016037489A1 (en) | Method, device and system for monitoring rcs spam messages | |
| CN111355793A (en) | Large file uploading method based on HTML5 and Python | |
| CN110392016B (en) | Method, device and system for preventing traffic from being hijacked | |
| WO2014089968A1 (en) | Virtual machine system data encryption method and device | |
| CN104573518A (en) | Method, device, server and system for scanning files | |
| CN112448932B (en) | Message processing method and device | |
| WO2019200690A1 (en) | Data protection method, server and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |