CN111314144B

CN111314144B - Communication data processing method and device and data processing terminal

Info

Publication number: CN111314144B
Application number: CN202010110003.6A
Authority: CN
Inventors: 徐世云
Original assignee: Shenzhen Zhutai Defense Intelligent Technology Co ltd
Current assignee: SHENZHEN ZHUTAI DEFENSE INTELLIGENT TECHNOLOGY Co.,Ltd.
Priority date: 2020-02-23
Filing date: 2020-02-23
Publication date: 2021-02-26
Anticipated expiration: 2040-02-23
Also published as: CN112235389A; CN111314144A; CN112202618A

Abstract

The invention provides a communication data processing method, a communication data processing device and a data processing terminal, which can analyze communication records of the data processing terminal and M target terminals in N continuous time periods before the current time, further determine a first communication parameter of the data processing terminal and a second communication parameter of the target terminal, then sequentially determine a network state, a multidimensional state vector and a network state change track of a communication network in each time period based on the first communication parameter and the second communication parameter, and map the obtained first data processing track to the network state change track to obtain the second data processing track. And finally, generating a track adjustment parameter based on the track coincidence rate of the second data processing track and the network state change track so as to realize the adjustment of the working state of the data processing terminal and ensure that the network states of the data processing terminal and the communication network are synchronous and are subjected to self-adaptive adjustment so as to improve the data processing efficiency.

Description

Communication data processing method and device and data processing terminal

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for processing communication data, and a data processing terminal.

Background

Data has become an essential part of people's life. Nowadays, most of the society produces and lives without data. With the development of communication technology, the interaction of communication data can provide a convenient and efficient communication and communication mode for multiple parties, so that the whole society operates efficiently and orderly. Electronic terminals with data interaction function are also gradually favored by people such as mobile phones, tablets, notebook computers, smart homes, etc., and in some fields such as medical field and car networking field, intelligent terminals with data communication and interaction function are also gradually applied such as telemedicine equipment and vehicle-mounted controllers. However, most of the data communication technologies developed for the electronic terminals or the smart terminals at present only relate to functions such as data transceiving, data storage, and data format conversion, and cannot adaptively adjust the operating state of the electronic terminals or the smart terminals according to the real-time communication network state.

Disclosure of Invention

In order to improve the problems, the invention provides a communication data processing method, a communication data processing device and a data processing terminal.

In a first aspect of the embodiments of the present invention, a communication data processing method is provided, which is applied to a data processing terminal, where the data processing terminal and M target terminals form a communication network and communicate with each other, and the method includes:

acquiring first communication records of a data processing terminal in N continuous time periods and second communication records of each target terminal in M target terminals in N continuous time periods; respectively analyzing the first communication record and the M second communication records in each time interval, and determining a first communication parameter of the data processing terminal and a second communication parameter of each target terminal in each time interval, wherein N and M are positive integers;

determining a first communication state and a second communication state of the data processing terminal and the M target terminals in each time period according to the first communication parameters and the M second communication parameters in each time period, and determining a network state of the communication network based on the first communication state and the M second communication states in each time period;

determining a multidimensional state vector of the communication network in each time period according to the network state of the communication network in each time period of N continuous time periods, wherein the multidimensional state vector comprises a stability vector, a delay vector and a packet loss vector;

acquiring a log file of the data processing terminal, determining a communication data processing form of the data processing terminal based on the log file, and acquiring a feature vector set according to N multi-dimensional state vectors corresponding to the communication network and the communication data processing form; performing K-means clustering on the feature vector set to obtain a target cluster, wherein the target cluster is used for representing a network state change track of the communication network;

performing feature analysis on at least part of target vectors included in the target cluster to obtain a network state change track of the communication network; carrying out logic extraction on the communication data processing form to obtain a first data processing track of the communication data processing form; mapping the first data processing track to the network state change track to obtain a second data processing track corresponding to the first data processing track; generating a track adjusting parameter for adjusting the second data processing track based on the track coincidence rate of the second data processing track and the network state change track, mapping the track adjusting parameter to a preset parameter database for searching to obtain a target parameter, and adjusting the working state of the data processing terminal according to the target parameter.

In an alternative embodiment, the determining the network status of the communication network based on the first communication status and the M second communication statuses in each period comprises:

judging whether state information used for representing that a state breakpoint exists in the data processing terminal in the first communication state in each time period exists, if so, determining the number of intermittent pause states in the M second communication states in the time period, and determining state description information of the communication network in the time period according to the number and the state information;

extracting features of the state description information to obtain a state array corresponding to the state description information, wherein the state array comprises a plurality of state values, and each state value is used for describing the communication state of the communication network in the period;

judging whether the communication connection form of the communication network is node connection or non-node connection in the time period according to the state array;

determining a communication link stability factor of the communication network in the time period according to the communication connection form, wherein if the communication connection form is the non-node connection, the communication link stability factor of the communication network in the time period is calculated according to the communication protocol of the communication network in the time period and at least part of address pairs included in the communication protocol; if the communication connection form is node connection, determining the node weight of the communication network in the time period according to a communication data coding mode corresponding to the node interface type in the communication network in the time period, and determining the protocol reuse rate of the communication network in the time period according to the protocol pairing result between the data processing terminal and the M target terminals in the time period; determining a communication link stability coefficient of the communication network in the time period according to the node weight and the protocol multiplexing rate of the communication network in the time period;

judging whether the communication link stability coefficient falls into the communication connection form of a communication link interval corresponding to a communication network in the pre-stored time period; if yes, judging that the data processing terminal and the M target terminals in the time interval have no equipment heterogeneous phenomenon, and weighting a first communication state and M second communication states in the time interval according to the communication link stability coefficient to obtain a network state of the communication network in the time interval; and if not, judging that the data processing terminal and the M target terminals have equipment heterogeneous phenomena in the time period, weighting the M second communication states in the time period according to the communication link stability coefficient to obtain the network state of the communication network in the time period, wherein the network state is represented by a state list.

In an alternative embodiment, the determining a multidimensional state vector for the communication network for each of N consecutive time periods from the network state of the communication network for each of the time periods comprises:

acquiring a resource configuration sequence of the communication network in each time interval and each state list corresponding to the network state; under the condition that a compatible resource region is determined to be contained in the communication network according to the resource configuration sequence, determining a first corresponding relation between each state list of the communication network under an incompatible resource region and each state list of the communication network under the compatible resource region according to the state list of the communication network under the compatible resource region and the list sequence thereof, and adjusting the state list of the communication network under the incompatible resource region and the state list under the compatible resource region to be under the compatible resource region based on the first corresponding relation;

judging whether the communication network contains a plurality of state lists in the non-compatible resource area; if yes, determining a second corresponding relation between the state lists of the communication network under the incompatible resource region according to the state lists and the list sequence of the communication network under the compatible resource region, and layering the state lists under the incompatible resource region according to the second corresponding relation between the state lists; adding a level coefficient to each layer of state list obtained by layering according to the state list of the communication network under the compatible resource region and the list sequence thereof, and adjusting at least a plurality of layers of state lists under the compatible resource region based on the level coefficient corresponding to each layer of state list;

and determining a correlation coefficient between each state list in all state lists under the compatible resource region and any state list out of the state lists in all the state lists, and performing feature extraction on each state list based on a plurality of correlation coefficients corresponding to each state list in all the state lists to obtain a multidimensional state vector of the communication network in the period.

In an alternative embodiment, the performing feature analysis on at least a part of the target vectors included in the target cluster to obtain a network state change trajectory of the communication network includes:

judging whether a vector identifier for generating a network topology of a communication network is stored in the vector for each vector in the target cluster, if not, removing the vector from the target cluster, and if so, determining the vector as a target vector;

identifying the dimensional features of vector values contained in at least part of target vectors screened from the target clusters, and judging whether the vector identifications corresponding to the at least part of target vectors store identification pairs corresponding to the vector values of the dimensional features; if not, establishing an identification pair of the vector value of the dimensional characteristic in the vector identification corresponding to the at least part of target vectors, and establishing a node connection line list corresponding to the network topology of the identification pair in the at least part of target vectors; if yes, judging whether the dimensional characteristics of the vector values contained in the at least part of target vectors are the same as preset characteristics, if so, updating a node connecting line list corresponding to the network topology of the identifier pair in the at least part of target vectors aiming at the identifier pair corresponding to the vector values of the dimensional characteristics, and if not, establishing a node connecting line list corresponding to the network topology of the at least part of target vectors containing the dimensional characteristics in the identifier pair of the vector values of the dimensional characteristics;

and extracting node information and connection information in the node connection list, and generating a network state change track of the communication network according to the node information and the connection information.

In an alternative embodiment, the adjusting the operating state of the data processing terminal according to the target parameter includes:

determining the adjustment step length and the critical value of each type of parameter according to the adjustment trend information of each type of parameter in the target parameter;

determining an adjusting factor for adjusting the critical value of each type of parameter according to the global weight of each type of parameter and the residual memory of the data processing terminal; the adjustment factors are determined by global adjustment factors and local adjustment factors of various parameters, the global adjustment factors are obtained through a residual memory of the data processing terminal, and the local adjustment factors are obtained through a used memory of the data processing terminal;

and carrying out iterative adjustment on various parameters according to the adjustment step length, the critical value and the adjustment factor of the various parameters, determining whether a state evaluation factor corresponding to a target working state obtained based on the various parameters after the iterative adjustment of the data processing terminal falls into a preset evaluation interval or not based on the result of the iterative adjustment, if so, judging that the adjustment of the working state of the data processing terminal is finished, and if not, returning to the step of carrying out iterative adjustment on the various parameters according to the adjustment step length, the critical value and the adjustment factor of the various parameters.

In an alternative embodiment, the obtaining a log file of the data processing terminal, and determining a communication data processing form of the data processing terminal based on the log file, includes:

determining all resource information flow directions from the resource information updating time corresponding to the running resource information to the resource information packaging time according to the running resource information of the data processing terminal; the resource information flow direction is the information flow direction in which the initial resource information at the resource information updating time is updated to the resource information packaging time through the resource information cache thread of the data processing terminal;

judging whether target resource information flow direction meeting the bidirectional flow condition of communication data exists in all the determined resource information flow directions; if the current target resource information flow direction exists, integrating the target resource information flow direction, extracting at least part of resource information from the running resource information based on the integrated target resource information flow direction, and extracting time information and data information of at least part of resource information to obtain a log file;

and determining a communication data processing form of the data processing terminal according to the communication object information, the communication time information and the communication service information which are included in the log file.

In an alternative embodiment, the determining a communication data processing form of the data processing terminal according to the communication object information, the communication time information and the communication service information included in the log file includes:

and determining the incidence relation among the communication object information, the communication time information and the communication service information included in the log file, building a blank form according to the incidence relation, and importing each piece of communication object information and the corresponding communication time information and communication service information into the blank form based on the incidence relation to obtain the communication data processing form.

In a second aspect of the embodiments of the present invention, there is provided a communication data processing apparatus applied to a data processing terminal, where the data processing terminal and M target terminals form a communication network and communicate with each other, the apparatus including:

the acquisition module is used for acquiring first communication records of the data processing terminal in N continuous time periods and second communication records of each target terminal in the M target terminals in the N continuous time periods; respectively analyzing the first communication record and the M second communication records in each time interval, and determining a first communication parameter of the data processing terminal and a second communication parameter of each target terminal in each time interval, wherein N and M are positive integers;

the network state determining module is used for determining a first communication state and a second communication state of the data processing terminal and the M target terminals in each time period according to the first communication parameters and the M second communication parameters in each time period, and determining a network state of the communication network based on the first communication state and the M second communication states in each time period;

a state vector obtaining module, configured to determine a multidimensional state vector of the communication network in each time period according to a network state of the communication network in each time period of N consecutive time periods, where the multidimensional state vector includes a stability vector, a delay vector, and a packet loss vector;

the clustering module is used for acquiring a log file of the data processing terminal, determining a communication data processing form of the data processing terminal based on the log file, and obtaining a feature vector set according to a plurality of multidimensional state vectors corresponding to the communication network and the communication data processing form; performing K-means clustering on the feature vector set to obtain a target cluster, wherein the target cluster is used for representing a network state change track of the communication network;

the adjusting module is used for carrying out feature analysis on at least part of target vectors included in the target cluster to obtain a network state change track of the communication network; carrying out logic extraction on the communication data processing form to obtain a first data processing track of the communication data processing form; mapping the first data processing track to the network state change track to obtain a second data processing track corresponding to the first data processing track; generating a track adjusting parameter for adjusting the second data processing track based on the track coincidence rate of the second data processing track and the network state change track, mapping the track adjusting parameter to a preset parameter database for searching to obtain a target parameter, and adjusting the working state of the data processing terminal according to the target parameter.

In a third aspect of the embodiments of the present invention, there is provided a data processing terminal, including: a processor and a memory and bus connected to the processor; the processor and the memory are communicated with each other through the bus; the processor is used for calling the computer program in the memory so as to execute the communication data processing method.

In a fourth aspect of the embodiments of the present invention, there is provided a readable storage medium, on which a program is stored, the program implementing the communication data processing method described above when executed by a processor.

The communication data processing method, the communication data processing device and the data processing terminal provided by the embodiment of the invention can analyze the communication records of the data processing terminal and M target terminals in N continuous time periods before the current time, further determine the first communication parameters of the data processing terminal and the second communication parameters of the target terminals, then sequentially determine the network state, the multidimensional state vector and the network state change track of the communication network in each time period based on the first communication parameters and the second communication parameters, and map the obtained first data processing track to the network state change track to obtain the second data processing track. And finally, generating a track adjustment parameter based on the track coincidence rate of the second data processing track and the network state change track so as to realize the adjustment of the working state of the data processing terminal and ensure that the network states of the data processing terminal and the communication network are synchronous and are subjected to self-adaptive adjustment so as to improve the data processing efficiency.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.

Fig. 1 is a schematic diagram of communication connection of a communication data processing system according to an embodiment of the present invention.

Fig. 2 is a flowchart of a communication data processing method according to an embodiment of the present invention.

Fig. 3 is a functional block diagram of a communication data processing apparatus according to an embodiment of the present invention.

Fig. 4 is a schematic diagram of product modules of a data processing terminal according to an embodiment of the present invention.

Icon:

100-a communication data processing system;

200-a data processing terminal; 201-a communication data processing apparatus; 2011-an acquisition module; 2012-network status determination module; 2013-a state vector obtaining module; 2014-clustering module; 2015-adjusting module; 211-a processor; 212-a memory; 213-a bus;

300-target terminal.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

In order to better understand the technical solutions of the present invention, the following detailed descriptions of the technical solutions of the present invention are provided with the accompanying drawings and the specific embodiments, and it should be understood that the specific features in the embodiments and the examples of the present invention are the detailed descriptions of the technical solutions of the present invention, and are not limitations of the technical solutions of the present invention, and the technical features in the embodiments and the examples of the present invention may be combined with each other without conflict.

The data processing terminal comprises a data processing terminal body, a data processing terminal body and a data processing terminal, wherein the data processing terminal body is connected with the data processing terminal body through a network, and the data processing terminal body is connected with the data processing terminal body through a network.

Therefore, the embodiment of the invention provides a communication data processing method, a communication data processing device and a data processing terminal, wherein the data processing terminal can take the network state of a corresponding communication network into account, and further adaptively adjust the working state of the data processing terminal according to the real-time communication network state, so that the processing efficiency of the data processing terminal on communication data is improved.

Referring to fig. 1, a communication connection diagram of a communication data processing system 100 according to an embodiment of the present invention is shown, where the communication data processing system 100 includes a data processing terminal 200 and a plurality of target terminals 300. Wherein the data processing terminal 200 and the plurality of target terminals 300 are communicatively connected to each other to form a communication network.

It is understood that there is interaction of communication data, such as data transceiving and data analysis, between the data processing terminal 200 and the plurality of target terminals 300. Taking the data processing terminal 200 as an example, the data processing terminal 200 attaches to the entire communication network to perform data processing on the data transmission channel provided for the data processing terminal 200.

However, the network status of the communication network may change due to the operation status of some terminals in the communication network or interference of an external network. In this case, the data processing terminal 200 is actually in a communication network that changes in real time. However, the conventional technology cannot make the data processing terminal 200 capture the changes, and further cannot make the data processing terminal 200 adaptively adjust its service processing method according to the real-time network state of the communication network, which may reduce the efficiency of communication data processing of the data processing terminal 200.

In the present embodiment, the communication data processing system 100 can be applied to a plurality of fields, such as the automatic driving field, the remote medical field, and the block chain field, which require the communication data processing system 100 to have low latency and high stability. If the data processing terminal 200 applied to these fields cannot adaptively adjust its own service processing mode according to the real-time network state of the communication network, delay and instability of the data processing terminal 200 may be caused.

In order to improve the above problem, the embodiment of the present invention improves on the data processing terminal 200 side, so that the data processing terminal 200 can adaptively adjust the operating parameters of the data processing terminal 200 itself according to the real-time network state of the communication network to ensure low latency and stability of the data processing terminal 200, and improve the communication data processing efficiency of the data processing terminal 200.

Referring to fig. 2, a flowchart of a communication data processing method according to an embodiment of the present invention is shown, where the method can be applied to the data processing terminal 200 in fig. 1, and can also be applied to any one of the target terminals 300 in fig. 1.

Step S21, acquiring first communication records of the data processing terminal in N continuous time periods and second communication records of each target terminal in M target terminals in N continuous time periods; and respectively analyzing the first communication record and the M second communication records in each time interval, and determining the first communication parameter of the data processing terminal and the second communication parameter of each target terminal in each time interval, wherein N and M are positive integers.

In the present embodiment, the ending time of the continuous period may be the current time, for example, if the current time is t0, the continuous period may be (t0-t1)/N, where t1 is the time before the current time t 0. Further, t1 and N may be determined according to the number of target terminals 300. For example, if the number of the target terminals 300 is larger, t0-t1 is smaller and the value of N is larger, and if the number of the target terminals 300 is smaller, t0-t1 is larger and the value of N is smaller.

In this way, the length and number of the continuous periods can be determined based on the density of the entire communication network, and if the number of the target terminals 300 is greater, the density characterizing the communication network is greater, the timeliness of the communication network and the rate of change of the network state per unit time are higher, in which case, more continuous periods and shorter period durations are required to ensure accurate subsequent analysis of the network state of the communication network.

Step S22, determining the first communication status and the second communication status of the data processing terminal and the M target terminals in each time period according to the first communication parameters and the M second communication parameters in each time period, and determining the network status of the communication network based on the first communication status and the M second communication statuses in each time period.

Step S23, determining a multidimensional state vector of the communication network in each time period according to the network state of the communication network in each time period of N consecutive time periods, where the multidimensional state vector includes a stability vector, a delay vector, and a packet loss vector.

In this embodiment, the multidimensional state vector may be understood as a state matrix of the communication network in each time period, and the number of the state matrices may be N. Further, the stability vector is used to represent communication stability of the communication network, the delay vector is used to represent data transmission delay of the communication network, and the packet loss vector is used to represent packet loss rate of the communication network when transmitting data.

Step S24, acquiring a log file of the data processing terminal, determining a communication data processing form of the data processing terminal based on the log file, and obtaining a feature vector set according to N multi-dimensional state vectors corresponding to the communication network and the communication data processing form; and performing K-means clustering on the feature vector set to obtain a target cluster, wherein the target cluster is used for representing a network state change track of the communication network.

Step S25, performing feature analysis on at least part of target vectors included in the target cluster to obtain a network state change track of the communication network; carrying out logic extraction on the communication data processing form to obtain a first data processing track of the communication data processing form; mapping the first data processing track to the network state change track to obtain a second data processing track corresponding to the first data processing track; generating a track adjusting parameter for adjusting the second data processing track based on the track coincidence rate of the second data processing track and the network state change track, mapping the track adjusting parameter to a preset parameter database for searching to obtain a target parameter, and adjusting the working state of the data processing terminal according to the target parameter.

In this embodiment, the network state change trajectory is used to represent a real-time change trend of the communication network. In a network change track, each time interval corresponds to a network state node, the network state nodes are connected through a directed connecting line, the network state nodes are obtained by weighting according to vector characteristic values corresponding to stability vectors, delay vectors and packet loss vectors of the communication network, and each point on the directed connecting line corresponds to the stability vectors, the delay vectors and the packet loss vectors of the communication network at different moments.

In this embodiment, the track coincidence ratio of the second data processing track and the network state change track is used to represent the efficiency of the data processing terminal 200 in performing communication data processing (including but not limited to data transceiving timeliness and data processing stability), and the higher the track coincidence ratio, the higher the efficiency of the data processing terminal 200 in performing communication data processing.

In the embodiment, the trajectory adjustment parameter is used to adjust the second data processing trajectory to increase the trajectory overlap rate of the second data processing trajectory and the network state change trajectory, since the second data processing trajectory is mapped into the network state change trajectory by the first data processing trajectory, the trajectory adjustment parameter cannot be directly used by the data processing terminal 200, and, for this reason, the trajectory adjustment parameter may be mapped to a preset parameter database to find a target parameter that can be directly used by the target parameter data processing terminal 200, therefore, the data processing terminal 200 adjusts the working state of the data processing terminal 200 according to the target parameter, and ensures that the data processing terminal 200 can synchronize with the network state of the communication network according to the network state change track and perform adaptive adjustment, thereby improving the data processing efficiency of the data processing terminal 200.

It can be understood that based on the above steps S21-S25, the communication records of the data processing terminal and the M target terminals in N consecutive time periods before the current time are analyzed, so as to determine the first communication parameter of the data processing terminal and the second communication parameter of the target terminal, then sequentially determine the network state, the multidimensional state vector, and the network state change trajectory of the communication network in each time period based on the first communication parameter and the second communication parameter, and map the obtained first data processing trajectory to the network state change trajectory to obtain the second data processing trajectory. And finally, generating a track adjustment parameter based on the track coincidence rate of the second data processing track and the network state change track so as to realize the adjustment of the working state of the data processing terminal and ensure that the network states of the data processing terminal and the communication network are synchronous and are subjected to self-adaptive adjustment so as to improve the data processing efficiency.

In an alternative implementation manner, in step S25, the generating a trajectory adjustment parameter for adjusting the second data processing trajectory based on the trajectory coincidence rate of the second data processing trajectory and the network state change trajectory may specifically include the following.

Step S2511, according to the moving state of the second data processing trajectory, controlling the start or stop of the calculation thread of the trajectory coincidence rate between each trajectory node in the second data processing trajectory and the corresponding network state node in the network state change trajectory.

In this embodiment, the moving state includes a first state for indicating that the second data processing trajectory is in the running state and a second state for indicating that the second data processing trajectory is in the suspended state. It is understood that the data processing terminal controls the computing thread to start when the moving state of the second data processing track is the first state, and controls the computing thread to stop when the moving state of the second data processing track is the second state. Thus, the calculation load of the data processing terminal can be effectively reduced.

Step S2512, when the computing thread is controlled to be closed, obtaining a script file before closing the computing thread, where the script file is generated and cached when the computing thread is started, and the script file is updated when the computing thread is closed each time.

Step S2513, when the computing thread is controlled to start, the cached script file is obtained, the computing thread is debugged based on the script file, and the track coincidence rate between each track node and the corresponding network state node is determined according to the debugged computing thread.

In the embodiment, the calculation thread can be debugged based on the cached script file each time the calculation thread is started, so that the accuracy of the track coincidence rate can be ensured.

Step S2514, judging whether the track coincidence rate is lower than a set value or not according to each track coincidence rate; if so, determining a node characteristic array of the network state node corresponding to the track coincidence rate, wherein the node characteristic data is used for representing a first working condition of each target terminal in the network state of the communication network corresponding to the network state node; determining a second working condition of the data processing terminal corresponding to the track node corresponding to the track coincidence rate in the network state of the communication network corresponding to the network state node; determining whether disturbance exists between the data processing terminal and the target terminal under the network state corresponding to the track coincidence rate based on the first working condition and the second working condition; if so, generating a current adjustment parameter of the track node corresponding to the track coincidence rate according to a preset adjustment interval, adjusting the track node corresponding to the track coincidence rate according to the current adjustment parameter, determining the track coincidence rate between the adjusted track node and the corresponding network state node, and returning to the step of judging whether the track coincidence rate is lower than a set value, if the track coincidence rate is not lower than the set value, determining the current adjustment parameter as the track adjustment parameter, and if the track coincidence rate is still lower than the set value, iterating the current adjustment parameter according to the adjustment interval and returning to the step of adjusting the track node corresponding to the track coincidence rate according to the current adjustment parameter.

In this embodiment, the setting value may be adjusted according to a service requirement of the data processing terminal, where the service requirement includes, but is not limited to, data transceiving delay, data transmission drop rate, and data transmission rate.

It can be understood that, through steps S2511 to S2514, the track adjustment parameters can be generated by a gradual iteration method of the adjustment interval, so that the workload of the data processing terminal can be effectively reduced on the premise of accurately determining the track adjustment parameters.

In a specific implementation, device heterogeneity between the data processing terminal and the target terminal needs to be considered when determining the network status of the communication network, and for this reason, in step S22, the determining the network status of the communication network based on the first communication status and the M second communication statuses in each period may specifically include the following.

Step S221, judging whether state information used for representing that the data processing terminal has a state breakpoint exists in the first communication state in each time period, if so, determining the number of intermittent pause states in the M second communication states in the time period, and determining the state description information of the communication network in the time period according to the number and the state information.

Step S222, performing feature extraction on the state description information to obtain a state array corresponding to the state description information, where the state array includes a plurality of state values, and each state value is used to describe a communication state of the communication network in the period.

Step S223, determining whether the communication connection form of the communication network is node connection or non-node connection in the time period according to the state array.

Step S224, determining a communication link stability factor of the communication network in the time period according to the communication connection form, wherein if the communication connection form is the non-node connection, the communication link stability factor of the communication network in the time period is calculated according to the communication protocol of the communication network in the time period and at least part of address pairs included in the communication protocol; if the communication connection form is node connection, determining the node weight of the communication network in the time period according to a communication data coding mode corresponding to the node interface type in the communication network in the time period, and determining the protocol reuse rate of the communication network in the time period according to the protocol pairing result between the data processing terminal and the M target terminals in the time period; and determining the communication link stability coefficient of the communication network in the period according to the node weight and the protocol multiplexing rate of the communication network in the period.

Step S225, judging whether the communication link stability coefficient falls into the communication connection form of the communication link interval corresponding to the communication network in the pre-stored time period; if yes, judging that the data processing terminal and the M target terminals in the time interval have no equipment heterogeneous phenomenon, and weighting a first communication state and M second communication states in the time interval according to the communication link stability coefficient to obtain a network state of the communication network in the time interval; and if not, judging that the data processing terminal and the M target terminals have equipment heterogeneous phenomena in the time period, weighting the M second communication states in the time period according to the communication link stability coefficient to obtain the network state of the communication network in the time period, wherein the network state is represented by a state list.

In the present embodiment, based on steps S221 to S225, it can be determined whether the data processing terminal and the target terminal have device heterogeneous phenomenon in each time period according to the communication link stability factor of the communication network in each time period, so as to determine the network status of the communication network in each time period by adopting different methods according to the determination result. In this way, the device heterogeneous phenomena of the data processing terminal and the target terminal in different time periods can be taken into account, and the accuracy and reliability of the network state of the communication network in each time period can be further ensured.

In a specific implementation, in order to ensure the feature restoration degree of the multidimensional state vector to the communication network, in step S23, the determining the multidimensional state vector of the communication network in each period according to the network state of the communication network in each period of N consecutive periods may specifically include the following.

Step S231, aiming at each time interval, acquiring a resource configuration sequence of the communication network in the time interval and each state list corresponding to the network state; under the condition that a compatible resource region is determined to be contained in the communication network according to the resource configuration sequence, a first corresponding relation between each state list of the communication network under an incompatible resource region and each state list of the communication network under the compatible resource region is determined according to the state list of the communication network under the compatible resource region and the list sequence of the state lists, and the state list of the communication network under the incompatible resource region and the state list under the compatible resource region with an affiliation relation is adjusted to be under the compatible resource region based on the first corresponding relation.

Step S232, judging whether the communication network contains a plurality of state lists in the non-compatible resource area; if yes, determining a second corresponding relation between the state lists of the communication network under the incompatible resource region according to the state lists and the list sequence of the communication network under the compatible resource region, and layering the state lists under the incompatible resource region according to the second corresponding relation between the state lists; and adding a level coefficient to each layer of state list obtained by layering according to the state list of the communication network under the compatible resource region and the list sequence thereof, and adjusting at least a plurality of layers of state lists under the compatible resource region based on the level coefficient corresponding to each layer of state list.

Step S233, determining a correlation coefficient between each state list in all state lists in the compatible resource region and any state list in all state lists except the state list, and performing feature extraction on each state list based on a plurality of correlation coefficients corresponding to each state list in all state lists to obtain a multidimensional state vector of the communication network in the period.

In this embodiment, through steps S231 to S233, a plurality of state lists corresponding to network states of the communication network in each period can be reasonably distributed in the compatible resource region and the incompatible resource region based on the resource configuration sequence, so as to ensure the number of the state lists under the compatible resource region, and when performing feature extraction on the state lists under the compatible resource region, a plurality of association coefficients corresponding to each state list are predetermined, so that the degree of reduction of information in each state list when performing feature extraction on each state list can be ensured, thereby ensuring the degree of reduction of the feature of the communication network by the multidimensional state vector.

In a specific implementation, in order to ensure the accuracy of the network state change trajectory, in step S25, the performing feature analysis on at least part of the target vectors included in the target cluster to obtain the network state change trajectory of the communication network may specifically include the following.

Step S2521, for each vector in the target cluster, determine whether the vector stores a vector identifier for generating a network topology of the communication network, if not, remove the vector from the target cluster, and if so, determine the vector as a target vector.

Step S2522, for at least part of target vectors screened from the target cluster, identifying dimensional features of vector values contained in the at least part of target vectors, and judging whether identifier pairs corresponding to the vector values of the dimensional features are stored in vector identifiers corresponding to the at least part of target vectors; if not, establishing an identification pair of the vector value of the dimensional characteristic in the vector identification corresponding to the at least part of target vectors, and establishing a node connection line list corresponding to the network topology of the identification pair in the at least part of target vectors; if so, judging whether the dimensional characteristics of the vector values contained in the at least part of target vectors are the same as preset characteristics, if so, updating a node connecting line list corresponding to the network topology of the identifier pair in the at least part of target vectors aiming at the identifier pair corresponding to the vector values of the dimensional characteristics, and if not, establishing a node connecting line list corresponding to the network topology of the at least part of target vectors containing the dimensional characteristics in the identifier pair of the vector values of the dimensional characteristics.

Step S2523, extracting node information and connection information in the node connection list, and generating a network state change trajectory of the communication network according to the node information and the connection information.

It can be understood that, through steps S2521 to S2523, vectors in the target cluster can be filtered to ensure that the target vectors hold vector identifiers of the network topology of the communication network, and then different node connection lists are generated under different conditions based on the dimensional features of the vector values included in the target vectors and the vector identifiers corresponding to the target vectors. Therefore, the network state change track of the communication network can be generated based on the node information and the connection information in the node connection list, so that the accuracy of the network state change track is ensured.

In practical applications, the adjusting the operating state of the data processing terminal according to the target parameter may specifically include the following.

Step S2531, determining the adjustment step length and the critical value of each type of parameter according to the adjustment trend information of each type of parameter in the target parameter.

Step S2532, determining adjusting factors for adjusting the critical values of various parameters according to the global weight of various parameters and the residual memory of the data processing terminal; the adjustment factors are determined by global adjustment factors and local adjustment factors of various parameters, the global adjustment factors are obtained through a residual memory of the data processing terminal, and the local adjustment factors are obtained through a used memory of the data processing terminal.

And S2534, performing iterative adjustment on various parameters according to the adjustment step length, the critical value and the adjustment factor of the various parameters, determining whether a state evaluation factor corresponding to a target working state obtained based on the various parameters after the iterative adjustment of the data processing terminal falls into a preset evaluation interval or not based on the result of the iterative adjustment, if so, judging that the adjustment of the working state of the data processing terminal is completed, and if not, returning to the step of performing iterative adjustment on the various parameters according to the adjustment step length, the critical value and the adjustment factor of the various parameters.

In this embodiment, through the above, the working state of the data processing terminal can be iteratively adjusted, and it can be determined whether the data processing terminal after adjusting the working state can normally operate based on the evaluation interval by taking the actual working condition of the data processing terminal into consideration, if the state evaluation factor falls into the evaluation interval, it represents that the data processing terminal in the target working state can normally operate, and if the state evaluation factor does not fall into the evaluation interval, it represents that the data processing terminal in the target working state cannot normally operate, and then the working state of the data processing terminal continues to be iteratively adjusted. In this way, stable and progressive adjustment of the operating state of the data processing terminal can be ensured.

Alternatively, in order to accurately acquire the communication data processing form, in step S24, the acquiring a log file of the data processing terminal and determining the communication data processing form of the data processing terminal based on the log file may specifically include the following steps.

Step S241, according to the running resource information of the data processing terminal, determining all resource information flow directions from the resource information updating time corresponding to the running resource information to the resource information packaging time; the resource information flow direction is the information flow direction in which the initial resource information at the resource information updating time is updated to the resource information packaging time through the resource information cache thread of the data processing terminal.

Step S242, determining whether there is a target resource information flow direction satisfying the bidirectional flow condition of the communication data in all the determined resource information flow directions; and if the current target resource information flow direction exists, integrating the target resource information flow direction, extracting at least part of resource information from the running resource information based on the integrated target resource information flow direction, and extracting time information and data information of at least part of resource information to obtain a log file.

Step S243, determining a communication data processing form of the data processing terminal according to the communication object information, the communication time information, and the communication service information included in the log file.

By the aid of the method, the log file can be accurately extracted based on the running resource information of the data processing terminal, and then the communication data processing form is determined according to the log file. Because the log file is extracted from the running resource information based on the integrated target resource information flow, the log file comprises the interaction information of the data processing terminal and other terminals, so that the data processing performed by the data processing terminal on the local side can be filtered, the communication data processing form is generated by interacting with other terminals, and the accuracy of the communication data processing form is further ensured.

Optionally, the determining a communication data processing form of the data processing terminal according to the communication object information, the communication time information, and the communication service information included in the log file specifically includes: and determining the incidence relation among the communication object information, the communication time information and the communication service information included in the log file, building a blank form according to the incidence relation, and importing each piece of communication object information and the corresponding communication time information and communication service information into the blank form based on the incidence relation to obtain the communication data processing form. In this way, the one-to-one correspondence relationship among the communication object information, the communication time information and the communication service information in the communication data processing form can be ensured, and the traceability of the communication data processing form can be further ensured.

On the basis of the above, please refer to fig. 3, which is a block diagram of a communication data processing apparatus 201 according to an embodiment of the present invention, wherein the communication data processing apparatus 201 may include the following modules.

An obtaining module 2011, configured to obtain first communication records of the data processing terminal in N consecutive time periods and second communication records of each of the M target terminals in the N consecutive time periods; and respectively analyzing the first communication record and the M second communication records in each time interval, and determining the first communication parameter of the data processing terminal and the second communication parameter of each target terminal in each time interval, wherein N and M are positive integers.

The network status determining module 2012 is configured to determine, according to the first communication parameter and the M second communication parameters in each time period, a first communication status and a second communication status of the data processing terminal and the M target terminals in each time period, and determine a network status of the communication network based on the first communication status and the M second communication statuses in each time period.

A state vector obtaining module 2013, configured to determine, according to a network state of the communication network in each of N consecutive time periods, a multidimensional state vector of the communication network in each time period, where the multidimensional state vector includes a stability vector, a delay vector, and a packet loss vector.

A clustering module 2014, configured to obtain a log file of the data processing terminal, determine a communication data processing form of the data processing terminal based on the log file, and obtain a feature vector set according to the N multidimensional state vectors corresponding to the communication network and the communication data processing form; and performing K-means clustering on the feature vector set to obtain a target cluster, wherein the target cluster is used for representing a network state change track of the communication network.

An adjusting module 2015, configured to perform feature analysis on at least part of the target vectors included in the target cluster to obtain a network state change trajectory of the communication network; carrying out logic extraction on the communication data processing form to obtain a first data processing track of the communication data processing form; mapping the first data processing track to the network state change track to obtain a second data processing track corresponding to the first data processing track; generating a track adjusting parameter for adjusting the second data processing track based on the track coincidence rate of the second data processing track and the network state change track, mapping the track adjusting parameter to a preset parameter database for searching to obtain a target parameter, and adjusting the working state of the data processing terminal according to the target parameter.

An embodiment of the present invention further provides a readable storage medium, on which a program is stored, and the program, when executed by a processor, implements the communication data processing method described above.

The embodiment of the invention also provides a processor, wherein the processor is used for running the program, and the communication data processing method is executed when the program runs.

In this embodiment, as shown in fig. 4, the data processing terminal 200 includes at least one processor 211, and at least one memory 212 and a bus 213 connected to the processor 211. The processor 211 and the memory 212 are in communication with each other via a bus 213. The processor 211 is used to call program instructions in the memory 212 to execute the above-mentioned communication data processing method.

To sum up, the communication data processing method, the communication data processing device, and the data processing terminal provided in the embodiments of the present invention can analyze communication records of the data processing terminal and M target terminals in N consecutive time periods before a current time, further determine a first communication parameter of the data processing terminal and a second communication parameter of the target terminal, then sequentially determine a network state, a multidimensional state vector, and a network state change trajectory of a communication network in each time period based on the first communication parameter and the second communication parameter, and map the obtained first data processing trajectory to the network state change trajectory to obtain a second data processing trajectory. And finally, generating a track adjustment parameter based on the track coincidence rate of the second data processing track and the network state change track so as to realize the adjustment of the working state of the data processing terminal and ensure that the network states of the data processing terminal and the communication network are synchronous and are subjected to self-adaptive adjustment so as to improve the data processing efficiency.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, cloud data processing terminals (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing cloud data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing cloud data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a cloud data processing terminal includes one or more processors (CPUs), memory, and a bus. The cloud data processing terminal may further include an input/output interface, a network interface, and the like.

The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip. The memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), random access memory with other feature weights (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage cloud data processing terminals, or any other non-transmission medium that can be used to store information that can be matched by a computing cloud data processing terminal. As defined herein, computer readable media does not include transitory computer readable media such as modulated data signals and carrier waves.

It should be further noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or cloud data processing terminal that comprises a list of elements does not include only those elements but also other elements not expressly listed or inherent to such process, method, article, or cloud data processing terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of additional like elements in a process, method, article of manufacture, or cloud data processing terminal that comprises the element.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A communication data processing method applied to a data processing terminal, the data processing terminal and M target terminals forming a communication network and communicating with each other, the method comprising:

2. The method of claim 1, wherein determining the network status of the communication network based on the first communication status and the M second communication statuses in each period comprises:

3. The method of claim 2, wherein determining the multidimensional state vector for the communication network for each time period based on the network state of the communication network for each of the N consecutive time periods comprises:

4. The method according to claim 1, wherein the performing feature analysis on at least part of the target vectors included in the target cluster to obtain a network state change trajectory of the communication network comprises:

5. The method according to any one of claims 1 to 4, wherein the adjusting the operating state of the data processing terminal according to the target parameter comprises:

6. The method according to claim 1, wherein the obtaining a log file of the data processing terminal and the determining a communication data processing form of the data processing terminal based on the log file comprises:

7. The method according to claim 6, wherein the determining a communication data processing form of the data processing terminal according to the communication object information, the communication time information and the communication service information included in the log file comprises:

8. A communication data processing apparatus applied to a data processing terminal which forms a communication network with M target terminals and communicates with each other, the apparatus comprising:

9. A data processing terminal, comprising: a processor and a memory and bus connected to the processor; the processor and the memory are communicated with each other through the bus; the processor is configured to call a computer program in the memory to execute the communication data processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that a program is stored thereon, which when executed by a processor implements the communication data processing method of any of the above claims 1-7.