CN118075358A - Communication data transmission processing system based on general artificial intelligence - Google Patents

Communication data transmission processing system based on general artificial intelligence Download PDF

Info

Publication number
CN118075358A
CN118075358A CN202410458632.6A CN202410458632A CN118075358A CN 118075358 A CN118075358 A CN 118075358A CN 202410458632 A CN202410458632 A CN 202410458632A CN 118075358 A CN118075358 A CN 118075358A
Authority
CN
China
Prior art keywords
transmission
mode
data
ratio
setting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202410458632.6A
Other languages
Chinese (zh)
Other versions
CN118075358B (en
Inventor
赵然
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nantong Cosine Intelligence Technology Co ltd
Original Assignee
Nantong Cosine Intelligence Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nantong Cosine Intelligence Technology Co ltd filed Critical Nantong Cosine Intelligence Technology Co ltd
Priority to CN202410458632.6A priority Critical patent/CN118075358B/en
Publication of CN118075358A publication Critical patent/CN118075358A/en
Application granted granted Critical
Publication of CN118075358B publication Critical patent/CN118075358B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Communication Control (AREA)

Abstract

The invention belongs to the technical field of data transmission processing, and particularly discloses a communication data transmission processing system based on general artificial intelligence, which comprises the following components: the system comprises a transmission information extraction module, a device information extraction module, a transmission assessment confirmation module, a transmission information base and a transmission feedback control terminal. According to the invention, through setting each transmission mode and combining the network state, the application state and the storage state of the transmission end to analyze and transmit feasibility and transmit optimization analysis, the adaptive transmission mode and the adaptive transmission setting are confirmed, the problem of high probability of data loss in the current data transmission mode is effectively solved, the availability and reliability of the corresponding received data of the receiving end are ensured, the efficiency of data transmission and the integrity and the analysis accuracy of the transmitted data are ensured on the premise of reducing the error rate of data transmission, the practical limit of the current transmission scene is broken, and the complexity of transmission is reduced.

Description

Communication data transmission processing system based on general artificial intelligence
Technical Field
The invention belongs to the technical field of data transmission processing, and relates to a communication data transmission processing system based on general artificial intelligence.
Background
Communication data transmission processing refers to a process of transmitting information from one location to another, and covers the whole process from data generation to reception. In order to ensure the stability and efficiency of communication data transmission, the transmission process needs to be processed.
The communication data transmission processing relates to the processes of data segmentation, compression, encryption, decryption and the like, and particularly when the communication data transmission efficiency is improved, the current common data segmentation and compression mode is used for processing, and the following problems also exist: 1. the probability of data loss is greater: when huge communication data volume is needed, high compression or multiple data segmentation is needed, the probability of data loss and error is increased, the availability and reliability of the data received by a receiving end cannot be guaranteed, meanwhile, the relevance between original data is lost due to the excessive segmentation, and the integrity of the data and the accuracy of analysis can be influenced particularly when the relevance exists between data of cross-segmentation.
2. Applicability limitations: some compression algorithms may be only suitable for data of a specific type or format, while for other types of data the effect is poor, the compression algorithms need to be switched between different types of data, increasing complexity and management cost, while the speed of compression and decompression is slow, which may cause problems in the context of real-time data transmission, and some compression algorithms and excessive segmentation may have security holes, which may increase the risk of data leakage or tampering.
3. The resource consumption is large: compression and decompression of data may require significant computational resources and, during segmentation, may require handling of segment boundaries to ensure that the segmented data is correctly restored to original data, which may introduce additional complexity and computational overhead.
Disclosure of Invention
In view of this, in order to solve the problems set forth in the background art, a communication data transmission processing system based on general artificial intelligence is now proposed.
The aim of the invention can be achieved by the following technical scheme: the invention provides a communication data transmission processing system based on general artificial intelligence, which comprises: and the transmission information extraction module is used for recording the current communication data to be transmitted as data K, extracting the number of transmission bytes, the transmission content form and setting a transmission protocol of the data K.
The device information extraction module is used for extracting state information of a transmission end corresponding to the data K, and comprises network state information, application state information and storage state information.
The transmission assessment confirmation module is used for assessing the adaptive transmission mode and the adaptive transmission setting of the data K, and comprises the following steps: s1, setting a transmission mode: setting each transmission mode, namely compression transmission, segmentation transmission, equipment storage release transmission and combination transmission in sequence.
S2, transmission feasibility analysis: and analyzing the feasibility of each transmission mode.
S3, transmission optimization analysis: and (3) marking the transmission modes with the feasibility degree larger than 0 as feasible modes, and analyzing the transmission optimization ratio of each feasible mode.
S4, confirming a transmission mode: and taking the feasible mode with the maximum transmission optimization ratio as an adaptive transmission mode of the data K.
S5, transmitting a setting confirmation: confirming the adaptation transmission setting.
The transmission information base is used for storing the reference compression time length and decompression time length of the unit compression rate, storing the segmentation time length and the reassembly time length corresponding to the sizes of the data segments, storing the reference lossless compression rate and the reference transmission time length of the transmission contents of each form under the number of transmission bytes, storing the reference transmission time length of the sizes of the data segments under the transmission rate of each network, and storing the number of the limited transmission data packets of each transmission protocol.
And the transmission feedback control terminal is used for feeding back the adaptive transmission mode to the transmission control terminal and performing transmission control.
Preferably, the analyzing the feasibility of each transmission mode includes: each transmission scheme is labeled as scheme a, scheme B, scheme C, and scheme D in order.
When the transmission mode is mode A, extracting the reference lossless compression ratio and the reference transmission time length of the data K from the transmission information base according to the number of transmission bytes and the transmission content of the data K, and respectively recording asAnd/>
The number of transmission bytes of the data K is recorded asWill/>The feasibility of embodiment A is expressed as/>
When the transmission mode is mode B, the number of the data segments required to be divided is confirmed and recorded asExtracting the number of the transmission data packets of which the transmission protocol is correspondingly set by the data K from the transmission information base, and recording the number as/>Will/>The feasibility of embodiment B is expressed as/>,/>The number of segments is different for setting the reference divided data.
When the transmission mode is mode C, the number of non-communication transmission applications which are currently opened and the number of storage bytes, the storage position and the number of cache bytes of each non-communication transmission application are extracted from the application state information, and meanwhile, the rated memory byte number, the rated cache byte number, the current memory occupancy rate and the current cache occupancy rate of a transmission end are extracted from the storage state information, so that the transmission rate lifting rate of storage release is counted according to the number of non-communication transmission applications which are currently opened and the number of storage bytes, the storage position and the number of cache bytes of each non-communication transmission application are extracted, and the transmission rate lifting rate is recorded asWill/>The feasibility of embodiment C is expressed as/>The transmission rate for the reference is set to an effective ramp-up ratio.
When the transmission mode is mode D, confirming the corresponding transmission efficiency improvement ratio under each combination type, screening the maximum value from the transmission efficiency improvement ratio, and marking the maximum value asAccording to/>The feasibility of the obtained mode D is checked in the same way as the check mode of (a), and is expressed as/>
Preferably, the determining the number of required split data segments includes: and extracting the network transmission rate of each monitoring time point from the network state information, and obtaining the average network transmission rate through average value calculation.
Positioning the reference transmission time length of each data segment size and the corresponding segment time length of each data segment size under the average network transmission rate from the transmission information base, and respectively marking asAnd/>,/>Representing data segment number,/>
The size of each data segment is recorded asStatistics of segmentation effectiveness/>, of each data segment size,/>To set the reference time difference,/>To round the symbol up.
The data segment size with the maximum segmentation effectiveness is recorded asWill/>The number of data segments is split as a requirement.
Preferably, the transmission rate improvement ratio of the statistical storage release includes: recording each open non-communication transmission application as each additional application, and setting the storage release influence tendency based on the storage byte number and the storage position of each additional applicationAnd respectively marking the current memory occupancy ratio and the current buffer occupancy ratio of the transmission end as/>And/>
Summing the number of storage bytes and the number of cache bytes of each additional application to obtain the number of comprehensive storage bytesAnd comprehensive cache byte number/>
Will be、/>、/>、/>、/>Introducing the transmission rate improvement evaluation model, and outputting the transmission rate improvement ratio/>, of the storage releaseThe specific expression formula of the transmission rate improvement evaluation model is as follows: wherein/> For each evaluation condition,/>Representation/>And/>,/>Representation/>And/>,/>Representation/>And/>,/>Representation/>And/>,/>、/>Respectively, the transmission influence memory occupation ratio, the transmission influence buffer occupation ratio are set、/>Respectively setting the transmission rate lifting ratio of the number of the released bytes of the unit memory under the memory occupied interference and the memory unoccupied interference,/>、/>Transmission rate improvement ratio of unit buffer release byte number under set buffer occupied interference and buffer unoccupied interference respectively,/>And the memory release transmission rate lifting ratio corresponding to the unit memory release influence trend under the set memory release influence is set.
Preferably, the setting stores a release influence tendency, including: counting the number of additional applications stored in the storage location as the local and remote servers of the device, comparing the number with the number of additional applications currently opened, and recording the ratio as
Summing the number of storage bytes of each additional application stored at the location of the device local and remote servers, andMaking a comparison, and recording the ratio as/>And will/>As a memory release impact trend/>
Preferably, the analyzing the transmission optimization ratio of each feasible mode includes: when the feasible mode is mode AThe reference compression ratio as data K is denoted as/>Extracting the reference compression duration/>, which is used for extracting the unit compression multiplying power, from the transmission information baseDecompression duration/>
Based on the network transmission rate of each monitoring time point, confirming the network transmission interference durationThe average network transmission rate is noted as/>And will/>As the transmission optimization ratio of mode a.
When the feasible mode is mode B, willAs the size of the reference divided data segment of the data K, the segment duration and the reorganization duration corresponding to the size of the reference divided data segment are respectively recorded as/>, and are positioned from a transmission information baseAnd/>And then willAs the transmission optimization ratio of mode B.
When the feasible mode is mode C, the transmission rate of the memory release is improved by the ratioAs the transmission optimization ratio of mode C.
When the feasible mode is mode D, the maximum value of the corresponding transmission efficiency improvement ratio under each combination typeAs the transmission optimization ratio of mode D.
Preferably, the confirming the network transmission interference duration includes: constructing a network transmission rate change curve by taking the monitoring time point as an abscissa and the network transmission rate as an ordinate, and positioning the peak point number from the network transmission rate change curveSum valley point number/>And simultaneously, the network transmission rate difference between each peak point and the adjacent valley point is positioned.
The average value of the network transmission rate difference between each amplitude point and the adjacent valley point is calculated, and the calculation result is recorded asSimultaneously, the maximum network transmission rate difference/> isscreened out
Counting network transmission interference time,/>,/>To set the number of reference peaks and valleys,/>Respectively setting the network transmission rate difference and the network fluctuation rate difference deviation of the reference,/>The set unit fluctuation corresponds to the reference transmission interference duration.
Preferably, the confirming the adapting transmission setting includes: when the adaptive transmission mode is mode A, the transmission compression ratio is used as the transmission setting, and the adaptive transmission compression ratio is calculated,/>And will/>As an adapted transmission setting,/>And the reference transmission time length of the corresponding data segment size under the transmission compression ratio is adapted.
When the adaptive transmission mode is mode B, taking the number of transmission segmentation data segments as transmission setting, and calculating the number of the adaptive transmission segmentation data segments,/>Will/>As an adaptive transmission setting,/>And/>Segment duration and reassembly duration under the number of adapted transmission segmented data segments, respectively,/>The reference transmission duration for the number of segmented data segments for adapting transmission at the average network transmission rate.
And when the transmission adaptation mode is mode C, taking the closed application as transmission setting, confirming each closed application, and taking the closed application as adaptation transmission setting.
And when the transmission adaptation mode is mode D, taking the combination type and the combination information under the combination type as transmission setting, confirming the adaptation combination type and the combination information under the adaptation combination type, and taking the combination information as adaptation transmission setting.
Preferably, the adaptive combining type is a combining type with the maximum transmission efficiency improvement ratio.
Preferably, the confirming each closing application includes: extracting maximum value and minimum value from network transmission rate of each monitoring time point respectively, making difference between them, recording the difference value as reference network transmission rate difference, and making matching comparison with the optimized reference release memory ratio correspondent to the set every network transmission rate difference to obtain the optimized reference release memory ratio of reference network transmission rate difference, recording as
And ordering the additional applications according to the storage release influence tendencies of the additional applications from large to small, and numbering the additional applications according to the ordering order.
The ratio of the number of the cache bytes of each additional application to the rated number of the cache bytes is taken as a cache ratio and is recorded asRepresenting additional application number,/>
If it isRank as front/>Additional applications of bits as respective shutdown applications,/>For/>The cache ratio of the additional applications.
Compared with the prior art, the invention has the following beneficial effects: (1) According to the invention, through setting each transmission mode and combining the network state, the application state and the storage state of the transmission end to analyze and transmit feasibility and transmit optimization analysis, the adaptive transmission mode and the adaptive transmission setting are confirmed, the problem of high probability of data loss in the current data transmission mode is effectively solved, the availability and reliability of the corresponding received data of the receiving end are ensured, the efficiency of data transmission and the integrity and the analysis accuracy of the transmitted data are ensured on the premise of reducing the error rate of data transmission, the practical limit of the current transmission scene is broken, the complexity and the management cost of transmission are reduced, the leakage risk and the falsification risk in the data transmission process are reduced, the data transmission effect is ensured, and the calculation resource and the calculation cost of data transmission are also reduced on the other level.
(2) In the invention, during the transmission feasibility analysis, the enforceable conditions of each transmission mode are intuitively displayed by carrying out targeted one-by-one analysis according to the transmission characteristics of each transmission mode, and a data base is set for the selection of the subsequent adaptive transmission mode.
(3) When the transmission optimization analysis is carried out, the invention facilitates the provision of a more comprehensive and comprehensive optimization scheme for the subsequent transmission by carrying out detailed analysis on the transmission efficiency improvement conditions of various transmission modes, thereby leading the subsequent transmission mode to have larger corresponding transmission efficiency improvement potential, leading the subsequent transmission scheme to be more suitable for different transmission scenes, having better sustainability and further improving the reliability and stability of the subsequent data transmission.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of the connection of the modules of the system of the present invention.
FIG. 2 is a schematic diagram of a process for transmitting assessment confirmation of an assessment confirmation module according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, the present invention provides a communication data transmission processing system based on general artificial intelligence, which includes: the system comprises a transmission information extraction module, a device information extraction module, a transmission assessment confirmation module, a transmission information base and a transmission feedback control terminal.
The transmission assessment confirmation module is respectively connected with the transmission information extraction module, the equipment information extraction module, the transmission information base and the transmission feedback control terminal.
The transmission information extraction module is used for recording the current communication data to be transmitted as data K, extracting the number of transmission bytes, the transmission content form and setting a transmission protocol of the data K.
The device information extraction module is used for extracting state information of a transmission end corresponding to the data K, and comprises network state information, application state information and storage state information.
The network state information comprises, but is not limited to, network transmission rates at each monitoring time point, the application state information comprises, but is not limited to, the number of currently opened non-communication transmission applications, and the number of storage bytes, storage positions and cache bytes of each opened non-communication transmission application, and the storage state information comprises, but is not limited to, the rated memory byte number, the rated cache byte number, the current memory occupancy rate and the current cache occupancy rate of a transmission end.
Referring to fig. 2, the transmission assessment confirmation module is configured to assess an adaptive transmission mode and an adaptive transmission setting of data K, and includes: s1, setting a transmission mode: setting each transmission mode, namely compression transmission, segmentation transmission, equipment storage release transmission and combination transmission in sequence.
S2, transmission feasibility analysis: and analyzing the feasibility of each transmission mode.
Illustratively, analyzing the feasibility of each transmission mode includes: s21, each transmission mode is marked as a mode A, a mode B, a mode C and a mode D in sequence.
S22, when the transmission mode is mode A, extracting the reference lossless compression ratio and the reference transmission time length of the data K from the transmission information base according to the number of transmission bytes and the transmission content of the data K, and respectively recording asAnd/>
S23, recording the transmission byte number of the data K asWill/>The feasibility of embodiment A is expressed as/>
S24, when the transmission mode is mode B, confirming the number of the required divided data segments, and recording asExtracting the number of the transmission data packets of which the transmission protocol is correspondingly set by the data K from the transmission information base, and recording the number as/>Will/>The feasibility of embodiment B is expressed as/>,/>The number of segments is different for setting the reference divided data.
In one embodiment, the data is divided into a plurality of data segments, each data segment corresponds to a data packet, and different transmission protocols have different data packet formats and regulations, and some protocols may limit the number of data packets, so that the data packets need to be segmented according to the protocol requirements, that is, the determination of the number of data packets is closely related to the use of the transmission protocol.
S25, when the transmission mode is mode C, extracting the number of currently opened non-communication transmission applications and the number of storage bytes, storage positions and cache bytes of each opened non-communication transmission application from the application state information, and simultaneously extracting the rated memory byte number, the rated cache byte number, the current memory occupancy rate and the current cache occupancy rate of the transmission end from the storage state information, and counting the transmission rate lifting rate of storage release according to the number of the rated memory bytes, the rated cache byte number, the current memory occupancy rate and the current cache occupancy rate, wherein the transmission rate lifting rate is recorded asWill/>The feasibility of embodiment C is expressed as/>,/>The transmission rate for the reference is set to an effective ramp-up ratio.
S26, when the transmission mode is mode D, confirming the corresponding transmission efficiency improvement ratio under each combination type, screening the maximum value from the transmission efficiency improvement ratio, and marking the maximum value asAccording to/>The feasibility of the obtained mode D is checked in the same way as the check mode of (a), and is expressed as/>
Further, the step S24 of confirming the number of the required split data segments includes: and X1, extracting the network transmission rate of each monitoring time point from the network state information, and obtaining the average network transmission rate through average value calculation.
X2, locating the reference transmission time length of each data segment size and the corresponding segment time length of each data segment size under the average network transmission rate from the transmission information base, and respectively recording asAnd/>,/>Representing data segment number,/>
It should be noted that, the data segments are numbered according to the corresponding size sequence of the data segments, where the data segments are numbered for convenience in selecting the sizes of the data segments, and in a specific embodiment,The value is a positive integer greater than 1.
X3, the size of each data segment is recorded asStatistics of segmentation effectiveness/>, of each data segment size,/>To set the reference time difference,/>To round the symbol up.
X4, recording the data segment size with the maximum segmentation effectiveness asWill/>The number of data segments is split as a requirement.
Further, in step S25, counting the transmission rate improvement ratio of the memory release, including: q1, recording each open non-communication transmission application as each additional application, and setting the storage release influence trend degree based on the storage byte number and the storage position of each additional applicationAnd respectively marking the current memory occupancy ratio and the current buffer occupancy ratio of the transmission end as/>And/>
Understandably, setting the storage release influence tendencies includes: q11, counting the number of additional applications of which the storage positions are the local and remote servers of the device, comparing the number of the additional applications with the number of the additional applications which are opened currently, and recording the ratio as
Q12 summing the number of storage bytes of each additional application stored at the location of the device local and remote servers, andMaking a comparison, and recording the ratio as/>And will/>As a storage release impact trend
Q2, respectively summing the storage byte number and the buffer byte number of each additional application to obtain the comprehensive storage byte numberAnd comprehensive cache byte number/>
Q3, will、/>、/>、/>、/>Introducing the transmission rate improvement evaluation model, and outputting the transmission rate improvement ratio/>, of the storage releaseThe specific expression formula of the transmission rate improvement evaluation model is as follows: wherein/> For each of the evaluation conditions,Representation/>And/>,/>Representation/>And/>,/>Representation/>And is also provided with,/>Representation/>And/>,/>、/>Respectively, the transmission influence memory occupation ratio, the transmission influence buffer occupation ratio are set、/>Respectively setting the transmission rate lifting ratio of the number of the released bytes of the unit memory under the memory occupied interference and the memory unoccupied interference,/>、/>Transmission rate improvement ratio of unit buffer release byte number under set buffer occupied interference and buffer unoccupied interference respectively,/>And the memory release transmission rate lifting ratio corresponding to the unit memory release influence trend under the set memory release influence is set.
Further, in step S26, each combination type is sequentially a mode a+mode B, a mode a+mode C, a mode b+mode C, and a mode a+mode b+mode C, where the confirmation modes of the transmission efficiency improvement ratios corresponding to the mode a+mode C and the mode b+mode C are the same, and further the specific confirmation process of the corresponding transmission efficiency improvement ratios under each combination type is as follows: 1) The combination type is mode a+mode B: the first step: setting upReference compression ratio for data K/>The average network transmission rate is noted as/>Extracting the reference compression duration/>, which is used for extracting the unit compression multiplying power, from the transmission information baseDecompression duration/>And then willThe data transmission duration of scheme A is denoted as/>
Second step, settingFor the reference divided data segment size of the data K, locating the segment duration/>, corresponding to the transmission of the single data segment, of the reference divided data segment size from the transmission information baseAnd recombination duration/>And then willThe data transmission duration as scheme B is denoted/>
Thirdly, estimating and obtaining the number of the target segmentation data segments through a segmentation compression combination estimation modelAnd target compression ratio/>The ratio of the number of transmission bytes of the data K to the number of target segmentation data segments is used as the size of the reference segmentation data segments, and the segmentation duration/>, corresponding to the size of the reference segmentation data segments, is positioned from a transmission information baseAnd recombination duration/>
Fourth, the reference transmission time length of the transmission content form corresponding to the data K under the single transmission byte number is positioned from the transmission information base by taking the reference divided data segment size X (1-target compression multiplying power) as the single transmission byte number, and is recorded asAnd will/>The data transmission time length of the mode A+mode B is recorded as
Fifth step, willAs a corresponding transmission efficiency improvement ratio in the mode a+mode B combination type, wherein/>To perform the minimum value calculation.
2) When the combination type is mode A+mode C or mode B+mode C, the transmission rate of the memory release is improved by the ratioAs the transmission efficiency improvement ratio corresponding to the mode a+mode C combination type or the mode b+mode C combination type.
3) When the combination type is mode A+mode B+mode C, the combination type is mode A+mode B+mode CAs a corresponding transmission efficiency improvement ratio in the mode a+mode b+mode C combination type.
It should be added that the specific evaluation mode of the segment compression combination evaluation model in the third step is as follows: w1, reference lossless compression ratio of data KFor the upper limit compression multiplying power, the number/>, of the transmission data packets limited by the transmission protocol is correspondingly set by the data KThe number of data segments is partitioned for an upper limit.
W2, setting a plurality of test compression multiplying factors and a plurality of test division data segment numbers according to the set compression multiplying factor interval and the set division data segment number interval, randomly combining the plurality of test division segment numbers and the plurality of test compression multiplying factors to generate a plurality of segmentation compression combination types, recording the test compression multiplying factors and the test division data segment numbers under each segmentation compression combination type, and respectively recording asAnd/>,/>The segment compression combination type number is represented,
In one embodiment of the present invention, in one embodiment,Is a positive integer greater than 1.
W3, taking the ratio of the number of transmission bytes of the data K to the number of test segmentation data segments under each segmentation compression combination type as the size of the unit segmentation data segments of each segmentation compression combination type, and further taking the size X (1-the test compression multiplying power of each segmentation compression combination type) of the unit segmentation data segments corresponding to each segmentation compression combination type as the number of single transmission bytes under each segmentation compression combination type.
W4, locating the reference transmission time length of the single transmission byte number of the transmission content form corresponding to the data K under each sectional compression combination type from the transmission information base, and marking asMeanwhile, the segment duration/>, corresponding to the size of the unit segmentation data segment under each segment compression combination type, is positioned from the transmission information baseAnd recombination duration/>
W5 is to、/>、/>、/>、/>、/>、/>And/>As an output of the segment compression combination evaluation model, taking the recommended priority as an output of the segment compression combination evaluation model, wherein the concrete expression formula of the segment compression combination evaluation model is as follows: /(I),/>Represents the/>Recommendation priority for individual segment compression combination types.
And W6, taking the test compression ratio and the number of the test segmentation data segments under the segmentation compression combination type with the maximum recommended priority as the target compression ratio and the number of the target segmentation data segments respectively.
In the embodiment of the invention, when the transmission feasibility is analyzed, the enforceable conditions of the transmission modes are intuitively displayed by carrying out targeted one-by-one analysis according to the transmission characteristics of the transmission modes, and a data base is set for the selection of the subsequent adaptive transmission modes.
S3, transmission optimization analysis: and (3) marking the transmission modes with the feasibility degree larger than 0 as feasible modes, and analyzing the transmission optimization ratio of each feasible mode.
Illustratively, analyzing the transmission optimization ratio of each feasible manner includes: s31, when the feasible mode is mode A, settingReference compression ratio for data K/>
S32, confirming network transmission interference duration based on network transmission rate of each monitoring time pointAnd then willAs the transmission optimization ratio of mode a.
S33, when the feasible mode is mode B, settingSegmenting the data segment size for reference of data K, willAs the transmission optimization ratio of mode B.
S34, when the feasible mode is mode C, the transmission rate of the memory release is improved by a ratioAs the transmission optimization ratio of mode C.
S35, when the feasible mode is mode D, the maximum value of the corresponding transmission efficiency improvement ratio under each combination type is calculatedAs the transmission optimization ratio of mode D.
Further, in step S32, confirming the network transmission interference duration includes: l1, constructing a network transmission rate change curve by taking a monitoring time point as an abscissa and a network transmission rate as an ordinate, and positioning the number of peak points from the network transmission rate change curveSum valley point number/>And simultaneously, the network transmission rate difference between each peak point and the adjacent valley point is positioned.
L2, carrying out average value calculation on the network transmission rate difference between each amplitude point and the adjacent valley point, and recording the calculation result asSimultaneously, the maximum network transmission rate difference/> isscreened out
L3, counting network transmission interference time length,/>,/>To set the number of reference peaks and valleys,/>Respectively setting the network transmission rate difference and the network fluctuation rate difference deviation of the reference,/>The set unit fluctuation corresponds to the reference transmission interference duration.
When the transmission optimization analysis is carried out, the embodiment of the invention facilitates providing a more comprehensive and comprehensive optimization scheme for the follow-up by carrying out detailed analysis on the transmission efficiency improvement condition of various transmission modes, so that the follow-up transmission mode has larger corresponding transmission efficiency improvement potential, the follow-up transmission scheme is more suitable for different transmission scenes, the sustainability is better, and the reliability and the stability of the follow-up data transmission are further improved.
S4, confirming a transmission mode: and taking the feasible mode with the maximum transmission optimization ratio as an adaptive transmission mode of the data K.
S5, transmitting a setting confirmation: confirming the adaptation transmission setting.
Illustratively, validating the adapted transmission setting includes: s51, when the adaptive transmission mode is mode A, taking the transmission compression ratio as the transmission setting, and calculating the adaptive transmission compression ratio,/>And will/>As an adapted transmission setting,/>And the reference transmission time length of the corresponding data segment size under the transmission compression ratio is adapted.
S52, when the adaptive transmission mode is mode B, taking the number of the transmission segmentation data segments as the transmission setting, and calculating the number of the adaptive transmission segmentation data segments,/>Will/>As an adaptive transmission setting,/>And/>Segment duration and reassembly duration under the number of adapted transmission segmented data segments, respectively,/>The reference transmission duration for the number of segmented data segments for adapting transmission at the average network transmission rate.
And S53, when the transmission adaptation mode is mode C, the closed applications are used as transmission settings, and each closed application is confirmed and used as an adaptation transmission setting.
S54, when the transmission adaptation mode is mode D, taking the combination type and the combination information under the combination type as transmission setting, confirming the adaptation combination type and the combination information under the adaptation combination type, and taking the combination information as adaptation transmission setting.
It is to be added that the method comprises the steps of,To adapt the size of the data segment at the transmission compression ratio.
It is also necessary to supplement the fact that,And/>/>The method is obtained by positioning from a transmission information base, and the specific positioning process is as follows: will/>The method comprises the steps of locating the segmentation duration and the reassembly duration corresponding to the actual segmentation data segment size from a transmission information base as the actual segmentation data segment size, locating the actual transmission data segment size under the average network transmission rate from the transmission information base according to the actual transmission data segment size and serving as the reference transmission duration under the number of the adaptive transmission segmentation data segments under the average network transmission rate.
Further, confirming each closing application in step S53 includes: y1, respectively extracting a maximum value and a minimum value from the network transmission rates of all monitoring time points, making a difference between the maximum value and the minimum value, marking the difference as a reference network transmission rate difference, matching and comparing the reference network transmission rate difference with the set optimized reference release memory ratio corresponding to each network transmission rate difference to obtain an optimized reference release memory ratio of the reference network transmission rate difference, and marking the optimized reference release memory ratio as
And Y2, sequencing the additional applications according to the storage release influence tendencies of the additional applications from large to small, and numbering the additional applications according to the sequencing order.
Y3, taking the ratio of the number of the cache bytes of each additional application to the rated number of the cache bytes as a cache ratio, and recording as,/>Representing additional application number,/>
In one embodiment of the present invention, in one embodiment,Is a positive integer greater than 1.
Y4, ifRank as front/>The additional application of bits serves as each shutdown application,For/>Cache ratio of additional applications,/>
Further, the adapting combination type in the step S54 is a combination type with the maximum transmission efficiency improvement ratio, and the specific confirmation process of the corresponding combination information under the adapting combination type in the step S54 includes: and step 1, when the adaptive combination type is a mode A+a mode B, estimating and obtaining the number of the target segmentation data segments and the target compression multiplying power through a segmentation compression combination estimation model, and taking the number of the target segmentation data segments and the target compression multiplying power as combination information under the adaptive combination type of the mode A+the mode B.
And 2, when the adaptive combination type is the mode A+the mode C, closing each additional application and combining transmission setting of which the adaptive transmission mode is the mode A, and taking the combination setting as combination information under the adaptive combination type of the mode A+the mode C.
And 3, when the adaptive combination type is the mode B+the mode C, closing each additional application, combining the transmission setting of which the adaptive transmission mode is the mode B, and taking the combination information as the combination information under the adaptive combination type of the mode B+the mode C.
And 4, when the adaptive combination type is the mode A+mode B+mode C, closing each additional application and using the combination information under the mode A+mode B adaptive combination type as the combination information under the mode A+mode B+mode C adaptive combination type.
The transmission information base is used for storing the reference compression time length and decompression time length of the unit compression rate, storing the segmentation time length and the reassembly time length corresponding to the sizes of the data segments, storing the reference lossless compression rate and the reference transmission time length of the transmission contents of each form under the number of transmission bytes, storing the reference transmission time length of the sizes of the data segments under the transmission rate of each network, and storing the number of the limited transmission data packets of each transmission protocol.
The transmission feedback control terminal is used for feeding back the adaptive transmission mode to the transmission control terminal and performing transmission control.
According to the embodiment of the invention, the transmission modes are set, and the network state, the application state and the storage state of the transmission end are combined to perform analysis and transmission feasibility analysis and transmission optimization analysis, so that the adaptive transmission mode and the adaptive transmission setting are confirmed, the problem of high probability of data loss in the current data transmission mode is effectively solved, the availability and reliability of the corresponding received data of the receiving end are ensured, the efficiency of data transmission and the integrity and analysis accuracy of the transmitted data are ensured on the premise of reducing the error rate of data transmission, the practical limit of the current transmission scene is broken, the complexity and the management cost of transmission are reduced, the leakage risk and the falsification risk in the data transmission process are reduced, the data transmission effect is ensured, and the calculation resource and the calculation cost of data transmission are also reduced on the other level.
The foregoing is merely illustrative and explanatory of the principles of this invention, as various modifications and additions may be made to the specific embodiments described, or similar arrangements may be substituted by those skilled in the art, without departing from the principles of this invention or beyond the scope of this invention as defined in the claims.

Claims (10)

1. A communication data transmission processing system based on general artificial intelligence is characterized in that: the system comprises:
The transmission information extraction module is used for recording the current communication data to be transmitted as data K, extracting the number of transmission bytes of the data K, the transmission content form and setting a transmission protocol;
the device information extraction module is used for extracting state information of a transmission end corresponding to the data K, and comprises network state information, application state information and storage state information;
The transmission assessment confirmation module is used for assessing the adaptive transmission mode and the adaptive transmission setting of the data K, and comprises the following steps:
S1, setting a transmission mode: setting each transmission mode, namely compression transmission, segmentation transmission, equipment storage release transmission and combination transmission in sequence;
S2, transmission feasibility analysis: the feasibility of each transmission mode is analyzed;
s3, transmission optimization analysis: the transmission mode with the feasibility degree larger than 0 is marked as a feasible mode, and the transmission optimization ratio of each feasible mode is analyzed;
s4, confirming a transmission mode: taking the feasible mode with the maximum transmission optimization ratio as an adaptive transmission mode of the data K;
S5, transmitting a setting confirmation: confirming an adaptive transmission setting;
The transmission information base is used for storing the reference compression time length and decompression time length of the unit compression rate, storing the segmentation time length and the reassembly time length corresponding to the sizes of the data segments, storing the reference lossless compression rate and the reference transmission time length of the transmission contents of each form under the number of transmission bytes, storing the reference transmission time length of the sizes of the data segments under the transmission rate of each network, and storing the number of the limited transmission data packets of each transmission protocol;
and the transmission feedback control terminal is used for feeding back the adaptive transmission mode to the transmission control terminal and performing transmission control.
2. A universal artificial intelligence based communication data transmission processing system as claimed in claim 1, wherein: the analyzing the feasibility of each transmission mode comprises the following steps:
Marking each transmission mode as a mode A, a mode B, a mode C and a mode D in sequence;
When the transmission mode is mode A, extracting the reference lossless compression ratio and the reference transmission time length of the data K from the transmission information base according to the number of transmission bytes and the transmission content of the data K, and respectively recording as And/>
The number of transmission bytes of the data K is recorded asWill/>The feasibility of embodiment A is expressed as/>
When the transmission mode is mode B, the number of the data segments required to be divided is confirmed and recorded asExtracting the number of the transmission data packets of which the transmission protocol is correspondingly set by the data K from the transmission information base, and recording the number as/>Will/>The feasibility of embodiment B is expressed as/>,/>Setting a reference segment number difference;
When the transmission mode is mode C, the number of non-communication transmission applications which are currently opened and the number of storage bytes, the storage position and the number of cache bytes of each non-communication transmission application are extracted from the application state information, and meanwhile, the rated memory byte number, the rated cache byte number, the current memory occupancy rate and the current cache occupancy rate of a transmission end are extracted from the storage state information, so that the transmission rate lifting rate of storage release is counted according to the number of non-communication transmission applications which are currently opened and the number of storage bytes, the storage position and the number of cache bytes of each non-communication transmission application are extracted, and the transmission rate lifting rate is recorded as Will/>The feasibility of embodiment C is expressed as/>,/>An effective lifting ratio for setting a reference transmission rate;
When the transmission mode is mode D, confirming the corresponding transmission efficiency improvement ratio under each combination type, screening the maximum value from the transmission efficiency improvement ratio, and marking the maximum value as According to/>The feasibility of the obtained mode D is checked in the same way as the check mode of (a), and is expressed as/>
3. A universal artificial intelligence based communication data transmission processing system as claimed in claim 2, wherein: the identifying the number of demand-split data segments includes:
extracting network transmission rates of all monitoring time points from the network state information, and obtaining an average network transmission rate through average value calculation;
Positioning the reference transmission time length of each data segment size and the corresponding segment time length of each data segment size under the average network transmission rate from the transmission information base, and respectively marking as And/>,/>Representing data segment number,/>
The size of each data segment is recorded asStatistics of segmentation effectiveness/>, of each data segment size,/>To set the reference time difference,/>Rounding up the symbol;
the data segment size with the maximum segmentation effectiveness is recorded as Will/>The number of data segments is split as a requirement.
4. A communication data transmission processing system based on general artificial intelligence as claimed in claim 3, wherein: the transmission rate boost ratio of the statistical storage release comprises:
Recording each open non-communication transmission application as each additional application, and setting the storage release influence tendency based on the storage byte number and the storage position of each additional application And respectively marking the current memory occupancy ratio and the current buffer occupancy ratio of the transmission end as/>And/>
Summing the number of storage bytes and the number of cache bytes of each additional application to obtain the number of comprehensive storage bytesAnd comprehensive cache byte number/>
Will be、/>、/>、/>、/>Introducing the transmission rate improvement evaluation model, and outputting the transmission rate improvement ratio/>, of the storage releaseThe specific expression formula of the transmission rate improvement evaluation model is as follows:
wherein/> For each evaluation condition,/>Representation/>And/>,/>Representation/>And/>,/>Representation/>And/>,/>Representation/>And/>,/>、/>Respectively, the transmission influence memory occupation ratio, the transmission influence buffer occupation ratio are set、/>Respectively setting the transmission rate lifting ratio of the number of the released bytes of the unit memory under the memory occupied interference and the memory unoccupied interference,/>、/>Transmission rate improvement ratio of unit buffer release byte number under set buffer occupied interference and buffer unoccupied interference respectively,/>And the memory release transmission rate lifting ratio corresponding to the unit memory release influence trend under the set memory release influence is set.
5. A universal artificial intelligence based communication data transmission processing system as claimed in claim 4, wherein: the setting of the release influence tendencies includes:
counting the number of additional applications stored in the storage location as the local and remote servers of the device, comparing the number with the number of additional applications currently opened, and recording the ratio as
Summing the number of storage bytes of each additional application stored at the location of the device local and remote servers, andMaking a comparison, and recording the ratio as/>And will/>As a memory release impact trend/>
6. A universal artificial intelligence based communication data transmission processing system as claimed in claim 4, wherein: the analysis of the transmission optimization ratio of each feasible mode comprises the following steps:
When the feasible mode is mode A The reference compression ratio as data K is denoted as/>Extracting the reference compression duration/>, which is used for extracting the unit compression multiplying power, from the transmission information baseDecompression duration/>
Based on the network transmission rate of each monitoring time point, confirming the network transmission interference durationThe average network transmission rate is noted as/>And will/>As a transmission optimization ratio of mode a;
When the feasible mode is mode B, will As the size of the reference divided data segment of the data K, the segment duration and the reorganization duration corresponding to the size of the reference divided data segment are respectively recorded as/>, and are positioned from a transmission information baseAnd/>And then willAs a transmission optimization ratio of mode B;
When the feasible mode is mode C, the transmission rate of the memory release is improved by the ratio As a transmission optimization ratio of mode C;
When the feasible mode is mode D, the maximum value of the corresponding transmission efficiency improvement ratio under each combination type As the transmission optimization ratio of mode D.
7. A universal artificial intelligence based communication data transmission processing system as claimed in claim 6, wherein: the confirming the network transmission interference duration comprises the following steps:
Constructing a network transmission rate change curve by taking the monitoring time point as an abscissa and the network transmission rate as an ordinate, and positioning the peak point number from the network transmission rate change curve Sum valley point number/>Simultaneously, network transmission speed difference between each peak point and adjacent valley points is positioned;
the average value of the network transmission rate difference between each amplitude point and the adjacent valley point is calculated, and the calculation result is recorded as Simultaneously, the maximum network transmission rate difference/> isscreened out
Counting network transmission interference time,/>,/>To set the number of reference peaks and valleys,/>Respectively setting the network transmission rate difference and the network fluctuation rate difference deviation of the reference,/>The set unit fluctuation corresponds to the reference transmission interference duration.
8. A universal artificial intelligence based communication data transmission processing system as claimed in claim 6, wherein: the confirmation adaptation transmission setting comprises:
When the adaptive transmission mode is mode A, the transmission compression ratio is used as the transmission setting, and the adaptive transmission compression ratio is calculated And will/>As an adapted transmission setting,/>The method comprises the steps of adapting the reference transmission time length of the corresponding data segment size under the transmission compression multiplying power;
When the adaptive transmission mode is mode B, taking the number of transmission segmentation data segments as transmission setting, and calculating the number of the adaptive transmission segmentation data segments ,/>Will/>As an adaptive transmission setting,/>And/>Segment duration and reassembly duration under the number of adapted transmission segmented data segments, respectively,/>The method comprises the steps of adapting transmission of a reference transmission duration under the number of divided data segments under the average network transmission rate;
When the transmission adaptation mode is mode C, the closed application is used as transmission setting, each closed application is confirmed, and the closed application is used as adaptation transmission setting;
And when the transmission adaptation mode is mode D, taking the combination type and the combination information under the combination type as transmission setting, confirming the adaptation combination type and the combination information under the adaptation combination type, and taking the combination information as adaptation transmission setting.
9. A universal artificial intelligence based communication data transmission processing system as claimed in claim 8, wherein: the adaptive combination type is the combination type with the maximum transmission efficiency improvement ratio.
10. A universal artificial intelligence based communication data transmission processing system as claimed in claim 8, wherein: the confirming each closing application comprises:
Extracting maximum value and minimum value from network transmission rate of each monitoring time point respectively, making difference between them, recording the difference value as reference network transmission rate difference, and making matching comparison with the optimized reference release memory ratio correspondent to the set every network transmission rate difference to obtain the optimized reference release memory ratio of reference network transmission rate difference, recording as
Sequencing the additional applications according to the storage release influence tendencies of the additional applications from large to small, and numbering the additional applications according to the sequencing order;
the ratio of the number of the cache bytes of each additional application to the rated number of the cache bytes is taken as a cache ratio and is recorded as ,/>Representing additional application number,/>
If it isRank as front/>The additional application of bits serves as each shutdown application,For/>The cache ratio of the additional applications.
CN202410458632.6A 2024-04-17 2024-04-17 Communication data transmission processing system based on general artificial intelligence Active CN118075358B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410458632.6A CN118075358B (en) 2024-04-17 2024-04-17 Communication data transmission processing system based on general artificial intelligence

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202410458632.6A CN118075358B (en) 2024-04-17 2024-04-17 Communication data transmission processing system based on general artificial intelligence

Publications (2)

Publication Number Publication Date
CN118075358A true CN118075358A (en) 2024-05-24
CN118075358B CN118075358B (en) 2024-06-28

Family

ID=91095701

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202410458632.6A Active CN118075358B (en) 2024-04-17 2024-04-17 Communication data transmission processing system based on general artificial intelligence

Country Status (1)

Country Link
CN (1) CN118075358B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110035469A (en) * 2018-01-12 2019-07-19 电信科学技术研究院有限公司 Data transmission method, transmission device, base station and the terminal of wireless backhaul network
WO2021208843A1 (en) * 2020-04-13 2021-10-21 中兴通讯股份有限公司 Segment routing header compression method and apparatus and service processing method and apparatus
CN115174075A (en) * 2022-07-22 2022-10-11 武汉卓诺世环电子商务有限公司 Data transmission method, data transmission equipment and computer storage medium
CN116881372A (en) * 2023-09-08 2023-10-13 清华大学 Water meter metering big data optimization processing method and system based on Internet of things
CN117560458A (en) * 2023-11-27 2024-02-13 江苏普旭科技股份有限公司 Video synchronization control method and device based on airborne TSN network and computer readable medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110035469A (en) * 2018-01-12 2019-07-19 电信科学技术研究院有限公司 Data transmission method, transmission device, base station and the terminal of wireless backhaul network
WO2021208843A1 (en) * 2020-04-13 2021-10-21 中兴通讯股份有限公司 Segment routing header compression method and apparatus and service processing method and apparatus
CN115174075A (en) * 2022-07-22 2022-10-11 武汉卓诺世环电子商务有限公司 Data transmission method, data transmission equipment and computer storage medium
CN116881372A (en) * 2023-09-08 2023-10-13 清华大学 Water meter metering big data optimization processing method and system based on Internet of things
CN117560458A (en) * 2023-11-27 2024-02-13 江苏普旭科技股份有限公司 Video synchronization control method and device based on airborne TSN network and computer readable medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
GUANGYU LI等: "An Effective MEC Sustained Charging Data Transmission Algorithm in VANET-Based Smart Grids", IEEE, 27 May 2020 (2020-05-27) *
米叶赛尔·阿不都克依木: "广播电视信号传输中光纤传输技术的运用", 信息:技术与应用, vol. 22, no. 9, 30 September 2021 (2021-09-30) *
马鸿洋等: "基于循环码和信息压缩融合的量子保密通信算法", 通信学报, no. 03, 25 March 2020 (2020-03-25) *

Also Published As

Publication number Publication date
CN118075358B (en) 2024-06-28

Similar Documents

Publication Publication Date Title
CN112087334B (en) Alarm root cause analysis method, electronic device and storage medium
CN111970353A (en) Data processing method and device for heterogeneous equipment in Internet of things of cloud computing platform
CN115037700B (en) Complex network data packet transmission method, system, terminal and storage medium
US20220303198A1 (en) Method and apparatus for detecting anomaly of traffic of internet of things device based on automata
CN108200387A (en) A kind of transmission method of file, system and camera
CN111953670A (en) Self-adaptive confusion method and system based on Meek transmission plug-in and computer storage medium
CN118075358B (en) Communication data transmission processing system based on general artificial intelligence
CN111225077B (en) Network distribution method, device and system for Internet of things equipment
CN111935767A (en) Network simulation system
CN114039955B (en) Communication safety monitoring system based on artificial intelligence
CN114337942B (en) Message retransmission method and device and electronic equipment
CN104038307A (en) Data stream transmission system and method
CN113783780B (en) IEEE802.11 packet loss statistics and traffic prediction method, system and terminal
CN112637055B (en) Multi-link aggregation method, system and storage medium based on VPN tunnel
CN112751567B (en) Compression method for transient wave recording interaction data of power system
CN114661555A (en) Equipment monitoring method, device, server and storage medium
CN114157716A (en) Data processing method and device based on block chain and electronic equipment
CN117857649B (en) Transmission method and system for transmission control protocol data packet
CN114726891A (en) Video transmission reporting method based on Internet of things
CN115474220B (en) Network fault diagnosis method, device, equipment and medium based on big data
CN114707606B (en) Data processing method and device based on federal learning, equipment and storage medium
CN113453043B (en) Video scheduling optimization method and device, computer equipment and storage medium
CN116707863B (en) High-capacity data transmission management and control system
CN116112203B (en) Risk model-based network communication risk prediction method and device
CN115103000B (en) Method for restoring and analyzing business session of railway data network based on NetStream

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant