CN114978425A - Remote measuring data elastic transmission method, device, electronic equipment and storage medium - Google Patents
Remote measuring data elastic transmission method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN114978425A CN114978425A CN202210532326.3A CN202210532326A CN114978425A CN 114978425 A CN114978425 A CN 114978425A CN 202210532326 A CN202210532326 A CN 202210532326A CN 114978425 A CN114978425 A CN 114978425A
- Authority
- CN
- China
- Prior art keywords
- data
- data frame
- compressed
- bytes
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 76
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000003860 storage Methods 0.000 title claims abstract description 20
- 238000007906 compression Methods 0.000 claims description 51
- 230000006835 compression Effects 0.000 claims description 51
- 238000012545 processing Methods 0.000 claims description 28
- 238000004590 computer program Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 abstract description 27
- 230000008859 change Effects 0.000 abstract description 7
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000005457 optimization Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 13
- 230000006837 decompression Effects 0.000 description 11
- 230000008569 process Effects 0.000 description 9
- 238000009792 diffusion process Methods 0.000 description 7
- 238000004422 calculation algorithm Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000011084 recovery Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 239000002699 waste material Substances 0.000 description 3
- 238000013144 data compression Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000005242 forging Methods 0.000 description 1
- 230000002068 genetic effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012966 insertion method Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
- H04L1/0009—Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the channel coding
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
The application relates to the technical field of communication, in particular to a telemetry data elastic transmission method, a device, electronic equipment and a computer readable storage medium, wherein the method comprises the following steps: acquiring telemetering data to be transmitted; compressing repeated bytes of at least one data frame in the telemetry data, and generating a new data frame according to the residual uncompressed bytes and the corresponding position in the at least one data frame; and generating compressed telemetering data according to the new data frame and the uncompressed data frame, and sending the compressed telemetering data to a receiving end, so that the receiving end decompresses the compressed telemetering data to obtain telemetering data. Therefore, the problems that the telemetry parameters change slowly and the satellite telemetry data has high redundancy characteristic and the like caused by the newly increased information amount in each change in the related technology are solved.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to a method and an apparatus for flexibly transmitting telemetry data, an electronic device, and a storage medium.
Background
The telemetering data is an important representation of the on-orbit running state of the satellite and has the characteristics of multiple parameter types, different change characteristics, periodic acquisition and the like. Meanwhile, most of the telemetry parameters change slowly, and the newly increased information amount is limited in each change, so that the satellite telemetry data has a high redundancy characteristic.
The high reliability of the satellite telemetry data transmission link is critical to success or failure of the satellite mission, while the high redundancy of telemetry data provides the possibility for flexible transmission of telemetry data. Under the condition of limited transmission bandwidth, in order to eliminate the waste of data transmission and processing cost and ensure the level margin of a communication link, the transmission rate of the telemetric data is reduced, so that the telemetric data needs to be compressed and elastically transmitted.
In the aspect of telemetry data compression, lossless compression is generally adopted, and comprises Huffman coding, run-length coding, arithmetic coding, LZ series coding and the like. In recent years, scholars at home and abroad also compress telemetered data by using clustering, machine learning and other modes and combining the characteristics of the telemetered data, and the existing algorithm has two defects, namely, the difficulty of one-step compression improvement on the compression ratio without loss is high, and error diffusion is easily caused, so that the telemetered data compression mode needs to be improved by combining the two points.
In the related art, the elastic transmission mode of the telemetering data has defects, and an improved elastic transmission method of the telemetering data needs to be found.
Disclosure of Invention
The application provides a method and a device for flexibly transmitting telemetering data, electronic equipment and a computer readable storage medium, which effectively improve the flexible transmission efficiency, prevent error code diffusion in the flexible transmission process and achieve the purposes of ensuring the level margin of a communication link and saving communication resources under the condition of limited transmission bandwidth.
The embodiment of the first aspect of the application provides a telemetry data elastic transmission method, which comprises the following steps: acquiring telemetering data to be transmitted; compressing repeated bytes of at least one data frame in the telemetry data, and generating a new data frame according to the residual uncompressed bytes and the corresponding position in the at least one data frame; and generating compressed telemetering data according to the new data frame and the uncompressed data frame, and sending the compressed telemetering data to a receiving end, so that the receiving end decompresses the compressed telemetering data to obtain the telemetering data.
In an embodiment of the present application, the compressing the repeated bytes of at least one data frame in the telemetry data and generating a new data frame according to the remaining uncompressed bytes and the corresponding positions in the at least one data frame includes: identifying at least one reference data frame and a data frame to be compressed in the telemetry data according to a target compression interval; discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, identifying the positions of the residual bytes in the data frame to be compressed, and forming the new data frame according to the residual bytes and the corresponding positions.
In this embodiment of the present application, before discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, the method further includes: judging whether the total length of the repeated bytes is greater than a discarding length; if the total length of the repeated bytes is larger than the discarding length, discarding the repeated bytes, otherwise, not compressing the data frame to be compressed.
In this embodiment of the present application, before discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, the method further includes: judging whether the data of the data frame to be compressed is the same as the data of the at least one reference data frame; if the length of the repeated bytes is equal to the length of the discarded data frame, discarding the data frame to be compressed, and recording the frame header of the data frame to be compressed, otherwise, judging whether the total length of the repeated bytes is greater than the discarded length.
In this embodiment, before sending the compressed telemetry data to the receiving end, the method further includes: and carrying out format processing on the compressed telemetry data according to an identification code so that the compressed telemetry data meets a target transmission condition, wherein the identification code is used for identifying the byte length of each data frame.
The embodiment of the second aspect of the application provides a telemetering data elastic transmission device, which comprises: the acquisition module is used for acquiring telemetering data to be transmitted; the compression module is used for compressing repeated bytes of at least one data frame in the telemetry data and generating a new data frame according to the residual uncompressed bytes and the corresponding position in the at least one data frame; and the transmission module is used for generating compressed telemetering data according to the new data frame and the uncompressed data frame and sending the compressed telemetering data to a receiving end, so that the receiving end decompresses the compressed telemetering data to obtain the telemetering data.
In an embodiment of the present application, the compression module is configured to: identifying at least one reference data frame and a data frame to be compressed in the telemetry data according to a target compression interval; discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, identifying the positions of the residual bytes in the data frame to be compressed, and forming the new data frame according to the residual bytes and the corresponding positions.
In the embodiment of the present application, the method further includes: a first judging module, configured to judge whether a total length of a repetition byte is greater than a discard length before discarding the repetition byte of the data frame to be compressed and the at least one reference data frame; if the total length of the repeated bytes is larger than the discarding length, discarding the repeated bytes, otherwise, not compressing the data frame to be compressed.
In the embodiment of the present application, the method further includes: a second determining module, configured to determine whether data of the data frame to be compressed and the at least one reference data frame are the same before discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame; if the length of the repeated bytes is equal to the length of the discarded data frame, discarding the data frame to be compressed, and recording the frame header of the data frame to be compressed, otherwise, judging whether the total length of the repeated bytes is greater than the discarded length.
In the embodiment of the present application, the method further includes: and the processing module is used for carrying out format processing on the compressed telemetering data according to the identification code before sending the compressed telemetering data to a receiving end so that the compressed telemetering data meets a target transmission condition, wherein the identification code is used for identifying the byte length of each data frame.
An embodiment of a third aspect of the present application provides an electronic device, including: the device comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the telemetry data elastic transmission method according to the embodiment.
A fourth aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the program is executed by a processor, and is used to implement the telemetry data elastic transmission method according to the foregoing embodiments.
Therefore, the application has at least the following beneficial effects:
the method comprises the steps of compressing a telemetered data frame as a unit, comprehensively considering a plurality of expected targets such as compression rate, identification line occupation proportion, error synchronization probability, frame loss rate and the like, establishing a multi-target optimization model, obtaining optimal compression and data processing interval parameters meeting constraint conditions, compressing highly redundant satellite telemetered data, and performing elastic transmission on the satellite telemetered data, ensuring the level allowance of a communication link, effectively improving the elastic transmission efficiency, compressing the telemetered data without depending on the physical characteristics of the telemetered data and expert experience, preventing error code diffusion in the elastic transmission process, and achieving the purposes of ensuring the level allowance of the communication link and saving communication resources under the condition of limited transmission bandwidth.
Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a flow chart of a method for flexibly transmitting telemetry data according to an embodiment of the present application;
FIG. 2 is a diagram of a certain satellite adjacent telemetry data frame format and data composition provided in accordance with an embodiment of the present application;
fig. 3 is a graph illustrating a variation trend of n indicating a byte number ratio occupied by a row according to an embodiment of the present disclosure;
FIG. 4 is a graph of a variation trend (logarithm) of a mis-synchronization probability with n according to an embodiment of the present application;
FIG. 5 is a graph illustrating a trend of a data correct rate with n according to an embodiment of the present disclosure;
FIG. 6 is a flow chart illustrating a flexible transmission of telemetry data according to an embodiment of the present application;
FIG. 7 is a diagram illustrating an example of telemetry data flexible transmission results provided in accordance with an embodiment of the present application;
FIG. 8 is an exemplary diagram of a telemetry data elastomeric transfer device provided in accordance with an embodiment of the present application;
fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
In the related technology, the satellite telemetry parameters are various, the data generation rate is high, the total amount of data is huge, huge pressure is brought to channel transmission with limited bandwidth and limited storage media, in order to guarantee the level allowance of a communication link and eliminate the waste of data transmission and processing cost, the telemetry data needs to be compressed and elastically transmitted, and the high redundancy characteristic of the satellite telemetry data provides feasibility for the elastic transmission of the telemetry data. Therefore, the embodiment of the application provides an elastic compression processing and transmission scheme of the telemetry data based on the local characteristics of the satellite telemetry data, namely, provides an elastic transmission method and device of the telemetry data, electronic equipment and a computer readable storage medium.
A telemetry data elastic transmission method, apparatus, electronic device and computer-readable storage medium according to embodiments of the present application will be described below with reference to the accompanying drawings. Specifically, fig. 1 is a schematic flowchart of a method for flexibly transmitting telemetry data according to an embodiment of the present disclosure.
As shown in fig. 1, the telemetry data elastic transmission method comprises the following steps:
in step S101, telemetry data to be transmitted is acquired.
In step S102, the repeated bytes of at least one data frame in the telemetry data are compressed, and a new data frame is generated according to the remaining uncompressed bytes and corresponding positions in the at least one data frame.
It can be understood that the method can compress and process the telemetering data frame in real time, can perform characteristic analysis on telemetering quantity according to the telemetering data frame format, compresses the telemetering data frame in units of telemetering data frames, reorganizes the telemetering data frame, retains changed bytes, discards unchanged bytes, and records the positions and contents of the changed bytes in a storage area in a mode of 'position + data', so that error diffusion can be limited within two bytes, and transmission error diffusion is effectively inhibited.
For the example of fig. 2, the first and second frames of telemetry data are shown within dashed boxes, with light squares representing changes to the corresponding data of the first and second frames and dark squares representing no changes to the corresponding data of the first and second frames. That is, light squares represent valid data and gray squares represent redundant data. The grey squares need only be recorded once, only the light squares need be of interest.
In an embodiment of the present application, compressing repeated bytes of at least one data frame in the telemetry data and generating a new data frame based on remaining uncompressed bytes and corresponding locations in the at least one data frame comprises: identifying at least one reference data frame and a data frame to be compressed in the telemetry data according to the target compression interval; discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, identifying the positions of the residual bytes in the data frame to be compressed, and forming a new data frame according to the residual bytes and the corresponding positions.
It can be understood that the embodiment of the application can compress the telemetered data frame as a unit, comprehensively considers a plurality of expected targets such as compression rate, identification line occupation proportion, error synchronization probability, frame loss rate and the like, establishes a multi-objective optimization model, and obtains the optimal compression and data processing interval parameter which accords with the constraint condition, thereby providing the compression and processing interval based on the multi-objective optimization condition and effectively improving the elastic transmission efficiency.
In this embodiment of the present application, before discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, the method further includes: judging whether the data of the data frame to be compressed is the same as the data of at least one reference data frame; if the data frames are the same, discarding the data frames to be compressed, and recording the frame headers of the data frames to be compressed, otherwise, judging whether the total length of the repeated bytes is greater than the discarding length; if the total length of the repeated bytes is larger than the discarding length, discarding the repeated bytes, otherwise, not compressing the data frame to be compressed.
It can be understood that, in the embodiment of the present application, when data in an updated telemetry data frame changes, a frame header of the updated telemetry data frame may be recorded in a storage area to record the position of the frame header, so that the frame header may be retained during compression to identify the position of the telemetry frame; if the data in the updated telemetry data frame changes and the changed data length is small, the data is recorded in a mode of 'position + data', and when the changed data length is large, the operation is not carried out, and the whole updated telemetry data frame is completely recorded in a storage area.
For example, for a set of telemetry data a x b (a frames, b bytes per frame), each k a Compressing the frame once to get the 1 st, k th a +1，2k a +1，.......，i*k a +1(i，k a ∈N + ) Storing frame telemetering data in a buffer, comparing the frame telemetering data with an adjacent telemetering data frame in the buffer after receiving an updated telemetering data frame, and recording a frame header of the updated telemetering data frame in a storage area to record the position of the frame telemetering data frame if the data in the updated telemetering data frame is not changed; if the data in the updated telemetry data frame changes and the length of the changed data is smaller than 1/2 of the length of the telemetry data frame, discarding the unchanged bytes and recording the position and the content of the changed bytes in a storage area in a mode of 'position + data'; if the data in the updated telemetry data frame changes but the length of the changed data is not less than 1/2 the length of the telemetry data frame is not operated and the entire updated telemetry data frame is fully recorded in the storage area. Downloading data in a storage area to the groundAnd the station repeats the steps until all the telemetering data are processed. Thus, the compressed telemetry data is a x (frames a, number of bytes per frame x), where x ≦ b.
When compression is performed, the compression rate when the packetization compression method is not used is CR, that is, k is a When a is the actual compression ratio CR, the compression effect is the best. In order to reduce the loss caused by frame loss, a packet compression method is adopted to select a certain compression interval k a Then, the compression ratio is obtained
It can be seen that the compression ratio of telemetry data is k a Increase and decrease of value, in actual engineering, k a Is derived from the desired compression ratio R com And (6) determining.
In step S103, compressed telemetry data is generated according to the new data frame and the uncompressed data frame, and the compressed telemetry data is sent to the receiving end, so that the receiving end decompresses the compressed telemetry data to obtain telemetry data.
In this embodiment of the present application, before sending the compressed telemetry data to the receiving end, the method further includes: format processing is carried out on the compressed telemetering data according to an identification code so that the compressed telemetering data meets target transmission conditions, wherein the identification code is used for identifying the byte length of each data frame
It can be understood that, in order to meet the requirement of the telemetry data transmission format, format processing needs to be carried out on compressed data, and optimal compression and processing parameters under the condition of multi-objective optimization are selected. After the compressed and processed telemetering data is transmitted through a channel, data format recovery is carried out at a receiving end through an identification code, and then decompression is carried out by taking a telemetering data packet as a unit, so that the whole telemetering data elastic transmission process is completed. By the telemetry data elastic transmission method, highly redundant satellite telemetry data can be compressed and elastically transmitted, and the level allowance of a communication link is guaranteed.
In particular, data processing, data recovery, and telemetry data decompression are described below, with the following details:
1. data processing
The number of bytes of each frame of the telemetry data after packet compression is different, which does not meet the requirement of the telemetry data transmission format, and the format of the telemetry data needs to be processed by utilizing an identification code, and the method comprises the following steps: for a set of telemetry data m k a *p(m*k a Frame, byte number of each frame is p), firstly judging byte number of each frame, then every n x k a Inserting an identification code of code length l followed by the number of bytes per frame as an identification line (1 st, k th) a +1，2k a +1，......，i*k a +1(i，k a ∈N + ) The frame is not compressed and its byte count is uploaded only once), and telemetry data transmission is performed. The purpose of introducing the identification code is to achieve frame synchronization by inserting a special code group, usually using a coherent insertion method, so the selection of the identification code has the following requirements:
1) the identification code is easy to generate and recognize and is distinguished from the data symbol;
2) the length of the identification code needs to be considered comprehensively, the communication efficiency of the system is reduced when the length is too long, and the error synchronization probability is increased when the length is too short.
By combining the above requirements, the frame synchronization code with the advantages of easy recognition, small error probability, etc. can be selected as the identification code. Meanwhile, for telemetry data frames that are not encoded or that employ convolutional encoding, the frame synchronization code may be set to 1ACFFC1D, which may be used directly as the identification code.
In data processing, the value of n influences the elastic transmission efficiency from three aspects of byte number proportion occupied by an identification row, error synchronization probability and loss caused by frame loss, a multi-objective optimization model needs to be established to calculate a proper n value, and the method comprises the following steps:
1) the byte number proportion occupied by the identification row is as small as possible. Identifying a line length L ═ I + n [ (k) ] a -1), one n x k after compression a The number of bytes in the memory is N ═ N × k a +n*p+n*(k a -1) q, where q ≦ p, then the occupation ratio of the identification row is
When q is 0, is reachedLower bound, N min ＝n*k a + n × p; when q ═ p, the upper bound is reached, N max ＝n*k a +n*p+n*(k a -1)*p＝n*k a (p +1) so
Namely, it is
At k a When l and p are specified, the change of R with n is as shown in FIG. 3, and it is found that the larger n is, the better n is, in order to make R as small as possible. Since q is not more than p, the value is not fixed, so the upper bound is taken as the objective function, namely
2) The probability of false synchronization is as small as possible. According to Bernoulli independent experiments, in the process of sliding search byte by byte with the length of n bytes, the probability of forging local r-byte frame synchronous codes by random data is
The background of the problem is
Where a is the probability of success of each experiment, b is the probability of failure (i.e., b 1-a), and x is the equation s 1+ ba l s l+1 The minimum positive root of (2) can be solved by adopting an iterative approximation method. The variation of the error probability with n is shown in fig. 4, and it is found that in order to make the error probability as small as possible, n is larger and better.
3) The loss caused by frame loss is as small as possible. If frame rate is lost
The effect of frame dropping rate on the decompression effect is reflected in
The variation of the accuracy with n is shown in FIG. 5. it is found that when the frame loss rate is constant, n is smaller in order to minimize the loss due to frame lossThe better.
Thus, the following multi-objective optimization problem can be formed:
s.t.1＜n≤m，n∈N
wherein the function f i (N) { i ═ 1, 2, 3} is an objective function, N is more than 1 and less than or equal to m, N ∈ N is a constraint function, and the value of N is a feasible domain of the formula. In this multi-objective optimization problem there are 3 objective functions (2 minimized objective functions, 1 maximized objective function) and 2 constraint functions. Minimizing the objective function of the multi-objective optimization problem formula
Obtaining a standard multi-objective optimization model under the background: min F (x) ═ F 1 (n)，f 2 (n)，f’ 3 (n)] T ，s.t.1＜n≤m，n∈N。
The solving method of the multi-objective optimization problem comprises a traditional conversion method taking algorithms such as a linear weighting method, a constraint method and a target planning method as main algorithms and an intelligent solution method comprising a genetic algorithm, an ant colony algorithm and a particle swarm algorithm. The problem is solved by adopting a traditional weighting method, which comprises the following steps: setting the weight ω ═ ω 1 ，ω 2 ，ω 3 ] T With F (x) ═ ω T [f 1 (n)，f 2 (n)，f’ 3 (n)] T ＝ω 1 f 1 (n)+ω 2 f 2 (n)+ω 3 f 3 (N) to obtain a final multi-objective optimization model min F (x), wherein s.t.1 is more than N and less than or equal to m, N belongs to N and omega 1 +ω 2 +ω 3 ＝1。
2. And (3) data recovery: after the telemetry data transmission is completed, data recovery is required, that is, the data is cut by reading the identification code and the byte number of each line, so that the format before the data format processing is recovered, and the decompression process is completed. The specific method comprises the following steps: searching the identification code according to bit matching for the sequence received by the receiving end, and if the identification code is completely corresponding, cutting the data sequence according to the number of bytes per frame after the identification code to recover the form before format processing; and if the identification codes correspond to errors, continuing to match and searching for the next identification code until the data sequence is cut completely. Thus, the telemetry data may be restored to a previous format.
3. Telemetry data decompression: after the telemetry data format is recovered, the decompression process needs to be completed to obtain the original telemetry data. The specific method of the decompression process is as follows: for the compressed telemetry data a x, the 1 st, k th a +1，2k a +1，.......，i*k a +1(i，k a ∈N + ) Frame telemetry data is stored in a buffer area, and the data length of each of the other frames is sequentially judged. If the data length x in the telemetering data frame is the same as the length b of the original telemetering data frame, not operating, and completely recording the telemetering data frame; if the data length x in the telemetering data frame is 1 (only a position frame header), supplementing the data length x with adjacent telemetering frames in a buffer except the position frame header to obtain a telemetering frame with the data length b; if the data length x in the telemetering data frame is less than b and x is not equal to 1, the changed data is supplemented in a mode of 'position + data', and the unchanged data is supplemented by combining the adjacent telemetering frames in the buffer area, so that the telemetering frame with the data length b is obtained. And repeating the steps until all the telemetering data are processed, and finishing the decompression process.
It should be noted that the embodiments of the present application can be applied to various satellite telemetry data, and are not limited to the real-time telemetry data in the embodiments of the present application. The method for flexibly transmitting telemetry data will be further described below by taking real-time telemetry data of a certain satellite task as an example, as shown in fig. 6, specifically as follows:
first, a part of telemetry data of the telemetry data frame shown in fig. 2 is selected, and a complete telemetry data flexible transmission process of the embodiment of the present application is implemented in an ideal channel with a frame loss rate of 0, and parameters are set as: telemetry data volume 6 x 10(6 frames, 10 bytes per frame), compression interval k a 3, data processing interval n k a 1 × 3, the frame synchronization code 1ACFFC1D is used as the identification code. Thereby, the telemetric data can be flexibly transmitted with the compression ratio CR 0 0.7333, the accuracy of the decompressed data is 100%, and the related result is shown in fig. 7. For ease of viewing, the bytes and identification codes that change in the telemetry data are shown underlined and bolded.
A satellite telemetry data set is selected for elastic transmission based on telemetry characteristics. For the set of satellite telemetry data sets, the amount of telemetry data is 455 x 121(m x k) a 455, number of bytes per frame p 121), compression ratio when the packetization compression method is not used is CR 0.5168, and compression ratio R required for the channel com ＝ 0.6130 . By
K is obtained by calculation a When the value is 5, m is 91. Using the frame synchronization code 1ACFFC1D as the identification code, I equals 4. Get omega 1 ＝0.5，ω 2 ＝0.1，ω 3 0.4, frame loss rate x r The success rate a is 0.01 and the success rate b is 0.99. Therefore, the obtained multi-objective optimization model is as follows:
s.t.1＜n≤91，n∈N
calculated n is 2. Thus, for the satellite telemetry data, k a The compression is performed at a sub-packet interval of 5, and the compression ratio is CR obtained through simulation 1 ＝0.6135＞R com 0.6130, consistent with theoretical results. After compression is complete, n x k a Format processing is performed at a spacing of 2 x 5 x 10, and the simulation of channel transmission and subsequent format recovery and decompression flowsThe process. If the frame loss rate in the channel transmission process is set to be 0, the decompression accuracy is 100.0 percent compared with the original telemetering data; if the frame loss rate in the channel transmission process is set to be 0.2%, the decompression accuracy is 96.26% compared with the original telemetry data.
Therefore, the method and the device can effectively solve the transmission pressure of satellite telemetry data with various parameters, high data generation rate and huge data total amount on channel transmission with limited bandwidth and limited storage media, provide a telemetry data elastic transmission scheme independent of expert experience and physical characteristics of the telemetry data, perform sub-packet compression and elastic transmission on highly redundant telemetry data, reduce data transmission cost waste, save communication resources and provide possibility for guaranteeing high reliability of a communication link.
According to the telemetering data elastic transmission method provided by the embodiment of the application, the telemetering data frame is used as a unit for compression, a plurality of expected targets such as a compression rate, an identification line occupation ratio, error synchronization probability, a frame loss rate and the like are comprehensively considered, a multi-target optimization model is established, optimal compression and data processing interval parameters meeting constraint conditions are obtained, highly redundant satellite telemetering data can be compressed and elastically transmitted, the level allowance of a communication link is guaranteed, the elastic transmission efficiency is effectively improved, the telemetering data can be compressed under the condition that the physical characteristics of the telemetering data and the expert experience are not relied on, error code diffusion in the elastic transmission process is prevented, and the purposes of guaranteeing the level allowance of the communication link and saving communication resources under the condition that the transmission bandwidth is limited are achieved.
Next, a telemetry data elastic transmission apparatus according to an embodiment of the present application will be described with reference to the accompanying drawings.
FIG. 8 is a block diagram of a telemetry data elastomeric transfer device according to an embodiment of the application.
As shown in fig. 8, the telemetry data elastic transmission device 10 includes: an acquisition module 100, a compression module 200, and a transmission module 300.
The acquisition module 100 is configured to acquire telemetry data to be transmitted; a compression module 200, configured to compress repeated bytes of at least one data frame in the telemetry data, and generate a new data frame according to remaining uncompressed bytes and corresponding positions in the at least one data frame; and a transmission module 300, configured to generate compressed telemetry data according to the new data frame and the uncompressed data frame, and send the compressed telemetry data to the receiving end, so that the receiving end decompresses the compressed telemetry data to obtain the telemetry data.
In the embodiment of the present application, the compression module 200 is configured to: identifying at least one reference data frame and a data frame to be compressed in the telemetry data according to the target compression interval; discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, identifying the positions of the residual bytes in the data frame to be compressed, and forming a new data frame according to the residual bytes and the corresponding positions.
In the embodiment of the present application, the apparatus 10 of the embodiment of the present application further includes: and a first judging module. The first judging module is used for judging whether the total length of the repeated bytes is greater than the discarding length before discarding the repeated bytes of the data frame to be compressed and at least one reference data frame; if the total length of the repeated bytes is larger than the discarding length, discarding the repeated bytes, otherwise, not compressing the data frame to be compressed.
In the embodiment of the present application, the apparatus 10 of the embodiment of the present application further includes: and a second judgment module. The second judging module is used for judging whether the data of the data frame to be compressed and the data of the at least one reference data frame are the same or not before discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame; if the length of the repeated bytes is equal to the length of the discarded data frame, discarding the data frame to be compressed and recording the frame header of the data frame to be compressed, otherwise, judging whether the total length of the repeated bytes is greater than the discarded length.
In the embodiment of the present application, the apparatus 10 of the embodiment of the present application further includes: and a processing module. The processing module is used for carrying out format processing on the compressed telemetering data according to the identification code before the compressed telemetering data are sent to the receiving end, so that the compressed telemetering data meet target transmission conditions, wherein the identification code is used for identifying the byte length of each data frame.
It should be noted that the foregoing explanation of the embodiment of the elastic telemetry data transmission method is also applicable to the elastic telemetry data transmission apparatus of the embodiment, and details are not described here.
According to the telemetering data elastic transmission device provided by the embodiment of the application, the telemetering data frame is used as a unit for compression, a plurality of expected targets such as a compression rate, an identification line occupation ratio, error synchronization probability, a frame loss rate and the like are comprehensively considered, a multi-target optimization model is established, optimal compression and data processing interval parameters meeting constraint conditions are obtained, highly redundant satellite telemetering data can be compressed and elastically transmitted, the level allowance of a communication link is guaranteed, the elastic transmission efficiency is effectively improved, the telemetering data can be compressed under the condition that the physical characteristics of the telemetering data and the expert experience are not relied on, error code diffusion in the elastic transmission process is prevented, and the purposes of guaranteeing the level allowance of the communication link and saving communication resources under the condition that the transmission bandwidth is limited are achieved.
Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device may include:
a memory 901, a processor 902 and a computer program stored on the memory 901 and executable on the processor 902.
The processor 902, when executing the program, implements the telemetry data flexible transmission method provided in the above embodiments.
Further, the electronic device further includes:
a communication interface 903 for communication between the memory 901 and the processor 902.
A memory 901 for storing computer programs executable on the processor 902.
The Memory 901 may include a high-speed RAM (Random Access Memory) Memory, and may also include a nonvolatile Memory, such as at least one disk Memory.
If the memory 901, the processor 902, and the communication interface 903 are implemented independently, the communication interface 903, the memory 901, and the processor 902 may be connected to each other through a bus and perform communication with each other. The bus may be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 9, but that does not indicate only one bus or one type of bus.
Optionally, in a specific implementation, if the memory 901, the processor 902, and the communication interface 903 are integrated on a chip, the memory 901, the processor 902, and the communication interface 903 may complete mutual communication through an internal interface.
The processor 902 may be a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement embodiments of the present Application.
Embodiments of the present application also provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method for flexibly transmitting telemetry data as above is implemented.
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or N embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "N" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more N executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of implementing the embodiments of the present application.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a programmable gate array, a field programmable gate array, or the like.
It will be understood by those skilled in the art that all or part of the steps carried out in the method of implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and the program, when executed, includes one or a combination of the steps of the method embodiments.
Claims (12)
1. An elastic telemetric data transmission method is characterized by comprising the following steps:
acquiring telemetering data to be transmitted;
compressing repeated bytes of at least one data frame in the telemetry data, and generating a new data frame according to the residual uncompressed bytes and the corresponding position in the at least one data frame; and
and generating compressed telemetering data according to the new data frame and the uncompressed data frame, and sending the compressed telemetering data to a receiving end, so that the receiving end decompresses the compressed telemetering data to obtain the telemetering data.
2. The method of claim 1, wherein compressing the repeating bytes of at least one data frame of the telemetry data and generating a new data frame based on the remaining uncompressed bytes and corresponding locations in the at least one data frame comprises:
identifying at least one reference data frame and a data frame to be compressed in the telemetry data according to a target compression interval;
discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, identifying the positions of the residual bytes in the data frame to be compressed, and forming the new data frame according to the residual bytes and the corresponding positions.
3. The method of claim 2, further comprising, before discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame:
judging whether the total length of the repeated bytes is greater than a discarding length;
if the total length of the repeated bytes is larger than the discarding length, discarding the repeated bytes, otherwise, not compressing the data frame to be compressed.
4. The method of claim 3, further comprising, before discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame:
judging whether the data of the data frame to be compressed is the same as the data of the at least one reference data frame;
if the length of the repeated bytes is equal to the length of the discarded data frame, discarding the data frame to be compressed, and recording the frame header of the data frame to be compressed, otherwise, judging whether the total length of the repeated bytes is greater than the discarded length.
5. The method of any of claims 1-4, further comprising, prior to transmitting the compressed telemetry data to a receiving end:
and carrying out format processing on the compressed telemetry data according to an identification code so that the compressed telemetry data meets a target transmission condition, wherein the identification code is used for identifying the byte length of each data frame.
6. An elastic telemetric data transmission apparatus, comprising the steps of:
the acquisition module is used for acquiring the telemetering data to be transmitted;
the compression module is used for compressing repeated bytes of at least one data frame in the telemetry data and generating a new data frame according to the residual uncompressed bytes and the corresponding position in the at least one data frame; and
and the transmission module is used for generating compressed telemetering data according to the new data frame and the uncompressed data frame and sending the compressed telemetering data to a receiving end, so that the receiving end decompresses the compressed telemetering data to obtain the telemetering data.
7. The apparatus of claim 6, wherein the compression module is to:
identifying at least one reference data frame and a data frame to be compressed in the telemetry data according to a target compression interval;
discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame, identifying the positions of the residual bytes in the data frame to be compressed, and forming the new data frame according to the residual bytes and the corresponding positions.
8. The apparatus of claim 7, further comprising:
a first judging module, configured to judge whether a total length of a repetition byte is greater than a discard length before discarding the repetition byte of the data frame to be compressed and the at least one reference data frame; if the total length of the repeated bytes is larger than the discarding length, discarding the repeated bytes, otherwise, not compressing the data frame to be compressed.
9. The apparatus of claim 8, further comprising:
a second judging module, configured to judge whether data of the data frame to be compressed and the data of the at least one reference data frame are the same before discarding the repeated bytes of the data frame to be compressed and the at least one reference data frame; if the length of the repeated bytes is equal to the length of the discarded data frame, discarding the data frame to be compressed, and recording the frame header of the data frame to be compressed, otherwise, judging whether the total length of the repeated bytes is greater than the discarded length.
10. The apparatus of any one of claims 6-9, further comprising:
and the processing module is used for carrying out format processing on the compressed telemetering data according to the identification code before sending the compressed telemetering data to a receiving end so that the compressed telemetering data meets a target transmission condition, wherein the identification code is used for identifying the byte length of each data frame.
11. An electronic device, comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor executing the program to implement the telemetry data elastic transmission method according to any one of claims 1 to 5.
12. A computer-readable storage medium, on which a computer program is stored, the program being executable by a processor for implementing the method for resilient transmission of telemetry data as claimed in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210532326.3A CN114978425A (en) | 2022-05-09 | 2022-05-09 | Remote measuring data elastic transmission method, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210532326.3A CN114978425A (en) | 2022-05-09 | 2022-05-09 | Remote measuring data elastic transmission method, device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114978425A true CN114978425A (en) | 2022-08-30 |
Family
ID=82983933
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210532326.3A Pending CN114978425A (en) | 2022-05-09 | 2022-05-09 | Remote measuring data elastic transmission method, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114978425A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102882636A (en) * | 2012-09-07 | 2013-01-16 | 航天东方红卫星有限公司 | Lossless compression method for satellite packet telemetry data |
| US9489837B1 (en) * | 2014-06-25 | 2016-11-08 | EMC IP Holding Company, LLC | Providing storage system telemetry data |
| CN112165331A (en) * | 2020-09-22 | 2021-01-01 | 上海华东汽车信息技术有限公司 | Data compression method and device, data decompression method and device, storage medium and electronic equipment |
-
2022
- 2022-05-09 CN CN202210532326.3A patent/CN114978425A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102882636A (en) * | 2012-09-07 | 2013-01-16 | 航天东方红卫星有限公司 | Lossless compression method for satellite packet telemetry data |
| US9489837B1 (en) * | 2014-06-25 | 2016-11-08 | EMC IP Holding Company, LLC | Providing storage system telemetry data |
| CN112165331A (en) * | 2020-09-22 | 2021-01-01 | 上海华东汽车信息技术有限公司 | Data compression method and device, data decompression method and device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6606037B2 (en) | Qualitative modeling and compression of request sequences in ARQ protocols | |
| US8332705B2 (en) | Device and method of data combining | |
| CN112820306B (en) | Voice transmission method, system, device, computer readable storage medium and apparatus | |
| CN111242171A (en) | Model training, diagnosis and prediction method and device for network fault and electronic equipment | |
| JP2011109361A (en) | Data encoding program, data decoding program, and method | |
| CN112817940B (en) | Gradient compression-based federated learning data processing system | |
| CN114422607A (en) | Compression transmission method of real-time data | |
| WO2021068891A1 (en) | Method, system, electronic device, and storage medium for storing and collecting temperature data | |
| US9876608B2 (en) | Encoding apparatus and encoding method | |
| CN114726892B (en) | Edge data collection method based on artificial intelligence big data | |
| CN114978425A (en) | Remote measuring data elastic transmission method, device, electronic equipment and storage medium | |
| CN110995396B (en) | Compression method of communication messages of electricity consumption information acquisition system based on hierarchical structure | |
| CN111225077B (en) | Network distribution method, device and system for Internet of things equipment | |
| CN115695564B (en) | Efficient transmission method of Internet of things data | |
| CN114024952B (en) | File compression transmission method based on DL/T698.45-2007 protocol | |
| Wang et al. | Spiking semantic communication for feature transmission with harq | |
| US20230053844A1 (en) | Improved Quality Value Compression Framework in Aligned Sequencing Data Based on Novel Contexts | |
| US20220294557A1 (en) | Error correction in network packets | |
| AU2020438008B2 (en) | Time series data generation method and device based on multi-condition constraints, and medium | |
| CN115034255A (en) | Signal modulation identification algorithm with attention mechanism time convolution network | |
| CN111539029A (en) | Industrial internet-based big data storage rate optimization method and cloud computing center | |
| CN114978421A (en) | Dynamic coding method and device and electronic equipment | |
| CN111010200B (en) | Satellite meteorological data fountain decoding algorithm hardware system based on heterogeneous multi-core | |
| CN114978427B (en) | Data processing method, apparatus, program product, computer device, and medium | |
| WO2023045886A1 (en) | Model training method and apparatus, video user experience prediction method and apparatus, and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |