CN111858571B - Satellite data transmission data processing method and system - Google Patents
Satellite data transmission data processing method and system Download PDFInfo
- Publication number
- CN111858571B CN111858571B CN202010652433.0A CN202010652433A CN111858571B CN 111858571 B CN111858571 B CN 111858571B CN 202010652433 A CN202010652433 A CN 202010652433A CN 111858571 B CN111858571 B CN 111858571B
- Authority
- CN
- China
- Prior art keywords
- data
- channel
- header information
- packet header
- container
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 40
- 238000003672 processing method Methods 0.000 title claims abstract description 30
- 238000000034 method Methods 0.000 claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 13
- 238000013500 data storage Methods 0.000 claims description 10
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
Abstract
The invention provides a satellite data processing method, which does not adopt a method for comparing packet header information for a plurality of times, directly regards the packet header information as a whole, then searches packet header information in data of a data transmission frame, and can find a data packet by only comparing the packet header information once. The invention also provides a satellite data transmission data processing system. The beneficial effects of the invention are as follows: on one hand, the data sorting flow is simplified; on the other hand, data sorting efficiency is improved.
Description
Technical Field
The present invention relates to processing satellite data, and more particularly, to a method and system for processing satellite data.
Background
The data transmission data is used as the achievement generated during the satellite in-orbit operation, and the data generated by the payload data and the platform data are stored, which are important basis for reflecting the working state of each subsystem single machine equipment during the satellite in-orbit operation.
An important task in satellite entry is to transfer the data generated outside the country by data transmission. The designer knows the whole satellite state of the satellite and the working condition of the load through analyzing the data. However, the data packets of various channels are stored together in the data transmission system, for example: platform data, payload data, etc., as shown in fig. 1. How to sort out various data in the data transmission with high efficiency, especially when the data of various channels in the data transmission, is very important for a designer to analyze the data transmission.
The sorting of the model data is operated according to the model data transmission protocol. Each channel data on the satellite is stored in the data transmission, and the channel data is sorted out from the data transmission data which is downloaded on the satellite by the packet header information (packet header, flag bit, etc.) of the channel data.
At present, the sorting method of data transmission is to sort data by searching packet header information of the data in the frame data for each received frame data; as shown in fig. 2, it is a common practice to decompose header information into several bytes, compare byte by byte in a data frame, find one byte of the header, and then compare the next byte. If the comparison result is that the complete packet header is found, the packet data is considered to be found; otherwise, it is considered that no packet data is found. For example, the packet header information of a certain channel is AABBCCDD four bytes, the traditional method is to search for AA bytes first, then judge whether the next byte is BB or not after finding, if so, judge whether the next byte is CC and DD in sequence; if four bytes can be found, the data of the channel is found, otherwise, the data of the channel is not found. For the case of crossing frames of the packet header information, byte-by-byte comparison is performed first, and if some bytes are the same and the data frames are already compared to the frame tail, the next frame data is read for continuous comparison.
When the number of channels included in the data is small, the processing method can basically meet the requirement, and when the number of channels included in the data is large, the processing method is low in efficiency and complex in algorithm.
The disadvantages of the existing data processing software include the following points:
1) The data processing flow is complex;
2) For data transmission data containing multiple channels, the data sorting efficiency is low.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a satellite data transmission data processing method and system.
The invention provides a satellite data transmission processing method, which does not adopt a method for comparing packet header information for multiple times (namely, two times or more than two times), directly regards the packet header information as a whole, then searches packet header information in data transmission frame data, and can find a data packet only by comparing the packet header information once.
As a further improvement of the invention, the method comprises the following steps:
s1, sorting data, namely sorting different channel data from data transmission data;
s2, data storage, namely storing the sorted channel data.
As a further development of the invention, step S1 comprises the following sub-steps:
s11, reading the data into a data container, judging whether the data length in the data container is greater than or equal to the length of two frames of data, and if the data length is smaller than the length of two frames, reading one frame of data into the data container; if the data length in the data container is greater than or equal to the length of two frames, entering the next step;
s12, searching the whole packet header information in the data container; searching from the beginning to the end, if the header information is not found all the time, considering that the segment of data has no channel data, clearing the data in the data container, and returning to the step S11; if the packet header information is found, the channel data is found, and the next step is carried out;
s13, extracting channel data according to a data protocol and storing the channel data;
s14, clearing the compared data and the intercepted channel information in the data container, and keeping the residual data in the container, and returning to the step S11.
As a further development of the invention, step S2 comprises the following sub-steps:
s21, judging the channel type of the channel data through the packet header information;
s22, judging whether a folder for storing channel data of a corresponding channel class is established, if not, establishing the corresponding folder, establishing a data storage folder by the name of the channel class, and entering the next step; if so, proceeding to the next step;
s23, storing the sorted channel data in a corresponding folder, and finishing storing the sorted channel data.
The invention also provides a satellite data transmission data processing system, which comprises a readable storage medium, wherein the readable storage medium is stored with execution instructions, and the execution instructions are used for realizing the method of any one of the above when being executed by a processor.
The beneficial effects of the invention are as follows: through the scheme, on one hand, the data sorting flow is simplified; on the other hand, data sorting efficiency is improved.
Drawings
Fig. 1 is a diagram showing the composition of data transmitted in the prior art.
Fig. 2 is a diagram of a byte-by-byte alignment process in the prior art.
Fig. 3 is an information flow chart of data transmission of a satellite data transmission processing method according to the present invention.
Fig. 4 is a diagram of a process of comparing header information of a satellite data processing method according to the present invention.
Fig. 5 is a schematic diagram of frame data connection of a satellite data processing method according to the present invention.
Fig. 6 is a data sorting flow chart of a satellite data processing method according to the present invention.
FIG. 7 is a flow chart of data storage for a satellite data processing method according to the present invention.
Detailed Description
The invention is further described with reference to the following description of the drawings and detailed description.
A satellite data processing method directly regards the packet header information as a whole without multiple comparison of the packet header information, then searches the packet header in the data of the data transmission frame, and can find the data packet by only comparing the packet header information once, as shown in figure 4.
In order to simply and rapidly sort data, the satellite data processing method provided by the invention can rapidly sort data containing multi-channel data, rapidly process satellite data, and facilitate designers to analyze the data so as to know the on-orbit running state of the whole satellite. An information flow chart of the data transmission data processing is shown in fig. 3.
In order to solve the packet header and stride the situation of the frame conveniently, the solution of the invention is to set up a container first, guarantee the data transmission in the container is greater than or equal to 2 frames, in this way, guaranteed that the packet header is "connected" while being packet header and stride the frame, regard packet header information as a whole to find the packet data, can still find packet header information, will not lose the data because of packet header crosses the frame, as shown in figure 5. Thus, the problem of packet header frame crossing data is solved, and for the invention, the complex frame crossing problem is simplified, and the situation that no packet header frame crossing exists is converted.
The invention is mainly divided into two parts: data sorting and data storage.
The data sorting is to sort different channel data from the data transmission data, and the specific sorting process is to read the data transmission data into a data container, judge whether the data length in the container is greater than the length of two frames of data transmission, and if the data length is less than the length of two frames, read one frame of data into the data container; if the data in the data container is greater than the length of two frames of data, searching the whole packet head information in the data. And finally, searching from the beginning, if the header information is not found all the time, considering that the channel data does not exist in the segment of data, clearing the data in the container, continuously adding the data into the container, and then comparing again. If the packet header information is found, the channel data is found, and the channel data is extracted and stored according to the data protocol. And then clearing the compared data and the intercepted channel information in the container, keeping the residual data in the container, and continuing to repeat the process. The data sorting flow is shown in fig. 6.
The data storage flow is to store the sorted channel data, various channel data are mixed in the data transmission data, and after the data are sorted, the data of each channel are required to be stored in a classified mode so as to be convenient for a designer to utilize the data, thereby improving the use value of the data. The data storage flow is to judge which channel data the channel data belongs to through the packet header information, judge whether the folder storing the channel data is already established, if the corresponding folder is not established, establish the data storage folder through the name of the channel category, then store the sorted channel data in the corresponding folder, and finish storing the channel data after sorting. The data storage flow chart is shown in fig. 7.
The data sorting function is a core part of a data processing method and mainly aims to sort out data according to configuration. The data transmission data processing method sorts the original data transmission data into sub-frame data of different channels, and stores the sorted channel data according to configuration requirements, thereby being convenient for a designer to use the data.
A satellite data processing system comprising a readable storage medium having stored therein execution instructions which when executed by a processor are adapted to carry out the method of any one of the preceding claims.
The invention provides a satellite data processing method, which is a method for sorting and storing channel data in whole satellite data. Especially, the data transmission data of a plurality of channel data are stored, the channel data stored together can be rapidly and accurately sorted, a designer can conveniently check the data, and the utilization efficiency of the data is improved.
The satellite data transmission data processing method and system provided by the invention have the following advantages:
1. the algorithm is simple, and the sorting efficiency is high;
2. sorting for storing multi-channel data transmission data is facilitated;
3. the algorithm has high flexibility and is convenient for carrying out adaptive modification and expansion aiming at different models in later period.
The current data processing method is applied to the data processing of the type number, but is different from the technical scheme and application condition protected by the invention, and the invention mainly comprises the following aspects:
1. different application ranges
Because the tasks of the model and the protocols of the data are different, the processing methods of the data are different, and the processing methods of the data generally select the processing methods which accord with the model characteristics according to the characteristics of the model, so as to realize the processing of the data. The processing method of the invention is more universal and flexible, and can be suitable for data processing of different models, as long as the data of the models consists of data of different channels, no special data processing algorithm is required to be written aiming at the models.
2. Different technical proposal
The positioning method is a method for sorting and storing the channel data in the data, and the channel data is efficiently sorted out from the data and stored after the data of the model is processed, so that convenience is brought to a designer to check and process, and the utilization efficiency of the data is improved. The existing data processing method simply sorts data in a byte-by-byte mode by the most original method, and when various channel data exist in the data, the sorting efficiency is extremely low.
Depending on the model task requirements, some non-main steps of the present process may be simplified, while some other process steps may be added.
The data sorting function and the data storage function in the processing method can be combined to form a data transmission processing method.
The main functions of the processing method may be changed, only the processing method implementation is changed.
The invention is suitable for processing satellite data transmission and can be used for rapidly sorting and storing the data transmission. And a designer can conveniently interpret and analyze the data.
The foregoing is a further detailed description of the invention in connection with the preferred embodiments, and it is not intended that the invention be limited to the specific embodiments described. It will be apparent to those skilled in the art that several simple deductions or substitutions may be made without departing from the spirit of the invention, and these should be considered to be within the scope of the invention.
Claims (3)
1. A satellite data transmission data processing method is characterized in that: directly regarding the packet header information as a whole without adopting a method of comparing the packet header information for multiple times, then searching the packet header information in the data transmission frame data, and only comparing the packet header information once to find a data packet;
the method comprises the following steps:
s1, sorting data, namely sorting different channel data from data transmission data;
s2, storing data, namely storing the sorted channel data;
step S1 comprises the following sub-steps:
s11, reading the data into a data container, judging whether the data length in the data container is greater than or equal to the length of two frames of data, and if the data length is smaller than the length of two frames, reading one frame of data into the data container; if the data length in the data container is greater than or equal to the length of two frames, entering the next step;
s12, searching the whole packet header information in the data container; searching from the beginning to the end, if the header information is not found all the time, considering that the segment of data has no channel data, clearing the data in the data container, and returning to the step S11; if the packet header information is found, the channel data is found, and the next step is carried out;
s13, extracting channel data according to a data protocol and storing the channel data;
s14, clearing the compared data and the intercepted channel information in the data container, and keeping the residual data in the container, and returning to the step S11.
2. The satellite data processing method according to claim 1, wherein: step S2 comprises the following sub-steps:
s21, judging the channel type of the channel data through the packet header information;
s22, judging whether a folder for storing channel data of a corresponding channel class is established, if not, establishing the corresponding folder, establishing a data storage folder by the name of the channel class, and entering the next step; if so, proceeding to the next step;
s23, storing the sorted channel data in a corresponding folder, and finishing storing the sorted channel data.
3. A satellite data processing system, characterized in that: comprising a readable storage medium having stored therein execution instructions which, when executed by a processor, are adapted to carry out the method of any one of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010652433.0A CN111858571B (en) | 2020-07-08 | 2020-07-08 | Satellite data transmission data processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010652433.0A CN111858571B (en) | 2020-07-08 | 2020-07-08 | Satellite data transmission data processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111858571A CN111858571A (en) | 2020-10-30 |
| CN111858571B true CN111858571B (en) | 2024-04-09 |
Family
ID=73153172
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010652433.0A Active CN111858571B (en) | 2020-07-08 | 2020-07-08 | Satellite data transmission data processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111858571B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1728714A (en) * | 2004-07-27 | 2006-02-01 | 邓里文 | Method for mutual communication between IPv4 network and IPv6 network |
| CN102625251A (en) * | 2012-03-12 | 2012-08-01 | 成都林海电子有限责任公司 | Digital broadcasting treating method, mobile terminal and system |
| CN102706452A (en) * | 2012-04-28 | 2012-10-03 | 中国科学院国家天文台 | Method for processing real-time data of lunar satellite interference imaging spectrometer |
| CN105610548A (en) * | 2015-12-28 | 2016-05-25 | 北京卫星制造厂 | Telemetering framing and downloading method based on event-driven |
| CN108566262A (en) * | 2018-02-12 | 2018-09-21 | 上海航天电子有限公司 | A kind of satellite test data comparison method for Cortex data formats |
| CN109756514A (en) * | 2019-02-26 | 2019-05-14 | 北京控制工程研究所 | A kind of telemetry method for dynamically processing of spacecraft complex protocol |
| CN109872411A (en) * | 2019-02-26 | 2019-06-11 | 北京控制工程研究所 | A kind of asynchronous flight control data processing method of the multi-source unified based on timing |
| CN110719216A (en) * | 2019-10-22 | 2020-01-21 | 深圳航天东方红海特卫星有限公司 | Data transmission data processing method, system, device and storage medium |
| CN111241038A (en) * | 2020-01-19 | 2020-06-05 | 中国科学院电子学研究所 | Satellite data processing method and system |
-
2020
- 2020-07-08 CN CN202010652433.0A patent/CN111858571B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1728714A (en) * | 2004-07-27 | 2006-02-01 | 邓里文 | Method for mutual communication between IPv4 network and IPv6 network |
| CN102625251A (en) * | 2012-03-12 | 2012-08-01 | 成都林海电子有限责任公司 | Digital broadcasting treating method, mobile terminal and system |
| CN102706452A (en) * | 2012-04-28 | 2012-10-03 | 中国科学院国家天文台 | Method for processing real-time data of lunar satellite interference imaging spectrometer |
| CN105610548A (en) * | 2015-12-28 | 2016-05-25 | 北京卫星制造厂 | Telemetering framing and downloading method based on event-driven |
| CN108566262A (en) * | 2018-02-12 | 2018-09-21 | 上海航天电子有限公司 | A kind of satellite test data comparison method for Cortex data formats |
| CN109756514A (en) * | 2019-02-26 | 2019-05-14 | 北京控制工程研究所 | A kind of telemetry method for dynamically processing of spacecraft complex protocol |
| CN109872411A (en) * | 2019-02-26 | 2019-06-11 | 北京控制工程研究所 | A kind of asynchronous flight control data processing method of the multi-source unified based on timing |
| CN110719216A (en) * | 2019-10-22 | 2020-01-21 | 深圳航天东方红海特卫星有限公司 | Data transmission data processing method, system, device and storage medium |
| CN111241038A (en) * | 2020-01-19 | 2020-06-05 | 中国科学院电子学研究所 | Satellite data processing method and system |
Non-Patent Citations (1)
| Title |
|---|
| 气象卫星载荷原始数据包快视软件系统开发;汪少林;程静;张立国;马文佳;杨春燕;蔡先军;张波;;北京理工大学学报(第12期);第1295-1299页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111858571A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7349415B2 (en) | Method and apparatus for generating and using enhanced tree bitmap data structures in determining a longest prefix match | |
| CN101095310B (en) | Packet parsing processor and the method for parsing grouping in the processor | |
| CN107832343B (en) | Bitmap-based method for quickly retrieving data by MBF data index structure | |
| US20030204584A1 (en) | Apparatus and method for pattern matching in text based protocol | |
| CN101345707B (en) | Method and apparatus for implementing IPv6 packet classification | |
| CN107704728B (en) | Cloud computing acceleration method for gene sequence comparison | |
| CN110083746B (en) | Quick matching identification method and device based on character strings | |
| CN112235302B (en) | Protocol analysis method suitable for multiple buses | |
| US7937495B2 (en) | System and method for modifying data transferred from a source to a destination | |
| CN103188042A (en) | Matching method and matching accelerator of Internet protocol (IP) data package | |
| CN102195895A (en) | Message sending and receiving processing method and device | |
| CN101060482B (en) | A route search method and forwarding system | |
| CN107947965B (en) | Service chain compiler | |
| CN106850559B (en) | Extensible network protocol analysis system and method | |
| CN111858571B (en) | Satellite data transmission data processing method and system | |
| CN1585358A (en) | Route searching method and system | |
| US7420975B1 (en) | Method and apparatus for a high-speed frame tagger | |
| CN113411380B (en) | Processing method, logic circuit and equipment based on FPGA (field programmable gate array) programmable session table | |
| CN113867796B (en) | Protocol conversion bridge for improving reading performance by using multi-state machine and implementation method | |
| CN110489380A (en) | A kind of data processing method, device and equipment | |
| US5046025A (en) | Data transmission optimizer including multi-pass symbol buffer optimization, trial generation feature and MDT reset voting feature | |
| JP3233353B2 (en) | Header processing device and header processing method | |
| CN113343034A (en) | IP searching method, system and storage medium | |
| CN117349409B (en) | FPGA-based rapid regular expression matching realization system and method | |
| CN113419777B (en) | Instruction block conversion execution method and system of programmable switch |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: 518000 whole building of satellite building, 61 Gaoxin South Jiudao, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province Applicant after: Shenzhen Aerospace Dongfanghong Satellite Co.,Ltd. Address before: 518000 whole building of satellite building, 61 Gaoxin South Jiudao, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province Applicant before: AEROSPACE DONGFANGHONG DEVELOPMENT Ltd. Country or region before: China |
|
| CB02 | Change of applicant information |