CN106549702B - Data storage machine for satellite - Google Patents
Data storage machine for satellite Download PDFInfo
- Publication number
- CN106549702B CN106549702B CN201610898429.6A CN201610898429A CN106549702B CN 106549702 B CN106549702 B CN 106549702B CN 201610898429 A CN201610898429 A CN 201610898429A CN 106549702 B CN106549702 B CN 106549702B
- Authority
- CN
- China
- Prior art keywords
- data
- module
- real
- storage
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/1851—Systems using a satellite or space-based relay
- H04B7/18519—Operations control, administration or maintenance
Abstract
The invention relates to a data storage machine for a satellite, which comprises a real-time data receiving and transmitting front-end device, a data classifying device, a real-time storage device and a database device, wherein the data receiving and transmitting front-end device is used for receiving and transmitting data in real time; analyzing data packets sent by different real-time data receiving and sending front-end devices through a data classifying device, and caching the different data packets in different cache regions of a real-time storage device; and then the data packets of different cache regions are stored in a classified manner through the database device, so that high-speed storage of a large amount of data is realized.
Description
Technical Field
The invention relates to the field of data storage, in particular to a data storage machine for a satellite.
Background
At present, before the satellite is delivered to a user for use, a large number of experiments need to be completed on the satellite to verify various performance indexes and functional parameters of the satellite. The scientific researchers can judge the reliability of the satellite work by means of the data. During the experiment, a large amount of scientific experimental data was generated. If the ground command station cannot receive the data quickly, the data cannot be completely and correctly transmitted back to the ground command station. In order to avoid loss of the returned data, the data storage device of the ground command station is required to be capable of rapidly storing the data sent by the multi-function single machine.
Disclosure of Invention
In order to realize high-speed storage of data transmitted by a multifunctional microsatellite, the invention provides a data storage machine for a satellite, which comprises a real-time data receiving and transmitting front-end device, a data classifying device, a real-time storage device and a database device;
the real-time data receiving and transmitting front-end device is used for registering single satellite unit downlink data; the data classification device mainly comprises a receiving engine module and a metadata factory module; the database device consists of a meta storage module, a relation storage module and a numerical value storage module;
the meta-memory module provides record dividing bits and field dividing bits mapped by the frequency codes; the numerical value storage module stores data sent by a single satellite and feeds back a numerical value storage address; the relation storage module records a numerical value storage address and an mapping relation between the numerical value storage address and the frequency code;
the receiving engine module scans the real-time data receiving and transmitting front-end device according to the frequency codes, reads the data packets and sends the data packets to the metadata factory module; the metadata factory module reads in a record dividing digit from the metadata storage module according to the frequency codes, analyzes the data packet according to the record dividing digit and generates a data record table;
the data record analyzed by different frequency codes is sent to different cache regions of the real-time storage device by the metadata factory module; the data record analyzed by the same frequency codes is sent to the same cache region of the real-time storage device by the metadata factory module;
the real-time storage device stores the data record tables of different cache areas into different areas of the numerical value storage module and reads back the storage address of the first character and the last character of each data record table in the numerical value storage module; then, the real-time storage device converts the storage address of the first character and the last character of the data record list into the mapping relation with the frequency code, and the mapping relation is stored in the relation storage module.
Preferably, the data storage machine further comprises an analysis device; the analysis device firstly reads the relation storage module to obtain the storage address of the data table in the numerical value storage module and the mapping relation between the data recording table and the frequency code; secondly, reading in record dividing digits and field dividing digits from the meta-storage module according to the mapping relation between the data record list and the front-end frequency codes, and generating a tabulation mode; and thirdly, making a table from the data read from the numerical value storage module according to the table making mode and the storage address of the numerical value storage module.
Preferably, the frequency of transceiving of the real-time transceiving data front-end device is once per second.
Compared with the prior art, the invention has the advantages that the data transmitted by the real-time data transmitting and receiving front-end device can be quickly analyzed into the data record table after entering the metadata factory module by pre-coding each real-time data transmitting and receiving front-end device with different frequencies and associating and solidifying the frequency code of each real-time data transmitting and receiving front-end device as a main key into the record dividing digit and the field dividing digit in the metadata storage module. Then, the data recording table is classified and stored in different areas of the numerical value storage module through the real-time storage device. The real-time storage device reads back the storage address of the data record table in the numerical value storage module and stores the mapping relation between the storage address of the data record table and the frequency code in the relational data module. With such a data storage device, it is possible to store real-time data transmitted from a plurality of single devices in different areas of the numerical value storage module. In order to quickly store real-time data transmitted from a plurality of single machines, the real-time data transmitted from the plurality of single machines are stored in different areas of the numerical value storage module. In order to store a plurality of pieces of real-time data sent from a single machine in parallel and at high speed, the real-time data are stored in different areas of the numerical value storage module respectively, so that the storage is realized in parallel and at high speed.
When analyzing data, the analysis module calls the storage address of the data record table in the numerical module from the relation storage module and generates an analysis instruction according to the mapping relation between the storage address of the data record table and the frequency code; and reading the number of record splits and the number of field splits from the meta-storage module to generate a data split value. The analysis module then forms a form according to the analysis instructions and the data partitioning values.
All satellite single machines and the real-time data receiving and transmitting front-end device are communicated once per second, so that the satellite single machines return data to be displayed according to a time sequence.
Drawings
Fig. 1 is a schematic structural diagram of a data storage machine for a satellite according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a data storage machine for a satellite according to an embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings.
As shown in fig. 1, which is a schematic structural diagram of a data storage machine for a satellite according to an embodiment of the present invention, a data storage machine for a satellite includes a front-end device 4 for transmitting and receiving data in real time, a data classifying device 1, a real-time storage device 2, and a database device 3.
The real-time data receiving and transmitting front-end device 4 consists of a plurality of real-time data receiving and transmitting front-end devices. Each front-end device for transmitting and receiving data in real time only communicates with one satellite single machine. Each real-time data receiving and transmitting front-end device is provided with different data transmission frequencies and register addresses. The data classification device 1 is mainly composed of a receiving engine module 11 and a metadata factory module 12. The database device 3 is composed of a meta storage module 31, a relation storage module 33, and a numerical value storage module 32.
The meta-storage module 31 is used to store the frequency code of each front-end device for real-time data transmission and reception, the record dividing bits mapped by the frequency code, and the field dividing bits. The frequency code and the address code of each front-end device for transmitting and receiving data in real time are unique and are mutually mapped. The frequency code is used as a primary key to associate the record dividing digit and the field dividing digit. The frequency encoding, the number of record divisions, and the number of field divisions are fixed in the meta storage module 31. After the data storage device completes the authority setting, the meta storage module 31 cannot be rewritten and the meta storage module 31 can only be read. The number of frequency codes, the number of record partitions, and the number of field partitions in the meta-memory module 31 are used as parameters for processing the packet.
The value storage module 32 is used for storing the data packets sent from the satellite single machine. The memory address in the value storage module 32 is encoded as a data memory address serial number. The data storage address sequence number can be read.
The relation storage module 33 is used for recording the data storage address serial number and the mapping relation between the data storage address serial number and the front-end frequency code.
The reception engine module 11 has a scan thread and a read thread.
The scan thread scans the real-time transceiving data front-end device at a high frequency. The receiving engine performs one scan on all real-time data transceiving front-end devices, which is called to complete one scan. The scanning thread circularly scans the data stored by the real-time data receiving and transmitting front-end device to perform real-time monitoring on the data front-end.
And after scanning the frequency code by using the scanning thread, iterating to obtain the address serial number of the real-time data receiving and transmitting front-end device. The address serial number of the real-time data transmission and reception front-end device is transmitted to the reading thread through the register, and the reading thread reads out the data packet from the real-time data transmission and reception front-end device specified by the frequency coding.
The receiving engine module 11 performs one reading operation on all the real-time transceiving data front-end devices, which is called as completing one reading operation. The less time for completing one reading, the less delay processing phenomenon between the receiving engine module and the real-time data receiving and transmitting front-end device.
Each of the real-time data transmitting and receiving front-end devices transmits a data packet to the data receiving engine 11 in a UDP manner. Each real-time data transmitting and receiving front-end device transmits data packets in a UDP mode, so that each real-time data transmitting and receiving front-end device can transmit data in the cache in a high frequency mode.
After each reading is completed by the receiving engine module 11, the real-time transceiving front end requests each satellite stand-alone to send a new data packet. Each front-end device for receiving and transmitting data in real time communicates with the single satellite machine by using different frequencies. The address serial numbers of the front-end devices for transmitting and receiving data in real time are different. The receiving engine distinguishes data packets sent by the real-time data receiving and sending front-end device according to the address serial number. During sending, each real-time data receiving and sending front-end device converts data packets with different frequencies into a data packet with a unique address code identification. This address code serves as a packet identifier.
After the receiving engine module 11 reads the packet identifier, it converts the packet identifier into a frequency coding command. The receiving engine module 11 sends the frequency encoding instruction to the meta storage module 31. The reception engine module 11 transmits the received packets to the metadata factory module 12 at a reception timing.
The meta-storage module 31 sends the record dividing bits mapped by the frequency code to the metadata factory module 12 according to the frequency code command. The data packets transmitted from the real-time data-transceiving front-end device are processed using the record dividing bits, so that the data packets transmitted from the real-time data-transceiving front-end device can be quickly parsed into data records after entering the metadata factory 12. The metadata factory module 12 analyzes the data packet according to the read-in record division number, and generates a data record table. Each data record analyzed from the same frequency encoding data packet is classified into the data record in the same subsequent processing mode.
The metadata factory module 12 parses the once read data packet and generates a data record table called completing the once parsing. After the primary analysis is completed, the metadata factory module 12 sends various data records, frequency codes, and the analysis relationship between the data records and the frequency codes to the real-time storage device 2. The classification of each data record parsed from the same frequency-encoded data packet into data records in the same subsequent processing mode is realized in the following manner. The parsed data records from the different frequency encodings are sent by the metadata factory module 12 to different buffers of the real-time storage 2. The data records parsed from the same frequency encoding are sent by the metadata factory module 12 to the same buffer of the real-time storage device 2.
The real-time storage device 2 stores the data records of different buffer areas into different areas of the value storage module 32 and reads back the value storage address serial number of the first character of each data record. The sum of the numerical value storage address serial number of the first character of each data record and the record dividing digit minus 1 is the numerical value storage address serial number of the tail character of each data record. Then, the real-time storage device 2 converts the numerical value storage address serial number of the first character of each data record, the frequency code into the relation instruction data. Such relationship instruction data is stored in the relationship storage module 33.
In order to quickly store a plurality of data packets sent from a single machine in a classified manner in the value storage module 33, the real-time storage device 2 stores data records of different buffer areas in different areas of the value storage module 32 and reads back the numerical value storage address sequence number of the first character of each data record.
As shown in fig. 2, in order to analyze the stored data, the present invention adds an analysis module 5 to the data storage machine. First, the analysis module 5 reads the relation instruction from the relation storage module 33 and compiles the relation instruction into a numerical value storage address serial number and a frequency code. Secondly, the analysis module 5 reads in field dividing digit and record dividing digit from the meta-storage module 31 according to the frequency coding, and respectively records the field dividing digit and the record dividing digit into a field digit cache and a record digit cache of the analysis module; the analysis module 5 reads data from the value storage module 32 according to the value storage module address identified by the value storage address serial number and places the value storage address serial number in the address read cache of the analysis module 5. The analysis module 5 identifies the tab according to the number of field divisions. If the numerical value storage address serial number read by the analysis module 5 minus the numerical value storage address serial number stored in the address reading cache is equal to the record dividing digit, the data analysis module outputs a new record, and places the numerical value storage address serial number of the new record first character in the address reading cache of the data analysis module. Finally, the analysis module 5 outputs the data record table with the tab character, generates the table and completes the data analysis.
Since the analysis module 5 processes the classified data packets, it is not necessary to read the number of field division bits and record the number of division bits from the meta-storage module 31 according to the frequency code repeatedly. Thus, the analysis module 5 processes data at a much greater rate than the metadata factory module 12. Through classified storage, the data of the same type are combined, and the calling frequency of the analysis module 5 to the meta storage module 31 is reduced, so that the later data analysis work is more efficient.
All the satellite single machines and the real-time data receiving and transmitting front-end device 4 are communicated once per second, and the time that the data packets occupy the satellite single machine cache can be shortened. The occupied time of the single satellite unit cache is shortened, and the method is favorable for accurately receiving the data transmitted by the single satellite unit.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (3)
1. A data storage machine for a satellite is characterized by being arranged on a ground command station and comprising a real-time data receiving and transmitting front-end device, a data classifying device, a real-time storage device and a database device;
the real-time data receiving and transmitting front-end device is used for registering single satellite unit downlink data; the data classification device comprises a receiving engine module and a metadata factory module; the database device consists of a meta storage module, a relation storage module and a numerical value storage module;
the meta-memory module provides record dividing bits and field dividing bits mapped by the frequency codes; the numerical value storage module stores data sent by a single satellite and feeds back a numerical value storage address; the relation storage module records a numerical value storage address and an mapping relation between the numerical value storage address and the frequency code;
the receiving engine module scans the real-time data receiving and transmitting front-end device according to the frequency codes, reads the data packets and sends the data packets to the metadata factory module; the metadata factory module reads in a record dividing digit from the metadata storage module according to the frequency codes, analyzes the data packet according to the record dividing digit and generates a data record table;
the data record analyzed by different frequency codes is sent to different cache regions of the real-time storage device by the metadata factory module; the data record analyzed by the same frequency codes is sent to the same cache region of the real-time storage device by the metadata factory module;
the real-time storage device stores the data record tables of different cache areas into different areas of the numerical value storage module and reads back the storage address of the first character and the last character of each data record table in the numerical value storage module; then, the real-time storage device converts the storage address of the first character and the last character of the data record list into the mapping relation with the frequency code, and the mapping relation is stored in the relation storage module.
2. The data storage machine for a satellite of claim 1, further comprising an analysis device; the analysis device firstly reads the relation storage module to obtain the storage address of the data table in the numerical value storage module and the mapping relation between the data recording table and the frequency code; secondly, reading in record dividing digits and field dividing digits from the meta-storage module according to the mapping relation between the data record list and the front-end frequency codes, and generating a tabulation mode; and thirdly, making a table from the data read from the numerical value storage module according to the table making mode and the storage address of the numerical value storage module.
3. The data storage machine for a satellite of claim 2, wherein the frequency of transceiving of the real-time transceiving data front-end device is once per second.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610898429.6A CN106549702B (en) | 2016-10-14 | 2016-10-14 | Data storage machine for satellite |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610898429.6A CN106549702B (en) | 2016-10-14 | 2016-10-14 | Data storage machine for satellite |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106549702A CN106549702A (en) | 2017-03-29 |
| CN106549702B true CN106549702B (en) | 2020-05-19 |
Family
ID=58369156
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610898429.6A Expired - Fee Related CN106549702B (en) | 2016-10-14 | 2016-10-14 | Data storage machine for satellite |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106549702B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1606097A (en) * | 2003-10-08 | 2005-04-13 | 三星电子株式会社 | Flash memory control apparatus, memory management method, and memory chip |
| CN101354829A (en) * | 2008-09-12 | 2009-01-28 | 航天东方红卫星有限公司 | Satellite telemetering data transmission method |
| CN102037651A (en) * | 2007-12-13 | 2011-04-27 | 日本电气株式会社 | Decoding device, data storage device, data communication system, and decoding method |
| JP2014071704A (en) * | 2012-09-28 | 2014-04-21 | Kubota Corp | Farm work information management device and farm work information management system |
| CN105141352A (en) * | 2015-07-24 | 2015-12-09 | 哈尔滨工业大学 | Satellite high-speed data transmission baseband data error statistics and frame sequencing processing system and method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR19980022610U (en) * | 1996-10-29 | 1998-07-25 | 이언칠 | Beverage container with canister |
-
2016
- 2016-10-14 CN CN201610898429.6A patent/CN106549702B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1606097A (en) * | 2003-10-08 | 2005-04-13 | 三星电子株式会社 | Flash memory control apparatus, memory management method, and memory chip |
| CN102037651A (en) * | 2007-12-13 | 2011-04-27 | 日本电气株式会社 | Decoding device, data storage device, data communication system, and decoding method |
| CN101354829A (en) * | 2008-09-12 | 2009-01-28 | 航天东方红卫星有限公司 | Satellite telemetering data transmission method |
| JP2014071704A (en) * | 2012-09-28 | 2014-04-21 | Kubota Corp | Farm work information management device and farm work information management system |
| CN105141352A (en) * | 2015-07-24 | 2015-12-09 | 哈尔滨工业大学 | Satellite high-speed data transmission baseband data error statistics and frame sequencing processing system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106549702A (en) | 2017-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102510323B (en) | Frame identifying method for serial data | |
| US7770091B2 (en) | Data compression for use in communication systems | |
| US9258013B1 (en) | Data compression with Huffman code on multicore processors | |
| CN104040977B (en) | The method and apparatus of caching message | |
| CN104156400B (en) | The storage method and device of a kind of mass network flow data | |
| US9836248B2 (en) | In-memory data compression complementary to host data compression | |
| CN103346800B (en) | A kind of data compression method and device | |
| EP3217293B1 (en) | Method for retrieving encrypted graph, system for retrieving encrypted graph, and computer | |
| CN104517086B (en) | ID card information read method | |
| CN107241417A (en) | A kind of method, system, transmitting terminal and the receiving terminal of file transmission | |
| CN105657677A (en) | Short message sending method, short message gateway and service platform | |
| CN106549702B (en) | Data storage machine for satellite | |
| CN112559482B (en) | Binary data classification processing method and system based on distribution | |
| CN103530375A (en) | Method and device for data source matching | |
| CN105975498A (en) | Data query method, device and system | |
| CN110912841B (en) | SRIO protocol control character and data packet separation system facing 128bit width | |
| CN109587550B (en) | Channel searching method and device | |
| US9197243B2 (en) | Compression ratio for a compression engine | |
| EP2981081B1 (en) | Methods and devices for coding and decoding depth information, and video processing and playing device | |
| CN114363304B (en) | RTP video stream storage and playing method and device | |
| US8854234B1 (en) | Decompression circuit and associated decompression method | |
| US11907682B2 (en) | Device and method for generating a random number drawn according to a nonuniform distribution | |
| EP3125543A1 (en) | Intelligent information transmission method, system and apparatus | |
| CN105589969A (en) | Data processing method and device | |
| WO2018059509A1 (en) | Channel searching method and system for television terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200519 Termination date: 20211014 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |