CN112667150A - Avionics system data remote storage method - Google Patents
Avionics system data remote storage method Download PDFInfo
- Publication number
- CN112667150A CN112667150A CN202011427344.2A CN202011427344A CN112667150A CN 112667150 A CN112667150 A CN 112667150A CN 202011427344 A CN202011427344 A CN 202011427344A CN 112667150 A CN112667150 A CN 112667150A
- Authority
- CN
- China
- Prior art keywords
- data
- data block
- server
- information table
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a remote storage method of avionics system data, which is used for solving the problem of slow remote storage of big data of the traditional avionics system. The cloud storage idea is utilized, data are divided into a plurality of data blocks, and the data blocks are respectively stored on different servers; when the client accesses the data, the access task is decomposed into a plurality of subtasks according to the characteristics of data storage, and the plurality of subtasks access the server concurrently; and returning the result of the remote data storage of the integrated subtask to the application task. When the same data block is deployed on different servers, the same data block is synchronized by the servers when the system is idle or initialized. The invention can effectively solve the problem of slow remote storage of big data by a single server, improve the real-time performance of the system and ensure the reliability of data storage.
Description
Technical Field
The invention relates to an avionics system data storage technology, in particular to a remote storage method of avionics system data.
Background
The integrated task processor (IMP) is used as a core computing processing platform for controlling and managing the avionics system, has the capabilities of high-speed information processing, data computing and large-capacity storage, and provides the avionics system with FC network information interaction capability. The comprehensive processor mainly comprises a Data Processing Module (DPM), a Central Memory Module (CMM), an input/output interface module (IOM), a Network Switching Module (NSM) and a Power Supply Module (PSM). The CMM module is used as a remote storage unit and adopts a 1+1 hot backup method. In a normal condition, only one module is used as a server to provide remote storage service, the other module is used as backup, and after the main module fails, the backup module is switched to the main module to provide remote storage service for the system. When a client remotely reads big data or a plurality of clients access data simultaneously, the remote storage service provided by a single server causes long data access time and poor real-time performance; when data is recorded, data loss can be caused due to the storage bottleneck of the single server.
Disclosure of Invention
The purpose of the invention is as follows: in an avionics system, the remote data storage service provided by a single server causes slow data storage and low real-time performance. In order to solve the problems, the invention provides a remote storage method of avionics system data, which solves the problem that a single server is slow to remotely store data, is easy to implement, improves the real-time performance of an avionics system, and ensures the reliability of storage.
The technical scheme of the invention is as follows:
the invention discloses a remote storage method of avionics system data, which utilizes the idea of cloud storage. The big data is divided into a plurality of data blocks and stored on different remote servers. When the application software accesses data, the access task is decomposed into a plurality of subtasks according to the characteristics of data storage, each subtask is responsible for accessing the data on one server, and the plurality of subtasks access the server concurrently. And finally, integrating results and data of all subtasks remotely accessing the server and returning the results and data to the application software.
Furthermore, the large data is divided into a plurality of small data blocks and stored on different servers, and the same data block can be stored on a plurality of servers.
The remote storage is divided into two parts: client and server. The client is responsible for decomposing the access task into a plurality of subtasks, and the subtasks access the data of the server concurrently; the server is responsible for providing the client with a service for accessing data and synchronizing stored data with other servers.
The remote storage of the data is completed by configuring a data information table and a data block storage information table.
Data information table: and recording the data name and the address information of the corresponding data block storage information table.
Data block storage information table: recording information stored in the data block, wherein the information stored in the data block comprises a data block number, a data block length, a data block actual effective length, a data block stored server ID, a data block stored address and a data block effective mark.
Based on the configuration, the avionics system data remote storage method specifically comprises the following steps:
1. client updating data information table and data block storage information table
When the client is initialized, acquiring a data information table and a data block storage information table from the server, and updating the local data information table and the data block storage information table; and after the data information table and the data block storage information table of the server are changed, each client is informed to update the local data information table and the data block storage information table.
2. Data block accessed by client computing
The application software transmits the accessed data name, the data starting address and the data length information to the client, and the client acquires the address of the data block storage information table of the data from the data information table according to the data name; and according to the address of the data block storage information table, acquiring data block information of the data from the data block storage information table, wherein the data block information comprises the length of the data block, the actual effective length of the data block and the like, and calculating the data block required to be accessed by the access.
3. Decomposition of client access tasks
The client calculates the number of the servers to be accessed in the current access according to the data block storage information table and the data blocks to be accessed, and divides the task into a plurality of subtasks, wherein each subtask is responsible for accessing one server; distributing the accessed data blocks for each subtask according to the principle of server load balancing; and accessing the server according to the storage address of the data block on the server.
4. Server response data service
And after receiving the data access request of the client, the server responds to the read-write request of the client and returns the result to the client. If the data is the read request and the flag bit of the data in the local data block storage information table is invalid, returning an invalid return value of the data block to the client, and if the valid flag bit is valid; the accessed data is returned to the client. And if the request is a write request, writing the data into the storage address of the data block in the server, and updating the information in the local data block information storage table, including the validity mark of the data block on the server, the actual valid length of the data block and the like.
5. Updating data block validity
After receiving the result of the server, the subtask sends a request for setting the data block as invalid to other servers if the result is a write request; and after receiving a request that the client sets the data block to be invalid, the server sets the data block mark in the local data block storage information table to be invalid.
6. Synthesis of subtask access results
And after the data access is finished by the subtask, the client integrates the result of the data access and the data and returns the result to the application software.
7. Synchronization of identical data blocks of different servers
When the system is idle or initialized, the server searches the information of the data blocks which are invalid locally and sends the requests for updating the data blocks to other servers; after receiving data updating requests of other servers, the server for updating the data blocks sends the effective contents of the related data blocks to the server requesting the data blocks; the server updates the local data by using the data on other servers and updates the data block storage information table.
8. Server failure handling
The server detects heartbeat information of other servers, updates a local data block storage information table after the other servers fail, sets the valid mark of the data block stored by the failed server as invalid, and informs all the clients of updating the data block storage information table.
The invention has the beneficial effects that: the method for storing the system remote data effectively solves the problem of low speed of providing the data remote storage by the single server, improves the real-time performance of the avionic system and ensures the reliability.
Drawings
FIG. 1 is a schematic diagram of remote data storage.
FIG. 2 is a schematic diagram of data storage.
Fig. 3 is a schematic diagram of the operation of the server.
Fig. 4 is a schematic diagram of client operation.
Detailed Description
In an avionics system, the data storage of remote data storage service provided by a single server is slow, and the real-time performance is not high. In order to solve the problems, the invention provides a remote storage method of avionics system data, which solves the problem of slow remote data storage of a single server, is easy to realize, improves the real-time performance of an avionics system, and ensures the reliability of data storage.
Based on the idea of cloud storage, big data is divided into a plurality of data blocks and stored on different remote servers. When accessing data, the access task is decomposed into a plurality of subtasks according to the characteristics of data storage, each subtask is responsible for accessing the data on one server, and the plurality of subtasks access the server concurrently. And finally, integrating results of all subtasks for remotely accessing the data and returning the results to the application software.
The remote storage of the data is completed by the support of a data information table and a data block storage information table.
Data information table: and recording the data name and the address information of the corresponding data block storage information table. The DataName represents a data name, and when 0, it indicates that the data information table is ended. The DataBlockInfoAddr indicates an address of the data block storage information table.
Data block storage information table: and recording the information stored in the data block. BlockNum represents a data block number, and represents the end of the block storage information table when the data block number is 0 xFFFFFFFF; BlockLen represents the length of the data block; valLen represents the length of the data block that is actually valid; SeverId1 represents the first server ID of the chunk store, SeverIdN represents the Nth server ID of the chunk store, and a value of 0xff indicates that the chunk is not deployed on the server; StorgeAddr1 indicates the address of the block stored on the first server, StorgeAddr N indicates the address of the block stored on the nth server, AvailableFlag1 indicates the validity of the block on the first server, 1 indicates valid, 0 indicates invalid, AvailableFlag N indicates the validity of the block on the nth server. The same data may be stored on multiple servers.
The system operation scheme is as follows:
1. client updating data information table and block storage information
When the client is initialized, acquiring a data information table and a data block storage information table from the server, and updating the local data information table and the data block storage information table; after the data information table and the data block storage information table of the server are changed, each client is informed to update the local data information table and the data block storage information table;
2. data block accessed by client computing
The application software transmits the accessed data name, the data starting address and the data length information to the client, and the client acquires the address of the data block storage information table of the data from the data information table according to the data name; according to the address of the data block storage information table, acquiring data block information of the data from the data block storage information table, wherein the data block information comprises the length of the data block, the actual effective length of the data block and the like, and calculating the data block required to be accessed by the access;
the data block to be accessed is calculated according to the initial address of the access data, the data length, the length of the data block and the actual effective length of the data block.
3. Decomposition of client access tasks
The client calculates the number of the servers to be accessed in the current access according to the data block storage information table and the data blocks to be accessed, and divides the task into a plurality of subtasks, wherein each subtask is responsible for accessing one server; distributing the accessed data blocks for each subtask according to the principle of server load balancing; accessing the server according to the storage address of the data block on the server;
4. server response data service
After receiving a data access request of the client, the server responds to a read-write request of the client and returns a result to the client; if the data is the read request and the flag bit of the data in the local data block storage information table is invalid, returning an invalid return value of the data block to the client, and if the valid flag bit is valid; returning the accessed data to the client; if the request is a write request, writing data into a storage address of the data block in the server, and updating information in a local data block information storage table, wherein the information comprises an effectiveness mark of the data block on the server, an actual effective length of the data block and the like;
5. updating data block validity
After receiving the result of the server, the subtask sends a request for setting the data block as invalid to other servers if the result is a write request; after receiving a request that a client sets a data block to be invalid, a server sets a data block mark in a local data block storage information table to be invalid;
6. synthesis of subtask access results
After the data access is completed by the subtask, the client integrates the result and the data of the data access and returns the result and the data to the application software;
7. synchronization of identical data blocks of different servers
When the system is idle or initialized, the server searches the information of the data blocks which are invalid locally and sends the requests for updating the data blocks to other servers; after receiving data updating requests of other servers, the server for updating the data blocks sends the effective contents of the related data blocks to the server requesting the data blocks; the server updates local data by using data on other servers and updates a data block storage information table;
8. server failure handling
The server detects heartbeat information of other servers, updates a local data block storage information table after the other servers fail, sets the valid mark of the data block stored by the failed server as invalid, and informs all the clients of updating the data block storage information table.
The following is the table used in this example:
TABLE 1 data information Table
| DataName | DataBlockInfoAddr |
| “FireControl” | 0x31000000 |
| “faultData” | 0x32000000 |
| “configData” | 0x33000000 |
| “MapData” | 0x34000000 |
| 0 |
Table 2 data block storage information table
| BlockNum | BlockLen | valLen | SeverIdN | StorgeAddrN | AvailableFlagN | … |
| 0 | 0x1000 | 0x1000 | 0 | 0x31000000 | 1 | … |
| 1 | 0x1000 | 0x1000 | 1 | 0x31000000 | 1 | … |
| 2 | 0x1000 | 0x100 | 0 | 0x31001000 | 1 | … |
| 3 | 0x1000 | 0 | 0xff | 0x31001000 | 0 | … |
| 0xFFFFFFFF |
Claims (4)
1. A remote storage method of avionics system data is characterized in that big data is divided into a plurality of data blocks and stored on different remote servers; when the application software accesses data, the access task is decomposed into a plurality of subtasks according to the data storage characteristics, each subtask is responsible for accessing the data on one server, and the plurality of subtasks access the server concurrently; finally, integrating the result and data of data access and returning the result and data to the application software;
the remote storage is divided into two parts: a client and a server; the client is responsible for decomposing the access task into a plurality of subtasks, and the subtasks access the data of the server concurrently; the server is responsible for providing a service for accessing data for the client and synchronizing the stored data with other servers;
the remote storage of the data is completed by configuring a data information table and a data block storage information table.
2. The method of claim 1, wherein the large data is divided into a plurality of small data blocks, and stored on different servers, and the same data block can be stored on a plurality of servers.
3. Method for the remote storage of avionics system data according to claim 1 or 2, characterized in that the data information table: recording the data name and the address information of the corresponding data block storage information table;
data block storage information table: recording information stored in the data block, wherein the information stored in the data block comprises a data block number, a data block length, a data block actual effective length, a data block stored server ID, a data block stored address and a data block effective mark.
4. The avionics system data remote storage method according to claim 1 or 2, characterized in that the avionics system data remote storage method is specifically as follows:
(1) client updating data information table and data block storage information table
When the client is initialized, acquiring a data information table and a data block storage information table from the server, and updating the local data information table and the data block storage information table; after the data information table and the data block storage information table of the server are changed, each client is informed to update the local data information table and the data block storage information table;
(2) data block accessed by client computing
The application software transmits the accessed data name, the data starting address and the data length information to the client, and the client acquires the address of the data block storage information table of the data from the data information table according to the data name; according to the address of the data block storage information table, acquiring data block information of the data from the data block storage information table, wherein the data block information comprises the length of the data block and the actual effective length of the data block, and calculating the data block required to be accessed by the access;
(3) decomposition of client access tasks
The client calculates the number of the servers to be accessed in the current access according to the data block storage information table and the data blocks to be accessed, and divides the task into a plurality of subtasks, wherein each subtask is responsible for accessing one server; distributing the accessed data blocks for each subtask according to the principle of server load balancing; accessing the server according to the storage address of the data block on the server;
(4) server response data service
After receiving a data access request of a client, a server influences a read-write request of the client and returns a result to the client; if the data is the read request and the flag bit of the data in the local data block storage information table is invalid, returning an invalid return value of the data block to the client, and if the valid flag bit is valid; returning the accessed data to the client; if the request is a write request, writing data into a storage address of the data block in the server, and updating information in a local data block information storage table, wherein the information comprises an effectiveness mark of the data block on the server and an actual effective length of the data block;
(5) updating data block validity
After receiving the result of the server, the subtask sends a request for setting the data block as invalid to other servers if the result is a write request; after receiving a request that a client sets a data block to be invalid, a server sets a data block mark in a local data block storage information table to be invalid;
(6) synthesis of subtask access results
After the data access is completed by the subtask, the client integrates the result and the data of the data access and returns the result and the data to the application software;
(7) synchronization of identical data blocks of different servers
When the system is idle or initialized, the server searches the information of the data blocks which are invalid locally and sends the requests for updating the data blocks to other servers; after receiving data updating requests of other servers, the server for updating the data blocks sends the effective contents of the related data blocks to the server requesting the data blocks; the server updates local data by using data on other servers and updates a data block storage information table;
(8) server failure handling
The server detects heartbeat information of other servers, updates a local data block storage information table after the other servers fail, sets the valid mark of the data block stored by the failed server as invalid, and informs all the clients of updating the data block storage information table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011427344.2A CN112667150A (en) | 2020-12-07 | 2020-12-07 | Avionics system data remote storage method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011427344.2A CN112667150A (en) | 2020-12-07 | 2020-12-07 | Avionics system data remote storage method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112667150A true CN112667150A (en) | 2021-04-16 |
Family
ID=75401565
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011427344.2A Pending CN112667150A (en) | 2020-12-07 | 2020-12-07 | Avionics system data remote storage method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112667150A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101118508A (en) * | 2007-08-24 | 2008-02-06 | 成都索贝数码科技股份有限公司 | Safety storage method for data |
| CN101605148A (en) * | 2009-05-21 | 2009-12-16 | 何吴迪 | The framework method of the parallel system of cloud storage |
| CN102882983A (en) * | 2012-10-22 | 2013-01-16 | 南京云创存储科技有限公司 | Rapid data memory method for improving concurrent visiting performance in cloud memory system |
| CN103577503A (en) * | 2012-08-10 | 2014-02-12 | 鸿富锦精密工业（深圳）有限公司 | Cloud file storage system and method |
| CN103729470A (en) * | 2014-01-20 | 2014-04-16 | 刘强 | Secure storage method based on different cloud storage ends |
| CN105528371A (en) * | 2014-09-30 | 2016-04-27 | 北京金山云网络技术有限公司 | Method, device, and system for executing writing task |
| CN106302659A (en) * | 2016-08-02 | 2017-01-04 | 合肥奇也信息科技有限公司 | A kind of based on cloud storage system promotes access data quick storage method |
-
2020
- 2020-12-07 CN CN202011427344.2A patent/CN112667150A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101118508A (en) * | 2007-08-24 | 2008-02-06 | 成都索贝数码科技股份有限公司 | Safety storage method for data |
| CN101605148A (en) * | 2009-05-21 | 2009-12-16 | 何吴迪 | The framework method of the parallel system of cloud storage |
| CN103577503A (en) * | 2012-08-10 | 2014-02-12 | 鸿富锦精密工业（深圳）有限公司 | Cloud file storage system and method |
| CN102882983A (en) * | 2012-10-22 | 2013-01-16 | 南京云创存储科技有限公司 | Rapid data memory method for improving concurrent visiting performance in cloud memory system |
| CN103729470A (en) * | 2014-01-20 | 2014-04-16 | 刘强 | Secure storage method based on different cloud storage ends |
| CN105528371A (en) * | 2014-09-30 | 2016-04-27 | 北京金山云网络技术有限公司 | Method, device, and system for executing writing task |
| CN106302659A (en) * | 2016-08-02 | 2017-01-04 | 合肥奇也信息科技有限公司 | A kind of based on cloud storage system promotes access data quick storage method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105765554B (en) | Distribute data on distributed memory system | |
| US8185716B2 (en) | Memory system and method for using a memory system with virtual address translation capabilities | |
| CN108509462B (en) | Method and device for synchronizing activity transaction table | |
| US20190147069A1 (en) | Metadata journal in a distributed storage system | |
| CN104580437A (en) | Cloud storage client and high-efficiency data access method thereof | |
| CN105549905A (en) | Method for multiple virtual machines to access distributed object storage system | |
| EP2534571B1 (en) | Method and system for dynamically replicating data within a distributed storage system | |
| CN101930472A (en) | Parallel query method for distributed database | |
| CN100458790C (en) | Method and system for access data base | |
| CN103312624A (en) | Message queue service system and method | |
| CN102638584A (en) | Data distributing and caching method and data distributing and caching system | |
| CN109582686B (en) | Method, device, system and application for ensuring consistency of distributed metadata management | |
| CN101470667A (en) | Method for physical internal memory allocation in assigned address range on Linux system platform | |
| CN111309266B (en) | Distributed storage metadata system log optimization system and method based on ceph | |
| CN102420814A (en) | Data access method and device, and server | |
| CN113010549B (en) | Data processing method based on remote multi-activity system, related equipment and storage medium | |
| CN114490141B (en) | High-concurrency IPC data interaction method based on shared memory | |
| CN106126374A (en) | Method for writing data, method for reading data and device | |
| US20080229333A1 (en) | Method, System And Storage Medium For Implementing A Message Board Cache System | |
| CN104317944A (en) | Formula-based concurrency control method by timestamp dynamic adjustment | |
| CN103365987B (en) | Clustered database system and data processing method based on shared-disk framework | |
| CN107832017B (en) | Method and device for improving storage IO performance of seismic data | |
| CN112667150A (en) | Avionics system data remote storage method | |
| CN112540954A (en) | Multi-level storage construction and online migration method in directory unit | |
| CN114490540B (en) | Data storage method, medium, device and computing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20210416 |
|
| WD01 | Invention patent application deemed withdrawn after publication |