CN112532728B - Deterministic airborne high-performance file transmission method and system - Google Patents
Deterministic airborne high-performance file transmission method and system Download PDFInfo
- Publication number
- CN112532728B CN112532728B CN202011377342.7A CN202011377342A CN112532728B CN 112532728 B CN112532728 B CN 112532728B CN 202011377342 A CN202011377342 A CN 202011377342A CN 112532728 B CN112532728 B CN 112532728B
- Authority
- CN
- China
- Prior art keywords
- file
- timer
- client
- server
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
- H04L47/62—Queue scheduling characterised by scheduling criteria
- H04L47/625—Queue scheduling characterised by scheduling criteria for service slots or service orders
- H04L47/6275—Queue scheduling characterised by scheduling criteria for service slots or service orders based on priority
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/61—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources taking into account QoS or priority requirements
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention provides a deterministic airborne high-performance file transmission method and a system, wherein the system comprises the following steps: the system comprises a server and at least one client, wherein at least one application software runs on the client; a long message channel and a short message channel are arranged between the server and the client; the distributed priority scheduling control mechanism based on static configuration is utilized to ensure the file transmission service quality of different security level applications; the characteristic that an airborne network resource short message channel and a long message channel coexist is utilized to control a message to go through the short message channel and a data message to go through the long message channel, and a simplified response message transmission protocol is utilized to improve the performance of file transmission. By fully utilizing short and long message resources, simplifying transmission protocol response messages, reducing file closing times, reducing data copy and improving the efficiency of airborne file transmission; and the transmission service quality of the application with different safety levels is ensured by the priority rotation scheduling of the client and the server.
Description
Technical Field
The invention belongs to the technical field of computer system software, and relates to a deterministic airborne high-performance file transmission method and system.
Background
The new generation of distributed avionics system adopts the design ideas of distributed, integrated and modularized, realizes the integration of avionics system functions in a resource sharing mode, and the data management integration (centralized and unified management of file data) is an important aspect of the integration.
Traditional file transfer protocols, such as TFTP, FTP, etc., are designed for high latency, low reliability, and general-purpose networks, and cannot meet the requirements of the airborne field in terms of supporting determinism, supporting high performance, etc.
Disclosure of Invention
The purpose of the invention is as follows: a deterministic airborne high-performance file transmission method and a system are provided, and the file transmission service quality of different security level applications is ensured by utilizing a distributed priority scheduling control mechanism based on static configuration; the characteristic that an airborne network resource short message channel and a long message channel coexist is utilized, a control message and data message separation mode (a control message is transmitted through the short message channel, a data message is transmitted through the long message channel) and a simplified response message transmission protocol are adopted, and the file transmission performance is improved.
The invention provides a deterministic airborne high-performance file transmission method in a first aspect, which is applied to a client in a transmission system, wherein the system comprises: the system comprises a server and at least one client, wherein at least one application software runs on the client; a long message channel and a short message channel are arranged between the server and the client; the method comprises the following steps:
receiving a file downloading request generated by calling a file downloading interface by application software, and sending the file downloading request to a server through a short message channel; the file downloading request carries a file name to be downloaded;
suspending an application task corresponding to a file downloading request, and starting a first file block timer, wherein the timing time of the first file block timer is the timeout time of default configuration;
when a receiving task receives data of a first file block returned by a server, copying the data of the first file block to a buffer area, clearing a timer of the first file block, creating a timer list of the rest file blocks of the file downloading request according to the actual receiving time length of the first file block, and starting a timer in the timer list;
and when all the file blocks of the file downloading request are received, the application task is suspended, and a file transmission success message is returned to the application software.
Optionally, the method further includes:
and if the timer is overtime and the file block corresponding to the timer is not received, sending a file downloading request corresponding to the file block to the server again, and restarting the timer corresponding to the file block according to the actual receiving duration of the first file block.
Optionally, before sending the file download request corresponding to the file block to the server again, the method further includes:
when the timer is overtime, determining whether the overtime times of the file blocks corresponding to the timer exceed a default configuration limit;
and if so, the application task is suspended, and a file transmission failure message is returned to the application software.
Optionally, the file downloading request further carries an application receiving buffer location; the copying data of the first file block to a buffer comprises:
copying data of the first file block to the application receive buffer location.
In a second aspect, the present invention provides a deterministic airborne high-performance file transmission method, applied to a server in a transmission system, where the system includes: the system comprises a server and at least one client, wherein at least one application software runs on the client; a long message channel and a short message channel are arranged between the server and the client; the method comprises the following steps:
step one, a receiving task scans a short message channel list to receive a file downloading request sent by at least one client according to the sequence of the priority from high to low, and the file downloading request is put into a priority queue; configuring the state of the file download request to be an unprocessed state;
step two, taking out the file downloading request with the highest priority from the priority queue;
step three, judging the state of the file downloading request; if the state of the file downloading request is an unprocessed state, entering a fourth step; if the state of the file downloading request is a processing state, entering a fifth step;
opening a file corresponding to a file name carried in the file downloading request, creating a file descriptor of the file, putting the file descriptor into an opening table and the file downloading request, recording an opening timestamp of the file, modifying the state of the file downloading request into a processing state, and putting the file downloading request back to the priority queue; returning to the step two;
step five, reading a data block from the file corresponding to the file descriptor to a long message space, and calling a long message sending interface to send the data block in the long message space to the client corresponding to the file downloading request; judging whether the file block corresponding to the file downloading request is transmitted completely; if the transmission is not finished, the file downloading request is put back to the priority queue, and the opening time stamp of the file is updated; returning to the step two; and if the transmission is finished, directly returning to the step two.
Optionally, the method further includes:
and periodically scanning and checking the opening table, and deleting the file descriptors corresponding to the files with the opening duration exceeding a preset threshold value in the opening table.
Optionally, the placing the file download request into the priority queue includes:
and for the file downloading requests with the same priority, putting the file downloading requests into a priority queue according to the sequence of the sizes of the files corresponding to the file downloading requests from small to large.
A third aspect of the invention provides a deterministic on-board high-performance file transfer system comprising a server and at least one client, said client performing the method according to any one of the first aspect, said server performing the method according to any one of the second aspect.
The invention provides a deterministic airborne high-performance file transmission method and a deterministic airborne high-performance file transmission system, which fully utilize short and long message resources, simplify transmission protocol response messages, reduce file closing times, reduce data copying and improve the airborne file transmission efficiency; and the transmission service quality of the application with different safety levels is ensured by the priority rotation scheduling of the client and the server.
Drawings
FIG. 1 is a first schematic diagram of the deterministic airborne high performance file transfer system provided by the present invention;
FIG. 2 is a schematic diagram of a server provided by the present invention;
fig. 3 is a schematic structural diagram of a deterministic airborne high-performance file transfer system provided by the present invention.
Detailed Description
To further clarify the embodiments of the present invention, the detailed description will be further exemplified with reference to the accompanying drawings.
The present invention is described in further detail below with reference to the attached drawings.
Referring to fig. 1-3, the invention provides a method for implementing a deterministic airborne high-performance file transmission system based on short message channel and long message channel mechanisms of an airborne network, aiming at the problems that avionic application software in an airborne environment has low transmission efficiency and cannot ensure application service quality of different levels during file transmission.
The current airborne network supports a short message channel and a long message channel mechanism, wherein the short message channel is a channel which can only transmit KB level messages, has the characteristics of small buffer area, multiple data copying times, support of different QoS (quality of service) and the like, is suitable for a scene of transmitting a small amount of data at a time, and needs to copy user memory data to a network memory space during communication; the long message is a channel capable of transmitting MB level messages, and the channel has a large buffer area, is low in data copy frequency, supports zero copy and is suitable for a scene of transmitting a large amount of data at a time.
In a first aspect, a method for implementing a deterministic-supported airborne high-performance file transfer system is composed of a file transfer client, a file transfer server and a high-performance file transfer protocol.
In a second aspect, an implementation method of an airborne high-performance file transfer system supporting determinacy is applied to a file transfer client, and the method includes:
receiving an application software calling file downloading interface (interface parameters comprise a file name to be downloaded and application receiving buffer), generating a file downloading request, sending the file downloading request through a short message channel, starting a first file block timer according to the default configured timeout time, and suspending an application task;
when the client receives the data of the first file block returned by the server, the timer of the first file block is cleared, a subsequent file block timer list is created according to the actual receiving time length of the first file block which is 1 time and 2 times …, and meanwhile, the timer in the subsequent file block timer list is started;
possible response processing is as follows:
(1) and for a certain file block, if the file block returns from the server within the deadline, copying the file block to a corresponding position of the application receiving buffer, and clearing the timer of the file block.
(2) If the timer is overtime and the overtime times do not exceed the default configuration limit for a certain file block, retransmitting the file downloading request of the corresponding block, and restarting the timer according to the overtime time of the 1X default configuration;
(3) and for any file block, if the timer is overtime and the overtime times exceed the default configuration limit, the application task is suspended, and the file transmission failure is returned.
(4) And when all the data blocks are returned, the application task is suspended, and the file transmission success is returned.
In a third aspect, an implementation method of an airborne high-performance file transfer system supporting determinacy is applied to a file transfer server, and the method includes:
the server receives a task, scans the short message channel list according to the priority from high to low, receives a file downloading request sent by the client, and puts the file downloading request into a corresponding priority queue.
The server processing task takes out the request with the highest priority from the priority queue to perform the following processing:
step one, determining the state of a request; the states include: an unprocessed state and a processed state; entering the step two or the step three;
if the file is in an unprocessed state and is not opened, opening the file, creating a file descriptor, putting the file descriptor into an opening table and a request, and recording a file opening time stamp; returning to the step one;
if the state is the processing state and the file is opened, directly reading a data block from the local file system to the long message space by using the file descriptor in the request, and calling a long message sending interface to send the data block in the long message space; and judging whether the file is transmitted or not, if not, modifying the state of the short message, putting the short message into a priority queue, updating the file opening timestamp, and returning to the step one.
And (3) periodically scanning and checking the file opening table by the file opening table monitoring task, closing the opened file when the (current time-opening timestamp) > exceeds a timeout threshold, and deleting the corresponding entry of the file opening table.
The priority queue queues according to the priority of the file downloading request, and queues the same priority according to the sequence from small to large of the size of the file downloading request.
The invention also provides a deterministic supported airborne high-performance file transmission method, which adopts a high-performance transmission protocol, wherein the protocol comprises the following steps:
the request message based on the short message channel comprises: source node identification, destination node identification, session number, command number, file name, file block range;
a long message channel based response message comprising: source node identification, destination node identification, session number, command number, file name, file block number, data load length, and data load.
The invention fully utilizes short and long message resources, simplifies the transmission protocol response message, reduces the closing times of the file, reduces the data copy and improves the efficiency of the transmission of the airborne file; and the transmission service quality of the application with different safety levels is ensured by the priority rotation scheduling of the client and the server.
An example of a typical application of the present invention is shown in fig. 3:
(1) typical operating environment
A distributed avionics platform, comprising: the system comprises four physical nodes, namely a general processing module GPP1, a general processing module GPP2, a large-capacity storage module MMM and a network switching module NSM, wherein FC network communication supporting short messages and long messages is used, the MMM supports a high-reliability local file system, and a partition operating system is deployed on each physical node and is provided with a debugging serial port.
GPP deploys a file transmission client, and MMM deploys a file transmission server.
(2) Configuration and configuration data generation and loading
The GPP1 configures a node identifier of 1, a role of client CLNT, a node priority of high (H), a default timeout of 200ms, a short message channel identifier of 1, and a priority of H.
The GPP2 configures a node identifier of 2, a role of CLNT, a node priority of low (L), a default timeout time of 200ms, a short message channel identifier of 2, and a priority of L.
The MMM configures a node identifier 3, the role is a server SERV, the overtime threshold value of a file open table is 1s, the short message channel identifier of 1 is 1, the priority is H, the short message channel identifier of 2 is 2, and the priority is L.
Configuration data generation and loading mode: a copy of configuration data ft.dat is generated for the three nodes and loaded into the local file systems a \ \ of GPP1, GPP2 and MMM.
(3) Application effects
a. And powering on GPP2 and MMM, transmitting the node identification 2 into GPP2 through the initialization interface, transmitting the node identification 3 into the MMM through the initialization interface, respectively loading A: \ \ ft.dat data from the local file system of the module, and completing initialization.
GPP2 loads a test program, downloads a 10GB file, and a server serial port prints the following information:
CLNT2 REPLY 1
CLNT2 REPLY 2
…
c. the addition of power on to GPP1 loads A \ \ ft.dat data from the local file system of this module through initialization interface incoming node identification 1 by GPP1 and completes initialization.
GPP1 loads a test program, downloads a 9MB file, and a server serial port prints the following information:
CLNT2 REPLY n
CLNT2 REPLY n+1
CLNT1 REPLY 1
CLNT1 REPLY 2
CLNT1 REPLY 3
CLNT1 REPLY 4
CLNT1 REPLY 5
CLNT2 REPLY n+2
CLNT2 REPLY n+3
…
printing shows that in the case of high priority, GPP1(CLNT1) preempts and interrupts the ongoing transfer of GPP2(CLNT2), and after the transfer of GPP1(CLNT1) is completed, GPP2(CLNT2) continues the transfer.
Claims (5)
1. A deterministic airborne high-performance file transmission method is applied to a client in a transmission system, and the system comprises the following steps: the system comprises a server and at least one client, wherein at least one application software runs on the client; a long message channel and a short message channel are arranged between the server and the client; characterized in that the method comprises:
receiving a file downloading request generated by calling a file downloading interface by application software, and sending the file downloading request to a server through a short message channel; the file downloading request carries a file name to be downloaded;
suspending an application task corresponding to a file downloading request, and starting a first file block timer, wherein the timing time of the first file block timer is the timeout time of default configuration;
when a receiving task receives data of a first file block returned by a server, copying the data of the first file block to a buffer area, clearing a timer of the first file block, creating a timer list of the rest file blocks of the file downloading request according to the actual receiving time length of the first file block, and starting a timer in the timer list;
and when all the file blocks of the file downloading request are received, the application task is suspended, and a file transmission success message is returned to the application software.
2. The method of claim 1, further comprising:
and if the timer is overtime and the file block corresponding to the timer is not received, sending a file downloading request corresponding to the file block to the server again, and restarting the timer corresponding to the file block according to the actual receiving duration of the first file block.
3. The method according to claim 2, wherein before sending the file download request corresponding to the file block to the server again, the method further comprises:
when the timer is overtime, determining whether the overtime times of the file blocks corresponding to the timer exceed a default configuration limit;
and if so, the application task is suspended, and a file transmission failure message is returned to the application software.
4. The method according to claim 1, wherein the file download request further carries an application reception buffer location; the copying data of the first file block to a buffer comprises:
copying data of the first file block to the application receive buffer location.
5. A deterministic on-board high-performance file transfer system, characterized in that it comprises a server and at least one client, said client executing the method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011377342.7A CN112532728B (en) | 2020-11-30 | 2020-11-30 | Deterministic airborne high-performance file transmission method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011377342.7A CN112532728B (en) | 2020-11-30 | 2020-11-30 | Deterministic airborne high-performance file transmission method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112532728A CN112532728A (en) | 2021-03-19 |
| CN112532728B true CN112532728B (en) | 2022-09-20 |
Family
ID=74995905
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011377342.7A Active CN112532728B (en) | 2020-11-30 | 2020-11-30 | Deterministic airborne high-performance file transmission method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112532728B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102307210A (en) * | 2011-01-13 | 2012-01-04 | 国云科技股份有限公司 | Data downloading system and data management and downloading method thereof |
| CN107888277A (en) * | 2017-11-17 | 2018-04-06 | 中国航空工业集团公司西安航空计算技术研究所 | Aircraft floor network system file transfer services communication means |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07253936A (en) * | 1994-01-27 | 1995-10-03 | Toshiba Corp | Time-out processing circuit and reception device using the same |
| CN100411341C (en) * | 2005-08-10 | 2008-08-13 | 华为技术有限公司 | Parallel downloading method and terminal |
| CN101686144A (en) * | 2008-09-22 | 2010-03-31 | 华为技术有限公司 | Method and system for processing data and node device |
| CN101459676B (en) * | 2008-12-31 | 2012-01-04 | 中国科学院计算技术研究所 | Message transmission frame and method based on high-speed network oriented to file system |
| CN101860423A (en) * | 2010-06-07 | 2010-10-13 | 华为技术有限公司 | Method and device for retransmission of protocol packet transmission |
| WO2014068364A1 (en) * | 2012-10-30 | 2014-05-08 | Wijetunga Sagara | Method and systems for chunk-level peer-to-peer (p2p) file sharing |
| CN108234542A (en) * | 2016-12-14 | 2018-06-29 | 中国航空工业集团公司西安航空计算技术研究所 | A kind of airborne file network implementation method |
| CN109688208B (en) * | 2018-12-12 | 2021-12-24 | 中国航空工业集团公司西安航空计算技术研究所 | Data loading method based on FC-AE-ASM message |
-
2020
- 2020-11-30 CN CN202011377342.7A patent/CN112532728B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102307210A (en) * | 2011-01-13 | 2012-01-04 | 国云科技股份有限公司 | Data downloading system and data management and downloading method thereof |
| CN107888277A (en) * | 2017-11-17 | 2018-04-06 | 中国航空工业集团公司西安航空计算技术研究所 | Aircraft floor network system file transfer services communication means |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112532728A (en) | 2021-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101365838B1 (en) | Improved distributed kernel operating system | |
| WO2020052605A1 (en) | Network slice selection method and device | |
| CN110958281B (en) | Data transmission method and communication device based on Internet of things | |
| KR101363167B1 (en) | Improved distributed kernel operating system | |
| US20240069977A1 (en) | Data transmission method and data transmission server | |
| US6760304B2 (en) | Apparatus and method for receive transport protocol termination | |
| CN111935017B (en) | Cross-network application calling method and device and routing equipment | |
| CN111107081A (en) | DPDK-based multi-process DNS service method and system | |
| CN110178341A (en) | Telecommunication network with data center deployment | |
| CN110213320B (en) | Communication connection method and device, electronic equipment and computer readable storage medium | |
| CN110661840A (en) | Management delegation of transmission and acknowledgement of frames | |
| US20010010061A1 (en) | Communication system, communication method, gateway apparatus, and client | |
| CN111245660B (en) | Network-based equipment upgrading self-adaptive transmission method | |
| CN117478709A (en) | Industrial control device, industrial control system and operation method thereof | |
| CN112988416B (en) | Message processing method, device, equipment and computer readable storage medium | |
| CN112532728B (en) | Deterministic airborne high-performance file transmission method and system | |
| CN114070578B (en) | User private network intranet intercommunication method, system, computer and storage medium | |
| CN112462647B (en) | Radio station network control system and method | |
| CN114697269A (en) | Data communication method, apparatus, device and medium | |
| CN114641014A (en) | User plane entity, configuration method, system and equipment | |
| CN110139320B (en) | Method, device, medium and terminal for processing service conflict of multi-card communication terminal | |
| CN113051027A (en) | Virtual machine flow table information sending method and device of cloud management system | |
| CN113992732B (en) | Terminal management control method, device, server and storage medium | |
| CN115208739B (en) | Cross-multi-network-area docking method and method for docking one-way network areas in safe operation and maintenance areas | |
| WO2024067148A1 (en) | Edge interconnection service execution method, apparatus and system, electronic device, and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |