CN113438282A - Data transmission method and device based on FTP (file transfer protocol) and data transmission server - Google Patents
Data transmission method and device based on FTP (file transfer protocol) and data transmission server Download PDFInfo
- Publication number
- CN113438282A CN113438282A CN202110628800.8A CN202110628800A CN113438282A CN 113438282 A CN113438282 A CN 113438282A CN 202110628800 A CN202110628800 A CN 202110628800A CN 113438282 A CN113438282 A CN 113438282A
- Authority
- CN
- China
- Prior art keywords
- data
- data transmission
- module
- processed
- ftp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/18—Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
Abstract
The invention relates to a data transmission method, a device and a data transmission server based on an FTP protocol, wherein for a data providing end providing first data, when the data providing end needs to transmit the first data to a gateway through a network to which the data providing end belongs, the data providing end can be realized through a data access module, a data processing module and an FTP protocol module which are arranged in the data transmission server in the network. That is to say, in the present application, a data transmission server including a data access module, a data processing module, and an FTP protocol module may be deployed, and a function related to FTP protocol transmission in the FTP server is migrated to the data transmission server, so that the data transmission server in the embodiment of the present application may have functions of both the data transmission server and the FTP server in the prior art, and data transmission performance between networks may be improved.
Description
Technical Field
The present application belongs to the field of data transmission, and in particular, to a data transmission method and apparatus based on an FTP (File Transfer Protocol) Protocol, and a data transmission server.
Background
Due to the requirement of information security, an internal network and an external network exist in many application scenarios, and a gatekeeper is arranged between the internal network and the external network to form physical isolation.
In the prior art, when a file ferry gateway is used for cross-network data transmission, a data transmission server and an FTP server need to be deployed in both an internal network and an external network in order to ensure that data transmission can be performed between the internal network and the external network.
When data transmission is required between the two networks, an application a serving as a data providing end in one of the networks (assumed to be the network a) transmits data to be transmitted to an FTP server a deployed in the network a through the network a for storage, the gatekeeper further transfers the data to be transmitted stored in the FTP server a to an FTP directory corresponding to an FTP server B deployed in the other network (assumed to be the network B), and the data transmission server B deployed in the network B downloads the data to be transmitted from the FTP server B through the network and transmits the data to an application B serving as a data receiving end in the network B.
Although the above mechanism can implement data interaction between applications in two networks with physical isolation, the process of transmitting data to be transmitted to the gatekeeper by the application a in the network a must depend on the FTP server a and the data transmission server a deployed in the network a; and the process that the application B in the network B acquires the data to be transmitted from the gatekeeper must depend on the FTP server B and the data transmission server B deployed in the network B, that is, the FTP server and the data transmission server need to be deployed in each network located on both sides of the gatekeeper, which undoubtedly consumes a large amount of memory resources and network transmission overhead, thereby affecting the performance of data transmission.
Disclosure of Invention
In view of the above, an object of the present application is to provide a data transmission method, an apparatus and a data transmission server based on the FTP protocol, which can improve data transmission efficiency between networks for a network with physical isolation, and further improve data transmission performance.
The embodiment of the application is realized as follows:
in a first aspect, an embodiment of the present application provides a data transmission method, which is applied to a data transmission server, where a data transmission service is deployed in the data transmission server, the data transmission service includes a data access module, a data processing module, and an FTP protocol module, and the method includes: acquiring first data sent by a data providing end through the data access module, wherein the data access module supports a plurality of transmission protocols different from an FTP protocol; processing the first data through the data processing module, and sending the processed first data to the FTP protocol module; storing the processed first data to a memory corresponding to the data transmission service through the FTP protocol module so that the gatekeeper reads the processed first data from the memory corresponding to the data transmission service; the data access module, the data processing module and the FTP protocol module run in the same process.
That is to say, in the present application, by deploying a data transmission server including a data access module, a data processing module and an FTP protocol module, a function related to FTP protocol transmission in the FTP server may be migrated to the data transmission server, so that the data transmission server in the embodiment of the present application may have functions of both the data transmission server and the FTP server in the prior art. When the data providing end transmits the first data to the gatekeeper, the FTP server in the network to which the data providing end belongs does not need to be started, and even the FTP server does not need to be additionally deployed in the network.
Because the server needs to consume a large amount of memory resources for starting and running, in the embodiment of the application, the data providing end does not rely on the FTP server to transmit the first data to the gatekeeper, so that memory consumption (memory consumption for deploying and starting the FTP) can be reduced, and the data transmission performance is further improved. In addition, in the prior art, the first data needs to be transmitted between the data transmission server and the FTP server through a network, and there is a network transmission overhead. In the embodiment of the present application, because the data access module, the data processing module, and the FTP protocol module run in the same process in the data transmission server, the first data may be transmitted through the data transmission channel in the process among the three modules, and the first data does not need to be transmitted through the network transmission channel.
With reference to the embodiment of the first aspect, in a possible implementation manner, the data access module includes multiple sub-modules, and the sub-modules correspond to transmission protocols supported by the data access module one to one; the obtaining of the first data sent by the data providing end through the data access module includes: and accessing the first data sent by the data providing terminal through a sub-module corresponding to the transmission protocol used by the first data.
With reference to the embodiment of the first aspect, in a possible implementation manner, the storing the processed first data in a memory corresponding to the data transmission service includes: and storing the processed first data to a virtual memory file system corresponding to the data transmission service, so that the gatekeeper reads the processed first data from the virtual memory file system corresponding to the data transmission service.
With reference to the embodiment of the first aspect, in a possible implementation manner, the processing the first data includes: and converting the first data into data transmitted based on the FTP protocol.
With reference to the embodiment of the first aspect, in one possible implementation manner, the method further includes: acquiring second data sent by the gatekeeper through the FTP protocol module; and processing the second data through the data processing module, and sending the processed second data to the data access module.
With reference to the embodiment of the first aspect, in a possible implementation manner, the processing the second data includes: and converting the second data into an original data transmission protocol used by an original provider of the second data.
With reference to the embodiment of the first aspect, in a possible implementation manner, the data access module includes multiple sub-modules, and the sub-modules correspond to transmission protocols supported by the data access module one to one; the sending the processed second data to the data access module includes: and sending the processed second data to a sub-module corresponding to the original data transmission protocol used by the original provider of the second data in the data access module according to the original data transmission protocol used by the original provider of the second data.
With reference to the embodiment of the first aspect, in a possible implementation manner, after the sending the processed second data to the data access module, the method further includes: and sending the processed second data to a data receiving end corresponding to the original data transmission protocol used by the original providing end of the second data in the data receiving end according to the original data transmission protocol used by the original providing end of the second data.
In a second aspect, an embodiment of the present application provides a data transmission device, which is applied to a data transmission server, where a data transmission service is deployed in the data transmission server, the data transmission service includes a data access module, a data processing module, and an FTP protocol module, and the data access module, the data processing module, and the FTP protocol module operate in the same process; the device comprises: the device comprises an acquisition unit, a sending unit and a storage unit.
The acquisition unit is used for acquiring first data sent by a data providing end through the data access module, and the data access module supports a plurality of transmission protocols different from an FTP protocol;
the sending unit is used for processing the first data through the data processing module and sending the processed first data to the FTP protocol module;
and the storage unit is used for storing the processed first data to the memory corresponding to the data transmission service through the FTP protocol module so as to enable the gatekeeper to read the processed first data from the memory corresponding to the data transmission service.
With reference to the embodiment of the second aspect, in a possible implementation manner, the data access module includes a plurality of sub-modules, and the sub-modules correspond to the transmission protocols supported by the data access module one to one; the obtaining unit is configured to access the first data sent by the data providing terminal through a sub-module corresponding to a transmission protocol used by the first data.
With reference to the second aspect embodiment, in a possible implementation manner, the storage unit is configured to store the processed first data in a virtual memory file system corresponding to the data transmission service, so that the gatekeeper reads the processed first data from the virtual memory file system corresponding to the data transmission service.
With reference to the second aspect, in a possible implementation manner, the sending unit is configured to convert the first data into data that is transmitted based on the FTP protocol.
With reference to the second aspect, in a possible implementation manner, the obtaining unit is further configured to obtain, by the FTP module, second data sent by the gatekeeper through the FTP protocol;
the sending unit is further configured to process the second data through the data processing module, and send the processed second data to the data access module.
With reference to the second aspect, in a possible implementation manner, the sending unit is configured to convert the second data into an original data transmission protocol used by an original providing end of the second data.
With reference to the embodiment of the second aspect, in a possible implementation manner, the data access module includes a plurality of sub-modules, and the sub-modules correspond to the transmission protocols supported by the data access module one to one; the sending unit is configured to send the processed second data to a sub-module, corresponding to an original data transmission protocol used by an original provider of the second data, in the data access module according to the original data transmission protocol used by the original provider of the second data.
With reference to the second aspect, in a possible implementation manner, the sending unit is further configured to send the processed second data to a data receiving end, corresponding to an original data transmission protocol used by an original providing end of the second data, in a data receiving end according to the original data transmission protocol used by the original providing end of the second data.
In a third aspect, an embodiment of the present application further provides a data transmission server, including: a memory and a processor, the memory and the processor connected; the memory is used for storing programs; the processor calls a program stored in the memory to perform the method of the first aspect embodiment and/or any possible implementation manner of the first aspect embodiment.
In a fourth aspect, the present application further provides a non-transitory computer-readable storage medium (hereinafter, referred to as a computer-readable storage medium), on which a computer program is stored, where the computer program is executed by a computer to perform the method in the foregoing first aspect and/or any possible implementation manner of the first aspect.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the embodiments of the application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and drawings.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts. The foregoing and other objects, features and advantages of the application will be apparent from the accompanying drawings. Like reference numerals refer to like parts throughout the drawings. The drawings are not intended to be to scale as practical, emphasis instead being placed upon illustrating the subject matter of the present application.
Fig. 1 shows a schematic structural diagram of a data transmission server according to an embodiment of the present application.
Fig. 2 shows a flowchart of a data transmission method provided in an embodiment of the present application.
Fig. 3 illustrates a network architecture for data transmission according to an embodiment of the present application.
Fig. 4 shows a block diagram of a data transmission apparatus according to an embodiment of the present application.
Reference numerals: 100-a data transmission server; 110-a processor; 120-a memory; 130-a data transceiver; 400-a data transmission device; 410-an obtaining unit; 420-a transmitting unit; 430-memory cell.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, relational terms such as "first," "second," and the like may be used solely in the description herein to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
In addition, the defects (consumption of a large amount of memory resources and network transmission overhead, which affect the performance of data transmission) existing in the prior art when data transmission is performed on two physically isolated networks are the results obtained after the applicant has practiced and studied carefully, and therefore, the discovery process of the above defects and the solutions proposed in the following embodiments of the present application for the above defects should be the contributions of the applicant to the present application in the process of the present application.
In order to solve the above problem, embodiments of the present application provide a data transmission method and apparatus based on an FTP protocol, and a data transmission server, which can improve data transmission efficiency between networks for a network with physical isolation, so as to upgrade data transmission performance.
The technology can be realized by adopting corresponding software, hardware and a combination of software and hardware. The following describes embodiments of the present application in detail.
First, a data transmission server 100 for implementing the data transmission method and apparatus according to the embodiment of the present application is described with reference to fig. 1.
Among them, the data transmission server 100 may include: processor 110, memory 120, data transceiver 130.
It should be noted that the components and structure of the data transmission server 100 shown in fig. 1 are exemplary only, and not limiting, and the data transmission server 100 may have other components and structures as needed.
The processor 110, memory 120, data transceiver 130, and other components that may be present in the data transmission server 100 are electrically connected to each other, directly or indirectly, to enable the transmission or interaction of data. For example, the processor 110, the memory 120, the data transceiver 130, and other components that may be present may be electrically connected to each other via one or more communication buses or signal lines.
The data transceiver 130 is used for transceiving data to be transmitted, such as files, documents, instructions, and the like.
The memory 120 is used for storing programs, and may be used for storing application programs corresponding to a data transfer service, for example.
In the embodiment of the present application, the data transmission service may include a data access module, a data processing module, and an FTP protocol module.
It is worth pointing out that the data access module, the data processing module and the FTP protocol module should be understood as software virtual modules, which are also program codes in nature, and the data access module, the data processing module and the FTP protocol module run in the same process.
Further, the memory 120 may also store a program corresponding to a data transmission method appearing later or a data transmission device appearing later. Optionally, when a data transmission device is stored in the memory 120, the data transmission device includes at least one software functional unit that can be stored in the memory 120 in the form of software or firmware (firmware).
Alternatively, the software functional unit included in the data transmission device may also be solidified in an Operating System (OS) of the data transmission server 100.
The processor 110 is adapted to execute executable modules stored in the memory 120 and executable units, such as software functional units or computer programs comprised by the data transmission device. When the processor 110 receives the execution instruction, it may execute the computer program, for example, to perform: acquiring first data sent by a data providing end through the data access module, wherein the data access module supports a plurality of transmission protocols different from an FTP protocol; processing the first data through the data processing module, and sending the processed first data to the FTP protocol module; storing the processed first data to a memory corresponding to the data transmission service through the FTP protocol module so that the gatekeeper reads the processed first data from the memory corresponding to the data transmission service; the data access module, the data processing module and the FTP protocol module run in the same process.
Of course, the method disclosed in any of the embodiments of the present application can be applied to the processor 110, or implemented by the processor 110.
The data transmission method provided by the present application will be described with reference to fig. 2.
The embodiment of the present application provides a data transmission method applied to the data transmission server, where a network to which the data transmission server belongs is located at one side of a gatekeeper, and the method may include the following steps:
step S110: and acquiring first data sent by a data providing end through the data access module, wherein the data access module supports a plurality of transmission protocols different from the FTP protocol.
The data providing end often sends data by a protocol different from the FTP, and the protocols used by different data providing ends to send data are different. Therefore, the data access module of the data transmission service can support multiple transmission protocols to access data provided by different data providing terminals.
Step S120: and processing the first data through the data processing module, and sending the processed first data to the FTP protocol module.
The data processing module can convert data different from the FTP protocol into data conforming to the FTP protocol.
Step S130: and storing the processed first data to a memory corresponding to the data transmission service through the FTP protocol module so that the gatekeeper reads the processed first data from the memory corresponding to the data transmission service.
The FTP protocol module can store data conforming to the FTP protocol into a memory corresponding to the data transmission service, and waits for the gatekeeper to read the processed data from the memory corresponding to the data transmission service through the gatekeeper ferrying program.
The data access module, the data processing module and the FTP module run in the same process (which may be regarded as a process corresponding to the same data transmission service) in the data transmission server.
In the prior art, when a data provider providing first data needs to transmit the first data to a gatekeeper through a network to which the data provider belongs, the data provider needs to implement the first data through a data transmission server and an FTP server in the prior art.
In the prior art, the demand of the gatekeeper for the FTP server is only that the gatekeeper needs to interact with the application program through the FTP protocol, and other functions of the FTP server, such as a data storage function and the like, do not need to be used. In contrast, the FTP protocol is realized in the data transmission server, and the requirement that the gatekeeper and the data transmission server perform data interaction through the FTP protocol can be met, so that the additional arrangement of the FTP server is not needed.
In the embodiment of the present application, when a data provider providing first data needs to transmit the first data to a gatekeeper through a network to which the data provider provides the first data, the data provider may be implemented according to the processes described in the above step S110 to step S140 by a data access module, a data processing module, and an FTP protocol module included in a data transmission server deployed in the network.
That is to say, in the present application, by deploying a data transmission server including a data access module, a data processing module and an FTP protocol module, a function related to FTP protocol transmission in the FTP server is migrated to the data transmission server, and the FTP protocol is implemented in the data transmission server, so that the data transmission server in the embodiment of the present application may have functions of both the data transmission server and the FTP server in the prior art. When the data providing end transmits the first data to the gatekeeper, the FTP server in the network to which the data providing end belongs does not need to be started, and even the FTP server does not need to be additionally deployed in the network.
It can be understood that a large amount of memory resources are consumed for starting and operating the server, and in the embodiment of the present application, the data providing end does not rely on the FTP server to transmit the first data to the gatekeeper, so that memory consumption (memory consumption for deploying and starting FTP) can be reduced, and data transmission performance is improved.
In addition, in the prior art, the first data needs to be transmitted between the data transmission server and the FTP server through a network, and there is a network transmission overhead. In the embodiment of the present application, because the data access module, the data processing module, and the FTP protocol module run in the same process in the data transmission server, the first data may be transmitted through the data transmission channel in the process among the three modules, and the first data does not need to be transmitted through the network transmission channel.
For the sake of more clearly describing the present embodiment, please refer to fig. 3, which assumes that a network architecture exists, including network a, network B and gatekeeper. The network gate is arranged between the network A and the network B, so that physical isolation exists between the network A and the network B.
The network A has at least one application and a data transmission server A deployed in advance, and the network B has at least one application and a data transmission server B deployed in advance.
For the situations described in the above steps S110 to S140, it can be considered that the application a in the network a needs to transmit the first data to the application B in the network B, and based on this, the application a serving as the data providing end needs to first send the first data to the data transmission server a, so that the data transmission server a can transmit the first data to the gatekeeper based on the steps S110 to S140; subsequently, the gatekeeper bridges the first data to the network B, and then sends the first data to the application B by the data transmission service of the network B (i.e., the process corresponding to the solid arrow in fig. 3).
In addition, the above-mentioned situations described in step S110 to step S140 may also be regarded as that the application B in the network B needs to transmit the first data to the application a in the network a, and based on this, the application B serving as the data providing end needs to first send the first data to the data transmission server B, so that the data transmission server B can transmit the first data to the gatekeeper based on step S110 to step S140; subsequently, the gatekeeper bridges the first data to the network a, and then sends the first data to the application a by the data transmission service of the network B (i.e., the process corresponding to the dashed arrow in fig. 3).
The following describes the above steps in detail by taking the application a in the network a as a data providing end and transmitting the first data to the application B in the network B through the gatekeeper.
Step S110: and acquiring first data sent by a data providing end through the data access module, wherein the data access module supports a plurality of transmission protocols different from the FTP protocol.
In the embodiment of the present application, the data access module is mainly used for acquiring first data provided by a data providing end, that is, application a in fig. 3.
There may be a plurality of different applications in the network a, and any application in the network a may be the application a providing the first data.
It is worth pointing out that different applications may also use different transmission protocols when transmitting data, for example, TCP protocol, HTTP protocol, Kafka protocol may be used.
In order to ensure that the data access module can successfully acquire the first data transmitted based on various transmission protocols, in some embodiments, the data access module of the data transmission server may support as many transmission protocols as possible, so that the first data transmitted using various transmission protocols may be accessed.
Specifically, the data access module may include a plurality of sub-modules, and the sub-modules correspond to the transmission protocols supported by the data access module one to one, for example, the data access module may include a sub-module supporting a TCP protocol, a sub-module supporting an HTTP protocol, a sub-module supporting a Kafka protocol, and the like.
Correspondingly, after the data providing terminal provides the first data, the data access module may access the first data sent by the data providing terminal through the sub-module corresponding to the transmission protocol used by the current first data. And then, the data access module sends the first data to the data processing module.
Step S120: and processing the first data through the data processing module, and sending the processed first data to the FTP protocol module.
Because the gatekeeper can only transmit data based on the FTP protocol, and the transmission protocol used by the first data accessed by the data access module is not the FTP protocol, after the data access module accesses the first data, the data transmission server needs to perform protocol conversion on the first data through the data processing module so as to convert the first data into data transmitted based on the FTP protocol, so that the gatekeeper can successfully acquire the first data subsequently based on the FTP protocol module.
Of course, the data processing module may also have other functions, such as data compression, data decompression, etc., which are not limited herein.
Step S130: and storing the processed first data to a memory corresponding to the data transmission service through the FTP protocol module so that the gatekeeper reads the processed first data from the memory corresponding to the data transmission service.
In some embodiments, after acquiring the processed first data, the data transmission server may store the first data in a disk corresponding to the data transmission server, so that a subsequent gatekeeper may acquire the first data by reading the disk of the data transmission server.
Since the speed of the memory is faster than the speed of the disk when the memory is read and written, in some embodiments, in order to improve the data transmission efficiency, after the data transmission server obtains the processed first data, the data transmission server may store the first data in the memory corresponding to the data transmission server, so that a subsequent gatekeeper may obtain the first data by reading the memory of the data transmission server.
In an embodiment, the memory may be a virtual memory file system corresponding to a data transfer service.
It is noted that the above description is made in terms of the gatekeeper obtaining the first data from the data transmission server.
As can be seen from fig. 3, in some embodiments, the gatekeeper may also ferry (store) the acquired second data to the memory of the data transmission server a, so that the data transmission server a may acquire the second data, and at this time, the application a serves as a data receiving end.
The second data is provided by the application B as a data provider and is obtained from the data transmission server B by the gatekeeper. This process is similar to the process described above for the gatekeeper to obtain the first data from the data transmission server, and is not described here again.
The following will describe a process of the data transmission server a acquiring the second data transmitted by the gatekeeper. The process may include the steps of:
step S150: and acquiring second data sent by the gatekeeper through the FTP protocol module.
Optionally, the second data may be sent to the memory corresponding to the data transmission service in the data transmission server a through the FTP by the gatekeeper, so that the FTP module in the data transmission server a obtains the second data from the memory.
Step S160: and processing the second data through the data processing module, and sending the processed second data to the data access module.
As mentioned above, gatekeepers can only transfer data based on the FTP protocol. Therefore, the second data acquired by the data transmission server a is data transmitted based on the FTP protocol, but the original data transmission protocol used for the second data is not necessarily the FTP protocol, i.e. the second data may be subjected to protocol conversion by the data processing module in the data transmission server B.
In order to ensure that the second data acquired by the application a is the original data transmitted by the application B, the data processing module in the data transmission server a may further perform processing, such as protocol conversion, on the second data received by the FTP protocol module, so as to convert the current second data into the original data transmission protocol used by the original provider application B of the second data.
In one example, the second data using different original data transmission protocols can be converted into the original data transmission protocols thereof in the same conversion manner; in another example, the second data using different original data transmission protocols may have tags of the original data transmission protocols, and the data processing module may determine a conversion manner corresponding to the tags according to the tags, so as to convert the second data using different original data transmission protocols into the original data transmission protocols.
Of course, if the data processing module in the data transmission server B performs other processing on the second data, such as data compression, data decompression, and the like, correspondingly, the data processing module in the transmission server a may also perform corresponding inverse processing on the second data to restore the second data to the most original second data.
After obtaining the original data transmission protocol used by the original provider of the second data, the data processing module in the data transmission server a may send the processed second data to the data access module in the data transmission server a, so that the data access module sends the processed second data to the data receiving end in the network a.
In some embodiments, the data processing module in the data transmission server a sends the processed second data to a sub-module of the data transmission server a corresponding to an original data transmission protocol used by an original provider of the second data, so that the processed second data is sent to a data receiving end, namely the application a, of the data receiving ends in the network a corresponding to the original data transmission protocol used by the original provider of the second data through the original data transmission protocol used by the original provider of the second data.
As shown in fig. 4, an embodiment of the present application further provides a data transmission apparatus 400, which is applied to a data transmission server, where a data transmission service is deployed in the data transmission server, where the data transmission service includes a data access module, a data processing module, and an FTP protocol module, and the data access module, the data processing module, and the FTP protocol module operate in the same process.
The data transmission apparatus 400 may include: an acquisition unit 410, a transmission unit 420, and a storage unit 430.
An obtaining unit 410, configured to obtain first data sent by a data providing end through the data access module, where the data access module supports multiple transmission protocols different from an FTP protocol;
a sending unit 420, configured to process the first data through the data processing module, and send the processed first data to the FTP module;
the storage unit 430 is configured to store the processed first data in the memory corresponding to the data transmission service through the FTP protocol module, so that the gatekeeper reads the processed first data from the memory corresponding to the data transmission service.
In a possible implementation manner, the data access module comprises a plurality of sub-modules, and the sub-modules correspond to the transmission protocols supported by the data access module one to one; the obtaining unit 410 is configured to access the first data sent by the data providing end through a sub-module corresponding to a transmission protocol used by the first data.
In a possible implementation manner, the storage unit 430 is configured to store the processed first data in a virtual memory file system corresponding to the data transmission service, so that the gatekeeper reads the processed first data from the virtual memory file system corresponding to the data transmission service.
In a possible implementation manner, the sending unit 420 is configured to convert the first data into data that is transmitted based on the FTP protocol.
In a possible implementation manner, the obtaining unit 410 is further configured to obtain, by the FTP protocol module, second data sent by the gatekeeper through the FTP protocol;
the sending unit 420 is further configured to process the second data through the data processing module, and send the processed second data to the data access module.
In a possible implementation manner, the sending unit 420 is configured to convert the second data into an original data transmission protocol used by an original providing end of the second data.
In a possible implementation manner, the data access module comprises a plurality of sub-modules, and the sub-modules correspond to the transmission protocols supported by the data access module one to one; the sending unit 420 is configured to send the processed second data to a sub-module, corresponding to an original data transmission protocol used by an original provider of the second data, in the data access module according to the original data transmission protocol used by the original provider of the second data.
In a possible implementation manner, the sending unit is further configured to send the processed second data to a data receiving end corresponding to an original data transmission protocol used by an original providing end of the second data in a data receiving end according to the original data transmission protocol used by the original providing end of the second data.
The data transmission apparatus 400 provided in the embodiment of the present application has the same implementation principle and the same technical effect as those of the foregoing method embodiments, and for the sake of brief description, reference may be made to the corresponding contents in the foregoing method embodiments for the parts of the embodiment that are not mentioned in the description.
In addition, an embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a computer, the computer program performs the steps included in the data transmission method.
In summary, the data transmission method, the data transmission device and the data transmission server based on the FTP protocol provided in the embodiments of the present invention can be implemented by the data access module, the data processing module and the FTP protocol module included in the data transmission server deployed in the network when the data providing terminal providing the first data needs to transmit the first data to the gatekeeper through the network to which the data providing terminal belongs. That is to say, in the present application, by deploying a data transmission server including a data access module, a data processing module and an FTP protocol module, a function related to FTP protocol transmission in the FTP server may be migrated to the data transmission server, so that the data transmission server in the embodiment of the present application may have functions of both the data transmission server and the FTP server in the prior art. When the data providing end transmits the first data to the gatekeeper, the FTP server in the network to which the data providing end belongs does not need to be started, and even the FTP server does not need to be additionally deployed in the network.
Because the server needs to consume a large amount of memory resources for starting and running, in the embodiment of the application, the data providing end does not rely on the FTP server to transmit the first data to the gatekeeper, so that memory consumption (memory consumption for deploying and starting the FTP) can be reduced, and the data transmission performance is further improved.
In addition, in the prior art, the first data needs to be transmitted between the data transmission server and the FTP server through a network, and there is a network transmission overhead. In the embodiment of the present application, because the data access module, the data processing module, and the FTP protocol module run in the same process in the data transmission server, the first data may be transmitted through the data transmission channel in the process among the three modules, and the first data does not need to be transmitted through the network transmission channel.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a notebook computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application.
Claims (11)
1. A data transmission method based on FTP protocol is applied to a data transmission server, a data transmission service is deployed in the data transmission server, the data transmission service comprises a data access module, a data processing module and an FTP protocol module, and the method comprises the following steps:
acquiring first data sent by a data providing end through the data access module, wherein the data access module supports a plurality of transmission protocols different from an FTP protocol;
processing the first data through the data processing module, and sending the processed first data to the FTP protocol module;
storing the processed first data to a memory corresponding to the data transmission service through the FTP protocol module so that the gatekeeper reads the processed first data from the memory corresponding to the data transmission service;
the data access module, the data processing module and the FTP protocol module run in the same process.
2. The method of claim 1, wherein the data access module comprises a plurality of sub-modules, and the sub-modules are in one-to-one correspondence with the transmission protocols supported by the data access module; the obtaining of the first data sent by the data providing end through the data access module includes:
and accessing the first data sent by the data providing terminal through a sub-module corresponding to the transmission protocol used by the first data.
3. The method according to claim 1 or 2, wherein the storing the processed first data in the memory corresponding to the data transmission service so that the gatekeeper reads the processed first data from the memory corresponding to the data transmission service includes:
and storing the processed first data to a virtual memory file system corresponding to the data transmission service, so that the gatekeeper reads the processed first data from the virtual memory file system corresponding to the data transmission service.
4. The method according to any one of claims 1-3, wherein said processing said first data comprises:
and converting the first data into data transmitted based on the FTP protocol.
5. The method according to any one of claims 1-4, further comprising:
acquiring second data sent by the gatekeeper through the FTP protocol module;
and processing the second data through the data processing module, and sending the processed second data to the data access module.
6. The method of claim 5, wherein the processing the second data comprises:
and converting the second data into an original data transmission protocol used by an original provider of the second data.
7. The method of claim 6, wherein the data access module comprises a plurality of sub-modules, and the sub-modules correspond to the transmission protocols supported by the data access module one to one; the sending the processed second data to the data access module includes:
and sending the processed second data to a sub-module corresponding to the original data transmission protocol used by the original provider of the second data in the data access module according to the original data transmission protocol used by the original provider of the second data.
8. The method according to any of claims 5-7, wherein after said sending the processed second data to the data access module, the method further comprises:
and sending the processed second data to a data receiving end corresponding to the original data transmission protocol used by the original providing end of the second data in the data receiving end according to the original data transmission protocol used by the original providing end of the second data.
9. A data transmission device based on FTP protocol, applied to a data transmission server, where a data transmission service is deployed in the data transmission server, the data transmission service includes a data access module, a data processing module and an FTP protocol module, and the device includes:
the acquisition unit is used for acquiring first data sent by a data providing end through the data access module, and the data access module supports a plurality of transmission protocols different from an FTP protocol;
the sending unit is used for processing the first data through the data processing module and sending the processed first data to the FTP protocol module;
the storage unit is used for storing the processed first data to a memory corresponding to the data transmission service through the FTP protocol module so as to enable the gatekeeper to read the processed first data from the memory corresponding to the data transmission service;
the data access module, the data processing module and the FTP protocol module run in the same process.
10. A data transmission server, comprising: a memory and a processor, the memory and the processor connected;
the memory is used for storing programs;
the processor calls a program stored in the memory to perform the method of any of claims 1-8.
11. A computer-readable storage medium, on which a computer program is stored which, when executed by a computer, performs the method of any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110628800.8A CN113438282B (en) | 2021-06-04 | 2021-06-04 | Data transmission method and device based on FTP (file transfer protocol) and data transmission server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110628800.8A CN113438282B (en) | 2021-06-04 | 2021-06-04 | Data transmission method and device based on FTP (file transfer protocol) and data transmission server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113438282A true CN113438282A (en) | 2021-09-24 |
| CN113438282B CN113438282B (en) | 2022-09-27 |
Family
ID=77803745
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110628800.8A Active CN113438282B (en) | 2021-06-04 | 2021-06-04 | Data transmission method and device based on FTP (file transfer protocol) and data transmission server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113438282B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200906121A (en) * | 2007-07-17 | 2009-02-01 | Chunghwa Telecom Co Ltd | File and data transmission server system based on unitary interface |
| US20110010417A1 (en) * | 2009-07-08 | 2011-01-13 | Shinichiro Yoshida | Data transfer system and data transfer method |
| CN106603717A (en) * | 2016-12-31 | 2017-04-26 | 深圳市智联宝生态科技有限公司 | FTP extending method and FTP extending system supporting single data port and NAT traversal |
| CN110022295A (en) * | 2019-02-28 | 2019-07-16 | 视联动力信息技术股份有限公司 | A kind of method and view networked system of data transmission |
| CN110381093A (en) * | 2019-09-03 | 2019-10-25 | 北京旷视科技有限公司 | Method, apparatus, the system and electronic equipment of data transmission of data protocol conversion |
| US20200288540A1 (en) * | 2019-03-07 | 2020-09-10 | Alibaba Group Holding Limited | Gateway and data communication system |
-
2021
- 2021-06-04 CN CN202110628800.8A patent/CN113438282B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200906121A (en) * | 2007-07-17 | 2009-02-01 | Chunghwa Telecom Co Ltd | File and data transmission server system based on unitary interface |
| US20110010417A1 (en) * | 2009-07-08 | 2011-01-13 | Shinichiro Yoshida | Data transfer system and data transfer method |
| CN106603717A (en) * | 2016-12-31 | 2017-04-26 | 深圳市智联宝生态科技有限公司 | FTP extending method and FTP extending system supporting single data port and NAT traversal |
| CN110022295A (en) * | 2019-02-28 | 2019-07-16 | 视联动力信息技术股份有限公司 | A kind of method and view networked system of data transmission |
| US20200288540A1 (en) * | 2019-03-07 | 2020-09-10 | Alibaba Group Holding Limited | Gateway and data communication system |
| CN110381093A (en) * | 2019-09-03 | 2019-10-25 | 北京旷视科技有限公司 | Method, apparatus, the system and electronic equipment of data transmission of data protocol conversion |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113438282B (en) | 2022-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11159411B2 (en) | Distributed testing service | |
| US20200026545A1 (en) | Container login method, apparatus, and storage medium | |
| EP3734933B1 (en) | Resource acquisition method, server and storage medium | |
| EP2699024B1 (en) | Near Field Communication Device | |
| RU2689439C2 (en) | Improved performance of web access | |
| CN103106205B (en) | In the method and apparatus that mobile terminal browses file | |
| CN102053952A (en) | Method and device for converting data format of electronic book and portable electronic book reader | |
| CN112311774A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN112486074B (en) | Data processing system, method and device | |
| CN101183946A (en) | Method and system of obtaining resource listing of download file | |
| CN104378435A (en) | Method for transmitting file between browser of computing device and mobile terminal | |
| CN102739717A (en) | Downloading method, downloading proxy server and network system | |
| CN104376090A (en) | Screen synchronization equipment of browser in computing equipment and mobile terminal | |
| JP6404347B2 (en) | Execution offload | |
| CN113434249A (en) | Mirror image synchronization method and device, docker host and storage medium | |
| CN104394208A (en) | File transmission method and server | |
| CN104486371A (en) | Equipment and method for downloading file on batch | |
| JP5392553B2 (en) | Data transfer system and data transfer method | |
| WO2013140995A1 (en) | Information processing system, information processing method, communications terminal, server, control method therefor, and control program | |
| JP6381426B2 (en) | Information processing apparatus, control method, and program | |
| CN113438282B (en) | Data transmission method and device based on FTP (file transfer protocol) and data transmission server | |
| JP2003141002A (en) | Url length conversion system and program | |
| CN111131470B (en) | Terminal device, data processing method thereof and data processing system | |
| CN103729440A (en) | Method and device for having access to website | |
| CN109600452B (en) | Server cluster, message pushing method and related server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |