CN111355785A - FTP (File transfer protocol) secure transmission system and method based on CMSP (China Mobile protocol service) - Google Patents
FTP (File transfer protocol) secure transmission system and method based on CMSP (China Mobile protocol service) Download PDFInfo
- Publication number
- CN111355785A CN111355785A CN202010104527.4A CN202010104527A CN111355785A CN 111355785 A CN111355785 A CN 111355785A CN 202010104527 A CN202010104527 A CN 202010104527A CN 111355785 A CN111355785 A CN 111355785A
- Authority
- CN
- China
- Prior art keywords
- cmsp
- ftp
- data
- server
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 61
- 238000000034 method Methods 0.000 title claims abstract description 16
- 230000001360 synchronised effect Effects 0.000 claims abstract description 18
- 238000007906 compression Methods 0.000 claims abstract description 13
- 230000006835 compression Effects 0.000 claims abstract description 13
- 230000007246 mechanism Effects 0.000 claims abstract description 8
- 238000013144 data compression Methods 0.000 claims description 3
- 238000013500 data storage Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention particularly relates to a system and a method for FTP secure transmission based on CMSP. The FTP safe transmission system based on the CMSP comprises an FTP server, an FTP client, a synchronous front-end processor, a target server and a file system, wherein data transmission is realized between the synchronous front-end processor and the target server through a CMSP message middleware; the synchronous front-end processor is internally provided with an FTP data acquisition module, the cloud message service platform sends a node CMSP SN and an FTP proxy server, and the target server is internally provided with a file receiving module. According to the system and the method for FTP safe transmission based on CMSP, data collected from an FTP server and data received by an FTP client are published to a CMSP message queue, and by means of a compression and encryption mechanism provided by CMSP high-efficiency middleware, high-efficiency and stable transmission of the data is realized, the data can be ensured not to be lost, and the safety, stability and accuracy of data transmission are ensured.
Description
Technical Field
The invention relates to the technical field of data transmission, in particular to a system and a method for FTP secure transmission based on CMSP.
Background
Ftp (file Transfer protocol), the file Transfer protocol, is the most widely used file Transfer protocol in the internet. The FTP protocol comprises a server and a client, wherein the FTP server is used for storing files, and a user can use the FTP client to access resources located on the FTP server through the FTP protocol.
At present, the traditional FTP transmission protocol all adopts "username + password", and the username and password are transmitted in the channel. However, because the FTP transmission protocol is not designed by encryption transmission, data and passwords are transmitted between the FTP client and the server in a plaintext manner, and this transmission mode poses a great threat to the security of the FTP transmission protocol, because data such as usernames and passwords may be easily captured by others during the transmission process.
The CMSP (Langchao cloud message service engine) is a high-performance message middleware in cloud and big data era, provides high-performance and high-reliability message queue service externally in a cloud service and cluster mode, and supports a big data acquisition, aggregation and exchange structure, a big data real-time processing structure and a micro-service processing structure.
The FTP safe transmission system and method based on CMSP can meet the requirements of high throughput, high efficiency, encryption, safe transmission and the like, conveniently and quickly realize data acquisition and transmission, and greatly improve the safety of data transmission.
A message queue refers to a container in which messages are sent into a queue, and used to hold messages during the delivery of the messages. The primary purpose of the queue is to provide routing and to ensure delivery of the message, and if the recipient is unavailable when the message is sent, the message queue will hold the message until it can be successfully delivered.
Based on the above situation, in order to solve the security defect in the FTP transmission process, the invention provides a system and a method for FTP secure transmission based on CMSP.
Disclosure of Invention
In order to make up for the defects of the prior art, the invention provides a simple and efficient FTP secure transmission system and method based on CMSP.
The invention is realized by the following technical scheme:
a FTP secure transmission system based on CMSP is characterized in that: the system comprises an FTP server, an FTP client, a synchronous front-end processor, a target server and a file system, wherein data transmission is realized between the synchronous front-end processor and the target server through a CMSP message middleware; the synchronous front-end processor is internally provided with an FTP data acquisition module, a CMSP SN (cloud message service platform sending node) and an FTP proxy server (CMSPftp), and the target server is internally provided with a file receiving module.
The CMSP SN (cloud message service platform sending node) is responsible for sending the message of one Topic A in the CMSP message middleware to another Topic B; the Topic B may be in the same CMSP cluster as TopicA or in a different CMSP cluster.
The FTP data acquisition module is responsible for acquiring data from the FTP server, and then encrypting and compressing the data in real time through a CMSP SN (cloud message service platform sending node) and transmitting the data to a CMSP message queue of a target server.
The FTP proxy server (CMSPftp) is responsible for receiving data from the FTP client and then transmitting the data to a CMSP message queue of a target server through a CMSP SN (cloud message service platform sending node) in a real-time encryption and compression mode.
The file receiving module is responsible for reading data from a CMSP message queue of a CMSP SN (cloud message service platform sending node), analyzing the data, and storing the file into a specified directory of a file system according to a form before sending, so that safe transmission of the data is realized.
And the synchronous front-end processor and the target server utilize a network broadband to realize data compression, encryption and safe transmission in a CMSP message middleware mode.
The target server not only supports a linux system, but also supports an HDFS (Hadoop distributed File System) distributed file system, and kudu object storage, so that mass data storage is achieved, and convenient storage of mass data is guaranteed.
The invention relates to a transmission method of an FTP safe transmission system based on CMSP, which is characterized in that: based on a CMSP (wave cloud message service platform) message middleware, data collected from an FTP server and data received by an FTP client are released to CMSP message queues, and a compression mechanism and an encryption mechanism provided by the CMSP message middleware are used for carrying out encryption compression and efficient storage among the queues, so that the secure transmission of the data is finally realized.
The invention has the beneficial effects that: according to the system and the method for FTP safe transmission based on CMSP, data collected from an FTP server and data received by an FTP client are published to a CMSP message queue, and by means of a compression and encryption mechanism provided by CMSP high-efficiency middleware, high-efficiency and stable transmission of the data is realized, the data can be ensured not to be lost, and the safety, stability and accuracy of data transmission are ensured.
Drawings
Fig. 1 is a schematic diagram of the FTP secure transmission method based on the CMSP of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects to be solved by the present invention more apparent, the present invention is described in detail below with reference to the embodiments. It should be noted that the specific embodiments described herein are only for explaining the present invention and are not used to limit the present invention.
The FTP safe transmission system based on the CMSP comprises an FTP server, an FTP client, a synchronous front-end processor, a target server and a file system, wherein data transmission is realized between the synchronous front-end processor and the target server through a CMSP message middleware; the synchronous front-end processor is internally provided with an FTP data acquisition module, a CMSP SN (cloud message service platform sending node) and an FTP proxy server (CMSPftp), and the target server is internally provided with a file receiving module.
The CMSP SN (cloud message service platform sending node) is responsible for sending the message of one Topic A in the CMSP message middleware to another Topic B; the Topic B may be in the same CMSP cluster as TopicA or in a different CMSP cluster.
The FTP data acquisition module is responsible for acquiring data from the FTP server, and then encrypting and compressing the data in real time through a CMSP SN (cloud message service platform sending node) and transmitting the data to a CMSP message queue of a target server.
The FTP proxy server (CMSPftp) is responsible for receiving data from the FTP client and then transmitting the data to a CMSP message queue of a target server through a CMSP SN (cloud message service platform sending node) in a real-time encryption and compression mode.
The file receiving module is responsible for reading data from a CMSP message queue of a CMSP SN (cloud message service platform sending node), analyzing the data, and storing the file into a specified directory of a file system according to a form before sending, so that safe transmission of the data is realized.
And the synchronous front-end processor and the target server utilize a network broadband to realize data compression, encryption and safe transmission in a CMSP message middleware mode.
The target server not only supports a linux system, but also supports an HDFS (Hadoop distributed File System) distributed file system, and kudu object storage, so that mass data storage is achieved, and convenient storage of mass data is guaranteed.
The transmission method of the FTP safe transmission system based on the CMSP is based on a CMSP (wave cloud message service platform) message middleware, data collected from an FTP server and data received by an FTP client are released to a CMSP message queue, and a compression mechanism and an encryption mechanism provided by the CMSP message middleware are used for carrying out encryption compression and efficient storage among the queues, so that the safe transmission of the data is finally realized, and the transmission method belongs to the field of unstructured data collection and unstructured data synchronization.
The transmission method of the FTP secure transmission system based on the CMSP comprises the following specific steps:
firstly, data acquisition from an FTP server:
the data are collected from the FTP server and are released to the message queue of the CMSP, and the characteristics of no data loss, no transmission leakage, no retransmission and the like can be ensured by virtue of the security authentication and encryption functions of the CMSP message middleware. Meanwhile, the CMSP is an efficient message transmission middleware, and stable and efficient message transmission can be realized based on the CMSP. The terabyte file is transmitted in a multi-level mode, and a compression and encryption mechanism provided by CMSP is used, so that safe transmission can be realized, data is guaranteed not to be lost, and the data transmission is safe, stable, accurate and rapid.
And sending the message in the CMSP of the synchronous front-end processor (acquisition end) to a CMSP message queue of a receiving end through a CMSP SN (cloud message service platform sending node). The target server (receiving end) reads data from the CMSP message queue through the file receiving module, then analyzes the data, and stores the file into the designated directory in a form before sending. Under the condition that the network bandwidth allows, the bandwidth is fully utilized, and data can be synchronized from a synchronous front-end processor (a collection end) to a target server (a receiving end) in quasi real time. The target server (receiving end) not only supports the linux system, but also supports the HDFS distributed file system and the kudu object storage, so that mass data storage is achieved, and convenient storage of mass data is guaranteed.
Secondly, receiving data from the FTP client:
and the FTP proxy server (CMSPftp) receives the data from the FTP client, performs encryption compression, efficient storage and transfer among the queues through CMSP efficient middleware, and releases the received data to a target server (receiving end) CMSP.
An FTP proxy server (CMSPftp) and a file receiving module (CMSP receiving end ftprcv) are two independent programs, wherein the FTP proxy server (CMSPftp) is responsible for receiving data from an FTP client and publishing the data to a CMSP message queue; and the CMSP receiving end ftprcv is responsible for acquiring data from the CMSP message queue and storing the data as a file in a form before sending, so that the safe transmission of the data is realized.
The FTP secure transmission system based on the CMSP is a front-end agent tool developed on the basis of CMSP high-performance service, and can collect data from an FTP server through an FTP protocol or receive data from an FTP client. The transmission method of the FTP secure transmission system based on the CMSP is different from other similar products, has the advantages that the collected or received data can be issued to the message queue of the CMSP, the performance is stable and reliable, and meanwhile, as the CMSP high-performance middleware can encrypt and compress each queue, seamless, efficient and secure data storage and transmission can be performed by means of the CMSP.
The above-described embodiment is only one specific embodiment of the present invention, and general changes and substitutions by those skilled in the art within the technical scope of the present invention are included in the protection scope of the present invention.
Claims (8)
1. A FTP secure transmission system based on CMSP is characterized in that: the system comprises an FTP server, an FTP client, a synchronous front-end processor, a target server and a file system, wherein data transmission is realized between the synchronous front-end processor and the target server through a CMSP message middleware; the synchronous front-end processor is internally provided with an FTP data acquisition module, the cloud message service platform sends a node CMSP SN and an FTP proxy server, and the target server is internally provided with a file receiving module.
2. The CMSP-based FTP secure transport system of claim 1, wherein: the cloud message service platform sending node CMSP SN is responsible for sending the message of one Topic A in the CMSP message middleware to another TopicB; the Topic B may be in the same CMSP cluster as TopicA or in a different CMSP cluster.
3. The CMSP-based FTP secure transport system of claim 2, wherein: the FTP data acquisition module is responsible for acquiring data from the FTP server, and then encrypting and compressing the data in real time and transmitting the data to a CMSP message queue of a target server through a cloud message service platform sending node CMSPSN.
4. The CMSP-based FTP secure transport system of claim 2, wherein: the FTP proxy server is responsible for receiving data from the FTP client, and then transmits the data to a CMSP message queue of a target server in a real-time encryption and compression mode through a cloud message service platform sending node CMSPSN.
5. The CMSP-based FTP secure transport system of claim 2, wherein: the file receiving module is responsible for reading data from a CMSP message queue of a cloud message service platform sending node CMSP SN, analyzing the data and storing the file into a file system specified directory according to a form before sending, so that safe transmission of the data is realized.
6. The CMSP-based FTP secure transport system of claim 1, wherein: and the synchronous front-end processor and the target server utilize a network broadband to realize data compression, encryption and safe transmission in a CMSP message middleware mode.
7. The CMSP-based FTP secure transport system of claim 1, wherein: the target server not only supports a linux system, but also supports an HDFS distributed file system, and the kudu object is stored, so that mass data can be stored, and the convenient storage of the mass data is ensured.
8. A transmission method of the FTP secure transmission system based on CMSP according to claims 1 to 7, characterized in that: and on the basis of the CMSP message middleware, releasing the data collected from the FTP server and the data received by the FTP client to a CMSP message queue, and performing encryption compression and efficient storage among the queues by using a compression and encryption mechanism provided by the CMSP message middleware to finally realize the safe transmission of the data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010104527.4A CN111355785A (en) | 2020-02-20 | 2020-02-20 | FTP (File transfer protocol) secure transmission system and method based on CMSP (China Mobile protocol service) |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010104527.4A CN111355785A (en) | 2020-02-20 | 2020-02-20 | FTP (File transfer protocol) secure transmission system and method based on CMSP (China Mobile protocol service) |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111355785A true CN111355785A (en) | 2020-06-30 |
Family
ID=71197989
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010104527.4A Pending CN111355785A (en) | 2020-02-20 | 2020-02-20 | FTP (File transfer protocol) secure transmission system and method based on CMSP (China Mobile protocol service) |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111355785A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111885203A (en) * | 2020-08-04 | 2020-11-03 | 浪潮云信息技术股份公司 | Method for remote management based on CMSP |
| CN112003944A (en) * | 2020-08-26 | 2020-11-27 | 北京浪潮数据技术有限公司 | Method, system, equipment and storage medium for uploading object file |
| CN112269820A (en) * | 2020-10-30 | 2021-01-26 | 浪潮云信息技术股份公司 | Method and platform for realizing data batch synchronization based on CMSP |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103139251A (en) * | 2011-11-29 | 2013-06-05 | 神州数码信息系统有限公司 | Method of city-level data sharing exchange platform technology |
| CN109800262A (en) * | 2018-12-18 | 2019-05-24 | 北京市天元网络技术股份有限公司 | Data share exchange method and system |
| CN110175213A (en) * | 2019-05-27 | 2019-08-27 | 浪潮软件集团有限公司 | A kind of oracle database synchronization system and method based on SCN mode |
| CN110225074A (en) * | 2019-01-04 | 2019-09-10 | 国网浙江省电力有限公司 | A kind of communication packet dissemination system and distribution method based on device address domain |
| CN110377666A (en) * | 2019-07-26 | 2019-10-25 | 浪潮软件股份有限公司 | Based on the synchronous method of data between CMSP message-oriented middleware progress different source data library |
| CN110401851A (en) * | 2019-08-28 | 2019-11-01 | 浪潮软件集团有限公司 | A kind of video transcoding method based on CMSP |
| CN110493244A (en) * | 2019-08-28 | 2019-11-22 | 浪潮软件集团有限公司 | A kind of video capture method based on CMSP |
| CN110502490A (en) * | 2019-08-30 | 2019-11-26 | 浪潮软件集团有限公司 | A kind of MongoDB database in phase system and implementation method |
| CN110674221A (en) * | 2019-09-27 | 2020-01-10 | 浪潮软件股份有限公司 | Spatial data synchronization method, terminal and computer readable storage medium |
-
2020
- 2020-02-20 CN CN202010104527.4A patent/CN111355785A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103139251A (en) * | 2011-11-29 | 2013-06-05 | 神州数码信息系统有限公司 | Method of city-level data sharing exchange platform technology |
| CN109800262A (en) * | 2018-12-18 | 2019-05-24 | 北京市天元网络技术股份有限公司 | Data share exchange method and system |
| CN110225074A (en) * | 2019-01-04 | 2019-09-10 | 国网浙江省电力有限公司 | A kind of communication packet dissemination system and distribution method based on device address domain |
| CN110175213A (en) * | 2019-05-27 | 2019-08-27 | 浪潮软件集团有限公司 | A kind of oracle database synchronization system and method based on SCN mode |
| CN110377666A (en) * | 2019-07-26 | 2019-10-25 | 浪潮软件股份有限公司 | Based on the synchronous method of data between CMSP message-oriented middleware progress different source data library |
| CN110401851A (en) * | 2019-08-28 | 2019-11-01 | 浪潮软件集团有限公司 | A kind of video transcoding method based on CMSP |
| CN110493244A (en) * | 2019-08-28 | 2019-11-22 | 浪潮软件集团有限公司 | A kind of video capture method based on CMSP |
| CN110502490A (en) * | 2019-08-30 | 2019-11-26 | 浪潮软件集团有限公司 | A kind of MongoDB database in phase system and implementation method |
| CN110674221A (en) * | 2019-09-27 | 2020-01-10 | 浪潮软件股份有限公司 | Spatial data synchronization method, terminal and computer readable storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111885203A (en) * | 2020-08-04 | 2020-11-03 | 浪潮云信息技术股份公司 | Method for remote management based on CMSP |
| CN112003944A (en) * | 2020-08-26 | 2020-11-27 | 北京浪潮数据技术有限公司 | Method, system, equipment and storage medium for uploading object file |
| CN112003944B (en) * | 2020-08-26 | 2023-02-28 | 北京浪潮数据技术有限公司 | Method, system, equipment and storage medium for uploading object file |
| CN112269820A (en) * | 2020-10-30 | 2021-01-26 | 浪潮云信息技术股份公司 | Method and platform for realizing data batch synchronization based on CMSP |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111355785A (en) | FTP (File transfer protocol) secure transmission system and method based on CMSP (China Mobile protocol service) | |
| WO2016161857A1 (en) | Multi-tenant high-concurrency instant messaging cloud platform | |
| US9906630B2 (en) | Processing data packets in performance enhancing proxy (PEP) environment | |
| Armenia et al. | A flexible phasor data concentrator design leveraging existing software technologies | |
| US9344405B1 (en) | Optimized transport layer security | |
| CN101945103B (en) | IP (Internet Protocol) network application accelerating system | |
| US10027781B2 (en) | TCP link configuration method, apparatus, and device | |
| CN105024971A (en) | Communication protocol conversion method and communication protocol conversion device | |
| CN104639625A (en) | Data concentrator acquisition control method based on MQTT (Message Queuing Telemetry Transport), data concentrator acquisition control device based on MQTT and data concentrator acquisition control system based on MQTT | |
| JP2014146349A (en) | File folder transmission on network | |
| CN103401946B (en) | HTTP uploads accelerated method and system | |
| US9614928B1 (en) | System and method for communication between networked applications | |
| JP2018508072A (en) | Method and apparatus for pushing messages | |
| US10432530B2 (en) | System and method of providing compression technique for jitter sensitive application through multiple network links | |
| CN110855634A (en) | Cross-network switching service system and method based on secure network | |
| CN103916421A (en) | Cloud storage data service device, data transmission system, server and method | |
| CN115361455B (en) | Data transmission storage method and device and computer equipment | |
| CN106612307B (en) | A kind of implementation method and device of always online business | |
| CN105791239B (en) | A kind of TCP go-between processing method | |
| CN104780171A (en) | Message transferring method, device and system | |
| CN107104964B (en) | Network security terminal and use method | |
| CA2786634C (en) | System and method for improving service subscription or unsubscription speed for wireless application protocol (wap) roaming users | |
| US20130024543A1 (en) | Methods for generating multiple responses to a single request message and devices thereof | |
| CN116781764A (en) | Long-connection task execution method and device and related equipment | |
| CN102857504B (en) | Network optimized approach and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200630 |