CN113852666B - Method for acquiring HTTP (hyper text transport protocol) resources in real time through FTP (File transfer protocol) - Google Patents
Method for acquiring HTTP (hyper text transport protocol) resources in real time through FTP (File transfer protocol) Download PDFInfo
- Publication number
- CN113852666B CN113852666B CN202110980462.4A CN202110980462A CN113852666B CN 113852666 B CN113852666 B CN 113852666B CN 202110980462 A CN202110980462 A CN 202110980462A CN 113852666 B CN113852666 B CN 113852666B
- Authority
- CN
- China
- Prior art keywords
- ftp
- http
- request
- proxy module
- source station
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000012546 transfer Methods 0.000 title description 16
- 230000004044 response Effects 0.000 claims abstract description 24
- 230000000977 initiatory effect Effects 0.000 claims abstract description 14
- 230000015654 memory Effects 0.000 claims abstract description 12
- 238000007726 management method Methods 0.000 description 20
- 230000005540 biological transmission Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 9
- 239000003795 chemical substances by application Substances 0.000 description 7
- 238000006243 chemical reaction Methods 0.000 description 4
- 230000003936 working memory Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000002347 injection Methods 0.000 description 2
- 239000007924 injection Substances 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012384 transportation and delivery Methods 0.000 description 2
- 238000012550 audit Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
- G06F16/9566—URL specific, e.g. using aliases, detecting broken or misspelled links
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/163—In-band adaptation of TCP data exchange; In-band control procedures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L2212/00—Encapsulation of packets
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a method for acquiring HTTP resources in real time through an FTP protocol. The invention provides an FTP proxy module which converts an FTP request into an HTTP request in real time and converts an HTTP response into an FTP response in real time. In the invention, a client firstly initiates an FTP request to an FTP proxy module, authentication login is completed after TCP three-way handshake connection is established, the client then initiates the FTP request to the FTP proxy module to request HTTP resources, the FTP proxy module splices a URL for initiating the HTTP request to an HTTP source station based on the FTP request, and the spliced URL initiates the request to the HTTP source station. The HTTP source station sends HTTP response to the FTP proxy module, the FTP proxy module receives and analyzes the corresponding TCP message, the FTP proxy module applies for memory, stores temporary TCP message data, encapsulates the TCP message in the FTP format and sends the TCP message to the client, and therefore the purpose of real-time HTTP source returning is achieved.
Description
Technical Field
The present invention relates to the field of file transfer, and more particularly to the field of internet file (such as picture, video, etc.) transfer.
Background
FTP was proposed in 1971 as the longest historical network tool on the internet; HTTP was proposed in 1991 as the most popular application protocol on the internet. With the continuous development of communication technology, FTP and HTTP are very important services of the internet as file transfer protocols, and are widely applied to the fields of DVB, IPTV, OTT and the like.
The DVB and IPTV technologies have been developed for more than ten years, the user scale breaks through 7 hundred million users, the stock of videos is over ten millions of hours, according to the related technical specification requirements of video injection, the work orders and the content media are transmitted through the FTP protocol by default, hundreds of operation networks exist nationwide due to the operation characteristics of the division and sub-division operators of the DVB and IPTV services, and the content media are transmitted point to point between the network platforms based on the FTP protocol, so that the deployed FTP services are initiated to be inexhaustible.
Compared with DVB and IPTV, the audio-visual entertainment files on the Internet and OTT are transmitted based on the HTTP, and on the basis of HTTP, the transmission efficiency and the effect are improved through CDN technology, so that the audio-visual entertainment services such as popular movies, short videos, self-media and the like are well received.
At present, a small number of service platforms upgrade a content injection system to be compatible with HTTP (hyper text transfer protocol) back sources, so that audio-visual entertainment content of the Internet is introduced in an HTTP back source mode, but the existing platforms are greatly improved, and many platforms do not have the improvement upgrading conditions. Therefore, how HTTP resources can be obtained in real time through the FTP protocol becomes important on the basis of not changing the existing system.
Disclosure of Invention
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
According to an embodiment of the present invention, there is provided a method for acquiring HTTP resources in real time through an FTP protocol, including: receiving an FTP request in the form of a URL; splicing a URL (uniform resource locator) for initiating an HTTP request to an HTTP source station based on the FTP request; initiating an HTTP request to the HTTP source station by using the spliced URL; receiving an HTTP response from the HTTP source station; analyzing a TCP message corresponding to the HTTP response; encapsulating the TCP message by using an FTP format; wherein the method is implemented by the FTP proxy module.
According to another embodiment of the present invention, there is provided a system for acquiring HTTP resources in real time through an FTP protocol, including: an FTP proxy module configured to: receiving an FTP request in the form of a URL; splicing a URL (uniform resource locator) for initiating an HTTP request to an HTTP source station based on the FTP request; initiating an HTTP request to the HTTP source station by using the spliced URL; receiving an HTTP response from the HTTP source station; analyzing a TCP message corresponding to the HTTP response; and encapsulating the TCP message by using an FTP format.
According to another embodiment of the present invention, there is provided a computing device for acquiring HTTP resources in real time through an FTP protocol, including: a processor; a memory storing instructions that when executed by the processor are capable of performing the method as described above.
These and other features and advantages will become apparent upon reading the following detailed description and upon reference to the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are explanatory only and are not restrictive of aspects as claimed.
Drawings
So that the manner in which the above recited features of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings. It is to be noted, however, that the appended drawings illustrate only certain typical aspects of this invention and are therefore not to be considered limiting of its scope, for the description may admit to other equally effective aspects.
FIG. 1 shows a schematic diagram 100 of a prior art system for downloading and transferring files using FTP technology;
FIG. 2 illustrates a schematic diagram 200 of a system for acquiring HTTP resources in real-time via the FTP protocol, according to one embodiment of the present invention;
FIG. 3 shows a hierarchical structure of a prior art network model;
FIG. 4 shows a prior art TCP message map;
FIG. 5 illustrates a flow chart of a method 500 for acquiring HTTP resources in real-time via the FTP protocol according to one embodiment of the present invention;
FIG. 6 shows schematic diagrams 600-1 through 600-13 for illustrating the steps of FIG. 5, according to one embodiment of the invention; and
FIG. 7 illustrates a block diagram of a computing device 700 that may be applied to hardware devices of aspects of the invention, according to an embodiment of the invention.
Detailed Description
The features of the present invention will become more apparent from the detailed description set forth below when taken in conjunction with the drawings.
Industry term interpretation:
FTP (File Transfer Protocol ) is a protocol for two computers on a network to transfer files, runs on top of TCP, is a way to transfer files from one computer to another over the Internet, and is widely used for trusted file transfer in various industries by means of a protocol's natural authentication mechanism.
HTTP (HyperText Transfer Protocol ) delivers data (HTML files, picture files, query results, etc.) based on the TCP/IP communication protocol, which is one of the most widely used network transfer protocols on the internet, and all WWW files must comply with this standard.
IPTV (Internet Protocol Television, interactive internet protocol television) is a technology that integrates various technologies such as internet, multimedia, communication, etc. into a whole by using a broadband cable television network, and provides various interactive services including digital television to home users.
The CDN (Content Delivery Network ) is an intelligent virtual network constructed on the basis of the existing network, and by means of the edge servers deployed in various places, a user can obtain required content nearby through load balancing, content delivery, scheduling and other functional modules of the center platform, network congestion is reduced, and user access response speed is improved.
In general, the existing FTP file downloading needs to be prestored and then forwarded, and the invention proposes to analyze and package the messages of the FTP and HTTP protocols based on TCP transmission in real time based on the same, so as to realize real-time conversion.
Fig. 1 shows a schematic diagram 100 of a prior art system for downloading and transferring files using FTP technology. Although HTTP has been widely used in various industries, since FTP was proposed 20 years earlier than HTTP, there still exist some businesses that need to download and transfer files via FTP. When the files are to be obtained from the Internet, the files are required to be downloaded and stored in advance, and then the FTP download service is provided, so that the large storage space is occupied, the operation time is long, and the files are not updated timely.
For example, referring to FIG. 1, there is shown an HTTP source station 101, a file management system 102, and a business system 103. Generally, business system 103 is used to provide various services, such as video services, file services, etc., to clients (such as set-top boxes, smart homes, etc.). The business system 103 receives a request from a client, and initiates a request for video, files, pictures, etc. to the file management system 102. The file management system 102 downloads and stores and manages content (e.g., video, pictures, files, etc.) from the HTTP source station 101 via HTTP, and the service system 103 obtains the content from the file management system 102 via FTP transmission.
Specifically, in the related art related to the IPTV service, the file management system 102 provides a download service module 106, an FTP service module 107, and a distributed storage module 108 in addition to a job management module 104 that manages a job ticket and a file auditing module 105 that audits files. The job ticket management module 104 is configured to manage a job ticket, which generally refers to an information list of each time a download request is initiated, such as an ID of the initiation request, time, file name of the application for downloading, and the like. The file auditing module 105 is configured to confirm whether the requested file has problems, such as illegal content. Given the internet content URL to be downloaded, the file management system 102 downloads internet content (e.g., video, pictures, files, etc.) from the HTTP source station 101 via HTTP technology through the download service module 106 in advance, and stores the downloaded content in the distributed storage module 108. The file management system 102 then publishes the content available for download in an FTP service. When the service system 103 initiates an FTP request to transfer content via the URL of the spliced FTP, the file management system 102 transfers the stored content to the service system 103 via FTP.
However, as business progresses, more and more video content is stored at the file management system 102, causing the following problems: 1. FTP storage space requirements are also increasing; 2. downloading content in advance and storing the content reduces the speed of content introduction, resulting in low service operation efficiency.
FIG. 2 illustrates a schematic diagram 200 of a system for acquiring HTTP resources in real-time via the FTP protocol, according to one embodiment of the present invention.
In contrast to the prior art of fig. 1, in the file management system 102, an FTP proxy module 201 is employed in fig. 2 instead of the download service module 106, the FTP service module 107, and the distributed storage module 107 of fig. 1. Specifically, on the premise that the URL of the internet content to be downloaded is known, when the service system 103 splices the URL of the FTP and requests transmission, the FTP proxy module 201 converts the FTP request into an HTTP request in real time, and converts the HTTP response into an FTP response in real time, thereby providing FTP transmission.
In the present invention, the FTP proxy module 201 is configured to provide real-time conversion of HTTP and FTP, i.e., to convert FTP requests into HTTP requests in real time, and to convert HTTP responses into FTP responses in real time. The implementation logic of the FTP proxy module 201 is transparent to the service system 103, and provides FTP download service for the service system 103, and can be used for downloading files such as video, pictures, installation packages, and the like on the internet. Therefore, the method replaces the mode of downloading files in advance, storing files and releasing files through FTP in the application scene in the prior art with the FTP proxy module capable of converting HTTP and FTP in real time, thereby saving storage space and improving downloading speed.
Those skilled in the art will appreciate that any module may communicate with any other module at file management system 102, but not all connections are shown for ease of illustration. Also, it is to be fully understood by one skilled in the art that the various modules described above are merely for illustrative purposes herein, and that the functionality of one or more of the modules described above may be combined into a single module or split into multiple modules. Also, one or more of the above-described modules may be implemented in software, hardware, or a combination thereof. In addition, the communication between the HTTP source station 101, the file management system 102, and the service system 103 is performed in a manner known in the art, which is not within the scope of the present invention.
It is practically feasible to implement real-time conversion of FTP and HTTP. Fig. 3 shows a hierarchical structure of a network model in the prior art. Fig. 4 shows a prior art TCP message diagram. As can be seen from fig. 3, the FTP protocol and the HTTP protocol belong to the application layer of the network model, and are both transmitted based on the TCP protocol, and the transmitted messages conform to the TCP format. The invention is realized based on TCP Socket programming, and the protocol of the upper layer of the TCP message is required to be analyzed and processed.
Fig. 5 shows a flow chart of a method 500 for acquiring HTTP resources in real time via an FTP protocol, according to one embodiment of the present invention. FIG. 6 shows schematic diagrams 600-1 through 600-13 for illustrating the steps of FIG. 5, according to one embodiment of the invention. Wherein the FTP agent module may be implemented in the file management system 102. The scheme of fig. 5 is performed in the case where the service system knows the URL of the HTTP resource to be acquired at the file management system (e.g., directory location and name at the file management).
In general, the service system firstly initiates an FTP connection establishment request to the FTP proxy module, completes authentication login after TCP three-way handshake establishment, then initiates an FTP request to the FTP proxy module to request a file, the FTP proxy module converts and splices the request URL, and initiates a request to the HTTP source station by using the spliced URL. The HTTP source station sends HTTP response to the FTP proxy module, the FTP proxy module receives and analyzes the corresponding TCP message, the FTP proxy module applies for memory, stores temporary TCP message data, encapsulates the TCP message in the FTP format, and sends the TCP message to the service system, so that the purpose of real-time HTTP source returning is achieved.
In step 501, the service system initiates an FTP connection establishment request to the FTP proxy module and establishes a TCP connection. According to one embodiment of the invention, referring to fig. 600-1, a TCP connection is established after a TCP three-way handshake.
In step 502, the ftp agent module authenticates the login of the business system. According to one embodiment of the invention, the authentication comprises: (1) the FTP agent module sends a message to the business system. For example, referring to fig. 600-2, in this message, code field 220 indicates that the new user service is ready, arg field is the server name and version number, ftpProxy 1.0 is the service name and version number of the FTP proxy module; and (2) the service system sends a request message to the FTP proxy module. For example, referring to fig. 600-3, wherein the command field indicates that the message contains a user name and the arg field is the content of the user name; and (3) the FTP proxy module replies a response message. For example, see fig. 600-4, where code value is 331, indicating that a user name exists, requiring the entry of a password for verification; and (4) the service system sends a request message to the FTP proxy module. For example, see fig. 600-5, where command field indicates that the message contains a password and arg field is the password content; and (5) the FTP proxy module replies a response message. See, for example, figures 600-6 where the code value is 230, indicating that the user has logged in and can continue operation.
In step 503, the service system establishes an FTP passive connection with the FTP proxy module. As shown in fig. 4, the present invention supports both active and passive modes of FTP, and the present invention is exemplified as a passive mode. According to one embodiment of the invention, the business system sends a request to the FTP proxy module to establish a passive connection. And the FTP proxy module responds to agree to establish the passive connection and sends the IP and the monitoring port of the FTP proxy module to the service system. According to one embodiment of the invention, see, for example, figures 600-7, where the IP address of a passive connection is: 221.228.56.5, port 10028.
In step 504, the business system sends an FTP request to the FTP proxy module to make a request for HTTP resources. According to one embodiment of the invention, the FTP request has the format of an FTP URL. According to one embodiment of the invention, the FTP request includes at least the following: the IP address and port of the FTP agent module (generally, port of the FTP agent module is 21); directory location and name of the requested HTTP resource at the file management system. For example, the FTP request may beftp:// 221.228.56.5:21/config.txt. Figures 600-8 illustrate TCP messages for the FTP request, according to one embodiment of the invention.
In step 505, the FTP proxy module concatenates the URL for initiating the HTTP request to the HTTP source based on the received FTP request. According to one embodiment of the invention, an exampleFor example, referring to FIGS. 600-8, the splice URL includes: a) Parsing the destination IP and destination port (i.e., IP address and port of FTP proxy module) of the TCP message of FTP request in step 504, for example, yields 221.228.56.5:21; b) Analyzing a Request/Rest keyword in the TCP message, and intercepting a directory after a "/" symbol through a regular expression to be a root directory, for example, the file name is config. Txt; c) Inquiring the configuration file to obtain an HTTP source station address corresponding to the destination IP, for example, 221.228.39.45:9080; d) Splicing the obtained HTTP source station address with the URL of the file directory position and name in the FTP request to obtain the URL of the HTTP source station corresponding to the HTTP resource, for example, as followshttp://221.228.39.45:9080/config.txt. According to one embodiment of the invention, the configuration file describes the correspondence between the IP of the FTP proxy module and the HTTP source station address.
In step 506, the ftp proxy module initiates an HTTP request with the spliced URL to the HTTP source station. According to one embodiment of the invention, for example, referring to fig. 600-9, the ftp proxy module establishes a TCP connection with the HTTP source station through a three-way handshake. According to another embodiment of the invention, the FTP proxy module is configured according to the common source station address in the configuration file, and selects whether to use the long connection pool, so that the time consumption for establishing connection and disconnection is reduced.
In step 507, the HTTP source station sends an HTTP response to the FTP proxy module. According to one embodiment of the invention, for example, referring to figures 600-10, the HTTP response includes file data.
In step 508, the ftp proxy module receives and parses the TCP packet corresponding to the HTTP response, and applies for the memory to store temporary data. According to one embodiment of the invention, the FTP proxy module applies for memory to store temporary TCP message data. Specifically, the FTP proxy module parses the HTTP message obtained in step 507, removes the field of the HTTP message, and stores the field temporarily. A pool of size 256 is created for each HTTP connection and a pool of size 4096 is created for each request. The memory pool is managed through the linked list and the pointer, and comprises application, occupation, statistics, release and the like. For example, graphs 600-11 illustrate a memory pool model.
In step 509, the ftp proxy module encapsulates the TCP packet and sends the encapsulated TCP packet to the client. According to one embodiment of the present invention, referring to fig. 600-12, for example, the FTP proxy module encapsulates the response data temporarily stored in step 508 into a TCP packet in an FTP format, and sends the encapsulated TCP packet to the client.
After the data transfer is completed, the TCP connection between the service system and the FTP agent is disconnected at step 510. According to one embodiment of the invention, for example, referring to figures 600-13, the TCP connection is broken by four hand swings of TCP.
Meanwhile, the invention optimizes the FTP proxy module as follows:
1. breakpoint continuous transmission: the FTP protocol realizes the breakpoint continuous transmission instruction through the REST instruction, and the HTTP protocol realizes the RANGE request through the RANGE instruction, so that the protocol conversion of the breakpoint continuous transmission function is realized on the basis of realizing the whole file transmission.
2. Hot spot caching: considering that the service system may request the same file several times in a short time, the response speed of the file can be increased by temporarily caching the hot spot file, and meanwhile, the function can be controlled to be switched by referring to the no-cache instruction of HTTP.
3. Connection multiplexing: as an agent, TCP connection needs to be continuously established with the source station, but the source station is configured by a small number, so that a long-chain pool with a designated source station is introduced, three-way handshake and four-way hand waving time are saved, and a large number of timer wait states can be prevented from being generated in a large number of concurrences, so that the channel overload is caused.
Compared with the prior art, the invention has at least the following advantages:
1) In the technical scheme of the invention, the file management system does not need to provide an FTP storage service for downloading the content media, and only needs to deploy a proxy service of the FTP, so that the storage space requirement is reduced;
2) In the technical scheme of the invention, the file management system does not need to download the file in advance, thereby saving time, improving efficiency and improving the overall transmission speed of the content medium between the network and the platform.
FIG. 7 illustrates a block diagram of a computing device 700 that may be applied to hardware devices of aspects of the invention, according to an embodiment of the invention.
With reference to FIG. 7, a computing device 700 will now be described as one example of a hardware device that may be employed with aspects of the present invention. For example, the client, proxy module, and/or HTTP source station in fig. 5 may be implemented as computing device 700. Computing device 700 may be any machine that may be configured to implement processes and/or calculations and may be, but is not limited to, a workstation, a server, a desktop computer, a laptop computer, a tablet computer, a personal digital assistant, a smart phone, a vehicle mount computer, or any combination thereof. The various methods/apparatus/servers/client devices described above may be implemented, in whole or in part, by computing device 700 or a similar device or system.
Computing device 700 may include components that may be connected or in communication with a bus 702 via one or more interfaces. For example, computing device 700 may include a bus 702, one or more processors 704, one or more input devices 706, and one or more output devices 708. The one or more processors 704 may be any type of processor and may include, but are not limited to, one or more general purpose processors and/or one or more special purpose processors (e.g., special processing chips). Input device 706 may be any type of device capable of inputting information to a computing device and may include, but is not limited to, a mouse, keyboard, touch screen, microphone, and/or remote controller. Output device 708 may be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, a video/audio output terminal, a vibrator, and/or a printer. Computing device 700 may also include or be connected to a non-transitory storage device 710, which may be non-transitory and capable of data storage, and which may include, but is not limited to, a disk drive, an optical storage device, a solid state memory, a floppy disk, a flexible disk, a hard disk, a magnetic tape, or any other magnetic medium, an optical disk or any other optical medium, a ROM (read only memory), a RAM (random access memory), a cache memory, and/or any memory chip or cartridge, and/or any other medium from which a computer may read data, instructions, and/or code. The non-transitory storage device 610 may be separate from the interface. The non-transitory storage device 710 may have data/instructions/code for implementing the methods and steps described above. Computing device 700 may also include communication device 712. The communication device 712 may be any type of device or system capable of enabling communication with an internal apparatus and/or with a network and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication device, and/or a chipset, such as a bluetooth device, an IEEE 1302.11 device, a WiFi device, a WiMax device, a cellular communication device, and/or the like.
Bus 702 can include, but is not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.
Computing device 700 may also include a working memory 714, which working memory 714 may be any type of working memory capable of storing instructions and/or data that facilitate the operation of processor 704 and may include, but is not limited to, random access memory and/or read-only memory devices.
Software components may reside in the working memory 714 and include, but are not limited to, an operating system 716, one or more application programs 718, drivers, and/or other data and code. Instructions for implementing the above-described methods and steps of the present invention may be included in the one or more application programs 718 and the above-described methods 500 of the present invention may be implemented by the processor 704 reading and executing the instructions of the one or more application programs 718.
It should also be appreciated that variations may be made according to particular needs. For example, custom hardware may also be used, and/or particular components may be implemented in hardware, software, firmware, middleware, microcode, hardware description voices, or any combination thereof. In addition, connections to other computing devices, such as network input/output devices, etc., may be employed. For example, some or all of the disclosed methods and apparatus may be implemented with programming hardware (e.g., programmable logic circuits including Field Programmable Gate Arrays (FPGAs) and/or Programmable Logic Arrays (PLAs)) having an assembly language or hardware programming language (e.g., VERILOG, VHDL, C ++).
Although aspects of the present invention have been described so far with reference to the accompanying drawings, the above-described methods, systems and apparatuses are merely examples, and the scope of the present invention is not limited to these aspects but is limited only by the appended claims and equivalents thereof. Various components may be omitted or replaced with equivalent components. In addition, the steps may also be implemented in a different order than described in the present invention. Furthermore, the various components may be combined in various ways. It is also important that as technology advances, many of the described components can be replaced by equivalent components that appear later.
Claims (8)
1. A method for acquiring HTTP resources in real time through an FTP protocol comprises the following steps:
receiving an FTP request in the form of a URL;
splicing a URL (uniform resource locator) for initiating an HTTP request to an HTTP source station based on the FTP request;
initiating an HTTP request to the HTTP source station by using the spliced URL;
receiving an HTTP response from the HTTP source station;
analyzing a TCP message corresponding to the HTTP response;
encapsulating the TCP message by using an FTP format;
wherein the method is implemented by an FTP proxy module;
wherein the FTP proxy module is included in a file management system, wherein stitching a URL for initiating an HTTP request to an HTTP source based on the FTP request further comprises:
resolving the FTP Request to obtain an HTTP source station address corresponding to the IP of the FTP proxy module indicated in the FTP Request, and obtaining the directory position and name of the HTTP resource indicated in the FTP Request in the file management system, wherein resolving further comprises resolving a Request/Rest keyword in the FTP Request, and intercepting the directory after a "/" symbol is a root directory through a regular expression;
and splicing the HTTP source station address with the directory position and the name of the HTTP resource in the file management system to obtain the URL of the HTTP source station corresponding to the HTTP resource.
2. The method of claim 1, wherein the FTP request is received from a business system.
3. The method as recited in claim 2, further comprising:
before receiving the FTP request, the service system initiates an FTP connection establishment request to the FTP proxy module, and authentication login is completed after TCP three-way handshake connection establishment.
4. The method as recited in claim 1, further comprising: the memory is applied for storing temporary TCP message data.
5. The method as recited in claim 2, further comprising: and sending the encapsulated TCP message to the client.
6. A system for obtaining HTTP resources in real time via an FTP protocol, comprising:
an FTP proxy module configured to:
receiving an FTP request in the form of a URL;
splicing a URL (uniform resource locator) for initiating an HTTP request to an HTTP source station based on the FTP request;
initiating an HTTP request to the HTTP source station by using the spliced URL;
receiving an HTTP response from the HTTP source station;
analyzing a TCP message corresponding to the HTTP response;
encapsulating the TCP message by using an FTP format;
wherein the FTP proxy module is included in a file management system, wherein stitching a URL for initiating an HTTP request to an HTTP source based on the FTP request further comprises:
resolving the FTP Request to obtain an HTTP source station address corresponding to the IP of the FTP proxy module indicated in the FTP Request, and obtaining the directory position and name of the HTTP resource indicated in the FTP Request in the file management system, wherein resolving further comprises resolving a Request/Rest keyword in the FTP Request, and intercepting the directory after a "/" symbol is a root directory through a regular expression;
and splicing the HTTP source station address with the directory position and the name of the HTTP resource in the file management system to obtain the URL of the HTTP source station corresponding to the HTTP resource.
7. The system as recited in claim 6, further comprising: a business system configured to:
initiating an FTP connection establishment request to the FTP proxy module, and establishing TCP connection;
sending the FTP request to the FTP proxy module;
and receiving the encapsulated TCP message sent by the FTP proxy module.
8. A computing device for acquiring HTTP resources in real time via an FTP protocol, comprising:
a processor;
a memory storing instructions that, when executed by the processor, are capable of performing the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110980462.4A CN113852666B (en) | 2021-08-25 | 2021-08-25 | Method for acquiring HTTP (hyper text transport protocol) resources in real time through FTP (File transfer protocol) |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110980462.4A CN113852666B (en) | 2021-08-25 | 2021-08-25 | Method for acquiring HTTP (hyper text transport protocol) resources in real time through FTP (File transfer protocol) |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113852666A CN113852666A (en) | 2021-12-28 |
| CN113852666B true CN113852666B (en) | 2024-03-12 |
Family
ID=78976227
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110980462.4A Active CN113852666B (en) | 2021-08-25 | 2021-08-25 | Method for acquiring HTTP (hyper text transport protocol) resources in real time through FTP (File transfer protocol) |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113852666B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7565413B1 (en) * | 2002-08-05 | 2009-07-21 | Cisco Technology, Inc. | Content request redirection from a wed protocol to a file protocol |
| US7809858B1 (en) * | 2003-10-21 | 2010-10-05 | Adobe Systems Incorporated | Cross-protocol URL mapping |
| CN102347947A (en) * | 2011-09-21 | 2012-02-08 | 杭州海康威视软件有限公司 | Streaming media adaptor, streaming media network interaction system and method |
| CN103944992A (en) * | 2014-04-25 | 2014-07-23 | 厦门享游网络科技有限公司 | Method for accelerating HTTP on IOS |
| WO2019071608A1 (en) * | 2017-10-13 | 2019-04-18 | 深圳中兴力维技术有限公司 | Request processing method and device, and computer-readable storage medium |
| CN109819033A (en) * | 2019-01-25 | 2019-05-28 | 杭州迪普科技股份有限公司 | A kind of resource file loading method and system |
-
2021
- 2021-08-25 CN CN202110980462.4A patent/CN113852666B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7565413B1 (en) * | 2002-08-05 | 2009-07-21 | Cisco Technology, Inc. | Content request redirection from a wed protocol to a file protocol |
| US7809858B1 (en) * | 2003-10-21 | 2010-10-05 | Adobe Systems Incorporated | Cross-protocol URL mapping |
| CN102347947A (en) * | 2011-09-21 | 2012-02-08 | 杭州海康威视软件有限公司 | Streaming media adaptor, streaming media network interaction system and method |
| CN103944992A (en) * | 2014-04-25 | 2014-07-23 | 厦门享游网络科技有限公司 | Method for accelerating HTTP on IOS |
| WO2019071608A1 (en) * | 2017-10-13 | 2019-04-18 | 深圳中兴力维技术有限公司 | Request processing method and device, and computer-readable storage medium |
| CN109819033A (en) * | 2019-01-25 | 2019-05-28 | 杭州迪普科技股份有限公司 | A kind of resource file loading method and system |
Non-Patent Citations (1)
| Title |
|---|
| 基于SNMP和HTTP代理的远程信息采集系统设计;冯新;夏靖波;江友谊;;微计算机信息(第21期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113852666A (en) | 2021-12-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4363847B2 (en) | Digital TV application protocol for interactive TV | |
| EP2741474B1 (en) | System and method for providing distributed online services | |
| US8787164B2 (en) | Media delivery system and method for transporting media to desired target devices | |
| CN102904959B (en) | Network accelerating method and gateway | |
| US20050204393A1 (en) | Home network server | |
| JP2004529410A (en) | Service gateway for interactive TV | |
| AU2002240200A1 (en) | A digital television application protocol for interactive television | |
| US8817983B2 (en) | Streaming video to cellular phones | |
| CN109510754B (en) | Online document generation method, device and system and electronic equipment | |
| CN110769009B (en) | User identity authentication method and system | |
| CN114070833A (en) | Multi-protocol service compatible method, system, device, medium, and program product | |
| US7743113B2 (en) | Proxy operations on client devices | |
| CN113852666B (en) | Method for acquiring HTTP (hyper text transport protocol) resources in real time through FTP (File transfer protocol) | |
| CN116684703A (en) | Streaming media data transmission method and related equipment based on proximity service communication protocol | |
| CN112149392A (en) | Rich text editing method and device | |
| CN113746851A (en) | Agent system and method for supporting real-time analysis of GRPC request | |
| KR102050736B1 (en) | Cloud streaming system and apparatus for caching date in the system | |
| CN114615331B (en) | Internet application design deployment method based on microservice and gatekeeper deployment | |
| CN110636374A (en) | Method and device for searching information | |
| US20160100217A1 (en) | System and method for optimizing delivery of video content in native mobile applications | |
| CN113497821A (en) | Method, device and system for uploading files | |
| CN115348319A (en) | Cloud desktop management link method, system and equipment based on SPICE protocol | |
| KR101366031B1 (en) | Method for managing cache server and apparatus thereof | |
| KR20130026709A (en) | Method for accelerating web access in web accelerator system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |