WO2011057525A1

WO2011057525A1 - Http server based on packet processing and data processing method thereof

Info

Publication number: WO2011057525A1
Application number: PCT/CN2010/077486
Authority: WO
Inventors: 张富春
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2009-11-10
Filing date: 2010-09-29
Publication date: 2011-05-19
Also published as: CN102055774B; CN102055774A

Abstract

A Hyper Text Transfer Protocol (HTTP) server based on packet processing and the data processing method thereof are provided by the present invention. Said HTTP server processes the data packets on the communication ports with raw sockets, wherein, the HTTP server receives the data sent from a client, the network card driver processes said data, and the HTTP server copies the data to the memory buffer by the way of memory mapping; when sending data, the HTTP server constructs IP data packets on the application layer, and sends said IP data packets to an IP protocol stack. The IP protocol stack sends the IP data packets to the network card driver. The network card driver processes the IP data packets and sends them to the client. The HTTP server based on packet processing and the data processing method thereof provided by the present invention can support the mass data requests of the client, and have a better processing performance.

Description

HTTP server based on packet processing and data processing method thereof

技术领域 Technical field

The present invention relates to the field of network technologies, and in particular, to an HTTP server based on packet processing and a data processing method thereof.

背景技术Background technique

Hypertext Transfer Protocol ('HTTP') ) is a transport protocol for transferring hypertext from a web server to a local browser. The current HTTP server is based on the Transmission Control Protocol (Transmission Control). Protocol, abbreviated as 'TCP', as shown in FIG. 3, the specific process of the HTTP server processing the data packet sent by the client is: the data packet sent by the client to the HTTP server is first processed by the network card driver. The network data frame is restored to an IP data packet; then the network card driver delivers the IP data packet to the protocol stack of the kernel, and the protocol stack parses the data packet, and when the TCP data packet is parsed, the serial number check and sort operations are performed, Ensure the reliability of TCP transmission; after the protocol stack is processed, the TCP socket of the application layer receives the message and parses it on the data content of the TCP protocol to obtain the HTTP data and enter the relevant logic processing of HTTP.

The above HTTP server processes the data packets sent by the client through layer layer resolution, layer-by-layer copying, and the processing logic is very complicated. Therefore, the number of connections supported by the HTTP server is very limited. For some small data volumes and applications that need to frequently interact with the server, when the current HTTP server faces a large number of requests from the client, the protocol stack consumes a large amount of system resources, so performance low.

发明内容Summary of the invention

Based on this, it is necessary to provide a packet processing-based HTTP server that can handle massive data requests from clients and has better processing performance.

In addition, it is necessary to provide an HTTP server data processing method that can handle massive data requests from clients and has better processing performance.

The invention provides an HTTP server based on packet processing, which uses raw sockets to process data packets of a communication port.

Preferably, the HTTP server receives the data sent by the client, and copies the data to the memory buffer of the application layer in a memory mapping manner after being processed by the network card driver.

Further preferably, the network card driver can be used to convert the received network data frame into an IP data packet.

Preferably, The HTTP server constructs an IP data packet at the application layer, and sends the IP data packet to the IP protocol stack, and the IP data packet is sent to the network card driver by the IP protocol stack, and the network card driver processes the IP data packet and sends it to the client.

Further preferably, the network card driver can be used to convert IP data packets into network data frames.

The invention also provides an HTTP server data processing method, comprising: the HTTP server processing the data packet of the communication port by using the original socket.

Preferably, the step of the HTTP server processing the data packet of the communication port by using the original socket may include: The HTTP server receives the data sent by the client, and copies the data to the memory buffer of the application layer in a memory mapping manner after being processed by the network card driver.

Further preferably, the step of the network card driving process may specifically be: the network card driver converts the received network data frame into an IP data packet.

Preferably, the step of processing, by the HTTP server, the data packet of the communication port by using the original socket may further include: The HTTP server constructs an IP data packet at the application layer, and sends the IP data packet to the IP protocol stack, and the IP data packet is sent to the network card driver by the IP protocol stack, and the network card driver processes the IP data packet and sends it to the client.

Further preferably, the step of processing the IP data packet by the network card driver may specifically be: the network card driver converts the IP data packet into a network data frame.

An HTTP server based on packet processing, comprising: a network card driver, receiving a data packet; a memory buffer copying the data packet processed by the network card driver in a memory mapping manner; and an HTTP server, using the original socket pair data The package is processed.

Preferably, the network card driver converts the received network data frame into an IP data packet.

Preferably, the packet processing-based HTTP server further includes an IP protocol stack; the HTTP server constructs an IP data packet at an application layer, and sends the IP data packet to an IP protocol stack, and the IP protocol stack transmits IP data. The packet is sent to the network card driver, and the network card driver processes the IP data packet and sends it to the client.

Further preferably, the network card driver is configured to convert IP data packets into network data frames.

The above-mentioned packet processing-based HTTP server and its data processing method process the data packet of the communication port by using the original socket, and when the HTTP server receives the data sent by the client, it is not necessary to hand the data to the protocol stack, but directly The data is copied to the memory buffer of the application layer in a memory-mapped manner, and the HTTP server can directly use the data, and does not need to go through other processing of the socket, thereby reducing a large part of system resource consumption. Since the data processing of the HTTP server is implemented on the IP protocol level, the data packet does not enter the TCP protocol stack, thereby improving the response speed of the HTTP server, enabling the HTTP server to process the massive data request of the client; on the other hand, the HTTP server returns When the data is sent to the client, the IP data packet is directly constructed by the application layer, and the IP data packet is sent to the IP protocol stack, and then sent by the IP protocol stack to the network card driver, because the performance of the data transmission of the original socket is much higher than that. TCP sockets are sent for data, which also improves performance.

附图说明DRAWINGS

1 is a schematic diagram of a client interacting with an HTTP server in an embodiment;

2 is a schematic diagram of an HTTP server data processing method in an embodiment;

3 is a schematic diagram of a prior art HTTP server data processing method.

具体实施方式detailed description

Since the communication process of the HTTP protocol is generally a short connection, the communication mode is a request-response mode. Referring to Figure 1, an interaction process between the client and the HTTP server is as follows:

(1) The client sends a SYN packet to the HTTP server;

(2) The HTTP server sends a SYN+ACK packet to the client;

(3) The client sends an ACK packet to the HTTP server;

(4) The client sends a packet with the content GET to the HTTP server;

(5) The HTTP server returns a packet with a content of 200 OK to the client;

(6) Close the connection after the data transmission is completed.

The SYN packet is a handshake packet, the ACK is a response packet, and the FIN is an end packet. The above steps (1) to (3) are typical TCP three-way handshake procedures; and the GET packet is a request packet of the HTTP protocol, 200. OK is the content package returned by the HTTP server to the client. It can be seen from the above that the first communication between the client and the HTTP server includes three data packets (SYN packets, ACK packets, and GET packets) sent by the client to the HTTP server and two data packets (ACK+SYN) that the HTTP server responds to the client. Handshake reply packet and ACK+FIN with content of 200 OK's business-related response package).

In one embodiment, the packet processing-based HTTP server provided by the present invention processes the data packets of the communication port using the original socket. The communication port here is the default port 80. The original socket is a different network communication method than the TCP socket. It can collect the data packets of the link layer. Because the link layer is the IP protocol layer, IP. Above the protocol layer is the TCP protocol layer, and the original socket is the lowest level application programming interface (Application The Programming Interface (referred to as 'API') is therefore able to collect packets from all layers.

Referring to FIG. 2, the packet processing-based HTTP server of the present invention includes: a network card driver, an IP protocol stack, a memory buffer, and an HTTP server;

The network card driver receives the data packet, and converts the received network data frame into an IP data packet and converts the IP data packet into a network data frame;

The memory buffer copies the data packet processed by the network card driver in a memory mapping manner;

HTTP The server uses the original socket to process the data packet, constructs an IP data packet in the application layer, and sends the IP data packet to the IP protocol stack, and the IP protocol stack sends the IP data packet to the network card driver, and the network card driver drives the IP data packet. After processing, send it to the client.

In one embodiment, as shown in FIG. 2, the process of processing the data packet of the communication port by using the original socket by the HTTP server includes a process of receiving data sent by the client and a process of returning data to the client. The process of the HTTP server receiving the data sent by the client is as follows: (1) The client sends data to the network card driver. The network card driver receives the network data frame transmitted by the client through the network; (2) the network card driver converts the received network data frame into an IP data packet; and (3) the network card driver processes the obtained IP data packet into a memory mapped The way to copy the data to the memory buffer of the application layer. After IP packets are copied into memory, the HTTP server can use these packets directly without having to go through other socket processing.

As shown in Figure 2, the HTTP server responds to the client as follows: (1) The HTTP server constructs an IP packet at the application layer and sends the IP packet to the IP protocol stack; (2) The IP protocol stack sends the IP packet to NIC driver; (3) NIC driver to process IP packets. Specifically, the network card driver converts IP data packets into network data frames. (4) The network card driver sends the network data frame to the client through the network.

In the above-mentioned packet processing-based HTTP server and its data processing method, data only needs to be copied once in the process of processing, and no layer-level copying is required, so the flow of data processing is reduced, and for the application, the process of receiving data is also Simpler, the number of connections it can support will be higher. Since the data processing process of the HTTP server is implemented at the level of the IP protocol, the data packet does not enter the TCP protocol stack, so the response speed of the HTTP server is faster and the consumption of the server is smaller. In addition, since the above-mentioned packet processing-based HTTP server bypasses the TCP protocol stack, the server side does not need to save the connection state between the client and the server. When the client initiates an attack against the TCP protocol stack, the packet processing is performed. HTTP server is not applicable, so it can effectively resist malicious SYN FLOOD or slow connection.

The above-described packet processing-based HTTP server and its data processing method are widely applicable to HTTP applications having a large number of requests and a very small amount of data transmission per request and response because of the high number of connections that can be supported. For example: statistics server (such as counters on online advertising), chat server (such as HTTP-based two-person chat or chat room), verification code server (such as generating complex captcha pictures), avatar image server (such as processing GZIP compressed Images smaller than 1460 bytes), and other HTTP applications with less than 1460 bytes of request and response content.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. Within the scope.

Claims

An HTTP server based on packet processing, characterized in that the HTTP server processes the data packet of the communication port by using the original socket.
The packet processing-based HTTP server according to claim 1, wherein the HTTP server receives the data sent by the client, and copies the data to the memory buffer of the application layer in a memory mapping manner after being processed by the network card driver. .
The packet processing based HTTP server of claim 2, wherein the network card driver is configured to convert the received network data frame into an IP data packet.
The packet processing-based HTTP server according to any one of claims 1 to 3, wherein the HTTP server constructs an IP data packet at an application layer, and transmits the IP data packet to an IP protocol stack, The IP protocol stack sends the IP data packet to the network card driver, and the network card driver processes the IP data packet and sends it to the client.
The packet processing-based HTTP server according to claim 4, wherein the network card driver is configured to convert an IP data packet into a network data frame.
An HTTP server data processing method, the method comprising:

The HTTP server processes the data packets of the communication port using the original socket.
The HTTP server data processing method according to claim 6, wherein the step of processing, by the HTTP server, the data packet of the communication port by using the original socket comprises:

The HTTP server receives the data sent by the client, and copies the data to the memory buffer of the application layer in a memory mapping manner after being processed by the network card driver.
The HTTP server data processing method according to claim 7, wherein the step of the network card driving process is specifically: the network card driver converts the received network data frame into an IP data packet.
A method according to any one of claims 6 to 8 The HTTP server data processing method is characterized in that: the step of processing, by the HTTP server, the original socket to process the data packet of the communication port further includes:

The HTTP server constructs an IP data packet at the application layer, and sends the IP data packet to the IP protocol stack, and the IP data packet sends the IP data packet to the network card driver, and the network card driver processes the IP data packet and sends the IP data packet. To the client.
The HTTP server data processing method according to claim 9, wherein the step of processing the IP data packet by the network card driver is specifically: the network card driver converts the IP data packet into a network data frame.
An HTTP server based on packet processing, characterized in that it comprises:

Network card driver, receiving data packets;

a memory buffer that copies the data packet processed by the network card driver in a memory mapped manner;

And an HTTP server that processes the packet with raw sockets.
The packet processing-based HTTP server according to claim 11, wherein said network card driver converts the received network data frame into an IP data packet.
The packet processing-based HTTP server according to claim 11 or 12, further comprising an IP protocol stack; the HTTP server constructs an IP data packet at an application layer, and transmits the IP data packet to an IP protocol stack The IP data packet is sent by the IP protocol stack to the network card driver, and the network card driver processes the IP data packet and sends it to the client.
The packet processing based HTTP server of claim 13, wherein the network card driver is configured to convert an IP data packet into a network data frame.