WO2014036718A1

WO2014036718A1 - Data sending method and device at server end and server using device

Info

Publication number: WO2014036718A1
Application number: PCT/CN2012/081113
Authority: WO
Inventors: 官宇; 钟超; 刘凌云
Original assignee: 北京网鼎芯睿科技有限公司
Priority date: 2012-09-07
Filing date: 2012-09-07
Publication date: 2014-03-13

Abstract

The present invention provides a data sending method and device at a server end and a server using the device. The data sending method at a server end comprises the following steps: A. configuring a data content storage area, saving data to be accessed by a client in the data content storage area, and determining a location of the data in the data content storage area; B. sending information about the location of the data in the data content storage area to a content sending pointer based on a data access request sent by the client; C. the content sending pointer obtaining the data from the data content storage area based on the location information, encapsulating the data, and sending the encapsulated data to the client. In the method, the data content storage area is configured and data is directly sent to the client through data multiplexing and the content sending pointer, thereby improving the data sending performance of the server in the case of a large number of concurrent connections.

Description

Server-side data transmitting method and device, and server using the same

The present invention relates to a network communication technology, and more particularly to an optimized server-side data transmission method and apparatus and a server using the same. Background technique

Currently, most applications on the Internet are client-server models. The client communicates with the service through the TCP/IP protocol.

Establish a connection, access to get server data resources. Servers carry huge data resources on the Internet, and these data resources have become an indispensable part of our lives. The WWW service on the Internet is provided by the Web server, and the service standard port is port 80 of TCP/IP; the FTP service is provided by the book FTP server, and the standard service port is port 21. When the client needs to access the data resource, it requests a TCP/IP connection to the server's service port.

Most data resource access is initiated by the client and then obtained by the server. When the client connects to the server and requests the server to send data, the server establishes a send buffer for each connection with the client, and then copies the data to be sent to the send buffer.

If a large number of clients establish a connection to the server at the same time, there will be a large number of concurrent connections on the server side. At this time, the server needs to copy the data resources requested by each client to each sending buffer area, and maintain and manage these sending buffer areas, so that the efficiency of data transmission on the server side is greatly reduced, and the resources of the processor in the server are occupied. . As a result, the number of concurrent connections on servers on the Internet has rapidly declined. Summary of the invention

The present invention is directed to the problem that when the server is concurrently connected with a large number of clients, the existing server-side data transmission method causes the server performance to be degraded due to copying the data resources requested by the clients to the respective transmission buffers and then sending them to the clients. Providing a server-side data sending method, setting a data content storage area, directly transmitting data to the client through data multiplexing and content sending pointers, and improving data transmission performance of the server under a large number of concurrent connections. The present invention also provides a server-side data transmitting apparatus and a server using the same.

The technical solution of the present invention is as follows:

A server-side data transmitting method, characterized in that the method comprises the following steps:

A. setting a data content storage area and storing data for client access in the data content storage area, and determining a location of the data in the data content storage area;

B. Send the location information of the data in the data content storage area to the content sending pointer according to the request of the client access; C. The content sending pointer acquires data in the data content storage area according to the location information, and encapsulates the data and sends the data to the client.

In the step A, the location of the data in the data content storage area is determined by establishing data location information.

The specific steps of step A are as follows:

A analyzes the size of the data accessed by the client;

A2, a space for allocating corresponding data in the memory storage area as a data content storage area;

A3. Store data for client access in the data content storage area;

A4. Establish positioning information of data in the data content storage area to determine the location of the data in the data content storage area. In the step B, after the client establishes a TCP/IP connection with the server, the server establishes a content sending pointer used by the client TCP/IP connection, and then according to the client's access request, the access request data is The location information of the data content storage area is sent to the content delivery pointer.

The data accessed by the client is sent in the form of a plurality of data blocks, and the position of each data block in the data in the data content storage area is determined by step A, and the location information of the data block in the data content storage area is determined in the step B. Sending to the content sending pointer, in step C, the content sending pointer acquires the data block in the data content storage area, and sends it to the client after encapsulation, and then updates the content of the content sending pointer, so that the updated content is sent according to the pointer. The location information of a data block in the data content storage area is obtained in the next data block in the data content storage area, and is sent to the client after being encapsulated until all data accessed by the client is completely transmitted.

The data sent by the server includes IP data or UDP data or TCP data.

A server-side data transmitting device, comprising: an interconnected data content storage area, a system module, and a sending module, wherein the sending module includes a content sending pointer, and the system module is configured to load a data resource, and the client The accessed data is stored in the data content storage area, determining the location of the data in the data content storage area and managing the content sending pointer; the system module sends the location information of the data in the data content storage area to the content sending according to the request of the client access The pointer sends the data in the data content storage area through the content sending pointer, and encapsulates the data and sends the data to the client.

The transmitting module includes an FPGA or a network processor.

The data content storage area includes a RAM or SSD hard disk or a network storage system.

The system module determines the location of the data in the data content storage area by establishing data location information.

After the client establishes a TCP/IP connection with the sending module, the system module sends the location information of the data of the access request in the data content storage area to the content sending pointer according to the access request of the client.

The device sends the data accessed by the client in the form of a plurality of data blocks, and the system module determines the location of each data block in the data content storage area, and sends the location information of the data block in the data content storage area. Send content a pointer; the sending module acquires a data block in the data content storage area through the content sending pointer, and sends the data block to the client after being encapsulated, and the sending module updates the content of the content sending pointer, so that the updated content sending pointer is based on the next data. The location information of the block in the data content storage area is obtained in the next data block in the data content storage area, and is sent to the client after being encapsulated until all the data accessed by the client is completely transmitted.

A server characterized by comprising the server-side data transmitting apparatus described above. The technical effects of the present invention are as follows:

The server-side data transmitting method of the present invention, by setting a data content storage area and storing data for client access in the data content storage area, and determining the location of the data in the data content storage area, The content sending pointer needs to establish a connection for the data, and the content sending pointer acquires the data accessed by the client stored in the data content storage area according to the location information of the data, and directly sends the data to the client, so the method of the present invention only needs to be Each connection establishes a content sending pointer for data access, and does not need to establish a sending buffer for each concurrent connection, and at the same time, does not need to copy the data requested by the client in the data transmission multiple times, avoiding a large number of When the client concurrently connects the data resources requested by the clients to the respective sending buffers, the data transmission on the server side is slow, and the performance of the server is degraded. The method of the present invention sends the data when the data resources of the server are accessed. No need to carry out any form Replication, high performance server transmits data at a large number of concurrent connections.

The server-side data transmitting apparatus according to the present invention sets a data content storage area system module and a sending module, and sets a content sending pointer in the sending module, and the system module stores data for client access in the data content storage area, The location of the data in the data content storage area is determined and the content delivery pointer is managed. The sending module obtains the data in the data content storage area through the content sending pointer, and sends the data to the client after the data is encapsulated. The device does not need to set a transmission buffer area for each concurrent connection. At the same time, the data does not need to be copied and retransmitted multiple times, and the components work together to directly send data to the client through data multiplexing and content sending pointers. Therefore, it can effectively improve the server data transmission performance.

The server of the above-mentioned server-side data transmitting device optimizes the data transmission efficiency of the client access, overcomes the problem that the existing server has a rapidly decreasing performance with the number of concurrent connections, and effectively improves the performance of the server itself. DRAWINGS

FIG. 1 is a flowchart of a method for transmitting data on a server side according to the present invention.

2 is a schematic structural diagram of a data transmitting apparatus on a server side according to the present invention. detailed description

The invention will now be described with reference to the accompanying drawings. The present invention relates to a server-side data transmission method. The flowchart of the method is as shown in FIG. 1 and includes the following steps: A. Setting a data content storage area and storing data for client access in the data content storage area And determining the location of the data in the data content storage area; wherein, the data content storage area is specifically set, and the size of the data accessible by the client may be analyzed, and then the space of the corresponding data is allocated in the memory storage area as Data content storage area. Data for client access is loaded in the data content storage area, and positioning information of the data resource is established, and the location of the data in the data content storage area is determined.

B. The data of the client access request may be IP data or UDP data or TCP data, and the location information of the data in the data content storage area is sent to the content sending pointer according to the request of the client access. Preferably, after the client accesses the server, the server establishes a TCP/IP connection with the client, receives the access request of the client, and assigns a content sending pointer to the connection, or the server establishes a TCP/IP connection with the client. The used content sending pointer analyzes the data access request of the client, determines the positioning information of the data of the access request, and transmits the location information of the data in the data content storage area to the content sending pointer.

c. The data accessed by the client pointed to by the content sending pointer is located in the data content storage area, and the data in the data content storage area is obtained, and the data is encapsulated and sent to the client.

The data accessed by the client may be sent in the form of a plurality of data blocks. In the method of the present invention, in step A, the location of each data block in the data in the data content storage area is determined, and the data is in step B. The location information of the block in the data content storage area is sent to the content delivery pointer. In step C, the content delivery pointer obtains the data in the data content storage area according to the location information of the data block in the data content storage area of the data accessed by the client. Block, and after being encapsulated, sent to the client, and then update the content of the content sending pointer to point to the next data block position, that is, the updated content sending pointer points to the next data block in the data accessed by the client in the data content. The location in the storage area is obtained according to the updated content sending pointer, and the next data block in the data content storage area is obtained and sent to the client after being encapsulated until all the data accessed by the client is completely transmitted.

The present invention relates to a server-side data transmitting apparatus. The schematic structural diagram of the apparatus is as shown in FIG. 2, and includes an interconnected data content storage area, a system module, and a sending module, and the sending module includes a content sending pointer. The preferred transmitting module may comprise an FPGA (Field-Programmable Gate Array) or a Network Processor NP (Network Processor), and the preferred system module comprises a CPU. The preferred data content storage area includes RAM (Random Access Memory) or SSD hard disk (Solid State Disk) or network storage system.

The sending module is responsible for establishing a TCP/IP/UDP connection with the client (implementing TCP communication or IP communication or UDP communication with the client), reading data from the content storage area, and transmitting the data package. The system module is responsible for loading the data resources, storing the data accessed by the client in the data content storage area, constructing a data resource location table (or establishing location information of the data by other means) to determine the location of the data in the data content storage area. , managing the content sending pointer of the sending module; The system module sends the location information of the data of the access request in the data content storage area to the content sending pointer according to the request of the client access; the sending module acquires the data in the data content storage area through the content sending pointer, and encapsulates the data and sends the data to the client. end.

When the data of the client access request is relatively large, the device of the present invention may send the data accessed by the client in the form of multiple data blocks, and the system module sends the location information of each data block in the data content storage area to the device. The content sending pointer, the sending module first obtains the data block in the data content storage area through the content sending pointer, and sends the data block to the client after being encapsulated, and the sending module updates the content of the content sending pointer, so that the updated content sending pointer is according to the client. The location information of the next data block in the accessed data in the data content storage area is obtained in the data content storage area, and is sent to the client after being encapsulated until all the data accessed by the client is completely transmitted.

The device of the present invention specifically works as follows: The system module first pre-stores all data for the client to access the browsing in the data content storage area, and determines the location of the data in the data content storage area; After the server, the sending module establishes communication with the client, and the sending module notifies the system module of the client's access request, and the system module transmits the location information of the data requested by the client in the data memory storage area to the content according to the request. Sending a pointer; the sending module obtains data in the data content storage area through the direction of the content sending pointer, and encapsulates it and sends it to the client. After the data is sent, the sending module modifies the content sending pointer to point to the next transmitted data block, and reads the data from the data content storage area through the modified content sending pointer (ie, acquires the next data block), and encapsulates It is then sent to the client until the requested data is sent. After the client disconnects, the contents of the connection send pointer content is cleared.

The present invention also relates to a novel server, that is, a server using the server-side data transmitting apparatus according to the present invention, when a large number of clients simultaneously establish a connection with the server, the data transmission performance of the server is not lowered. Data multiplexing and content sending pointers optimize the data transmission efficiency of the data resources accessed by the client. When the client accesses the server and then performs data transmission, there is no need to establish a transmission buffer area, and no need to perform any data transmission process. Formal data replication, including DMA (Direct Memory Access) replication, effectively improves the performance of the server itself.

It should be noted that the above-described embodiments may enable those skilled in the art to more fully understand the present invention, but do not limit the invention in any way. Therefore, although the present invention has been described in detail with reference to the drawings and embodiments, it will be understood by those skilled in the art that the invention may be modified or equivalently substituted. In short, all without departing from the invention. The technical solutions of the spirit and scope and their improvements shall be covered by the scope of protection of the patents of the present invention.

Claims

1. A server-side data sending method, characterized in that the method includes the following steps:

A. Set up a data content storage area and store the data for client access in the data content storage area, and then determine the location of the data in the data content storage area;

B. Send the location information of the data in the data content storage area to the content sending pointer according to the client access request;

C. The content sending pointer obtains the data in the data content storage area according to the location information, and encapsulates the data before sending it to the client.

2. The method according to claim 1, characterized in that, in step A, the location of the data in the data content storage area is determined by establishing data positioning information.

3. The method according to claim 1, characterized in that the specific steps of step A are:

A Analyze the data size for client access;

A2. Allocate space for corresponding data in the memory storage area as the data content storage area;

A3. Store data for client access in the data content storage area;

A4. Establish the positioning information of the data in the data content storage area to determine the location of the data in the data content storage area.

4. The method according to any one of claims 1 to 3, characterized in that, in step B, after the client establishes a TCP/IP connection with the server, the server establishes a TCP/IP connection with the client. The content sending pointer is used, and then according to the client's access request, the location information of the access requested data in the data content storage area is sent to the content sending pointer.

5. The method according to any one of claims 1 to 3, characterized in that the data accessed by the client is sent in the form of multiple data blocks, and the location of each data block in the data in the data content storage area is determined through step A. , and in step B, the location information of the data block in the data content storage area is sent to the content sending pointer. In step C, the content sending pointer obtains the data block in the data content storage area, and sends it to the client after encapsulation end, and then update the content of the content sending pointer, so that the updated content sending pointer obtains the next data block in the data content storage area based on the position information of the next data block in the data content storage area, and sends it after encapsulation to the client until all data accessed by the client is sent.

6. The method according to one of claims 1 to 3, characterized in that the data sent by the server includes IP data or UDP data or TCP data.

7. A server-side data sending device, characterized in that it includes an interconnected data content storage area, a system module and a sending module. The sending module includes a content sending pointer, and the system module is used for loading data resources. The data accessed by the client is stored in the data content storage area, determines the location of the data in the data content storage area and manages the content sending pointer; the system module sends the location information of the data in the data content storage area to the client according to the client access request. Content sending pointer; The sending module obtains the data in the data content storage area through the content sending pointer and encapsulates the data. Sent to client.

8. The device according to claim 7, wherein the sending module includes an FPGA or a network processor.

9. The device according to claim 7, characterized in that the data content storage area includes RAM or SSD hard disk or network storage system.

10. The device according to any one of claims 7 to 9, characterized in that the system module determines the location of the data in the data content storage area by establishing data positioning information.

11. The device according to any one of claims 7 to 9, characterized in that, after the client establishes a TCP/IP connection with the sending module, the system module stores the access requested data in the data content storage area according to the client's access request. The location information is sent to the content sending pointer.

12. The device according to any one of claims 7 to 9, characterized in that, the device sends the data accessed by the client in the form of multiple data blocks, and the system module determines that each data block in the data is in the data. The location of the content storage area, and sends the location information of the data block in the data content storage area to the content sending pointer; the sending module obtains the data block in the data content storage area through the content sending pointer, and sends it to the client after encapsulation , the sending module then updates the content of the content sending pointer, so that the updated content sending pointer obtains the next data block in the data content storage area based on the position information of the next data block in the data content storage area, and after encapsulation Sent to the client until all data accessed by the client is sent.

13. A server, characterized by comprising the server-side data sending device according to one of claims 7 to 12.