WO2022267692A1

WO2022267692A1 - Data processing method, file service system, terminal device, and storage medium

Info

Publication number: WO2022267692A1
Application number: PCT/CN2022/090046
Authority: WO
Inventors: 叶在伟; 曾伟; 刘超; 孔伟
Original assignee: 中兴通讯股份有限公司
Priority date: 2021-06-23
Filing date: 2022-04-28
Publication date: 2022-12-29
Also published as: CN115514753A

Abstract

A data processing method, a file service system, a terminal device, and a storage medium. The data processing method comprises: when the number of concurrent download connections of the file service system reaches a connection threshold value, obtaining a first file download request, wherein the first file download request indicates that a first node applies to the file service system for downloading a file, and the file comprises at least one data fragment (S100); and allocating a second node to the first node according to the first file download request, so that the first node obtains a download data fragment required for the first node by means of the second node (S200).

Description

Data processing method, file service system, terminal device and storage medium

Cross References to Related Applications

This application is based on a Chinese patent application with application number 202110696241.4 and a filing date of June 23, 2021, and claims the priority of this Chinese patent application. The entire content of this Chinese patent application is hereby incorporated by reference into this application.

technical field

The embodiments of the present application relate to but are not limited to the communication field, and in particular, relate to a data processing method, a file service system, a terminal device, and a storage medium.

Background technique

With the development of 5G technology, information exchange through 5G communication is becoming more and more popular. The way of information transmission has developed from text and pictures to sound and video, and the demand for the transmission of sound and video information is getting higher and higher, which poses new challenges to the file processing capabilities of 5G messaging systems.

The current 5G message system provides a unified traditional C/S mode. In people's daily communication, the 5G message system mainly provides chat modes in three scenarios: single chat, group chat, and group sending. However, in these three modes, the 5G message system uniformly adopts the C/S mode to provide file acquisition services to the terminal.

For file acquisition in group chat and group sending scenarios, since there are scenarios where multiple terminals need to acquire the same file at the same time, once there are too many acquirers, the acquisition load of the file server will increase sharply, and in severe cases, the file server will not even be able to provide Users provide services, and in the face of this problem, the current main solution is to expand the file server equipment, but the equipment expansion will greatly increase the hardware cost and reduce the market competitiveness of the product.

Contents of the invention

The following is an overview of the topics described in detail in this article. This summary is not intended to limit the scope of the claims.

Embodiments of the present application provide a data processing method, a file service system, a terminal device, and a storage medium.

On the one hand, an embodiment of the present application provides a data processing method applied to a file service system, including: obtaining a first file download request when the number of concurrent download connections of the file service system reaches a connection threshold, and the The first file download request indicates that the first node applies to the file service system for downloading a file, and the file includes at least one data segment; assigns a second node to the first node according to the first file download request, so that all The first node acquires and downloads the data segment required by the first node through the second node.

In the second aspect, the embodiment of the present application also provides a data processing method applied to the first node, including: obtaining node information from the second node allocated by the file service system, the second node is the node that has downloaded the The node of the data segment that the first node needs to download; send a second file download request to the second node according to the node information of the second node, so as to obtain the required download through the second node data fragment.

In the third aspect, the embodiment of the present application also provides a data processing method applied to the second node, including: obtaining the second file download request sent from the first node, and the second file download request is sent to the The first node acquires a request for the data segment to be downloaded, and the sending object of the second file download request is allocated by the file service system when the number of concurrent download connections of the file service system reaches the connection threshold; according to the second A file download request sends the data segment to the first node.

In the fourth aspect, the embodiment of the present application also provides a file service system, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the computer program when executing the computer program. The data processing method described in the first aspect.

In the fifth aspect, the embodiment of the present application also provides a terminal device, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the first step when executing the computer program. The data processing method described in the second aspect, or realize the data processing method described in the third aspect.

In the sixth aspect, the embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are used to execute the data processing method described in the first aspect, or execute the second aspect The data processing method described in the third aspect, or execute the data processing method described in the third aspect.

Additional features and advantages of the application will be set forth in the description which follows, and, in part, will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Description of drawings

FIG. 1 is a schematic diagram of a system architecture for executing a data processing method provided by an embodiment of the present application;

FIG. 2 is a flowchart of a data processing method on the file service system side provided by an embodiment of the present application;

FIG. 3 is a flow chart of generating a first data node list in a data processing method on the file service system side provided by an embodiment of the present application;

FIG. 4 is a flow chart of allocating a second node in the data processing method on the file service system side provided by an embodiment of the present application;

FIG. 5 is another flow chart of allocating a second node in the data processing method on the file service system side provided by an embodiment of the present application;

FIG. 6 is a flow chart of generating a second data node list in the data processing method on the file service system side provided by an embodiment of the present application;

FIG. 7 is another flow chart of allocating a second node in the data processing method on the file service system side provided by an embodiment of the present application;

FIG. 8 is a flowchart of a data processing method on the first node side provided by an embodiment of the present application;

FIG. 9 is a flow chart of processing downloaded data segments in a data processing method on the first node side provided by an embodiment of the present application;

FIG. 10 is a flowchart of a data processing method on the second node side provided by an embodiment of the present application;

FIG. 11 is a flow chart of processing downloaded data segments in a data processing method on the second node side provided by an embodiment of the present application;

Fig. 12 is a flowchart of a data processing method based on a system architecture platform provided by an embodiment of the present application;

Fig. 13 is a schematic diagram of a file service system provided by an embodiment of the present application;

Fig. 14 is a schematic diagram of a terminal device provided by an embodiment of the present application.

detailed description

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.

It should be noted that although the functional modules are divided in the schematic diagram of the device, and the logical sequence is shown in the flowchart, in some cases, it can be executed in a different order than the module division in the device or the flowchart in the flowchart. steps shown or described. The terms "first", "second" and the like in the specification, claims or the above drawings are used to distinguish similar objects, and not necessarily used to describe a specific order or sequence.

An embodiment of the present application provides a data processing method, a file service system, a terminal device, and a storage medium. The data processing method includes but is not limited to the following steps: when the number of concurrent download connections of the file service system reaches the connection threshold, obtain The first file download request, the first file download request indicates that the first node applies to the file service system for downloading the file, and the file includes at least one data segment; according to the first file download request, the second node is allocated to the first node, so that the first node The download data segment required by the first node is acquired through the second node. In the embodiment of this technical solution, when the number of concurrent download connections of the file service system reaches the connection threshold, the file service system cannot provide the download service to the first node, then the file service system can send the file service system to the second node according to the first file download request. A node allocates the second node that has downloaded the data segment that the first node needs to download, so that the first node obtains the downloaded data segment required by the first node through the second node, because the embodiment of this technical solution can distribute the second node Providing data segment download services for the first node can solve the problem that the file service system cannot provide download services for the first node when the number of concurrent download connections reaches the connection threshold without the need to expand the device, thereby improving user experience .

The embodiments of the present application will be further described below in conjunction with the accompanying drawings.

As shown in FIG. 1 , FIG. 1 is a schematic diagram of a system architecture platform 100 for executing a data processing method provided by an embodiment of the present application.

In the example of FIG. 1, the system architecture platform 100 is provided with a file service system 110 and a terminal device 120. The file service system 110 is connected to the terminal device 120. The terminal device 120 can download files through the file service system 110. Between the terminal devices 120 Files can be transferred. It can be understood that the terminal device 120 is a node in the system architecture platform, and the same terminal device 120 can be the first node or the second node according to different situations. It is not specifically limited. For example: when a terminal device 120 cannot download the file or data segment to be downloaded through the file service system 110 (that is, when the number of concurrent download connections of the file service system 110 reaches the connection threshold in this embodiment) , then the terminal device 120 is the first node; and in the case that the terminal device 120 has downloaded files or data fragments to be downloaded from other first nodes, the terminal device 120 is the second node.

Wherein, the file service system 110 may include a file download server node 111 , a file download manager 112 and a firewall penetration manager 113 . in,

The file download server node 111 can be used to provide the components of the file download service to the terminal device 120, but the number of concurrent download connections between the file download server node 111 and the terminal device 120 is limited, for example: the file download server node 111 can at most simultaneously Provide connections to 10 terminal devices 120, then the file download server node 111 connection threshold is 10;

The file download manager 112 is used to manage the download of files, manage the distributed network, and distribute the load generated by the terminal devices 120 that need to be downloaded to the distributed network. It should be noted that multiple terminal devices 120 download simultaneously The file can be a file that does not involve the user's personal privacy, which is not uniquely limited in this embodiment;

The firewall penetration manager 113 is a component used to help each node (terminal device 120) in the distributed network to complete TCP connection creation and file transfer. It should be noted that the firewall penetration manager 113 may be the NAT firewall penetration manager 113, which is not uniquely limited in this embodiment;

It should be understood that the file service system 110 may also include multiple components related to signal sending and receiving (for example, a processor, a modulator, a multiplexer, a demodulator, or a demultiplexer, etc.).

The terminal device 120 may be a node participating in the distributed network, and can share the file download service with other terminals when the number of concurrent download connections of the file download server node 111 reaches the connection threshold.

Terminal equipment 120 may also be referred to as user equipment (user equipment, UE), access terminal, subscriber unit, subscriber station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, User Agent or User Device. The terminal device 120 in the embodiment of the present application can be a mobile phone (mobile phone), a tablet computer (Pad), a computer with a wireless transceiver function, a virtual reality (virtual reality, VR) terminal device 120, an augmented reality (augmented reality, AR) ) terminal equipment 120, wireless terminals in industrial control, wireless terminals in self driving, wireless terminals in remote medical, wireless terminals in smart grid, Wireless terminals in transportation safety, wireless terminals in smart city, wireless terminals in smart home, etc. The embodiments of the present application do not limit the application scenarios. In this application, the terminal device 120 with wireless transceiver function and the chips that can be installed in the aforementioned terminal device 120 are collectively referred to as the terminal device 120 .

Those skilled in the art can understand that the system architecture platform 100 can be applied to a communication network system and a subsequent evolved mobile communication network system, etc., which is not specifically limited in this embodiment.

Those skilled in the art can understand that the system architecture platform shown in FIG. 1 does not constitute a limitation to the embodiment of the present application, and may include more or less components than those shown in the illustration, or combine some components, or have different Part placement.

Based on the above-mentioned system architecture platform, various embodiments of the data processing method of the present application are proposed below.

As shown in Figure 2, Figure 2 is a flowchart of a data processing method on the file service system side provided by an embodiment of the present application, the data processing method is applied to the file service system, and the data processing method includes but is not limited to step S100 , Step S200.

Step S100, when the number of concurrent download connections of the file service system reaches the connection threshold, a first file download request is obtained. The first file download request indicates that the first node applies to the file service system to download a file, and the file includes at least one data segment.

When the number of concurrent download connections of the file service system reaches the connection threshold, the file service system can no longer connect to the first node, and directly provides download services to the first node, then the file service system can obtain the first node issued by the first node. A file download request, the first file download request indicates that the first node applies to the file service system to download a file, and the file includes at least one data segment.

It should be noted that a file may be a public file in a general transmission scenario, or a private file in a closed transmission scenario, which is not specifically limited in this embodiment.

It should be noted that the file service system can divide the file into fragments according to the number of bytes of the file. For example, if the number of bytes of the file is less than or equal to the threshold, the file does not need to be divided into fragments, that is, The file includes one data segment; and for example, when the number of bytes of the file is greater than the threshold, then the file is segmented, that is, the file can include more than two data segments; The quantity is not specifically limited.

Step S200, assigning a second node to the first node according to the first file download request, so that the first node obtains the download data segment required by the first node through the second node.

The file service system can assign the second node that has downloaded the data segment to the first node according to the data segment that needs to be downloaded in the download request of the first node, so that the first node can obtain the data segment through the second node. The embodiment of the technical solution can allocate the second node to provide the data segment download service for the first node, and can reduce the problem that the file service system cannot provide the download service for the first node without the need to expand the device.

It should be noted that the file service system can determine the node that has downloaded the file or the data segment in the file as the second node and allocate To the first node; the file service system can also send query information to a node that establishes a connection relationship with the file service system within a period of time, and the query information is used to query whether the node has downloaded the file or data segment that the first node needs to download , then the feedback information of the node can be obtained, and then according to the feedback information, the node that has downloaded the file or the data fragment in the file is determined as the second node and assigned to the first node. The method is not specifically limited.

In one embodiment, when the number of concurrent download connections of the file service system reaches the connection threshold, the first file download request is obtained, and the file service system can no longer connect to the first node that sends the first file download request, and directly Provide download service to the first node, the first file download request indicates that the first node applies to the file service system for downloading the file, and the file includes at least one data segment; then the file service system can download the file according to the needs in the download request of the first node The data segment of the data segment is allocated to the first node to the second node that has downloaded the data segment, so that the first node can obtain the data segment through the second node. Since the embodiment of the technical solution can reach the number of concurrent download connections of the file service system In the case of the connection threshold, by assigning the second node to provide the data fragment download service for the first node, it can solve the problem that the file service system cannot provide the first node when the number of concurrent download connections reaches the connection threshold without expanding the device. Download service issues, thereby improving user experience.

As shown in FIG. 3 , FIG. 3 is a flow chart of generating a first data node list in the data processing method on the file service system side provided by an embodiment of the present application. The method steps for generating the first data node list are before step S100, including But not limited to step S310.

Step S310, generating a first data node list according to the data segment and the second nodes that have downloaded the data segment, and the first data node list includes node information of all the second nodes that have downloaded the data segment.

The file service system may generate a first data node list according to the data segments included in the file and the second nodes that downloaded the data segments. The first data node list includes node information of all the second nodes that have downloaded the data segments. It can be understood that, The first data node list is a data node list composed of node information of all second nodes that have downloaded a certain data segment.

It can be understood that, when the file service system segments a certain file into the first number of data segments, then the first data node list corresponding to the file has the first number.

It should be noted that after the downloaded data fragments are added to the second node, the file service system will obtain the first fragment information sent from the second node, the first fragment information represents the data fragments downloaded by the second node, and then The first data node list may be updated according to the first fragment information.

It should be noted that the file service system can initiate a request to the second node to obtain the first fragment information of the second node at regular intervals, so that the first fragment information sent from the second node can be obtained to update the first data Information in the node list.

As shown in FIG. 4, FIG. 4 is a flow chart of allocating second nodes in the data processing method on the file service system side provided by an embodiment of the present application. When the file service system has generated the first data node list, step S200 The method of allocating the second node to the first node according to the first file download request includes step S410 and step S420.

Step S410, query the first data node list corresponding to the data segment according to the first file download request.

The file service system may determine the first data node list corresponding to the data segment according to the downloaded data segment required by the first node in the first file download request, and query the first data node list.

Step S420, determining node information of a second node from the first data node list, and assigning the determined second node to the first node according to the node information of the second node.

The file service system can determine the node information of a second node from the first data node list, and then allocate the second node to the first node according to the node information of the second node, so that the first node can obtain the data through the second node Fragments, because the embodiment of this technical solution can provide data fragment download services for the first node by assigning the second node, it can solve the problem that the file service system cannot provide data fragments when the number of concurrent download connections reaches the connection threshold without the need for expansion equipment. The problem that the first node provides the download service can improve user experience.

It should be noted that the method of determining a second node from the first data node list may be to randomly determine a second node from the first data node list, or by obtaining the quality of the second node in the first data node list parameter, and then determine the second node with the highest quality parameter in the first data node list according to the quality parameter. This embodiment does not specifically limit the method for determining a second node from the first data node list.

It should be noted that the quality parameter may be a signal-to-noise ratio or a transmission rate, which is not specifically limited in this embodiment.

As shown in Figure 5, Figure 5 is another flow chart of allocating the second node in the data processing method on the file service system side provided by an embodiment of the present application, the file service system has generated the first data node list, and the data fragments include the first A data fragment and a second data fragment, in the case that the data fragments to be downloaded by the first node include the first data fragment and the second data fragment, in step S200, assign the second node to the first node according to the first file download request It includes step S510, step S520 and step S530.

Step S510, respectively query the first data node list corresponding to the first data segment and the first data node list corresponding to the second data segment according to the first file download request.

The file service system may determine the first data node list corresponding to the first data segment and the list of nodes corresponding to the second data segment according to the downloaded first data segment and the second data segment required by the first node in the first file download request. The first data node list, and respectively query the first data node list corresponding to the first data segment and the first data node list corresponding to the second data segment.

Step S520, determining node information of a second node from the first data node list corresponding to the first data segment, and assigning a second node that has downloaded the first data segment to the first node.

The file service system may determine the node information of a second node from the first data node list corresponding to the first data segment, and then submit the node information of the second node determined in the first data node list corresponding to the first data segment to The first node allocates the determined second node so that the first node can obtain the first data segment through the second node, because the embodiment of this technical solution can provide the first node with the first data segment download service by assigning the second node It can solve the problem that the file service system cannot provide the download service for the first node when the number of concurrent download connections reaches the connection threshold without expanding the capacity of the device, thereby improving user experience.

Step S530, determining node information of a second node from the first data node list corresponding to the second data segment, and assigning a second node that has downloaded the second data segment to the first node.

The file service system may determine the node information of a second node from the first data node list corresponding to the second data fragment, and then submit the node information of the second node determined in the first data node list corresponding to the second data fragment to The first node allocates the second node so that the first node can obtain the second data fragment through the second node. Since the embodiment of the technical solution can provide the second data fragment download service for the first node by assigning the second node, it can be Without the need to expand the device, the problem that the file service system cannot provide download services for the first node when the number of concurrent download connections reaches the connection threshold is solved, thereby improving user experience.

It should be noted that the method for determining the node information of a second node from the first data node list may be to randomly determine the node information of a second node from the first data node list, or by obtaining the node information of the first data node The quality parameter of the second node in the list, and then determine the node information of the second node with the highest quality parameter in the first data node list according to the quality parameter. This embodiment determines the node information of a second node from the first data node list The method is not specifically limited.

As shown in FIG. 6, FIG. 6 is a flow chart of generating a second data node list in the data processing method on the file service system side provided by an embodiment of the present application. The method steps for generating the first data node list are before step S100, including But not limited to step S610.

Step S610, generating a second data node list according to the data segment and the second node of the downloaded data segment, the second data node list includes segment information of all data segments and a second node corresponding to each segment information in all segment information Node information for the node.

The file service system may generate a second data node list according to the data segments included in the file and the second node for downloading the data segments, the second data node list includes segment information of all data segments and information related to each segment information in all segment information Corresponding to the node information of the second node, it can be understood that the second data node list is data composed of the segment information of all data segments and the node information of the second node corresponding to each data segment in all data segments list of nodes.

It can be understood that, when the file service system segments a file into a second number of data segments, the second data node list corresponding to the file includes segment information of the second number of data segments.

It should be noted that after the downloaded data fragments are added to the second node, the file service system will obtain the first fragment information sent from the second node, the first fragment information represents the data fragments downloaded by the second node, and then The second data node list may be updated according to the first fragment information.

It should be noted that the file service system may initiate an acquisition request to the second node to obtain the first fragment information of the second node at regular intervals, so that the first fragment information sent from the second node can be obtained to update the second node. Information in the list of data nodes.

As shown in FIG. 7, FIG. 7 is another flow chart of allocating the second node in the data processing method on the file service system side provided by an embodiment of the present application. In step S200, the first node is allocated to the first node according to the first file download request. The two nodes include step S710, step S720 and step S730.

Step S710, obtaining a second data node list;

Step S720, determining node information of a second node corresponding to the data segment from the second data node list according to the first file download request;

Step S730, assigning the second node to the first node according to the node information of the second node.

The file service system can obtain the second data node list, and then determine the node information of a second node corresponding to the data segment from the second data node list according to the first file download request, and then send the first file to the first node according to the node information of the second node The node allocates the second node so that the first node can obtain the data segment through the second node. Since the embodiment of this technical solution can provide the first node with the data segment download service by assigning the second node, there is no need to expand the device , which can reduce the problem that the file service system cannot provide the download service for the first node.

The data fragment includes the first data fragment and the second data fragment. In the case that the data fragment to be downloaded by the first node includes the first data fragment and the second data fragment, the file service system can obtain the second data node list, and then according to The first file download request determines the node information of a second node that has downloaded the first data fragment and the second data fragment from the second data node list, and allocates the second node to the first node according to the node information of the second node, so as to The first node can obtain the first data segment and the second data segment through the second node. Since the embodiment of this technical solution can provide the first node with the data segment download service by assigning the second node, it can The method solves the problem that the file service system cannot provide the download service for the first node when the number of concurrent download connections reaches the connection threshold, thereby improving user experience.

It should be noted that, the method for determining the node information of a second node from the second data node list may be to determine from the second data node list a plurality of second The node information of the node, and then randomly determine the node information of a second node from the node information of multiple second nodes; it can also be determined by obtaining all the data downloaded by the first node that needs to be downloaded by obtaining the second data node list The node information of multiple second nodes of the segment, and then obtain the quality parameters of multiple second nodes, and then determine the node information of the second node with the highest quality parameter according to the quality parameters. This embodiment determines from the second data node list The method of a second node is not specifically limited.

As shown in Figure 8, Figure 8 is a flowchart of a data processing method on the first node side provided by an embodiment of the present application, the data processing method is applied to the first node, and the data processing method includes but is not limited to step S810 , step S820.

Step S810, acquiring node information from the second node allocated by the file service system, the second node is a node that has downloaded the data segment required by the first node.

The first node sends the first file download request to the file service system. If the number of concurrent download connections in the file service system reaches the connection threshold, the first node will obtain the node from the second node allocated by the file service system. information, the second node is a node that has downloaded the data segment that the first node needs to download, and the second node information is used to trigger the first node to initiate a second node to the second node that has downloaded the data segment that the first node needs to download. File download request.

Step S820, sending a second file download request to the second node according to the node information of the second node, so as to obtain the data segment to be downloaded through the second node.

The first node can send a second file download request to the second node assigned by the file service system according to the node information of the second node, so that the first node obtains the data segment to be downloaded through the second node. Due to the technical solution In this embodiment, the second node allocated by the file service system can download data segments, which can solve the problem that the file service system cannot provide download services for the first node when the number of concurrent download connections reaches the connection threshold without the need for expansion equipment , thereby improving user experience.

As shown in Figure 9, Figure 9 is a flow chart of processing the downloaded data fragments of the data processing method on the first node side provided by an embodiment of the present application, the first node includes a first cache module, and the data in Figure 8 The processing method also includes but not limited to step S910.

Step S910, storing the data fragment obtained from the second node in the first cache module, and sending the second fragment information to the file service system, so that the file service system updates the first data node list or the first data node list according to the second fragment information. Two data node lists, the second fragment information is the fragment information of the data fragments downloaded by the first node.

After the first node completes the acquisition of the data segment from the second node, the first node stores the data segment in the first cache module, and then sends the second segment information to the file service system (the second segment information is the first node's fragment information of the downloaded data fragment), so that the file service system updates the first data node list or the second data node list according to the second fragment information, that is, the first node becomes the second node of the data fragment, and can be other A node provides the download service of the data segment.

It should be noted that after the first node stores the data segment in the first cache module, the declaration cycle can be set for the first cache module. When a node is downloading the data segment, delete the data segment, and send a first notification to the file service system to notify the file service system to delete the first data segment in the first data node list or the second data node list. information about a node.

As shown in Figure 10, Figure 10 is a flowchart of a data processing method on the second node side provided by an embodiment of the present application, the data processing method is applied to the second node, and the data processing method includes but is not limited to step S1010 , step S1020.

Step S1010, obtain the second file download request sent from the first node, the second file download request is a request to obtain the data segment to be downloaded from the first node, and the sending object of the second file download request is provided by the file service system in It is allocated when the number of concurrent download connections of the file service system reaches the connection threshold.

Step S1020, sending the data segment to the first node according to the second file download request.

The second node obtains the second file download request sent from the first node, wherein the second file download request is a request to obtain the data segment to be downloaded from the first node, and the second file download request is sent to the file service system Assigned when the number of concurrent download connections of the file service system reaches the connection threshold, the second node has downloaded the data segment to be downloaded, and then the second node sends the data segment to the first node according to the second file download request, because In the embodiment of the technical solution, the second node can send data fragments to the first node according to the second file download request when the number of concurrent download connections of the file service system reaches the connection threshold, which can solve the problem of file service without expanding the device. When the number of concurrent download connections reaches the connection threshold, the system cannot provide download services for the first node, thereby improving user experience.

As shown in Figure 11, Figure 11 is a flow chart of processing the downloaded data fragments of the data processing method on the second node side provided by an embodiment of the present application, the second node includes a second cache module, and the data in Figure 10 The processing method also includes but not limited to step S1110.

Step S1110, storing the data fragments obtained through the file service system in the second cache module, and sending the first fragment information to the file service system, so that the file service system can update the first data node list or the first data node list according to the first fragment information. Two data node lists, the first fragment information is the fragment information of the data fragments downloaded by the second node.

After the second node downloads the data segment through the file service system, the second node stores the data segment in the second cache module, and then sends the second segment information to the file service system (the first segment information is the downloaded data of the second node) fragment information of the data fragment), so that the file service system updates the first data node list or the second data node list according to the second fragment information.

It should be noted that after the second node stores the data segment in the second cache module, the declaration cycle can be set for the second cache module. When a node is downloading the data segment, delete the data segment and send a second notification to the file service system to notify the file service system to delete the data segment corresponding to the data segment in the first data node list or the second data node list Node information of the second node.

As shown in Figure 12, Figure 12 is a flowchart of a data processing method based on a system architecture platform provided by an embodiment of the present application, applied to the system architecture platform, and the data processing method in the scenario where the system architecture platform is used in a 5G message system Including but not limited to step 1210 to step S1280.

Step S1210, the terminal device initiates a first file download request to the file download server node;

Step S1220, the file download server node judges whether the file is a public file according to the file identifier descriptor (File Identifier Descriptor, FID) of the file to be downloaded by the terminal device in the first file download request;

Step S1230, if the file downloaded by the current user is a public file, then judge whether the number of concurrent download connections of the current file download server node reaches the connection threshold;

Step S1240, if the number of concurrent download connections does not reach the connection threshold, the file download server node directly provides the download service to the terminal device, and includes the node information of the terminal device in the data node list of the public file for standby;

Step S1250, if the number of concurrent download connections reaches the connection threshold, the file download manager searches the data node list according to the FID, and obtains the list information of the terminal device that is downloading the file and the fragment information of the data fragment of the file;

Step S1260, the file download manager allocates the terminal device that has downloaded the file to the terminal device according to the obtained list information of the terminal device currently downloading the file and the segment information of the data segment;

Step S1270, when the terminal device successfully downloads a data segment, the terminal device stores the data segment in the cache module, and prepares to provide services to terminal devices of other distributed nodes;

Step S1280, setting a statement period for the cache module of the terminal device, and when the time for storing the data segment in the cache module exceeds the statement period, and no other terminal device is currently downloading the data segment, delete the data segment from the cache module, And initiate a notification to the file download manager to notify the file download manager to delete the terminal device corresponding to the segment information of the data segment in the data node list.

Since the embodiment of the technical solution can provide the first node with data fragment download service by allocating the second node when the number of concurrent download connections of the file service system reaches the connection threshold, it can solve the file service system problem without expanding the capacity of the device. The problem that the download service cannot be provided for the first node when the number of concurrent download connections reaches the connection threshold can improve user experience.

Based on the above data processing method, various embodiments of the file service system, the terminal device, and the computer-readable storage medium of the present application are respectively proposed below.

An embodiment of the present application also provides a file service system. As shown in FIG. 13 , the file service system 1300 includes a memory 1320 , a processor 1310 and a computer program stored in the memory 1320 and executable on the processor 1310 .

The processor 1310 and the memory 1320 may be connected via a bus or in other ways.

The memory 1320, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. In addition, the memory 1320 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some implementations, memory 1320 may include memory located remotely from the processor, which remote memory may be connected to the processor through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The non-transitory software programs and instructions required to realize the data processing method of the above-mentioned embodiment are stored in the memory 1320, and when executed by the processor 1310, the data processing method in the above-mentioned embodiment is executed, for example, executing the above-described Figure 2 Method steps S100 to S200 in, method steps S310 in Fig. 3, method steps S410 to S420 in Fig. 4, method steps S510 to S530 in Fig. 5, method steps S610 in Fig. 6 and method steps in Fig. 7 S710 to S730.

An embodiment of the present application also provides a terminal device. As shown in FIG. 14 , a terminal device 1400 includes a memory 1420 , a processor 1410 , and a computer program stored in the memory 1420 and operable on the processor 1410 .

The processor 1410 and the memory 1420 may be connected through a bus or in other ways.

As a non-transitory computer-readable storage medium, the memory 1420 can be used to store non-transitory software programs and non-transitory computer-executable programs. In addition, the memory 1420 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. In some implementations, memory 1420 may include memory located remotely from the processor, which remote memory may be connected to the processor through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The non-transitory software programs and instructions required to realize the data processing method of the above-mentioned embodiment are stored in the memory 1420, and when executed by the processor 1410, the data processing method in the above-mentioned embodiment is executed, for example, executing the above-described Figure 8 The method steps S810 to S820 in FIG. 9 , the method steps S910 in FIG. 9 , the method steps S1010 to S1020 in FIG. 10 , and the method step S1110 in FIG. 11 .

In addition, an embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by a processor or a controller, for example, by the above-mentioned Execution by a processor in the communication device in the embodiment can cause the processor to execute the data processing method corresponding to the file service system in the above embodiment, for example, execute the method steps S100 to S200 in Fig. 2 described above, and Fig. 3 Method step S310 in FIG. 4 , method steps S410 to S420 in FIG. 4 , method steps S510 to S530 in FIG. 5 , method step S610 in FIG. 6 , and method steps S710 to S730 in FIG. 7 .

Alternatively, execute the data processing method corresponding to the terminal device in the above embodiments, for example, execute the method steps S810 to S820 in FIG. 8 , the method steps S910 in FIG. 9 , and the method steps S1010 to S1020 in FIG. 10 described above. , method step S1110 in FIG. 11 .

The embodiment of the present application includes: when the number of concurrent download connections of the file service system reaches the connection threshold, obtaining a first file download request, the first file download request indicates that the first node applies to the file service system to download a file, and the file includes at least one Data segment: assigning a second node to the first node according to the first file download request, so that the first node obtains the downloaded data segment required by the first node through the second node. In the embodiment of this technical solution, when the number of concurrent download connections of the file service system reaches the connection threshold, the file service system cannot provide the download service to the first node, then the file service system can send the file service system to the second node according to the first file download request. A node allocates the second node that has downloaded the data segment that the first node needs to download, so that the first node obtains the downloaded data segment required by the first node through the second node, because the embodiment of this technical solution can distribute the second node Providing the data fragment download service for the first node can reduce the problem that the file service system cannot provide the download service for the first node without expanding the device.

Those skilled in the art can understand that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware and an appropriate combination thereof. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit . Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. permanent, removable and non-removable media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

The above is a specific description of several embodiments of the present application, but the present application is not limited to the above-mentioned embodiments, and those skilled in the art can also make various equivalent deformations or replacements without violating the spirit of the present application. Equivalent modifications or replacements are all within the scope defined by the claims of the present application.

Claims

A data processing method applied to a file service system, comprising:

When the number of concurrent download connections of the file service system reaches the connection threshold, a first file download request is obtained, and the first file download request indicates that the first node applies to the file service system to download a file, and the file includes at least one data segment;

Allocating a second node to the first node according to the first file download request, so that the first node obtains the data segment required by the first node for downloading through the second node.
The data processing method according to claim 1, wherein, before assigning the second node to the first node according to the first file download request, comprising:

A first data node list is generated according to the data segment and the second node that has downloaded the data segment, and the first data node list includes node information of all the second nodes that have downloaded the data segment.
The data processing method according to claim 2, wherein said allocating a second node to said first node according to said first file download request comprises:

Querying the first data node list corresponding to the data segment according to the first file download request;

determining node information of one of the second nodes from the first data node list, and assigning the second node to the first node according to the node information of the second node.
The data processing method according to claim 2, wherein the data fragments include a first data fragment and a second data fragment, and the data fragments to be downloaded at the first node include the first data fragments and the second data fragments. In the case of the second data segment, the allocating the second node to the first node according to the first file download request includes:

respectively querying the first data node list corresponding to the first data segment and the first data node list corresponding to the second data segment according to the first file download request;

determining node information of a second node from the first data node list corresponding to the first data segment, and assigning a second node that has downloaded the first data segment to the first node;

Determining node information of a second node from the first data node list corresponding to the second data segment, and assigning a second node that has downloaded the second data segment to the first node.
The data processing method according to claim 1, wherein, before assigning the second node to the first node according to the first file download request, comprising:

Generate a second data node list according to the data fragment and the second node that has downloaded the data fragment, the second data node list includes fragment information of all the data fragments and each of all the fragment information Node information of the second node corresponding to the fragment information.
The data processing method according to claim 5, wherein said allocating a second node to said first node according to said first file download request comprises:

Obtain the second data node list;

determining node information of a second node corresponding to the data segment from the second data node list according to the first file download request;

Allocating the second node to the first node according to the node information of the second node.
The data processing method according to claim 6, wherein the data fragments include a first data fragment and a second data fragment, and the data fragments to be downloaded at the first node include the first data fragments and the second data fragments. In the case of the second data segment, the determining a second node corresponding to the data segment from the second data node list according to the first file download request includes:

A second node that has downloaded the first data segment and the second data segment is determined from the second data node list according to the first file download request.
The data processing method according to claim 2, wherein said method further comprises:

Obtaining first segment information sent from the second node, where the first segment information is segment information of the data segments downloaded by the second node;

Updating the first data node list according to the first fragment information.
The data processing method according to claim 5, wherein said method further comprises:

Obtaining first segment information sent from the second node, where the first segment information is segment information of the data segments downloaded by the second node;

Updating the second data node list according to the first fragment information.
A data processing method, applied to a first node, comprising:

Obtaining node information from a second node allocated by the file service system, the second node being a node that has downloaded the data segment required by the first node;

Sending a second file download request to the second node according to the node information of the second node, so as to obtain the data segment to be downloaded through the second node.
The data processing method according to claim 10, wherein the first node includes a first cache module, and the method further includes:

storing the data fragments obtained from the second node in the first cache module, and sending the second fragment information to the file service system, so that the file service system updates the first A data node list or a second data node list, the second segment information is the segment information of the data segments downloaded by the first node.
A data processing method applied to a second node, comprising:

Obtain a second file download request sent by the first node, the second file download request is a request to obtain the data segment to be downloaded from the first node, and the sending object of the second file download request is a file Assigned by the service system when the number of concurrent download connections of the file service system reaches the connection threshold;

sending the data segment to the first node according to a second file download request.
The data processing method according to claim 12, wherein the second node includes a second cache module, and the method further includes:

storing the data segments obtained through the file service system in a second cache module, and sending first segment information to the file service system, so that the file service system updates the first segment information according to the first segment information A data node list or a second data node list, the first segment information is the segment information of the data segments downloaded by the second node.
A file service system, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein, when the processor executes the computer program, any one of claims 1 to 9 is realized The data processing method described.
A terminal device, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein, when the processor executes the computer program, the data according to claim 10 or 11 is realized processing method, or realize the data processing method as claimed in claim 12 or 13.
A computer-readable storage medium storing computer-executable instructions for executing the data processing method described in any one of claims 1 to 9, or executing the data processing method described in claim 10 or 11 processing method, or execute the data processing method described in claim 12 or 13.