WO2022267692A1 - Procédé de traitement de données, système de service de fichiers, dispositif terminal et support de stockage - Google Patents

Procédé de traitement de données, système de service de fichiers, dispositif terminal et support de stockage Download PDF

Info

Publication number
WO2022267692A1
WO2022267692A1 PCT/CN2022/090046 CN2022090046W WO2022267692A1 WO 2022267692 A1 WO2022267692 A1 WO 2022267692A1 CN 2022090046 W CN2022090046 W CN 2022090046W WO 2022267692 A1 WO2022267692 A1 WO 2022267692A1
Authority
WO
WIPO (PCT)
Prior art keywords
node
data
file
information
segment
Prior art date
Application number
PCT/CN2022/090046
Other languages
English (en)
Chinese (zh)
Inventor
叶在伟
曾伟
刘超
孔伟
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2022267692A1 publication Critical patent/WO2022267692A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
    • H04L67/1078—Resource delivery mechanisms
    • H04L67/108—Resource delivery mechanisms characterised by resources being split in blocks or fragments

Definitions

  • the embodiments of the present application relate to but are not limited to the communication field, and in particular, relate to a data processing method, a file service system, a terminal device, and a storage medium.
  • the current 5G message system provides a unified traditional C/S mode.
  • the 5G message system mainly provides chat modes in three scenarios: single chat, group chat, and group sending.
  • the 5G message system uniformly adopts the C/S mode to provide file acquisition services to the terminal.
  • Embodiments of the present application provide a data processing method, a file service system, a terminal device, and a storage medium.
  • an embodiment of the present application provides a data processing method applied to a file service system, including: obtaining a first file download request when the number of concurrent download connections of the file service system reaches a connection threshold, and the The first file download request indicates that the first node applies to the file service system for downloading a file, and the file includes at least one data segment; assigns a second node to the first node according to the first file download request, so that all The first node acquires and downloads the data segment required by the first node through the second node.
  • the embodiment of the present application also provides a data processing method applied to the first node, including: obtaining node information from the second node allocated by the file service system, the second node is the node that has downloaded the The node of the data segment that the first node needs to download; send a second file download request to the second node according to the node information of the second node, so as to obtain the required download through the second node data fragment.
  • the embodiment of the present application also provides a data processing method applied to the second node, including: obtaining the second file download request sent from the first node, and the second file download request is sent to the The first node acquires a request for the data segment to be downloaded, and the sending object of the second file download request is allocated by the file service system when the number of concurrent download connections of the file service system reaches the connection threshold; according to the second A file download request sends the data segment to the first node.
  • the embodiment of the present application also provides a file service system, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the computer program when executing the computer program.
  • a file service system including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the computer program when executing the computer program.
  • the embodiment of the present application also provides a terminal device, including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the first step when executing the computer program.
  • a terminal device including: a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor implements the first step when executing the computer program.
  • the embodiment of the present application also provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are used to execute the data processing method described in the first aspect, or execute the second aspect The data processing method described in the third aspect, or execute the data processing method described in the third aspect.
  • FIG. 1 is a schematic diagram of a system architecture for executing a data processing method provided by an embodiment of the present application
  • FIG. 2 is a flowchart of a data processing method on the file service system side provided by an embodiment of the present application
  • FIG. 3 is a flow chart of generating a first data node list in a data processing method on the file service system side provided by an embodiment of the present application;
  • FIG. 4 is a flow chart of allocating a second node in the data processing method on the file service system side provided by an embodiment of the present application;
  • FIG. 5 is another flow chart of allocating a second node in the data processing method on the file service system side provided by an embodiment of the present application;
  • FIG. 6 is a flow chart of generating a second data node list in the data processing method on the file service system side provided by an embodiment of the present application;
  • FIG. 7 is another flow chart of allocating a second node in the data processing method on the file service system side provided by an embodiment of the present application.
  • FIG. 8 is a flowchart of a data processing method on the first node side provided by an embodiment of the present application.
  • FIG. 9 is a flow chart of processing downloaded data segments in a data processing method on the first node side provided by an embodiment of the present application.
  • FIG. 10 is a flowchart of a data processing method on the second node side provided by an embodiment of the present application.
  • FIG. 11 is a flow chart of processing downloaded data segments in a data processing method on the second node side provided by an embodiment of the present application.
  • Fig. 12 is a flowchart of a data processing method based on a system architecture platform provided by an embodiment of the present application
  • Fig. 13 is a schematic diagram of a file service system provided by an embodiment of the present application.
  • Fig. 14 is a schematic diagram of a terminal device provided by an embodiment of the present application.
  • An embodiment of the present application provides a data processing method, a file service system, a terminal device, and a storage medium.
  • the data processing method includes but is not limited to the following steps: when the number of concurrent download connections of the file service system reaches the connection threshold, obtain The first file download request, the first file download request indicates that the first node applies to the file service system for downloading the file, and the file includes at least one data segment; according to the first file download request, the second node is allocated to the first node, so that the first node The download data segment required by the first node is acquired through the second node.
  • the file service system when the number of concurrent download connections of the file service system reaches the connection threshold, the file service system cannot provide the download service to the first node, then the file service system can send the file service system to the second node according to the first file download request.
  • a node allocates the second node that has downloaded the data segment that the first node needs to download, so that the first node obtains the downloaded data segment required by the first node through the second node, because the embodiment of this technical solution can distribute the second node Providing data segment download services for the first node can solve the problem that the file service system cannot provide download services for the first node when the number of concurrent download connections reaches the connection threshold without the need to expand the device, thereby improving user experience .
  • FIG. 1 is a schematic diagram of a system architecture platform 100 for executing a data processing method provided by an embodiment of the present application.
  • the system architecture platform 100 is provided with a file service system 110 and a terminal device 120.
  • the file service system 110 is connected to the terminal device 120.
  • the terminal device 120 can download files through the file service system 110. Between the terminal devices 120 Files can be transferred. It can be understood that the terminal device 120 is a node in the system architecture platform, and the same terminal device 120 can be the first node or the second node according to different situations. It is not specifically limited.
  • the terminal device 120 when a terminal device 120 cannot download the file or data segment to be downloaded through the file service system 110 (that is, when the number of concurrent download connections of the file service system 110 reaches the connection threshold in this embodiment) , then the terminal device 120 is the first node; and in the case that the terminal device 120 has downloaded files or data fragments to be downloaded from other first nodes, the terminal device 120 is the second node.
  • the file service system 110 may include a file download server node 111 , a file download manager 112 and a firewall penetration manager 113 . in,
  • the file download server node 111 can be used to provide the components of the file download service to the terminal device 120, but the number of concurrent download connections between the file download server node 111 and the terminal device 120 is limited, for example: the file download server node 111 can at most simultaneously Provide connections to 10 terminal devices 120, then the file download server node 111 connection threshold is 10;
  • the file download manager 112 is used to manage the download of files, manage the distributed network, and distribute the load generated by the terminal devices 120 that need to be downloaded to the distributed network. It should be noted that multiple terminal devices 120 download simultaneously
  • the file can be a file that does not involve the user's personal privacy, which is not uniquely limited in this embodiment;
  • the firewall penetration manager 113 is a component used to help each node (terminal device 120) in the distributed network to complete TCP connection creation and file transfer. It should be noted that the firewall penetration manager 113 may be the NAT firewall penetration manager 113, which is not uniquely limited in this embodiment;
  • the file service system 110 may also include multiple components related to signal sending and receiving (for example, a processor, a modulator, a multiplexer, a demodulator, or a demultiplexer, etc.).
  • the terminal device 120 may be a node participating in the distributed network, and can share the file download service with other terminals when the number of concurrent download connections of the file download server node 111 reaches the connection threshold.
  • Terminal equipment 120 may also be referred to as user equipment (user equipment, UE), access terminal, subscriber unit, subscriber station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, User Agent or User Device.
  • the terminal device 120 in the embodiment of the present application can be a mobile phone (mobile phone), a tablet computer (Pad), a computer with a wireless transceiver function, a virtual reality (virtual reality, VR) terminal device 120, an augmented reality (augmented reality, AR) ) terminal equipment 120, wireless terminals in industrial control, wireless terminals in self driving, wireless terminals in remote medical, wireless terminals in smart grid, Wireless terminals in transportation safety, wireless terminals in smart city, wireless terminals in smart home, etc.
  • the embodiments of the present application do not limit the application scenarios.
  • the terminal device 120 with wireless transceiver function and the chips that can be installed in the aforementioned terminal device 120 are collectively referred to as the terminal device 120 .
  • system architecture platform 100 can be applied to a communication network system and a subsequent evolved mobile communication network system, etc., which is not specifically limited in this embodiment.
  • FIG. 1 does not constitute a limitation to the embodiment of the present application, and may include more or less components than those shown in the illustration, or combine some components, or have different Part placement.
  • Figure 2 is a flowchart of a data processing method on the file service system side provided by an embodiment of the present application, the data processing method is applied to the file service system, and the data processing method includes but is not limited to step S100 , Step S200.
  • Step S100 when the number of concurrent download connections of the file service system reaches the connection threshold, a first file download request is obtained.
  • the first file download request indicates that the first node applies to the file service system to download a file, and the file includes at least one data segment.
  • the file service system can no longer connect to the first node, and directly provides download services to the first node, then the file service system can obtain the first node issued by the first node.
  • a file download request, the first file download request indicates that the first node applies to the file service system to download a file, and the file includes at least one data segment.
  • a file may be a public file in a general transmission scenario, or a private file in a closed transmission scenario, which is not specifically limited in this embodiment.
  • the file service system can divide the file into fragments according to the number of bytes of the file. For example, if the number of bytes of the file is less than or equal to the threshold, the file does not need to be divided into fragments, that is, The file includes one data segment; and for example, when the number of bytes of the file is greater than the threshold, then the file is segmented, that is, the file can include more than two data segments; The quantity is not specifically limited.
  • Step S200 assigning a second node to the first node according to the first file download request, so that the first node obtains the download data segment required by the first node through the second node.
  • the file service system can assign the second node that has downloaded the data segment to the first node according to the data segment that needs to be downloaded in the download request of the first node, so that the first node can obtain the data segment through the second node.
  • the embodiment of the technical solution can allocate the second node to provide the data segment download service for the first node, and can reduce the problem that the file service system cannot provide the download service for the first node without the need to expand the device.
  • the file service system can determine the node that has downloaded the file or the data segment in the file as the second node and allocate To the first node; the file service system can also send query information to a node that establishes a connection relationship with the file service system within a period of time, and the query information is used to query whether the node has downloaded the file or data segment that the first node needs to download , then the feedback information of the node can be obtained, and then according to the feedback information, the node that has downloaded the file or the data fragment in the file is determined as the second node and assigned to the first node.
  • the method is not specifically limited.
  • the first file download request when the number of concurrent download connections of the file service system reaches the connection threshold, the first file download request is obtained, and the file service system can no longer connect to the first node that sends the first file download request, and directly Provide download service to the first node, the first file download request indicates that the first node applies to the file service system for downloading the file, and the file includes at least one data segment; then the file service system can download the file according to the needs in the download request of the first node The data segment of the data segment is allocated to the first node to the second node that has downloaded the data segment, so that the first node can obtain the data segment through the second node.
  • connection threshold By assigning the second node to provide the data fragment download service for the first node, it can solve the problem that the file service system cannot provide the first node when the number of concurrent download connections reaches the connection threshold without expanding the device. Download service issues, thereby improving user experience.
  • FIG. 3 is a flow chart of generating a first data node list in the data processing method on the file service system side provided by an embodiment of the present application.
  • the method steps for generating the first data node list are before step S100, including But not limited to step S310.
  • Step S310 generating a first data node list according to the data segment and the second nodes that have downloaded the data segment, and the first data node list includes node information of all the second nodes that have downloaded the data segment.
  • the file service system may generate a first data node list according to the data segments included in the file and the second nodes that downloaded the data segments.
  • the first data node list includes node information of all the second nodes that have downloaded the data segments. It can be understood that, The first data node list is a data node list composed of node information of all second nodes that have downloaded a certain data segment.
  • the file service system segments a certain file into the first number of data segments, then the first data node list corresponding to the file has the first number.
  • the file service system will obtain the first fragment information sent from the second node, the first fragment information represents the data fragments downloaded by the second node, and then The first data node list may be updated according to the first fragment information.
  • the file service system can initiate a request to the second node to obtain the first fragment information of the second node at regular intervals, so that the first fragment information sent from the second node can be obtained to update the first data Information in the node list.
  • FIG. 4 is a flow chart of allocating second nodes in the data processing method on the file service system side provided by an embodiment of the present application.
  • step S200 The method of allocating the second node to the first node according to the first file download request includes step S410 and step S420.
  • Step S410 query the first data node list corresponding to the data segment according to the first file download request.
  • the file service system may determine the first data node list corresponding to the data segment according to the downloaded data segment required by the first node in the first file download request, and query the first data node list.
  • Step S420 determining node information of a second node from the first data node list, and assigning the determined second node to the first node according to the node information of the second node.
  • the file service system can determine the node information of a second node from the first data node list, and then allocate the second node to the first node according to the node information of the second node, so that the first node can obtain the data through the second node Fragments, because the embodiment of this technical solution can provide data fragment download services for the first node by assigning the second node, it can solve the problem that the file service system cannot provide data fragments when the number of concurrent download connections reaches the connection threshold without the need for expansion equipment.
  • the problem that the first node provides the download service can improve user experience.
  • the method of determining a second node from the first data node list may be to randomly determine a second node from the first data node list, or by obtaining the quality of the second node in the first data node list parameter, and then determine the second node with the highest quality parameter in the first data node list according to the quality parameter.
  • This embodiment does not specifically limit the method for determining a second node from the first data node list.
  • the quality parameter may be a signal-to-noise ratio or a transmission rate, which is not specifically limited in this embodiment.
  • Figure 5 is another flow chart of allocating the second node in the data processing method on the file service system side provided by an embodiment of the present application
  • the file service system has generated the first data node list, and the data fragments include the first A data fragment and a second data fragment, in the case that the data fragments to be downloaded by the first node include the first data fragment and the second data fragment, in step S200, assign the second node to the first node according to the first file download request It includes step S510, step S520 and step S530.
  • Step S510 respectively query the first data node list corresponding to the first data segment and the first data node list corresponding to the second data segment according to the first file download request.
  • the file service system may determine the first data node list corresponding to the first data segment and the list of nodes corresponding to the second data segment according to the downloaded first data segment and the second data segment required by the first node in the first file download request.
  • the first data node list and respectively query the first data node list corresponding to the first data segment and the first data node list corresponding to the second data segment.
  • Step S520 determining node information of a second node from the first data node list corresponding to the first data segment, and assigning a second node that has downloaded the first data segment to the first node.
  • the file service system may determine the node information of a second node from the first data node list corresponding to the first data segment, and then submit the node information of the second node determined in the first data node list corresponding to the first data segment to The first node allocates the determined second node so that the first node can obtain the first data segment through the second node, because the embodiment of this technical solution can provide the first node with the first data segment download service by assigning the second node It can solve the problem that the file service system cannot provide the download service for the first node when the number of concurrent download connections reaches the connection threshold without expanding the capacity of the device, thereby improving user experience.
  • the file service system may determine the node information of a second node from the first data node list corresponding to the second data fragment, and then submit the node information of the second node determined in the first data node list corresponding to the second data fragment to The first node allocates the second node so that the first node can obtain the second data fragment through the second node. Since the embodiment of the technical solution can provide the second data fragment download service for the first node by assigning the second node, it can be Without the need to expand the device, the problem that the file service system cannot provide download services for the first node when the number of concurrent download connections reaches the connection threshold is solved, thereby improving user experience.
  • the method for determining the node information of a second node from the first data node list may be to randomly determine the node information of a second node from the first data node list, or by obtaining the node information of the first data node The quality parameter of the second node in the list, and then determine the node information of the second node with the highest quality parameter in the first data node list according to the quality parameter.
  • This embodiment determines the node information of a second node from the first data node list
  • the method is not specifically limited.
  • the quality parameter may be a signal-to-noise ratio or a transmission rate, which is not specifically limited in this embodiment.
  • FIG. 6 is a flow chart of generating a second data node list in the data processing method on the file service system side provided by an embodiment of the present application.
  • the method steps for generating the first data node list are before step S100, including But not limited to step S610.
  • Step S610 generating a second data node list according to the data segment and the second node of the downloaded data segment, the second data node list includes segment information of all data segments and a second node corresponding to each segment information in all segment information Node information for the node.
  • the file service system may generate a second data node list according to the data segments included in the file and the second node for downloading the data segments, the second data node list includes segment information of all data segments and information related to each segment information in all segment information Corresponding to the node information of the second node, it can be understood that the second data node list is data composed of the segment information of all data segments and the node information of the second node corresponding to each data segment in all data segments list of nodes.
  • the second data node list corresponding to the file includes segment information of the second number of data segments.
  • the file service system will obtain the first fragment information sent from the second node, the first fragment information represents the data fragments downloaded by the second node, and then The second data node list may be updated according to the first fragment information.
  • the file service system may initiate an acquisition request to the second node to obtain the first fragment information of the second node at regular intervals, so that the first fragment information sent from the second node can be obtained to update the second node.
  • Information in the list of data nodes may be initiated to initiate an acquisition request to the second node to obtain the first fragment information of the second node at regular intervals, so that the first fragment information sent from the second node can be obtained to update the second node.
  • FIG. 7 is another flow chart of allocating the second node in the data processing method on the file service system side provided by an embodiment of the present application.
  • step S200 the first node is allocated to the first node according to the first file download request.
  • the two nodes include step S710, step S720 and step S730.
  • Step S710 obtaining a second data node list
  • Step S720 determining node information of a second node corresponding to the data segment from the second data node list according to the first file download request;
  • Step S730 assigning the second node to the first node according to the node information of the second node.
  • the file service system can obtain the second data node list, and then determine the node information of a second node corresponding to the data segment from the second data node list according to the first file download request, and then send the first file to the first node according to the node information of the second node
  • the node allocates the second node so that the first node can obtain the data segment through the second node. Since the embodiment of this technical solution can provide the first node with the data segment download service by assigning the second node, there is no need to expand the device , which can reduce the problem that the file service system cannot provide the download service for the first node.
  • the data fragment includes the first data fragment and the second data fragment.
  • the file service system can obtain the second data node list, and then according to The first file download request determines the node information of a second node that has downloaded the first data fragment and the second data fragment from the second data node list, and allocates the second node to the first node according to the node information of the second node, so as to The first node can obtain the first data segment and the second data segment through the second node.
  • the embodiment of this technical solution can provide the first node with the data segment download service by assigning the second node, it can The method solves the problem that the file service system cannot provide the download service for the first node when the number of concurrent download connections reaches the connection threshold, thereby improving user experience.
  • the method for determining the node information of a second node from the second data node list may be to determine from the second data node list a plurality of second The node information of the node, and then randomly determine the node information of a second node from the node information of multiple second nodes; it can also be determined by obtaining all the data downloaded by the first node that needs to be downloaded by obtaining the second data node list The node information of multiple second nodes of the segment, and then obtain the quality parameters of multiple second nodes, and then determine the node information of the second node with the highest quality parameter according to the quality parameters.
  • This embodiment determines from the second data node list
  • the method of a second node is not specifically limited.
  • the quality parameter may be a signal-to-noise ratio or a transmission rate, which is not specifically limited in this embodiment.
  • Figure 8 is a flowchart of a data processing method on the first node side provided by an embodiment of the present application, the data processing method is applied to the first node, and the data processing method includes but is not limited to step S810 , step S820.
  • Step S810 acquiring node information from the second node allocated by the file service system, the second node is a node that has downloaded the data segment required by the first node.
  • the first node sends the first file download request to the file service system. If the number of concurrent download connections in the file service system reaches the connection threshold, the first node will obtain the node from the second node allocated by the file service system. information, the second node is a node that has downloaded the data segment that the first node needs to download, and the second node information is used to trigger the first node to initiate a second node to the second node that has downloaded the data segment that the first node needs to download. File download request.
  • Step S820 sending a second file download request to the second node according to the node information of the second node, so as to obtain the data segment to be downloaded through the second node.
  • the first node can send a second file download request to the second node assigned by the file service system according to the node information of the second node, so that the first node obtains the data segment to be downloaded through the second node. Due to the technical solution In this embodiment, the second node allocated by the file service system can download data segments, which can solve the problem that the file service system cannot provide download services for the first node when the number of concurrent download connections reaches the connection threshold without the need for expansion equipment , thereby improving user experience.
  • Figure 9 is a flow chart of processing the downloaded data fragments of the data processing method on the first node side provided by an embodiment of the present application, the first node includes a first cache module, and the data in Figure 8 The processing method also includes but not limited to step S910.
  • Step S910 storing the data fragment obtained from the second node in the first cache module, and sending the second fragment information to the file service system, so that the file service system updates the first data node list or the first data node list according to the second fragment information.
  • the second fragment information is the fragment information of the data fragments downloaded by the first node.
  • the first node After the first node completes the acquisition of the data segment from the second node, the first node stores the data segment in the first cache module, and then sends the second segment information to the file service system (the second segment information is the first node's fragment information of the downloaded data fragment), so that the file service system updates the first data node list or the second data node list according to the second fragment information, that is, the first node becomes the second node of the data fragment, and can be other A node provides the download service of the data segment.
  • the second segment information is the first node's fragment information of the downloaded data fragment
  • the declaration cycle can be set for the first cache module.
  • a node is downloading the data segment, delete the data segment, and send a first notification to the file service system to notify the file service system to delete the first data segment in the first data node list or the second data node list. information about a node.
  • Figure 10 is a flowchart of a data processing method on the second node side provided by an embodiment of the present application, the data processing method is applied to the second node, and the data processing method includes but is not limited to step S1010 , step S1020.
  • Step S1010 obtain the second file download request sent from the first node, the second file download request is a request to obtain the data segment to be downloaded from the first node, and the sending object of the second file download request is provided by the file service system in It is allocated when the number of concurrent download connections of the file service system reaches the connection threshold.
  • Step S1020 sending the data segment to the first node according to the second file download request.
  • the second node obtains the second file download request sent from the first node, wherein the second file download request is a request to obtain the data segment to be downloaded from the first node, and the second file download request is sent to the file service system Assigned when the number of concurrent download connections of the file service system reaches the connection threshold, the second node has downloaded the data segment to be downloaded, and then the second node sends the data segment to the first node according to the second file download request, because
  • the second node can send data fragments to the first node according to the second file download request when the number of concurrent download connections of the file service system reaches the connection threshold, which can solve the problem of file service without expanding the device.
  • the connection threshold the system cannot provide download services for the first node, thereby improving user experience.
  • Figure 11 is a flow chart of processing the downloaded data fragments of the data processing method on the second node side provided by an embodiment of the present application, the second node includes a second cache module, and the data in Figure 10
  • the processing method also includes but not limited to step S1110.
  • Step S1110 storing the data fragments obtained through the file service system in the second cache module, and sending the first fragment information to the file service system, so that the file service system can update the first data node list or the first data node list according to the first fragment information.
  • the first fragment information is the fragment information of the data fragments downloaded by the second node.
  • the second node After the second node downloads the data segment through the file service system, the second node stores the data segment in the second cache module, and then sends the second segment information to the file service system (the first segment information is the downloaded data of the second node) fragment information of the data fragment), so that the file service system updates the first data node list or the second data node list according to the second fragment information.
  • the declaration cycle can be set for the second cache module.
  • a node is downloading the data segment, delete the data segment and send a second notification to the file service system to notify the file service system to delete the data segment corresponding to the data segment in the first data node list or the second data node list Node information of the second node.
  • Figure 12 is a flowchart of a data processing method based on a system architecture platform provided by an embodiment of the present application, applied to the system architecture platform, and the data processing method in the scenario where the system architecture platform is used in a 5G message system Including but not limited to step 1210 to step S1280.
  • Step S1210 the terminal device initiates a first file download request to the file download server node
  • Step S1220 the file download server node judges whether the file is a public file according to the file identifier descriptor (File Identifier Descriptor, FID) of the file to be downloaded by the terminal device in the first file download request;
  • FID File Identifier Descriptor
  • Step S1230 if the file downloaded by the current user is a public file, then judge whether the number of concurrent download connections of the current file download server node reaches the connection threshold;
  • Step S1240 if the number of concurrent download connections does not reach the connection threshold, the file download server node directly provides the download service to the terminal device, and includes the node information of the terminal device in the data node list of the public file for standby;
  • Step S1250 if the number of concurrent download connections reaches the connection threshold, the file download manager searches the data node list according to the FID, and obtains the list information of the terminal device that is downloading the file and the fragment information of the data fragment of the file;
  • Step S1260 the file download manager allocates the terminal device that has downloaded the file to the terminal device according to the obtained list information of the terminal device currently downloading the file and the segment information of the data segment;
  • Step S1270 when the terminal device successfully downloads a data segment, the terminal device stores the data segment in the cache module, and prepares to provide services to terminal devices of other distributed nodes;
  • Step S1280 setting a statement period for the cache module of the terminal device, and when the time for storing the data segment in the cache module exceeds the statement period, and no other terminal device is currently downloading the data segment, delete the data segment from the cache module, And initiate a notification to the file download manager to notify the file download manager to delete the terminal device corresponding to the segment information of the data segment in the data node list.
  • the embodiment of the technical solution can provide the first node with data fragment download service by allocating the second node when the number of concurrent download connections of the file service system reaches the connection threshold, it can solve the file service system problem without expanding the capacity of the device.
  • the problem that the download service cannot be provided for the first node when the number of concurrent download connections reaches the connection threshold can improve user experience.
  • the file service system 1300 includes a memory 1320 , a processor 1310 and a computer program stored in the memory 1320 and executable on the processor 1310 .
  • the processor 1310 and the memory 1320 may be connected via a bus or in other ways.
  • the memory 1320 can be used to store non-transitory software programs and non-transitory computer-executable programs.
  • the memory 1320 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices.
  • memory 1320 may include memory located remotely from the processor, which remote memory may be connected to the processor through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the non-transitory software programs and instructions required to realize the data processing method of the above-mentioned embodiment are stored in the memory 1320, and when executed by the processor 1310, the data processing method in the above-mentioned embodiment is executed, for example, executing the above-described Figure 2 Method steps S100 to S200 in, method steps S310 in Fig. 3, method steps S410 to S420 in Fig. 4, method steps S510 to S530 in Fig. 5, method steps S610 in Fig. 6 and method steps in Fig. 7 S710 to S730.
  • a terminal device 1400 includes a memory 1420 , a processor 1410 , and a computer program stored in the memory 1420 and operable on the processor 1410 .
  • the processor 1410 and the memory 1420 may be connected through a bus or in other ways.
  • the memory 1420 can be used to store non-transitory software programs and non-transitory computer-executable programs.
  • the memory 1420 may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices.
  • memory 1420 may include memory located remotely from the processor, which remote memory may be connected to the processor through a network. Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the non-transitory software programs and instructions required to realize the data processing method of the above-mentioned embodiment are stored in the memory 1420, and when executed by the processor 1410, the data processing method in the above-mentioned embodiment is executed, for example, executing the above-described Figure 8
  • the method steps S810 to S820 in FIG. 9 , the method steps S910 in FIG. 9 , the method steps S1010 to S1020 in FIG. 10 , and the method step S1110 in FIG. 11 are stored in the memory 1420, and when executed by the processor 1410, the data processing method in the above-mentioned embodiment is executed, for example, executing the above-described Figure 8
  • the method steps S810 to S820 in FIG. 9 the method steps S910 in FIG. 9
  • the method steps S1010 to S1020 in FIG. 10 the method steps S1110 in FIG. 11 .
  • an embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by a processor or a controller, for example, by the above-mentioned Execution by a processor in the communication device in the embodiment can cause the processor to execute the data processing method corresponding to the file service system in the above embodiment, for example, execute the method steps S100 to S200 in Fig. 2 described above, and Fig. 3 Method step S310 in FIG. 4 , method steps S410 to S420 in FIG. 4 , method steps S510 to S530 in FIG. 5 , method step S610 in FIG. 6 , and method steps S710 to S730 in FIG. 7 .
  • execute the data processing method corresponding to the terminal device in the above embodiments for example, execute the method steps S810 to S820 in FIG. 8 , the method steps S910 in FIG. 9 , and the method steps S1010 to S1020 in FIG. 10 described above. , method step S1110 in FIG. 11 .
  • the embodiment of the present application includes: when the number of concurrent download connections of the file service system reaches the connection threshold, obtaining a first file download request, the first file download request indicates that the first node applies to the file service system to download a file, and the file includes at least one Data segment: assigning a second node to the first node according to the first file download request, so that the first node obtains the downloaded data segment required by the first node through the second node.
  • the file service system when the number of concurrent download connections of the file service system reaches the connection threshold, the file service system cannot provide the download service to the first node, then the file service system can send the file service system to the second node according to the first file download request.
  • a node allocates the second node that has downloaded the data segment that the first node needs to download, so that the first node obtains the downloaded data segment required by the first node through the second node, because the embodiment of this technical solution can distribute the second node Providing the data fragment download service for the first node can reduce the problem that the file service system cannot provide the download service for the first node without expanding the device.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer.
  • communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un procédé de traitement de données, un système de service de fichiers, un dispositif terminal et un support de stockage. Le procédé de traitement de données comprend les étapes suivantes : lorsque le nombre de connexions simultanées de téléchargement du système de service de fichiers atteint une valeur seuil de connexions, obtenir une première demande de téléchargement de fichier, la première demande de téléchargement de fichier indiquant qu'un premier noeud demande au système de service de fichier de télécharger un fichier, le fichier comprenant au moins un fragment de données (S100) ; et attribuer un second noeud au premier noeud selon la première demande de téléchargement de fichier, de sorte que le premier noeud obtient un fragment de données de téléchargement requis pour le premier noeud au moyen du second noeud (S200).
PCT/CN2022/090046 2021-06-23 2022-04-28 Procédé de traitement de données, système de service de fichiers, dispositif terminal et support de stockage WO2022267692A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110696241.4A CN115514753A (zh) 2021-06-23 2021-06-23 数据处理方法、文件服务系统、终端设备以及存储介质
CN202110696241.4 2021-06-23

Publications (1)

Publication Number Publication Date
WO2022267692A1 true WO2022267692A1 (fr) 2022-12-29

Family

ID=84499015

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/090046 WO2022267692A1 (fr) 2021-06-23 2022-04-28 Procédé de traitement de données, système de service de fichiers, dispositif terminal et support de stockage

Country Status (2)

Country Link
CN (1) CN115514753A (fr)
WO (1) WO2022267692A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101039187A (zh) * 2006-03-17 2007-09-19 腾讯科技（深圳）有限公司 一种数据下载的方法及其系统
CN101505315A (zh) * 2008-12-25 2009-08-12 中山大学 P2p游戏服务器控制系统
US20120054282A1 (en) * 2010-08-27 2012-03-01 Industrial Technology Research Institute Architecture and method for hybrid peer to peer/client-server data transmission
CN102685083A (zh) * 2011-03-17 2012-09-19 开心人网络科技（北京）有限公司 一种点对点文件下载方法、服务器及客户端
CN103747032A (zh) * 2013-12-12 2014-04-23 北京奇虎科技有限公司 一种文件传输方法、设备和系统
CN111147595A (zh) * 2019-12-30 2020-05-12 昆山丘钛微电子科技有限公司 一种文档下载方法、系统、服务器和客户端

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101039187A (zh) * 2006-03-17 2007-09-19 腾讯科技（深圳）有限公司 一种数据下载的方法及其系统
CN101505315A (zh) * 2008-12-25 2009-08-12 中山大学 P2p游戏服务器控制系统
US20120054282A1 (en) * 2010-08-27 2012-03-01 Industrial Technology Research Institute Architecture and method for hybrid peer to peer/client-server data transmission
CN102685083A (zh) * 2011-03-17 2012-09-19 开心人网络科技（北京）有限公司 一种点对点文件下载方法、服务器及客户端
CN103747032A (zh) * 2013-12-12 2014-04-23 北京奇虎科技有限公司 一种文件传输方法、设备和系统
CN111147595A (zh) * 2019-12-30 2020-05-12 昆山丘钛微电子科技有限公司 一种文档下载方法、系统、服务器和客户端

Also Published As

Publication number Publication date
CN115514753A (zh) 2022-12-23

Similar Documents

Publication Publication Date Title
US11172023B2 (en) Data synchronization method and system
US10419531B2 (en) Method for setting gateway device identity, and management gateway device
CN111565404B (zh) 一种数据分流方法和装置
US20180019961A1 (en) Message processing method, processing server, terminal, and storage medium
WO2019001421A1 (fr) Procédé, dispositif, système et support de stockage lisible par ordinateur de gestion de tranche de réseau
CN113596191B (zh) 一种数据处理方法、网元设备以及可读存储介质
US20170373931A1 (en) Method for updating network service descriptor nsd and apparatus
US11251981B2 (en) Communication method and apparatus
EP3735043B1 (fr) Procédé et appareil de déploiement de tranche de réseau
WO2022237280A1 (fr) Procédé et appareil de découverte de serveur dns, dispositif informatique, support de stockage lisible par ordinateur et produit-programme informatique
US11617063B2 (en) Method, apparatus, and system for changing association relationship between MCPTT user and MCPTT group
US20200244753A1 (en) Method, system and server for stream-pushing
KR102500594B1 (ko) 통신 네트워크에서의 서비스 계층 메시지 템플릿들
US20220248290A1 (en) Communication Method and Communications Apparatus
WO2020015649A1 (fr) Procédé, dispositif et système de traitement de relation d'exclusion mutuelle de tranches de réseau, et support
US20230269794A1 (en) Local network accessing method and apparatus
US9459807B2 (en) Methods and systems for providing resources for cloud storage
EP3417367A1 (fr) Mettre en oeuvre un système de stockage au moyen d'un dispositif utilisateur individuel et d'un dispositif de distribution de données
KR20170016281A (ko) 콘텐트 중심 네트워크 스택들에서의 상태 전달
KR20130130295A (ko) 단말을 서버에 할당하고 단말로의 효율적인 메시징을 위한 시스템 및 방법
US10268532B2 (en) Application message processing system, method, and application device
WO2020248633A1 (fr) Procédé et appareil de gestion de membre de groupe, procédé et appareil de traitement de message de groupe, dispositif, et support de stockage
WO2022267692A1 (fr) Procédé de traitement de données, système de service de fichiers, dispositif terminal et support de stockage
CN107087011B (zh) 一种远程访问的实现方法、装置和系统
US20050198370A1 (en) Method for creating, deleting, and maintaining logical networks

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22827191

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22827191

Country of ref document: EP

Kind code of ref document: A1