CN113271475A - Data processing method, system, electronic equipment and storage medium - Google Patents

Data processing method, system, electronic equipment and storage medium Download PDF

Info

Publication number
CN113271475A
CN113271475A CN202110390541.XA CN202110390541A CN113271475A CN 113271475 A CN113271475 A CN 113271475A CN 202110390541 A CN202110390541 A CN 202110390541A CN 113271475 A CN113271475 A CN 113271475A
Authority
CN
China
Prior art keywords
video
acquisition request
client
video acquisition
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110390541.XA
Other languages
Chinese (zh)
Other versions
CN113271475B (en
Inventor
姜宇嘉
胡晨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN202110390541.XA priority Critical patent/CN113271475B/en
Publication of CN113271475A publication Critical patent/CN113271475A/en
Application granted granted Critical
Publication of CN113271475B publication Critical patent/CN113271475B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23406Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving management of server-side video buffer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application provides a data processing method, a data processing system, electronic equipment and a storage medium, and belongs to the technical field of internet. The method comprises the steps of receiving a first video acquisition request sent by client equipment; if a second video acquisition request which is not processed exists currently, acquiring first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request; determining whether there is duplicate content in the first video and the second video based on the first video information and the second video information; if the first video and the second video have repeated content, instructing the P2P client to continue providing data corresponding to the second video acquisition request; and if the first video and the second video do not have repeated content, indicating the P2P client to provide data corresponding to the first video acquisition request. Avoiding the situation where the P2P client cannot confirm which video acquisition request should be processed.

Description

Data processing method, system, electronic equipment and storage medium
Technical Field
The present application relates to the field of internet technologies, and in particular, to a data processing method, system, electronic device, and storage medium.
Background
The system player is a carrier for playing videos for the terminal device, and there are two ways to provide video data to the system player: the CDN server directly provides video data and the P2P network provides video data, because the CDN server directly provides video data easily causes large bandwidth consumption, so to reduce cost, the P2P network is often used to provide video data, and the P2P client provides corresponding video data according to a data request sent by the system player.
P2P is the abbreviation of peer-to-peer, also called peer-to-peer technology, where peer-to-peer transmission mainly refers to the transmission of data without passing through a server, but two points are directly connected and then transmit data, and it is a peer-to-peer network without a central server and relying on a user group node to exchange information. Each user node in the P2P network is a client and a server, and can simultaneously serve as a server to other nodes.
However, when the system player is provided with video data through the P2P network, the previous data request is not processed and the next data request is continued. In this case, the P2P client cannot easily confirm which request should be processed, and a contradiction occurs between the processing of the current request and the processing of the next request, which may cause the phenomena of skipping, jamming, and incapability of playing video in the system player.
Disclosure of Invention
In order to solve the technical problems of the phenomena of film skipping, pause, incapability of playing and the like generated in the process of playing videos by the system player, the application provides a data processing method, a system, electronic equipment and a storage medium.
In a first aspect, a data processing method is provided, the method including:
receiving a first video acquisition request sent by client equipment;
if a second video acquisition request which is not processed exists currently, acquiring first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request;
determining whether there is duplicate content in the first video and the second video based on the first video information and the second video information;
if the first video and the second video have repeated content, instructing the P2P client to continue providing data corresponding to the second video acquisition request;
and if the first video and the second video do not have repeated content, indicating the P2P client to provide data corresponding to the first video acquisition request.
Optionally, before receiving the first video obtaining request sent by the client device, the method further includes:
if a data request sent by client equipment is received, acquiring an index file corresponding to the data request, wherein the index file comprises at least one video acquisition request;
replacing the original data server address in the index file by using a preset proxy module IP address and a preset port number;
and sending the index file to the client equipment.
Optionally, if a data request sent by the client device is received, the method further includes:
creating a processing task corresponding to the index file based on the index file corresponding to the data request;
if a first video acquisition request sent by client equipment is received, searching an index file corresponding to the first video acquisition request, and processing the first video acquisition request by using a processing task corresponding to the index file.
Optionally, the instructing the P2P client to provide data corresponding to the first video acquisition request includes:
determining a target download location based on the first video acquisition request;
and instructing the P2P client to adjust the current downloading position to the target downloading position so as to download the data corresponding to the first video acquisition request.
Optionally, if there is duplicate content in the first video and the second video, the method further includes:
switching the P2P client providing data so that the switched P2P client provides data corresponding to the second video acquisition request.
Optionally, if there is duplicate content in the first video and the second video, the method further includes:
and switching the network used for downloading the data, so that the P2P client provides the data corresponding to the second video acquisition request by using the switched network.
In a second aspect, there is provided a data processing system, the system comprising: client devices, proxy modules and P2P clients;
the client device is used for sending a first video acquisition request to the agent module;
the proxy module is used for receiving a first video acquisition request sent by client equipment; if a second video acquisition request which is not processed exists currently, acquiring first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request; determining whether there is duplicate content in the first video and the second video based on the first video information and the second video information; if the first video and the second video have repeated content, instructing the P2P client to continue providing data corresponding to the second video acquisition request; if the first video and the second video do not have repeated content, instructing the P2P client to provide data corresponding to the first video acquisition request;
and the P2P client is used for providing corresponding data according to the indication of the proxy module.
Optionally, the system further comprises:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring an index file corresponding to a data request if the data request sent by client equipment is received, and the index file comprises at least one video acquisition request;
the replacing module is used for replacing the original data server address in the index file by using a preset proxy module IP address and a preset port number;
and the sending module is used for sending the index file to the client equipment.
Optionally, the system further comprises:
a creation module configured to create a processing task corresponding to the index file based on the index file corresponding to the data request;
the searching module is used for searching an index file corresponding to a first video obtaining request if the first video obtaining request sent by client equipment is received, and processing the first video obtaining request by using a processing task corresponding to the index file.
Optionally, the agent module is further configured to:
determining a target download location based on the first video acquisition request;
and instructing the P2P client to adjust the current downloading position to the target downloading position so as to download the data corresponding to the first video acquisition request.
Optionally, the system further comprises:
and the P2P client switching module is configured to switch the P2P client providing data, so that the switched P2P client provides data corresponding to the second video acquisition request.
Optionally, the system further comprises:
and the network switching module is used for switching a network used in downloading data so that the P2P client provides data corresponding to the second video acquisition request by using the switched network.
In a third aspect, an electronic device is provided, which includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of the first aspect when executing a program stored in the memory.
In a fourth aspect, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when executed by a processor, the computer program implements the method steps of any of the first aspects.
In a fifth aspect, there is provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the data processing methods described above.
The embodiment of the application has the following beneficial effects:
the embodiment of the application provides a data processing method, a data processing system, electronic equipment and a storage medium, and receives a first video acquisition request sent by client equipment; if a second video acquisition request which is not processed exists currently, acquiring first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request; determining whether there is duplicate content in the first video and the second video based on the first video information and the second video information; if the first video and the second video have repeated content, instructing the P2P client to continue providing data corresponding to the second video acquisition request; and if the first video and the second video do not have repeated content, indicating the P2P client to provide data corresponding to the first video acquisition request.
That is, when a first video acquisition request sent by a client device is received, if an unprocessed second video acquisition request exists, whether the P2P client is instructed to process the first video acquisition request or process the second video acquisition request can be determined according to whether the first video and the second video have repeated content, so that the situation that the P2P client cannot confirm which video acquisition request is processed is avoided, and phenomena such as skip, pause, and incapability of playing in the process of playing videos by the conventional player are avoided.
Of course, not all advantages described above need to be achieved at the same time in the practice of any one product or method of the present application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a flowchart of a data processing method according to an embodiment of the present application;
fig. 2 is a flowchart of a data processing method according to another embodiment of the present application;
FIG. 3 is a schematic diagram of a data processing system according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Since video data is provided to the client device using the P2P network, it often happens that the previous data request is not processed and the next data request is continued. In this case, the P2P client cannot easily confirm which request should be processed, and a contradiction occurs between the processing of the current request and the processing of the next request, which may cause the client device to jump, pause, and fail to play the video. Therefore, the embodiment of the application provides a data processing method which can be applied to a proxy module.
A data processing method provided in the embodiments of the present application will be described in detail below with reference to specific embodiments, as shown in fig. 1, the specific steps are as follows:
s101, receiving a first video acquisition request sent by client equipment.
In the embodiment of the application, after receiving a video playing task specified by a user, a client device first obtains an index file corresponding to the video playing task, where the index file includes a plurality of video obtaining requests corresponding to the video playing task, where the video obtaining requests are generally Hypertext Transfer Protocol (HTTP) requests, and each video obtaining request is used for requesting a segment of video data corresponding to the video playing task. For example, the video playing task is a video of 30 minutes, the index file may include 3 video acquisition requests, a first video acquisition request is used to request a video of 0-10 minutes in the video playing task, a second video acquisition request is used to request a video of 10-20 minutes in the video playing task, and a third video acquisition request is used to request a video of 20-30 minutes in the video playing task.
Before playing the video, the client device sequentially sends a plurality of video acquisition requests in the index file to a proxy module to request corresponding video data, wherein the proxy module may be one of the client devices, and the proxy module may control the P2P client to provide the corresponding video data. After the client device obtains the video data, playing a corresponding video based on the video data.
Normally, each time the client device sends a video acquisition request, the proxy module receives the video acquisition request and controls the P2P client to provide data corresponding to the video acquisition request. However, sometimes a situation occurs in which, when a first video acquisition request sent by a client device is received, a P2P client is processing a second video acquisition request, and there are two main reasons for this: one is that the user modifies the video playing task to send a first video acquisition request, for example, the video playing task is a video of 30 minutes, the P2P client is processing a second video acquisition request and providing video data of 0-10 minutes, at this time, the user modifies the video playing task to start playing from the 20 th minute, and the client device sends the first video acquisition request for requesting video data of 20-30 minutes; another is that the system mechanism automatically sends the first video capture request, for example, the system mechanism defaults that the time for processing one video capture request by the P2P client is 10 seconds, the P2P client is processing the second video capture request and providing 0-10 minutes of video data, and the client device will send the first video capture request again for requesting 0-10 minutes of video data if it does not receive 0-10 minutes of video data for more than 10 seconds.
S102, if a second video acquisition request which is not processed exists currently, first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request are acquired.
In the embodiment of the present application, the first video information may be video data requested by the first video obtaining request, and the second video information may be video data requested by the second video obtaining request. After receiving the first video acquisition request, the agent module needs to first determine whether an unprocessed second video acquisition request exists at present in order to avoid processing conflicts, and if an unprocessed second video acquisition request exists at present, the agent module needs to determine the video acquisition request to be processed according to video data requested by the first video acquisition request and the second video acquisition request, so that first video information and second video information are acquired.
S103, determining whether the first video and the second video have repeated content based on the first video information and the second video information.
In the embodiment of the present application, it may be determined whether there is duplicate content in the first video and the second video based on the data start position and the data end position of the first video and the data start position and the data end position of the second video.
For example, in the same video, the data start position and the data end position of the first video are 10 to 20 seconds respectively, and the data start position and the data end position of the second video are 15 to 25 seconds respectively, it may be determined that the first video and the second video have the repetitive content, and the repetitive content is 15 to 20 seconds of data.
And S104, if the first video and the second video have repeated content, indicating the P2P client to continue to provide data corresponding to the second video acquisition request.
In the embodiment of the present application, if there is duplicate content in the first video and the second video, three situations are generally included: one is that the client device does not receive the video data within a preset time to resend the video acquisition request; one is that a problem occurs in the system mechanism, which causes the video acquisition request to be retransmitted; the other is that the misoperation of the user causes the video acquisition request to be sent again; resulting in a video acquisition request in which there is duplicate content, at which point it is determined to continue processing the second video acquisition request, instructing the P2P client to continue downloading data corresponding to the second video acquisition request.
And S105, if the first video and the second video do not have the repeated content, indicating the P2P client to provide data corresponding to the first video acquisition request.
In this embodiment of the present application, if there is no duplicate content in the first video and the second video, generally because the user modifies the playback task, at this time, the P2P client is instructed to determine to process the first video obtaining request and download the data corresponding to the first video obtaining request.
In the embodiment of the application, when a first video acquisition request sent by a client device is received, if an unprocessed second video acquisition request exists, whether the first video acquisition request is processed or the second video acquisition request is processed by an indication P2P client can be determined according to whether the first video and the second video have repeated content, so that the situation that the P2P client cannot confirm which video acquisition request is processed is avoided, and phenomena such as skip, pause, and incapability of playing in the process of playing videos by a conventional player are avoided.
In yet another embodiment of the present application, before the S101, the method may further include the steps of:
s201, if a data request sent by a client device is received, an index file corresponding to the data request is obtained, and the index file comprises at least one video obtaining request.
In the embodiment of the present application, the index file is a video index file, for example, an M3U8 file, and the index file corresponding to the data request includes at least one video acquisition request corresponding to the data request. The client device plays a segment of video, and at least one video acquisition request needs to be sequentially sent based on the index file to request corresponding data, and the corresponding data can be played only after being obtained. Under normal conditions, the client device sends a data request to the CDN server, in this embodiment of the present application, after the client device sends the data request, the proxy module may receive the data request, and when receiving the data request sent by the client device, may obtain an index file corresponding to the data request.
S202, replacing the original data server address in the index file by using the preset proxy module IP address and the port number.
In the embodiment of the application, after the index file corresponding to the data request is acquired, the proxy module replaces the original data server address in the index file by using the preset proxy module IP address and the port number.
S203, sending the index file to the client device.
In the embodiment of the application, the index file with the address replaced is sent to the client device, and when the subsequent client device sends the video acquisition request based on the index file, the video acquisition request can be sent to the proxy module according to the address after replacement.
In the embodiment of the application, if a data request sent by client equipment is received, an index file corresponding to the data request is acquired, wherein the index file comprises at least one video acquisition request; replacing the original data server address in the index file by using a preset proxy module IP address and a preset port number; and sending the index file to the client equipment. According to the scheme, the address of the video acquisition request sent by the client device can be changed, the video acquisition request is processed by the proxy module, and the data for playing the video is acquired by matching with the P2P client, so that the bandwidth consumption of the CDN server is reduced.
In yet another embodiment of the present application, the method may further comprise the steps of:
step one, if a data request sent by client equipment is received, a processing task corresponding to an index file is created based on the index file corresponding to the data request.
In the embodiment of the application, when the client device receives a play task, a data request is sent for the play task, and each data request corresponds to an index file. If a data request sent by the client device is received, a processing task corresponding to an index file corresponding to the data request may be created in the proxy module based on the index file. Therefore, when the client device receives a plurality of playback tasks, the agent module creates a corresponding processing task for each playback task, as shown in fig. 3, tasks 1 and 2 … … n are all processing tasks, and the task management includes a plurality of processing tasks.
And step two, if a first video acquisition request sent by client equipment is received, searching an index file corresponding to the first video acquisition request, and processing the first video acquisition request by using a processing task corresponding to the index file.
In the embodiment of the application, if a first video acquisition request sent by a client device is received, an index file corresponding to the first video acquisition request is searched first, and then the first video acquisition request is processed by using a processing task corresponding to the index file. That is, when the client device has a plurality of playback tasks, the client device allocates each first video acquisition request sent by each playback task to the processing task corresponding to the playback task for processing, as shown in fig. 3, each processing task is responsible for processing its corresponding video acquisition request.
In the embodiment of the application, a processing task is created for each play task of each client device, and the first video acquisition request corresponding to the play task is processed by using the processing task corresponding to the play task, so that the processing efficiency of each play task can be improved.
In another embodiment of the present application, the S105 may include the following steps:
step one, a target downloading position is determined based on the first video acquisition request.
In this embodiment of the application, the first video obtaining request includes a download position of the first video requested by the first video obtaining request, and therefore, the agent module may determine the target download position based on the first video obtaining request.
And step two, instructing the P2P client to adjust the current downloading position to the target downloading position, so as to download the data corresponding to the first video acquisition request.
In this embodiment, after determining the target download location, the proxy module may instruct the P2P client to adjust the current download location to the target download location to download the data corresponding to the first video acquisition request.
In this embodiment, when the user modifies the playback task, for example, fast forwards for a while, the proxy module may determine a target download position based on the first video capture request, and then instruct the P2P client to adjust the current download position to the target download position, so as to download the data corresponding to the first video capture request. Therefore, the downloading position is quickly adjusted to match the requirements of the user.
In yet another embodiment of the present application, the method may further comprise the steps of:
and if the first video and the second video have repeated content, switching the P2P client providing data so that the switched P2P client provides data corresponding to the second video acquisition request.
In the embodiment of the application, if there is duplicate content in the first video and the second video, it is considered that the client device cannot receive the result in a period of time, and the video acquisition request is retransmitted, at this time, the P2P client is instructed to switch the P2P client providing data, so as to speed up downloading of data corresponding to the second video acquisition request, and avoid that the processing efficiency of the second video acquisition request is too low, which affects the viewing experience of the user.
In yet another embodiment of the present application, the method may further comprise the steps of:
and if the first video and the second video have repeated content, switching a network used for downloading data so that the P2P client provides data corresponding to the second video acquisition request by using the switched network.
In the embodiment of the application, if the first video and the second video have the repeated content, the P2P client may be further instructed to switch the network used when downloading the data, so as to speed up downloading of the data corresponding to the second video acquisition request, and avoid that the processing efficiency of the second video acquisition request is too low, which affects the viewing experience of the user.
In yet another embodiment of the present application, the method may further comprise the steps of:
step one, if the first video and the second video have repeated content, judging whether the first video and the second video are completely repeated.
In the embodiment of the application, if the first video and the second video have repeated content, whether the first video acquisition request and the second video acquisition request are the same video acquisition request is judged by judging whether the first video and the second video are all repeated.
And if the first video and the second video are completely repeated, after the data corresponding to the second video acquisition request downloaded by the P2P client is acquired, replying a first message to the client device, where the first message is used to notify the client device that the processing of the first video acquisition request and the processing of the second video acquisition request have been completed.
In this embodiment of the application, if the first video and the second video are completely repeated, it indicates that the first video acquisition request and the second video acquisition request are the same video acquisition request, at this time, after the data corresponding to the second video acquisition request that is downloaded by the P2P client is acquired, the proxy module replies to the client device for the video acquisition request, and the content of the reply is that the processing of the first video acquisition request and the processing of the second video acquisition request are completed.
In the embodiment of the application, if the first video and the second video are completely repeated, it indicates that the first video acquisition request and the second video acquisition request are the same video acquisition request, and when the processing of the second video acquisition request is completed, the client device is notified that the processing of the first video acquisition request and the processing of the second video acquisition request are completed. The unprocessed video acquisition requests reserved in the client equipment are reduced, and resources are occupied.
In yet another embodiment of the present application, the method may further comprise the steps of:
step one, if the first video and the second video are repeated, after data corresponding to the second video obtaining request downloaded by the P2P client is obtained, replying a second message to the client device, where the second message is used to notify the client device that the processing of the second video obtaining request is completed.
In this embodiment of the application, if the first video and the second video are partially repeated, it indicates that the first video acquisition request and the second video acquisition request are not the same video acquisition request. At this time, after the P2P client downloads the completed data corresponding to the second video acquisition request, a second message is replied to the client device, where the second message is used to notify the client device that the processing of the second video acquisition request is completed.
In the embodiment of the application, if the first video and the second video are partially repeated, it indicates that the first video acquisition request and the second video acquisition request are not the same video acquisition request, and when the processing of the second video acquisition request is completed, the client device is notified that the processing of the second video acquisition request is completed. The unprocessed video acquisition requests reserved in the client equipment are reduced, and resources are occupied.
In the embodiment of the application, when a first video acquisition request sent by a client device is received, if an unprocessed second video acquisition request exists, whether the first video acquisition request is processed or the second video acquisition request is processed by an indication P2P client can be determined according to whether the first video and the second video have repeated content, so that the situation that the P2P client cannot confirm which video acquisition request is processed is avoided, and phenomena such as skip, pause, and incapability of playing in the process of playing videos by a conventional player are avoided.
Based on the same technical concept, an embodiment of the present application further provides a data processing system, as shown in fig. 3, the apparatus system includes: client devices, proxy modules and P2P clients;
the client device is used for sending a first video acquisition request to the agent module;
the proxy module is used for receiving a first video acquisition request sent by client equipment; if a second video acquisition request which is not processed exists currently, acquiring first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request; determining whether there is duplicate content in the first video and the second video based on the first video information and the second video information; if the first video and the second video have repeated content, instructing the P2P client to continue providing data corresponding to the second video acquisition request; if the first video and the second video do not have repeated content, instructing the P2P client to provide data corresponding to the first video acquisition request;
and the P2P client is used for providing corresponding data according to the indication of the proxy module.
Optionally, the system further comprises:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring an index file corresponding to a data request if the data request sent by client equipment is received, and the index file comprises at least one video acquisition request;
the replacing module is used for replacing the original data server address in the index file by using a preset proxy module IP address and a preset port number;
and the sending module is used for sending the index file to the client equipment.
Optionally, the system further comprises:
a creation module configured to create a processing task corresponding to the index file based on the index file corresponding to the data request;
the searching module is used for searching an index file corresponding to a first video obtaining request if the first video obtaining request sent by client equipment is received, and processing the first video obtaining request by using a processing task corresponding to the index file.
Optionally, the agent module is further configured to:
determining a target download location based on the first video acquisition request;
and instructing the P2P client to adjust the current downloading position to the target downloading position so as to download the data corresponding to the first video acquisition request.
Optionally, the system further comprises:
and the P2P client switching module is configured to switch the P2P client providing data, so that the switched P2P client provides data corresponding to the second video acquisition request.
Optionally, the system further comprises:
and the network switching module is used for switching a network used in downloading data so that the P2P client provides data corresponding to the second video acquisition request by using the switched network.
In the embodiment of the application, when a first video acquisition request sent by a client device is received, if an unprocessed second video acquisition request exists, whether the first video acquisition request is processed or the second video acquisition request is processed by an indication P2P client can be determined according to whether the first video and the second video have repeated content, so that the situation that the P2P client cannot confirm which video acquisition request is processed is avoided, and phenomena such as skip, pause, and incapability of playing in the process of playing videos by a conventional player are avoided.
Based on the same technical concept, the embodiment of the present invention further provides an electronic device, as shown in fig. 4, including a processor 401, a communication interface 402, a memory 403 and a communication bus 404, where the processor 401, the communication interface 402, and the memory 403 complete mutual communication through the communication bus 404,
a memory 403 for storing a computer program;
the processor 401, when executing the program stored in the memory 403, implements the following steps:
receiving a first video acquisition request sent by client equipment;
if a second video acquisition request which is not processed exists currently, acquiring first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request;
determining whether there is duplicate content in the first video and the second video based on the first video information and the second video information;
if the first video and the second video have repeated content, instructing the P2P client to continue providing data corresponding to the second video acquisition request;
and if the first video and the second video do not have repeated content, indicating the P2P client to provide data corresponding to the first video acquisition request.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In yet another embodiment provided by the present invention, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program realizes the steps of any of the above data processing methods when executed by a processor.
In a further embodiment, the present invention also provides a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the data processing methods of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing are merely exemplary embodiments of the present invention, which enable those skilled in the art to understand or practice the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (9)

1. A method of data processing, the method comprising:
receiving a first video acquisition request sent by client equipment;
if a second video acquisition request which is not processed exists currently, acquiring first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request;
determining whether there is duplicate content in the first video and the second video based on the first video information and the second video information;
if the first video and the second video have repeated content, instructing the P2P client to continue providing data corresponding to the second video acquisition request;
and if the first video and the second video do not have repeated content, indicating the P2P client to provide data corresponding to the first video acquisition request.
2. The method of claim 1, wherein before receiving the first video acquisition request sent by the client device, the method further comprises:
if a data request sent by client equipment is received, acquiring an index file corresponding to the data request, wherein the index file comprises at least one video acquisition request;
replacing the original data server address in the index file by using a preset proxy module IP address and a preset port number;
and sending the index file to the client equipment.
3. The method of claim 2, wherein if a data request sent by a client device is received, the method further comprises:
creating a processing task corresponding to the index file based on the index file corresponding to the data request;
if a first video acquisition request sent by client equipment is received, searching an index file corresponding to the first video acquisition request, and processing the first video acquisition request by using a processing task corresponding to the index file.
4. The method of claim 1, wherein instructing the P2P client to provide data corresponding to the first video retrieval request comprises:
determining a target download location based on the first video acquisition request;
and instructing the P2P client to adjust the current downloading position to the target downloading position so as to download the data corresponding to the first video acquisition request.
5. The method of claim 1, wherein if there is duplicate content in the first video and the second video, the method further comprises:
switching the P2P client providing data so that the switched P2P client provides data corresponding to the second video acquisition request.
6. The method of claim 1, wherein if there is duplicate content in the first video and the second video, the method further comprises:
and switching the network used for downloading the data, so that the P2P client provides the data corresponding to the second video acquisition request by using the switched network.
7. A data processing system, characterized in that the system comprises: client devices, proxy modules and P2P clients;
the client device is used for sending a first video acquisition request to the agent module;
the proxy module is used for receiving a first video acquisition request sent by client equipment; if a second video acquisition request which is not processed exists currently, acquiring first video information corresponding to the first video acquisition request and second video information corresponding to the second video acquisition request; determining whether there is duplicate content in the first video and the second video based on the first video information and the second video information; if the first video and the second video have repeated content, instructing the P2P client to continue providing data corresponding to the second video acquisition request; if the first video and the second video do not have repeated content, instructing the P2P client to provide data corresponding to the first video acquisition request;
and the P2P client is used for providing corresponding data according to the indication of the proxy module.
8. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of claims 1-6 when executing a program stored in the memory.
9. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 6.
CN202110390541.XA 2021-04-12 2021-04-12 Data processing method, system, electronic equipment and storage medium Active CN113271475B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110390541.XA CN113271475B (en) 2021-04-12 2021-04-12 Data processing method, system, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110390541.XA CN113271475B (en) 2021-04-12 2021-04-12 Data processing method, system, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN113271475A true CN113271475A (en) 2021-08-17
CN113271475B CN113271475B (en) 2023-01-10

Family

ID=77228669

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110390541.XA Active CN113271475B (en) 2021-04-12 2021-04-12 Data processing method, system, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113271475B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080133767A1 (en) * 2006-11-22 2008-06-05 Metis Enterprise Technologies Llc Real-time multicast peer-to-peer video streaming platform
US20080320476A1 (en) * 2007-06-25 2008-12-25 Sonics, Inc. Various methods and apparatus to support outstanding requests to multiple targets while maintaining transaction ordering
CN101345768A (en) * 2008-08-15 2009-01-14 南京邮电大学 Peer-to-peer network transmission method of music demand system
CN101515892A (en) * 2009-04-10 2009-08-26 华为技术有限公司 Method for realizing multi-resource processing in peer-to-peer network, equipment and system thereof
US20110131278A1 (en) * 2008-05-23 2011-06-02 Jason Nieh Systems and methods for peer-to-peer bandwidth allocation
CN102685232A (en) * 2012-05-14 2012-09-19 安科智慧城市技术(中国)有限公司 Streaming media server-based multimedia file acquisition method and streaming media server
CN103581693A (en) * 2013-11-12 2014-02-12 北京清源新创科技有限公司 Internet-oriented large-scale live time shifting method and system based on fragment transmission
CN103686198A (en) * 2013-12-30 2014-03-26 优视科技有限公司 Video data processing method, device and system
CN105681874A (en) * 2015-06-02 2016-06-15 深圳Tcl数字技术有限公司 Network video online playing method and device
WO2017035795A1 (en) * 2015-09-01 2017-03-09 深圳好视网络科技有限公司 Method and device for transmitting streaming media data
CN106572358A (en) * 2016-11-11 2017-04-19 青岛海信宽带多媒体技术有限公司 Live broadcast time shift method and client
US20170164020A1 (en) * 2015-12-08 2017-06-08 Le Holdings (Beijing) Co., Ltd. Content delivery method for content delivery network platform and scheduling proxy server
CN107135249A (en) * 2017-04-06 2017-09-05 腾讯科技(深圳)有限公司 Data download method and device
CN111277869A (en) * 2020-02-14 2020-06-12 腾讯科技(深圳)有限公司 Video playing method, device, equipment and storage medium

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080133767A1 (en) * 2006-11-22 2008-06-05 Metis Enterprise Technologies Llc Real-time multicast peer-to-peer video streaming platform
US20080320476A1 (en) * 2007-06-25 2008-12-25 Sonics, Inc. Various methods and apparatus to support outstanding requests to multiple targets while maintaining transaction ordering
US20110131278A1 (en) * 2008-05-23 2011-06-02 Jason Nieh Systems and methods for peer-to-peer bandwidth allocation
CN101345768A (en) * 2008-08-15 2009-01-14 南京邮电大学 Peer-to-peer network transmission method of music demand system
CN101515892A (en) * 2009-04-10 2009-08-26 华为技术有限公司 Method for realizing multi-resource processing in peer-to-peer network, equipment and system thereof
CN102685232A (en) * 2012-05-14 2012-09-19 安科智慧城市技术(中国)有限公司 Streaming media server-based multimedia file acquisition method and streaming media server
CN103581693A (en) * 2013-11-12 2014-02-12 北京清源新创科技有限公司 Internet-oriented large-scale live time shifting method and system based on fragment transmission
CN103686198A (en) * 2013-12-30 2014-03-26 优视科技有限公司 Video data processing method, device and system
CN105681874A (en) * 2015-06-02 2016-06-15 深圳Tcl数字技术有限公司 Network video online playing method and device
WO2017035795A1 (en) * 2015-09-01 2017-03-09 深圳好视网络科技有限公司 Method and device for transmitting streaming media data
US20170164020A1 (en) * 2015-12-08 2017-06-08 Le Holdings (Beijing) Co., Ltd. Content delivery method for content delivery network platform and scheduling proxy server
CN106572358A (en) * 2016-11-11 2017-04-19 青岛海信宽带多媒体技术有限公司 Live broadcast time shift method and client
CN107135249A (en) * 2017-04-06 2017-09-05 腾讯科技(深圳)有限公司 Data download method and device
CN111277869A (en) * 2020-02-14 2020-06-12 腾讯科技(深圳)有限公司 Video playing method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN113271475B (en) 2023-01-10

Similar Documents

Publication Publication Date Title
CN107566786B (en) Method and device for acquiring monitoring video and terminal equipment
US9608957B2 (en) Request routing using network computing components
CN110324434B (en) Domain name resolution method, client, server and electronic equipment
US9727579B2 (en) Systems and methods for storing digital content
CN110247985B (en) Resource downloading method and device, electronic equipment and medium
US20090222515A1 (en) Methods and apparatus for transferring data
CN111355971B (en) Live streaming transmission method and device, CDN server and computer readable medium
CN112787936B (en) Play failure recovery method, device and storage medium under IPv4/IPv6 dual-stack environment
CN110213653B (en) Method and device for playing video
CN109982152A (en) P2P CDN method for processing business, intelligent gateway and CDN platform
CN110944220A (en) Video screen projection playing method, device, equipment and system
CN113709530A (en) Resource downloading method, system, electronic equipment and storage medium
CN113572750B (en) Video data transmission method and device
CN110312140B (en) Live broadcast data processing method, device and system and computer readable storage medium
CN113556618B (en) Data transmission method and device
CN110958279B (en) Data processing method and device
CN102025782A (en) Point-to-point communication method, device and system
CN112769671B (en) Message processing method, device and system
CN113271475B (en) Data processing method, system, electronic equipment and storage medium
JP2015230731A (en) Method for operating cache arranged along transmission path between client terminal and at least one server, and corresponding cache
CN113285920B (en) Service access method, device, equipment and storage medium
US8832281B2 (en) Utilizing resources of a peer-to-peer computer environment
CN111400327B (en) Data synchronization method and device, electronic equipment and storage medium
CN114398659A (en) Resource checking method, device, equipment and storage medium
CN115412777A (en) Streaming media data transmission method, device and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant